-- Logs begin at Wed 2021-11-24 16:02:23 UTC, end at Wed 2021-11-24 17:20:55 UTC. -- Nov 24 16:28:48.223376 dv-cinder-818778-2-iscsi systemd[1]: Starting Devstack devstack@keystone.service... Nov 24 16:28:48.231955 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: [uWSGI] getting INI configuration from /etc/keystone/keystone-uwsgi-public.ini Nov 24 16:28:48.232373 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: open("./http_plugin.so"): No such file or directory [core/utils.c line 3732] Nov 24 16:28:48.232373 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: !!! UNABLE to load uWSGI plugin: ./http_plugin.so: cannot open shared object file: No such file or directory !!! Nov 24 16:28:48.232373 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: open("./python3_plugin.so"): No such file or directory [core/utils.c line 3732] Nov 24 16:28:48.232373 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: !!! UNABLE to load uWSGI plugin: ./python3_plugin.so: cannot open shared object file: No such file or directory !!! Nov 24 16:28:48.232373 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: *** Starting uWSGI 2.0.20 (64bit) on [Wed Nov 24 16:28:48 2021] *** Nov 24 16:28:48.232373 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: compiled with version: 7.5.0 on 24 November 2021 16:24:00 Nov 24 16:28:48.232373 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: os: Linux-4.15.0-55-generic #60-Ubuntu SMP Tue Jul 2 18:22:20 UTC 2019 Nov 24 16:28:48.232373 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: nodename: dv-cinder-818778-2-iscsi Nov 24 16:28:48.232373 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: machine: x86_64 Nov 24 16:28:48.232373 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: clock source: unix Nov 24 16:28:48.232373 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: pcre jit disabled Nov 24 16:28:48.232373 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: detected number of CPU cores: 4 Nov 24 16:28:48.232373 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: current working directory: / Nov 24 16:28:48.232373 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: detected binary path: /usr/local/bin/uwsgi Nov 24 16:28:48.232373 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: your processes number limit is 47843 Nov 24 16:28:48.232373 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: your memory page size is 4096 bytes Nov 24 16:28:48.232373 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: detected max file descriptor number: 2048 Nov 24 16:28:48.232373 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: lock engine: pthread robust mutexes Nov 24 16:28:48.232373 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: thunder lock: enabled Nov 24 16:28:48.233824 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: uwsgi socket 0 bound to UNIX address /var/run/uwsgi/keystone-wsgi-public.socket fd 4 Nov 24 16:28:48.233824 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: Python version: 3.6.9 (default, Jan 26 2021, 15:33:00) [GCC 8.4.0] Nov 24 16:28:48.278820 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: Python main interpreter initialized at 0x55b755fa15f0 Nov 24 16:28:48.278820 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: python threads support enabled Nov 24 16:28:48.278820 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: your server socket listen backlog is limited to 100 connections Nov 24 16:28:48.278820 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: your mercy for graceful operations on workers is 90 seconds Nov 24 16:28:48.279178 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: mapped 403077 bytes (393 KB) for 2 cores Nov 24 16:28:48.279178 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: *** Operational MODE: preforking *** Nov 24 16:28:48.279496 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: *** uWSGI is running in multiple interpreter mode *** Nov 24 16:28:48.279496 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: spawned uWSGI master process (pid: 71937) Nov 24 16:28:48.279695 dv-cinder-818778-2-iscsi systemd[1]: Started Devstack devstack@keystone.service. Nov 24 16:28:48.280093 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: spawned uWSGI worker 1 (pid: 71938, cores: 1) Nov 24 16:28:48.280245 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: spawned uWSGI worker 2 (pid: 71939, cores: 1) Nov 24 16:28:48.280569 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: running "unix_signal:15 gracefully_kill_them_all" (master-start)... Nov 24 16:28:51.228995 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=71939) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2567}} Nov 24 16:28:51.229474 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG uwsgi [-] Configuration options gathered from: {{(pid=71939) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2568}} Nov 24 16:28:51.229562 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=71938) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2567}} Nov 24 16:28:51.229781 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG uwsgi [-] Configuration options gathered from: {{(pid=71938) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2568}} Nov 24 16:28:51.230300 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG uwsgi [-] command line args: [] {{(pid=71939) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2569}} Nov 24 16:28:51.230628 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG uwsgi [-] config files: ['/etc/keystone/keystone.conf'] {{(pid=71939) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2571}} Nov 24 16:28:51.230849 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG uwsgi [-] ================================================================================ {{(pid=71939) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2572}} Nov 24 16:28:51.231072 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG uwsgi [-] command line args: [] {{(pid=71938) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2569}} Nov 24 16:28:51.231188 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG uwsgi [-] admin_token = **** {{(pid=71939) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Nov 24 16:28:51.231282 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG uwsgi [-] config files: ['/etc/keystone/keystone.conf'] {{(pid=71938) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2571}} Nov 24 16:28:51.231376 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG uwsgi [-] config_dir = [] {{(pid=71939) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Nov 24 16:28:51.231476 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG uwsgi [-] ================================================================================ {{(pid=71938) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2572}} Nov 24 16:28:51.231570 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG uwsgi [-] config_file = ['/etc/keystone/keystone.conf'] {{(pid=71939) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Nov 24 16:28:51.231662 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG uwsgi [-] admin_token = **** {{(pid=71938) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Nov 24 16:28:51.231761 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG uwsgi [-] config_source = [] {{(pid=71939) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Nov 24 16:28:51.231909 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG uwsgi [-] config_dir = [] {{(pid=71938) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Nov 24 16:28:51.232004 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG uwsgi [-] debug = True {{(pid=71939) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Nov 24 16:28:51.232135 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG uwsgi [-] config_file = ['/etc/keystone/keystone.conf'] {{(pid=71938) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Nov 24 16:28:51.232250 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG uwsgi [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'dogpile=INFO', 'routes=INFO'] {{(pid=71939) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Nov 24 16:28:51.232465 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG uwsgi [-] config_source = [] {{(pid=71938) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Nov 24 16:28:51.232539 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG uwsgi [-] default_publisher_id = None {{(pid=71939) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Nov 24 16:28:51.232606 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG uwsgi [-] debug = True {{(pid=71938) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Nov 24 16:28:51.232673 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG uwsgi [-] insecure_debug = False {{(pid=71939) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Nov 24 16:28:51.232804 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG uwsgi [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'dogpile=INFO', 'routes=INFO'] {{(pid=71938) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Nov 24 16:28:51.232883 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG uwsgi [-] instance_format = [instance: %(uuid)s] {{(pid=71939) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Nov 24 16:28:51.233110 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG uwsgi [-] default_publisher_id = None {{(pid=71938) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Nov 24 16:28:51.233204 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG uwsgi [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=71939) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Nov 24 16:28:51.233274 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG uwsgi [-] insecure_debug = False {{(pid=71938) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Nov 24 16:28:51.233344 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG uwsgi [-] list_limit = None {{(pid=71939) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Nov 24 16:28:51.233413 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG uwsgi [-] instance_format = [instance: %(uuid)s] {{(pid=71938) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Nov 24 16:28:51.233480 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG uwsgi [-] log_config_append = None {{(pid=71939) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Nov 24 16:28:51.233669 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG uwsgi [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=71939) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Nov 24 16:28:51.233754 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG uwsgi [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=71938) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Nov 24 16:28:51.233823 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG uwsgi [-] log_dir = None {{(pid=71939) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Nov 24 16:28:51.233973 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG uwsgi [-] list_limit = None {{(pid=71938) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Nov 24 16:28:51.234091 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG uwsgi [-] log_file = None {{(pid=71939) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Nov 24 16:28:51.234165 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG uwsgi [-] log_config_append = None {{(pid=71938) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Nov 24 16:28:51.234313 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG uwsgi [-] log_rotate_interval = 1 {{(pid=71939) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Nov 24 16:28:51.234396 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG uwsgi [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=71938) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Nov 24 16:28:51.234532 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG uwsgi [-] log_dir = None {{(pid=71938) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Nov 24 16:28:51.234648 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG uwsgi [-] log_rotate_interval_type = days {{(pid=71939) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Nov 24 16:28:51.234738 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG uwsgi [-] log_file = None {{(pid=71938) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Nov 24 16:28:51.234829 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG uwsgi [-] log_rotation_type = none {{(pid=71939) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Nov 24 16:28:51.234921 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG uwsgi [-] log_rotate_interval = 1 {{(pid=71938) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Nov 24 16:28:51.235064 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG uwsgi [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=71939) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Nov 24 16:28:51.235170 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG uwsgi [-] log_rotate_interval_type = days {{(pid=71938) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Nov 24 16:28:51.235263 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG uwsgi [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=71939) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Nov 24 16:28:51.235433 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG uwsgi [-] log_rotation_type = none {{(pid=71938) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Nov 24 16:28:51.235531 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG uwsgi [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=71939) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Nov 24 16:28:51.235710 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG uwsgi [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=71939) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Nov 24 16:28:51.235814 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG uwsgi [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=71938) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Nov 24 16:28:51.235903 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG uwsgi [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=71938) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Nov 24 16:28:51.235995 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG uwsgi [-] logging_user_identity_format = %(user)s %(tenant)s %(domain)s %(user_domain)s %(project_domain)s {{(pid=71939) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Nov 24 16:28:51.236090 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG uwsgi [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=71938) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Nov 24 16:28:51.236222 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG uwsgi [-] max_logfile_count = 30 {{(pid=71939) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Nov 24 16:28:51.236315 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG uwsgi [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=71938) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Nov 24 16:28:51.236481 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG uwsgi [-] max_logfile_size_mb = 200 {{(pid=71939) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Nov 24 16:28:51.236581 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG uwsgi [-] logging_user_identity_format = %(user)s %(tenant)s %(domain)s %(user_domain)s %(project_domain)s {{(pid=71938) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Nov 24 16:28:51.236739 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG uwsgi [-] max_param_size = 64 {{(pid=71939) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Nov 24 16:28:51.236831 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG uwsgi [-] max_logfile_count = 30 {{(pid=71938) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Nov 24 16:28:51.236995 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG uwsgi [-] max_project_tree_depth = 5 {{(pid=71939) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Nov 24 16:28:51.237093 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG uwsgi [-] max_logfile_size_mb = 200 {{(pid=71938) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Nov 24 16:28:51.237248 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG uwsgi [-] max_token_size = 16384 {{(pid=71939) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Nov 24 16:28:51.237339 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG uwsgi [-] max_param_size = 64 {{(pid=71938) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Nov 24 16:28:51.237525 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG uwsgi [-] notification_format = cadf {{(pid=71939) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Nov 24 16:28:51.237617 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG uwsgi [-] max_project_tree_depth = 5 {{(pid=71938) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Nov 24 16:28:51.237806 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG uwsgi [-] max_token_size = 16384 {{(pid=71938) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Nov 24 16:28:51.237898 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG uwsgi [-] notification_opt_out = ['identity.authenticate.success', 'identity.authenticate.pending', 'identity.authenticate.failed'] {{(pid=71939) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Nov 24 16:28:51.238121 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG uwsgi [-] notification_format = cadf {{(pid=71938) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Nov 24 16:28:51.238433 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG uwsgi [-] public_endpoint = http://10.222.0.53/identity {{(pid=71939) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Nov 24 16:28:51.238540 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG uwsgi [-] notification_opt_out = ['identity.authenticate.success', 'identity.authenticate.pending', 'identity.authenticate.failed'] {{(pid=71938) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Nov 24 16:28:51.238628 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG uwsgi [-] publish_errors = False {{(pid=71939) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Nov 24 16:28:51.238875 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG uwsgi [-] pydev_debug_host = None {{(pid=71939) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Nov 24 16:28:51.239012 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG uwsgi [-] public_endpoint = http://10.222.0.53/identity {{(pid=71938) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Nov 24 16:28:51.239113 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG uwsgi [-] pydev_debug_port = None {{(pid=71939) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Nov 24 16:28:51.239200 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG uwsgi [-] publish_errors = False {{(pid=71938) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Nov 24 16:28:51.239286 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG uwsgi [-] rate_limit_burst = 0 {{(pid=71939) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Nov 24 16:28:51.239459 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG uwsgi [-] pydev_debug_host = None {{(pid=71938) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Nov 24 16:28:51.239557 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG uwsgi [-] rate_limit_except_level = CRITICAL {{(pid=71939) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Nov 24 16:28:51.239716 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG uwsgi [-] pydev_debug_port = None {{(pid=71938) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Nov 24 16:28:51.239820 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG uwsgi [-] rate_limit_interval = 0 {{(pid=71939) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Nov 24 16:28:51.239913 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG uwsgi [-] rate_limit_burst = 0 {{(pid=71938) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Nov 24 16:28:51.240001 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG uwsgi [-] standard_threads = False {{(pid=71939) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Nov 24 16:28:51.240181 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG uwsgi [-] rate_limit_except_level = CRITICAL {{(pid=71938) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Nov 24 16:28:51.240273 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG uwsgi [-] strict_password_check = False {{(pid=71939) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Nov 24 16:28:51.240446 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG uwsgi [-] rate_limit_interval = 0 {{(pid=71938) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Nov 24 16:28:51.240540 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG uwsgi [-] syslog_log_facility = LOG_USER {{(pid=71939) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Nov 24 16:28:51.240672 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG uwsgi [-] use_eventlog = False {{(pid=71939) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Nov 24 16:28:51.240766 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG uwsgi [-] standard_threads = False {{(pid=71938) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Nov 24 16:28:51.240853 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG uwsgi [-] use_journal = False {{(pid=71939) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Nov 24 16:28:51.240938 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG uwsgi [-] strict_password_check = False {{(pid=71938) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Nov 24 16:28:51.241037 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG uwsgi [-] use_json = False {{(pid=71939) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Nov 24 16:28:51.241190 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG uwsgi [-] syslog_log_facility = LOG_USER {{(pid=71938) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Nov 24 16:28:51.241293 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG uwsgi [-] use_stderr = False {{(pid=71939) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Nov 24 16:28:51.241497 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG uwsgi [-] use_eventlog = False {{(pid=71938) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Nov 24 16:28:51.241593 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG uwsgi [-] use_syslog = False {{(pid=71939) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Nov 24 16:28:51.241686 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG uwsgi [-] use_journal = False {{(pid=71938) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Nov 24 16:28:51.241773 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG uwsgi [-] watch_log_file = False {{(pid=71939) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Nov 24 16:28:51.241865 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG uwsgi [-] use_json = False {{(pid=71938) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Nov 24 16:28:51.241959 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG uwsgi [-] oslo_concurrency.disable_process_locking = False {{(pid=71939) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Nov 24 16:28:51.242073 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG uwsgi [-] use_stderr = False {{(pid=71938) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Nov 24 16:28:51.242165 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG uwsgi [-] oslo_concurrency.lock_path = None {{(pid=71939) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Nov 24 16:28:51.242251 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG uwsgi [-] use_syslog = False {{(pid=71938) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Nov 24 16:28:51.242394 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG uwsgi [-] watch_log_file = False {{(pid=71938) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Nov 24 16:28:51.242500 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG uwsgi [-] profiler.connection_string = messaging:// {{(pid=71939) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Nov 24 16:28:51.242654 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG uwsgi [-] profiler.enabled = False {{(pid=71939) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Nov 24 16:28:51.242752 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG uwsgi [-] oslo_concurrency.disable_process_locking = False {{(pid=71938) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Nov 24 16:28:51.242915 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG uwsgi [-] oslo_concurrency.lock_path = None {{(pid=71938) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Nov 24 16:28:51.243014 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG uwsgi [-] profiler.es_doc_type = notification {{(pid=71939) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Nov 24 16:28:51.243173 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG uwsgi [-] profiler.es_scroll_size = 10000 {{(pid=71939) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Nov 24 16:28:51.243271 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG uwsgi [-] profiler.connection_string = messaging:// {{(pid=71938) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Nov 24 16:28:51.243452 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG uwsgi [-] profiler.es_scroll_time = 2m {{(pid=71939) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Nov 24 16:28:51.243546 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG uwsgi [-] profiler.enabled = False {{(pid=71938) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Nov 24 16:28:51.243713 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG uwsgi [-] profiler.filter_error_trace = False {{(pid=71939) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Nov 24 16:28:51.243807 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG uwsgi [-] profiler.es_doc_type = notification {{(pid=71938) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Nov 24 16:28:51.243972 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG uwsgi [-] profiler.es_scroll_size = 10000 {{(pid=71938) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Nov 24 16:28:51.244070 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG uwsgi [-] profiler.hmac_keys = SECRET_KEY {{(pid=71939) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Nov 24 16:28:51.244245 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG uwsgi [-] profiler.sentinel_service_name = mymaster {{(pid=71939) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Nov 24 16:28:51.244339 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG uwsgi [-] profiler.es_scroll_time = 2m {{(pid=71938) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Nov 24 16:28:51.244501 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG uwsgi [-] profiler.filter_error_trace = False {{(pid=71938) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Nov 24 16:28:51.244602 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG uwsgi [-] profiler.socket_timeout = 0.1 {{(pid=71939) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Nov 24 16:28:51.244754 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG uwsgi [-] profiler.trace_sqlalchemy = False {{(pid=71939) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Nov 24 16:28:51.244846 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG uwsgi [-] profiler.hmac_keys = SECRET_KEY {{(pid=71938) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Nov 24 16:28:51.245037 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG uwsgi [-] profiler.sentinel_service_name = mymaster {{(pid=71938) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Nov 24 16:28:51.245130 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG uwsgi [-] audit.namespace = openstack {{(pid=71939) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Nov 24 16:28:51.245309 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG uwsgi [-] keystone_authtoken.admin_password = **** {{(pid=71939) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Nov 24 16:28:51.245456 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG uwsgi [-] profiler.socket_timeout = 0.1 {{(pid=71938) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Nov 24 16:28:51.245586 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG uwsgi [-] profiler.trace_sqlalchemy = False {{(pid=71938) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Nov 24 16:28:51.245714 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG uwsgi [-] keystone_authtoken.admin_tenant_name = admin {{(pid=71939) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Nov 24 16:28:51.245842 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG uwsgi [-] keystone_authtoken.admin_token = **** {{(pid=71939) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Nov 24 16:28:51.245970 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG uwsgi [-] audit.namespace = openstack {{(pid=71938) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Nov 24 16:28:51.246119 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG uwsgi [-] keystone_authtoken.admin_user = None {{(pid=71939) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Nov 24 16:28:51.246261 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG uwsgi [-] keystone_authtoken.admin_password = **** {{(pid=71938) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Nov 24 16:28:51.246402 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG uwsgi [-] keystone_authtoken.auth_admin_prefix = {{(pid=71939) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Nov 24 16:28:51.246543 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG uwsgi [-] keystone_authtoken.admin_tenant_name = admin {{(pid=71938) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Nov 24 16:28:51.246672 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG uwsgi [-] keystone_authtoken.auth_host = 127.0.0.1 {{(pid=71939) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Nov 24 16:28:51.246801 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG uwsgi [-] keystone_authtoken.admin_token = **** {{(pid=71938) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Nov 24 16:28:51.246929 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG uwsgi [-] keystone_authtoken.auth_port = 35357 {{(pid=71939) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Nov 24 16:28:51.247064 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG uwsgi [-] keystone_authtoken.admin_user = None {{(pid=71938) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Nov 24 16:28:51.247193 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG uwsgi [-] keystone_authtoken.auth_protocol = https {{(pid=71939) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Nov 24 16:28:51.247326 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG uwsgi [-] keystone_authtoken.auth_admin_prefix = {{(pid=71938) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Nov 24 16:28:51.247455 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG uwsgi [-] keystone_authtoken.auth_section = None {{(pid=71939) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Nov 24 16:28:51.247583 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG uwsgi [-] keystone_authtoken.auth_host = 127.0.0.1 {{(pid=71938) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Nov 24 16:28:51.247711 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG uwsgi [-] keystone_authtoken.auth_type = None {{(pid=71939) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Nov 24 16:28:51.247846 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG uwsgi [-] keystone_authtoken.auth_port = 35357 {{(pid=71938) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Nov 24 16:28:51.247975 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG uwsgi [-] keystone_authtoken.auth_uri = None {{(pid=71939) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Nov 24 16:28:51.248108 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG uwsgi [-] keystone_authtoken.auth_protocol = https {{(pid=71938) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Nov 24 16:28:51.248243 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG uwsgi [-] keystone_authtoken.auth_version = None {{(pid=71939) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Nov 24 16:28:51.248371 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG uwsgi [-] keystone_authtoken.auth_section = None {{(pid=71938) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Nov 24 16:28:51.248499 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG uwsgi [-] keystone_authtoken.cache = None {{(pid=71939) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Nov 24 16:28:51.248635 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG uwsgi [-] keystone_authtoken.auth_type = None {{(pid=71938) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Nov 24 16:28:51.248769 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG uwsgi [-] keystone_authtoken.cafile = None {{(pid=71939) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Nov 24 16:28:51.248904 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG uwsgi [-] keystone_authtoken.auth_uri = None {{(pid=71938) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Nov 24 16:28:51.249033 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG uwsgi [-] keystone_authtoken.certfile = None {{(pid=71939) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Nov 24 16:28:51.249160 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG uwsgi [-] keystone_authtoken.auth_version = None {{(pid=71938) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Nov 24 16:28:51.249292 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG uwsgi [-] keystone_authtoken.delay_auth_decision = False {{(pid=71939) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Nov 24 16:28:51.249415 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG uwsgi [-] keystone_authtoken.cache = None {{(pid=71938) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Nov 24 16:28:51.249517 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG uwsgi [-] keystone_authtoken.enforce_token_bind = permissive {{(pid=71939) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Nov 24 16:28:51.249648 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG uwsgi [-] keystone_authtoken.cafile = None {{(pid=71938) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Nov 24 16:28:51.249776 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG uwsgi [-] keystone_authtoken.http_connect_timeout = None {{(pid=71939) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Nov 24 16:28:51.249910 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG uwsgi [-] keystone_authtoken.certfile = None {{(pid=71938) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Nov 24 16:28:51.249910 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG uwsgi [-] keystone_authtoken.delay_auth_decision = False {{(pid=71938) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Nov 24 16:28:51.250197 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG uwsgi [-] keystone_authtoken.http_request_max_retries = 3 {{(pid=71939) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Nov 24 16:28:51.250197 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG uwsgi [-] keystone_authtoken.identity_uri = None {{(pid=71939) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Nov 24 16:28:51.250443 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG uwsgi [-] keystone_authtoken.enforce_token_bind = permissive {{(pid=71938) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Nov 24 16:28:51.250443 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG uwsgi [-] keystone_authtoken.http_connect_timeout = None {{(pid=71938) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Nov 24 16:28:51.250696 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG uwsgi [-] keystone_authtoken.include_service_catalog = True {{(pid=71939) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Nov 24 16:28:51.250825 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG uwsgi [-] keystone_authtoken.http_request_max_retries = 3 {{(pid=71938) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Nov 24 16:28:51.250960 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG uwsgi [-] keystone_authtoken.insecure = False {{(pid=71939) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Nov 24 16:28:51.251089 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG uwsgi [-] keystone_authtoken.identity_uri = None {{(pid=71938) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Nov 24 16:28:51.251217 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG uwsgi [-] keystone_authtoken.interface = admin {{(pid=71939) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Nov 24 16:28:51.251351 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG uwsgi [-] keystone_authtoken.include_service_catalog = True {{(pid=71938) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Nov 24 16:28:51.251480 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG uwsgi [-] keystone_authtoken.keyfile = None {{(pid=71939) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Nov 24 16:28:51.251607 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG uwsgi [-] keystone_authtoken.insecure = False {{(pid=71938) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Nov 24 16:28:51.251742 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_conn_get_timeout = 10 {{(pid=71939) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Nov 24 16:28:51.251872 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG uwsgi [-] keystone_authtoken.interface = admin {{(pid=71938) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Nov 24 16:28:51.251999 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_dead_retry = 300 {{(pid=71939) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Nov 24 16:28:51.252127 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG uwsgi [-] keystone_authtoken.keyfile = None {{(pid=71938) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Nov 24 16:28:51.252255 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_maxsize = 10 {{(pid=71939) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Nov 24 16:28:51.252383 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_conn_get_timeout = 10 {{(pid=71938) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Nov 24 16:28:51.252519 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_socket_timeout = 3 {{(pid=71939) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Nov 24 16:28:51.252647 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_dead_retry = 300 {{(pid=71938) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Nov 24 16:28:51.252775 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_unused_timeout = 60 {{(pid=71939) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Nov 24 16:28:51.252902 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_maxsize = 10 {{(pid=71938) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Nov 24 16:28:51.253029 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG uwsgi [-] keystone_authtoken.memcache_secret_key = **** {{(pid=71939) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Nov 24 16:28:51.253163 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_socket_timeout = 3 {{(pid=71938) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Nov 24 16:28:51.253299 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG uwsgi [-] keystone_authtoken.memcache_security_strategy = None {{(pid=71939) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Nov 24 16:28:51.253429 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_unused_timeout = 60 {{(pid=71938) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Nov 24 16:28:51.253557 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG uwsgi [-] keystone_authtoken.memcache_use_advanced_pool = False {{(pid=71939) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Nov 24 16:28:51.253684 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG uwsgi [-] keystone_authtoken.memcache_secret_key = **** {{(pid=71938) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Nov 24 16:28:51.253812 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG uwsgi [-] keystone_authtoken.memcached_servers = None {{(pid=71939) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Nov 24 16:28:51.254474 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG uwsgi [-] keystone_authtoken.memcache_security_strategy = None {{(pid=71938) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Nov 24 16:28:51.254607 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG uwsgi [-] keystone_authtoken.region_name = None {{(pid=71939) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Nov 24 16:28:51.254740 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG uwsgi [-] keystone_authtoken.memcache_use_advanced_pool = False {{(pid=71938) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Nov 24 16:28:51.254870 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles = ['service'] {{(pid=71939) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Nov 24 16:28:51.254999 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG uwsgi [-] keystone_authtoken.memcached_servers = None {{(pid=71938) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Nov 24 16:28:51.255127 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles_required = False {{(pid=71939) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Nov 24 16:28:51.255263 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG uwsgi [-] keystone_authtoken.region_name = None {{(pid=71938) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Nov 24 16:28:51.255399 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG uwsgi [-] keystone_authtoken.service_type = None {{(pid=71939) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Nov 24 16:28:51.255530 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles = ['service'] {{(pid=71938) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Nov 24 16:28:51.255658 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG uwsgi [-] keystone_authtoken.token_cache_time = 300 {{(pid=71939) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Nov 24 16:28:51.255792 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles_required = False {{(pid=71938) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Nov 24 16:28:51.255921 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG uwsgi [-] keystone_authtoken.www_authenticate_uri = None {{(pid=71939) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Nov 24 16:28:51.256043 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG uwsgi [-] keystone_authtoken.service_type = None {{(pid=71938) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Nov 24 16:28:51.256147 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG uwsgi [-] cache.backend = dogpile.cache.memcached {{(pid=71939) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Nov 24 16:28:51.256247 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG uwsgi [-] keystone_authtoken.token_cache_time = 300 {{(pid=71938) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Nov 24 16:28:51.256346 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG uwsgi [-] cache.backend_argument = **** {{(pid=71939) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Nov 24 16:28:51.256467 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG uwsgi [-] keystone_authtoken.www_authenticate_uri = None {{(pid=71938) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Nov 24 16:28:51.256576 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG uwsgi [-] cache.config_prefix = cache.oslo {{(pid=71939) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Nov 24 16:28:51.256685 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG uwsgi [-] cache.backend = dogpile.cache.memcached {{(pid=71938) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Nov 24 16:28:51.256787 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG uwsgi [-] cache.debug_cache_backend = False {{(pid=71939) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Nov 24 16:28:51.256887 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG uwsgi [-] cache.backend_argument = **** {{(pid=71938) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Nov 24 16:28:51.256994 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG uwsgi [-] cache.enabled = True {{(pid=71939) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Nov 24 16:28:51.257095 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG uwsgi [-] cache.config_prefix = cache.oslo {{(pid=71938) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Nov 24 16:28:51.257201 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG uwsgi [-] cache.expiration_time = 600 {{(pid=71939) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Nov 24 16:28:51.257309 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG uwsgi [-] cache.debug_cache_backend = False {{(pid=71938) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Nov 24 16:28:51.257415 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG uwsgi [-] cache.memcache_dead_retry = 300 {{(pid=71939) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Nov 24 16:28:51.257415 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG uwsgi [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=71939) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Nov 24 16:28:51.257609 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG uwsgi [-] cache.enabled = True {{(pid=71938) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Nov 24 16:28:51.257709 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG uwsgi [-] cache.memcache_pool_maxsize = 10 {{(pid=71939) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Nov 24 16:28:51.257813 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG uwsgi [-] cache.expiration_time = 600 {{(pid=71938) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Nov 24 16:28:51.257923 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG uwsgi [-] cache.memcache_pool_unused_timeout = 60 {{(pid=71939) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Nov 24 16:28:51.258075 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG uwsgi [-] cache.memcache_dead_retry = 300 {{(pid=71938) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Nov 24 16:28:51.258075 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG uwsgi [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=71938) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Nov 24 16:28:51.258275 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG uwsgi [-] cache.memcache_servers = ['localhost:11211'] {{(pid=71939) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Nov 24 16:28:51.258375 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG uwsgi [-] cache.memcache_pool_maxsize = 10 {{(pid=71938) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Nov 24 16:28:51.258474 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG uwsgi [-] cache.memcache_socket_timeout = 1.0 {{(pid=71939) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Nov 24 16:28:51.258639 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG uwsgi [-] cache.memcache_pool_unused_timeout = 60 {{(pid=71938) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Nov 24 16:28:51.258746 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG uwsgi [-] cache.proxies = [] {{(pid=71939) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Nov 24 16:28:51.258746 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG uwsgi [-] cache.tls_allowed_ciphers = None {{(pid=71939) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Nov 24 16:28:51.258941 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG uwsgi [-] cache.memcache_servers = ['localhost:11211'] {{(pid=71938) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Nov 24 16:28:51.259072 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG uwsgi [-] cache.tls_cafile = None {{(pid=71939) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Nov 24 16:28:51.259231 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG uwsgi [-] cache.memcache_socket_timeout = 1.0 {{(pid=71938) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Nov 24 16:28:51.259372 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG uwsgi [-] cache.tls_certfile = None {{(pid=71939) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Nov 24 16:28:51.259508 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG uwsgi [-] cache.proxies = [] {{(pid=71938) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Nov 24 16:28:51.259638 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG uwsgi [-] cache.tls_enabled = False {{(pid=71939) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Nov 24 16:28:51.259768 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG uwsgi [-] cache.tls_allowed_ciphers = None {{(pid=71938) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Nov 24 16:28:51.259897 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG uwsgi [-] cache.tls_keyfile = None {{(pid=71939) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Nov 24 16:28:51.260001 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG uwsgi [-] cache.tls_cafile = None {{(pid=71938) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Nov 24 16:28:51.260136 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG uwsgi [-] application_credential.cache_time = None {{(pid=71939) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Nov 24 16:28:51.260267 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG uwsgi [-] cache.tls_certfile = None {{(pid=71938) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Nov 24 16:28:51.260396 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG uwsgi [-] application_credential.caching = True {{(pid=71939) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Nov 24 16:28:51.260526 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG uwsgi [-] cache.tls_enabled = False {{(pid=71938) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Nov 24 16:28:51.260655 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG uwsgi [-] application_credential.driver = sql {{(pid=71939) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Nov 24 16:28:51.260786 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG uwsgi [-] cache.tls_keyfile = None {{(pid=71938) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Nov 24 16:28:51.260926 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG uwsgi [-] application_credential.user_limit = -1 {{(pid=71939) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Nov 24 16:28:51.261061 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG uwsgi [-] application_credential.cache_time = None {{(pid=71938) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Nov 24 16:28:51.261061 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG uwsgi [-] application_credential.caching = True {{(pid=71938) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Nov 24 16:28:51.261306 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG uwsgi [-] assignment.driver = sql {{(pid=71939) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Nov 24 16:28:51.261443 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG uwsgi [-] application_credential.driver = sql {{(pid=71938) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Nov 24 16:28:51.261574 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG uwsgi [-] assignment.prohibited_implied_role = ['admin'] {{(pid=71939) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Nov 24 16:28:51.261703 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG uwsgi [-] application_credential.user_limit = -1 {{(pid=71938) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Nov 24 16:28:51.261844 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG uwsgi [-] auth.application_credential = None {{(pid=71939) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Nov 24 16:28:51.261844 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG uwsgi [-] auth.external = None {{(pid=71939) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Nov 24 16:28:51.262108 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG uwsgi [-] assignment.driver = sql {{(pid=71938) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Nov 24 16:28:51.262239 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG uwsgi [-] auth.mapped = None {{(pid=71939) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Nov 24 16:28:51.262368 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG uwsgi [-] assignment.prohibited_implied_role = ['admin'] {{(pid=71938) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Nov 24 16:28:51.262368 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG uwsgi [-] auth.application_credential = None {{(pid=71938) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Nov 24 16:28:51.262623 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG uwsgi [-] auth.methods = ['external', 'password', 'token', 'oauth1', 'mapped', 'application_credential'] {{(pid=71939) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Nov 24 16:28:51.262755 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG uwsgi [-] auth.external = None {{(pid=71938) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Nov 24 16:28:51.262885 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG uwsgi [-] auth.oauth1 = None {{(pid=71939) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Nov 24 16:28:51.263015 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG uwsgi [-] auth.mapped = None {{(pid=71938) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Nov 24 16:28:51.263144 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG uwsgi [-] auth.password = None {{(pid=71939) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Nov 24 16:28:51.263144 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG uwsgi [-] auth.token = None {{(pid=71939) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Nov 24 16:28:51.263397 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG uwsgi [-] auth.methods = ['external', 'password', 'token', 'oauth1', 'mapped', 'application_credential'] {{(pid=71938) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Nov 24 16:28:51.263528 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG uwsgi [-] catalog.cache_time = None {{(pid=71939) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Nov 24 16:28:51.263657 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG uwsgi [-] auth.oauth1 = None {{(pid=71938) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Nov 24 16:28:51.263791 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG uwsgi [-] catalog.caching = True {{(pid=71939) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Nov 24 16:28:51.263923 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG uwsgi [-] auth.password = None {{(pid=71938) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Nov 24 16:28:51.264052 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG uwsgi [-] catalog.driver = sql {{(pid=71939) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Nov 24 16:28:51.264189 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG uwsgi [-] auth.token = None {{(pid=71938) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Nov 24 16:28:51.264320 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG uwsgi [-] catalog.list_limit = None {{(pid=71939) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Nov 24 16:28:51.264450 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG uwsgi [-] catalog.cache_time = None {{(pid=71938) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Nov 24 16:28:51.264579 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG uwsgi [-] catalog.template_file = default_catalog.templates {{(pid=71939) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Nov 24 16:28:51.264709 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG uwsgi [-] catalog.caching = True {{(pid=71938) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Nov 24 16:28:51.264839 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG uwsgi [-] credential.auth_ttl = 15 {{(pid=71939) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Nov 24 16:28:51.264977 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG uwsgi [-] catalog.driver = sql {{(pid=71938) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Nov 24 16:28:51.265107 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG uwsgi [-] credential.cache_time = None {{(pid=71939) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Nov 24 16:28:51.265237 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG uwsgi [-] catalog.list_limit = None {{(pid=71938) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Nov 24 16:28:51.265367 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG uwsgi [-] credential.caching = True {{(pid=71939) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Nov 24 16:28:51.265497 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG uwsgi [-] catalog.template_file = default_catalog.templates {{(pid=71938) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Nov 24 16:28:51.265627 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG uwsgi [-] credential.driver = sql {{(pid=71939) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Nov 24 16:28:51.265767 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG uwsgi [-] credential.auth_ttl = 15 {{(pid=71938) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Nov 24 16:28:51.265898 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG uwsgi [-] credential.key_repository = /etc/keystone/credential-keys/ {{(pid=71939) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Nov 24 16:28:51.266044 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG uwsgi [-] credential.cache_time = None {{(pid=71938) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Nov 24 16:28:51.266186 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG uwsgi [-] credential.provider = fernet {{(pid=71939) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Nov 24 16:28:51.266325 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG uwsgi [-] credential.caching = True {{(pid=71938) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Nov 24 16:28:51.266468 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG uwsgi [-] domain_config.cache_time = 300 {{(pid=71939) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Nov 24 16:28:51.266599 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG uwsgi [-] credential.driver = sql {{(pid=71938) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Nov 24 16:28:51.266738 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG uwsgi [-] domain_config.caching = True {{(pid=71939) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Nov 24 16:28:51.266870 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG uwsgi [-] credential.key_repository = /etc/keystone/credential-keys/ {{(pid=71938) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Nov 24 16:28:51.267010 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG uwsgi [-] domain_config.driver = sql {{(pid=71939) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Nov 24 16:28:51.267141 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG uwsgi [-] credential.provider = fernet {{(pid=71938) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Nov 24 16:28:51.267276 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG uwsgi [-] endpoint_filter.driver = sql {{(pid=71939) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Nov 24 16:28:51.267407 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG uwsgi [-] domain_config.cache_time = 300 {{(pid=71938) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Nov 24 16:28:51.267545 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG uwsgi [-] endpoint_filter.return_all_endpoints_if_no_filter = True {{(pid=71939) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Nov 24 16:28:51.267677 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG uwsgi [-] domain_config.caching = True {{(pid=71938) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Nov 24 16:28:51.267807 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG uwsgi [-] endpoint_policy.driver = sql {{(pid=71939) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Nov 24 16:28:51.267936 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG uwsgi [-] domain_config.driver = sql {{(pid=71938) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Nov 24 16:28:51.268067 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG uwsgi [-] eventlet_server.admin_bind_host = 0.0.0.0 {{(pid=71939) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Nov 24 16:28:51.268198 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG uwsgi [-] endpoint_filter.driver = sql {{(pid=71938) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Nov 24 16:28:51.268336 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG uwsgi [-] eventlet_server.admin_port = 35357 {{(pid=71939) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Nov 24 16:28:51.268467 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG uwsgi [-] endpoint_filter.return_all_endpoints_if_no_filter = True {{(pid=71938) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Nov 24 16:28:51.268597 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG uwsgi [-] eventlet_server.public_bind_host = 0.0.0.0 {{(pid=71939) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Nov 24 16:28:51.268727 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG uwsgi [-] endpoint_policy.driver = sql {{(pid=71938) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Nov 24 16:28:51.268857 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG uwsgi [-] eventlet_server.public_port = 5000 {{(pid=71939) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Nov 24 16:28:51.268857 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG uwsgi [-] federation.assertion_prefix = {{(pid=71939) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Nov 24 16:28:51.269111 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG uwsgi [-] eventlet_server.admin_bind_host = 0.0.0.0 {{(pid=71938) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Nov 24 16:28:51.269243 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG uwsgi [-] federation.caching = True {{(pid=71939) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Nov 24 16:28:51.269373 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG uwsgi [-] eventlet_server.admin_port = 35357 {{(pid=71938) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Nov 24 16:28:51.269546 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG uwsgi [-] federation.default_authorization_ttl = 0 {{(pid=71939) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Nov 24 16:28:51.270256 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG uwsgi [-] eventlet_server.public_bind_host = 0.0.0.0 {{(pid=71938) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Nov 24 16:28:51.270399 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG uwsgi [-] federation.driver = sql {{(pid=71939) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Nov 24 16:28:51.270540 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG uwsgi [-] eventlet_server.public_port = 5000 {{(pid=71938) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Nov 24 16:28:51.270672 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG uwsgi [-] federation.federated_domain_name = Federated {{(pid=71939) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Nov 24 16:28:51.270802 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG uwsgi [-] federation.assertion_prefix = {{(pid=71938) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Nov 24 16:28:51.270933 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG uwsgi [-] federation.remote_id_attribute = None {{(pid=71939) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Nov 24 16:28:51.271071 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG uwsgi [-] federation.caching = True {{(pid=71938) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Nov 24 16:28:51.271203 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG uwsgi [-] federation.sso_callback_template = /etc/keystone/sso_callback_template.html {{(pid=71939) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Nov 24 16:28:51.271427 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG uwsgi [-] federation.default_authorization_ttl = 0 {{(pid=71938) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Nov 24 16:28:51.271570 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG uwsgi [-] federation.trusted_dashboard = [] {{(pid=71939) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Nov 24 16:28:51.271703 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG uwsgi [-] federation.driver = sql {{(pid=71938) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Nov 24 16:28:51.271835 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG uwsgi [-] fernet_receipts.key_repository = /etc/keystone/fernet-keys/ {{(pid=71939) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Nov 24 16:28:51.271967 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG uwsgi [-] federation.federated_domain_name = Federated {{(pid=71938) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Nov 24 16:28:51.272106 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG uwsgi [-] fernet_receipts.max_active_keys = 3 {{(pid=71939) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Nov 24 16:28:51.272239 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG uwsgi [-] federation.remote_id_attribute = None {{(pid=71938) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Nov 24 16:28:51.272371 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG uwsgi [-] fernet_tokens.key_repository = /etc/keystone/fernet-keys/ {{(pid=71939) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Nov 24 16:28:51.272503 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG uwsgi [-] federation.sso_callback_template = /etc/keystone/sso_callback_template.html {{(pid=71938) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Nov 24 16:28:51.272635 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG uwsgi [-] fernet_tokens.max_active_keys = 3 {{(pid=71939) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Nov 24 16:28:51.272765 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG uwsgi [-] federation.trusted_dashboard = [] {{(pid=71938) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Nov 24 16:28:51.272904 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG uwsgi [-] identity.cache_time = 600 {{(pid=71939) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Nov 24 16:28:51.273036 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG uwsgi [-] fernet_receipts.key_repository = /etc/keystone/fernet-keys/ {{(pid=71938) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Nov 24 16:28:51.273168 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG uwsgi [-] identity.caching = True {{(pid=71939) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Nov 24 16:28:51.273298 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG uwsgi [-] fernet_receipts.max_active_keys = 3 {{(pid=71938) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Nov 24 16:28:51.273431 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG uwsgi [-] identity.default_domain_id = default {{(pid=71939) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Nov 24 16:28:51.273561 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG uwsgi [-] fernet_tokens.key_repository = /etc/keystone/fernet-keys/ {{(pid=71938) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Nov 24 16:28:51.273700 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG uwsgi [-] identity.domain_config_dir = /etc/keystone/domains {{(pid=71939) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Nov 24 16:28:51.273834 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG uwsgi [-] fernet_tokens.max_active_keys = 3 {{(pid=71938) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Nov 24 16:28:51.273966 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG uwsgi [-] identity.domain_configurations_from_database = False {{(pid=71939) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Nov 24 16:28:51.274114 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG uwsgi [-] identity.cache_time = 600 {{(pid=71938) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Nov 24 16:28:51.274246 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG uwsgi [-] identity.domain_specific_drivers_enabled = False {{(pid=71939) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Nov 24 16:28:51.274379 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG uwsgi [-] identity.caching = True {{(pid=71938) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Nov 24 16:28:51.274524 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG uwsgi [-] identity.driver = sql {{(pid=71939) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Nov 24 16:28:51.274665 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG uwsgi [-] identity.default_domain_id = default {{(pid=71938) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Nov 24 16:28:51.274797 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG uwsgi [-] identity.list_limit = None {{(pid=71939) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Nov 24 16:28:51.274928 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG uwsgi [-] identity.domain_config_dir = /etc/keystone/domains {{(pid=71938) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Nov 24 16:28:51.275065 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG uwsgi [-] identity.max_password_length = 4096 {{(pid=71939) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Nov 24 16:28:51.275203 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG uwsgi [-] identity.domain_configurations_from_database = False {{(pid=71938) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Nov 24 16:28:51.275349 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG uwsgi [-] identity.password_hash_algorithm = bcrypt {{(pid=71939) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Nov 24 16:28:51.275483 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG uwsgi [-] identity.domain_specific_drivers_enabled = False {{(pid=71938) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Nov 24 16:28:51.275614 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG uwsgi [-] identity.password_hash_rounds = 4 {{(pid=71939) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Nov 24 16:28:51.275745 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG uwsgi [-] identity.driver = sql {{(pid=71938) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Nov 24 16:28:51.275876 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG uwsgi [-] identity.salt_bytesize = None {{(pid=71939) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Nov 24 16:28:51.276014 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG uwsgi [-] identity.list_limit = None {{(pid=71938) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Nov 24 16:28:51.276147 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG uwsgi [-] identity.scrypt_block_size = None {{(pid=71939) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Nov 24 16:28:51.276147 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG uwsgi [-] identity.scrypt_parallelism = None {{(pid=71939) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Nov 24 16:28:51.276400 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG uwsgi [-] identity.max_password_length = 4096 {{(pid=71938) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Nov 24 16:28:51.276534 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG uwsgi [-] identity_mapping.backward_compatible_ids = True {{(pid=71939) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Nov 24 16:28:51.276676 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG uwsgi [-] identity.password_hash_algorithm = bcrypt {{(pid=71938) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Nov 24 16:28:51.276808 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG uwsgi [-] identity_mapping.driver = sql {{(pid=71939) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Nov 24 16:28:51.276939 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG uwsgi [-] identity.password_hash_rounds = 4 {{(pid=71938) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Nov 24 16:28:51.277071 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG uwsgi [-] identity_mapping.generator = sha256 {{(pid=71939) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Nov 24 16:28:51.277202 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG uwsgi [-] identity.salt_bytesize = None {{(pid=71938) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Nov 24 16:28:51.277332 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG uwsgi [-] jwt_tokens.jws_private_key_repository = /etc/keystone/jws-keys/private {{(pid=71939) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Nov 24 16:28:51.277471 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG uwsgi [-] identity.scrypt_block_size = None {{(pid=71938) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Nov 24 16:28:51.277471 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG uwsgi [-] identity.scrypt_parallelism = None {{(pid=71938) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Nov 24 16:28:51.277722 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG uwsgi [-] jwt_tokens.jws_public_key_repository = /etc/keystone/jws-keys/public {{(pid=71939) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Nov 24 16:28:51.277861 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG uwsgi [-] identity_mapping.backward_compatible_ids = True {{(pid=71938) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Nov 24 16:28:51.277993 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG uwsgi [-] ldap.alias_dereferencing = default {{(pid=71939) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Nov 24 16:28:51.278158 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG uwsgi [-] identity_mapping.driver = sql {{(pid=71938) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Nov 24 16:28:51.278306 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG uwsgi [-] ldap.auth_pool_connection_lifetime = 60 {{(pid=71939) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Nov 24 16:28:51.278440 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG uwsgi [-] identity_mapping.generator = sha256 {{(pid=71938) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Nov 24 16:28:51.278573 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG uwsgi [-] ldap.auth_pool_size = 100 {{(pid=71939) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Nov 24 16:28:51.278573 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG uwsgi [-] ldap.chase_referrals = None {{(pid=71939) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Nov 24 16:28:51.278821 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG uwsgi [-] jwt_tokens.jws_private_key_repository = /etc/keystone/jws-keys/private {{(pid=71938) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Nov 24 16:28:51.278960 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG uwsgi [-] ldap.connection_timeout = -1 {{(pid=71939) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Nov 24 16:28:51.279098 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG uwsgi [-] jwt_tokens.jws_public_key_repository = /etc/keystone/jws-keys/public {{(pid=71938) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Nov 24 16:28:51.279232 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG uwsgi [-] ldap.debug_level = None {{(pid=71939) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Nov 24 16:28:51.279363 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG uwsgi [-] ldap.alias_dereferencing = default {{(pid=71938) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Nov 24 16:28:51.279494 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG uwsgi [-] ldap.group_ad_nesting = False {{(pid=71939) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Nov 24 16:28:51.279626 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG uwsgi [-] ldap.auth_pool_connection_lifetime = 60 {{(pid=71938) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Nov 24 16:28:51.279765 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG uwsgi [-] ldap.group_additional_attribute_mapping = [] {{(pid=71939) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Nov 24 16:28:51.279898 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG uwsgi [-] ldap.auth_pool_size = 100 {{(pid=71938) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Nov 24 16:28:51.280029 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG uwsgi [-] ldap.group_attribute_ignore = [] {{(pid=71939) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Nov 24 16:28:51.280168 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG uwsgi [-] ldap.chase_referrals = None {{(pid=71938) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Nov 24 16:28:51.280300 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG uwsgi [-] ldap.group_desc_attribute = description {{(pid=71939) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Nov 24 16:28:51.280431 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG uwsgi [-] ldap.connection_timeout = -1 {{(pid=71938) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Nov 24 16:28:51.280570 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG uwsgi [-] ldap.group_filter = None {{(pid=71939) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Nov 24 16:28:51.280703 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG uwsgi [-] ldap.debug_level = None {{(pid=71938) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Nov 24 16:28:51.280834 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG uwsgi [-] ldap.group_id_attribute = cn {{(pid=71939) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Nov 24 16:28:51.280966 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG uwsgi [-] ldap.group_ad_nesting = False {{(pid=71938) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Nov 24 16:28:51.281097 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG uwsgi [-] ldap.group_member_attribute = member {{(pid=71939) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Nov 24 16:28:51.281233 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG uwsgi [-] ldap.group_additional_attribute_mapping = [] {{(pid=71938) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Nov 24 16:28:51.281373 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG uwsgi [-] ldap.group_members_are_ids = False {{(pid=71939) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Nov 24 16:28:51.281506 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG uwsgi [-] ldap.group_attribute_ignore = [] {{(pid=71938) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Nov 24 16:28:51.281637 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG uwsgi [-] ldap.group_name_attribute = ou {{(pid=71939) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Nov 24 16:28:51.281770 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG uwsgi [-] ldap.group_desc_attribute = description {{(pid=71938) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Nov 24 16:28:51.281907 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG uwsgi [-] ldap.group_objectclass = groupOfNames {{(pid=71939) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Nov 24 16:28:51.282054 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG uwsgi [-] ldap.group_filter = None {{(pid=71938) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Nov 24 16:28:51.282200 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG uwsgi [-] ldap.group_tree_dn = None {{(pid=71939) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Nov 24 16:28:51.282333 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG uwsgi [-] ldap.group_id_attribute = cn {{(pid=71938) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Nov 24 16:28:51.282465 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG uwsgi [-] ldap.page_size = 0 {{(pid=71939) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Nov 24 16:28:51.282595 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG uwsgi [-] ldap.group_member_attribute = member {{(pid=71938) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Nov 24 16:28:51.282726 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG uwsgi [-] ldap.password = **** {{(pid=71939) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Nov 24 16:28:51.282858 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG uwsgi [-] ldap.group_members_are_ids = False {{(pid=71938) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Nov 24 16:28:51.282996 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG uwsgi [-] ldap.pool_connection_lifetime = 600 {{(pid=71939) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Nov 24 16:28:51.283129 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG uwsgi [-] ldap.group_name_attribute = ou {{(pid=71938) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Nov 24 16:28:51.283265 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG uwsgi [-] ldap.pool_connection_timeout = -1 {{(pid=71939) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Nov 24 16:28:51.283398 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG uwsgi [-] ldap.group_objectclass = groupOfNames {{(pid=71938) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Nov 24 16:28:51.283509 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG uwsgi [-] ldap.pool_retry_delay = 0.1 {{(pid=71939) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Nov 24 16:28:51.283639 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG uwsgi [-] ldap.group_tree_dn = None {{(pid=71938) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Nov 24 16:28:51.283777 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG uwsgi [-] ldap.pool_retry_max = 3 {{(pid=71939) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Nov 24 16:28:51.283911 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG uwsgi [-] ldap.page_size = 0 {{(pid=71938) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Nov 24 16:28:51.284042 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG uwsgi [-] ldap.pool_size = 10 {{(pid=71939) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Nov 24 16:28:51.284172 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG uwsgi [-] ldap.password = **** {{(pid=71938) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Nov 24 16:28:51.284303 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG uwsgi [-] ldap.query_scope = one {{(pid=71939) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Nov 24 16:28:51.284434 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG uwsgi [-] ldap.pool_connection_lifetime = 600 {{(pid=71938) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Nov 24 16:28:51.284573 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG uwsgi [-] ldap.suffix = cn=example,cn=com {{(pid=71939) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Nov 24 16:28:51.284706 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG uwsgi [-] ldap.pool_connection_timeout = -1 {{(pid=71938) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Nov 24 16:28:51.284837 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG uwsgi [-] ldap.tls_cacertdir = None {{(pid=71939) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Nov 24 16:28:51.284969 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG uwsgi [-] ldap.pool_retry_delay = 0.1 {{(pid=71938) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Nov 24 16:28:51.285108 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG uwsgi [-] ldap.tls_cacertfile = None {{(pid=71939) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Nov 24 16:28:51.285244 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG uwsgi [-] ldap.pool_retry_max = 3 {{(pid=71938) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Nov 24 16:28:51.285383 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG uwsgi [-] ldap.tls_req_cert = demand {{(pid=71939) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Nov 24 16:28:51.285515 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG uwsgi [-] ldap.pool_size = 10 {{(pid=71938) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Nov 24 16:28:51.285645 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG uwsgi [-] ldap.url = ldap://localhost {{(pid=71939) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Nov 24 16:28:51.285784 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG uwsgi [-] ldap.query_scope = one {{(pid=71938) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Nov 24 16:28:51.285926 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG uwsgi [-] ldap.use_auth_pool = True {{(pid=71939) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Nov 24 16:28:51.286072 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG uwsgi [-] ldap.suffix = cn=example,cn=com {{(pid=71938) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Nov 24 16:28:51.286218 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG uwsgi [-] ldap.use_pool = True {{(pid=71939) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Nov 24 16:28:51.286351 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG uwsgi [-] ldap.tls_cacertdir = None {{(pid=71938) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Nov 24 16:28:51.286487 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG uwsgi [-] ldap.use_tls = False {{(pid=71939) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Nov 24 16:28:51.286618 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG uwsgi [-] ldap.tls_cacertfile = None {{(pid=71938) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Nov 24 16:28:51.286749 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG uwsgi [-] ldap.user = None {{(pid=71939) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Nov 24 16:28:51.286880 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG uwsgi [-] ldap.tls_req_cert = demand {{(pid=71938) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Nov 24 16:28:51.287076 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG uwsgi [-] ldap.user_additional_attribute_mapping = [] {{(pid=71939) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Nov 24 16:28:51.287210 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG uwsgi [-] ldap.url = ldap://localhost {{(pid=71938) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Nov 24 16:28:51.287210 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG uwsgi [-] ldap.use_auth_pool = True {{(pid=71938) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Nov 24 16:28:51.287210 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG uwsgi [-] ldap.use_pool = True {{(pid=71938) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Nov 24 16:28:51.287210 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG uwsgi [-] ldap.use_tls = False {{(pid=71938) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Nov 24 16:28:51.287698 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG uwsgi [-] ldap.user_attribute_ignore = ['default_project_id'] {{(pid=71939) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Nov 24 16:28:51.287837 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG uwsgi [-] ldap.user = None {{(pid=71938) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Nov 24 16:28:51.287969 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG uwsgi [-] ldap.user_default_project_id_attribute = None {{(pid=71939) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Nov 24 16:28:51.288100 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG uwsgi [-] ldap.user_additional_attribute_mapping = [] {{(pid=71938) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Nov 24 16:28:51.288232 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG uwsgi [-] ldap.user_description_attribute = description {{(pid=71939) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Nov 24 16:28:51.288232 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG uwsgi [-] ldap.user_enabled_attribute = enabled {{(pid=71939) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Nov 24 16:28:51.288232 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG uwsgi [-] ldap.user_enabled_default = True {{(pid=71939) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Nov 24 16:28:51.288232 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG uwsgi [-] ldap.user_enabled_emulation = False {{(pid=71939) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Nov 24 16:28:51.288727 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG uwsgi [-] ldap.user_attribute_ignore = ['default_project_id'] {{(pid=71938) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Nov 24 16:28:51.288859 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG uwsgi [-] ldap.user_enabled_emulation_dn = None {{(pid=71939) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Nov 24 16:28:51.288990 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG uwsgi [-] ldap.user_default_project_id_attribute = None {{(pid=71938) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Nov 24 16:28:51.289122 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG uwsgi [-] ldap.user_enabled_emulation_use_group_config = False {{(pid=71939) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Nov 24 16:28:51.289254 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG uwsgi [-] ldap.user_description_attribute = description {{(pid=71938) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Nov 24 16:28:51.289391 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG uwsgi [-] ldap.user_enabled_invert = False {{(pid=71939) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Nov 24 16:28:51.289524 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG uwsgi [-] ldap.user_enabled_attribute = enabled {{(pid=71938) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Nov 24 16:28:51.289654 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG uwsgi [-] ldap.user_enabled_mask = 0 {{(pid=71939) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Nov 24 16:28:51.289785 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG uwsgi [-] ldap.user_enabled_default = True {{(pid=71938) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Nov 24 16:28:51.289916 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG uwsgi [-] ldap.user_filter = None {{(pid=71939) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Nov 24 16:28:51.290083 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG uwsgi [-] ldap.user_enabled_emulation = False {{(pid=71938) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Nov 24 16:28:51.290230 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG uwsgi [-] ldap.user_id_attribute = cn {{(pid=71939) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Nov 24 16:28:51.290363 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG uwsgi [-] ldap.user_enabled_emulation_dn = None {{(pid=71938) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Nov 24 16:28:51.290494 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG uwsgi [-] ldap.user_mail_attribute = mail {{(pid=71939) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Nov 24 16:28:51.290625 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG uwsgi [-] ldap.user_enabled_emulation_use_group_config = False {{(pid=71938) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Nov 24 16:28:51.290757 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG uwsgi [-] ldap.user_name_attribute = sn {{(pid=71939) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Nov 24 16:28:51.290888 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG uwsgi [-] ldap.user_enabled_invert = False {{(pid=71938) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Nov 24 16:28:51.291026 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG uwsgi [-] ldap.user_objectclass = inetOrgPerson {{(pid=71939) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Nov 24 16:28:51.291159 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG uwsgi [-] ldap.user_enabled_mask = 0 {{(pid=71938) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Nov 24 16:28:51.291290 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG uwsgi [-] ldap.user_pass_attribute = userPassword {{(pid=71939) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Nov 24 16:28:51.291421 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG uwsgi [-] ldap.user_filter = None {{(pid=71938) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Nov 24 16:28:51.291552 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG uwsgi [-] ldap.user_tree_dn = None {{(pid=71939) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Nov 24 16:28:51.291683 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG uwsgi [-] ldap.user_id_attribute = cn {{(pid=71938) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Nov 24 16:28:51.291822 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG uwsgi [-] memcache.dead_retry = 300 {{(pid=71939) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Nov 24 16:28:51.291954 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG uwsgi [-] ldap.user_mail_attribute = mail {{(pid=71938) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Nov 24 16:28:51.292085 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG uwsgi [-] memcache.pool_connection_get_timeout = 10 {{(pid=71939) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Nov 24 16:28:51.292218 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG uwsgi [-] ldap.user_name_attribute = sn {{(pid=71938) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Nov 24 16:28:51.292356 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG uwsgi [-] memcache.pool_maxsize = 10 {{(pid=71939) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Nov 24 16:28:51.292489 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG uwsgi [-] ldap.user_objectclass = inetOrgPerson {{(pid=71938) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Nov 24 16:28:51.292628 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG uwsgi [-] memcache.pool_unused_timeout = 60 {{(pid=71939) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Nov 24 16:28:51.292628 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG uwsgi [-] memcache.socket_timeout = 3 {{(pid=71939) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Nov 24 16:28:51.292887 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG uwsgi [-] ldap.user_pass_attribute = userPassword {{(pid=71938) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Nov 24 16:28:51.293018 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG uwsgi [-] oauth1.access_token_duration = 86400 {{(pid=71939) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Nov 24 16:28:51.293150 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG uwsgi [-] ldap.user_tree_dn = None {{(pid=71938) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Nov 24 16:28:51.293282 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG uwsgi [-] oauth1.driver = sql {{(pid=71939) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Nov 24 16:28:51.293421 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG uwsgi [-] memcache.dead_retry = 300 {{(pid=71938) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Nov 24 16:28:51.293561 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG uwsgi [-] oauth1.request_token_duration = 28800 {{(pid=71939) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Nov 24 16:28:51.293694 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG uwsgi [-] memcache.pool_connection_get_timeout = 10 {{(pid=71938) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Nov 24 16:28:51.293694 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG uwsgi [-] memcache.pool_maxsize = 10 {{(pid=71938) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Nov 24 16:28:51.293941 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG uwsgi [-] policy.driver = sql {{(pid=71939) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Nov 24 16:28:51.293941 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG uwsgi [-] policy.list_limit = None {{(pid=71939) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Nov 24 16:28:51.294263 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG uwsgi [-] memcache.pool_unused_timeout = 60 {{(pid=71938) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Nov 24 16:28:51.294263 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG uwsgi [-] memcache.socket_timeout = 3 {{(pid=71938) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Nov 24 16:28:51.294514 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG uwsgi [-] receipt.cache_on_issue = True {{(pid=71939) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Nov 24 16:28:51.294514 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG uwsgi [-] receipt.cache_time = 300 {{(pid=71939) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Nov 24 16:28:51.294776 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG uwsgi [-] oauth1.access_token_duration = 86400 {{(pid=71938) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Nov 24 16:28:51.294908 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG uwsgi [-] receipt.caching = True {{(pid=71939) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Nov 24 16:28:51.295052 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG uwsgi [-] oauth1.driver = sql {{(pid=71938) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Nov 24 16:28:51.295185 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG uwsgi [-] receipt.expiration = 300 {{(pid=71939) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Nov 24 16:28:51.295316 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG uwsgi [-] oauth1.request_token_duration = 28800 {{(pid=71938) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Nov 24 16:28:51.295448 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG uwsgi [-] receipt.provider = fernet {{(pid=71939) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Nov 24 16:28:51.295579 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG uwsgi [-] policy.driver = sql {{(pid=71938) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Nov 24 16:28:51.295717 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG uwsgi [-] resource.admin_project_domain_name = None {{(pid=71939) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Nov 24 16:28:51.295849 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG uwsgi [-] policy.list_limit = None {{(pid=71938) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Nov 24 16:28:51.295980 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG uwsgi [-] resource.admin_project_name = None {{(pid=71939) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Nov 24 16:28:51.296113 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG uwsgi [-] receipt.cache_on_issue = True {{(pid=71938) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Nov 24 16:28:51.296218 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG uwsgi [-] resource.cache_time = None {{(pid=71939) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Nov 24 16:28:51.296321 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG uwsgi [-] receipt.cache_time = 300 {{(pid=71938) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Nov 24 16:28:51.296463 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG uwsgi [-] resource.caching = True {{(pid=71939) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Nov 24 16:28:51.296595 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG uwsgi [-] receipt.caching = True {{(pid=71938) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Nov 24 16:28:51.296728 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG uwsgi [-] resource.domain_name_url_safe = off {{(pid=71939) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Nov 24 16:28:51.296858 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG uwsgi [-] receipt.expiration = 300 {{(pid=71938) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Nov 24 16:28:51.296990 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG uwsgi [-] resource.driver = sql {{(pid=71939) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Nov 24 16:28:51.297122 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG uwsgi [-] receipt.provider = fernet {{(pid=71938) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Nov 24 16:28:51.297260 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG uwsgi [-] resource.list_limit = None {{(pid=71939) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Nov 24 16:28:51.297366 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG uwsgi [-] resource.admin_project_domain_name = None {{(pid=71938) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Nov 24 16:28:51.297497 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG uwsgi [-] resource.project_name_url_safe = off {{(pid=71939) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Nov 24 16:28:51.297629 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG uwsgi [-] resource.admin_project_name = None {{(pid=71938) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Nov 24 16:28:51.297759 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG uwsgi [-] revoke.cache_time = 3600 {{(pid=71939) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Nov 24 16:28:51.297890 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG uwsgi [-] resource.cache_time = None {{(pid=71938) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Nov 24 16:28:51.298044 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG uwsgi [-] revoke.caching = True {{(pid=71939) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Nov 24 16:28:51.298154 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG uwsgi [-] resource.caching = True {{(pid=71938) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Nov 24 16:28:51.298257 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG uwsgi [-] revoke.driver = sql {{(pid=71939) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Nov 24 16:28:51.298387 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG uwsgi [-] resource.domain_name_url_safe = off {{(pid=71938) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Nov 24 16:28:51.298519 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG uwsgi [-] revoke.expiration_buffer = 1800 {{(pid=71939) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Nov 24 16:28:51.298650 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG uwsgi [-] resource.driver = sql {{(pid=71938) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Nov 24 16:28:51.298766 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG uwsgi [-] role.cache_time = None {{(pid=71939) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Nov 24 16:28:51.298868 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG uwsgi [-] resource.list_limit = None {{(pid=71938) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Nov 24 16:28:51.298935 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG uwsgi [-] role.caching = True {{(pid=71939) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Nov 24 16:28:51.298998 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG uwsgi [-] resource.project_name_url_safe = off {{(pid=71938) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Nov 24 16:28:51.299059 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG uwsgi [-] role.driver = sql {{(pid=71939) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Nov 24 16:28:51.299059 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG uwsgi [-] role.list_limit = None {{(pid=71939) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Nov 24 16:28:51.299178 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG uwsgi [-] revoke.cache_time = 3600 {{(pid=71938) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Nov 24 16:28:51.299243 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG uwsgi [-] saml.assertion_expiration_time = 3600 {{(pid=71939) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Nov 24 16:28:51.299243 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG uwsgi [-] saml.certfile = /etc/keystone/ssl/certs/signing_cert.pem {{(pid=71939) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Nov 24 16:28:51.299358 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG uwsgi [-] revoke.caching = True {{(pid=71938) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Nov 24 16:28:51.299421 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG uwsgi [-] saml.idp_contact_company = Example, Inc. {{(pid=71939) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Nov 24 16:28:51.299421 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG uwsgi [-] saml.idp_contact_email = support@example.com {{(pid=71939) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Nov 24 16:28:51.299540 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG uwsgi [-] revoke.driver = sql {{(pid=71938) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Nov 24 16:28:51.299609 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG uwsgi [-] saml.idp_contact_name = SAML Identity Provider Support {{(pid=71939) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Nov 24 16:28:51.299674 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG uwsgi [-] revoke.expiration_buffer = 1800 {{(pid=71938) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Nov 24 16:28:51.299736 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG uwsgi [-] saml.idp_contact_surname = Support {{(pid=71939) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Nov 24 16:28:51.299797 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG uwsgi [-] role.cache_time = None {{(pid=71938) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Nov 24 16:28:51.299858 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG uwsgi [-] saml.idp_contact_telephone = +1 800 555 0100 {{(pid=71939) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Nov 24 16:28:51.299927 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG uwsgi [-] role.caching = True {{(pid=71938) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Nov 24 16:28:51.299996 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG uwsgi [-] saml.idp_contact_type = other {{(pid=71939) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Nov 24 16:28:51.300059 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG uwsgi [-] role.driver = sql {{(pid=71938) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Nov 24 16:28:51.300121 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG uwsgi [-] saml.idp_entity_id = None {{(pid=71939) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Nov 24 16:28:51.300182 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG uwsgi [-] role.list_limit = None {{(pid=71938) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Nov 24 16:28:51.300243 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG uwsgi [-] saml.idp_lang = en {{(pid=71939) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Nov 24 16:28:51.300311 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG uwsgi [-] saml.assertion_expiration_time = 3600 {{(pid=71938) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Nov 24 16:28:51.300376 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG uwsgi [-] saml.idp_metadata_path = /etc/keystone/saml2_idp_metadata.xml {{(pid=71939) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Nov 24 16:28:51.300439 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG uwsgi [-] saml.certfile = /etc/keystone/ssl/certs/signing_cert.pem {{(pid=71938) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Nov 24 16:28:51.300500 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG uwsgi [-] saml.idp_organization_display_name = OpenStack SAML Identity Provider {{(pid=71939) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Nov 24 16:28:51.300561 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG uwsgi [-] saml.idp_contact_company = Example, Inc. {{(pid=71938) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Nov 24 16:28:51.300623 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG uwsgi [-] saml.idp_organization_name = SAML Identity Provider {{(pid=71939) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Nov 24 16:28:51.300691 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG uwsgi [-] saml.idp_contact_email = support@example.com {{(pid=71938) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Nov 24 16:28:51.300691 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG uwsgi [-] saml.idp_contact_name = SAML Identity Provider Support {{(pid=71938) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Nov 24 16:28:51.300804 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG uwsgi [-] saml.idp_organization_url = https://example.com/ {{(pid=71939) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Nov 24 16:28:51.300866 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG uwsgi [-] saml.idp_contact_surname = Support {{(pid=71938) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Nov 24 16:28:51.300927 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG uwsgi [-] saml.idp_sso_endpoint = None {{(pid=71939) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Nov 24 16:28:51.300989 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG uwsgi [-] saml.idp_contact_telephone = +1 800 555 0100 {{(pid=71938) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Nov 24 16:28:51.301100 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG uwsgi [-] saml.keyfile = /etc/keystone/ssl/private/signing_key.pem {{(pid=71939) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Nov 24 16:28:51.301236 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG uwsgi [-] saml.idp_contact_type = other {{(pid=71938) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Nov 24 16:28:51.301368 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG uwsgi [-] saml.relay_state_prefix = ss:mem: {{(pid=71939) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Nov 24 16:28:51.301499 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG uwsgi [-] saml.idp_entity_id = None {{(pid=71938) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Nov 24 16:28:51.301631 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG uwsgi [-] saml.xmlsec1_binary = xmlsec1 {{(pid=71939) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Nov 24 16:28:51.301762 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG uwsgi [-] saml.idp_lang = en {{(pid=71938) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Nov 24 16:28:51.301901 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG uwsgi [-] security_compliance.change_password_upon_first_use = False {{(pid=71939) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Nov 24 16:28:51.302092 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG uwsgi [-] saml.idp_metadata_path = /etc/keystone/saml2_idp_metadata.xml {{(pid=71938) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Nov 24 16:28:51.302228 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG uwsgi [-] security_compliance.disable_user_account_days_inactive = None {{(pid=71939) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Nov 24 16:28:51.302359 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG uwsgi [-] saml.idp_organization_display_name = OpenStack SAML Identity Provider {{(pid=71938) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Nov 24 16:28:51.302500 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG uwsgi [-] security_compliance.lockout_duration = 10 {{(pid=71939) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Nov 24 16:28:51.302639 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG uwsgi [-] saml.idp_organization_name = SAML Identity Provider {{(pid=71938) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Nov 24 16:28:51.302772 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG uwsgi [-] security_compliance.lockout_failure_attempts = 2 {{(pid=71939) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Nov 24 16:28:51.302772 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG uwsgi [-] security_compliance.minimum_password_age = 0 {{(pid=71939) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Nov 24 16:28:51.303019 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG uwsgi [-] saml.idp_organization_url = https://example.com/ {{(pid=71938) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Nov 24 16:28:51.303150 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG uwsgi [-] security_compliance.password_expires_days = None {{(pid=71939) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Nov 24 16:28:51.303281 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG uwsgi [-] saml.idp_sso_endpoint = None {{(pid=71938) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Nov 24 16:28:51.303419 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG uwsgi [-] security_compliance.password_regex = None {{(pid=71939) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Nov 24 16:28:51.303552 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG uwsgi [-] saml.keyfile = /etc/keystone/ssl/private/signing_key.pem {{(pid=71938) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Nov 24 16:28:51.303684 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG uwsgi [-] security_compliance.password_regex_description = None {{(pid=71939) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Nov 24 16:28:51.303816 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG uwsgi [-] saml.relay_state_prefix = ss:mem: {{(pid=71938) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Nov 24 16:28:51.303947 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG uwsgi [-] security_compliance.unique_last_password_count = 2 {{(pid=71939) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Nov 24 16:28:51.304078 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG uwsgi [-] saml.xmlsec1_binary = xmlsec1 {{(pid=71938) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Nov 24 16:28:51.304220 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG uwsgi [-] shadow_users.driver = sql {{(pid=71939) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Nov 24 16:28:51.304352 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG uwsgi [-] security_compliance.change_password_upon_first_use = False {{(pid=71938) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Nov 24 16:28:51.304484 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG uwsgi [-] token.allow_expired_window = 172800 {{(pid=71939) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Nov 24 16:28:51.304614 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG uwsgi [-] security_compliance.disable_user_account_days_inactive = None {{(pid=71938) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Nov 24 16:28:51.304744 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG uwsgi [-] token.allow_rescope_scoped_token = True {{(pid=71939) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Nov 24 16:28:51.304744 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG uwsgi [-] token.cache_on_issue = True {{(pid=71939) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Nov 24 16:28:51.304999 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG uwsgi [-] security_compliance.lockout_duration = 10 {{(pid=71938) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Nov 24 16:28:51.305132 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG uwsgi [-] token.cache_time = None {{(pid=71939) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Nov 24 16:28:51.305262 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG uwsgi [-] security_compliance.lockout_failure_attempts = 2 {{(pid=71938) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Nov 24 16:28:51.305393 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG uwsgi [-] token.caching = True {{(pid=71939) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Nov 24 16:28:51.305523 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG uwsgi [-] security_compliance.minimum_password_age = 0 {{(pid=71938) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Nov 24 16:28:51.305654 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG uwsgi [-] token.expiration = 3600 {{(pid=71939) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Nov 24 16:28:51.305792 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG uwsgi [-] security_compliance.password_expires_days = None {{(pid=71938) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Nov 24 16:28:51.305925 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG uwsgi [-] token.provider = fernet {{(pid=71939) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Nov 24 16:28:51.306070 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG uwsgi [-] security_compliance.password_regex = None {{(pid=71938) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Nov 24 16:28:51.306204 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG uwsgi [-] token.revoke_by_id = True {{(pid=71939) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Nov 24 16:28:51.306334 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG uwsgi [-] security_compliance.password_regex_description = None {{(pid=71938) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Nov 24 16:28:51.306471 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG uwsgi [-] tokenless_auth.issuer_attribute = SSL_CLIENT_I_DN {{(pid=71939) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Nov 24 16:28:51.306613 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG uwsgi [-] security_compliance.unique_last_password_count = 2 {{(pid=71938) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Nov 24 16:28:51.306745 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG uwsgi [-] tokenless_auth.protocol = x509 {{(pid=71939) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Nov 24 16:28:51.306876 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG uwsgi [-] shadow_users.driver = sql {{(pid=71938) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Nov 24 16:28:51.307007 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG uwsgi [-] tokenless_auth.trusted_issuer = [] {{(pid=71939) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Nov 24 16:28:51.307137 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG uwsgi [-] token.allow_expired_window = 172800 {{(pid=71938) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Nov 24 16:28:51.307267 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG uwsgi [-] totp.included_previous_windows = 1 {{(pid=71939) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Nov 24 16:28:51.307405 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG uwsgi [-] token.allow_rescope_scoped_token = True {{(pid=71938) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Nov 24 16:28:51.307536 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG uwsgi [-] trust.allow_redelegation = False {{(pid=71939) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Nov 24 16:28:51.307666 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG uwsgi [-] token.cache_on_issue = True {{(pid=71938) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Nov 24 16:28:51.307796 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG uwsgi [-] trust.driver = sql {{(pid=71939) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Nov 24 16:28:51.307928 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG uwsgi [-] token.cache_time = None {{(pid=71938) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Nov 24 16:28:51.308058 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG uwsgi [-] trust.max_redelegation_count = 3 {{(pid=71939) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Nov 24 16:28:51.308197 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG uwsgi [-] token.caching = True {{(pid=71938) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Nov 24 16:28:51.308328 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG uwsgi [-] unified_limit.cache_time = None {{(pid=71939) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Nov 24 16:28:51.308459 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG uwsgi [-] token.expiration = 3600 {{(pid=71938) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Nov 24 16:28:51.308563 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG uwsgi [-] unified_limit.caching = True {{(pid=71939) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Nov 24 16:28:51.308665 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG uwsgi [-] token.provider = fernet {{(pid=71938) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Nov 24 16:28:51.308766 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG uwsgi [-] unified_limit.driver = sql {{(pid=71939) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Nov 24 16:28:51.308875 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG uwsgi [-] token.revoke_by_id = True {{(pid=71938) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Nov 24 16:28:51.308944 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG uwsgi [-] unified_limit.enforcement_model = flat {{(pid=71939) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Nov 24 16:28:51.309007 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG uwsgi [-] tokenless_auth.issuer_attribute = SSL_CLIENT_I_DN {{(pid=71938) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Nov 24 16:28:51.309070 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG uwsgi [-] unified_limit.list_limit = None {{(pid=71939) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Nov 24 16:28:51.309131 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG uwsgi [-] tokenless_auth.protocol = x509 {{(pid=71938) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Nov 24 16:28:51.309193 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG uwsgi [-] wsgi.debug_middleware = False {{(pid=71939) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Nov 24 16:28:51.309318 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG uwsgi [-] tokenless_auth.trusted_issuer = [] {{(pid=71938) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Nov 24 16:28:51.309385 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG uwsgi [-] database.backend = sqlalchemy {{(pid=71939) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Nov 24 16:28:51.309448 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG uwsgi [-] totp.included_previous_windows = 1 {{(pid=71938) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Nov 24 16:28:51.309559 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG uwsgi [-] database.connection = **** {{(pid=71939) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Nov 24 16:28:51.309689 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG uwsgi [-] trust.allow_redelegation = False {{(pid=71938) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Nov 24 16:28:51.309820 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG uwsgi [-] database.connection_debug = 0 {{(pid=71939) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Nov 24 16:28:51.309959 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG uwsgi [-] trust.driver = sql {{(pid=71938) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Nov 24 16:28:51.310111 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG uwsgi [-] database.connection_parameters = {{(pid=71939) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Nov 24 16:28:51.310245 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG uwsgi [-] trust.max_redelegation_count = 3 {{(pid=71938) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Nov 24 16:28:51.310376 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG uwsgi [-] database.connection_recycle_time = 3600 {{(pid=71939) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Nov 24 16:28:51.310507 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG uwsgi [-] unified_limit.cache_time = None {{(pid=71938) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Nov 24 16:28:51.310637 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG uwsgi [-] database.connection_trace = False {{(pid=71939) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Nov 24 16:28:51.310780 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG uwsgi [-] unified_limit.caching = True {{(pid=71938) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Nov 24 16:28:51.310913 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG uwsgi [-] database.db_inc_retry_interval = True {{(pid=71939) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Nov 24 16:28:51.311045 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG uwsgi [-] unified_limit.driver = sql {{(pid=71938) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Nov 24 16:28:51.311176 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG uwsgi [-] database.db_max_retries = 20 {{(pid=71939) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Nov 24 16:28:51.311307 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG uwsgi [-] unified_limit.enforcement_model = flat {{(pid=71938) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Nov 24 16:28:51.311439 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG uwsgi [-] database.db_max_retry_interval = 10 {{(pid=71939) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Nov 24 16:28:51.311577 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG uwsgi [-] unified_limit.list_limit = None {{(pid=71938) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Nov 24 16:28:51.311709 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG uwsgi [-] database.db_retry_interval = 1 {{(pid=71939) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Nov 24 16:28:51.311840 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG uwsgi [-] wsgi.debug_middleware = False {{(pid=71938) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Nov 24 16:28:51.311971 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG uwsgi [-] database.max_overflow = 50 {{(pid=71939) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Nov 24 16:28:51.312102 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG uwsgi [-] database.backend = sqlalchemy {{(pid=71938) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Nov 24 16:28:51.312234 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG uwsgi [-] database.max_pool_size = 5 {{(pid=71939) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Nov 24 16:28:51.312373 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG uwsgi [-] database.connection = **** {{(pid=71938) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Nov 24 16:28:51.312505 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG uwsgi [-] database.max_retries = 10 {{(pid=71939) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Nov 24 16:28:51.312637 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG uwsgi [-] database.connection_debug = 0 {{(pid=71938) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Nov 24 16:28:51.312767 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG uwsgi [-] database.mysql_enable_ndb = False {{(pid=71939) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Nov 24 16:28:51.312898 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG uwsgi [-] database.connection_parameters = {{(pid=71938) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Nov 24 16:28:51.313029 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG uwsgi [-] database.mysql_sql_mode = TRADITIONAL {{(pid=71939) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Nov 24 16:28:51.313168 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG uwsgi [-] database.connection_recycle_time = 3600 {{(pid=71938) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Nov 24 16:28:51.313301 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG uwsgi [-] database.pool_timeout = None {{(pid=71939) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Nov 24 16:28:51.313432 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG uwsgi [-] database.connection_trace = False {{(pid=71938) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Nov 24 16:28:51.313562 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG uwsgi [-] database.retry_interval = 10 {{(pid=71939) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Nov 24 16:28:51.313666 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG uwsgi [-] database.db_inc_retry_interval = True {{(pid=71938) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Nov 24 16:28:51.313766 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG uwsgi [-] database.slave_connection = **** {{(pid=71939) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Nov 24 16:28:51.313876 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG uwsgi [-] database.db_max_retries = 20 {{(pid=71938) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Nov 24 16:28:51.313979 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG uwsgi [-] database.sqlite_synchronous = True {{(pid=71939) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Nov 24 16:28:51.314165 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG uwsgi [-] database.db_max_retry_interval = 10 {{(pid=71938) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Nov 24 16:28:51.314282 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG uwsgi [-] database.use_db_reconnect = False {{(pid=71939) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Nov 24 16:28:51.314282 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=71939) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2591}} Nov 24 16:28:51.314484 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG uwsgi [-] database.db_retry_interval = 1 {{(pid=71938) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Nov 24 16:28:51.314484 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG uwsgi [-] database.max_overflow = 50 {{(pid=71938) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Nov 24 16:28:51.314676 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG uwsgi [-] database.max_pool_size = 5 {{(pid=71938) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Nov 24 16:28:51.314777 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG uwsgi [-] database.max_retries = 10 {{(pid=71938) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Nov 24 16:28:51.315026 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG uwsgi [-] database.mysql_enable_ndb = False {{(pid=71938) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Nov 24 16:28:51.315311 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG uwsgi [-] database.mysql_sql_mode = TRADITIONAL {{(pid=71938) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Nov 24 16:28:51.315580 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG uwsgi [-] database.pool_timeout = None {{(pid=71938) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Nov 24 16:28:51.315857 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG uwsgi [-] database.retry_interval = 10 {{(pid=71938) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Nov 24 16:28:51.316119 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG uwsgi [-] database.slave_connection = **** {{(pid=71938) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Nov 24 16:28:51.316912 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG uwsgi [-] database.sqlite_synchronous = True {{(pid=71938) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Nov 24 16:28:51.317179 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG uwsgi [-] database.use_db_reconnect = False {{(pid=71938) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Nov 24 16:28:51.317379 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=71938) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2591}} Nov 24 16:28:51.345362 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.deleted`. {{(pid=71939) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Nov 24 16:28:51.345615 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.disabled`. {{(pid=71939) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Nov 24 16:28:51.345873 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_assignment_removal` subscribed to event `identity.remove_application_credentials_for_user.internal`. {{(pid=71939) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Nov 24 16:28:51.347346 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.deleted`. {{(pid=71938) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Nov 24 16:28:51.347633 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.disabled`. {{(pid=71938) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Nov 24 16:28:51.347900 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_assignment_removal` subscribed to event `identity.remove_application_credentials_for_user.internal`. {{(pid=71938) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Nov 24 16:28:51.356257 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.notifications [-] Callback: `keystone.assignment.core.Manager._delete_domain_assignments` subscribed to event `identity.domain.deleted`. {{(pid=71939) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Nov 24 16:28:51.358317 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.notifications [-] Callback: `keystone.assignment.core.Manager._delete_domain_assignments` subscribed to event `identity.domain.deleted`. {{(pid=71938) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Nov 24 16:28:51.385780 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.project.deleted`. {{(pid=71939) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Nov 24 16:28:51.386098 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.endpoint.deleted`. {{(pid=71939) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Nov 24 16:28:51.386368 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.project.deleted`. {{(pid=71938) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Nov 24 16:28:51.386635 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.endpoint.deleted`. {{(pid=71938) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Nov 24 16:28:51.503256 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.notifications [-] Callback: `keystone.federation.core.Manager._cleanup_identity_provider` subscribed to event `identity.domain_deleted.internal`. {{(pid=71939) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Nov 24 16:28:51.503730 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.notifications [-] Callback: `keystone.federation.core.Manager._cleanup_identity_provider` subscribed to event `identity.domain_deleted.internal`. {{(pid=71938) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Nov 24 16:28:51.556323 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._domain_deleted` subscribed to event `identity.domain_deleted.internal`. {{(pid=71939) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Nov 24 16:28:51.556583 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._unset_default_project` subscribed to event `identity.project.deleted`. {{(pid=71939) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Nov 24 16:28:51.557319 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._domain_deleted` subscribed to event `identity.domain_deleted.internal`. {{(pid=71938) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Nov 24 16:28:51.557592 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._unset_default_project` subscribed to event `identity.project.deleted`. {{(pid=71938) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Nov 24 16:28:51.626905 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._trust_callback` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=71939) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Nov 24 16:28:51.627113 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._trust_callback` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=71938) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Nov 24 16:28:51.627271 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._consumer_callback` subscribed to event `identity.OS-OAUTH1:consumer.deleted`. {{(pid=71939) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Nov 24 16:28:51.627392 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._consumer_callback` subscribed to event `identity.OS-OAUTH1:consumer.deleted`. {{(pid=71938) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Nov 24 16:28:51.627486 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.deleted`. {{(pid=71939) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Nov 24 16:28:51.627576 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.deleted`. {{(pid=71938) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Nov 24 16:28:51.627664 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._project_callback` subscribed to event `identity.project.deleted`. {{(pid=71939) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Nov 24 16:28:51.627753 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._project_callback` subscribed to event `identity.project.deleted`. {{(pid=71938) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Nov 24 16:28:51.627849 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.disabled`. {{(pid=71939) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Nov 24 16:28:51.627939 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.disabled`. {{(pid=71938) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Nov 24 16:28:51.628026 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.persist_revocation_event_for_user.internal`. {{(pid=71939) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Nov 24 16:28:51.628114 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.persist_revocation_event_for_user.internal`. {{(pid=71938) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Nov 24 16:28:51.654167 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=71939) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Nov 24 16:28:51.654428 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.deleted`. {{(pid=71939) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Nov 24 16:28:51.654554 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=71938) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Nov 24 16:28:51.654692 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.deleted`. {{(pid=71939) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Nov 24 16:28:51.654791 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.deleted`. {{(pid=71938) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Nov 24 16:28:51.654944 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.disabled`. {{(pid=71939) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Nov 24 16:28:51.655042 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.deleted`. {{(pid=71938) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Nov 24 16:28:51.655188 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.disabled`. {{(pid=71939) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Nov 24 16:28:51.655286 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.disabled`. {{(pid=71938) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Nov 24 16:28:51.655428 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.project.disabled`. {{(pid=71939) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Nov 24 16:28:51.655524 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.disabled`. {{(pid=71938) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Nov 24 16:28:51.655670 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.project.disabled`. {{(pid=71938) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Nov 24 16:28:51.655774 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=71939) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Nov 24 16:28:51.655918 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=71938) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Nov 24 16:28:51.667788 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.notifications [-] Callback: `keystone.trust.core.Manager._on_user_delete` subscribed to event `identity.user.deleted`. {{(pid=71939) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Nov 24 16:28:51.668264 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.notifications [-] Callback: `keystone.trust.core.Manager._on_user_delete` subscribed to event `identity.user.deleted`. {{(pid=71938) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Nov 24 16:28:51.680733 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=71939) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Nov 24 16:28:51.680992 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.deleted`. {{(pid=71939) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Nov 24 16:28:51.681245 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.deleted`. {{(pid=71939) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Nov 24 16:28:51.681348 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=71938) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Nov 24 16:28:51.681495 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.disabled`. {{(pid=71939) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Nov 24 16:28:51.681593 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.deleted`. {{(pid=71938) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Nov 24 16:28:51.681742 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.disabled`. {{(pid=71939) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Nov 24 16:28:51.681849 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.deleted`. {{(pid=71938) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Nov 24 16:28:51.681985 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.project.disabled`. {{(pid=71939) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Nov 24 16:28:51.682115 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.disabled`. {{(pid=71938) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Nov 24 16:28:51.682254 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=71939) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Nov 24 16:28:51.682351 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.disabled`. {{(pid=71938) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Nov 24 16:28:51.682497 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.project.disabled`. {{(pid=71938) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Nov 24 16:28:51.682743 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=71938) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Nov 24 16:28:51.702528 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/projects' {}] {{(pid=71939) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:420}} Nov 24 16:28:51.702768 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/projects' {}] {{(pid=71939) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:437}} Nov 24 16:28:51.703141 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/domains' {}] {{(pid=71939) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:420}} Nov 24 16:28:51.703240 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/projects' {}] {{(pid=71938) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:420}} Nov 24 16:28:51.703347 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/domains' {}] {{(pid=71939) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:437}} Nov 24 16:28:51.703441 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/projects' {}] {{(pid=71938) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:437}} Nov 24 16:28:51.703761 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/domains' {}] {{(pid=71938) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:420}} Nov 24 16:28:51.703858 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/system' {}] {{(pid=71939) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:420}} Nov 24 16:28:51.703997 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/domains' {}] {{(pid=71938) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:437}} Nov 24 16:28:51.704102 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/catalog' {}] {{(pid=71939) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:420}} Nov 24 16:28:51.704354 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens/OS-PKI/revoked' {}] {{(pid=71939) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:420}} Nov 24 16:28:51.704701 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/system' {}] {{(pid=71938) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:420}} Nov 24 16:28:51.704898 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens' {}] {{(pid=71939) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:420}} Nov 24 16:28:51.704994 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/catalog' {}] {{(pid=71938) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:420}} Nov 24 16:28:51.705269 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens/OS-PKI/revoked' {}] {{(pid=71938) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:420}} Nov 24 16:28:51.705610 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens' {}] {{(pid=71938) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:420}} Nov 24 16:28:51.716788 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2' {}] {{(pid=71939) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:420}} Nov 24 16:28:51.717101 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2/ecp' {}] {{(pid=71939) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:420}} Nov 24 16:28:51.717405 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/websso/' {}] {{(pid=71939) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:420}} Nov 24 16:28:51.717503 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2' {}] {{(pid=71938) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:420}} Nov 24 16:28:51.717715 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/identity_providers//protocols//websso' {}] {{(pid=71939) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:420}} Nov 24 16:28:51.717813 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2/ecp' {}] {{(pid=71938) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:420}} Nov 24 16:28:51.718140 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/websso/' {}] {{(pid=71938) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:420}} Nov 24 16:28:51.718457 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/identity_providers//protocols//websso' {}] {{(pid=71938) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:420}} Nov 24 16:28:51.727077 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.common [-] Adding standard routes to API credentials for `MethodViewType` (API Prefix: ) [/credentials, /credentials/] {{(pid=71939) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:350}} Nov 24 16:28:51.728084 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.common [-] Adding standard routes to API credentials for `MethodViewType` (API Prefix: ) [/credentials, /credentials/] {{(pid=71938) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:350}} Nov 24 16:28:51.730681 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.common [-] Adding standard routes to API domains for `MethodViewType` (API Prefix: ) [/domains, /domains/] {{(pid=71939) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:350}} Nov 24 16:28:51.730995 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config' {}] {{(pid=71939) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:420}} Nov 24 16:28:51.731310 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config/' {}] {{(pid=71939) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:420}} Nov 24 16:28:51.731626 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config//' {}] {{(pid=71939) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:420}} Nov 24 16:28:51.731724 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.common [-] Adding standard routes to API domains for `MethodViewType` (API Prefix: ) [/domains, /domains/] {{(pid=71938) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:350}} Nov 24 16:28:51.731940 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config/default' {}] {{(pid=71939) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:420}} Nov 24 16:28:51.732039 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config' {}] {{(pid=71938) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:420}} Nov 24 16:28:51.732236 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config//default' {}] {{(pid=71939) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:420}} Nov 24 16:28:51.732332 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config/' {}] {{(pid=71938) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:420}} Nov 24 16:28:51.732537 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config///default' {}] {{(pid=71939) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:420}} Nov 24 16:28:51.732642 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config//' {}] {{(pid=71938) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:420}} Nov 24 16:28:51.732843 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles' {}] {{(pid=71939) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:420}} Nov 24 16:28:51.732940 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config/default' {}] {{(pid=71938) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:420}} Nov 24 16:28:51.733145 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config//default' {}] {{(pid=71938) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:420}} Nov 24 16:28:51.733241 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles/' {}] {{(pid=71939) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:420}} Nov 24 16:28:51.733443 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles' {}] {{(pid=71939) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:420}} Nov 24 16:28:51.733539 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config///default' {}] {{(pid=71938) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:420}} Nov 24 16:28:51.733741 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles/' {}] {{(pid=71939) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:420}} Nov 24 16:28:51.733838 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles' {}] {{(pid=71938) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:420}} Nov 24 16:28:51.734064 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles/' {}] {{(pid=71938) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:420}} Nov 24 16:28:51.734365 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles' {}] {{(pid=71938) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:420}} Nov 24 16:28:51.734668 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles/' {}] {{(pid=71938) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:420}} Nov 24 16:28:51.764042 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.common [-] Adding resource routes to API ec2tokens: ['/ec2tokens' {}] {{(pid=71939) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:420}} Nov 24 16:28:51.765053 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.common [-] Adding resource routes to API ec2tokens: ['/ec2tokens' {}] {{(pid=71938) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:420}} Nov 24 16:28:51.765743 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.common [-] Adding standard routes to API endpoints for `MethodViewType` (API Prefix: ) [/endpoints, /endpoints/] {{(pid=71939) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:350}} Nov 24 16:28:51.766082 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.common [-] Adding resource routes to API endpoints: ['/endpoints//OS-ENDPOINT-POLICY/policy' {}] {{(pid=71939) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:420}} Nov 24 16:28:51.766858 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.common [-] Adding standard routes to API endpoints for `MethodViewType` (API Prefix: ) [/endpoints, /endpoints/] {{(pid=71938) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:350}} Nov 24 16:28:51.767174 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.common [-] Adding resource routes to API endpoints: ['/endpoints//OS-ENDPOINT-POLICY/policy' {}] {{(pid=71938) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:420}} Nov 24 16:28:51.773101 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.common [-] Adding standard routes to API groups for `MethodViewType` (API Prefix: ) [/groups, /groups/] {{(pid=71939) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:350}} Nov 24 16:28:51.773268 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.common [-] Adding standard routes to API groups for `MethodViewType` (API Prefix: ) [/groups, /groups/] {{(pid=71938) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:350}} Nov 24 16:28:51.773412 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users' {}] {{(pid=71939) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:420}} Nov 24 16:28:51.773608 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users' {}] {{(pid=71938) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:420}} Nov 24 16:28:51.773707 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users/' {}] {{(pid=71939) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:420}} Nov 24 16:28:51.773924 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users/' {}] {{(pid=71938) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:420}} Nov 24 16:28:51.781659 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.common [-] Adding standard routes to API limits for `MethodViewType` (API Prefix: ) [/limits, /limits/] {{(pid=71939) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:350}} Nov 24 16:28:51.782009 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.common [-] Adding standard routes to API limits for `MethodViewType` (API Prefix: ) [/limits, /limits/] {{(pid=71938) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:350}} Nov 24 16:28:51.782171 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.common [-] Adding resource routes to API limits: ['/limits/model' {}] {{(pid=71939) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:420}} Nov 24 16:28:51.782348 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.common [-] Adding resource routes to API limits: ['/limits/model' {}] {{(pid=71938) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:420}} Nov 24 16:28:51.786875 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-EP-FILTER for `MethodViewType` (API Prefix: /OS-EP-FILTER) [/endpoint_groups, /endpoint_groups/] {{(pid=71939) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:350}} Nov 24 16:28:51.787191 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoints//projects' {}] {{(pid=71939) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:420}} Nov 24 16:28:51.787290 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-EP-FILTER for `MethodViewType` (API Prefix: /OS-EP-FILTER) [/endpoint_groups, /endpoint_groups/] {{(pid=71938) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:350}} Nov 24 16:28:51.787505 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoints//projects' {}] {{(pid=71938) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:420}} Nov 24 16:28:51.787613 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints/' {}] {{(pid=71939) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:420}} Nov 24 16:28:51.787818 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints' {}] {{(pid=71939) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:420}} Nov 24 16:28:51.787913 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints/' {}] {{(pid=71938) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:420}} Nov 24 16:28:51.788126 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoint_groups' {}] {{(pid=71939) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:420}} Nov 24 16:28:51.788222 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints' {}] {{(pid=71938) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:420}} Nov 24 16:28:51.788438 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoint_groups' {}] {{(pid=71938) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:420}} Nov 24 16:28:51.788535 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//endpoints' {}] {{(pid=71939) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:420}} Nov 24 16:28:51.788748 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//endpoints' {}] {{(pid=71938) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:420}} Nov 24 16:28:51.788843 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects' {}] {{(pid=71939) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:420}} Nov 24 16:28:51.789121 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects/' {}] {{(pid=71939) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:420}} Nov 24 16:28:51.789223 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects' {}] {{(pid=71938) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:420}} Nov 24 16:28:51.789447 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects/' {}] {{(pid=71938) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:420}} Nov 24 16:28:51.810853 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/saml2/metadata' {}] {{(pid=71939) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:420}} Nov 24 16:28:51.811165 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/identity_providers//protocols//auth' {}] {{(pid=71939) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:420}} Nov 24 16:28:51.811406 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/saml2/metadata' {}] {{(pid=71938) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:420}} Nov 24 16:28:51.811723 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/identity_providers//protocols//auth' {}] {{(pid=71938) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:420}} Nov 24 16:28:51.817055 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.common [-] Adding standard routes to API identity_providers for `MethodViewType` (API Prefix: /OS-FEDERATION) [/identity_providers, /identity_providers/] {{(pid=71939) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:350}} Nov 24 16:28:51.817597 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.common [-] Adding standard routes to API identity_providers for `MethodViewType` (API Prefix: /OS-FEDERATION) [/identity_providers, /identity_providers/] {{(pid=71938) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:350}} Nov 24 16:28:51.821243 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols/' {}] {{(pid=71939) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:420}} Nov 24 16:28:51.821566 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols' {}] {{(pid=71939) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:420}} Nov 24 16:28:51.821836 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols/' {}] {{(pid=71938) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:420}} Nov 24 16:28:51.822216 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols' {}] {{(pid=71938) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:420}} Nov 24 16:28:51.827383 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.common [-] Adding standard routes to API mappings for `MethodViewType` (API Prefix: /OS-FEDERATION) [/mappings, /mappings/] {{(pid=71939) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:350}} Nov 24 16:28:51.828047 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.common [-] Adding standard routes to API mappings for `MethodViewType` (API Prefix: /OS-FEDERATION) [/mappings, /mappings/] {{(pid=71938) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:350}} Nov 24 16:28:51.831673 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.common [-] Adding standard routes to API service_providers for `MethodViewType` (API Prefix: /OS-FEDERATION) [/service_providers, /service_providers/] {{(pid=71939) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:350}} Nov 24 16:28:51.832392 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.common [-] Adding standard routes to API service_providers for `MethodViewType` (API Prefix: /OS-FEDERATION) [/service_providers, /service_providers/] {{(pid=71938) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:350}} Nov 24 16:28:51.835976 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles//inherited_to_projects' {}] {{(pid=71939) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:420}} Nov 24 16:28:51.836303 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles/inherited_to_projects' {}] {{(pid=71939) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:420}} Nov 24 16:28:51.836625 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles//inherited_to_projects' {}] {{(pid=71939) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:420}} Nov 24 16:28:51.836721 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles//inherited_to_projects' {}] {{(pid=71938) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:420}} Nov 24 16:28:51.836937 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles/inherited_to_projects' {}] {{(pid=71939) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:420}} Nov 24 16:28:51.837045 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles/inherited_to_projects' {}] {{(pid=71938) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:420}} Nov 24 16:28:51.837244 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//users//roles//inherited_to_projects' {}] {{(pid=71939) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:420}} Nov 24 16:28:51.837340 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles//inherited_to_projects' {}] {{(pid=71938) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:420}} Nov 24 16:28:51.837566 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//groups//roles//inherited_to_projects' {}] {{(pid=71939) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:420}} Nov 24 16:28:51.837662 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles/inherited_to_projects' {}] {{(pid=71938) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:420}} Nov 24 16:28:51.837870 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//users//roles//inherited_to_projects' {}] {{(pid=71938) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:420}} Nov 24 16:28:51.838218 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//groups//roles//inherited_to_projects' {}] {{(pid=71938) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:420}} Nov 24 16:28:51.859353 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-OAUTH1 for `MethodViewType` (API Prefix: /OS-OAUTH1) [/consumers, /consumers/] {{(pid=71939) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:350}} Nov 24 16:28:51.859675 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/request_token' {}] {{(pid=71939) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:420}} Nov 24 16:28:51.859981 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/access_token' {}] {{(pid=71939) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:420}} Nov 24 16:28:51.860247 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-OAUTH1 for `MethodViewType` (API Prefix: /OS-OAUTH1) [/consumers, /consumers/] {{(pid=71938) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:350}} Nov 24 16:28:51.860344 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/authorize/' {}] {{(pid=71939) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:420}} Nov 24 16:28:51.860573 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/request_token' {}] {{(pid=71938) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:420}} Nov 24 16:28:51.860885 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/access_token' {}] {{(pid=71938) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:420}} Nov 24 16:28:51.861194 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/authorize/' {}] {{(pid=71938) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:420}} Nov 24 16:28:51.871482 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.common [-] Adding resource routes to API events: ['/events' {}] {{(pid=71939) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:420}} Nov 24 16:28:51.872022 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.common [-] Adding resource routes to API events: ['/events' {}] {{(pid=71938) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:420}} Nov 24 16:28:51.873942 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/ca' {}] {{(pid=71938) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:420}} Nov 24 16:28:51.874299 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/certificates' {}] {{(pid=71938) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:420}} Nov 24 16:28:51.877231 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/ca' {}] {{(pid=71939) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:420}} Nov 24 16:28:51.877544 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/certificates' {}] {{(pid=71939) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:420}} Nov 24 16:28:51.877775 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.common [-] Adding standard routes to API policy for `MethodViewType` (API Prefix: ) [/policies, /policies/] {{(pid=71938) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:350}} Nov 24 16:28:51.878133 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints' {}] {{(pid=71938) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:420}} Nov 24 16:28:51.878466 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints/' {}] {{(pid=71938) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:420}} Nov 24 16:28:51.878789 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services/' {}] {{(pid=71938) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:420}} Nov 24 16:28:51.879665 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services//regions/' {}] {{(pid=71938) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:420}} Nov 24 16:28:51.881794 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.common [-] Adding standard routes to API policy for `MethodViewType` (API Prefix: ) [/policies, /policies/] {{(pid=71939) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:350}} Nov 24 16:28:51.882128 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints' {}] {{(pid=71939) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:420}} Nov 24 16:28:51.882451 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints/' {}] {{(pid=71939) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:420}} Nov 24 16:28:51.882761 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services/' {}] {{(pid=71939) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:420}} Nov 24 16:28:51.883077 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services//regions/' {}] {{(pid=71939) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:420}} Nov 24 16:28:51.895150 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.common [-] Adding standard routes to API projects for `MethodViewType` (API Prefix: ) [/projects, /projects/] {{(pid=71938) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:350}} Nov 24 16:28:51.895466 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags' {}] {{(pid=71938) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:420}} Nov 24 16:28:51.895782 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags/' {}] {{(pid=71938) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:420}} Nov 24 16:28:51.896196 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles/' {}] {{(pid=71938) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:420}} Nov 24 16:28:51.896403 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles' {}] {{(pid=71938) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:420}} Nov 24 16:28:51.896698 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles/' {}] {{(pid=71938) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:420}} Nov 24 16:28:51.897015 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles' {}] {{(pid=71938) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:420}} Nov 24 16:28:51.899985 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.common [-] Adding standard routes to API projects for `MethodViewType` (API Prefix: ) [/projects, /projects/] {{(pid=71939) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:350}} Nov 24 16:28:51.900311 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags' {}] {{(pid=71939) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:420}} Nov 24 16:28:51.900628 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags/' {}] {{(pid=71939) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:420}} Nov 24 16:28:51.900944 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles/' {}] {{(pid=71939) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:420}} Nov 24 16:28:51.901278 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles' {}] {{(pid=71939) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:420}} Nov 24 16:28:51.901590 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles/' {}] {{(pid=71939) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:420}} Nov 24 16:28:51.901907 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles' {}] {{(pid=71939) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:420}} Nov 24 16:28:51.917345 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.common [-] Adding standard routes to API regions for `MethodViewType` (API Prefix: ) [/regions, /regions/] {{(pid=71938) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:350}} Nov 24 16:28:51.920991 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.common [-] Adding standard routes to API registered_limit for `MethodViewType` (API Prefix: ) [/registered_limits, /registered_limits/] {{(pid=71938) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:350}} Nov 24 16:28:51.922065 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.common [-] Adding standard routes to API regions for `MethodViewType` (API Prefix: ) [/regions, /regions/] {{(pid=71939) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:350}} Nov 24 16:28:51.924734 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_assignments: ['/role_assignments' {}] {{(pid=71938) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:420}} Nov 24 16:28:51.925608 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.common [-] Adding standard routes to API registered_limit for `MethodViewType` (API Prefix: ) [/registered_limits, /registered_limits/] {{(pid=71939) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:350}} Nov 24 16:28:51.927053 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_inferences: ['/role_inferences' {}] {{(pid=71938) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:420}} Nov 24 16:28:51.928881 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.common [-] Adding standard routes to API roles for `MethodViewType` (API Prefix: ) [/roles, /roles/] {{(pid=71938) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:350}} Nov 24 16:28:51.929196 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies' {}] {{(pid=71938) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:420}} Nov 24 16:28:51.929627 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies/' {}] {{(pid=71938) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:420}} Nov 24 16:28:51.929847 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_assignments: ['/role_assignments' {}] {{(pid=71939) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:420}} Nov 24 16:28:51.931682 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_inferences: ['/role_inferences' {}] {{(pid=71939) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:420}} Nov 24 16:28:51.933490 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.common [-] Adding standard routes to API roles for `MethodViewType` (API Prefix: ) [/roles, /roles/] {{(pid=71939) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:350}} Nov 24 16:28:51.933807 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies' {}] {{(pid=71939) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:420}} Nov 24 16:28:51.934259 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies/' {}] {{(pid=71939) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:420}} Nov 24 16:28:51.937773 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.common [-] Adding resource routes to API s3tokens: ['/s3tokens' {}] {{(pid=71938) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:420}} Nov 24 16:28:51.939677 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.common [-] Adding standard routes to API services for `MethodViewType` (API Prefix: ) [/services, /services/] {{(pid=71938) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:350}} Nov 24 16:28:51.942814 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.common [-] Adding resource routes to API s3tokens: ['/s3tokens' {}] {{(pid=71939) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:420}} Nov 24 16:28:51.943802 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles' {}] {{(pid=71938) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:420}} Nov 24 16:28:51.944131 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles/' {}] {{(pid=71938) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:420}} Nov 24 16:28:51.944451 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles' {}] {{(pid=71938) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:420}} Nov 24 16:28:51.944551 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.common [-] Adding standard routes to API services for `MethodViewType` (API Prefix: ) [/services, /services/] {{(pid=71939) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:350}} Nov 24 16:28:51.944760 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles/' {}] {{(pid=71938) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:420}} Nov 24 16:28:51.948097 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles' {}] {{(pid=71939) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:420}} Nov 24 16:28:51.948425 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles/' {}] {{(pid=71939) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:420}} Nov 24 16:28:51.948738 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles' {}] {{(pid=71939) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:420}} Nov 24 16:28:51.949044 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles/' {}] {{(pid=71939) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:420}} Nov 24 16:28:51.955297 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.common [-] Adding standard routes to API trusts for `MethodViewType` (API Prefix: /OS-TRUST) [/trusts, /trusts/] {{(pid=71938) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:350}} Nov 24 16:28:51.955621 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles' {}] {{(pid=71938) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:420}} Nov 24 16:28:51.955946 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles/' {}] {{(pid=71938) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:420}} Nov 24 16:28:51.960155 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.common [-] Adding standard routes to API trusts for `MethodViewType` (API Prefix: /OS-TRUST) [/trusts, /trusts/] {{(pid=71939) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:350}} Nov 24 16:28:51.960469 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles' {}] {{(pid=71939) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:420}} Nov 24 16:28:51.960788 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles/' {}] {{(pid=71939) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:420}} Nov 24 16:28:51.965396 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.common [-] Adding standard routes to API users for `MethodViewType` (API Prefix: ) [/users, /users/] {{(pid=71938) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:350}} Nov 24 16:28:51.965707 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//password' {}] {{(pid=71938) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:420}} Nov 24 16:28:51.966059 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//groups' {}] {{(pid=71938) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:420}} Nov 24 16:28:51.966374 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//projects' {}] {{(pid=71938) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:420}} Nov 24 16:28:51.966690 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2' {}] {{(pid=71938) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:420}} Nov 24 16:28:51.967008 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2/' {}] {{(pid=71938) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:420}} Nov 24 16:28:51.967327 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens' {}] {{(pid=71938) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:420}} Nov 24 16:28:51.967630 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens/' {}] {{(pid=71938) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:420}} Nov 24 16:28:51.968026 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles' {}] {{(pid=71938) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:420}} Nov 24 16:28:51.968339 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles/' {}] {{(pid=71938) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:420}} Nov 24 16:28:51.968651 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials' {}] {{(pid=71938) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:420}} Nov 24 16:28:51.968946 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials/' {}] {{(pid=71938) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:420}} Nov 24 16:28:51.969261 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules' {}] {{(pid=71938) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:420}} Nov 24 16:28:51.969558 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.common [-] Adding standard routes to API users for `MethodViewType` (API Prefix: ) [/users, /users/] {{(pid=71939) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:350}} Nov 24 16:28:51.969693 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules/' {}] {{(pid=71938) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:420}} Nov 24 16:28:51.969874 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//password' {}] {{(pid=71939) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:420}} Nov 24 16:28:51.970220 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//groups' {}] {{(pid=71939) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:420}} Nov 24 16:28:51.970529 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//projects' {}] {{(pid=71939) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:420}} Nov 24 16:28:51.970841 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2' {}] {{(pid=71939) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:420}} Nov 24 16:28:51.971156 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2/' {}] {{(pid=71939) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:420}} Nov 24 16:28:51.971471 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens' {}] {{(pid=71939) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:420}} Nov 24 16:28:51.971773 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens/' {}] {{(pid=71939) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:420}} Nov 24 16:28:51.972159 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles' {}] {{(pid=71939) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:420}} Nov 24 16:28:51.972461 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles/' {}] {{(pid=71939) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:420}} Nov 24 16:28:51.973356 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials' {}] {{(pid=71939) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:420}} Nov 24 16:28:51.973625 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials/' {}] {{(pid=71939) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:420}} Nov 24 16:28:51.973936 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules' {}] {{(pid=71939) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:420}} Nov 24 16:28:51.974270 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules/' {}] {{(pid=71939) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:420}} Nov 24 16:28:52.013362 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: WSGI app 0 (mountpoint='') ready in 4 seconds on interpreter 0x55b755fa15f0 pid: 71938 (default app) Nov 24 16:28:52.016989 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: WSGI app 0 (mountpoint='') ready in 4 seconds on interpreter 0x55b755fa15f0 pid: 71939 (default app) Nov 24 16:28:52.017430 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b84308a6-23f6-40a0-9160-3fcf10982ee5 None None] REQUEST_METHOD: `GET` {{(pid=71938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 24 16:28:52.017777 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b84308a6-23f6-40a0-9160-3fcf10982ee5 None None] SCRIPT_NAME: `/identity` {{(pid=71938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 24 16:28:52.018134 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b84308a6-23f6-40a0-9160-3fcf10982ee5 None None] PATH_INFO: `/v3` {{(pid=71938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 24 16:28:52.023056 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: [pid: 71938|app: 0|req: 1/1] 10.222.0.53 () {50 vars in 782 bytes} [Wed Nov 24 16:28:52 2021] GET /identity/v3/ => generated 255 bytes in 9 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 24 16:28:57.643939 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3493cc43-0aac-4880-b888-06abbc915bd6 None None] REQUEST_METHOD: `GET` {{(pid=71939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 24 16:28:57.645000 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3493cc43-0aac-4880-b888-06abbc915bd6 None None] SCRIPT_NAME: `/identity` {{(pid=71939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 24 16:28:57.645092 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3493cc43-0aac-4880-b888-06abbc915bd6 None None] PATH_INFO: `/` {{(pid=71939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 24 16:28:57.650367 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: [pid: 71939|app: 0|req: 1/2] 10.222.0.53 () {54 vars in 915 bytes} [Wed Nov 24 16:28:57 2021] GET /identity => generated 270 bytes in 10 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 24 16:28:57.656111 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efa41a40-6846-4709-9110-7eefb97ac63b None None] REQUEST_METHOD: `POST` {{(pid=71938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 24 16:28:57.656452 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efa41a40-6846-4709-9110-7eefb97ac63b None None] SCRIPT_NAME: `/identity` {{(pid=71938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 24 16:28:57.656784 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efa41a40-6846-4709-9110-7eefb97ac63b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=71938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 24 16:28:57.699267 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG oslo_db.sqlalchemy.engines [None req-efa41a40-6846-4709-9110-7eefb97ac63b None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_AUTO_CREATE_USER,NO_ENGINE_SUBSTITUTION {{(pid=71938) _check_effective_sql_mode /usr/local/lib/python3.6/dist-packages/oslo_db/sqlalchemy/engines.py:304}} Nov 24 16:28:57.862069 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG passlib.handlers.bcrypt [None req-efa41a40-6846-4709-9110-7eefb97ac63b None None] detected 'bcrypt' backend, version '3.1.7' {{(pid=71938) _load_backend_mixin /usr/local/lib/python3.6/dist-packages/passlib/handlers/bcrypt.py:567}} Nov 24 16:28:57.862519 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG passlib.handlers.bcrypt [None req-efa41a40-6846-4709-9110-7eefb97ac63b None None] 'bcrypt' backend lacks $2$ support, enabling workaround {{(pid=71938) _finalize_backend_mixin /usr/local/lib/python3.6/dist-packages/passlib/handlers/bcrypt.py:382}} Nov 24 16:28:57.924710 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.auth.core [None req-efa41a40-6846-4709-9110-7eefb97ac63b None None] MFA Rules not processed for user `0f2ba2e8375b4e8c8792ee1e22b60427`. Rule list: `[]` (Enabled: `True`). {{(pid=71938) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:442}} Nov 24 16:28:57.926384 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.fernet_utils [None req-efa41a40-6846-4709-9110-7eefb97ac63b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=71938) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:289}} Nov 24 16:28:58.027695 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: [pid: 71938|app: 0|req: 2/3] 10.222.0.53 () {58 vars in 1013 bytes} [Wed Nov 24 16:28:57 2021] POST /identity/v3/auth/tokens => generated 1067 bytes in 373 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 24 16:28:58.109007 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ceafa57-1fb5-4255-8c24-4e84f21a6ca3 None None] REQUEST_METHOD: `POST` {{(pid=71939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 24 16:28:58.109321 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ceafa57-1fb5-4255-8c24-4e84f21a6ca3 None None] SCRIPT_NAME: `/identity` {{(pid=71939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 24 16:28:58.109656 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ceafa57-1fb5-4255-8c24-4e84f21a6ca3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=71939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 24 16:28:58.155997 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG oslo_db.sqlalchemy.engines [None req-8ceafa57-1fb5-4255-8c24-4e84f21a6ca3 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_AUTO_CREATE_USER,NO_ENGINE_SUBSTITUTION {{(pid=71939) _check_effective_sql_mode /usr/local/lib/python3.6/dist-packages/oslo_db/sqlalchemy/engines.py:304}} Nov 24 16:28:58.275270 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG passlib.handlers.bcrypt [None req-8ceafa57-1fb5-4255-8c24-4e84f21a6ca3 None None] detected 'bcrypt' backend, version '3.1.7' {{(pid=71939) _load_backend_mixin /usr/local/lib/python3.6/dist-packages/passlib/handlers/bcrypt.py:567}} Nov 24 16:28:58.275733 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG passlib.handlers.bcrypt [None req-8ceafa57-1fb5-4255-8c24-4e84f21a6ca3 None None] 'bcrypt' backend lacks $2$ support, enabling workaround {{(pid=71939) _finalize_backend_mixin /usr/local/lib/python3.6/dist-packages/passlib/handlers/bcrypt.py:382}} Nov 24 16:28:58.321921 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.auth.core [None req-8ceafa57-1fb5-4255-8c24-4e84f21a6ca3 None None] MFA Rules not processed for user `0f2ba2e8375b4e8c8792ee1e22b60427`. Rule list: `[]` (Enabled: `True`). {{(pid=71939) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:442}} Nov 24 16:28:58.323616 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.fernet_utils [None req-8ceafa57-1fb5-4255-8c24-4e84f21a6ca3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=71939) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:289}} Nov 24 16:28:58.333789 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: [pid: 71939|app: 0|req: 2/4] 10.222.0.53 () {58 vars in 1013 bytes} [Wed Nov 24 16:28:58 2021] POST /identity/v3/auth/tokens => generated 1067 bytes in 226 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Nov 24 16:28:58.339963 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efa41a40-6846-4709-9110-7eefb97ac63b None None] Authenticating user token {{(pid=71938) process_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 24 16:28:58.352511 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efa41a40-6846-4709-9110-7eefb97ac63b None None] Validating token access rules against request {{(pid=71938) validate_allowed_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 24 16:28:58.356910 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d3e4192-56a1-4c31-ad01-7c7a51e3b612 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f2ba2e8375b4e8c8792ee1e22b60427', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '00a5583c7b7443e98e7a1d31a0b638dc', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=71938) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 24 16:28:58.357571 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d3e4192-56a1-4c31-ad01-7c7a51e3b612 admin admin] REQUEST_METHOD: `GET` {{(pid=71938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 24 16:28:58.357911 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d3e4192-56a1-4c31-ad01-7c7a51e3b612 admin admin] SCRIPT_NAME: `/identity` {{(pid=71938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 24 16:28:58.358271 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d3e4192-56a1-4c31-ad01-7c7a51e3b612 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=71938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 24 16:28:58.367691 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d3e4192-56a1-4c31-ad01-7c7a51e3b612 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=71938) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:442}} Nov 24 16:28:58.410469 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: WARNING keystone.common.rbac_enforcer.enforcer [None req-0d3e4192-56a1-4c31-ad01-7c7a51e3b612 admin admin] Deprecated policy rules found. Use oslopolicy-policy-generator and oslopolicy-policy-upgrade to detect and resolve deprecated policies in your configuration. Nov 24 16:28:58.410852 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d3e4192-56a1-4c31-ad01-7c7a51e3b612 admin admin] RBAC: Authorization granted {{(pid=71938) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 24 16:28:58.420973 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: [pid: 71938|app: 0|req: 3/5] 10.222.0.53 () {58 vars in 1315 bytes} [Wed Nov 24 16:28:58 2021] GET /identity/v3/auth/tokens => generated 1067 bytes in 82 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 24 16:28:58.427938 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ceafa57-1fb5-4255-8c24-4e84f21a6ca3 None None] Authenticating user token {{(pid=71939) process_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 24 16:28:58.440506 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ceafa57-1fb5-4255-8c24-4e84f21a6ca3 None None] Validating token access rules against request {{(pid=71939) validate_allowed_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 24 16:28:58.445430 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07ec2193-3f20-4410-9b06-3ded53d60ccf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f2ba2e8375b4e8c8792ee1e22b60427', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '00a5583c7b7443e98e7a1d31a0b638dc', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=71939) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 24 16:28:58.446317 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07ec2193-3f20-4410-9b06-3ded53d60ccf admin admin] REQUEST_METHOD: `GET` {{(pid=71939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 24 16:28:58.446650 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07ec2193-3f20-4410-9b06-3ded53d60ccf admin admin] SCRIPT_NAME: `/identity` {{(pid=71939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 24 16:28:58.446973 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07ec2193-3f20-4410-9b06-3ded53d60ccf admin admin] PATH_INFO: `/v3/projects/00a5583c7b7443e98e7a1d31a0b638dc` {{(pid=71939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 24 16:28:58.448737 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07ec2193-3f20-4410-9b06-3ded53d60ccf admin admin] RBAC: Authorizing `identity:get_project(project_id=00a5583c7b7443e98e7a1d31a0b638dc)` {{(pid=71939) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:442}} Nov 24 16:28:58.491579 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: WARNING keystone.common.rbac_enforcer.enforcer [None req-07ec2193-3f20-4410-9b06-3ded53d60ccf admin admin] Deprecated policy rules found. Use oslopolicy-policy-generator and oslopolicy-policy-upgrade to detect and resolve deprecated policies in your configuration. Nov 24 16:28:58.491901 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07ec2193-3f20-4410-9b06-3ded53d60ccf admin admin] RBAC: Authorization granted {{(pid=71939) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 24 16:28:58.496702 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: [pid: 71939|app: 0|req: 3/6] 10.222.0.53 () {56 vars in 1198 bytes} [Wed Nov 24 16:28:58 2021] GET /identity/v3/projects/00a5583c7b7443e98e7a1d31a0b638dc => generated 344 bytes in 70 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 24 16:29:00.506720 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fec30f44-8138-42a8-93ff-ca66ff35fdc4 None None] REQUEST_METHOD: `GET` {{(pid=71938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 24 16:29:00.507218 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fec30f44-8138-42a8-93ff-ca66ff35fdc4 None None] SCRIPT_NAME: `/identity` {{(pid=71938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 24 16:29:00.507325 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fec30f44-8138-42a8-93ff-ca66ff35fdc4 None None] PATH_INFO: `/` {{(pid=71938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 24 16:29:00.512332 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: [pid: 71938|app: 0|req: 4/7] 10.222.0.53 () {54 vars in 915 bytes} [Wed Nov 24 16:29:00 2021] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 24 16:29:00.518310 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e4ba7f6-6fa7-444e-b0dd-44c865412092 None None] REQUEST_METHOD: `POST` {{(pid=71939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 24 16:29:00.518659 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e4ba7f6-6fa7-444e-b0dd-44c865412092 None None] SCRIPT_NAME: `/identity` {{(pid=71939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 24 16:29:00.518990 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e4ba7f6-6fa7-444e-b0dd-44c865412092 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=71939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 24 16:29:00.543528 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.auth.core [None req-2e4ba7f6-6fa7-444e-b0dd-44c865412092 None None] MFA Rules not processed for user `0f2ba2e8375b4e8c8792ee1e22b60427`. Rule list: `[]` (Enabled: `True`). {{(pid=71939) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:442}} Nov 24 16:29:00.545100 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.fernet_utils [None req-2e4ba7f6-6fa7-444e-b0dd-44c865412092 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=71939) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:289}} Nov 24 16:29:00.552631 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: [pid: 71939|app: 0|req: 4/8] 10.222.0.53 () {58 vars in 1013 bytes} [Wed Nov 24 16:29:00 2021] POST /identity/v3/auth/tokens => generated 1067 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 24 16:29:00.575270 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1979fa6c-8de4-4b9e-98d0-b9a8594b63e8 None None] REQUEST_METHOD: `POST` {{(pid=71938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 24 16:29:00.575608 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1979fa6c-8de4-4b9e-98d0-b9a8594b63e8 None None] SCRIPT_NAME: `/identity` {{(pid=71938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 24 16:29:00.575946 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1979fa6c-8de4-4b9e-98d0-b9a8594b63e8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=71938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 24 16:29:00.602115 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.auth.core [None req-1979fa6c-8de4-4b9e-98d0-b9a8594b63e8 None None] MFA Rules not processed for user `0f2ba2e8375b4e8c8792ee1e22b60427`. Rule list: `[]` (Enabled: `True`). {{(pid=71938) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:442}} Nov 24 16:29:00.603674 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.fernet_utils [None req-1979fa6c-8de4-4b9e-98d0-b9a8594b63e8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=71938) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:289}} Nov 24 16:29:00.610747 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: [pid: 71938|app: 0|req: 5/9] 10.222.0.53 () {58 vars in 1013 bytes} [Wed Nov 24 16:29:00 2021] POST /identity/v3/auth/tokens => generated 1067 bytes in 37 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 24 16:29:00.617116 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e4ba7f6-6fa7-444e-b0dd-44c865412092 None None] Authenticating user token {{(pid=71939) process_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 24 16:29:00.626676 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e4ba7f6-6fa7-444e-b0dd-44c865412092 None None] Validating token access rules against request {{(pid=71939) validate_allowed_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 24 16:29:00.631377 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d22aeac5-343f-47a7-8420-884338622012 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f2ba2e8375b4e8c8792ee1e22b60427', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '00a5583c7b7443e98e7a1d31a0b638dc', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=71939) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 24 16:29:00.632016 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d22aeac5-343f-47a7-8420-884338622012 admin admin] REQUEST_METHOD: `GET` {{(pid=71939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 24 16:29:00.632351 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d22aeac5-343f-47a7-8420-884338622012 admin admin] SCRIPT_NAME: `/identity` {{(pid=71939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 24 16:29:00.632677 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d22aeac5-343f-47a7-8420-884338622012 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=71939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 24 16:29:00.640743 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d22aeac5-343f-47a7-8420-884338622012 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=71939) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:442}} Nov 24 16:29:00.669677 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d22aeac5-343f-47a7-8420-884338622012 admin admin] RBAC: Authorization granted {{(pid=71939) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 24 16:29:00.680020 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: [pid: 71939|app: 0|req: 5/10] 10.222.0.53 () {58 vars in 1315 bytes} [Wed Nov 24 16:29:00 2021] GET /identity/v3/auth/tokens => generated 1067 bytes in 63 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 24 16:29:00.686103 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1979fa6c-8de4-4b9e-98d0-b9a8594b63e8 None None] Authenticating user token {{(pid=71938) process_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 24 16:29:00.695893 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1979fa6c-8de4-4b9e-98d0-b9a8594b63e8 None None] Validating token access rules against request {{(pid=71938) validate_allowed_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 24 16:29:00.700178 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-147f2843-3768-48bf-873a-09541db8f67d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f2ba2e8375b4e8c8792ee1e22b60427', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '00a5583c7b7443e98e7a1d31a0b638dc', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=71938) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 24 16:29:00.701067 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-147f2843-3768-48bf-873a-09541db8f67d admin admin] REQUEST_METHOD: `GET` {{(pid=71938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 24 16:29:00.701406 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-147f2843-3768-48bf-873a-09541db8f67d admin admin] SCRIPT_NAME: `/identity` {{(pid=71938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 24 16:29:00.701740 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-147f2843-3768-48bf-873a-09541db8f67d admin admin] PATH_INFO: `/v3/users/0f2ba2e8375b4e8c8792ee1e22b60427` {{(pid=71938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 24 16:29:00.703946 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-147f2843-3768-48bf-873a-09541db8f67d admin admin] RBAC: Authorizing `identity:get_user(user_id=0f2ba2e8375b4e8c8792ee1e22b60427)` {{(pid=71938) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:442}} Nov 24 16:29:00.732459 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-147f2843-3768-48bf-873a-09541db8f67d admin admin] RBAC: Authorization granted {{(pid=71938) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 24 16:29:00.734187 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: [pid: 71938|app: 0|req: 6/11] 10.222.0.53 () {56 vars in 1189 bytes} [Wed Nov 24 16:29:00 2021] GET /identity/v3/users/0f2ba2e8375b4e8c8792ee1e22b60427 => generated 247 bytes in 49 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 24 16:29:02.748631 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0f1d41e-7d0e-4fa0-a328-ab8f88923445 None None] REQUEST_METHOD: `GET` {{(pid=71939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 24 16:29:02.749166 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0f1d41e-7d0e-4fa0-a328-ab8f88923445 None None] SCRIPT_NAME: `/identity` {{(pid=71939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 24 16:29:02.749365 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0f1d41e-7d0e-4fa0-a328-ab8f88923445 None None] PATH_INFO: `/` {{(pid=71939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 24 16:29:02.751250 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: [pid: 71939|app: 0|req: 6/12] 10.222.0.53 () {54 vars in 915 bytes} [Wed Nov 24 16:29:02 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 24 16:29:02.757313 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-917c9b22-2566-4f09-b7c3-3dbe7e01d362 None None] REQUEST_METHOD: `POST` {{(pid=71938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 24 16:29:02.757655 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-917c9b22-2566-4f09-b7c3-3dbe7e01d362 None None] SCRIPT_NAME: `/identity` {{(pid=71938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 24 16:29:02.757984 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-917c9b22-2566-4f09-b7c3-3dbe7e01d362 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=71938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 24 16:29:02.781984 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.auth.core [None req-917c9b22-2566-4f09-b7c3-3dbe7e01d362 None None] MFA Rules not processed for user `0f2ba2e8375b4e8c8792ee1e22b60427`. Rule list: `[]` (Enabled: `True`). {{(pid=71938) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:442}} Nov 24 16:29:02.783265 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.fernet_utils [None req-917c9b22-2566-4f09-b7c3-3dbe7e01d362 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=71938) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:289}} Nov 24 16:29:02.790400 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: [pid: 71938|app: 0|req: 7/13] 10.222.0.53 () {58 vars in 1013 bytes} [Wed Nov 24 16:29:02 2021] POST /identity/v3/auth/tokens => generated 1067 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 24 16:29:02.812418 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efd53ef0-be25-4a4f-a840-5b90b5c85dba None None] REQUEST_METHOD: `POST` {{(pid=71939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 24 16:29:02.812761 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efd53ef0-be25-4a4f-a840-5b90b5c85dba None None] SCRIPT_NAME: `/identity` {{(pid=71939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 24 16:29:02.813089 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efd53ef0-be25-4a4f-a840-5b90b5c85dba None None] PATH_INFO: `/v3/auth/tokens` {{(pid=71939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 24 16:29:02.837077 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.auth.core [None req-efd53ef0-be25-4a4f-a840-5b90b5c85dba None None] MFA Rules not processed for user `0f2ba2e8375b4e8c8792ee1e22b60427`. Rule list: `[]` (Enabled: `True`). {{(pid=71939) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:442}} Nov 24 16:29:02.838323 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.fernet_utils [None req-efd53ef0-be25-4a4f-a840-5b90b5c85dba None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=71939) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:289}} Nov 24 16:29:02.845241 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: [pid: 71939|app: 0|req: 7/14] 10.222.0.53 () {58 vars in 1013 bytes} [Wed Nov 24 16:29:02 2021] POST /identity/v3/auth/tokens => generated 1067 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 24 16:29:02.851298 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-917c9b22-2566-4f09-b7c3-3dbe7e01d362 None None] Authenticating user token {{(pid=71938) process_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 24 16:29:02.861011 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-917c9b22-2566-4f09-b7c3-3dbe7e01d362 None None] Validating token access rules against request {{(pid=71938) validate_allowed_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 24 16:29:02.866226 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ef3d549-e14d-4e66-9bfa-a6c69f80fb96 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f2ba2e8375b4e8c8792ee1e22b60427', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '00a5583c7b7443e98e7a1d31a0b638dc', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=71938) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 24 16:29:02.867152 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ef3d549-e14d-4e66-9bfa-a6c69f80fb96 admin admin] REQUEST_METHOD: `GET` {{(pid=71938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 24 16:29:02.867589 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ef3d549-e14d-4e66-9bfa-a6c69f80fb96 admin admin] SCRIPT_NAME: `/identity` {{(pid=71938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 24 16:29:02.868028 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ef3d549-e14d-4e66-9bfa-a6c69f80fb96 admin admin] PATH_INFO: `/v3/roles/admin` {{(pid=71938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 24 16:29:02.882812 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ef3d549-e14d-4e66-9bfa-a6c69f80fb96 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=71938) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:401}} Nov 24 16:29:02.890251 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: WARNING keystone.server.flask.application [None req-5ef3d549-e14d-4e66-9bfa-a6c69f80fb96 admin admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Nov 24 16:29:02.891488 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: [pid: 71938|app: 0|req: 8/15] 10.222.0.53 () {56 vars in 1108 bytes} [Wed Nov 24 16:29:02 2021] GET /identity/v3/roles/admin => generated 83 bytes in 41 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 24 16:29:02.898167 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efd53ef0-be25-4a4f-a840-5b90b5c85dba None None] Authenticating user token {{(pid=71939) process_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 24 16:29:02.907253 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efd53ef0-be25-4a4f-a840-5b90b5c85dba None None] Validating token access rules against request {{(pid=71939) validate_allowed_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 24 16:29:02.911808 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82328ac3-5494-4761-abdb-fe37efac75d6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f2ba2e8375b4e8c8792ee1e22b60427', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '00a5583c7b7443e98e7a1d31a0b638dc', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=71939) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 24 16:29:02.912474 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82328ac3-5494-4761-abdb-fe37efac75d6 admin admin] REQUEST_METHOD: `GET` {{(pid=71939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 24 16:29:02.912807 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82328ac3-5494-4761-abdb-fe37efac75d6 admin admin] SCRIPT_NAME: `/identity` {{(pid=71939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 24 16:29:02.913133 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82328ac3-5494-4761-abdb-fe37efac75d6 admin admin] PATH_INFO: `/v3/roles` {{(pid=71939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 24 16:29:02.913937 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82328ac3-5494-4761-abdb-fe37efac75d6 admin admin] RBAC: Adding query filter params (name=admin) {{(pid=71939) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:161}} Nov 24 16:29:02.914317 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82328ac3-5494-4761-abdb-fe37efac75d6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=71939) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:442}} Nov 24 16:29:02.943171 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: WARNING py.warnings [None req-82328ac3-5494-4761-abdb-fe37efac75d6 admin admin] /usr/local/lib/python3.6/dist-packages/oslo_policy/policy.py:1018: UserWarning: Policy identity:list_roles failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 24 16:29:02.943171 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: warnings.warn(msg) Nov 24 16:29:02.943171 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: Nov 24 16:29:02.944200 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82328ac3-5494-4761-abdb-fe37efac75d6 admin admin] RBAC: Authorization granted {{(pid=71939) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 24 16:29:02.957706 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: [pid: 71939|app: 0|req: 8/16] 10.222.0.53 () {56 vars in 1111 bytes} [Wed Nov 24 16:29:02 2021] GET /identity/v3/roles?name=admin => generated 339 bytes in 60 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 24 16:29:02.963702 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ef3d549-e14d-4e66-9bfa-a6c69f80fb96 admin admin] Authenticating user token {{(pid=71938) process_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 24 16:29:02.974111 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ef3d549-e14d-4e66-9bfa-a6c69f80fb96 admin admin] Validating token access rules against request {{(pid=71938) validate_allowed_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 24 16:29:02.978314 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c805ed22-b570-4521-b16e-2e05575178e2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f2ba2e8375b4e8c8792ee1e22b60427', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '00a5583c7b7443e98e7a1d31a0b638dc', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=71938) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 24 16:29:02.979195 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c805ed22-b570-4521-b16e-2e05575178e2 admin admin] REQUEST_METHOD: `GET` {{(pid=71938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 24 16:29:02.979533 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c805ed22-b570-4521-b16e-2e05575178e2 admin admin] SCRIPT_NAME: `/identity` {{(pid=71938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 24 16:29:02.979868 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c805ed22-b570-4521-b16e-2e05575178e2 admin admin] PATH_INFO: `/v3/users/0f2ba2e8375b4e8c8792ee1e22b60427` {{(pid=71938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 24 16:29:02.981074 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c805ed22-b570-4521-b16e-2e05575178e2 admin admin] RBAC: Authorizing `identity:get_user(user_id=0f2ba2e8375b4e8c8792ee1e22b60427)` {{(pid=71938) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:442}} Nov 24 16:29:03.010308 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c805ed22-b570-4521-b16e-2e05575178e2 admin admin] RBAC: Authorization granted {{(pid=71938) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 24 16:29:03.011929 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: [pid: 71938|app: 0|req: 9/17] 10.222.0.53 () {56 vars in 1189 bytes} [Wed Nov 24 16:29:02 2021] GET /identity/v3/users/0f2ba2e8375b4e8c8792ee1e22b60427 => generated 247 bytes in 49 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 24 16:29:03.018655 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82328ac3-5494-4761-abdb-fe37efac75d6 admin admin] Authenticating user token {{(pid=71939) process_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 24 16:29:03.028961 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82328ac3-5494-4761-abdb-fe37efac75d6 admin admin] Validating token access rules against request {{(pid=71939) validate_allowed_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 24 16:29:03.033167 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82b726a1-2548-4a54-8078-3cc445b3ebcc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f2ba2e8375b4e8c8792ee1e22b60427', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '00a5583c7b7443e98e7a1d31a0b638dc', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=71939) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 24 16:29:03.033970 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82b726a1-2548-4a54-8078-3cc445b3ebcc admin admin] REQUEST_METHOD: `GET` {{(pid=71939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 24 16:29:03.034333 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82b726a1-2548-4a54-8078-3cc445b3ebcc admin admin] SCRIPT_NAME: `/identity` {{(pid=71939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 24 16:29:03.034663 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82b726a1-2548-4a54-8078-3cc445b3ebcc admin admin] PATH_INFO: `/v3/domains/default` {{(pid=71939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 24 16:29:03.035862 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82b726a1-2548-4a54-8078-3cc445b3ebcc admin admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=71939) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:442}} Nov 24 16:29:03.064211 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82b726a1-2548-4a54-8078-3cc445b3ebcc admin admin] RBAC: Authorization granted {{(pid=71939) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 24 16:29:03.066001 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: [pid: 71939|app: 0|req: 9/18] 10.222.0.53 () {56 vars in 1120 bytes} [Wed Nov 24 16:29:03 2021] GET /identity/v3/domains/default => generated 199 bytes in 49 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 24 16:29:03.072790 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c805ed22-b570-4521-b16e-2e05575178e2 admin admin] Authenticating user token {{(pid=71938) process_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 24 16:29:03.083345 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c805ed22-b570-4521-b16e-2e05575178e2 admin admin] Validating token access rules against request {{(pid=71938) validate_allowed_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 24 16:29:03.087690 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e49f22e8-757c-4b4a-a534-bd6896bae55c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f2ba2e8375b4e8c8792ee1e22b60427', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '00a5583c7b7443e98e7a1d31a0b638dc', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=71938) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 24 16:29:03.088361 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e49f22e8-757c-4b4a-a534-bd6896bae55c admin admin] REQUEST_METHOD: `GET` {{(pid=71938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 24 16:29:03.088698 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e49f22e8-757c-4b4a-a534-bd6896bae55c admin admin] SCRIPT_NAME: `/identity` {{(pid=71938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 24 16:29:03.089030 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e49f22e8-757c-4b4a-a534-bd6896bae55c admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=71938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 24 16:29:03.089922 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e49f22e8-757c-4b4a-a534-bd6896bae55c admin admin] RBAC: Adding query filter params (role.id=5611724e350b41e19921b5961a342582, scope.domain.id=default, user.id=0f2ba2e8375b4e8c8792ee1e22b60427) {{(pid=71938) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:161}} Nov 24 16:29:03.090329 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e49f22e8-757c-4b4a-a534-bd6896bae55c admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=71938) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:442}} Nov 24 16:29:03.119096 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: WARNING py.warnings [None req-e49f22e8-757c-4b4a-a534-bd6896bae55c admin admin] /usr/local/lib/python3.6/dist-packages/oslo_policy/policy.py:1018: UserWarning: Policy identity:list_role_assignments failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Nov 24 16:29:03.119096 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: warnings.warn(msg) Nov 24 16:29:03.119096 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: Nov 24 16:29:03.120399 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e49f22e8-757c-4b4a-a534-bd6896bae55c admin admin] RBAC: Authorization granted {{(pid=71938) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 24 16:29:03.126815 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: [pid: 71938|app: 0|req: 10/19] 10.222.0.53 () {56 vars in 1334 bytes} [Wed Nov 24 16:29:03 2021] GET /identity/v3/role_assignments?user.id=0f2ba2e8375b4e8c8792ee1e22b60427&scope.domain.id=default&role.id=5611724e350b41e19921b5961a342582 => generated 233 bytes in 55 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 24 16:29:05.151248 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55db6616-e446-4de3-8e34-1e3a704a6e63 None None] REQUEST_METHOD: `GET` {{(pid=71939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 24 16:29:05.151781 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55db6616-e446-4de3-8e34-1e3a704a6e63 None None] SCRIPT_NAME: `/identity` {{(pid=71939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 24 16:29:05.151889 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55db6616-e446-4de3-8e34-1e3a704a6e63 None None] PATH_INFO: `/` {{(pid=71939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 24 16:29:05.153822 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: [pid: 71939|app: 0|req: 10/20] 10.222.0.53 () {54 vars in 915 bytes} [Wed Nov 24 16:29:05 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 24 16:29:05.160345 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5af08057-aeb1-4a14-98a4-a3e781d5af84 None None] REQUEST_METHOD: `POST` {{(pid=71938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 24 16:29:05.160687 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5af08057-aeb1-4a14-98a4-a3e781d5af84 None None] SCRIPT_NAME: `/identity` {{(pid=71938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 24 16:29:05.161029 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5af08057-aeb1-4a14-98a4-a3e781d5af84 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=71938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 24 16:29:05.186184 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.auth.core [None req-5af08057-aeb1-4a14-98a4-a3e781d5af84 None None] MFA Rules not processed for user `0f2ba2e8375b4e8c8792ee1e22b60427`. Rule list: `[]` (Enabled: `True`). {{(pid=71938) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:442}} Nov 24 16:29:05.187431 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.fernet_utils [None req-5af08057-aeb1-4a14-98a4-a3e781d5af84 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=71938) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:289}} Nov 24 16:29:05.195195 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: [pid: 71938|app: 0|req: 11/21] 10.222.0.53 () {58 vars in 1013 bytes} [Wed Nov 24 16:29:05 2021] POST /identity/v3/auth/tokens => generated 1067 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 24 16:29:05.219085 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-692b58e8-831d-4279-a984-6cc11cf28761 None None] REQUEST_METHOD: `POST` {{(pid=71939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 24 16:29:05.219495 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-692b58e8-831d-4279-a984-6cc11cf28761 None None] SCRIPT_NAME: `/identity` {{(pid=71939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 24 16:29:05.219766 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-692b58e8-831d-4279-a984-6cc11cf28761 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=71939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 24 16:29:05.243787 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.auth.core [None req-692b58e8-831d-4279-a984-6cc11cf28761 None None] MFA Rules not processed for user `0f2ba2e8375b4e8c8792ee1e22b60427`. Rule list: `[]` (Enabled: `True`). {{(pid=71939) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:442}} Nov 24 16:29:05.245005 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.fernet_utils [None req-692b58e8-831d-4279-a984-6cc11cf28761 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=71939) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:289}} Nov 24 16:29:05.252168 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: [pid: 71939|app: 0|req: 11/22] 10.222.0.53 () {58 vars in 1013 bytes} [Wed Nov 24 16:29:05 2021] POST /identity/v3/auth/tokens => generated 1067 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 24 16:29:05.258009 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5af08057-aeb1-4a14-98a4-a3e781d5af84 None None] Authenticating user token {{(pid=71938) process_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 24 16:29:05.267878 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5af08057-aeb1-4a14-98a4-a3e781d5af84 None None] Validating token access rules against request {{(pid=71938) validate_allowed_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 24 16:29:05.272777 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e8bc5e2-1114-4223-89d5-b2a72d393ec4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f2ba2e8375b4e8c8792ee1e22b60427', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '00a5583c7b7443e98e7a1d31a0b638dc', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=71938) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 24 16:29:05.273601 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e8bc5e2-1114-4223-89d5-b2a72d393ec4 admin admin] REQUEST_METHOD: `GET` {{(pid=71938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 24 16:29:05.273944 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e8bc5e2-1114-4223-89d5-b2a72d393ec4 admin admin] SCRIPT_NAME: `/identity` {{(pid=71938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 24 16:29:05.274311 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e8bc5e2-1114-4223-89d5-b2a72d393ec4 admin admin] PATH_INFO: `/v3/roles/admin` {{(pid=71938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 24 16:29:05.287437 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e8bc5e2-1114-4223-89d5-b2a72d393ec4 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=71938) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:401}} Nov 24 16:29:05.295124 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: WARNING keystone.server.flask.application [None req-4e8bc5e2-1114-4223-89d5-b2a72d393ec4 admin admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Nov 24 16:29:05.296337 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: [pid: 71938|app: 0|req: 12/23] 10.222.0.53 () {56 vars in 1108 bytes} [Wed Nov 24 16:29:05 2021] GET /identity/v3/roles/admin => generated 83 bytes in 39 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 24 16:29:05.304128 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-692b58e8-831d-4279-a984-6cc11cf28761 None None] Authenticating user token {{(pid=71939) process_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 24 16:29:05.313591 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-692b58e8-831d-4279-a984-6cc11cf28761 None None] Validating token access rules against request {{(pid=71939) validate_allowed_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 24 16:29:05.318067 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e875c2a-dc4e-482e-86b5-5b1d72225581 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f2ba2e8375b4e8c8792ee1e22b60427', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '00a5583c7b7443e98e7a1d31a0b638dc', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=71939) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 24 16:29:05.321746 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e875c2a-dc4e-482e-86b5-5b1d72225581 admin admin] REQUEST_METHOD: `GET` {{(pid=71939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 24 16:29:05.321746 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e875c2a-dc4e-482e-86b5-5b1d72225581 admin admin] SCRIPT_NAME: `/identity` {{(pid=71939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 24 16:29:05.321746 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e875c2a-dc4e-482e-86b5-5b1d72225581 admin admin] PATH_INFO: `/v3/roles` {{(pid=71939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 24 16:29:05.321746 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e875c2a-dc4e-482e-86b5-5b1d72225581 admin admin] RBAC: Adding query filter params (name=admin) {{(pid=71939) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:161}} Nov 24 16:29:05.321746 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e875c2a-dc4e-482e-86b5-5b1d72225581 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=71939) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:442}} Nov 24 16:29:05.350923 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e875c2a-dc4e-482e-86b5-5b1d72225581 admin admin] RBAC: Authorization granted {{(pid=71939) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 24 16:29:05.360539 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: [pid: 71939|app: 0|req: 12/24] 10.222.0.53 () {56 vars in 1111 bytes} [Wed Nov 24 16:29:05 2021] GET /identity/v3/roles?name=admin => generated 339 bytes in 57 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 24 16:29:05.366688 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e8bc5e2-1114-4223-89d5-b2a72d393ec4 admin admin] Authenticating user token {{(pid=71938) process_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 24 16:29:05.377101 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e8bc5e2-1114-4223-89d5-b2a72d393ec4 admin admin] Validating token access rules against request {{(pid=71938) validate_allowed_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 24 16:29:05.382162 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6711715-a6a5-44e0-9711-4615e0fada96 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f2ba2e8375b4e8c8792ee1e22b60427', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '00a5583c7b7443e98e7a1d31a0b638dc', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=71938) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 24 16:29:05.383053 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6711715-a6a5-44e0-9711-4615e0fada96 admin admin] REQUEST_METHOD: `GET` {{(pid=71938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 24 16:29:05.383388 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6711715-a6a5-44e0-9711-4615e0fada96 admin admin] SCRIPT_NAME: `/identity` {{(pid=71938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 24 16:29:05.383719 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6711715-a6a5-44e0-9711-4615e0fada96 admin admin] PATH_INFO: `/v3/users/0f2ba2e8375b4e8c8792ee1e22b60427` {{(pid=71938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 24 16:29:05.385111 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6711715-a6a5-44e0-9711-4615e0fada96 admin admin] RBAC: Authorizing `identity:get_user(user_id=0f2ba2e8375b4e8c8792ee1e22b60427)` {{(pid=71938) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:442}} Nov 24 16:29:05.415954 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6711715-a6a5-44e0-9711-4615e0fada96 admin admin] RBAC: Authorization granted {{(pid=71938) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 24 16:29:05.417684 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: [pid: 71938|app: 0|req: 13/25] 10.222.0.53 () {56 vars in 1189 bytes} [Wed Nov 24 16:29:05 2021] GET /identity/v3/users/0f2ba2e8375b4e8c8792ee1e22b60427 => generated 247 bytes in 52 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 24 16:29:05.423849 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e875c2a-dc4e-482e-86b5-5b1d72225581 admin admin] Authenticating user token {{(pid=71939) process_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 24 16:29:05.434420 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e875c2a-dc4e-482e-86b5-5b1d72225581 admin admin] Validating token access rules against request {{(pid=71939) validate_allowed_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 24 16:29:05.438924 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f74a653-71af-47a1-80ee-79bee78cfc27 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f2ba2e8375b4e8c8792ee1e22b60427', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '00a5583c7b7443e98e7a1d31a0b638dc', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=71939) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 24 16:29:05.439726 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f74a653-71af-47a1-80ee-79bee78cfc27 admin admin] REQUEST_METHOD: `GET` {{(pid=71939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 24 16:29:05.440067 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f74a653-71af-47a1-80ee-79bee78cfc27 admin admin] SCRIPT_NAME: `/identity` {{(pid=71939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 24 16:29:05.440401 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f74a653-71af-47a1-80ee-79bee78cfc27 admin admin] PATH_INFO: `/v3/domains/default` {{(pid=71939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 24 16:29:05.441601 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f74a653-71af-47a1-80ee-79bee78cfc27 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=71939) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:442}} Nov 24 16:29:05.470813 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f74a653-71af-47a1-80ee-79bee78cfc27 admin admin] RBAC: Authorization granted {{(pid=71939) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 24 16:29:05.473186 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: [pid: 71939|app: 0|req: 13/26] 10.222.0.53 () {56 vars in 1120 bytes} [Wed Nov 24 16:29:05 2021] GET /identity/v3/domains/default => generated 199 bytes in 50 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 24 16:29:05.480914 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6711715-a6a5-44e0-9711-4615e0fada96 admin admin] Authenticating user token {{(pid=71938) process_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 24 16:29:05.491613 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6711715-a6a5-44e0-9711-4615e0fada96 admin admin] Validating token access rules against request {{(pid=71938) validate_allowed_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 24 16:29:05.496336 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a108281-d05b-4bdf-929d-570ec2b711e1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f2ba2e8375b4e8c8792ee1e22b60427', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '00a5583c7b7443e98e7a1d31a0b638dc', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=71938) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 24 16:29:05.497218 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a108281-d05b-4bdf-929d-570ec2b711e1 admin admin] REQUEST_METHOD: `PUT` {{(pid=71938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 24 16:29:05.497558 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a108281-d05b-4bdf-929d-570ec2b711e1 admin admin] SCRIPT_NAME: `/identity` {{(pid=71938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 24 16:29:05.497976 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a108281-d05b-4bdf-929d-570ec2b711e1 admin admin] PATH_INFO: `/v3/domains/default/users/0f2ba2e8375b4e8c8792ee1e22b60427/roles/5611724e350b41e19921b5961a342582` {{(pid=71938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 24 16:29:05.500084 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a108281-d05b-4bdf-929d-570ec2b711e1 admin admin] RBAC: Authorizing `identity:create_grant(domain_id=default, user_id=0f2ba2e8375b4e8c8792ee1e22b60427, role_id=5611724e350b41e19921b5961a342582)` {{(pid=71938) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:442}} Nov 24 16:29:05.529279 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: WARNING py.warnings [None req-2a108281-d05b-4bdf-929d-570ec2b711e1 admin admin] /usr/local/lib/python3.6/dist-packages/oslo_policy/policy.py:1018: UserWarning: Policy identity:create_grant failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Nov 24 16:29:05.529279 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: warnings.warn(msg) Nov 24 16:29:05.529279 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: Nov 24 16:29:05.531526 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a108281-d05b-4bdf-929d-570ec2b711e1 admin admin] RBAC: Authorization granted {{(pid=71938) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 24 16:29:05.789161 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: [pid: 71938|app: 0|req: 14/27] 10.222.0.53 () {58 vars in 1373 bytes} [Wed Nov 24 16:29:05 2021] PUT /identity/v3/domains/default/users/0f2ba2e8375b4e8c8792ee1e22b60427/roles/5611724e350b41e19921b5961a342582 => generated 0 bytes in 309 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 24 16:29:07.771678 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43625982-4002-433c-86fe-84c0b29583d2 None None] REQUEST_METHOD: `GET` {{(pid=71939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 24 16:29:07.772199 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43625982-4002-433c-86fe-84c0b29583d2 None None] SCRIPT_NAME: `/identity` {{(pid=71939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 24 16:29:07.772302 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43625982-4002-433c-86fe-84c0b29583d2 None None] PATH_INFO: `/` {{(pid=71939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 24 16:29:07.774130 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: [pid: 71939|app: 0|req: 14/28] 10.222.0.53 () {54 vars in 915 bytes} [Wed Nov 24 16:29:07 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 24 16:29:07.782331 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9761d358-c942-4f82-8d6f-cec41c626995 None None] REQUEST_METHOD: `POST` {{(pid=71938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 24 16:29:07.782700 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9761d358-c942-4f82-8d6f-cec41c626995 None None] SCRIPT_NAME: `/identity` {{(pid=71938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 24 16:29:07.783048 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9761d358-c942-4f82-8d6f-cec41c626995 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=71938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 24 16:29:07.813344 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.auth.core [None req-9761d358-c942-4f82-8d6f-cec41c626995 None None] MFA Rules not processed for user `0f2ba2e8375b4e8c8792ee1e22b60427`. Rule list: `[]` (Enabled: `True`). {{(pid=71938) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:442}} Nov 24 16:29:07.815091 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.fernet_utils [None req-9761d358-c942-4f82-8d6f-cec41c626995 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=71938) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:289}} Nov 24 16:29:07.883775 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: [pid: 71938|app: 0|req: 15/29] 10.222.0.53 () {58 vars in 1013 bytes} [Wed Nov 24 16:29:07 2021] POST /identity/v3/auth/tokens => generated 1067 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 24 16:29:07.906789 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d81078ca-e4a1-43d3-be30-8b577aeb5742 None None] REQUEST_METHOD: `POST` {{(pid=71939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 24 16:29:07.907140 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d81078ca-e4a1-43d3-be30-8b577aeb5742 None None] SCRIPT_NAME: `/identity` {{(pid=71939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 24 16:29:07.907478 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d81078ca-e4a1-43d3-be30-8b577aeb5742 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=71939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 24 16:29:07.930548 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.auth.core [None req-d81078ca-e4a1-43d3-be30-8b577aeb5742 None None] MFA Rules not processed for user `0f2ba2e8375b4e8c8792ee1e22b60427`. Rule list: `[]` (Enabled: `True`). {{(pid=71939) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:442}} Nov 24 16:29:07.931768 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.fernet_utils [None req-d81078ca-e4a1-43d3-be30-8b577aeb5742 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=71939) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:289}} Nov 24 16:29:07.938897 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: [pid: 71939|app: 0|req: 15/30] 10.222.0.53 () {58 vars in 1013 bytes} [Wed Nov 24 16:29:07 2021] POST /identity/v3/auth/tokens => generated 1067 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 24 16:29:07.945101 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9761d358-c942-4f82-8d6f-cec41c626995 None None] Authenticating user token {{(pid=71938) process_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 24 16:29:07.955221 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9761d358-c942-4f82-8d6f-cec41c626995 None None] Validating token access rules against request {{(pid=71938) validate_allowed_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 24 16:29:07.960118 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f920ee5-b89f-4fdb-aae7-ce251448039f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f2ba2e8375b4e8c8792ee1e22b60427', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '00a5583c7b7443e98e7a1d31a0b638dc', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=71938) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 24 16:29:07.961026 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f920ee5-b89f-4fdb-aae7-ce251448039f admin admin] REQUEST_METHOD: `GET` {{(pid=71938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 24 16:29:07.961361 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f920ee5-b89f-4fdb-aae7-ce251448039f admin admin] SCRIPT_NAME: `/identity` {{(pid=71938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 24 16:29:07.961688 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f920ee5-b89f-4fdb-aae7-ce251448039f admin admin] PATH_INFO: `/v3/roles/admin` {{(pid=71938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 24 16:29:07.973558 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f920ee5-b89f-4fdb-aae7-ce251448039f admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=71938) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:401}} Nov 24 16:29:07.981055 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: WARNING keystone.server.flask.application [None req-1f920ee5-b89f-4fdb-aae7-ce251448039f admin admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Nov 24 16:29:07.982355 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: [pid: 71938|app: 0|req: 16/31] 10.222.0.53 () {56 vars in 1108 bytes} [Wed Nov 24 16:29:07 2021] GET /identity/v3/roles/admin => generated 83 bytes in 38 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 24 16:29:07.988874 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d81078ca-e4a1-43d3-be30-8b577aeb5742 None None] Authenticating user token {{(pid=71939) process_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 24 16:29:07.997910 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d81078ca-e4a1-43d3-be30-8b577aeb5742 None None] Validating token access rules against request {{(pid=71939) validate_allowed_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 24 16:29:08.004068 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8111d3d-fe25-4531-bf94-7a721a1ddf3a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f2ba2e8375b4e8c8792ee1e22b60427', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '00a5583c7b7443e98e7a1d31a0b638dc', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=71939) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 24 16:29:08.004732 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8111d3d-fe25-4531-bf94-7a721a1ddf3a admin admin] REQUEST_METHOD: `GET` {{(pid=71939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 24 16:29:08.005063 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8111d3d-fe25-4531-bf94-7a721a1ddf3a admin admin] SCRIPT_NAME: `/identity` {{(pid=71939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 24 16:29:08.005385 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8111d3d-fe25-4531-bf94-7a721a1ddf3a admin admin] PATH_INFO: `/v3/roles` {{(pid=71939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 24 16:29:08.006218 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8111d3d-fe25-4531-bf94-7a721a1ddf3a admin admin] RBAC: Adding query filter params (name=admin) {{(pid=71939) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:161}} Nov 24 16:29:08.006566 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8111d3d-fe25-4531-bf94-7a721a1ddf3a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=71939) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:442}} Nov 24 16:29:08.036630 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8111d3d-fe25-4531-bf94-7a721a1ddf3a admin admin] RBAC: Authorization granted {{(pid=71939) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 24 16:29:08.049039 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: [pid: 71939|app: 0|req: 16/32] 10.222.0.53 () {56 vars in 1111 bytes} [Wed Nov 24 16:29:07 2021] GET /identity/v3/roles?name=admin => generated 339 bytes in 61 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 24 16:29:08.055501 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f920ee5-b89f-4fdb-aae7-ce251448039f admin admin] Authenticating user token {{(pid=71938) process_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 24 16:29:08.067090 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f920ee5-b89f-4fdb-aae7-ce251448039f admin admin] Validating token access rules against request {{(pid=71938) validate_allowed_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 24 16:29:08.071404 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddd26013-810a-45d6-82b6-f11d4ba84f19 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f2ba2e8375b4e8c8792ee1e22b60427', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '00a5583c7b7443e98e7a1d31a0b638dc', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=71938) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 24 16:29:08.072300 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddd26013-810a-45d6-82b6-f11d4ba84f19 admin admin] REQUEST_METHOD: `GET` {{(pid=71938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 24 16:29:08.072641 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddd26013-810a-45d6-82b6-f11d4ba84f19 admin admin] SCRIPT_NAME: `/identity` {{(pid=71938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 24 16:29:08.072974 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddd26013-810a-45d6-82b6-f11d4ba84f19 admin admin] PATH_INFO: `/v3/users/0f2ba2e8375b4e8c8792ee1e22b60427` {{(pid=71938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 24 16:29:08.076493 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddd26013-810a-45d6-82b6-f11d4ba84f19 admin admin] RBAC: Authorizing `identity:get_user(user_id=0f2ba2e8375b4e8c8792ee1e22b60427)` {{(pid=71938) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:442}} Nov 24 16:29:08.107782 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddd26013-810a-45d6-82b6-f11d4ba84f19 admin admin] RBAC: Authorization granted {{(pid=71938) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 24 16:29:08.112647 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: [pid: 71938|app: 0|req: 17/33] 10.222.0.53 () {56 vars in 1189 bytes} [Wed Nov 24 16:29:08 2021] GET /identity/v3/users/0f2ba2e8375b4e8c8792ee1e22b60427 => generated 247 bytes in 58 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 24 16:29:08.119222 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8111d3d-fe25-4531-bf94-7a721a1ddf3a admin admin] Authenticating user token {{(pid=71939) process_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 24 16:29:08.129736 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8111d3d-fe25-4531-bf94-7a721a1ddf3a admin admin] Validating token access rules against request {{(pid=71939) validate_allowed_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 24 16:29:08.133894 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-649197b2-7f92-4fe3-805a-e964b386d79c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f2ba2e8375b4e8c8792ee1e22b60427', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '00a5583c7b7443e98e7a1d31a0b638dc', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=71939) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 24 16:29:08.134732 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-649197b2-7f92-4fe3-805a-e964b386d79c admin admin] REQUEST_METHOD: `GET` {{(pid=71939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 24 16:29:08.135064 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-649197b2-7f92-4fe3-805a-e964b386d79c admin admin] SCRIPT_NAME: `/identity` {{(pid=71939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 24 16:29:08.135389 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-649197b2-7f92-4fe3-805a-e964b386d79c admin admin] PATH_INFO: `/v3/domains/default` {{(pid=71939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 24 16:29:08.136577 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-649197b2-7f92-4fe3-805a-e964b386d79c admin admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=71939) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:442}} Nov 24 16:29:08.165225 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-649197b2-7f92-4fe3-805a-e964b386d79c admin admin] RBAC: Authorization granted {{(pid=71939) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 24 16:29:08.166827 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: [pid: 71939|app: 0|req: 17/34] 10.222.0.53 () {56 vars in 1120 bytes} [Wed Nov 24 16:29:08 2021] GET /identity/v3/domains/default => generated 199 bytes in 48 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 24 16:29:08.172849 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddd26013-810a-45d6-82b6-f11d4ba84f19 admin admin] Authenticating user token {{(pid=71938) process_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 24 16:29:08.183108 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddd26013-810a-45d6-82b6-f11d4ba84f19 admin admin] Validating token access rules against request {{(pid=71938) validate_allowed_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 24 16:29:08.187608 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62cbcfa6-bcd4-45a5-9893-468637d90c58 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f2ba2e8375b4e8c8792ee1e22b60427', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '00a5583c7b7443e98e7a1d31a0b638dc', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=71938) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 24 16:29:08.188278 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62cbcfa6-bcd4-45a5-9893-468637d90c58 admin admin] REQUEST_METHOD: `GET` {{(pid=71938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 24 16:29:08.188615 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62cbcfa6-bcd4-45a5-9893-468637d90c58 admin admin] SCRIPT_NAME: `/identity` {{(pid=71938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 24 16:29:08.188944 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62cbcfa6-bcd4-45a5-9893-468637d90c58 admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=71938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 24 16:29:08.189855 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62cbcfa6-bcd4-45a5-9893-468637d90c58 admin admin] RBAC: Adding query filter params (role.id=5611724e350b41e19921b5961a342582, scope.domain.id=default, user.id=0f2ba2e8375b4e8c8792ee1e22b60427) {{(pid=71938) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:161}} Nov 24 16:29:08.190264 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62cbcfa6-bcd4-45a5-9893-468637d90c58 admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=71938) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:442}} Nov 24 16:29:08.219527 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62cbcfa6-bcd4-45a5-9893-468637d90c58 admin admin] RBAC: Authorization granted {{(pid=71938) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 24 16:29:08.226772 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: [pid: 71938|app: 0|req: 18/35] 10.222.0.53 () {56 vars in 1334 bytes} [Wed Nov 24 16:29:08 2021] GET /identity/v3/role_assignments?user.id=0f2ba2e8375b4e8c8792ee1e22b60427&scope.domain.id=default&role.id=5611724e350b41e19921b5961a342582 => generated 530 bytes in 54 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 24 16:29:10.258987 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-922b22c0-9aee-4b76-9a9b-0c2d95991190 None None] REQUEST_METHOD: `GET` {{(pid=71939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 24 16:29:10.259473 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-922b22c0-9aee-4b76-9a9b-0c2d95991190 None None] SCRIPT_NAME: `/identity` {{(pid=71939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 24 16:29:10.259642 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-922b22c0-9aee-4b76-9a9b-0c2d95991190 None None] PATH_INFO: `/` {{(pid=71939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 24 16:29:10.261450 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: [pid: 71939|app: 0|req: 18/36] 10.222.0.53 () {54 vars in 915 bytes} [Wed Nov 24 16:29:10 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 24 16:29:10.267169 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0134ec3a-1abb-4caa-9963-3532e145c9ef None None] REQUEST_METHOD: `POST` {{(pid=71938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 24 16:29:10.267524 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0134ec3a-1abb-4caa-9963-3532e145c9ef None None] SCRIPT_NAME: `/identity` {{(pid=71938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 24 16:29:10.267865 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0134ec3a-1abb-4caa-9963-3532e145c9ef None None] PATH_INFO: `/v3/auth/tokens` {{(pid=71938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 24 16:29:10.291752 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.auth.core [None req-0134ec3a-1abb-4caa-9963-3532e145c9ef None None] MFA Rules not processed for user `0f2ba2e8375b4e8c8792ee1e22b60427`. Rule list: `[]` (Enabled: `True`). {{(pid=71938) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:442}} Nov 24 16:29:10.293027 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.fernet_utils [None req-0134ec3a-1abb-4caa-9963-3532e145c9ef None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=71938) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:289}} Nov 24 16:29:10.300197 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: [pid: 71938|app: 0|req: 19/37] 10.222.0.53 () {58 vars in 1013 bytes} [Wed Nov 24 16:29:10 2021] POST /identity/v3/auth/tokens => generated 1067 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 24 16:29:10.322211 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5129875a-9846-4100-9d9f-20f6d5015ad6 None None] REQUEST_METHOD: `POST` {{(pid=71939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 24 16:29:10.322548 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5129875a-9846-4100-9d9f-20f6d5015ad6 None None] SCRIPT_NAME: `/identity` {{(pid=71939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 24 16:29:10.322883 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5129875a-9846-4100-9d9f-20f6d5015ad6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=71939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 24 16:29:10.346610 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.auth.core [None req-5129875a-9846-4100-9d9f-20f6d5015ad6 None None] MFA Rules not processed for user `0f2ba2e8375b4e8c8792ee1e22b60427`. Rule list: `[]` (Enabled: `True`). {{(pid=71939) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:442}} Nov 24 16:29:10.348346 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.fernet_utils [None req-5129875a-9846-4100-9d9f-20f6d5015ad6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=71939) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:289}} Nov 24 16:29:10.355378 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: [pid: 71939|app: 0|req: 19/38] 10.222.0.53 () {58 vars in 1013 bytes} [Wed Nov 24 16:29:10 2021] POST /identity/v3/auth/tokens => generated 1067 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 24 16:29:10.361182 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0134ec3a-1abb-4caa-9963-3532e145c9ef None None] Authenticating user token {{(pid=71938) process_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 24 16:29:10.371595 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0134ec3a-1abb-4caa-9963-3532e145c9ef None None] Validating token access rules against request {{(pid=71938) validate_allowed_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 24 16:29:10.375819 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44d53f94-3724-43cc-a63e-fad995cd22cb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f2ba2e8375b4e8c8792ee1e22b60427', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '00a5583c7b7443e98e7a1d31a0b638dc', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=71938) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 24 16:29:10.376479 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44d53f94-3724-43cc-a63e-fad995cd22cb admin admin] REQUEST_METHOD: `GET` {{(pid=71938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 24 16:29:10.376821 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44d53f94-3724-43cc-a63e-fad995cd22cb admin admin] SCRIPT_NAME: `/identity` {{(pid=71938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 24 16:29:10.377156 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44d53f94-3724-43cc-a63e-fad995cd22cb admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=71938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 24 16:29:10.385679 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44d53f94-3724-43cc-a63e-fad995cd22cb admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=71938) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:442}} Nov 24 16:29:10.415021 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44d53f94-3724-43cc-a63e-fad995cd22cb admin admin] RBAC: Authorization granted {{(pid=71938) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 24 16:29:10.424658 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: [pid: 71938|app: 0|req: 20/39] 10.222.0.53 () {58 vars in 1315 bytes} [Wed Nov 24 16:29:10 2021] GET /identity/v3/auth/tokens => generated 1067 bytes in 64 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 24 16:29:10.430754 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5129875a-9846-4100-9d9f-20f6d5015ad6 None None] Authenticating user token {{(pid=71939) process_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 24 16:29:10.439892 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5129875a-9846-4100-9d9f-20f6d5015ad6 None None] Validating token access rules against request {{(pid=71939) validate_allowed_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 24 16:29:10.444200 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12c7f2a7-c976-404e-9118-4a7fa5fe46af admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f2ba2e8375b4e8c8792ee1e22b60427', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '00a5583c7b7443e98e7a1d31a0b638dc', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=71939) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 24 16:29:10.445004 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12c7f2a7-c976-404e-9118-4a7fa5fe46af admin admin] REQUEST_METHOD: `GET` {{(pid=71939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 24 16:29:10.445341 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12c7f2a7-c976-404e-9118-4a7fa5fe46af admin admin] SCRIPT_NAME: `/identity` {{(pid=71939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 24 16:29:10.445669 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12c7f2a7-c976-404e-9118-4a7fa5fe46af admin admin] PATH_INFO: `/v3/domains/default` {{(pid=71939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 24 16:29:10.446875 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12c7f2a7-c976-404e-9118-4a7fa5fe46af admin admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=71939) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:442}} Nov 24 16:29:10.476087 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12c7f2a7-c976-404e-9118-4a7fa5fe46af admin admin] RBAC: Authorization granted {{(pid=71939) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 24 16:29:10.477651 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: [pid: 71939|app: 0|req: 20/40] 10.222.0.53 () {56 vars in 1120 bytes} [Wed Nov 24 16:29:10 2021] GET /identity/v3/domains/default => generated 199 bytes in 47 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 24 16:29:12.473954 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-584ddd07-2b3d-4f1f-9005-8bdf545ed163 None None] REQUEST_METHOD: `GET` {{(pid=71938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 24 16:29:12.474507 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-584ddd07-2b3d-4f1f-9005-8bdf545ed163 None None] SCRIPT_NAME: `/identity` {{(pid=71938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 24 16:29:12.474610 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-584ddd07-2b3d-4f1f-9005-8bdf545ed163 None None] PATH_INFO: `/` {{(pid=71938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 24 16:29:12.476531 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: [pid: 71938|app: 0|req: 21/41] 10.222.0.53 () {54 vars in 915 bytes} [Wed Nov 24 16:29:12 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 24 16:29:12.482365 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5015fba7-1372-43b7-be8d-6341ca81d7e3 None None] REQUEST_METHOD: `POST` {{(pid=71939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 24 16:29:12.482710 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5015fba7-1372-43b7-be8d-6341ca81d7e3 None None] SCRIPT_NAME: `/identity` {{(pid=71939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 24 16:29:12.483044 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5015fba7-1372-43b7-be8d-6341ca81d7e3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=71939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 24 16:29:12.513093 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.auth.core [None req-5015fba7-1372-43b7-be8d-6341ca81d7e3 None None] MFA Rules not processed for user `0f2ba2e8375b4e8c8792ee1e22b60427`. Rule list: `[]` (Enabled: `True`). {{(pid=71939) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:442}} Nov 24 16:29:12.514356 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.fernet_utils [None req-5015fba7-1372-43b7-be8d-6341ca81d7e3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=71939) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:289}} Nov 24 16:29:12.527408 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: [pid: 71939|app: 0|req: 21/42] 10.222.0.53 () {58 vars in 1013 bytes} [Wed Nov 24 16:29:12 2021] POST /identity/v3/auth/tokens => generated 1067 bytes in 46 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 24 16:29:12.553342 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d279f1f-134c-4bcc-bb46-57c70d36da32 None None] REQUEST_METHOD: `POST` {{(pid=71938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 24 16:29:12.553967 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d279f1f-134c-4bcc-bb46-57c70d36da32 None None] SCRIPT_NAME: `/identity` {{(pid=71938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 24 16:29:12.554603 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d279f1f-134c-4bcc-bb46-57c70d36da32 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=71938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 24 16:29:12.581757 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.auth.core [None req-2d279f1f-134c-4bcc-bb46-57c70d36da32 None None] MFA Rules not processed for user `0f2ba2e8375b4e8c8792ee1e22b60427`. Rule list: `[]` (Enabled: `True`). {{(pid=71938) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:442}} Nov 24 16:29:12.583041 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.fernet_utils [None req-2d279f1f-134c-4bcc-bb46-57c70d36da32 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=71938) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:289}} Nov 24 16:29:12.590379 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: [pid: 71938|app: 0|req: 22/43] 10.222.0.53 () {58 vars in 1013 bytes} [Wed Nov 24 16:29:12 2021] POST /identity/v3/auth/tokens => generated 1067 bytes in 39 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 24 16:29:12.596504 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5015fba7-1372-43b7-be8d-6341ca81d7e3 None None] Authenticating user token {{(pid=71939) process_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 24 16:29:12.606766 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5015fba7-1372-43b7-be8d-6341ca81d7e3 None None] Validating token access rules against request {{(pid=71939) validate_allowed_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 24 16:29:12.612455 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6213c9cc-51c2-4fe8-87a8-fee350b118c4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f2ba2e8375b4e8c8792ee1e22b60427', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '00a5583c7b7443e98e7a1d31a0b638dc', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=71939) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 24 16:29:12.613975 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6213c9cc-51c2-4fe8-87a8-fee350b118c4 admin admin] REQUEST_METHOD: `GET` {{(pid=71939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 24 16:29:12.615182 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6213c9cc-51c2-4fe8-87a8-fee350b118c4 admin admin] SCRIPT_NAME: `/identity` {{(pid=71939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 24 16:29:12.615182 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6213c9cc-51c2-4fe8-87a8-fee350b118c4 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=71939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 24 16:29:12.630779 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6213c9cc-51c2-4fe8-87a8-fee350b118c4 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=71939) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:442}} Nov 24 16:29:12.662231 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6213c9cc-51c2-4fe8-87a8-fee350b118c4 admin admin] RBAC: Authorization granted {{(pid=71939) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 24 16:29:12.682523 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: WARNING keystone.server.flask.application [None req-6213c9cc-51c2-4fe8-87a8-fee350b118c4 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Nov 24 16:29:12.683781 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: [pid: 71939|app: 0|req: 22/44] 10.222.0.53 () {56 vars in 1120 bytes} [Wed Nov 24 16:29:12 2021] GET /identity/v3/domains/Default => generated 87 bytes in 88 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 24 16:29:12.691266 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d279f1f-134c-4bcc-bb46-57c70d36da32 None None] Authenticating user token {{(pid=71938) process_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 24 16:29:12.702754 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d279f1f-134c-4bcc-bb46-57c70d36da32 None None] Validating token access rules against request {{(pid=71938) validate_allowed_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 24 16:29:12.707930 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cf65a3d-7571-49d1-9a71-c946064b08cf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f2ba2e8375b4e8c8792ee1e22b60427', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '00a5583c7b7443e98e7a1d31a0b638dc', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=71938) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 24 16:29:12.708605 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cf65a3d-7571-49d1-9a71-c946064b08cf admin admin] REQUEST_METHOD: `GET` {{(pid=71938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 24 16:29:12.708984 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cf65a3d-7571-49d1-9a71-c946064b08cf admin admin] SCRIPT_NAME: `/identity` {{(pid=71938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 24 16:29:12.709317 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cf65a3d-7571-49d1-9a71-c946064b08cf admin admin] PATH_INFO: `/v3/domains` {{(pid=71938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 24 16:29:12.710156 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cf65a3d-7571-49d1-9a71-c946064b08cf admin admin] RBAC: Adding query filter params (name=Default) {{(pid=71938) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:161}} Nov 24 16:29:12.710512 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cf65a3d-7571-49d1-9a71-c946064b08cf admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=71938) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:442}} Nov 24 16:29:12.739787 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: WARNING py.warnings [None req-0cf65a3d-7571-49d1-9a71-c946064b08cf admin admin] /usr/local/lib/python3.6/dist-packages/oslo_policy/policy.py:1018: UserWarning: Policy identity:list_domains failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 24 16:29:12.739787 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: warnings.warn(msg) Nov 24 16:29:12.739787 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: Nov 24 16:29:12.740764 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cf65a3d-7571-49d1-9a71-c946064b08cf admin admin] RBAC: Authorization granted {{(pid=71938) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 24 16:29:12.756178 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: [pid: 71938|app: 0|req: 23/45] 10.222.0.53 () {56 vars in 1121 bytes} [Wed Nov 24 16:29:12 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 66 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 24 16:29:12.762398 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6213c9cc-51c2-4fe8-87a8-fee350b118c4 admin admin] Authenticating user token {{(pid=71939) process_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 24 16:29:12.774143 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6213c9cc-51c2-4fe8-87a8-fee350b118c4 admin admin] Validating token access rules against request {{(pid=71939) validate_allowed_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 24 16:29:12.778479 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-789d0059-5269-44e8-bf17-de69b19e562d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f2ba2e8375b4e8c8792ee1e22b60427', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '00a5583c7b7443e98e7a1d31a0b638dc', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=71939) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 24 16:29:12.779142 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-789d0059-5269-44e8-bf17-de69b19e562d admin admin] REQUEST_METHOD: `POST` {{(pid=71939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 24 16:29:12.779483 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-789d0059-5269-44e8-bf17-de69b19e562d admin admin] SCRIPT_NAME: `/identity` {{(pid=71939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 24 16:29:12.779813 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-789d0059-5269-44e8-bf17-de69b19e562d admin admin] PATH_INFO: `/v3/projects` {{(pid=71939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 24 16:29:12.780571 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-789d0059-5269-44e8-bf17-de69b19e562d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=71939) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:442}} Nov 24 16:29:12.815057 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: WARNING py.warnings [None req-789d0059-5269-44e8-bf17-de69b19e562d admin admin] /usr/local/lib/python3.6/dist-packages/oslo_policy/policy.py:1018: UserWarning: Policy identity:create_project failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Nov 24 16:29:12.815057 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: warnings.warn(msg) Nov 24 16:29:12.815057 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: Nov 24 16:29:12.816484 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-789d0059-5269-44e8-bf17-de69b19e562d admin admin] RBAC: Authorization granted {{(pid=71939) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 24 16:29:13.119217 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: [pid: 71939|app: 0|req: 23/46] 10.222.0.53 () {60 vars in 1152 bytes} [Wed Nov 24 16:29:12 2021] POST /identity/v3/projects => generated 301 bytes in 357 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 24 16:29:15.144092 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7961e9f-0a65-4381-8daa-e8113a7b3554 None None] REQUEST_METHOD: `GET` {{(pid=71938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 24 16:29:15.144647 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7961e9f-0a65-4381-8daa-e8113a7b3554 None None] SCRIPT_NAME: `/identity` {{(pid=71938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 24 16:29:15.144740 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7961e9f-0a65-4381-8daa-e8113a7b3554 None None] PATH_INFO: `/` {{(pid=71938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 24 16:29:15.146645 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: [pid: 71938|app: 0|req: 24/47] 10.222.0.53 () {54 vars in 915 bytes} [Wed Nov 24 16:29:15 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 24 16:29:15.155568 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-000f3fa0-fedf-4ad4-941f-68e607173975 None None] REQUEST_METHOD: `POST` {{(pid=71939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 24 16:29:15.155936 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-000f3fa0-fedf-4ad4-941f-68e607173975 None None] SCRIPT_NAME: `/identity` {{(pid=71939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 24 16:29:15.156282 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-000f3fa0-fedf-4ad4-941f-68e607173975 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=71939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 24 16:29:15.185499 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.auth.core [None req-000f3fa0-fedf-4ad4-941f-68e607173975 None None] MFA Rules not processed for user `0f2ba2e8375b4e8c8792ee1e22b60427`. Rule list: `[]` (Enabled: `True`). {{(pid=71939) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:442}} Nov 24 16:29:15.187293 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.fernet_utils [None req-000f3fa0-fedf-4ad4-941f-68e607173975 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=71939) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:289}} Nov 24 16:29:15.264042 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: [pid: 71939|app: 0|req: 24/48] 10.222.0.53 () {58 vars in 1013 bytes} [Wed Nov 24 16:29:15 2021] POST /identity/v3/auth/tokens => generated 1067 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 24 16:29:15.286538 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5e99884-003c-448a-83d7-4f917f5556c5 None None] REQUEST_METHOD: `POST` {{(pid=71938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 24 16:29:15.286879 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5e99884-003c-448a-83d7-4f917f5556c5 None None] SCRIPT_NAME: `/identity` {{(pid=71938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 24 16:29:15.287216 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5e99884-003c-448a-83d7-4f917f5556c5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=71938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 24 16:29:15.310831 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.auth.core [None req-d5e99884-003c-448a-83d7-4f917f5556c5 None None] MFA Rules not processed for user `0f2ba2e8375b4e8c8792ee1e22b60427`. Rule list: `[]` (Enabled: `True`). {{(pid=71938) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:442}} Nov 24 16:29:15.312048 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.fernet_utils [None req-d5e99884-003c-448a-83d7-4f917f5556c5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=71938) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:289}} Nov 24 16:29:15.319253 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: [pid: 71938|app: 0|req: 25/49] 10.222.0.53 () {58 vars in 1013 bytes} [Wed Nov 24 16:29:15 2021] POST /identity/v3/auth/tokens => generated 1067 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 24 16:29:15.325142 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-000f3fa0-fedf-4ad4-941f-68e607173975 None None] Authenticating user token {{(pid=71939) process_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 24 16:29:15.335837 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-000f3fa0-fedf-4ad4-941f-68e607173975 None None] Validating token access rules against request {{(pid=71939) validate_allowed_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 24 16:29:15.340113 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70722728-b07a-41c1-a1c1-fcc265b228de admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f2ba2e8375b4e8c8792ee1e22b60427', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '00a5583c7b7443e98e7a1d31a0b638dc', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=71939) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 24 16:29:15.340831 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70722728-b07a-41c1-a1c1-fcc265b228de admin admin] REQUEST_METHOD: `POST` {{(pid=71939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 24 16:29:15.341173 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70722728-b07a-41c1-a1c1-fcc265b228de admin admin] SCRIPT_NAME: `/identity` {{(pid=71939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 24 16:29:15.341508 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70722728-b07a-41c1-a1c1-fcc265b228de admin admin] PATH_INFO: `/v3/roles` {{(pid=71939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 24 16:29:15.342409 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70722728-b07a-41c1-a1c1-fcc265b228de admin admin] RBAC: Authorizing `identity:create_role()` {{(pid=71939) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:442}} Nov 24 16:29:15.371827 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: WARNING py.warnings [None req-70722728-b07a-41c1-a1c1-fcc265b228de admin admin] /usr/local/lib/python3.6/dist-packages/oslo_policy/policy.py:1018: UserWarning: Policy identity:create_role failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 24 16:29:15.371827 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: warnings.warn(msg) Nov 24 16:29:15.371827 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: Nov 24 16:29:15.372916 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70722728-b07a-41c1-a1c1-fcc265b228de admin admin] RBAC: Authorization granted {{(pid=71939) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 24 16:29:15.386960 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: [pid: 71939|app: 0|req: 25/50] 10.222.0.53 () {60 vars in 1143 bytes} [Wed Nov 24 16:29:15 2021] POST /identity/v3/roles => generated 219 bytes in 62 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 24 16:29:17.402650 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01c2e358-4a61-42f9-8163-06d56677a69a None None] REQUEST_METHOD: `GET` {{(pid=71938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 24 16:29:17.403191 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01c2e358-4a61-42f9-8163-06d56677a69a None None] SCRIPT_NAME: `/identity` {{(pid=71938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 24 16:29:17.403284 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01c2e358-4a61-42f9-8163-06d56677a69a None None] PATH_INFO: `/` {{(pid=71938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 24 16:29:17.405087 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: [pid: 71938|app: 0|req: 26/51] 10.222.0.53 () {54 vars in 915 bytes} [Wed Nov 24 16:29:17 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 24 16:29:17.411666 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2771625-588e-449f-90e1-c13d7e8bf069 None None] REQUEST_METHOD: `POST` {{(pid=71939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 24 16:29:17.412016 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2771625-588e-449f-90e1-c13d7e8bf069 None None] SCRIPT_NAME: `/identity` {{(pid=71939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 24 16:29:17.412357 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2771625-588e-449f-90e1-c13d7e8bf069 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=71939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 24 16:29:17.435656 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.auth.core [None req-c2771625-588e-449f-90e1-c13d7e8bf069 None None] MFA Rules not processed for user `0f2ba2e8375b4e8c8792ee1e22b60427`. Rule list: `[]` (Enabled: `True`). {{(pid=71939) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:442}} Nov 24 16:29:17.436860 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.fernet_utils [None req-c2771625-588e-449f-90e1-c13d7e8bf069 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=71939) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:289}} Nov 24 16:29:17.443902 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: [pid: 71939|app: 0|req: 26/52] 10.222.0.53 () {58 vars in 1013 bytes} [Wed Nov 24 16:29:17 2021] POST /identity/v3/auth/tokens => generated 1067 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 24 16:29:17.466518 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff720762-55be-4547-9088-e35cd863e555 None None] REQUEST_METHOD: `POST` {{(pid=71938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 24 16:29:17.466803 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff720762-55be-4547-9088-e35cd863e555 None None] SCRIPT_NAME: `/identity` {{(pid=71938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 24 16:29:17.467134 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff720762-55be-4547-9088-e35cd863e555 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=71938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 24 16:29:17.490422 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.auth.core [None req-ff720762-55be-4547-9088-e35cd863e555 None None] MFA Rules not processed for user `0f2ba2e8375b4e8c8792ee1e22b60427`. Rule list: `[]` (Enabled: `True`). {{(pid=71938) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:442}} Nov 24 16:29:17.491645 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.fernet_utils [None req-ff720762-55be-4547-9088-e35cd863e555 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=71938) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:289}} Nov 24 16:29:17.498760 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: [pid: 71938|app: 0|req: 27/53] 10.222.0.53 () {58 vars in 1013 bytes} [Wed Nov 24 16:29:17 2021] POST /identity/v3/auth/tokens => generated 1067 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 24 16:29:17.505018 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2771625-588e-449f-90e1-c13d7e8bf069 None None] Authenticating user token {{(pid=71939) process_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 24 16:29:17.514847 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2771625-588e-449f-90e1-c13d7e8bf069 None None] Validating token access rules against request {{(pid=71939) validate_allowed_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 24 16:29:17.519760 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-615b948f-c787-48dc-8383-0187a5e687a0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f2ba2e8375b4e8c8792ee1e22b60427', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '00a5583c7b7443e98e7a1d31a0b638dc', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=71939) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 24 16:29:17.520435 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-615b948f-c787-48dc-8383-0187a5e687a0 admin admin] REQUEST_METHOD: `POST` {{(pid=71939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 24 16:29:17.520778 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-615b948f-c787-48dc-8383-0187a5e687a0 admin admin] SCRIPT_NAME: `/identity` {{(pid=71939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 24 16:29:17.521113 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-615b948f-c787-48dc-8383-0187a5e687a0 admin admin] PATH_INFO: `/v3/roles` {{(pid=71939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 24 16:29:17.521912 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-615b948f-c787-48dc-8383-0187a5e687a0 admin admin] RBAC: Authorizing `identity:create_role()` {{(pid=71939) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:442}} Nov 24 16:29:17.550553 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-615b948f-c787-48dc-8383-0187a5e687a0 admin admin] RBAC: Authorization granted {{(pid=71939) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 24 16:29:17.562499 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: [pid: 71939|app: 0|req: 27/54] 10.222.0.53 () {60 vars in 1143 bytes} [Wed Nov 24 16:29:17 2021] POST /identity/v3/roles => generated 225 bytes in 58 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 24 16:29:19.560849 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-847b93aa-9a97-438f-b03b-f9423af4dfd3 None None] REQUEST_METHOD: `GET` {{(pid=71938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 24 16:29:19.561333 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-847b93aa-9a97-438f-b03b-f9423af4dfd3 None None] SCRIPT_NAME: `/identity` {{(pid=71938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 24 16:29:19.561435 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-847b93aa-9a97-438f-b03b-f9423af4dfd3 None None] PATH_INFO: `/` {{(pid=71938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 24 16:29:19.563328 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: [pid: 71938|app: 0|req: 28/55] 10.222.0.53 () {54 vars in 915 bytes} [Wed Nov 24 16:29:19 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 24 16:29:19.569531 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecb5b275-f7ce-4227-96f0-19389771c299 None None] REQUEST_METHOD: `POST` {{(pid=71939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 24 16:29:19.569882 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecb5b275-f7ce-4227-96f0-19389771c299 None None] SCRIPT_NAME: `/identity` {{(pid=71939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 24 16:29:19.570253 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecb5b275-f7ce-4227-96f0-19389771c299 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=71939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 24 16:29:19.593847 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.auth.core [None req-ecb5b275-f7ce-4227-96f0-19389771c299 None None] MFA Rules not processed for user `0f2ba2e8375b4e8c8792ee1e22b60427`. Rule list: `[]` (Enabled: `True`). {{(pid=71939) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:442}} Nov 24 16:29:19.595106 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.fernet_utils [None req-ecb5b275-f7ce-4227-96f0-19389771c299 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=71939) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:289}} Nov 24 16:29:19.602177 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: [pid: 71939|app: 0|req: 28/56] 10.222.0.53 () {58 vars in 1013 bytes} [Wed Nov 24 16:29:19 2021] POST /identity/v3/auth/tokens => generated 1067 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 24 16:29:19.624105 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db6c8062-5d47-4f11-a6bf-c9f76c56728f None None] REQUEST_METHOD: `POST` {{(pid=71938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 24 16:29:19.624451 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db6c8062-5d47-4f11-a6bf-c9f76c56728f None None] SCRIPT_NAME: `/identity` {{(pid=71938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 24 16:29:19.624797 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db6c8062-5d47-4f11-a6bf-c9f76c56728f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=71938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 24 16:29:19.648241 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.auth.core [None req-db6c8062-5d47-4f11-a6bf-c9f76c56728f None None] MFA Rules not processed for user `0f2ba2e8375b4e8c8792ee1e22b60427`. Rule list: `[]` (Enabled: `True`). {{(pid=71938) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:442}} Nov 24 16:29:19.649439 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.fernet_utils [None req-db6c8062-5d47-4f11-a6bf-c9f76c56728f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=71938) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:289}} Nov 24 16:29:19.656548 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: [pid: 71938|app: 0|req: 29/57] 10.222.0.53 () {58 vars in 1013 bytes} [Wed Nov 24 16:29:19 2021] POST /identity/v3/auth/tokens => generated 1067 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 24 16:29:19.662019 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecb5b275-f7ce-4227-96f0-19389771c299 None None] Authenticating user token {{(pid=71939) process_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 24 16:29:19.671449 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecb5b275-f7ce-4227-96f0-19389771c299 None None] Validating token access rules against request {{(pid=71939) validate_allowed_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 24 16:29:19.676141 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b79aa758-60cc-47f4-bf7c-6ce2b534721b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f2ba2e8375b4e8c8792ee1e22b60427', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '00a5583c7b7443e98e7a1d31a0b638dc', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=71939) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 24 16:29:19.676803 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b79aa758-60cc-47f4-bf7c-6ce2b534721b admin admin] REQUEST_METHOD: `POST` {{(pid=71939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 24 16:29:19.677139 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b79aa758-60cc-47f4-bf7c-6ce2b534721b admin admin] SCRIPT_NAME: `/identity` {{(pid=71939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 24 16:29:19.677469 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b79aa758-60cc-47f4-bf7c-6ce2b534721b admin admin] PATH_INFO: `/v3/roles` {{(pid=71939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 24 16:29:19.678275 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b79aa758-60cc-47f4-bf7c-6ce2b534721b admin admin] RBAC: Authorizing `identity:create_role()` {{(pid=71939) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:442}} Nov 24 16:29:19.706831 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b79aa758-60cc-47f4-bf7c-6ce2b534721b admin admin] RBAC: Authorization granted {{(pid=71939) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 24 16:29:19.718190 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: [pid: 71939|app: 0|req: 29/58] 10.222.0.53 () {60 vars in 1143 bytes} [Wed Nov 24 16:29:19 2021] POST /identity/v3/roles => generated 223 bytes in 57 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 24 16:29:21.704488 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e36b1fae-578c-4682-b54e-3ca0453dd322 None None] REQUEST_METHOD: `GET` {{(pid=71938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 24 16:29:21.705002 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e36b1fae-578c-4682-b54e-3ca0453dd322 None None] SCRIPT_NAME: `/identity` {{(pid=71938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 24 16:29:21.705150 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e36b1fae-578c-4682-b54e-3ca0453dd322 None None] PATH_INFO: `/` {{(pid=71938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 24 16:29:21.707061 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: [pid: 71938|app: 0|req: 30/59] 10.222.0.53 () {54 vars in 915 bytes} [Wed Nov 24 16:29:21 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 24 16:29:21.712694 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ba89f66-1e53-42ad-bc7b-37df48f82ccd None None] REQUEST_METHOD: `POST` {{(pid=71939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 24 16:29:21.713045 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ba89f66-1e53-42ad-bc7b-37df48f82ccd None None] SCRIPT_NAME: `/identity` {{(pid=71939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 24 16:29:21.713380 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ba89f66-1e53-42ad-bc7b-37df48f82ccd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=71939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 24 16:29:21.736462 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.auth.core [None req-5ba89f66-1e53-42ad-bc7b-37df48f82ccd None None] MFA Rules not processed for user `0f2ba2e8375b4e8c8792ee1e22b60427`. Rule list: `[]` (Enabled: `True`). {{(pid=71939) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:442}} Nov 24 16:29:21.738219 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.fernet_utils [None req-5ba89f66-1e53-42ad-bc7b-37df48f82ccd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=71939) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:289}} Nov 24 16:29:21.745319 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: [pid: 71939|app: 0|req: 30/60] 10.222.0.53 () {58 vars in 1013 bytes} [Wed Nov 24 16:29:21 2021] POST /identity/v3/auth/tokens => generated 1067 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 24 16:29:21.768072 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69c9013c-8e88-4b57-8e4d-088d07089870 None None] REQUEST_METHOD: `POST` {{(pid=71938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 24 16:29:21.768411 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69c9013c-8e88-4b57-8e4d-088d07089870 None None] SCRIPT_NAME: `/identity` {{(pid=71938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 24 16:29:21.768745 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69c9013c-8e88-4b57-8e4d-088d07089870 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=71938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 24 16:29:21.791501 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.auth.core [None req-69c9013c-8e88-4b57-8e4d-088d07089870 None None] MFA Rules not processed for user `0f2ba2e8375b4e8c8792ee1e22b60427`. Rule list: `[]` (Enabled: `True`). {{(pid=71938) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:442}} Nov 24 16:29:21.792693 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.fernet_utils [None req-69c9013c-8e88-4b57-8e4d-088d07089870 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=71938) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:289}} Nov 24 16:29:21.799650 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: [pid: 71938|app: 0|req: 31/61] 10.222.0.53 () {58 vars in 1013 bytes} [Wed Nov 24 16:29:21 2021] POST /identity/v3/auth/tokens => generated 1067 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 24 16:29:21.805599 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ba89f66-1e53-42ad-bc7b-37df48f82ccd None None] Authenticating user token {{(pid=71939) process_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 24 16:29:21.815046 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ba89f66-1e53-42ad-bc7b-37df48f82ccd None None] Validating token access rules against request {{(pid=71939) validate_allowed_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 24 16:29:21.819865 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c183e33-b60e-4f8b-b17a-b70d9817d3c7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f2ba2e8375b4e8c8792ee1e22b60427', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '00a5583c7b7443e98e7a1d31a0b638dc', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=71939) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 24 16:29:21.820828 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c183e33-b60e-4f8b-b17a-b70d9817d3c7 admin admin] REQUEST_METHOD: `GET` {{(pid=71939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 24 16:29:21.821457 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c183e33-b60e-4f8b-b17a-b70d9817d3c7 admin admin] SCRIPT_NAME: `/identity` {{(pid=71939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 24 16:29:21.821457 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c183e33-b60e-4f8b-b17a-b70d9817d3c7 admin admin] PATH_INFO: `/v3/domains/default` {{(pid=71939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 24 16:29:21.823545 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c183e33-b60e-4f8b-b17a-b70d9817d3c7 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=71939) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:442}} Nov 24 16:29:21.851897 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c183e33-b60e-4f8b-b17a-b70d9817d3c7 admin admin] RBAC: Authorization granted {{(pid=71939) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 24 16:29:21.853458 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: [pid: 71939|app: 0|req: 31/62] 10.222.0.53 () {56 vars in 1120 bytes} [Wed Nov 24 16:29:21 2021] GET /identity/v3/domains/default => generated 199 bytes in 48 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 24 16:29:21.858845 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69c9013c-8e88-4b57-8e4d-088d07089870 None None] Authenticating user token {{(pid=71938) process_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 24 16:29:21.868277 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69c9013c-8e88-4b57-8e4d-088d07089870 None None] Validating token access rules against request {{(pid=71938) validate_allowed_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 24 16:29:21.872439 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddb33b22-0f78-467e-89a7-f2adc5e7e8ce admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f2ba2e8375b4e8c8792ee1e22b60427', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '00a5583c7b7443e98e7a1d31a0b638dc', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=71938) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 24 16:29:21.873104 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddb33b22-0f78-467e-89a7-f2adc5e7e8ce admin admin] REQUEST_METHOD: `POST` {{(pid=71938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 24 16:29:21.873437 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddb33b22-0f78-467e-89a7-f2adc5e7e8ce admin admin] SCRIPT_NAME: `/identity` {{(pid=71938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 24 16:29:21.873764 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddb33b22-0f78-467e-89a7-f2adc5e7e8ce admin admin] PATH_INFO: `/v3/projects` {{(pid=71938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 24 16:29:21.874542 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddb33b22-0f78-467e-89a7-f2adc5e7e8ce admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=71938) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:442}} Nov 24 16:29:21.902129 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: WARNING py.warnings [None req-ddb33b22-0f78-467e-89a7-f2adc5e7e8ce admin admin] /usr/local/lib/python3.6/dist-packages/oslo_policy/policy.py:1018: UserWarning: Policy identity:create_project failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Nov 24 16:29:21.902129 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: warnings.warn(msg) Nov 24 16:29:21.902129 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: Nov 24 16:29:21.903466 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddb33b22-0f78-467e-89a7-f2adc5e7e8ce admin admin] RBAC: Authorization granted {{(pid=71938) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 24 16:29:21.930986 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: [pid: 71938|app: 0|req: 32/63] 10.222.0.53 () {60 vars in 1152 bytes} [Wed Nov 24 16:29:21 2021] POST /identity/v3/projects => generated 312 bytes in 73 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 24 16:29:23.974384 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8282258-ea58-4b07-afb1-1a2958d29f27 None None] REQUEST_METHOD: `GET` {{(pid=71939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 24 16:29:23.974924 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8282258-ea58-4b07-afb1-1a2958d29f27 None None] SCRIPT_NAME: `/identity` {{(pid=71939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 24 16:29:23.975055 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8282258-ea58-4b07-afb1-1a2958d29f27 None None] PATH_INFO: `/` {{(pid=71939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 24 16:29:23.976983 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: [pid: 71939|app: 0|req: 32/64] 10.222.0.53 () {54 vars in 915 bytes} [Wed Nov 24 16:29:23 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 24 16:29:23.982654 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3aaf501-1bab-4342-877f-60ecebd336ed None None] REQUEST_METHOD: `POST` {{(pid=71938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 24 16:29:23.983015 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3aaf501-1bab-4342-877f-60ecebd336ed None None] SCRIPT_NAME: `/identity` {{(pid=71938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 24 16:29:23.983358 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3aaf501-1bab-4342-877f-60ecebd336ed None None] PATH_INFO: `/v3/auth/tokens` {{(pid=71938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 24 16:29:24.009010 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.auth.core [None req-d3aaf501-1bab-4342-877f-60ecebd336ed None None] MFA Rules not processed for user `0f2ba2e8375b4e8c8792ee1e22b60427`. Rule list: `[]` (Enabled: `True`). {{(pid=71938) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:442}} Nov 24 16:29:24.010263 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.fernet_utils [None req-d3aaf501-1bab-4342-877f-60ecebd336ed None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=71938) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:289}} Nov 24 16:29:24.080899 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: [pid: 71938|app: 0|req: 33/65] 10.222.0.53 () {58 vars in 1013 bytes} [Wed Nov 24 16:29:23 2021] POST /identity/v3/auth/tokens => generated 1067 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 24 16:29:24.107354 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d83ab44-3067-4531-8b6c-23ac58c5089f None None] REQUEST_METHOD: `POST` {{(pid=71939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 24 16:29:24.107699 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d83ab44-3067-4531-8b6c-23ac58c5089f None None] SCRIPT_NAME: `/identity` {{(pid=71939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 24 16:29:24.108050 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d83ab44-3067-4531-8b6c-23ac58c5089f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=71939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 24 16:29:24.135884 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.auth.core [None req-7d83ab44-3067-4531-8b6c-23ac58c5089f None None] MFA Rules not processed for user `0f2ba2e8375b4e8c8792ee1e22b60427`. Rule list: `[]` (Enabled: `True`). {{(pid=71939) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:442}} Nov 24 16:29:24.137102 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.fernet_utils [None req-7d83ab44-3067-4531-8b6c-23ac58c5089f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=71939) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:289}} Nov 24 16:29:24.144258 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: [pid: 71939|app: 0|req: 33/66] 10.222.0.53 () {58 vars in 1013 bytes} [Wed Nov 24 16:29:24 2021] POST /identity/v3/auth/tokens => generated 1067 bytes in 39 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 24 16:29:24.149959 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3aaf501-1bab-4342-877f-60ecebd336ed None None] Authenticating user token {{(pid=71938) process_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 24 16:29:24.159479 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3aaf501-1bab-4342-877f-60ecebd336ed None None] Validating token access rules against request {{(pid=71938) validate_allowed_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 24 16:29:24.163581 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00fe498b-e550-4a9e-a7f3-9c61ce0e69ed admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f2ba2e8375b4e8c8792ee1e22b60427', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '00a5583c7b7443e98e7a1d31a0b638dc', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=71938) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 24 16:29:24.164388 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00fe498b-e550-4a9e-a7f3-9c61ce0e69ed admin admin] REQUEST_METHOD: `GET` {{(pid=71938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 24 16:29:24.164728 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00fe498b-e550-4a9e-a7f3-9c61ce0e69ed admin admin] SCRIPT_NAME: `/identity` {{(pid=71938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 24 16:29:24.165057 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00fe498b-e550-4a9e-a7f3-9c61ce0e69ed admin admin] PATH_INFO: `/v3/domains/default` {{(pid=71938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 24 16:29:24.166244 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00fe498b-e550-4a9e-a7f3-9c61ce0e69ed admin admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=71938) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:442}} Nov 24 16:29:24.197423 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00fe498b-e550-4a9e-a7f3-9c61ce0e69ed admin admin] RBAC: Authorization granted {{(pid=71938) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 24 16:29:24.199117 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: [pid: 71938|app: 0|req: 34/67] 10.222.0.53 () {56 vars in 1120 bytes} [Wed Nov 24 16:29:24 2021] GET /identity/v3/domains/default => generated 199 bytes in 50 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 24 16:29:24.205236 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d83ab44-3067-4531-8b6c-23ac58c5089f None None] Authenticating user token {{(pid=71939) process_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 24 16:29:24.214494 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d83ab44-3067-4531-8b6c-23ac58c5089f None None] Validating token access rules against request {{(pid=71939) validate_allowed_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 24 16:29:24.219017 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3463826c-7285-48d6-bf71-f8a606902227 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f2ba2e8375b4e8c8792ee1e22b60427', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '00a5583c7b7443e98e7a1d31a0b638dc', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=71939) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 24 16:29:24.219685 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3463826c-7285-48d6-bf71-f8a606902227 admin admin] REQUEST_METHOD: `POST` {{(pid=71939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 24 16:29:24.220019 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3463826c-7285-48d6-bf71-f8a606902227 admin admin] SCRIPT_NAME: `/identity` {{(pid=71939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 24 16:29:24.220348 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3463826c-7285-48d6-bf71-f8a606902227 admin admin] PATH_INFO: `/v3/projects` {{(pid=71939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 24 16:29:24.221097 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3463826c-7285-48d6-bf71-f8a606902227 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=71939) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:442}} Nov 24 16:29:24.250252 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3463826c-7285-48d6-bf71-f8a606902227 admin admin] RBAC: Authorization granted {{(pid=71939) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 24 16:29:24.276225 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: [pid: 71939|app: 0|req: 34/68] 10.222.0.53 () {60 vars in 1152 bytes} [Wed Nov 24 16:29:24 2021] POST /identity/v3/projects => generated 298 bytes in 72 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 24 16:29:26.270983 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c045595-d3a2-4ec8-a199-4f17da13b0ee None None] REQUEST_METHOD: `GET` {{(pid=71938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 24 16:29:26.271485 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c045595-d3a2-4ec8-a199-4f17da13b0ee None None] SCRIPT_NAME: `/identity` {{(pid=71938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 24 16:29:26.271610 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c045595-d3a2-4ec8-a199-4f17da13b0ee None None] PATH_INFO: `/` {{(pid=71938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 24 16:29:26.273447 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: [pid: 71938|app: 0|req: 35/69] 10.222.0.53 () {54 vars in 915 bytes} [Wed Nov 24 16:29:26 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 24 16:29:26.279110 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36704f8e-0796-450e-b7c5-cd8ee1f14c89 None None] REQUEST_METHOD: `POST` {{(pid=71939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 24 16:29:26.279465 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36704f8e-0796-450e-b7c5-cd8ee1f14c89 None None] SCRIPT_NAME: `/identity` {{(pid=71939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 24 16:29:26.279808 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36704f8e-0796-450e-b7c5-cd8ee1f14c89 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=71939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 24 16:29:26.303440 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.auth.core [None req-36704f8e-0796-450e-b7c5-cd8ee1f14c89 None None] MFA Rules not processed for user `0f2ba2e8375b4e8c8792ee1e22b60427`. Rule list: `[]` (Enabled: `True`). {{(pid=71939) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:442}} Nov 24 16:29:26.304677 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.fernet_utils [None req-36704f8e-0796-450e-b7c5-cd8ee1f14c89 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=71939) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:289}} Nov 24 16:29:26.372599 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: [pid: 71939|app: 0|req: 35/70] 10.222.0.53 () {58 vars in 1013 bytes} [Wed Nov 24 16:29:26 2021] POST /identity/v3/auth/tokens => generated 1067 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 24 16:29:26.395681 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71031d4d-2e7d-461e-b3d8-775bf81c9f27 None None] REQUEST_METHOD: `POST` {{(pid=71938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 24 16:29:26.396031 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71031d4d-2e7d-461e-b3d8-775bf81c9f27 None None] SCRIPT_NAME: `/identity` {{(pid=71938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 24 16:29:26.396366 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71031d4d-2e7d-461e-b3d8-775bf81c9f27 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=71938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 24 16:29:26.420195 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.auth.core [None req-71031d4d-2e7d-461e-b3d8-775bf81c9f27 None None] MFA Rules not processed for user `0f2ba2e8375b4e8c8792ee1e22b60427`. Rule list: `[]` (Enabled: `True`). {{(pid=71938) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:442}} Nov 24 16:29:26.421427 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.fernet_utils [None req-71031d4d-2e7d-461e-b3d8-775bf81c9f27 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=71938) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:289}} Nov 24 16:29:26.430261 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: [pid: 71938|app: 0|req: 36/71] 10.222.0.53 () {58 vars in 1013 bytes} [Wed Nov 24 16:29:26 2021] POST /identity/v3/auth/tokens => generated 1067 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Nov 24 16:29:26.436070 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36704f8e-0796-450e-b7c5-cd8ee1f14c89 None None] Authenticating user token {{(pid=71939) process_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 24 16:29:26.445687 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36704f8e-0796-450e-b7c5-cd8ee1f14c89 None None] Validating token access rules against request {{(pid=71939) validate_allowed_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 24 16:29:26.449864 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8142a57-405a-4d3a-916a-78b9721dda49 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f2ba2e8375b4e8c8792ee1e22b60427', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '00a5583c7b7443e98e7a1d31a0b638dc', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=71939) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 24 16:29:26.450705 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8142a57-405a-4d3a-916a-78b9721dda49 admin admin] REQUEST_METHOD: `GET` {{(pid=71939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 24 16:29:26.451051 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8142a57-405a-4d3a-916a-78b9721dda49 admin admin] SCRIPT_NAME: `/identity` {{(pid=71939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 24 16:29:26.451383 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8142a57-405a-4d3a-916a-78b9721dda49 admin admin] PATH_INFO: `/v3/domains/default` {{(pid=71939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 24 16:29:26.452610 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8142a57-405a-4d3a-916a-78b9721dda49 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=71939) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:442}} Nov 24 16:29:26.481976 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8142a57-405a-4d3a-916a-78b9721dda49 admin admin] RBAC: Authorization granted {{(pid=71939) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 24 16:29:26.483556 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: [pid: 71939|app: 0|req: 36/72] 10.222.0.53 () {56 vars in 1120 bytes} [Wed Nov 24 16:29:26 2021] GET /identity/v3/domains/default => generated 199 bytes in 48 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 24 16:29:26.489303 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71031d4d-2e7d-461e-b3d8-775bf81c9f27 None None] Authenticating user token {{(pid=71938) process_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 24 16:29:26.499021 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71031d4d-2e7d-461e-b3d8-775bf81c9f27 None None] Validating token access rules against request {{(pid=71938) validate_allowed_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 24 16:29:26.503770 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc93dfe1-ad94-4ba2-bb7c-e47dd1f73e5f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f2ba2e8375b4e8c8792ee1e22b60427', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '00a5583c7b7443e98e7a1d31a0b638dc', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=71938) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 24 16:29:26.504443 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc93dfe1-ad94-4ba2-bb7c-e47dd1f73e5f admin admin] REQUEST_METHOD: `POST` {{(pid=71938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 24 16:29:26.504783 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc93dfe1-ad94-4ba2-bb7c-e47dd1f73e5f admin admin] SCRIPT_NAME: `/identity` {{(pid=71938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 24 16:29:26.505118 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc93dfe1-ad94-4ba2-bb7c-e47dd1f73e5f admin admin] PATH_INFO: `/v3/users` {{(pid=71938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 24 16:29:26.505874 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc93dfe1-ad94-4ba2-bb7c-e47dd1f73e5f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=71938) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:442}} Nov 24 16:29:26.534290 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: WARNING py.warnings [None req-cc93dfe1-ad94-4ba2-bb7c-e47dd1f73e5f admin admin] /usr/local/lib/python3.6/dist-packages/oslo_policy/policy.py:1018: UserWarning: Policy identity:create_user failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Nov 24 16:29:26.534290 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: warnings.warn(msg) Nov 24 16:29:26.534290 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: Nov 24 16:29:26.535665 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc93dfe1-ad94-4ba2-bb7c-e47dd1f73e5f admin admin] RBAC: Authorization granted {{(pid=71938) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 24 16:29:26.559750 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: [pid: 71938|app: 0|req: 37/73] 10.222.0.53 () {60 vars in 1144 bytes} [Wed Nov 24 16:29:26 2021] POST /identity/v3/users => generated 275 bytes in 71 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 24 16:29:28.552381 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8784ec6f-aae3-48d9-b2bc-a65c0c5cdc55 None None] REQUEST_METHOD: `GET` {{(pid=71939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 24 16:29:28.552913 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8784ec6f-aae3-48d9-b2bc-a65c0c5cdc55 None None] SCRIPT_NAME: `/identity` {{(pid=71939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 24 16:29:28.553025 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8784ec6f-aae3-48d9-b2bc-a65c0c5cdc55 None None] PATH_INFO: `/` {{(pid=71939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 24 16:29:28.554856 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: [pid: 71939|app: 0|req: 37/74] 10.222.0.53 () {54 vars in 915 bytes} [Wed Nov 24 16:29:28 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 24 16:29:28.560338 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfb0a58a-80c6-4c03-b6fd-1a051b635cc4 None None] REQUEST_METHOD: `POST` {{(pid=71938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 24 16:29:28.560692 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfb0a58a-80c6-4c03-b6fd-1a051b635cc4 None None] SCRIPT_NAME: `/identity` {{(pid=71938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 24 16:29:28.561034 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfb0a58a-80c6-4c03-b6fd-1a051b635cc4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=71938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 24 16:29:28.584801 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.auth.core [None req-dfb0a58a-80c6-4c03-b6fd-1a051b635cc4 None None] MFA Rules not processed for user `0f2ba2e8375b4e8c8792ee1e22b60427`. Rule list: `[]` (Enabled: `True`). {{(pid=71938) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:442}} Nov 24 16:29:28.586087 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.fernet_utils [None req-dfb0a58a-80c6-4c03-b6fd-1a051b635cc4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=71938) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:289}} Nov 24 16:29:28.593127 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: [pid: 71938|app: 0|req: 38/75] 10.222.0.53 () {58 vars in 1013 bytes} [Wed Nov 24 16:29:28 2021] POST /identity/v3/auth/tokens => generated 1067 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 24 16:29:28.615640 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27b8689d-5568-4e9c-8dce-1081f967d3ab None None] REQUEST_METHOD: `POST` {{(pid=71939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 24 16:29:28.615992 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27b8689d-5568-4e9c-8dce-1081f967d3ab None None] SCRIPT_NAME: `/identity` {{(pid=71939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 24 16:29:28.616332 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27b8689d-5568-4e9c-8dce-1081f967d3ab None None] PATH_INFO: `/v3/auth/tokens` {{(pid=71939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 24 16:29:28.640048 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.auth.core [None req-27b8689d-5568-4e9c-8dce-1081f967d3ab None None] MFA Rules not processed for user `0f2ba2e8375b4e8c8792ee1e22b60427`. Rule list: `[]` (Enabled: `True`). {{(pid=71939) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:442}} Nov 24 16:29:28.641281 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.fernet_utils [None req-27b8689d-5568-4e9c-8dce-1081f967d3ab None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=71939) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:289}} Nov 24 16:29:28.648332 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: [pid: 71939|app: 0|req: 38/76] 10.222.0.53 () {58 vars in 1013 bytes} [Wed Nov 24 16:29:28 2021] POST /identity/v3/auth/tokens => generated 1067 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Nov 24 16:29:28.653925 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfb0a58a-80c6-4c03-b6fd-1a051b635cc4 None None] Authenticating user token {{(pid=71938) process_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 24 16:29:28.667720 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfb0a58a-80c6-4c03-b6fd-1a051b635cc4 None None] Validating token access rules against request {{(pid=71938) validate_allowed_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 24 16:29:28.672059 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a85b4007-4862-40a5-84e6-f0e9bd0652a0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f2ba2e8375b4e8c8792ee1e22b60427', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '00a5583c7b7443e98e7a1d31a0b638dc', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=71938) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 24 16:29:28.672874 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a85b4007-4862-40a5-84e6-f0e9bd0652a0 admin admin] REQUEST_METHOD: `GET` {{(pid=71938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 24 16:29:28.673216 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a85b4007-4862-40a5-84e6-f0e9bd0652a0 admin admin] SCRIPT_NAME: `/identity` {{(pid=71938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 24 16:29:28.673552 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a85b4007-4862-40a5-84e6-f0e9bd0652a0 admin admin] PATH_INFO: `/v3/roles/member` {{(pid=71938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 24 16:29:28.686366 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a85b4007-4862-40a5-84e6-f0e9bd0652a0 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=71938) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:401}} Nov 24 16:29:28.694356 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: WARNING keystone.server.flask.application [None req-a85b4007-4862-40a5-84e6-f0e9bd0652a0 admin admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Nov 24 16:29:28.695556 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: [pid: 71938|app: 0|req: 39/77] 10.222.0.53 () {56 vars in 1111 bytes} [Wed Nov 24 16:29:28 2021] GET /identity/v3/roles/member => generated 84 bytes in 42 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 24 16:29:28.701865 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27b8689d-5568-4e9c-8dce-1081f967d3ab None None] Authenticating user token {{(pid=71939) process_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 24 16:29:28.711159 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27b8689d-5568-4e9c-8dce-1081f967d3ab None None] Validating token access rules against request {{(pid=71939) validate_allowed_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 24 16:29:28.715304 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97bb071a-46c3-4fef-9956-7aaa5ab7612d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f2ba2e8375b4e8c8792ee1e22b60427', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '00a5583c7b7443e98e7a1d31a0b638dc', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=71939) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 24 16:29:28.715966 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97bb071a-46c3-4fef-9956-7aaa5ab7612d admin admin] REQUEST_METHOD: `GET` {{(pid=71939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 24 16:29:28.716302 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97bb071a-46c3-4fef-9956-7aaa5ab7612d admin admin] SCRIPT_NAME: `/identity` {{(pid=71939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 24 16:29:28.716632 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97bb071a-46c3-4fef-9956-7aaa5ab7612d admin admin] PATH_INFO: `/v3/roles` {{(pid=71939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 24 16:29:28.717669 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97bb071a-46c3-4fef-9956-7aaa5ab7612d admin admin] RBAC: Adding query filter params (name=member) {{(pid=71939) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:161}} Nov 24 16:29:28.717790 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97bb071a-46c3-4fef-9956-7aaa5ab7612d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=71939) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:442}} Nov 24 16:29:28.746930 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97bb071a-46c3-4fef-9956-7aaa5ab7612d admin admin] RBAC: Authorization granted {{(pid=71939) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 24 16:29:28.756663 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: [pid: 71939|app: 0|req: 39/78] 10.222.0.53 () {56 vars in 1113 bytes} [Wed Nov 24 16:29:28 2021] GET /identity/v3/roles?name=member => generated 341 bytes in 55 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 24 16:29:28.762481 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a85b4007-4862-40a5-84e6-f0e9bd0652a0 admin admin] Authenticating user token {{(pid=71938) process_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 24 16:29:28.772918 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a85b4007-4862-40a5-84e6-f0e9bd0652a0 admin admin] Validating token access rules against request {{(pid=71938) validate_allowed_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 24 16:29:28.777239 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cae2e796-2e29-4367-b41f-f08d342903a3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f2ba2e8375b4e8c8792ee1e22b60427', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '00a5583c7b7443e98e7a1d31a0b638dc', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=71938) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 24 16:29:28.778163 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cae2e796-2e29-4367-b41f-f08d342903a3 admin admin] REQUEST_METHOD: `GET` {{(pid=71938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 24 16:29:28.778505 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cae2e796-2e29-4367-b41f-f08d342903a3 admin admin] SCRIPT_NAME: `/identity` {{(pid=71938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 24 16:29:28.778839 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cae2e796-2e29-4367-b41f-f08d342903a3 admin admin] PATH_INFO: `/v3/users/a38b605a5d8b4fd286a841b891d7b4c4` {{(pid=71938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 24 16:29:28.798697 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cae2e796-2e29-4367-b41f-f08d342903a3 admin admin] RBAC: Authorizing `identity:get_user(user_id=a38b605a5d8b4fd286a841b891d7b4c4)` {{(pid=71938) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:442}} Nov 24 16:29:28.827796 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cae2e796-2e29-4367-b41f-f08d342903a3 admin admin] RBAC: Authorization granted {{(pid=71938) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 24 16:29:28.829663 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: [pid: 71938|app: 0|req: 40/79] 10.222.0.53 () {56 vars in 1189 bytes} [Wed Nov 24 16:29:28 2021] GET /identity/v3/users/a38b605a5d8b4fd286a841b891d7b4c4 => generated 275 bytes in 68 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 24 16:29:28.835628 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97bb071a-46c3-4fef-9956-7aaa5ab7612d admin admin] Authenticating user token {{(pid=71939) process_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 24 16:29:28.845467 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97bb071a-46c3-4fef-9956-7aaa5ab7612d admin admin] Validating token access rules against request {{(pid=71939) validate_allowed_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 24 16:29:28.850163 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79268598-326f-44a1-9eaa-1b516c571cfa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f2ba2e8375b4e8c8792ee1e22b60427', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '00a5583c7b7443e98e7a1d31a0b638dc', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=71939) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 24 16:29:28.850808 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79268598-326f-44a1-9eaa-1b516c571cfa admin admin] REQUEST_METHOD: `GET` {{(pid=71939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 24 16:29:28.851146 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79268598-326f-44a1-9eaa-1b516c571cfa admin admin] SCRIPT_NAME: `/identity` {{(pid=71939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 24 16:29:28.851479 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79268598-326f-44a1-9eaa-1b516c571cfa admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=71939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 24 16:29:28.859631 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79268598-326f-44a1-9eaa-1b516c571cfa admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=71939) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:442}} Nov 24 16:29:28.888649 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79268598-326f-44a1-9eaa-1b516c571cfa admin admin] RBAC: Authorization granted {{(pid=71939) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 24 16:29:28.898714 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: [pid: 71939|app: 0|req: 40/80] 10.222.0.53 () {58 vars in 1315 bytes} [Wed Nov 24 16:29:28 2021] GET /identity/v3/auth/tokens => generated 1067 bytes in 64 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 24 16:29:28.904842 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cae2e796-2e29-4367-b41f-f08d342903a3 admin admin] Authenticating user token {{(pid=71938) process_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 24 16:29:28.914794 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cae2e796-2e29-4367-b41f-f08d342903a3 admin admin] Validating token access rules against request {{(pid=71938) validate_allowed_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 24 16:29:28.919082 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-454ec34a-d958-49a6-bdcf-18968be4c1f9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f2ba2e8375b4e8c8792ee1e22b60427', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '00a5583c7b7443e98e7a1d31a0b638dc', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=71938) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 24 16:29:28.919961 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-454ec34a-d958-49a6-bdcf-18968be4c1f9 admin admin] REQUEST_METHOD: `GET` {{(pid=71938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 24 16:29:28.920300 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-454ec34a-d958-49a6-bdcf-18968be4c1f9 admin admin] SCRIPT_NAME: `/identity` {{(pid=71938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 24 16:29:28.920636 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-454ec34a-d958-49a6-bdcf-18968be4c1f9 admin admin] PATH_INFO: `/v3/projects/6a75e77ca1684c808c57b448b83e73d2` {{(pid=71938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 24 16:29:28.921894 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-454ec34a-d958-49a6-bdcf-18968be4c1f9 admin admin] RBAC: Authorizing `identity:get_project(project_id=6a75e77ca1684c808c57b448b83e73d2)` {{(pid=71938) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:442}} Nov 24 16:29:28.950967 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-454ec34a-d958-49a6-bdcf-18968be4c1f9 admin admin] RBAC: Authorization granted {{(pid=71938) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 24 16:29:28.952675 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: [pid: 71938|app: 0|req: 41/81] 10.222.0.53 () {56 vars in 1198 bytes} [Wed Nov 24 16:29:28 2021] GET /identity/v3/projects/6a75e77ca1684c808c57b448b83e73d2 => generated 298 bytes in 48 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 24 16:29:28.960039 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79268598-326f-44a1-9eaa-1b516c571cfa admin admin] Authenticating user token {{(pid=71939) process_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 24 16:29:28.969154 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79268598-326f-44a1-9eaa-1b516c571cfa admin admin] Validating token access rules against request {{(pid=71939) validate_allowed_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 24 16:29:28.973515 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27078af4-b8ae-4e85-86eb-7629ef9429b7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f2ba2e8375b4e8c8792ee1e22b60427', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '00a5583c7b7443e98e7a1d31a0b638dc', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=71939) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 24 16:29:28.974217 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27078af4-b8ae-4e85-86eb-7629ef9429b7 admin admin] REQUEST_METHOD: `GET` {{(pid=71939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 24 16:29:28.974552 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27078af4-b8ae-4e85-86eb-7629ef9429b7 admin admin] SCRIPT_NAME: `/identity` {{(pid=71939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 24 16:29:28.974881 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27078af4-b8ae-4e85-86eb-7629ef9429b7 admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=71939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 24 16:29:28.975783 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27078af4-b8ae-4e85-86eb-7629ef9429b7 admin admin] RBAC: Adding query filter params (role.id=912ab5f10fa5477da74acf239f07604e, scope.project.id=6a75e77ca1684c808c57b448b83e73d2, user.id=a38b605a5d8b4fd286a841b891d7b4c4) {{(pid=71939) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:161}} Nov 24 16:29:28.976143 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27078af4-b8ae-4e85-86eb-7629ef9429b7 admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=71939) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:442}} Nov 24 16:29:29.003701 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: WARNING py.warnings [None req-27078af4-b8ae-4e85-86eb-7629ef9429b7 admin admin] /usr/local/lib/python3.6/dist-packages/oslo_policy/policy.py:1018: UserWarning: Policy identity:list_role_assignments failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Nov 24 16:29:29.003701 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: warnings.warn(msg) Nov 24 16:29:29.003701 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: Nov 24 16:29:29.004995 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27078af4-b8ae-4e85-86eb-7629ef9429b7 admin admin] RBAC: Authorization granted {{(pid=71939) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 24 16:29:29.010749 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: [pid: 71939|app: 0|req: 41/82] 10.222.0.53 () {56 vars in 1386 bytes} [Wed Nov 24 16:29:28 2021] GET /identity/v3/role_assignments?user.id=a38b605a5d8b4fd286a841b891d7b4c4&scope.project.id=6a75e77ca1684c808c57b448b83e73d2&role.id=912ab5f10fa5477da74acf239f07604e => generated 259 bytes in 51 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 24 16:29:30.969746 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bb939cb-ad02-4af6-999b-e274d545f365 None None] REQUEST_METHOD: `GET` {{(pid=71938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 24 16:29:30.970343 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bb939cb-ad02-4af6-999b-e274d545f365 None None] SCRIPT_NAME: `/identity` {{(pid=71938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 24 16:29:30.970461 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bb939cb-ad02-4af6-999b-e274d545f365 None None] PATH_INFO: `/` {{(pid=71938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 24 16:29:30.972871 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: [pid: 71938|app: 0|req: 42/83] 10.222.0.53 () {54 vars in 915 bytes} [Wed Nov 24 16:29:30 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 24 16:29:30.978471 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5ba29ff-9bdd-470b-b59c-a4056f392965 None None] REQUEST_METHOD: `POST` {{(pid=71939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 24 16:29:30.978820 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5ba29ff-9bdd-470b-b59c-a4056f392965 None None] SCRIPT_NAME: `/identity` {{(pid=71939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 24 16:29:30.979161 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5ba29ff-9bdd-470b-b59c-a4056f392965 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=71939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 24 16:29:31.002572 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.auth.core [None req-b5ba29ff-9bdd-470b-b59c-a4056f392965 None None] MFA Rules not processed for user `0f2ba2e8375b4e8c8792ee1e22b60427`. Rule list: `[]` (Enabled: `True`). {{(pid=71939) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:442}} Nov 24 16:29:31.004306 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.fernet_utils [None req-b5ba29ff-9bdd-470b-b59c-a4056f392965 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=71939) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:289}} Nov 24 16:29:31.011361 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: [pid: 71939|app: 0|req: 42/84] 10.222.0.53 () {58 vars in 1013 bytes} [Wed Nov 24 16:29:30 2021] POST /identity/v3/auth/tokens => generated 1067 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 24 16:29:31.033966 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d77aa81-044c-407d-aa61-229e9f1f0994 None None] REQUEST_METHOD: `POST` {{(pid=71938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 24 16:29:31.034562 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d77aa81-044c-407d-aa61-229e9f1f0994 None None] SCRIPT_NAME: `/identity` {{(pid=71938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 24 16:29:31.034903 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d77aa81-044c-407d-aa61-229e9f1f0994 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=71938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 24 16:29:31.057980 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.auth.core [None req-9d77aa81-044c-407d-aa61-229e9f1f0994 None None] MFA Rules not processed for user `0f2ba2e8375b4e8c8792ee1e22b60427`. Rule list: `[]` (Enabled: `True`). {{(pid=71938) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:442}} Nov 24 16:29:31.059306 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.fernet_utils [None req-9d77aa81-044c-407d-aa61-229e9f1f0994 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=71938) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:289}} Nov 24 16:29:31.067051 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: [pid: 71938|app: 0|req: 43/85] 10.222.0.53 () {58 vars in 1013 bytes} [Wed Nov 24 16:29:31 2021] POST /identity/v3/auth/tokens => generated 1067 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 24 16:29:31.072543 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5ba29ff-9bdd-470b-b59c-a4056f392965 None None] Authenticating user token {{(pid=71939) process_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 24 16:29:31.082899 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5ba29ff-9bdd-470b-b59c-a4056f392965 None None] Validating token access rules against request {{(pid=71939) validate_allowed_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 24 16:29:31.087057 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d29e1aeb-aa90-4ff0-8bc2-0025448c7ca2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f2ba2e8375b4e8c8792ee1e22b60427', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '00a5583c7b7443e98e7a1d31a0b638dc', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=71939) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 24 16:29:31.087875 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d29e1aeb-aa90-4ff0-8bc2-0025448c7ca2 admin admin] REQUEST_METHOD: `GET` {{(pid=71939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 24 16:29:31.088214 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d29e1aeb-aa90-4ff0-8bc2-0025448c7ca2 admin admin] SCRIPT_NAME: `/identity` {{(pid=71939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 24 16:29:31.088546 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d29e1aeb-aa90-4ff0-8bc2-0025448c7ca2 admin admin] PATH_INFO: `/v3/roles/member` {{(pid=71939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 24 16:29:31.100384 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d29e1aeb-aa90-4ff0-8bc2-0025448c7ca2 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=71939) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:401}} Nov 24 16:29:31.107925 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: WARNING keystone.server.flask.application [None req-d29e1aeb-aa90-4ff0-8bc2-0025448c7ca2 admin admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Nov 24 16:29:31.109190 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: [pid: 71939|app: 0|req: 43/86] 10.222.0.53 () {56 vars in 1111 bytes} [Wed Nov 24 16:29:31 2021] GET /identity/v3/roles/member => generated 84 bytes in 37 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 24 16:29:31.115726 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d77aa81-044c-407d-aa61-229e9f1f0994 None None] Authenticating user token {{(pid=71938) process_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 24 16:29:31.124901 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d77aa81-044c-407d-aa61-229e9f1f0994 None None] Validating token access rules against request {{(pid=71938) validate_allowed_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 24 16:29:31.129647 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a0b6da4-640a-4120-86c1-fb336ccdd1c9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f2ba2e8375b4e8c8792ee1e22b60427', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '00a5583c7b7443e98e7a1d31a0b638dc', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=71938) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 24 16:29:31.130338 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a0b6da4-640a-4120-86c1-fb336ccdd1c9 admin admin] REQUEST_METHOD: `GET` {{(pid=71938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 24 16:29:31.130676 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a0b6da4-640a-4120-86c1-fb336ccdd1c9 admin admin] SCRIPT_NAME: `/identity` {{(pid=71938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 24 16:29:31.131005 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a0b6da4-640a-4120-86c1-fb336ccdd1c9 admin admin] PATH_INFO: `/v3/roles` {{(pid=71938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 24 16:29:31.131805 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a0b6da4-640a-4120-86c1-fb336ccdd1c9 admin admin] RBAC: Adding query filter params (name=member) {{(pid=71938) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:161}} Nov 24 16:29:31.132153 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a0b6da4-640a-4120-86c1-fb336ccdd1c9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=71938) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:442}} Nov 24 16:29:31.160186 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: WARNING py.warnings [None req-4a0b6da4-640a-4120-86c1-fb336ccdd1c9 admin admin] /usr/local/lib/python3.6/dist-packages/oslo_policy/policy.py:1018: UserWarning: Policy identity:list_roles failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 24 16:29:31.160186 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: warnings.warn(msg) Nov 24 16:29:31.160186 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: Nov 24 16:29:31.161200 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a0b6da4-640a-4120-86c1-fb336ccdd1c9 admin admin] RBAC: Authorization granted {{(pid=71938) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 24 16:29:31.171407 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: [pid: 71938|app: 0|req: 44/87] 10.222.0.53 () {56 vars in 1113 bytes} [Wed Nov 24 16:29:31 2021] GET /identity/v3/roles?name=member => generated 341 bytes in 56 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 24 16:29:31.177094 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d29e1aeb-aa90-4ff0-8bc2-0025448c7ca2 admin admin] Authenticating user token {{(pid=71939) process_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 24 16:29:31.189435 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d29e1aeb-aa90-4ff0-8bc2-0025448c7ca2 admin admin] Validating token access rules against request {{(pid=71939) validate_allowed_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 24 16:29:31.194144 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c136082a-fe70-4617-9783-b4214ebda10f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f2ba2e8375b4e8c8792ee1e22b60427', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '00a5583c7b7443e98e7a1d31a0b638dc', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=71939) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 24 16:29:31.195025 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c136082a-fe70-4617-9783-b4214ebda10f admin admin] REQUEST_METHOD: `GET` {{(pid=71939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 24 16:29:31.195360 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c136082a-fe70-4617-9783-b4214ebda10f admin admin] SCRIPT_NAME: `/identity` {{(pid=71939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 24 16:29:31.195689 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c136082a-fe70-4617-9783-b4214ebda10f admin admin] PATH_INFO: `/v3/users/a38b605a5d8b4fd286a841b891d7b4c4` {{(pid=71939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 24 16:29:31.197775 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c136082a-fe70-4617-9783-b4214ebda10f admin admin] RBAC: Authorizing `identity:get_user(user_id=a38b605a5d8b4fd286a841b891d7b4c4)` {{(pid=71939) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:442}} Nov 24 16:29:31.227012 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c136082a-fe70-4617-9783-b4214ebda10f admin admin] RBAC: Authorization granted {{(pid=71939) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 24 16:29:31.228582 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: [pid: 71939|app: 0|req: 44/88] 10.222.0.53 () {56 vars in 1189 bytes} [Wed Nov 24 16:29:31 2021] GET /identity/v3/users/a38b605a5d8b4fd286a841b891d7b4c4 => generated 275 bytes in 52 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 24 16:29:31.234507 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a0b6da4-640a-4120-86c1-fb336ccdd1c9 admin admin] Authenticating user token {{(pid=71938) process_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 24 16:29:31.244375 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a0b6da4-640a-4120-86c1-fb336ccdd1c9 admin admin] Validating token access rules against request {{(pid=71938) validate_allowed_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 24 16:29:31.248574 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91d0f903-36fd-4c53-8e3f-90866b98a242 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f2ba2e8375b4e8c8792ee1e22b60427', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '00a5583c7b7443e98e7a1d31a0b638dc', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=71938) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 24 16:29:31.249527 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91d0f903-36fd-4c53-8e3f-90866b98a242 admin admin] REQUEST_METHOD: `GET` {{(pid=71938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 24 16:29:31.249870 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91d0f903-36fd-4c53-8e3f-90866b98a242 admin admin] SCRIPT_NAME: `/identity` {{(pid=71938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 24 16:29:31.250235 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91d0f903-36fd-4c53-8e3f-90866b98a242 admin admin] PATH_INFO: `/v3/projects/6a75e77ca1684c808c57b448b83e73d2` {{(pid=71938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 24 16:29:31.251440 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91d0f903-36fd-4c53-8e3f-90866b98a242 admin admin] RBAC: Authorizing `identity:get_project(project_id=6a75e77ca1684c808c57b448b83e73d2)` {{(pid=71938) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:442}} Nov 24 16:29:31.280992 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91d0f903-36fd-4c53-8e3f-90866b98a242 admin admin] RBAC: Authorization granted {{(pid=71938) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 24 16:29:31.282662 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: [pid: 71938|app: 0|req: 45/89] 10.222.0.53 () {56 vars in 1198 bytes} [Wed Nov 24 16:29:31 2021] GET /identity/v3/projects/6a75e77ca1684c808c57b448b83e73d2 => generated 298 bytes in 49 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 24 16:29:31.288249 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c136082a-fe70-4617-9783-b4214ebda10f admin admin] Authenticating user token {{(pid=71939) process_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 24 16:29:31.298158 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c136082a-fe70-4617-9783-b4214ebda10f admin admin] Validating token access rules against request {{(pid=71939) validate_allowed_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 24 16:29:31.302297 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6554d4f7-c2b4-4ee3-aa99-492e68641189 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f2ba2e8375b4e8c8792ee1e22b60427', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '00a5583c7b7443e98e7a1d31a0b638dc', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=71939) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 24 16:29:31.303190 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6554d4f7-c2b4-4ee3-aa99-492e68641189 admin admin] REQUEST_METHOD: `PUT` {{(pid=71939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 24 16:29:31.303526 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6554d4f7-c2b4-4ee3-aa99-492e68641189 admin admin] SCRIPT_NAME: `/identity` {{(pid=71939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 24 16:29:31.303857 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6554d4f7-c2b4-4ee3-aa99-492e68641189 admin admin] PATH_INFO: `/v3/projects/6a75e77ca1684c808c57b448b83e73d2/users/a38b605a5d8b4fd286a841b891d7b4c4/roles/912ab5f10fa5477da74acf239f07604e` {{(pid=71939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 24 16:29:31.305794 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6554d4f7-c2b4-4ee3-aa99-492e68641189 admin admin] RBAC: Authorizing `identity:create_grant(project_id=6a75e77ca1684c808c57b448b83e73d2, user_id=a38b605a5d8b4fd286a841b891d7b4c4, role_id=912ab5f10fa5477da74acf239f07604e)` {{(pid=71939) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:442}} Nov 24 16:29:31.334567 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: WARNING py.warnings [None req-6554d4f7-c2b4-4ee3-aa99-492e68641189 admin admin] /usr/local/lib/python3.6/dist-packages/oslo_policy/policy.py:1018: UserWarning: Policy identity:create_grant failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Nov 24 16:29:31.334567 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: warnings.warn(msg) Nov 24 16:29:31.334567 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: Nov 24 16:29:31.336763 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6554d4f7-c2b4-4ee3-aa99-492e68641189 admin admin] RBAC: Authorization granted {{(pid=71939) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 24 16:29:31.348492 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: [pid: 71939|app: 0|req: 45/90] 10.222.0.53 () {58 vars in 1451 bytes} [Wed Nov 24 16:29:31 2021] PUT /identity/v3/projects/6a75e77ca1684c808c57b448b83e73d2/users/a38b605a5d8b4fd286a841b891d7b4c4/roles/912ab5f10fa5477da74acf239f07604e => generated 0 bytes in 61 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 24 16:29:33.326134 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-323b41d4-ee14-425f-ae2e-b5693d793e32 None None] REQUEST_METHOD: `GET` {{(pid=71938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 24 16:29:33.326682 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-323b41d4-ee14-425f-ae2e-b5693d793e32 None None] SCRIPT_NAME: `/identity` {{(pid=71938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 24 16:29:33.326799 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-323b41d4-ee14-425f-ae2e-b5693d793e32 None None] PATH_INFO: `/` {{(pid=71938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 24 16:29:33.329290 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: [pid: 71938|app: 0|req: 46/91] 10.222.0.53 () {54 vars in 915 bytes} [Wed Nov 24 16:29:33 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 24 16:29:33.335173 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2c7d59f-7057-461a-a29d-01bfe09e3b1b None None] REQUEST_METHOD: `POST` {{(pid=71939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 24 16:29:33.335522 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2c7d59f-7057-461a-a29d-01bfe09e3b1b None None] SCRIPT_NAME: `/identity` {{(pid=71939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 24 16:29:33.335859 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2c7d59f-7057-461a-a29d-01bfe09e3b1b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=71939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 24 16:29:33.359853 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.auth.core [None req-c2c7d59f-7057-461a-a29d-01bfe09e3b1b None None] MFA Rules not processed for user `0f2ba2e8375b4e8c8792ee1e22b60427`. Rule list: `[]` (Enabled: `True`). {{(pid=71939) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:442}} Nov 24 16:29:33.361103 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.fernet_utils [None req-c2c7d59f-7057-461a-a29d-01bfe09e3b1b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=71939) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:289}} Nov 24 16:29:33.452039 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: [pid: 71939|app: 0|req: 46/92] 10.222.0.53 () {58 vars in 1013 bytes} [Wed Nov 24 16:29:33 2021] POST /identity/v3/auth/tokens => generated 1067 bytes in 118 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 24 16:29:33.475731 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1ee06fa-1465-4da6-b0ea-7c24f4de013e None None] REQUEST_METHOD: `POST` {{(pid=71938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 24 16:29:33.475987 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1ee06fa-1465-4da6-b0ea-7c24f4de013e None None] SCRIPT_NAME: `/identity` {{(pid=71938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 24 16:29:33.476324 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1ee06fa-1465-4da6-b0ea-7c24f4de013e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=71938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 24 16:29:33.501184 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.auth.core [None req-b1ee06fa-1465-4da6-b0ea-7c24f4de013e None None] MFA Rules not processed for user `0f2ba2e8375b4e8c8792ee1e22b60427`. Rule list: `[]` (Enabled: `True`). {{(pid=71938) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:442}} Nov 24 16:29:33.502487 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.fernet_utils [None req-b1ee06fa-1465-4da6-b0ea-7c24f4de013e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=71938) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:289}} Nov 24 16:29:33.509857 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: [pid: 71938|app: 0|req: 47/93] 10.222.0.53 () {58 vars in 1013 bytes} [Wed Nov 24 16:29:33 2021] POST /identity/v3/auth/tokens => generated 1067 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 24 16:29:33.515793 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2c7d59f-7057-461a-a29d-01bfe09e3b1b None None] Authenticating user token {{(pid=71939) process_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 24 16:29:33.525823 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2c7d59f-7057-461a-a29d-01bfe09e3b1b None None] Validating token access rules against request {{(pid=71939) validate_allowed_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 24 16:29:33.531215 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae18a364-f099-4d8b-a978-542f546e3aab admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f2ba2e8375b4e8c8792ee1e22b60427', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '00a5583c7b7443e98e7a1d31a0b638dc', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=71939) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 24 16:29:33.532156 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae18a364-f099-4d8b-a978-542f546e3aab admin admin] REQUEST_METHOD: `GET` {{(pid=71939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 24 16:29:33.532592 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae18a364-f099-4d8b-a978-542f546e3aab admin admin] SCRIPT_NAME: `/identity` {{(pid=71939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 24 16:29:33.533075 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae18a364-f099-4d8b-a978-542f546e3aab admin admin] PATH_INFO: `/v3/roles/member` {{(pid=71939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 24 16:29:33.546397 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae18a364-f099-4d8b-a978-542f546e3aab admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=71939) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:401}} Nov 24 16:29:33.554516 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: WARNING keystone.server.flask.application [None req-ae18a364-f099-4d8b-a978-542f546e3aab admin admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Nov 24 16:29:33.555770 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: [pid: 71939|app: 0|req: 47/94] 10.222.0.53 () {56 vars in 1111 bytes} [Wed Nov 24 16:29:33 2021] GET /identity/v3/roles/member => generated 84 bytes in 41 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 24 16:29:33.563070 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1ee06fa-1465-4da6-b0ea-7c24f4de013e None None] Authenticating user token {{(pid=71938) process_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 24 16:29:33.572733 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1ee06fa-1465-4da6-b0ea-7c24f4de013e None None] Validating token access rules against request {{(pid=71938) validate_allowed_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 24 16:29:33.577076 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfe0e973-3a75-4292-81ae-2ec5fd8d24a5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f2ba2e8375b4e8c8792ee1e22b60427', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '00a5583c7b7443e98e7a1d31a0b638dc', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=71938) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 24 16:29:33.577751 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfe0e973-3a75-4292-81ae-2ec5fd8d24a5 admin admin] REQUEST_METHOD: `GET` {{(pid=71938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 24 16:29:33.578118 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfe0e973-3a75-4292-81ae-2ec5fd8d24a5 admin admin] SCRIPT_NAME: `/identity` {{(pid=71938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 24 16:29:33.578573 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfe0e973-3a75-4292-81ae-2ec5fd8d24a5 admin admin] PATH_INFO: `/v3/roles` {{(pid=71938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 24 16:29:33.579486 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfe0e973-3a75-4292-81ae-2ec5fd8d24a5 admin admin] RBAC: Adding query filter params (name=member) {{(pid=71938) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:161}} Nov 24 16:29:33.579833 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfe0e973-3a75-4292-81ae-2ec5fd8d24a5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=71938) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:442}} Nov 24 16:29:33.608786 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfe0e973-3a75-4292-81ae-2ec5fd8d24a5 admin admin] RBAC: Authorization granted {{(pid=71938) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 24 16:29:33.619132 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: [pid: 71938|app: 0|req: 48/95] 10.222.0.53 () {56 vars in 1113 bytes} [Wed Nov 24 16:29:33 2021] GET /identity/v3/roles?name=member => generated 341 bytes in 57 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 24 16:29:33.625157 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae18a364-f099-4d8b-a978-542f546e3aab admin admin] Authenticating user token {{(pid=71939) process_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 24 16:29:33.635847 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae18a364-f099-4d8b-a978-542f546e3aab admin admin] Validating token access rules against request {{(pid=71939) validate_allowed_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 24 16:29:33.640074 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e90c33f-4797-4de7-a7e7-66de2552bc67 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f2ba2e8375b4e8c8792ee1e22b60427', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '00a5583c7b7443e98e7a1d31a0b638dc', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=71939) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 24 16:29:33.640966 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e90c33f-4797-4de7-a7e7-66de2552bc67 admin admin] REQUEST_METHOD: `GET` {{(pid=71939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 24 16:29:33.641296 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e90c33f-4797-4de7-a7e7-66de2552bc67 admin admin] SCRIPT_NAME: `/identity` {{(pid=71939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 24 16:29:33.641626 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e90c33f-4797-4de7-a7e7-66de2552bc67 admin admin] PATH_INFO: `/v3/users/a38b605a5d8b4fd286a841b891d7b4c4` {{(pid=71939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 24 16:29:33.642907 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e90c33f-4797-4de7-a7e7-66de2552bc67 admin admin] RBAC: Authorizing `identity:get_user(user_id=a38b605a5d8b4fd286a841b891d7b4c4)` {{(pid=71939) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:442}} Nov 24 16:29:33.672359 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e90c33f-4797-4de7-a7e7-66de2552bc67 admin admin] RBAC: Authorization granted {{(pid=71939) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 24 16:29:33.674112 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: [pid: 71939|app: 0|req: 48/96] 10.222.0.53 () {56 vars in 1189 bytes} [Wed Nov 24 16:29:33 2021] GET /identity/v3/users/a38b605a5d8b4fd286a841b891d7b4c4 => generated 275 bytes in 49 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 24 16:29:33.680096 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfe0e973-3a75-4292-81ae-2ec5fd8d24a5 admin admin] Authenticating user token {{(pid=71938) process_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 24 16:29:33.690265 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfe0e973-3a75-4292-81ae-2ec5fd8d24a5 admin admin] Validating token access rules against request {{(pid=71938) validate_allowed_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 24 16:29:33.694487 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00829fe0-7c7d-41cd-ac5a-7c7c530637d8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f2ba2e8375b4e8c8792ee1e22b60427', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '00a5583c7b7443e98e7a1d31a0b638dc', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=71938) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 24 16:29:33.695141 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00829fe0-7c7d-41cd-ac5a-7c7c530637d8 admin admin] REQUEST_METHOD: `GET` {{(pid=71938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 24 16:29:33.695485 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00829fe0-7c7d-41cd-ac5a-7c7c530637d8 admin admin] SCRIPT_NAME: `/identity` {{(pid=71938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 24 16:29:33.695825 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00829fe0-7c7d-41cd-ac5a-7c7c530637d8 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=71938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 24 16:29:33.703940 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00829fe0-7c7d-41cd-ac5a-7c7c530637d8 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=71938) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:442}} Nov 24 16:29:33.733720 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00829fe0-7c7d-41cd-ac5a-7c7c530637d8 admin admin] RBAC: Authorization granted {{(pid=71938) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 24 16:29:33.742710 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: [pid: 71938|app: 0|req: 49/97] 10.222.0.53 () {58 vars in 1315 bytes} [Wed Nov 24 16:29:33 2021] GET /identity/v3/auth/tokens => generated 1067 bytes in 63 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 24 16:29:33.748457 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e90c33f-4797-4de7-a7e7-66de2552bc67 admin admin] Authenticating user token {{(pid=71939) process_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 24 16:29:33.758283 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e90c33f-4797-4de7-a7e7-66de2552bc67 admin admin] Validating token access rules against request {{(pid=71939) validate_allowed_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 24 16:29:33.762425 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-554b2a6e-64c8-4be2-a585-dbf36d4268b4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f2ba2e8375b4e8c8792ee1e22b60427', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '00a5583c7b7443e98e7a1d31a0b638dc', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=71939) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 24 16:29:33.763290 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-554b2a6e-64c8-4be2-a585-dbf36d4268b4 admin admin] REQUEST_METHOD: `GET` {{(pid=71939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 24 16:29:33.763628 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-554b2a6e-64c8-4be2-a585-dbf36d4268b4 admin admin] SCRIPT_NAME: `/identity` {{(pid=71939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 24 16:29:33.763966 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-554b2a6e-64c8-4be2-a585-dbf36d4268b4 admin admin] PATH_INFO: `/v3/projects/6a75e77ca1684c808c57b448b83e73d2` {{(pid=71939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 24 16:29:33.765170 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-554b2a6e-64c8-4be2-a585-dbf36d4268b4 admin admin] RBAC: Authorizing `identity:get_project(project_id=6a75e77ca1684c808c57b448b83e73d2)` {{(pid=71939) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:442}} Nov 24 16:29:33.794715 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-554b2a6e-64c8-4be2-a585-dbf36d4268b4 admin admin] RBAC: Authorization granted {{(pid=71939) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 24 16:29:33.796451 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: [pid: 71939|app: 0|req: 49/98] 10.222.0.53 () {56 vars in 1198 bytes} [Wed Nov 24 16:29:33 2021] GET /identity/v3/projects/6a75e77ca1684c808c57b448b83e73d2 => generated 298 bytes in 48 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 24 16:29:33.802576 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00829fe0-7c7d-41cd-ac5a-7c7c530637d8 admin admin] Authenticating user token {{(pid=71938) process_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 24 16:29:33.811754 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00829fe0-7c7d-41cd-ac5a-7c7c530637d8 admin admin] Validating token access rules against request {{(pid=71938) validate_allowed_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 24 16:29:33.815989 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be53ef0d-32e5-4583-845a-12978781fad4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f2ba2e8375b4e8c8792ee1e22b60427', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '00a5583c7b7443e98e7a1d31a0b638dc', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=71938) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 24 16:29:33.816641 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be53ef0d-32e5-4583-845a-12978781fad4 admin admin] REQUEST_METHOD: `GET` {{(pid=71938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 24 16:29:33.816981 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be53ef0d-32e5-4583-845a-12978781fad4 admin admin] SCRIPT_NAME: `/identity` {{(pid=71938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 24 16:29:33.817313 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be53ef0d-32e5-4583-845a-12978781fad4 admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=71938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 24 16:29:33.818234 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be53ef0d-32e5-4583-845a-12978781fad4 admin admin] RBAC: Adding query filter params (role.id=912ab5f10fa5477da74acf239f07604e, scope.project.id=6a75e77ca1684c808c57b448b83e73d2, user.id=a38b605a5d8b4fd286a841b891d7b4c4) {{(pid=71938) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:161}} Nov 24 16:29:33.818600 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be53ef0d-32e5-4583-845a-12978781fad4 admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=71938) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:442}} Nov 24 16:29:33.848093 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be53ef0d-32e5-4583-845a-12978781fad4 admin admin] RBAC: Authorization granted {{(pid=71938) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 24 16:29:33.854218 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: [pid: 71938|app: 0|req: 50/99] 10.222.0.53 () {56 vars in 1386 bytes} [Wed Nov 24 16:29:33 2021] GET /identity/v3/role_assignments?user.id=a38b605a5d8b4fd286a841b891d7b4c4&scope.project.id=6a75e77ca1684c808c57b448b83e73d2&role.id=912ab5f10fa5477da74acf239f07604e => generated 608 bytes in 52 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 24 16:29:35.886767 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-716331fa-4584-4375-9dbc-334b5cf74585 None None] REQUEST_METHOD: `GET` {{(pid=71939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 24 16:29:35.887282 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-716331fa-4584-4375-9dbc-334b5cf74585 None None] SCRIPT_NAME: `/identity` {{(pid=71939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 24 16:29:35.887408 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-716331fa-4584-4375-9dbc-334b5cf74585 None None] PATH_INFO: `/` {{(pid=71939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 24 16:29:35.889225 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: [pid: 71939|app: 0|req: 50/100] 10.222.0.53 () {54 vars in 915 bytes} [Wed Nov 24 16:29:35 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 24 16:29:35.894894 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66788cdf-9b57-4222-a8d4-223a0559a39c None None] REQUEST_METHOD: `POST` {{(pid=71938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 24 16:29:35.895249 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66788cdf-9b57-4222-a8d4-223a0559a39c None None] SCRIPT_NAME: `/identity` {{(pid=71938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 24 16:29:35.895590 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66788cdf-9b57-4222-a8d4-223a0559a39c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=71938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 24 16:29:35.918920 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.auth.core [None req-66788cdf-9b57-4222-a8d4-223a0559a39c None None] MFA Rules not processed for user `0f2ba2e8375b4e8c8792ee1e22b60427`. Rule list: `[]` (Enabled: `True`). {{(pid=71938) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:442}} Nov 24 16:29:35.920130 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.fernet_utils [None req-66788cdf-9b57-4222-a8d4-223a0559a39c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=71938) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:289}} Nov 24 16:29:35.927688 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: [pid: 71938|app: 0|req: 51/101] 10.222.0.53 () {58 vars in 1013 bytes} [Wed Nov 24 16:29:35 2021] POST /identity/v3/auth/tokens => generated 1067 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 24 16:29:35.951146 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b58f91d-ae61-42d5-8fad-b10e29fd2f4c None None] REQUEST_METHOD: `POST` {{(pid=71939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 24 16:29:35.951487 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b58f91d-ae61-42d5-8fad-b10e29fd2f4c None None] SCRIPT_NAME: `/identity` {{(pid=71939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 24 16:29:35.951838 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b58f91d-ae61-42d5-8fad-b10e29fd2f4c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=71939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 24 16:29:35.975114 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.auth.core [None req-9b58f91d-ae61-42d5-8fad-b10e29fd2f4c None None] MFA Rules not processed for user `0f2ba2e8375b4e8c8792ee1e22b60427`. Rule list: `[]` (Enabled: `True`). {{(pid=71939) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:442}} Nov 24 16:29:35.976323 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.fernet_utils [None req-9b58f91d-ae61-42d5-8fad-b10e29fd2f4c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=71939) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:289}} Nov 24 16:29:35.983363 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: [pid: 71939|app: 0|req: 51/102] 10.222.0.53 () {58 vars in 1013 bytes} [Wed Nov 24 16:29:35 2021] POST /identity/v3/auth/tokens => generated 1067 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 24 16:29:35.989337 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66788cdf-9b57-4222-a8d4-223a0559a39c None None] Authenticating user token {{(pid=71938) process_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 24 16:29:35.998909 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66788cdf-9b57-4222-a8d4-223a0559a39c None None] Validating token access rules against request {{(pid=71938) validate_allowed_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 24 16:29:36.003711 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6870f57-9187-4e6e-b966-9097b0e1ce46 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f2ba2e8375b4e8c8792ee1e22b60427', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '00a5583c7b7443e98e7a1d31a0b638dc', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=71938) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 24 16:29:36.004516 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6870f57-9187-4e6e-b966-9097b0e1ce46 admin admin] REQUEST_METHOD: `GET` {{(pid=71938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 24 16:29:36.004852 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6870f57-9187-4e6e-b966-9097b0e1ce46 admin admin] SCRIPT_NAME: `/identity` {{(pid=71938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 24 16:29:36.005183 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6870f57-9187-4e6e-b966-9097b0e1ce46 admin admin] PATH_INFO: `/v3/roles/admin` {{(pid=71938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 24 16:29:36.016836 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6870f57-9187-4e6e-b966-9097b0e1ce46 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=71938) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:401}} Nov 24 16:29:36.024159 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: WARNING keystone.server.flask.application [None req-a6870f57-9187-4e6e-b966-9097b0e1ce46 admin admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Nov 24 16:29:36.025324 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: [pid: 71938|app: 0|req: 52/103] 10.222.0.53 () {56 vars in 1108 bytes} [Wed Nov 24 16:29:35 2021] GET /identity/v3/roles/admin => generated 83 bytes in 36 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 24 16:29:36.031616 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b58f91d-ae61-42d5-8fad-b10e29fd2f4c None None] Authenticating user token {{(pid=71939) process_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 24 16:29:36.040587 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b58f91d-ae61-42d5-8fad-b10e29fd2f4c None None] Validating token access rules against request {{(pid=71939) validate_allowed_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 24 16:29:36.044742 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5206a351-f392-412a-beca-d691c8a33394 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f2ba2e8375b4e8c8792ee1e22b60427', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '00a5583c7b7443e98e7a1d31a0b638dc', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=71939) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 24 16:29:36.045507 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5206a351-f392-412a-beca-d691c8a33394 admin admin] REQUEST_METHOD: `GET` {{(pid=71939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 24 16:29:36.045824 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5206a351-f392-412a-beca-d691c8a33394 admin admin] SCRIPT_NAME: `/identity` {{(pid=71939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 24 16:29:36.046192 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5206a351-f392-412a-beca-d691c8a33394 admin admin] PATH_INFO: `/v3/roles` {{(pid=71939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 24 16:29:36.046998 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5206a351-f392-412a-beca-d691c8a33394 admin admin] RBAC: Adding query filter params (name=admin) {{(pid=71939) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:161}} Nov 24 16:29:36.047353 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5206a351-f392-412a-beca-d691c8a33394 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=71939) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:442}} Nov 24 16:29:36.076184 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5206a351-f392-412a-beca-d691c8a33394 admin admin] RBAC: Authorization granted {{(pid=71939) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 24 16:29:36.085447 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: [pid: 71939|app: 0|req: 52/104] 10.222.0.53 () {56 vars in 1111 bytes} [Wed Nov 24 16:29:36 2021] GET /identity/v3/roles?name=admin => generated 339 bytes in 54 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 24 16:29:36.091382 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6870f57-9187-4e6e-b966-9097b0e1ce46 admin admin] Authenticating user token {{(pid=71938) process_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 24 16:29:36.108998 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6870f57-9187-4e6e-b966-9097b0e1ce46 admin admin] Validating token access rules against request {{(pid=71938) validate_allowed_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 24 16:29:36.113914 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ce254a2-ac8a-4034-86c9-914d38b21a26 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f2ba2e8375b4e8c8792ee1e22b60427', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '00a5583c7b7443e98e7a1d31a0b638dc', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=71938) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 24 16:29:36.114947 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ce254a2-ac8a-4034-86c9-914d38b21a26 admin admin] REQUEST_METHOD: `GET` {{(pid=71938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 24 16:29:36.115343 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ce254a2-ac8a-4034-86c9-914d38b21a26 admin admin] SCRIPT_NAME: `/identity` {{(pid=71938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 24 16:29:36.115735 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ce254a2-ac8a-4034-86c9-914d38b21a26 admin admin] PATH_INFO: `/v3/users/0f2ba2e8375b4e8c8792ee1e22b60427` {{(pid=71938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 24 16:29:36.117085 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ce254a2-ac8a-4034-86c9-914d38b21a26 admin admin] RBAC: Authorizing `identity:get_user(user_id=0f2ba2e8375b4e8c8792ee1e22b60427)` {{(pid=71938) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:442}} Nov 24 16:29:36.145926 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ce254a2-ac8a-4034-86c9-914d38b21a26 admin admin] RBAC: Authorization granted {{(pid=71938) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 24 16:29:36.147547 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: [pid: 71938|app: 0|req: 53/105] 10.222.0.53 () {56 vars in 1189 bytes} [Wed Nov 24 16:29:36 2021] GET /identity/v3/users/0f2ba2e8375b4e8c8792ee1e22b60427 => generated 247 bytes in 57 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 24 16:29:36.153356 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5206a351-f392-412a-beca-d691c8a33394 admin admin] Authenticating user token {{(pid=71939) process_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 24 16:29:36.163235 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5206a351-f392-412a-beca-d691c8a33394 admin admin] Validating token access rules against request {{(pid=71939) validate_allowed_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 24 16:29:36.167401 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca559733-8a33-457e-9ddf-55ef9728789e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f2ba2e8375b4e8c8792ee1e22b60427', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '00a5583c7b7443e98e7a1d31a0b638dc', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=71939) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 24 16:29:36.168063 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca559733-8a33-457e-9ddf-55ef9728789e admin admin] REQUEST_METHOD: `GET` {{(pid=71939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 24 16:29:36.168400 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca559733-8a33-457e-9ddf-55ef9728789e admin admin] SCRIPT_NAME: `/identity` {{(pid=71939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 24 16:29:36.168733 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca559733-8a33-457e-9ddf-55ef9728789e admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=71939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 24 16:29:36.177478 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca559733-8a33-457e-9ddf-55ef9728789e admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=71939) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:442}} Nov 24 16:29:36.206366 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca559733-8a33-457e-9ddf-55ef9728789e admin admin] RBAC: Authorization granted {{(pid=71939) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 24 16:29:36.215589 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: [pid: 71939|app: 0|req: 53/106] 10.222.0.53 () {58 vars in 1315 bytes} [Wed Nov 24 16:29:36 2021] GET /identity/v3/auth/tokens => generated 1067 bytes in 63 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 24 16:29:36.221589 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ce254a2-ac8a-4034-86c9-914d38b21a26 admin admin] Authenticating user token {{(pid=71938) process_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 24 16:29:36.231376 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ce254a2-ac8a-4034-86c9-914d38b21a26 admin admin] Validating token access rules against request {{(pid=71938) validate_allowed_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 24 16:29:36.235589 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a79392cf-e570-409f-9aa3-6e95b3b200e7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f2ba2e8375b4e8c8792ee1e22b60427', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '00a5583c7b7443e98e7a1d31a0b638dc', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=71938) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 24 16:29:36.236446 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a79392cf-e570-409f-9aa3-6e95b3b200e7 admin admin] REQUEST_METHOD: `GET` {{(pid=71938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 24 16:29:36.236824 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a79392cf-e570-409f-9aa3-6e95b3b200e7 admin admin] SCRIPT_NAME: `/identity` {{(pid=71938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 24 16:29:36.237676 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a79392cf-e570-409f-9aa3-6e95b3b200e7 admin admin] PATH_INFO: `/v3/projects/6a75e77ca1684c808c57b448b83e73d2` {{(pid=71938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 24 16:29:36.238899 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a79392cf-e570-409f-9aa3-6e95b3b200e7 admin admin] RBAC: Authorizing `identity:get_project(project_id=6a75e77ca1684c808c57b448b83e73d2)` {{(pid=71938) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:442}} Nov 24 16:29:36.267829 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a79392cf-e570-409f-9aa3-6e95b3b200e7 admin admin] RBAC: Authorization granted {{(pid=71938) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 24 16:29:36.269510 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: [pid: 71938|app: 0|req: 54/107] 10.222.0.53 () {56 vars in 1198 bytes} [Wed Nov 24 16:29:36 2021] GET /identity/v3/projects/6a75e77ca1684c808c57b448b83e73d2 => generated 298 bytes in 48 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 24 16:29:36.275366 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca559733-8a33-457e-9ddf-55ef9728789e admin admin] Authenticating user token {{(pid=71939) process_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 24 16:29:36.284918 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca559733-8a33-457e-9ddf-55ef9728789e admin admin] Validating token access rules against request {{(pid=71939) validate_allowed_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 24 16:29:36.289128 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d737493d-5807-4c3a-a082-90ddc60c6941 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f2ba2e8375b4e8c8792ee1e22b60427', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '00a5583c7b7443e98e7a1d31a0b638dc', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=71939) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 24 16:29:36.289778 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d737493d-5807-4c3a-a082-90ddc60c6941 admin admin] REQUEST_METHOD: `GET` {{(pid=71939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 24 16:29:36.290151 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d737493d-5807-4c3a-a082-90ddc60c6941 admin admin] SCRIPT_NAME: `/identity` {{(pid=71939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 24 16:29:36.290488 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d737493d-5807-4c3a-a082-90ddc60c6941 admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=71939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 24 16:29:36.291377 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d737493d-5807-4c3a-a082-90ddc60c6941 admin admin] RBAC: Adding query filter params (role.id=5611724e350b41e19921b5961a342582, scope.project.id=6a75e77ca1684c808c57b448b83e73d2, user.id=0f2ba2e8375b4e8c8792ee1e22b60427) {{(pid=71939) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:161}} Nov 24 16:29:36.291740 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d737493d-5807-4c3a-a082-90ddc60c6941 admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=71939) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:442}} Nov 24 16:29:36.320784 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d737493d-5807-4c3a-a082-90ddc60c6941 admin admin] RBAC: Authorization granted {{(pid=71939) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 24 16:29:36.326374 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: [pid: 71939|app: 0|req: 54/108] 10.222.0.53 () {56 vars in 1386 bytes} [Wed Nov 24 16:29:36 2021] GET /identity/v3/role_assignments?user.id=0f2ba2e8375b4e8c8792ee1e22b60427&scope.project.id=6a75e77ca1684c808c57b448b83e73d2&role.id=5611724e350b41e19921b5961a342582 => generated 259 bytes in 51 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 24 16:29:38.312703 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42d56794-728a-461e-9f45-d6ab209782e6 None None] REQUEST_METHOD: `GET` {{(pid=71938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 24 16:29:38.313229 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42d56794-728a-461e-9f45-d6ab209782e6 None None] SCRIPT_NAME: `/identity` {{(pid=71938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 24 16:29:38.313330 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42d56794-728a-461e-9f45-d6ab209782e6 None None] PATH_INFO: `/` {{(pid=71938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 24 16:29:38.315831 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: [pid: 71938|app: 0|req: 55/109] 10.222.0.53 () {54 vars in 915 bytes} [Wed Nov 24 16:29:38 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 24 16:29:38.322290 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc78bb43-bdbf-455a-bc95-1e8a8ddc701d None None] REQUEST_METHOD: `POST` {{(pid=71939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 24 16:29:38.322642 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc78bb43-bdbf-455a-bc95-1e8a8ddc701d None None] SCRIPT_NAME: `/identity` {{(pid=71939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 24 16:29:38.322980 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc78bb43-bdbf-455a-bc95-1e8a8ddc701d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=71939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 24 16:29:38.347136 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.auth.core [None req-bc78bb43-bdbf-455a-bc95-1e8a8ddc701d None None] MFA Rules not processed for user `0f2ba2e8375b4e8c8792ee1e22b60427`. Rule list: `[]` (Enabled: `True`). {{(pid=71939) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:442}} Nov 24 16:29:38.348358 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.fernet_utils [None req-bc78bb43-bdbf-455a-bc95-1e8a8ddc701d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=71939) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:289}} Nov 24 16:29:38.355386 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: [pid: 71939|app: 0|req: 55/110] 10.222.0.53 () {58 vars in 1013 bytes} [Wed Nov 24 16:29:38 2021] POST /identity/v3/auth/tokens => generated 1067 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 24 16:29:38.377146 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b1fdc4e-d51a-4804-b378-9821d66a144b None None] REQUEST_METHOD: `POST` {{(pid=71938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 24 16:29:38.377500 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b1fdc4e-d51a-4804-b378-9821d66a144b None None] SCRIPT_NAME: `/identity` {{(pid=71938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 24 16:29:38.378462 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b1fdc4e-d51a-4804-b378-9821d66a144b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=71938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 24 16:29:38.402787 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.auth.core [None req-1b1fdc4e-d51a-4804-b378-9821d66a144b None None] MFA Rules not processed for user `0f2ba2e8375b4e8c8792ee1e22b60427`. Rule list: `[]` (Enabled: `True`). {{(pid=71938) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:442}} Nov 24 16:29:38.403993 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.fernet_utils [None req-1b1fdc4e-d51a-4804-b378-9821d66a144b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=71938) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:289}} Nov 24 16:29:38.411165 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: [pid: 71938|app: 0|req: 56/111] 10.222.0.53 () {58 vars in 1013 bytes} [Wed Nov 24 16:29:38 2021] POST /identity/v3/auth/tokens => generated 1067 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 24 16:29:38.417481 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc78bb43-bdbf-455a-bc95-1e8a8ddc701d None None] Authenticating user token {{(pid=71939) process_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 24 16:29:38.427538 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc78bb43-bdbf-455a-bc95-1e8a8ddc701d None None] Validating token access rules against request {{(pid=71939) validate_allowed_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 24 16:29:38.431705 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac6b28c2-aa09-4ce5-861b-63e7a536a8ef admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f2ba2e8375b4e8c8792ee1e22b60427', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '00a5583c7b7443e98e7a1d31a0b638dc', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=71939) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 24 16:29:38.432514 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac6b28c2-aa09-4ce5-861b-63e7a536a8ef admin admin] REQUEST_METHOD: `GET` {{(pid=71939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 24 16:29:38.432853 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac6b28c2-aa09-4ce5-861b-63e7a536a8ef admin admin] SCRIPT_NAME: `/identity` {{(pid=71939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 24 16:29:38.433184 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac6b28c2-aa09-4ce5-861b-63e7a536a8ef admin admin] PATH_INFO: `/v3/roles/admin` {{(pid=71939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 24 16:29:38.445511 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac6b28c2-aa09-4ce5-861b-63e7a536a8ef admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=71939) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:401}} Nov 24 16:29:38.453032 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: WARNING keystone.server.flask.application [None req-ac6b28c2-aa09-4ce5-861b-63e7a536a8ef admin admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Nov 24 16:29:38.454659 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: [pid: 71939|app: 0|req: 56/112] 10.222.0.53 () {56 vars in 1108 bytes} [Wed Nov 24 16:29:38 2021] GET /identity/v3/roles/admin => generated 83 bytes in 38 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 24 16:29:38.461473 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b1fdc4e-d51a-4804-b378-9821d66a144b None None] Authenticating user token {{(pid=71938) process_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 24 16:29:38.471748 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b1fdc4e-d51a-4804-b378-9821d66a144b None None] Validating token access rules against request {{(pid=71938) validate_allowed_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 24 16:29:38.476309 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9ca053d-44ac-4768-adf7-5abdf9ea8a62 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f2ba2e8375b4e8c8792ee1e22b60427', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '00a5583c7b7443e98e7a1d31a0b638dc', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=71938) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 24 16:29:38.477398 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9ca053d-44ac-4768-adf7-5abdf9ea8a62 admin admin] REQUEST_METHOD: `GET` {{(pid=71938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 24 16:29:38.477954 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9ca053d-44ac-4768-adf7-5abdf9ea8a62 admin admin] SCRIPT_NAME: `/identity` {{(pid=71938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 24 16:29:38.478526 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9ca053d-44ac-4768-adf7-5abdf9ea8a62 admin admin] PATH_INFO: `/v3/roles` {{(pid=71938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 24 16:29:38.479815 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9ca053d-44ac-4768-adf7-5abdf9ea8a62 admin admin] RBAC: Adding query filter params (name=admin) {{(pid=71938) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:161}} Nov 24 16:29:38.480363 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9ca053d-44ac-4768-adf7-5abdf9ea8a62 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=71938) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:442}} Nov 24 16:29:38.527954 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9ca053d-44ac-4768-adf7-5abdf9ea8a62 admin admin] RBAC: Authorization granted {{(pid=71938) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 24 16:29:38.538314 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: [pid: 71938|app: 0|req: 57/113] 10.222.0.53 () {56 vars in 1111 bytes} [Wed Nov 24 16:29:38 2021] GET /identity/v3/roles?name=admin => generated 339 bytes in 77 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Nov 24 16:29:38.544271 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac6b28c2-aa09-4ce5-861b-63e7a536a8ef admin admin] Authenticating user token {{(pid=71939) process_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 24 16:29:38.555235 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac6b28c2-aa09-4ce5-861b-63e7a536a8ef admin admin] Validating token access rules against request {{(pid=71939) validate_allowed_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 24 16:29:38.559403 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf516349-cb9a-45e8-9424-c1bcc44cee33 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f2ba2e8375b4e8c8792ee1e22b60427', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '00a5583c7b7443e98e7a1d31a0b638dc', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=71939) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 24 16:29:38.560281 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf516349-cb9a-45e8-9424-c1bcc44cee33 admin admin] REQUEST_METHOD: `GET` {{(pid=71939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 24 16:29:38.560622 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf516349-cb9a-45e8-9424-c1bcc44cee33 admin admin] SCRIPT_NAME: `/identity` {{(pid=71939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 24 16:29:38.560953 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf516349-cb9a-45e8-9424-c1bcc44cee33 admin admin] PATH_INFO: `/v3/users/0f2ba2e8375b4e8c8792ee1e22b60427` {{(pid=71939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 24 16:29:38.562175 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf516349-cb9a-45e8-9424-c1bcc44cee33 admin admin] RBAC: Authorizing `identity:get_user(user_id=0f2ba2e8375b4e8c8792ee1e22b60427)` {{(pid=71939) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:442}} Nov 24 16:29:38.590228 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf516349-cb9a-45e8-9424-c1bcc44cee33 admin admin] RBAC: Authorization granted {{(pid=71939) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 24 16:29:38.591797 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: [pid: 71939|app: 0|req: 57/114] 10.222.0.53 () {56 vars in 1189 bytes} [Wed Nov 24 16:29:38 2021] GET /identity/v3/users/0f2ba2e8375b4e8c8792ee1e22b60427 => generated 247 bytes in 48 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 24 16:29:38.597739 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9ca053d-44ac-4768-adf7-5abdf9ea8a62 admin admin] Authenticating user token {{(pid=71938) process_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 24 16:29:38.607444 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9ca053d-44ac-4768-adf7-5abdf9ea8a62 admin admin] Validating token access rules against request {{(pid=71938) validate_allowed_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 24 16:29:38.611681 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44dd1452-e479-45f4-864b-5dcf8c107b74 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f2ba2e8375b4e8c8792ee1e22b60427', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '00a5583c7b7443e98e7a1d31a0b638dc', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=71938) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 24 16:29:38.613161 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44dd1452-e479-45f4-864b-5dcf8c107b74 admin admin] REQUEST_METHOD: `GET` {{(pid=71938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 24 16:29:38.613497 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44dd1452-e479-45f4-864b-5dcf8c107b74 admin admin] SCRIPT_NAME: `/identity` {{(pid=71938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 24 16:29:38.613831 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44dd1452-e479-45f4-864b-5dcf8c107b74 admin admin] PATH_INFO: `/v3/projects/6a75e77ca1684c808c57b448b83e73d2` {{(pid=71938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 24 16:29:38.615083 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44dd1452-e479-45f4-864b-5dcf8c107b74 admin admin] RBAC: Authorizing `identity:get_project(project_id=6a75e77ca1684c808c57b448b83e73d2)` {{(pid=71938) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:442}} Nov 24 16:29:38.643480 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44dd1452-e479-45f4-864b-5dcf8c107b74 admin admin] RBAC: Authorization granted {{(pid=71938) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 24 16:29:38.645119 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: [pid: 71938|app: 0|req: 58/115] 10.222.0.53 () {56 vars in 1198 bytes} [Wed Nov 24 16:29:38 2021] GET /identity/v3/projects/6a75e77ca1684c808c57b448b83e73d2 => generated 298 bytes in 48 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 24 16:29:38.650694 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf516349-cb9a-45e8-9424-c1bcc44cee33 admin admin] Authenticating user token {{(pid=71939) process_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 24 16:29:38.660794 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf516349-cb9a-45e8-9424-c1bcc44cee33 admin admin] Validating token access rules against request {{(pid=71939) validate_allowed_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 24 16:29:38.664880 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb7e9f22-47fe-4c20-862a-35407acff961 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f2ba2e8375b4e8c8792ee1e22b60427', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '00a5583c7b7443e98e7a1d31a0b638dc', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=71939) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 24 16:29:38.665755 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb7e9f22-47fe-4c20-862a-35407acff961 admin admin] REQUEST_METHOD: `PUT` {{(pid=71939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 24 16:29:38.666113 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb7e9f22-47fe-4c20-862a-35407acff961 admin admin] SCRIPT_NAME: `/identity` {{(pid=71939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 24 16:29:38.666448 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb7e9f22-47fe-4c20-862a-35407acff961 admin admin] PATH_INFO: `/v3/projects/6a75e77ca1684c808c57b448b83e73d2/users/0f2ba2e8375b4e8c8792ee1e22b60427/roles/5611724e350b41e19921b5961a342582` {{(pid=71939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 24 16:29:38.668341 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb7e9f22-47fe-4c20-862a-35407acff961 admin admin] RBAC: Authorizing `identity:create_grant(project_id=6a75e77ca1684c808c57b448b83e73d2, user_id=0f2ba2e8375b4e8c8792ee1e22b60427, role_id=5611724e350b41e19921b5961a342582)` {{(pid=71939) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:442}} Nov 24 16:29:38.697584 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb7e9f22-47fe-4c20-862a-35407acff961 admin admin] RBAC: Authorization granted {{(pid=71939) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 24 16:29:38.709171 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: [pid: 71939|app: 0|req: 58/116] 10.222.0.53 () {58 vars in 1451 bytes} [Wed Nov 24 16:29:38 2021] PUT /identity/v3/projects/6a75e77ca1684c808c57b448b83e73d2/users/0f2ba2e8375b4e8c8792ee1e22b60427/roles/5611724e350b41e19921b5961a342582 => generated 0 bytes in 59 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 24 16:29:40.675381 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c57afe17-1441-40cf-b47a-80060cf65a6b None None] REQUEST_METHOD: `GET` {{(pid=71938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 24 16:29:40.675908 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c57afe17-1441-40cf-b47a-80060cf65a6b None None] SCRIPT_NAME: `/identity` {{(pid=71938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 24 16:29:40.676004 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c57afe17-1441-40cf-b47a-80060cf65a6b None None] PATH_INFO: `/` {{(pid=71938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 24 16:29:40.677836 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: [pid: 71938|app: 0|req: 59/117] 10.222.0.53 () {54 vars in 915 bytes} [Wed Nov 24 16:29:40 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 24 16:29:40.683291 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28724468-cb1e-4347-bc55-32388d015e54 None None] REQUEST_METHOD: `POST` {{(pid=71939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 24 16:29:40.683643 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28724468-cb1e-4347-bc55-32388d015e54 None None] SCRIPT_NAME: `/identity` {{(pid=71939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 24 16:29:40.683979 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28724468-cb1e-4347-bc55-32388d015e54 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=71939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 24 16:29:40.708251 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.auth.core [None req-28724468-cb1e-4347-bc55-32388d015e54 None None] MFA Rules not processed for user `0f2ba2e8375b4e8c8792ee1e22b60427`. Rule list: `[]` (Enabled: `True`). {{(pid=71939) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:442}} Nov 24 16:29:40.709466 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.fernet_utils [None req-28724468-cb1e-4347-bc55-32388d015e54 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=71939) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:289}} Nov 24 16:29:40.774877 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: [pid: 71939|app: 0|req: 59/118] 10.222.0.53 () {58 vars in 1013 bytes} [Wed Nov 24 16:29:40 2021] POST /identity/v3/auth/tokens => generated 1067 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 24 16:29:40.797608 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af8eb548-1846-465f-b50d-97feb2842c7f None None] REQUEST_METHOD: `POST` {{(pid=71938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 24 16:29:40.797957 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af8eb548-1846-465f-b50d-97feb2842c7f None None] SCRIPT_NAME: `/identity` {{(pid=71938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 24 16:29:40.798349 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af8eb548-1846-465f-b50d-97feb2842c7f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=71938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 24 16:29:40.822403 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.auth.core [None req-af8eb548-1846-465f-b50d-97feb2842c7f None None] MFA Rules not processed for user `0f2ba2e8375b4e8c8792ee1e22b60427`. Rule list: `[]` (Enabled: `True`). {{(pid=71938) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:442}} Nov 24 16:29:40.823626 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.fernet_utils [None req-af8eb548-1846-465f-b50d-97feb2842c7f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=71938) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:289}} Nov 24 16:29:40.830918 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: [pid: 71938|app: 0|req: 60/119] 10.222.0.53 () {58 vars in 1013 bytes} [Wed Nov 24 16:29:40 2021] POST /identity/v3/auth/tokens => generated 1067 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 24 16:29:40.836434 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28724468-cb1e-4347-bc55-32388d015e54 None None] Authenticating user token {{(pid=71939) process_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 24 16:29:40.845990 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28724468-cb1e-4347-bc55-32388d015e54 None None] Validating token access rules against request {{(pid=71939) validate_allowed_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 24 16:29:40.850742 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19b9ae6d-9b48-4908-b744-61bd3291c762 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f2ba2e8375b4e8c8792ee1e22b60427', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '00a5583c7b7443e98e7a1d31a0b638dc', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=71939) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 24 16:29:40.851546 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19b9ae6d-9b48-4908-b744-61bd3291c762 admin admin] REQUEST_METHOD: `GET` {{(pid=71939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 24 16:29:40.851885 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19b9ae6d-9b48-4908-b744-61bd3291c762 admin admin] SCRIPT_NAME: `/identity` {{(pid=71939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 24 16:29:40.852220 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19b9ae6d-9b48-4908-b744-61bd3291c762 admin admin] PATH_INFO: `/v3/roles/admin` {{(pid=71939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 24 16:29:40.864571 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19b9ae6d-9b48-4908-b744-61bd3291c762 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=71939) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:401}} Nov 24 16:29:40.871914 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: WARNING keystone.server.flask.application [None req-19b9ae6d-9b48-4908-b744-61bd3291c762 admin admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Nov 24 16:29:40.873118 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: [pid: 71939|app: 0|req: 60/120] 10.222.0.53 () {56 vars in 1108 bytes} [Wed Nov 24 16:29:40 2021] GET /identity/v3/roles/admin => generated 83 bytes in 37 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 24 16:29:40.879617 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af8eb548-1846-465f-b50d-97feb2842c7f None None] Authenticating user token {{(pid=71938) process_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 24 16:29:40.888828 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af8eb548-1846-465f-b50d-97feb2842c7f None None] Validating token access rules against request {{(pid=71938) validate_allowed_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 24 16:29:40.893078 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-097dbd6c-a3c4-4eed-9089-81a8ee8269dd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f2ba2e8375b4e8c8792ee1e22b60427', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '00a5583c7b7443e98e7a1d31a0b638dc', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=71938) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 24 16:29:40.893748 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-097dbd6c-a3c4-4eed-9089-81a8ee8269dd admin admin] REQUEST_METHOD: `GET` {{(pid=71938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 24 16:29:40.894117 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-097dbd6c-a3c4-4eed-9089-81a8ee8269dd admin admin] SCRIPT_NAME: `/identity` {{(pid=71938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 24 16:29:40.894453 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-097dbd6c-a3c4-4eed-9089-81a8ee8269dd admin admin] PATH_INFO: `/v3/roles` {{(pid=71938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 24 16:29:40.895259 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-097dbd6c-a3c4-4eed-9089-81a8ee8269dd admin admin] RBAC: Adding query filter params (name=admin) {{(pid=71938) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:161}} Nov 24 16:29:40.895611 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-097dbd6c-a3c4-4eed-9089-81a8ee8269dd admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=71938) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:442}} Nov 24 16:29:40.923991 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-097dbd6c-a3c4-4eed-9089-81a8ee8269dd admin admin] RBAC: Authorization granted {{(pid=71938) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 24 16:29:40.933572 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: [pid: 71938|app: 0|req: 61/121] 10.222.0.53 () {56 vars in 1111 bytes} [Wed Nov 24 16:29:40 2021] GET /identity/v3/roles?name=admin => generated 339 bytes in 54 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 24 16:29:40.939052 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19b9ae6d-9b48-4908-b744-61bd3291c762 admin admin] Authenticating user token {{(pid=71939) process_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 24 16:29:40.949250 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19b9ae6d-9b48-4908-b744-61bd3291c762 admin admin] Validating token access rules against request {{(pid=71939) validate_allowed_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 24 16:29:40.953393 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6007fcfa-dc5b-4b79-8952-67fb34e2a99a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f2ba2e8375b4e8c8792ee1e22b60427', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '00a5583c7b7443e98e7a1d31a0b638dc', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=71939) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 24 16:29:40.955509 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6007fcfa-dc5b-4b79-8952-67fb34e2a99a admin admin] REQUEST_METHOD: `GET` {{(pid=71939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 24 16:29:40.955509 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6007fcfa-dc5b-4b79-8952-67fb34e2a99a admin admin] SCRIPT_NAME: `/identity` {{(pid=71939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 24 16:29:40.955509 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6007fcfa-dc5b-4b79-8952-67fb34e2a99a admin admin] PATH_INFO: `/v3/users/0f2ba2e8375b4e8c8792ee1e22b60427` {{(pid=71939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 24 16:29:40.956487 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6007fcfa-dc5b-4b79-8952-67fb34e2a99a admin admin] RBAC: Authorizing `identity:get_user(user_id=0f2ba2e8375b4e8c8792ee1e22b60427)` {{(pid=71939) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:442}} Nov 24 16:29:40.984852 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6007fcfa-dc5b-4b79-8952-67fb34e2a99a admin admin] RBAC: Authorization granted {{(pid=71939) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 24 16:29:40.986523 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: [pid: 71939|app: 0|req: 61/122] 10.222.0.53 () {56 vars in 1189 bytes} [Wed Nov 24 16:29:40 2021] GET /identity/v3/users/0f2ba2e8375b4e8c8792ee1e22b60427 => generated 247 bytes in 48 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 24 16:29:40.992699 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-097dbd6c-a3c4-4eed-9089-81a8ee8269dd admin admin] Authenticating user token {{(pid=71938) process_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 24 16:29:41.002719 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-097dbd6c-a3c4-4eed-9089-81a8ee8269dd admin admin] Validating token access rules against request {{(pid=71938) validate_allowed_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 24 16:29:41.007112 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b2c6ebc-1f4a-4ee7-8df2-a1768d6e3abb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f2ba2e8375b4e8c8792ee1e22b60427', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '00a5583c7b7443e98e7a1d31a0b638dc', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=71938) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 24 16:29:41.007767 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b2c6ebc-1f4a-4ee7-8df2-a1768d6e3abb admin admin] REQUEST_METHOD: `GET` {{(pid=71938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 24 16:29:41.008106 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b2c6ebc-1f4a-4ee7-8df2-a1768d6e3abb admin admin] SCRIPT_NAME: `/identity` {{(pid=71938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 24 16:29:41.008442 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b2c6ebc-1f4a-4ee7-8df2-a1768d6e3abb admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=71938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 24 16:29:41.016766 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b2c6ebc-1f4a-4ee7-8df2-a1768d6e3abb admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=71938) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:442}} Nov 24 16:29:41.045628 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b2c6ebc-1f4a-4ee7-8df2-a1768d6e3abb admin admin] RBAC: Authorization granted {{(pid=71938) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 24 16:29:41.055257 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: [pid: 71938|app: 0|req: 62/123] 10.222.0.53 () {58 vars in 1315 bytes} [Wed Nov 24 16:29:40 2021] GET /identity/v3/auth/tokens => generated 1067 bytes in 63 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 24 16:29:41.061111 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6007fcfa-dc5b-4b79-8952-67fb34e2a99a admin admin] Authenticating user token {{(pid=71939) process_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 24 16:29:41.070898 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6007fcfa-dc5b-4b79-8952-67fb34e2a99a admin admin] Validating token access rules against request {{(pid=71939) validate_allowed_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 24 16:29:41.075045 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0497daf-cd4a-4f8a-a2ef-a3e506a50f86 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f2ba2e8375b4e8c8792ee1e22b60427', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '00a5583c7b7443e98e7a1d31a0b638dc', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=71939) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 24 16:29:41.075911 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0497daf-cd4a-4f8a-a2ef-a3e506a50f86 admin admin] REQUEST_METHOD: `GET` {{(pid=71939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 24 16:29:41.076346 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0497daf-cd4a-4f8a-a2ef-a3e506a50f86 admin admin] SCRIPT_NAME: `/identity` {{(pid=71939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 24 16:29:41.076693 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0497daf-cd4a-4f8a-a2ef-a3e506a50f86 admin admin] PATH_INFO: `/v3/projects/6a75e77ca1684c808c57b448b83e73d2` {{(pid=71939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 24 16:29:41.077883 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0497daf-cd4a-4f8a-a2ef-a3e506a50f86 admin admin] RBAC: Authorizing `identity:get_project(project_id=6a75e77ca1684c808c57b448b83e73d2)` {{(pid=71939) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:442}} Nov 24 16:29:41.107049 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0497daf-cd4a-4f8a-a2ef-a3e506a50f86 admin admin] RBAC: Authorization granted {{(pid=71939) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 24 16:29:41.108775 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: [pid: 71939|app: 0|req: 62/124] 10.222.0.53 () {56 vars in 1198 bytes} [Wed Nov 24 16:29:41 2021] GET /identity/v3/projects/6a75e77ca1684c808c57b448b83e73d2 => generated 298 bytes in 48 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 24 16:29:41.115192 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b2c6ebc-1f4a-4ee7-8df2-a1768d6e3abb admin admin] Authenticating user token {{(pid=71938) process_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 24 16:29:41.124176 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b2c6ebc-1f4a-4ee7-8df2-a1768d6e3abb admin admin] Validating token access rules against request {{(pid=71938) validate_allowed_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 24 16:29:41.128411 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-501aa013-2a44-46e7-8e1e-8ab40a4f906f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f2ba2e8375b4e8c8792ee1e22b60427', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '00a5583c7b7443e98e7a1d31a0b638dc', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=71938) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 24 16:29:41.129065 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-501aa013-2a44-46e7-8e1e-8ab40a4f906f admin admin] REQUEST_METHOD: `GET` {{(pid=71938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 24 16:29:41.129406 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-501aa013-2a44-46e7-8e1e-8ab40a4f906f admin admin] SCRIPT_NAME: `/identity` {{(pid=71938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 24 16:29:41.129740 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-501aa013-2a44-46e7-8e1e-8ab40a4f906f admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=71938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 24 16:29:41.130678 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-501aa013-2a44-46e7-8e1e-8ab40a4f906f admin admin] RBAC: Adding query filter params (role.id=5611724e350b41e19921b5961a342582, scope.project.id=6a75e77ca1684c808c57b448b83e73d2, user.id=0f2ba2e8375b4e8c8792ee1e22b60427) {{(pid=71938) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:161}} Nov 24 16:29:41.131045 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-501aa013-2a44-46e7-8e1e-8ab40a4f906f admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=71938) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:442}} Nov 24 16:29:41.160528 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-501aa013-2a44-46e7-8e1e-8ab40a4f906f admin admin] RBAC: Authorization granted {{(pid=71938) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 24 16:29:41.166589 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: [pid: 71938|app: 0|req: 63/125] 10.222.0.53 () {56 vars in 1386 bytes} [Wed Nov 24 16:29:41 2021] GET /identity/v3/role_assignments?user.id=0f2ba2e8375b4e8c8792ee1e22b60427&scope.project.id=6a75e77ca1684c808c57b448b83e73d2&role.id=5611724e350b41e19921b5961a342582 => generated 608 bytes in 52 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 24 16:29:43.178345 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a410ec9-fec2-45a9-9b84-85d426307b9e None None] REQUEST_METHOD: `GET` {{(pid=71939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 24 16:29:43.178877 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a410ec9-fec2-45a9-9b84-85d426307b9e None None] SCRIPT_NAME: `/identity` {{(pid=71939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 24 16:29:43.178965 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a410ec9-fec2-45a9-9b84-85d426307b9e None None] PATH_INFO: `/` {{(pid=71939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 24 16:29:43.180804 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: [pid: 71939|app: 0|req: 63/126] 10.222.0.53 () {54 vars in 915 bytes} [Wed Nov 24 16:29:43 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 24 16:29:43.188144 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e625d29-1ce8-4ac2-8941-2bec54b1ae89 None None] REQUEST_METHOD: `POST` {{(pid=71938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 24 16:29:43.188500 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e625d29-1ce8-4ac2-8941-2bec54b1ae89 None None] SCRIPT_NAME: `/identity` {{(pid=71938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 24 16:29:43.188837 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e625d29-1ce8-4ac2-8941-2bec54b1ae89 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=71938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 24 16:29:43.213930 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.auth.core [None req-7e625d29-1ce8-4ac2-8941-2bec54b1ae89 None None] MFA Rules not processed for user `0f2ba2e8375b4e8c8792ee1e22b60427`. Rule list: `[]` (Enabled: `True`). {{(pid=71938) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:442}} Nov 24 16:29:43.215217 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.fernet_utils [None req-7e625d29-1ce8-4ac2-8941-2bec54b1ae89 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=71938) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:289}} Nov 24 16:29:43.222964 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: [pid: 71938|app: 0|req: 64/127] 10.222.0.53 () {58 vars in 1013 bytes} [Wed Nov 24 16:29:43 2021] POST /identity/v3/auth/tokens => generated 1067 bytes in 38 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 24 16:29:43.245173 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fd2f372-3f54-4825-bcdf-f27e258d0e97 None None] REQUEST_METHOD: `POST` {{(pid=71939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 24 16:29:43.245516 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fd2f372-3f54-4825-bcdf-f27e258d0e97 None None] SCRIPT_NAME: `/identity` {{(pid=71939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 24 16:29:43.245850 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fd2f372-3f54-4825-bcdf-f27e258d0e97 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=71939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 24 16:29:43.271332 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.auth.core [None req-7fd2f372-3f54-4825-bcdf-f27e258d0e97 None None] MFA Rules not processed for user `0f2ba2e8375b4e8c8792ee1e22b60427`. Rule list: `[]` (Enabled: `True`). {{(pid=71939) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:442}} Nov 24 16:29:43.272543 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.fernet_utils [None req-7fd2f372-3f54-4825-bcdf-f27e258d0e97 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=71939) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:289}} Nov 24 16:29:43.279504 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: [pid: 71939|app: 0|req: 64/128] 10.222.0.53 () {58 vars in 1013 bytes} [Wed Nov 24 16:29:43 2021] POST /identity/v3/auth/tokens => generated 1067 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 24 16:29:43.285212 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e625d29-1ce8-4ac2-8941-2bec54b1ae89 None None] Authenticating user token {{(pid=71938) process_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 24 16:29:43.294904 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e625d29-1ce8-4ac2-8941-2bec54b1ae89 None None] Validating token access rules against request {{(pid=71938) validate_allowed_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 24 16:29:43.299331 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-085d3ba9-0a49-4862-a828-f3fbf0b8f6a1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f2ba2e8375b4e8c8792ee1e22b60427', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '00a5583c7b7443e98e7a1d31a0b638dc', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=71938) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 24 16:29:43.300152 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-085d3ba9-0a49-4862-a828-f3fbf0b8f6a1 admin admin] REQUEST_METHOD: `GET` {{(pid=71938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 24 16:29:43.300495 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-085d3ba9-0a49-4862-a828-f3fbf0b8f6a1 admin admin] SCRIPT_NAME: `/identity` {{(pid=71938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 24 16:29:43.300830 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-085d3ba9-0a49-4862-a828-f3fbf0b8f6a1 admin admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=71938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 24 16:29:43.312671 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-085d3ba9-0a49-4862-a828-f3fbf0b8f6a1 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=71938) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:401}} Nov 24 16:29:43.320959 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: WARNING keystone.server.flask.application [None req-085d3ba9-0a49-4862-a828-f3fbf0b8f6a1 admin admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Nov 24 16:29:43.322179 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: [pid: 71938|app: 0|req: 65/129] 10.222.0.53 () {56 vars in 1126 bytes} [Wed Nov 24 16:29:43 2021] GET /identity/v3/roles/anotherrole => generated 89 bytes in 37 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 24 16:29:43.329496 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fd2f372-3f54-4825-bcdf-f27e258d0e97 None None] Authenticating user token {{(pid=71939) process_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 24 16:29:43.339215 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fd2f372-3f54-4825-bcdf-f27e258d0e97 None None] Validating token access rules against request {{(pid=71939) validate_allowed_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 24 16:29:43.343398 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30e11875-162a-4b4a-988b-c624c327bce0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f2ba2e8375b4e8c8792ee1e22b60427', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '00a5583c7b7443e98e7a1d31a0b638dc', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=71939) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 24 16:29:43.344067 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30e11875-162a-4b4a-988b-c624c327bce0 admin admin] REQUEST_METHOD: `GET` {{(pid=71939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 24 16:29:43.344396 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30e11875-162a-4b4a-988b-c624c327bce0 admin admin] SCRIPT_NAME: `/identity` {{(pid=71939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 24 16:29:43.344719 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30e11875-162a-4b4a-988b-c624c327bce0 admin admin] PATH_INFO: `/v3/roles` {{(pid=71939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 24 16:29:43.345514 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30e11875-162a-4b4a-988b-c624c327bce0 admin admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=71939) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:161}} Nov 24 16:29:43.345857 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30e11875-162a-4b4a-988b-c624c327bce0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=71939) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:442}} Nov 24 16:29:43.374165 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30e11875-162a-4b4a-988b-c624c327bce0 admin admin] RBAC: Authorization granted {{(pid=71939) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 24 16:29:43.383675 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: [pid: 71939|app: 0|req: 65/130] 10.222.0.53 () {56 vars in 1123 bytes} [Wed Nov 24 16:29:43 2021] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 55 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 24 16:29:43.389625 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-085d3ba9-0a49-4862-a828-f3fbf0b8f6a1 admin admin] Authenticating user token {{(pid=71938) process_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 24 16:29:43.400474 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-085d3ba9-0a49-4862-a828-f3fbf0b8f6a1 admin admin] Validating token access rules against request {{(pid=71938) validate_allowed_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 24 16:29:43.404808 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-263f9c6e-325c-438c-aed9-e8524c0cd919 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f2ba2e8375b4e8c8792ee1e22b60427', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '00a5583c7b7443e98e7a1d31a0b638dc', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=71938) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 24 16:29:43.405689 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-263f9c6e-325c-438c-aed9-e8524c0cd919 admin admin] REQUEST_METHOD: `GET` {{(pid=71938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 24 16:29:43.406038 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-263f9c6e-325c-438c-aed9-e8524c0cd919 admin admin] SCRIPT_NAME: `/identity` {{(pid=71938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 24 16:29:43.406394 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-263f9c6e-325c-438c-aed9-e8524c0cd919 admin admin] PATH_INFO: `/v3/users/a38b605a5d8b4fd286a841b891d7b4c4` {{(pid=71938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 24 16:29:43.407634 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-263f9c6e-325c-438c-aed9-e8524c0cd919 admin admin] RBAC: Authorizing `identity:get_user(user_id=a38b605a5d8b4fd286a841b891d7b4c4)` {{(pid=71938) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:442}} Nov 24 16:29:43.437175 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-263f9c6e-325c-438c-aed9-e8524c0cd919 admin admin] RBAC: Authorization granted {{(pid=71938) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 24 16:29:43.438777 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: [pid: 71938|app: 0|req: 66/131] 10.222.0.53 () {56 vars in 1189 bytes} [Wed Nov 24 16:29:43 2021] GET /identity/v3/users/a38b605a5d8b4fd286a841b891d7b4c4 => generated 275 bytes in 50 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 24 16:29:43.445157 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30e11875-162a-4b4a-988b-c624c327bce0 admin admin] Authenticating user token {{(pid=71939) process_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 24 16:29:43.455533 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30e11875-162a-4b4a-988b-c624c327bce0 admin admin] Validating token access rules against request {{(pid=71939) validate_allowed_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 24 16:29:43.460086 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6d6b198-9e77-49c9-b987-72b535613492 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f2ba2e8375b4e8c8792ee1e22b60427', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '00a5583c7b7443e98e7a1d31a0b638dc', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=71939) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 24 16:29:43.460739 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6d6b198-9e77-49c9-b987-72b535613492 admin admin] REQUEST_METHOD: `GET` {{(pid=71939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 24 16:29:43.461081 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6d6b198-9e77-49c9-b987-72b535613492 admin admin] SCRIPT_NAME: `/identity` {{(pid=71939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 24 16:29:43.461415 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6d6b198-9e77-49c9-b987-72b535613492 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=71939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 24 16:29:43.469688 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6d6b198-9e77-49c9-b987-72b535613492 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=71939) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:442}} Nov 24 16:29:43.498183 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6d6b198-9e77-49c9-b987-72b535613492 admin admin] RBAC: Authorization granted {{(pid=71939) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 24 16:29:43.508069 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: [pid: 71939|app: 0|req: 66/132] 10.222.0.53 () {58 vars in 1315 bytes} [Wed Nov 24 16:29:43 2021] GET /identity/v3/auth/tokens => generated 1067 bytes in 63 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 24 16:29:43.514240 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-263f9c6e-325c-438c-aed9-e8524c0cd919 admin admin] Authenticating user token {{(pid=71938) process_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 24 16:29:43.525554 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-263f9c6e-325c-438c-aed9-e8524c0cd919 admin admin] Validating token access rules against request {{(pid=71938) validate_allowed_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 24 16:29:43.529973 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b786180-22ce-45da-afb0-d284dddbd583 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f2ba2e8375b4e8c8792ee1e22b60427', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '00a5583c7b7443e98e7a1d31a0b638dc', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=71938) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 24 16:29:43.530882 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b786180-22ce-45da-afb0-d284dddbd583 admin admin] REQUEST_METHOD: `GET` {{(pid=71938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 24 16:29:43.531223 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b786180-22ce-45da-afb0-d284dddbd583 admin admin] SCRIPT_NAME: `/identity` {{(pid=71938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 24 16:29:43.531561 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b786180-22ce-45da-afb0-d284dddbd583 admin admin] PATH_INFO: `/v3/projects/6a75e77ca1684c808c57b448b83e73d2` {{(pid=71938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 24 16:29:43.532842 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b786180-22ce-45da-afb0-d284dddbd583 admin admin] RBAC: Authorizing `identity:get_project(project_id=6a75e77ca1684c808c57b448b83e73d2)` {{(pid=71938) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:442}} Nov 24 16:29:43.561899 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b786180-22ce-45da-afb0-d284dddbd583 admin admin] RBAC: Authorization granted {{(pid=71938) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 24 16:29:43.563618 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: [pid: 71938|app: 0|req: 67/133] 10.222.0.53 () {56 vars in 1198 bytes} [Wed Nov 24 16:29:43 2021] GET /identity/v3/projects/6a75e77ca1684c808c57b448b83e73d2 => generated 298 bytes in 50 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 24 16:29:43.571231 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6d6b198-9e77-49c9-b987-72b535613492 admin admin] Authenticating user token {{(pid=71939) process_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 24 16:29:43.580866 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6d6b198-9e77-49c9-b987-72b535613492 admin admin] Validating token access rules against request {{(pid=71939) validate_allowed_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 24 16:29:43.585210 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94813800-b2fa-448a-9eaa-8fe3ac69a0c2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f2ba2e8375b4e8c8792ee1e22b60427', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '00a5583c7b7443e98e7a1d31a0b638dc', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=71939) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 24 16:29:43.585866 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94813800-b2fa-448a-9eaa-8fe3ac69a0c2 admin admin] REQUEST_METHOD: `GET` {{(pid=71939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 24 16:29:43.586237 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94813800-b2fa-448a-9eaa-8fe3ac69a0c2 admin admin] SCRIPT_NAME: `/identity` {{(pid=71939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 24 16:29:43.586571 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94813800-b2fa-448a-9eaa-8fe3ac69a0c2 admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=71939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 24 16:29:43.587463 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94813800-b2fa-448a-9eaa-8fe3ac69a0c2 admin admin] RBAC: Adding query filter params (role.id=0de27ef8b6e744cda429a0d133117dcd, scope.project.id=6a75e77ca1684c808c57b448b83e73d2, user.id=a38b605a5d8b4fd286a841b891d7b4c4) {{(pid=71939) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:161}} Nov 24 16:29:43.587820 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94813800-b2fa-448a-9eaa-8fe3ac69a0c2 admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=71939) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:442}} Nov 24 16:29:43.618455 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94813800-b2fa-448a-9eaa-8fe3ac69a0c2 admin admin] RBAC: Authorization granted {{(pid=71939) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 24 16:29:43.625315 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: [pid: 71939|app: 0|req: 67/134] 10.222.0.53 () {56 vars in 1386 bytes} [Wed Nov 24 16:29:43 2021] GET /identity/v3/role_assignments?user.id=a38b605a5d8b4fd286a841b891d7b4c4&scope.project.id=6a75e77ca1684c808c57b448b83e73d2&role.id=0de27ef8b6e744cda429a0d133117dcd => generated 259 bytes in 55 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 24 16:29:45.595386 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89479641-999a-4563-8f60-b2185a20b64b None None] REQUEST_METHOD: `GET` {{(pid=71938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 24 16:29:45.595874 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89479641-999a-4563-8f60-b2185a20b64b None None] SCRIPT_NAME: `/identity` {{(pid=71938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 24 16:29:45.595976 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89479641-999a-4563-8f60-b2185a20b64b None None] PATH_INFO: `/` {{(pid=71938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 24 16:29:45.597847 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: [pid: 71938|app: 0|req: 68/135] 10.222.0.53 () {54 vars in 915 bytes} [Wed Nov 24 16:29:45 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 24 16:29:45.603702 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a61ec93-038c-4b87-9e8d-4ba0f9a4e353 None None] REQUEST_METHOD: `POST` {{(pid=71939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 24 16:29:45.604048 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a61ec93-038c-4b87-9e8d-4ba0f9a4e353 None None] SCRIPT_NAME: `/identity` {{(pid=71939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 24 16:29:45.604379 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a61ec93-038c-4b87-9e8d-4ba0f9a4e353 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=71939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 24 16:29:45.628804 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.auth.core [None req-0a61ec93-038c-4b87-9e8d-4ba0f9a4e353 None None] MFA Rules not processed for user `0f2ba2e8375b4e8c8792ee1e22b60427`. Rule list: `[]` (Enabled: `True`). {{(pid=71939) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:442}} Nov 24 16:29:45.630014 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.fernet_utils [None req-0a61ec93-038c-4b87-9e8d-4ba0f9a4e353 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=71939) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:289}} Nov 24 16:29:45.637245 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: [pid: 71939|app: 0|req: 68/136] 10.222.0.53 () {58 vars in 1013 bytes} [Wed Nov 24 16:29:45 2021] POST /identity/v3/auth/tokens => generated 1067 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 24 16:29:45.658721 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-560f6408-be55-49e1-aa7a-f33ebad74b19 None None] REQUEST_METHOD: `POST` {{(pid=71938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 24 16:29:45.659068 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-560f6408-be55-49e1-aa7a-f33ebad74b19 None None] SCRIPT_NAME: `/identity` {{(pid=71938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 24 16:29:45.659406 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-560f6408-be55-49e1-aa7a-f33ebad74b19 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=71938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 24 16:29:45.683291 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.auth.core [None req-560f6408-be55-49e1-aa7a-f33ebad74b19 None None] MFA Rules not processed for user `0f2ba2e8375b4e8c8792ee1e22b60427`. Rule list: `[]` (Enabled: `True`). {{(pid=71938) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:442}} Nov 24 16:29:45.684506 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.fernet_utils [None req-560f6408-be55-49e1-aa7a-f33ebad74b19 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=71938) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:289}} Nov 24 16:29:45.692195 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: [pid: 71938|app: 0|req: 69/137] 10.222.0.53 () {58 vars in 1013 bytes} [Wed Nov 24 16:29:45 2021] POST /identity/v3/auth/tokens => generated 1067 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 24 16:29:45.698049 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a61ec93-038c-4b87-9e8d-4ba0f9a4e353 None None] Authenticating user token {{(pid=71939) process_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 24 16:29:45.707962 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a61ec93-038c-4b87-9e8d-4ba0f9a4e353 None None] Validating token access rules against request {{(pid=71939) validate_allowed_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 24 16:29:45.712133 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9cbb252-32f4-4f17-b71d-a7c179927bcb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f2ba2e8375b4e8c8792ee1e22b60427', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '00a5583c7b7443e98e7a1d31a0b638dc', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=71939) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 24 16:29:45.712956 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9cbb252-32f4-4f17-b71d-a7c179927bcb admin admin] REQUEST_METHOD: `GET` {{(pid=71939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 24 16:29:45.713299 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9cbb252-32f4-4f17-b71d-a7c179927bcb admin admin] SCRIPT_NAME: `/identity` {{(pid=71939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 24 16:29:45.713629 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9cbb252-32f4-4f17-b71d-a7c179927bcb admin admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=71939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 24 16:29:45.725504 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9cbb252-32f4-4f17-b71d-a7c179927bcb admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=71939) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:401}} Nov 24 16:29:45.733241 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: WARNING keystone.server.flask.application [None req-c9cbb252-32f4-4f17-b71d-a7c179927bcb admin admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Nov 24 16:29:45.734524 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: [pid: 71939|app: 0|req: 69/138] 10.222.0.53 () {56 vars in 1126 bytes} [Wed Nov 24 16:29:45 2021] GET /identity/v3/roles/anotherrole => generated 89 bytes in 37 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 24 16:29:45.741617 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-560f6408-be55-49e1-aa7a-f33ebad74b19 None None] Authenticating user token {{(pid=71938) process_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 24 16:29:45.750892 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-560f6408-be55-49e1-aa7a-f33ebad74b19 None None] Validating token access rules against request {{(pid=71938) validate_allowed_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 24 16:29:45.755765 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44bf25a1-23fa-4f44-8d2a-9e0bfd966297 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f2ba2e8375b4e8c8792ee1e22b60427', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '00a5583c7b7443e98e7a1d31a0b638dc', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=71938) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 24 16:29:45.756434 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44bf25a1-23fa-4f44-8d2a-9e0bfd966297 admin admin] REQUEST_METHOD: `GET` {{(pid=71938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 24 16:29:45.756768 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44bf25a1-23fa-4f44-8d2a-9e0bfd966297 admin admin] SCRIPT_NAME: `/identity` {{(pid=71938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 24 16:29:45.757093 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44bf25a1-23fa-4f44-8d2a-9e0bfd966297 admin admin] PATH_INFO: `/v3/roles` {{(pid=71938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 24 16:29:45.757895 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44bf25a1-23fa-4f44-8d2a-9e0bfd966297 admin admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=71938) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:161}} Nov 24 16:29:45.758272 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44bf25a1-23fa-4f44-8d2a-9e0bfd966297 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=71938) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:442}} Nov 24 16:29:45.786109 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44bf25a1-23fa-4f44-8d2a-9e0bfd966297 admin admin] RBAC: Authorization granted {{(pid=71938) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 24 16:29:45.795389 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: [pid: 71938|app: 0|req: 70/139] 10.222.0.53 () {56 vars in 1123 bytes} [Wed Nov 24 16:29:45 2021] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 54 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 24 16:29:45.801887 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9cbb252-32f4-4f17-b71d-a7c179927bcb admin admin] Authenticating user token {{(pid=71939) process_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 24 16:29:45.812618 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9cbb252-32f4-4f17-b71d-a7c179927bcb admin admin] Validating token access rules against request {{(pid=71939) validate_allowed_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 24 16:29:45.817358 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0281e1e4-ef5f-46a8-8b2b-058bc12783eb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f2ba2e8375b4e8c8792ee1e22b60427', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '00a5583c7b7443e98e7a1d31a0b638dc', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=71939) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 24 16:29:45.818261 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0281e1e4-ef5f-46a8-8b2b-058bc12783eb admin admin] REQUEST_METHOD: `GET` {{(pid=71939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 24 16:29:45.818598 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0281e1e4-ef5f-46a8-8b2b-058bc12783eb admin admin] SCRIPT_NAME: `/identity` {{(pid=71939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 24 16:29:45.818928 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0281e1e4-ef5f-46a8-8b2b-058bc12783eb admin admin] PATH_INFO: `/v3/users/a38b605a5d8b4fd286a841b891d7b4c4` {{(pid=71939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 24 16:29:45.820128 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0281e1e4-ef5f-46a8-8b2b-058bc12783eb admin admin] RBAC: Authorizing `identity:get_user(user_id=a38b605a5d8b4fd286a841b891d7b4c4)` {{(pid=71939) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:442}} Nov 24 16:29:45.848655 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0281e1e4-ef5f-46a8-8b2b-058bc12783eb admin admin] RBAC: Authorization granted {{(pid=71939) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 24 16:29:45.850267 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: [pid: 71939|app: 0|req: 70/140] 10.222.0.53 () {56 vars in 1189 bytes} [Wed Nov 24 16:29:45 2021] GET /identity/v3/users/a38b605a5d8b4fd286a841b891d7b4c4 => generated 275 bytes in 49 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 24 16:29:45.856226 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44bf25a1-23fa-4f44-8d2a-9e0bfd966297 admin admin] Authenticating user token {{(pid=71938) process_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 24 16:29:45.866746 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44bf25a1-23fa-4f44-8d2a-9e0bfd966297 admin admin] Validating token access rules against request {{(pid=71938) validate_allowed_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 24 16:29:45.870926 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-171795a2-e7ae-49ca-ad2e-db9431b56449 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f2ba2e8375b4e8c8792ee1e22b60427', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '00a5583c7b7443e98e7a1d31a0b638dc', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=71938) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 24 16:29:45.871796 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-171795a2-e7ae-49ca-ad2e-db9431b56449 admin admin] REQUEST_METHOD: `GET` {{(pid=71938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 24 16:29:45.872132 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-171795a2-e7ae-49ca-ad2e-db9431b56449 admin admin] SCRIPT_NAME: `/identity` {{(pid=71938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 24 16:29:45.872460 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-171795a2-e7ae-49ca-ad2e-db9431b56449 admin admin] PATH_INFO: `/v3/projects/6a75e77ca1684c808c57b448b83e73d2` {{(pid=71938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 24 16:29:45.873654 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-171795a2-e7ae-49ca-ad2e-db9431b56449 admin admin] RBAC: Authorizing `identity:get_project(project_id=6a75e77ca1684c808c57b448b83e73d2)` {{(pid=71938) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:442}} Nov 24 16:29:45.902832 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-171795a2-e7ae-49ca-ad2e-db9431b56449 admin admin] RBAC: Authorization granted {{(pid=71938) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 24 16:29:45.904611 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: [pid: 71938|app: 0|req: 71/141] 10.222.0.53 () {56 vars in 1198 bytes} [Wed Nov 24 16:29:45 2021] GET /identity/v3/projects/6a75e77ca1684c808c57b448b83e73d2 => generated 298 bytes in 49 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 24 16:29:45.910679 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0281e1e4-ef5f-46a8-8b2b-058bc12783eb admin admin] Authenticating user token {{(pid=71939) process_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 24 16:29:45.920686 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0281e1e4-ef5f-46a8-8b2b-058bc12783eb admin admin] Validating token access rules against request {{(pid=71939) validate_allowed_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 24 16:29:45.925379 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fd03fff-b4e3-4207-b1a5-032e4d8de426 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f2ba2e8375b4e8c8792ee1e22b60427', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '00a5583c7b7443e98e7a1d31a0b638dc', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=71939) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 24 16:29:45.926304 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fd03fff-b4e3-4207-b1a5-032e4d8de426 admin admin] REQUEST_METHOD: `PUT` {{(pid=71939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 24 16:29:45.926647 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fd03fff-b4e3-4207-b1a5-032e4d8de426 admin admin] SCRIPT_NAME: `/identity` {{(pid=71939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 24 16:29:45.926981 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fd03fff-b4e3-4207-b1a5-032e4d8de426 admin admin] PATH_INFO: `/v3/projects/6a75e77ca1684c808c57b448b83e73d2/users/a38b605a5d8b4fd286a841b891d7b4c4/roles/0de27ef8b6e744cda429a0d133117dcd` {{(pid=71939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 24 16:29:45.929171 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fd03fff-b4e3-4207-b1a5-032e4d8de426 admin admin] RBAC: Authorizing `identity:create_grant(project_id=6a75e77ca1684c808c57b448b83e73d2, user_id=a38b605a5d8b4fd286a841b891d7b4c4, role_id=0de27ef8b6e744cda429a0d133117dcd)` {{(pid=71939) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:442}} Nov 24 16:29:45.959277 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fd03fff-b4e3-4207-b1a5-032e4d8de426 admin admin] RBAC: Authorization granted {{(pid=71939) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 24 16:29:45.970887 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: [pid: 71939|app: 0|req: 71/142] 10.222.0.53 () {58 vars in 1451 bytes} [Wed Nov 24 16:29:45 2021] PUT /identity/v3/projects/6a75e77ca1684c808c57b448b83e73d2/users/a38b605a5d8b4fd286a841b891d7b4c4/roles/0de27ef8b6e744cda429a0d133117dcd => generated 0 bytes in 61 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 24 16:29:47.967851 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73284d54-1312-46e2-b09f-585ab02863f5 None None] REQUEST_METHOD: `GET` {{(pid=71938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 24 16:29:47.968473 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73284d54-1312-46e2-b09f-585ab02863f5 None None] SCRIPT_NAME: `/identity` {{(pid=71938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 24 16:29:47.968473 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73284d54-1312-46e2-b09f-585ab02863f5 None None] PATH_INFO: `/` {{(pid=71938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 24 16:29:47.970333 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: [pid: 71938|app: 0|req: 72/143] 10.222.0.53 () {54 vars in 915 bytes} [Wed Nov 24 16:29:47 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 24 16:29:47.975975 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d693b3ae-b3fd-425d-a5f7-3ce39ff4d370 None None] REQUEST_METHOD: `POST` {{(pid=71939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 24 16:29:47.976322 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d693b3ae-b3fd-425d-a5f7-3ce39ff4d370 None None] SCRIPT_NAME: `/identity` {{(pid=71939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 24 16:29:47.976652 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d693b3ae-b3fd-425d-a5f7-3ce39ff4d370 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=71939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 24 16:29:48.000447 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.auth.core [None req-d693b3ae-b3fd-425d-a5f7-3ce39ff4d370 None None] MFA Rules not processed for user `0f2ba2e8375b4e8c8792ee1e22b60427`. Rule list: `[]` (Enabled: `True`). {{(pid=71939) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:442}} Nov 24 16:29:48.001662 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.fernet_utils [None req-d693b3ae-b3fd-425d-a5f7-3ce39ff4d370 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=71939) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:289}} Nov 24 16:29:48.068481 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: [pid: 71939|app: 0|req: 72/144] 10.222.0.53 () {58 vars in 1013 bytes} [Wed Nov 24 16:29:47 2021] POST /identity/v3/auth/tokens => generated 1067 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 24 16:29:48.091005 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ce7580d-1607-4931-918a-c117aab1e985 None None] REQUEST_METHOD: `POST` {{(pid=71938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 24 16:29:48.091353 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ce7580d-1607-4931-918a-c117aab1e985 None None] SCRIPT_NAME: `/identity` {{(pid=71938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 24 16:29:48.091697 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ce7580d-1607-4931-918a-c117aab1e985 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=71938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 24 16:29:48.115843 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.auth.core [None req-0ce7580d-1607-4931-918a-c117aab1e985 None None] MFA Rules not processed for user `0f2ba2e8375b4e8c8792ee1e22b60427`. Rule list: `[]` (Enabled: `True`). {{(pid=71938) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:442}} Nov 24 16:29:48.117064 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.fernet_utils [None req-0ce7580d-1607-4931-918a-c117aab1e985 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=71938) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:289}} Nov 24 16:29:48.124224 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: [pid: 71938|app: 0|req: 73/145] 10.222.0.53 () {58 vars in 1013 bytes} [Wed Nov 24 16:29:48 2021] POST /identity/v3/auth/tokens => generated 1067 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 24 16:29:48.130511 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d693b3ae-b3fd-425d-a5f7-3ce39ff4d370 None None] Authenticating user token {{(pid=71939) process_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 24 16:29:48.140509 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d693b3ae-b3fd-425d-a5f7-3ce39ff4d370 None None] Validating token access rules against request {{(pid=71939) validate_allowed_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 24 16:29:48.144725 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5929a1f4-cf0e-4814-9235-a3ae27fc4032 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f2ba2e8375b4e8c8792ee1e22b60427', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '00a5583c7b7443e98e7a1d31a0b638dc', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=71939) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 24 16:29:48.145545 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5929a1f4-cf0e-4814-9235-a3ae27fc4032 admin admin] REQUEST_METHOD: `GET` {{(pid=71939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 24 16:29:48.145884 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5929a1f4-cf0e-4814-9235-a3ae27fc4032 admin admin] SCRIPT_NAME: `/identity` {{(pid=71939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 24 16:29:48.146277 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5929a1f4-cf0e-4814-9235-a3ae27fc4032 admin admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=71939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 24 16:29:48.158142 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5929a1f4-cf0e-4814-9235-a3ae27fc4032 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=71939) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:401}} Nov 24 16:29:48.165881 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: WARNING keystone.server.flask.application [None req-5929a1f4-cf0e-4814-9235-a3ae27fc4032 admin admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Nov 24 16:29:48.167123 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: [pid: 71939|app: 0|req: 73/146] 10.222.0.53 () {56 vars in 1126 bytes} [Wed Nov 24 16:29:48 2021] GET /identity/v3/roles/anotherrole => generated 89 bytes in 37 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 24 16:29:48.173888 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ce7580d-1607-4931-918a-c117aab1e985 None None] Authenticating user token {{(pid=71938) process_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 24 16:29:48.183741 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ce7580d-1607-4931-918a-c117aab1e985 None None] Validating token access rules against request {{(pid=71938) validate_allowed_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 24 16:29:48.187988 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54d29d9e-8f4f-4c6b-958d-429d82e8840d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f2ba2e8375b4e8c8792ee1e22b60427', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '00a5583c7b7443e98e7a1d31a0b638dc', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=71938) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 24 16:29:48.188662 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54d29d9e-8f4f-4c6b-958d-429d82e8840d admin admin] REQUEST_METHOD: `GET` {{(pid=71938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 24 16:29:48.189002 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54d29d9e-8f4f-4c6b-958d-429d82e8840d admin admin] SCRIPT_NAME: `/identity` {{(pid=71938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 24 16:29:48.189336 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54d29d9e-8f4f-4c6b-958d-429d82e8840d admin admin] PATH_INFO: `/v3/roles` {{(pid=71938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 24 16:29:48.190773 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54d29d9e-8f4f-4c6b-958d-429d82e8840d admin admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=71938) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:161}} Nov 24 16:29:48.191382 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54d29d9e-8f4f-4c6b-958d-429d82e8840d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=71938) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:442}} Nov 24 16:29:48.219495 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54d29d9e-8f4f-4c6b-958d-429d82e8840d admin admin] RBAC: Authorization granted {{(pid=71938) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 24 16:29:48.228735 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: [pid: 71938|app: 0|req: 74/147] 10.222.0.53 () {56 vars in 1123 bytes} [Wed Nov 24 16:29:48 2021] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 55 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 24 16:29:48.234786 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5929a1f4-cf0e-4814-9235-a3ae27fc4032 admin admin] Authenticating user token {{(pid=71939) process_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 24 16:29:48.245678 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5929a1f4-cf0e-4814-9235-a3ae27fc4032 admin admin] Validating token access rules against request {{(pid=71939) validate_allowed_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 24 16:29:48.250111 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4056a6ca-8c7b-4fe1-9462-f2bd0947684a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f2ba2e8375b4e8c8792ee1e22b60427', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '00a5583c7b7443e98e7a1d31a0b638dc', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=71939) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 24 16:29:48.250993 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4056a6ca-8c7b-4fe1-9462-f2bd0947684a admin admin] REQUEST_METHOD: `GET` {{(pid=71939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 24 16:29:48.251331 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4056a6ca-8c7b-4fe1-9462-f2bd0947684a admin admin] SCRIPT_NAME: `/identity` {{(pid=71939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 24 16:29:48.251664 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4056a6ca-8c7b-4fe1-9462-f2bd0947684a admin admin] PATH_INFO: `/v3/users/a38b605a5d8b4fd286a841b891d7b4c4` {{(pid=71939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 24 16:29:48.253454 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4056a6ca-8c7b-4fe1-9462-f2bd0947684a admin admin] RBAC: Authorizing `identity:get_user(user_id=a38b605a5d8b4fd286a841b891d7b4c4)` {{(pid=71939) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:442}} Nov 24 16:29:48.281819 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4056a6ca-8c7b-4fe1-9462-f2bd0947684a admin admin] RBAC: Authorization granted {{(pid=71939) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 24 16:29:48.283474 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: [pid: 71939|app: 0|req: 74/148] 10.222.0.53 () {56 vars in 1189 bytes} [Wed Nov 24 16:29:48 2021] GET /identity/v3/users/a38b605a5d8b4fd286a841b891d7b4c4 => generated 275 bytes in 49 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 24 16:29:48.289897 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54d29d9e-8f4f-4c6b-958d-429d82e8840d admin admin] Authenticating user token {{(pid=71938) process_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 24 16:29:48.300405 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54d29d9e-8f4f-4c6b-958d-429d82e8840d admin admin] Validating token access rules against request {{(pid=71938) validate_allowed_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 24 16:29:48.304836 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a68e13b-7388-4946-baa8-f6656f91a86f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f2ba2e8375b4e8c8792ee1e22b60427', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '00a5583c7b7443e98e7a1d31a0b638dc', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=71938) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 24 16:29:48.305481 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a68e13b-7388-4946-baa8-f6656f91a86f admin admin] REQUEST_METHOD: `GET` {{(pid=71938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 24 16:29:48.305822 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a68e13b-7388-4946-baa8-f6656f91a86f admin admin] SCRIPT_NAME: `/identity` {{(pid=71938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 24 16:29:48.306185 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a68e13b-7388-4946-baa8-f6656f91a86f admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=71938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 24 16:29:48.314321 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a68e13b-7388-4946-baa8-f6656f91a86f admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=71938) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:442}} Nov 24 16:29:48.343408 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a68e13b-7388-4946-baa8-f6656f91a86f admin admin] RBAC: Authorization granted {{(pid=71938) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 24 16:29:48.354101 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: [pid: 71938|app: 0|req: 75/149] 10.222.0.53 () {58 vars in 1315 bytes} [Wed Nov 24 16:29:48 2021] GET /identity/v3/auth/tokens => generated 1067 bytes in 65 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 24 16:29:48.360199 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4056a6ca-8c7b-4fe1-9462-f2bd0947684a admin admin] Authenticating user token {{(pid=71939) process_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 24 16:29:48.371060 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4056a6ca-8c7b-4fe1-9462-f2bd0947684a admin admin] Validating token access rules against request {{(pid=71939) validate_allowed_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 24 16:29:48.375358 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a650604-c2ea-40bd-bdef-8c9936162432 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f2ba2e8375b4e8c8792ee1e22b60427', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '00a5583c7b7443e98e7a1d31a0b638dc', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=71939) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 24 16:29:48.376230 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a650604-c2ea-40bd-bdef-8c9936162432 admin admin] REQUEST_METHOD: `GET` {{(pid=71939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 24 16:29:48.376573 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a650604-c2ea-40bd-bdef-8c9936162432 admin admin] SCRIPT_NAME: `/identity` {{(pid=71939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 24 16:29:48.376910 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a650604-c2ea-40bd-bdef-8c9936162432 admin admin] PATH_INFO: `/v3/projects/6a75e77ca1684c808c57b448b83e73d2` {{(pid=71939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 24 16:29:48.378207 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a650604-c2ea-40bd-bdef-8c9936162432 admin admin] RBAC: Authorizing `identity:get_project(project_id=6a75e77ca1684c808c57b448b83e73d2)` {{(pid=71939) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:442}} Nov 24 16:29:48.414118 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a650604-c2ea-40bd-bdef-8c9936162432 admin admin] RBAC: Authorization granted {{(pid=71939) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 24 16:29:48.415910 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: [pid: 71939|app: 0|req: 75/150] 10.222.0.53 () {56 vars in 1198 bytes} [Wed Nov 24 16:29:48 2021] GET /identity/v3/projects/6a75e77ca1684c808c57b448b83e73d2 => generated 298 bytes in 56 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 24 16:29:48.422591 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a68e13b-7388-4946-baa8-f6656f91a86f admin admin] Authenticating user token {{(pid=71938) process_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 24 16:29:48.432409 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a68e13b-7388-4946-baa8-f6656f91a86f admin admin] Validating token access rules against request {{(pid=71938) validate_allowed_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 24 16:29:48.436641 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6acc356d-a83a-49c6-bb1f-03ad0056b4c6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f2ba2e8375b4e8c8792ee1e22b60427', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '00a5583c7b7443e98e7a1d31a0b638dc', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=71938) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 24 16:29:48.437300 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6acc356d-a83a-49c6-bb1f-03ad0056b4c6 admin admin] REQUEST_METHOD: `GET` {{(pid=71938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 24 16:29:48.437628 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6acc356d-a83a-49c6-bb1f-03ad0056b4c6 admin admin] SCRIPT_NAME: `/identity` {{(pid=71938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 24 16:29:48.438253 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6acc356d-a83a-49c6-bb1f-03ad0056b4c6 admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=71938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 24 16:29:48.439145 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6acc356d-a83a-49c6-bb1f-03ad0056b4c6 admin admin] RBAC: Adding query filter params (role.id=0de27ef8b6e744cda429a0d133117dcd, scope.project.id=6a75e77ca1684c808c57b448b83e73d2, user.id=a38b605a5d8b4fd286a841b891d7b4c4) {{(pid=71938) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:161}} Nov 24 16:29:48.439506 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6acc356d-a83a-49c6-bb1f-03ad0056b4c6 admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=71938) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:442}} Nov 24 16:29:48.468203 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6acc356d-a83a-49c6-bb1f-03ad0056b4c6 admin admin] RBAC: Authorization granted {{(pid=71938) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 24 16:29:48.475385 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: [pid: 71938|app: 0|req: 76/151] 10.222.0.53 () {56 vars in 1386 bytes} [Wed Nov 24 16:29:48 2021] GET /identity/v3/role_assignments?user.id=a38b605a5d8b4fd286a841b891d7b4c4&scope.project.id=6a75e77ca1684c808c57b448b83e73d2&role.id=0de27ef8b6e744cda429a0d133117dcd => generated 608 bytes in 53 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 24 16:29:50.533285 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f9569f6-f469-451a-b6f6-a6a4a55a0137 None None] REQUEST_METHOD: `GET` {{(pid=71939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 24 16:29:50.533956 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f9569f6-f469-451a-b6f6-a6a4a55a0137 None None] SCRIPT_NAME: `/identity` {{(pid=71939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 24 16:29:50.533956 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f9569f6-f469-451a-b6f6-a6a4a55a0137 None None] PATH_INFO: `/` {{(pid=71939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 24 16:29:50.535731 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: [pid: 71939|app: 0|req: 76/152] 10.222.0.53 () {54 vars in 915 bytes} [Wed Nov 24 16:29:50 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 24 16:29:50.541298 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7fbb4d6-d801-494f-969a-1da7e5f5b5b9 None None] REQUEST_METHOD: `POST` {{(pid=71938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 24 16:29:50.541645 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7fbb4d6-d801-494f-969a-1da7e5f5b5b9 None None] SCRIPT_NAME: `/identity` {{(pid=71938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 24 16:29:50.541981 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7fbb4d6-d801-494f-969a-1da7e5f5b5b9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=71938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 24 16:29:50.565920 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.auth.core [None req-f7fbb4d6-d801-494f-969a-1da7e5f5b5b9 None None] MFA Rules not processed for user `0f2ba2e8375b4e8c8792ee1e22b60427`. Rule list: `[]` (Enabled: `True`). {{(pid=71938) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:442}} Nov 24 16:29:50.567170 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.fernet_utils [None req-f7fbb4d6-d801-494f-969a-1da7e5f5b5b9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=71938) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:289}} Nov 24 16:29:50.574258 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: [pid: 71938|app: 0|req: 77/153] 10.222.0.53 () {58 vars in 1013 bytes} [Wed Nov 24 16:29:50 2021] POST /identity/v3/auth/tokens => generated 1067 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 24 16:29:50.599258 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de15876d-3497-42e7-bf21-e68bce21c2cb None None] REQUEST_METHOD: `POST` {{(pid=71939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 24 16:29:50.599602 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de15876d-3497-42e7-bf21-e68bce21c2cb None None] SCRIPT_NAME: `/identity` {{(pid=71939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 24 16:29:50.599984 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de15876d-3497-42e7-bf21-e68bce21c2cb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=71939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 24 16:29:50.623237 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.auth.core [None req-de15876d-3497-42e7-bf21-e68bce21c2cb None None] MFA Rules not processed for user `0f2ba2e8375b4e8c8792ee1e22b60427`. Rule list: `[]` (Enabled: `True`). {{(pid=71939) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:442}} Nov 24 16:29:50.624455 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.fernet_utils [None req-de15876d-3497-42e7-bf21-e68bce21c2cb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=71939) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:289}} Nov 24 16:29:50.632047 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: [pid: 71939|app: 0|req: 77/154] 10.222.0.53 () {58 vars in 1013 bytes} [Wed Nov 24 16:29:50 2021] POST /identity/v3/auth/tokens => generated 1067 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 24 16:29:50.637779 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7fbb4d6-d801-494f-969a-1da7e5f5b5b9 None None] Authenticating user token {{(pid=71938) process_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 24 16:29:50.648017 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7fbb4d6-d801-494f-969a-1da7e5f5b5b9 None None] Validating token access rules against request {{(pid=71938) validate_allowed_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 24 16:29:50.652183 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a9a4b67-d98d-4c8f-a76b-928b46478295 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f2ba2e8375b4e8c8792ee1e22b60427', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '00a5583c7b7443e98e7a1d31a0b638dc', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=71938) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 24 16:29:50.652993 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a9a4b67-d98d-4c8f-a76b-928b46478295 admin admin] REQUEST_METHOD: `GET` {{(pid=71938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 24 16:29:50.653330 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a9a4b67-d98d-4c8f-a76b-928b46478295 admin admin] SCRIPT_NAME: `/identity` {{(pid=71938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 24 16:29:50.653663 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a9a4b67-d98d-4c8f-a76b-928b46478295 admin admin] PATH_INFO: `/v3/roles/member` {{(pid=71938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 24 16:29:50.665428 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a9a4b67-d98d-4c8f-a76b-928b46478295 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=71938) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:401}} Nov 24 16:29:50.672794 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: WARNING keystone.server.flask.application [None req-1a9a4b67-d98d-4c8f-a76b-928b46478295 admin admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Nov 24 16:29:50.673969 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: [pid: 71938|app: 0|req: 78/155] 10.222.0.53 () {56 vars in 1111 bytes} [Wed Nov 24 16:29:50 2021] GET /identity/v3/roles/member => generated 84 bytes in 37 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 24 16:29:50.682227 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de15876d-3497-42e7-bf21-e68bce21c2cb None None] Authenticating user token {{(pid=71939) process_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 24 16:29:50.691811 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de15876d-3497-42e7-bf21-e68bce21c2cb None None] Validating token access rules against request {{(pid=71939) validate_allowed_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 24 16:29:50.695999 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-480b4c33-b204-4638-a571-1662dd357e28 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f2ba2e8375b4e8c8792ee1e22b60427', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '00a5583c7b7443e98e7a1d31a0b638dc', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=71939) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 24 16:29:50.696665 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-480b4c33-b204-4638-a571-1662dd357e28 admin admin] REQUEST_METHOD: `GET` {{(pid=71939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 24 16:29:50.697000 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-480b4c33-b204-4638-a571-1662dd357e28 admin admin] SCRIPT_NAME: `/identity` {{(pid=71939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 24 16:29:50.697329 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-480b4c33-b204-4638-a571-1662dd357e28 admin admin] PATH_INFO: `/v3/roles` {{(pid=71939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 24 16:29:50.698162 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-480b4c33-b204-4638-a571-1662dd357e28 admin admin] RBAC: Adding query filter params (name=member) {{(pid=71939) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:161}} Nov 24 16:29:50.698509 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-480b4c33-b204-4638-a571-1662dd357e28 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=71939) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:442}} Nov 24 16:29:50.727138 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-480b4c33-b204-4638-a571-1662dd357e28 admin admin] RBAC: Authorization granted {{(pid=71939) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 24 16:29:50.736218 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: [pid: 71939|app: 0|req: 78/156] 10.222.0.53 () {56 vars in 1113 bytes} [Wed Nov 24 16:29:50 2021] GET /identity/v3/roles?name=member => generated 341 bytes in 55 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 24 16:29:50.742091 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a9a4b67-d98d-4c8f-a76b-928b46478295 admin admin] Authenticating user token {{(pid=71938) process_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 24 16:29:50.752977 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a9a4b67-d98d-4c8f-a76b-928b46478295 admin admin] Validating token access rules against request {{(pid=71938) validate_allowed_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 24 16:29:50.757218 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fec782c0-8a20-4f1a-bc35-54e8279b1bbe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f2ba2e8375b4e8c8792ee1e22b60427', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '00a5583c7b7443e98e7a1d31a0b638dc', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=71938) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 24 16:29:50.758123 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fec782c0-8a20-4f1a-bc35-54e8279b1bbe admin admin] REQUEST_METHOD: `GET` {{(pid=71938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 24 16:29:50.758466 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fec782c0-8a20-4f1a-bc35-54e8279b1bbe admin admin] SCRIPT_NAME: `/identity` {{(pid=71938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 24 16:29:50.758798 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fec782c0-8a20-4f1a-bc35-54e8279b1bbe admin admin] PATH_INFO: `/v3/users/a38b605a5d8b4fd286a841b891d7b4c4` {{(pid=71938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 24 16:29:50.760183 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fec782c0-8a20-4f1a-bc35-54e8279b1bbe admin admin] RBAC: Authorizing `identity:get_user(user_id=a38b605a5d8b4fd286a841b891d7b4c4)` {{(pid=71938) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:442}} Nov 24 16:29:50.789242 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fec782c0-8a20-4f1a-bc35-54e8279b1bbe admin admin] RBAC: Authorization granted {{(pid=71938) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 24 16:29:50.790816 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: [pid: 71938|app: 0|req: 79/157] 10.222.0.53 () {56 vars in 1189 bytes} [Wed Nov 24 16:29:50 2021] GET /identity/v3/users/a38b605a5d8b4fd286a841b891d7b4c4 => generated 275 bytes in 49 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 24 16:29:50.796568 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-480b4c33-b204-4638-a571-1662dd357e28 admin admin] Authenticating user token {{(pid=71939) process_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 24 16:29:50.806802 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-480b4c33-b204-4638-a571-1662dd357e28 admin admin] Validating token access rules against request {{(pid=71939) validate_allowed_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 24 16:29:50.811237 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f2f152c-80ef-48b4-8302-d0a50f6ea25a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f2ba2e8375b4e8c8792ee1e22b60427', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '00a5583c7b7443e98e7a1d31a0b638dc', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=71939) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 24 16:29:50.811867 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f2f152c-80ef-48b4-8302-d0a50f6ea25a admin admin] REQUEST_METHOD: `GET` {{(pid=71939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 24 16:29:50.812202 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f2f152c-80ef-48b4-8302-d0a50f6ea25a admin admin] SCRIPT_NAME: `/identity` {{(pid=71939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 24 16:29:50.812529 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f2f152c-80ef-48b4-8302-d0a50f6ea25a admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=71939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 24 16:29:50.821494 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f2f152c-80ef-48b4-8302-d0a50f6ea25a admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=71939) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:442}} Nov 24 16:29:50.850694 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f2f152c-80ef-48b4-8302-d0a50f6ea25a admin admin] RBAC: Authorization granted {{(pid=71939) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 24 16:29:50.859555 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: [pid: 71939|app: 0|req: 79/158] 10.222.0.53 () {58 vars in 1315 bytes} [Wed Nov 24 16:29:50 2021] GET /identity/v3/auth/tokens => generated 1067 bytes in 63 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 24 16:29:50.870364 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fec782c0-8a20-4f1a-bc35-54e8279b1bbe admin admin] Authenticating user token {{(pid=71938) process_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 24 16:29:50.890524 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fec782c0-8a20-4f1a-bc35-54e8279b1bbe admin admin] Validating token access rules against request {{(pid=71938) validate_allowed_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 24 16:29:50.895330 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b33811a-5091-4ea0-b28a-98716f0fe67f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f2ba2e8375b4e8c8792ee1e22b60427', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '00a5583c7b7443e98e7a1d31a0b638dc', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=71938) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 24 16:29:50.896199 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b33811a-5091-4ea0-b28a-98716f0fe67f admin admin] REQUEST_METHOD: `GET` {{(pid=71938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 24 16:29:50.896541 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b33811a-5091-4ea0-b28a-98716f0fe67f admin admin] SCRIPT_NAME: `/identity` {{(pid=71938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 24 16:29:50.896878 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b33811a-5091-4ea0-b28a-98716f0fe67f admin admin] PATH_INFO: `/v3/projects/d96b97f0d3f24f6d8a8cdbe939730585` {{(pid=71938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 24 16:29:50.898118 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b33811a-5091-4ea0-b28a-98716f0fe67f admin admin] RBAC: Authorizing `identity:get_project(project_id=d96b97f0d3f24f6d8a8cdbe939730585)` {{(pid=71938) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:442}} Nov 24 16:29:50.927223 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b33811a-5091-4ea0-b28a-98716f0fe67f admin admin] RBAC: Authorization granted {{(pid=71938) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 24 16:29:50.928994 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: [pid: 71938|app: 0|req: 80/159] 10.222.0.53 () {56 vars in 1198 bytes} [Wed Nov 24 16:29:50 2021] GET /identity/v3/projects/d96b97f0d3f24f6d8a8cdbe939730585 => generated 312 bytes in 60 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 24 16:29:50.935299 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f2f152c-80ef-48b4-8302-d0a50f6ea25a admin admin] Authenticating user token {{(pid=71939) process_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 24 16:29:50.944482 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f2f152c-80ef-48b4-8302-d0a50f6ea25a admin admin] Validating token access rules against request {{(pid=71939) validate_allowed_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 24 16:29:50.948677 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b112f1db-2e5c-4707-9484-14b5f7f646d7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f2ba2e8375b4e8c8792ee1e22b60427', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '00a5583c7b7443e98e7a1d31a0b638dc', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=71939) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 24 16:29:50.949325 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b112f1db-2e5c-4707-9484-14b5f7f646d7 admin admin] REQUEST_METHOD: `GET` {{(pid=71939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 24 16:29:50.949662 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b112f1db-2e5c-4707-9484-14b5f7f646d7 admin admin] SCRIPT_NAME: `/identity` {{(pid=71939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 24 16:29:50.949994 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b112f1db-2e5c-4707-9484-14b5f7f646d7 admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=71939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 24 16:29:50.950924 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b112f1db-2e5c-4707-9484-14b5f7f646d7 admin admin] RBAC: Adding query filter params (role.id=912ab5f10fa5477da74acf239f07604e, scope.project.id=d96b97f0d3f24f6d8a8cdbe939730585, user.id=a38b605a5d8b4fd286a841b891d7b4c4) {{(pid=71939) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:161}} Nov 24 16:29:50.951290 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b112f1db-2e5c-4707-9484-14b5f7f646d7 admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=71939) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:442}} Nov 24 16:29:50.981675 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b112f1db-2e5c-4707-9484-14b5f7f646d7 admin admin] RBAC: Authorization granted {{(pid=71939) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 24 16:29:50.987596 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: [pid: 71939|app: 0|req: 80/160] 10.222.0.53 () {56 vars in 1386 bytes} [Wed Nov 24 16:29:50 2021] GET /identity/v3/role_assignments?user.id=a38b605a5d8b4fd286a841b891d7b4c4&scope.project.id=d96b97f0d3f24f6d8a8cdbe939730585&role.id=912ab5f10fa5477da74acf239f07604e => generated 259 bytes in 53 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 24 16:29:52.979458 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b772236f-5717-49b1-86a1-0d6c7b621954 None None] REQUEST_METHOD: `GET` {{(pid=71938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 24 16:29:52.979979 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b772236f-5717-49b1-86a1-0d6c7b621954 None None] SCRIPT_NAME: `/identity` {{(pid=71938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 24 16:29:52.980081 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b772236f-5717-49b1-86a1-0d6c7b621954 None None] PATH_INFO: `/` {{(pid=71938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 24 16:29:52.981910 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: [pid: 71938|app: 0|req: 81/161] 10.222.0.53 () {54 vars in 915 bytes} [Wed Nov 24 16:29:52 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 24 16:29:52.988350 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5392ec85-0e29-45b5-8839-4dc4adf64916 None None] REQUEST_METHOD: `POST` {{(pid=71939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 24 16:29:52.988697 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5392ec85-0e29-45b5-8839-4dc4adf64916 None None] SCRIPT_NAME: `/identity` {{(pid=71939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 24 16:29:52.989036 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5392ec85-0e29-45b5-8839-4dc4adf64916 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=71939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 24 16:29:53.012877 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.auth.core [None req-5392ec85-0e29-45b5-8839-4dc4adf64916 None None] MFA Rules not processed for user `0f2ba2e8375b4e8c8792ee1e22b60427`. Rule list: `[]` (Enabled: `True`). {{(pid=71939) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:442}} Nov 24 16:29:53.014145 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.fernet_utils [None req-5392ec85-0e29-45b5-8839-4dc4adf64916 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=71939) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:289}} Nov 24 16:29:53.021771 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: [pid: 71939|app: 0|req: 81/162] 10.222.0.53 () {58 vars in 1013 bytes} [Wed Nov 24 16:29:52 2021] POST /identity/v3/auth/tokens => generated 1067 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 24 16:29:53.045163 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a224d5a-7df6-4f24-b5db-8cf243e41c7c None None] REQUEST_METHOD: `POST` {{(pid=71938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 24 16:29:53.045505 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a224d5a-7df6-4f24-b5db-8cf243e41c7c None None] SCRIPT_NAME: `/identity` {{(pid=71938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 24 16:29:53.045836 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a224d5a-7df6-4f24-b5db-8cf243e41c7c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=71938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 24 16:29:53.070694 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.auth.core [None req-7a224d5a-7df6-4f24-b5db-8cf243e41c7c None None] MFA Rules not processed for user `0f2ba2e8375b4e8c8792ee1e22b60427`. Rule list: `[]` (Enabled: `True`). {{(pid=71938) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:442}} Nov 24 16:29:53.071923 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.fernet_utils [None req-7a224d5a-7df6-4f24-b5db-8cf243e41c7c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=71938) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:289}} Nov 24 16:29:53.079368 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: [pid: 71938|app: 0|req: 82/163] 10.222.0.53 () {58 vars in 1013 bytes} [Wed Nov 24 16:29:53 2021] POST /identity/v3/auth/tokens => generated 1067 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 24 16:29:53.085330 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5392ec85-0e29-45b5-8839-4dc4adf64916 None None] Authenticating user token {{(pid=71939) process_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 24 16:29:53.095062 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5392ec85-0e29-45b5-8839-4dc4adf64916 None None] Validating token access rules against request {{(pid=71939) validate_allowed_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 24 16:29:53.100026 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3b7ed0e-cd43-410d-8a58-0f1c8eb328d9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f2ba2e8375b4e8c8792ee1e22b60427', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '00a5583c7b7443e98e7a1d31a0b638dc', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=71939) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 24 16:29:53.100852 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3b7ed0e-cd43-410d-8a58-0f1c8eb328d9 admin admin] REQUEST_METHOD: `GET` {{(pid=71939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 24 16:29:53.101263 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3b7ed0e-cd43-410d-8a58-0f1c8eb328d9 admin admin] SCRIPT_NAME: `/identity` {{(pid=71939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 24 16:29:53.101712 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3b7ed0e-cd43-410d-8a58-0f1c8eb328d9 admin admin] PATH_INFO: `/v3/roles/member` {{(pid=71939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 24 16:29:53.114601 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3b7ed0e-cd43-410d-8a58-0f1c8eb328d9 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=71939) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:401}} Nov 24 16:29:53.122294 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: WARNING keystone.server.flask.application [None req-b3b7ed0e-cd43-410d-8a58-0f1c8eb328d9 admin admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Nov 24 16:29:53.123527 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: [pid: 71939|app: 0|req: 82/164] 10.222.0.53 () {56 vars in 1111 bytes} [Wed Nov 24 16:29:53 2021] GET /identity/v3/roles/member => generated 84 bytes in 39 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 24 16:29:53.130422 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a224d5a-7df6-4f24-b5db-8cf243e41c7c None None] Authenticating user token {{(pid=71938) process_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 24 16:29:53.148550 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a224d5a-7df6-4f24-b5db-8cf243e41c7c None None] Validating token access rules against request {{(pid=71938) validate_allowed_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 24 16:29:53.153369 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-633f9dc9-9c50-49f3-a509-17ded8f75356 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f2ba2e8375b4e8c8792ee1e22b60427', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '00a5583c7b7443e98e7a1d31a0b638dc', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=71938) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 24 16:29:53.154060 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-633f9dc9-9c50-49f3-a509-17ded8f75356 admin admin] REQUEST_METHOD: `GET` {{(pid=71938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 24 16:29:53.154434 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-633f9dc9-9c50-49f3-a509-17ded8f75356 admin admin] SCRIPT_NAME: `/identity` {{(pid=71938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 24 16:29:53.154772 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-633f9dc9-9c50-49f3-a509-17ded8f75356 admin admin] PATH_INFO: `/v3/roles` {{(pid=71938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 24 16:29:53.155589 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-633f9dc9-9c50-49f3-a509-17ded8f75356 admin admin] RBAC: Adding query filter params (name=member) {{(pid=71938) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:161}} Nov 24 16:29:53.155945 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-633f9dc9-9c50-49f3-a509-17ded8f75356 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=71938) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:442}} Nov 24 16:29:53.185075 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-633f9dc9-9c50-49f3-a509-17ded8f75356 admin admin] RBAC: Authorization granted {{(pid=71938) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 24 16:29:53.194953 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: [pid: 71938|app: 0|req: 83/165] 10.222.0.53 () {56 vars in 1113 bytes} [Wed Nov 24 16:29:53 2021] GET /identity/v3/roles?name=member => generated 341 bytes in 65 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 24 16:29:53.201003 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3b7ed0e-cd43-410d-8a58-0f1c8eb328d9 admin admin] Authenticating user token {{(pid=71939) process_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 24 16:29:53.212422 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3b7ed0e-cd43-410d-8a58-0f1c8eb328d9 admin admin] Validating token access rules against request {{(pid=71939) validate_allowed_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 24 16:29:53.216817 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c08ae364-129a-4550-b542-75ebdf349c02 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f2ba2e8375b4e8c8792ee1e22b60427', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '00a5583c7b7443e98e7a1d31a0b638dc', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=71939) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 24 16:29:53.217781 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c08ae364-129a-4550-b542-75ebdf349c02 admin admin] REQUEST_METHOD: `GET` {{(pid=71939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 24 16:29:53.218257 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c08ae364-129a-4550-b542-75ebdf349c02 admin admin] SCRIPT_NAME: `/identity` {{(pid=71939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 24 16:29:53.218624 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c08ae364-129a-4550-b542-75ebdf349c02 admin admin] PATH_INFO: `/v3/users/a38b605a5d8b4fd286a841b891d7b4c4` {{(pid=71939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 24 16:29:53.219808 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c08ae364-129a-4550-b542-75ebdf349c02 admin admin] RBAC: Authorizing `identity:get_user(user_id=a38b605a5d8b4fd286a841b891d7b4c4)` {{(pid=71939) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:442}} Nov 24 16:29:53.248928 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c08ae364-129a-4550-b542-75ebdf349c02 admin admin] RBAC: Authorization granted {{(pid=71939) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 24 16:29:53.250543 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: [pid: 71939|app: 0|req: 83/166] 10.222.0.53 () {56 vars in 1189 bytes} [Wed Nov 24 16:29:53 2021] GET /identity/v3/users/a38b605a5d8b4fd286a841b891d7b4c4 => generated 275 bytes in 50 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 24 16:29:53.256537 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-633f9dc9-9c50-49f3-a509-17ded8f75356 admin admin] Authenticating user token {{(pid=71938) process_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 24 16:29:53.266587 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-633f9dc9-9c50-49f3-a509-17ded8f75356 admin admin] Validating token access rules against request {{(pid=71938) validate_allowed_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 24 16:29:53.272478 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18e85e02-613a-4e26-abd8-0e5060ace78d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f2ba2e8375b4e8c8792ee1e22b60427', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '00a5583c7b7443e98e7a1d31a0b638dc', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=71938) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 24 16:29:53.273358 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18e85e02-613a-4e26-abd8-0e5060ace78d admin admin] REQUEST_METHOD: `GET` {{(pid=71938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 24 16:29:53.273699 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18e85e02-613a-4e26-abd8-0e5060ace78d admin admin] SCRIPT_NAME: `/identity` {{(pid=71938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 24 16:29:53.274065 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18e85e02-613a-4e26-abd8-0e5060ace78d admin admin] PATH_INFO: `/v3/projects/d96b97f0d3f24f6d8a8cdbe939730585` {{(pid=71938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 24 16:29:53.275335 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18e85e02-613a-4e26-abd8-0e5060ace78d admin admin] RBAC: Authorizing `identity:get_project(project_id=d96b97f0d3f24f6d8a8cdbe939730585)` {{(pid=71938) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:442}} Nov 24 16:29:53.304311 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18e85e02-613a-4e26-abd8-0e5060ace78d admin admin] RBAC: Authorization granted {{(pid=71938) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 24 16:29:53.306060 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: [pid: 71938|app: 0|req: 84/167] 10.222.0.53 () {56 vars in 1198 bytes} [Wed Nov 24 16:29:53 2021] GET /identity/v3/projects/d96b97f0d3f24f6d8a8cdbe939730585 => generated 312 bytes in 50 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 24 16:29:53.312394 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c08ae364-129a-4550-b542-75ebdf349c02 admin admin] Authenticating user token {{(pid=71939) process_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 24 16:29:53.322645 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c08ae364-129a-4550-b542-75ebdf349c02 admin admin] Validating token access rules against request {{(pid=71939) validate_allowed_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 24 16:29:53.326877 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbdfcbfe-efd5-4ffc-812c-a8fd95ef034d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f2ba2e8375b4e8c8792ee1e22b60427', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '00a5583c7b7443e98e7a1d31a0b638dc', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=71939) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 24 16:29:53.328319 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbdfcbfe-efd5-4ffc-812c-a8fd95ef034d admin admin] REQUEST_METHOD: `PUT` {{(pid=71939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 24 16:29:53.328667 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbdfcbfe-efd5-4ffc-812c-a8fd95ef034d admin admin] SCRIPT_NAME: `/identity` {{(pid=71939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 24 16:29:53.329272 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbdfcbfe-efd5-4ffc-812c-a8fd95ef034d admin admin] PATH_INFO: `/v3/projects/d96b97f0d3f24f6d8a8cdbe939730585/users/a38b605a5d8b4fd286a841b891d7b4c4/roles/912ab5f10fa5477da74acf239f07604e` {{(pid=71939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 24 16:29:53.331811 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbdfcbfe-efd5-4ffc-812c-a8fd95ef034d admin admin] RBAC: Authorizing `identity:create_grant(project_id=d96b97f0d3f24f6d8a8cdbe939730585, user_id=a38b605a5d8b4fd286a841b891d7b4c4, role_id=912ab5f10fa5477da74acf239f07604e)` {{(pid=71939) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:442}} Nov 24 16:29:53.362547 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbdfcbfe-efd5-4ffc-812c-a8fd95ef034d admin admin] RBAC: Authorization granted {{(pid=71939) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 24 16:29:53.374224 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: [pid: 71939|app: 0|req: 84/168] 10.222.0.53 () {58 vars in 1451 bytes} [Wed Nov 24 16:29:53 2021] PUT /identity/v3/projects/d96b97f0d3f24f6d8a8cdbe939730585/users/a38b605a5d8b4fd286a841b891d7b4c4/roles/912ab5f10fa5477da74acf239f07604e => generated 0 bytes in 62 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 24 16:29:55.395997 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b496b90b-b2d8-4ac4-b4a8-04bcd4ad85b0 None None] REQUEST_METHOD: `GET` {{(pid=71938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 24 16:29:55.396508 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b496b90b-b2d8-4ac4-b4a8-04bcd4ad85b0 None None] SCRIPT_NAME: `/identity` {{(pid=71938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 24 16:29:55.396659 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b496b90b-b2d8-4ac4-b4a8-04bcd4ad85b0 None None] PATH_INFO: `/` {{(pid=71938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 24 16:29:55.398526 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: [pid: 71938|app: 0|req: 85/169] 10.222.0.53 () {54 vars in 915 bytes} [Wed Nov 24 16:29:55 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 24 16:29:55.404113 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01785294-fc4e-44e6-9137-dd31442ed33a None None] REQUEST_METHOD: `POST` {{(pid=71939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 24 16:29:55.404469 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01785294-fc4e-44e6-9137-dd31442ed33a None None] SCRIPT_NAME: `/identity` {{(pid=71939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 24 16:29:55.404808 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01785294-fc4e-44e6-9137-dd31442ed33a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=71939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 24 16:29:55.429511 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.auth.core [None req-01785294-fc4e-44e6-9137-dd31442ed33a None None] MFA Rules not processed for user `0f2ba2e8375b4e8c8792ee1e22b60427`. Rule list: `[]` (Enabled: `True`). {{(pid=71939) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:442}} Nov 24 16:29:55.430762 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.fernet_utils [None req-01785294-fc4e-44e6-9137-dd31442ed33a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=71939) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:289}} Nov 24 16:29:55.500731 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: [pid: 71939|app: 0|req: 85/170] 10.222.0.53 () {58 vars in 1013 bytes} [Wed Nov 24 16:29:55 2021] POST /identity/v3/auth/tokens => generated 1067 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 24 16:29:55.525480 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4aaebe4e-2b04-4e03-a9a7-781ed809f915 None None] REQUEST_METHOD: `POST` {{(pid=71938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 24 16:29:55.525961 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4aaebe4e-2b04-4e03-a9a7-781ed809f915 None None] SCRIPT_NAME: `/identity` {{(pid=71938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 24 16:29:55.526345 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4aaebe4e-2b04-4e03-a9a7-781ed809f915 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=71938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 24 16:29:55.551838 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.auth.core [None req-4aaebe4e-2b04-4e03-a9a7-781ed809f915 None None] MFA Rules not processed for user `0f2ba2e8375b4e8c8792ee1e22b60427`. Rule list: `[]` (Enabled: `True`). {{(pid=71938) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:442}} Nov 24 16:29:55.553186 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.fernet_utils [None req-4aaebe4e-2b04-4e03-a9a7-781ed809f915 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=71938) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:289}} Nov 24 16:29:55.561323 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: [pid: 71938|app: 0|req: 86/171] 10.222.0.53 () {58 vars in 1013 bytes} [Wed Nov 24 16:29:55 2021] POST /identity/v3/auth/tokens => generated 1067 bytes in 37 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 24 16:29:55.568205 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01785294-fc4e-44e6-9137-dd31442ed33a None None] Authenticating user token {{(pid=71939) process_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 24 16:29:55.578173 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01785294-fc4e-44e6-9137-dd31442ed33a None None] Validating token access rules against request {{(pid=71939) validate_allowed_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 24 16:29:55.583324 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47cbe99b-c516-49f9-83fd-d20f1e5a70e6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f2ba2e8375b4e8c8792ee1e22b60427', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '00a5583c7b7443e98e7a1d31a0b638dc', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=71939) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 24 16:29:55.584137 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47cbe99b-c516-49f9-83fd-d20f1e5a70e6 admin admin] REQUEST_METHOD: `GET` {{(pid=71939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 24 16:29:55.584509 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47cbe99b-c516-49f9-83fd-d20f1e5a70e6 admin admin] SCRIPT_NAME: `/identity` {{(pid=71939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 24 16:29:55.584889 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47cbe99b-c516-49f9-83fd-d20f1e5a70e6 admin admin] PATH_INFO: `/v3/roles/member` {{(pid=71939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 24 16:29:55.597916 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47cbe99b-c516-49f9-83fd-d20f1e5a70e6 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=71939) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:401}} Nov 24 16:29:55.605760 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: WARNING keystone.server.flask.application [None req-47cbe99b-c516-49f9-83fd-d20f1e5a70e6 admin admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Nov 24 16:29:55.607022 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: [pid: 71939|app: 0|req: 86/172] 10.222.0.53 () {56 vars in 1111 bytes} [Wed Nov 24 16:29:55 2021] GET /identity/v3/roles/member => generated 84 bytes in 39 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 24 16:29:55.613851 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4aaebe4e-2b04-4e03-a9a7-781ed809f915 None None] Authenticating user token {{(pid=71938) process_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 24 16:29:55.623445 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4aaebe4e-2b04-4e03-a9a7-781ed809f915 None None] Validating token access rules against request {{(pid=71938) validate_allowed_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 24 16:29:55.628216 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-437bb82f-4b88-4dd7-8dad-aa19af28b3e0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f2ba2e8375b4e8c8792ee1e22b60427', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '00a5583c7b7443e98e7a1d31a0b638dc', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=71938) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 24 16:29:55.628893 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-437bb82f-4b88-4dd7-8dad-aa19af28b3e0 admin admin] REQUEST_METHOD: `GET` {{(pid=71938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 24 16:29:55.629262 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-437bb82f-4b88-4dd7-8dad-aa19af28b3e0 admin admin] SCRIPT_NAME: `/identity` {{(pid=71938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 24 16:29:55.629598 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-437bb82f-4b88-4dd7-8dad-aa19af28b3e0 admin admin] PATH_INFO: `/v3/roles` {{(pid=71938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 24 16:29:55.630640 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-437bb82f-4b88-4dd7-8dad-aa19af28b3e0 admin admin] RBAC: Adding query filter params (name=member) {{(pid=71938) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:161}} Nov 24 16:29:55.630998 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-437bb82f-4b88-4dd7-8dad-aa19af28b3e0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=71938) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:442}} Nov 24 16:29:55.663892 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-437bb82f-4b88-4dd7-8dad-aa19af28b3e0 admin admin] RBAC: Authorization granted {{(pid=71938) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 24 16:29:55.675166 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: [pid: 71938|app: 0|req: 87/173] 10.222.0.53 () {56 vars in 1113 bytes} [Wed Nov 24 16:29:55 2021] GET /identity/v3/roles?name=member => generated 341 bytes in 62 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 24 16:29:55.681162 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47cbe99b-c516-49f9-83fd-d20f1e5a70e6 admin admin] Authenticating user token {{(pid=71939) process_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 24 16:29:55.773790 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47cbe99b-c516-49f9-83fd-d20f1e5a70e6 admin admin] Validating token access rules against request {{(pid=71939) validate_allowed_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 24 16:29:55.778396 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7f2d5ed-15bb-4160-a1ab-8ec4796f0453 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f2ba2e8375b4e8c8792ee1e22b60427', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '00a5583c7b7443e98e7a1d31a0b638dc', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=71939) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 24 16:29:55.779306 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7f2d5ed-15bb-4160-a1ab-8ec4796f0453 admin admin] REQUEST_METHOD: `GET` {{(pid=71939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 24 16:29:55.779652 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7f2d5ed-15bb-4160-a1ab-8ec4796f0453 admin admin] SCRIPT_NAME: `/identity` {{(pid=71939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 24 16:29:55.779986 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7f2d5ed-15bb-4160-a1ab-8ec4796f0453 admin admin] PATH_INFO: `/v3/users/a38b605a5d8b4fd286a841b891d7b4c4` {{(pid=71939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 24 16:29:55.781226 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7f2d5ed-15bb-4160-a1ab-8ec4796f0453 admin admin] RBAC: Authorizing `identity:get_user(user_id=a38b605a5d8b4fd286a841b891d7b4c4)` {{(pid=71939) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:442}} Nov 24 16:29:55.810018 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7f2d5ed-15bb-4160-a1ab-8ec4796f0453 admin admin] RBAC: Authorization granted {{(pid=71939) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 24 16:29:55.811806 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: [pid: 71939|app: 0|req: 87/174] 10.222.0.53 () {56 vars in 1189 bytes} [Wed Nov 24 16:29:55 2021] GET /identity/v3/users/a38b605a5d8b4fd286a841b891d7b4c4 => generated 275 bytes in 131 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 24 16:29:55.818410 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-437bb82f-4b88-4dd7-8dad-aa19af28b3e0 admin admin] Authenticating user token {{(pid=71938) process_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 24 16:29:55.828546 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-437bb82f-4b88-4dd7-8dad-aa19af28b3e0 admin admin] Validating token access rules against request {{(pid=71938) validate_allowed_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 24 16:29:55.833710 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-514a82b1-e625-489d-829f-04f9e9e8dbc4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f2ba2e8375b4e8c8792ee1e22b60427', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '00a5583c7b7443e98e7a1d31a0b638dc', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=71938) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 24 16:29:55.834429 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-514a82b1-e625-489d-829f-04f9e9e8dbc4 admin admin] REQUEST_METHOD: `GET` {{(pid=71938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 24 16:29:55.834774 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-514a82b1-e625-489d-829f-04f9e9e8dbc4 admin admin] SCRIPT_NAME: `/identity` {{(pid=71938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 24 16:29:55.835115 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-514a82b1-e625-489d-829f-04f9e9e8dbc4 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=71938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 24 16:29:55.844053 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-514a82b1-e625-489d-829f-04f9e9e8dbc4 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=71938) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:442}} Nov 24 16:29:55.872240 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-514a82b1-e625-489d-829f-04f9e9e8dbc4 admin admin] RBAC: Authorization granted {{(pid=71938) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 24 16:29:55.882581 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: [pid: 71938|app: 0|req: 88/175] 10.222.0.53 () {58 vars in 1315 bytes} [Wed Nov 24 16:29:55 2021] GET /identity/v3/auth/tokens => generated 1067 bytes in 65 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 24 16:29:55.888704 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7f2d5ed-15bb-4160-a1ab-8ec4796f0453 admin admin] Authenticating user token {{(pid=71939) process_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 24 16:29:55.899191 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7f2d5ed-15bb-4160-a1ab-8ec4796f0453 admin admin] Validating token access rules against request {{(pid=71939) validate_allowed_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 24 16:29:55.903401 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6189ab6b-f92e-4b83-98e0-a6944aa85c51 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f2ba2e8375b4e8c8792ee1e22b60427', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '00a5583c7b7443e98e7a1d31a0b638dc', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=71939) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 24 16:29:55.904275 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6189ab6b-f92e-4b83-98e0-a6944aa85c51 admin admin] REQUEST_METHOD: `GET` {{(pid=71939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 24 16:29:55.904617 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6189ab6b-f92e-4b83-98e0-a6944aa85c51 admin admin] SCRIPT_NAME: `/identity` {{(pid=71939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 24 16:29:55.904952 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6189ab6b-f92e-4b83-98e0-a6944aa85c51 admin admin] PATH_INFO: `/v3/projects/d96b97f0d3f24f6d8a8cdbe939730585` {{(pid=71939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 24 16:29:55.906180 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6189ab6b-f92e-4b83-98e0-a6944aa85c51 admin admin] RBAC: Authorizing `identity:get_project(project_id=d96b97f0d3f24f6d8a8cdbe939730585)` {{(pid=71939) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:442}} Nov 24 16:29:55.934595 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6189ab6b-f92e-4b83-98e0-a6944aa85c51 admin admin] RBAC: Authorization granted {{(pid=71939) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 24 16:29:55.936247 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: [pid: 71939|app: 0|req: 88/176] 10.222.0.53 () {56 vars in 1198 bytes} [Wed Nov 24 16:29:55 2021] GET /identity/v3/projects/d96b97f0d3f24f6d8a8cdbe939730585 => generated 312 bytes in 48 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 24 16:29:55.942831 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-514a82b1-e625-489d-829f-04f9e9e8dbc4 admin admin] Authenticating user token {{(pid=71938) process_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 24 16:29:55.952019 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-514a82b1-e625-489d-829f-04f9e9e8dbc4 admin admin] Validating token access rules against request {{(pid=71938) validate_allowed_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 24 16:29:55.957149 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4c3a0d6-125a-4803-86a5-38a614b7e6de admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f2ba2e8375b4e8c8792ee1e22b60427', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '00a5583c7b7443e98e7a1d31a0b638dc', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=71938) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 24 16:29:55.957802 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4c3a0d6-125a-4803-86a5-38a614b7e6de admin admin] REQUEST_METHOD: `GET` {{(pid=71938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 24 16:29:55.958169 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4c3a0d6-125a-4803-86a5-38a614b7e6de admin admin] SCRIPT_NAME: `/identity` {{(pid=71938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 24 16:29:55.958505 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4c3a0d6-125a-4803-86a5-38a614b7e6de admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=71938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 24 16:29:55.959395 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4c3a0d6-125a-4803-86a5-38a614b7e6de admin admin] RBAC: Adding query filter params (role.id=912ab5f10fa5477da74acf239f07604e, scope.project.id=d96b97f0d3f24f6d8a8cdbe939730585, user.id=a38b605a5d8b4fd286a841b891d7b4c4) {{(pid=71938) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:161}} Nov 24 16:29:55.959749 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4c3a0d6-125a-4803-86a5-38a614b7e6de admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=71938) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:442}} Nov 24 16:29:55.987832 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4c3a0d6-125a-4803-86a5-38a614b7e6de admin admin] RBAC: Authorization granted {{(pid=71938) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 24 16:29:55.994243 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: [pid: 71938|app: 0|req: 89/177] 10.222.0.53 () {56 vars in 1386 bytes} [Wed Nov 24 16:29:55 2021] GET /identity/v3/role_assignments?user.id=a38b605a5d8b4fd286a841b891d7b4c4&scope.project.id=d96b97f0d3f24f6d8a8cdbe939730585&role.id=912ab5f10fa5477da74acf239f07604e => generated 608 bytes in 52 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 24 16:29:58.008052 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6aae5c94-f3ba-4748-ba29-07b7a03efaee None None] REQUEST_METHOD: `GET` {{(pid=71939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 24 16:29:58.008703 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6aae5c94-f3ba-4748-ba29-07b7a03efaee None None] SCRIPT_NAME: `/identity` {{(pid=71939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 24 16:29:58.008703 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6aae5c94-f3ba-4748-ba29-07b7a03efaee None None] PATH_INFO: `/` {{(pid=71939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 24 16:29:58.010589 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: [pid: 71939|app: 0|req: 89/178] 10.222.0.53 () {54 vars in 915 bytes} [Wed Nov 24 16:29:58 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 24 16:29:58.016421 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-475a4902-3b38-449c-b511-4e8d78d58586 None None] REQUEST_METHOD: `POST` {{(pid=71938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 24 16:29:58.016773 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-475a4902-3b38-449c-b511-4e8d78d58586 None None] SCRIPT_NAME: `/identity` {{(pid=71938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 24 16:29:58.017113 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-475a4902-3b38-449c-b511-4e8d78d58586 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=71938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 24 16:29:58.041777 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.auth.core [None req-475a4902-3b38-449c-b511-4e8d78d58586 None None] MFA Rules not processed for user `0f2ba2e8375b4e8c8792ee1e22b60427`. Rule list: `[]` (Enabled: `True`). {{(pid=71938) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:442}} Nov 24 16:29:58.043091 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.fernet_utils [None req-475a4902-3b38-449c-b511-4e8d78d58586 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=71938) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:289}} Nov 24 16:29:58.051050 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: [pid: 71938|app: 0|req: 90/179] 10.222.0.53 () {58 vars in 1013 bytes} [Wed Nov 24 16:29:58 2021] POST /identity/v3/auth/tokens => generated 1067 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 24 16:29:58.074244 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ca6dace-1755-4096-a482-8a3d1a9c58a7 None None] REQUEST_METHOD: `POST` {{(pid=71939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 24 16:29:58.074628 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ca6dace-1755-4096-a482-8a3d1a9c58a7 None None] SCRIPT_NAME: `/identity` {{(pid=71939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 24 16:29:58.074993 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ca6dace-1755-4096-a482-8a3d1a9c58a7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=71939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 24 16:29:58.099655 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.auth.core [None req-6ca6dace-1755-4096-a482-8a3d1a9c58a7 None None] MFA Rules not processed for user `0f2ba2e8375b4e8c8792ee1e22b60427`. Rule list: `[]` (Enabled: `True`). {{(pid=71939) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:442}} Nov 24 16:29:58.100873 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.fernet_utils [None req-6ca6dace-1755-4096-a482-8a3d1a9c58a7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=71939) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:289}} Nov 24 16:29:58.108311 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: [pid: 71939|app: 0|req: 90/180] 10.222.0.53 () {58 vars in 1013 bytes} [Wed Nov 24 16:29:58 2021] POST /identity/v3/auth/tokens => generated 1067 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 24 16:29:58.121047 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-475a4902-3b38-449c-b511-4e8d78d58586 None None] Authenticating user token {{(pid=71938) process_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 24 16:29:58.131911 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-475a4902-3b38-449c-b511-4e8d78d58586 None None] Validating token access rules against request {{(pid=71938) validate_allowed_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 24 16:29:58.136236 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfe51165-63c0-4111-a3e5-13f45aa712ff admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f2ba2e8375b4e8c8792ee1e22b60427', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '00a5583c7b7443e98e7a1d31a0b638dc', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=71938) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 24 16:29:58.137056 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfe51165-63c0-4111-a3e5-13f45aa712ff admin admin] REQUEST_METHOD: `GET` {{(pid=71938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 24 16:29:58.137396 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfe51165-63c0-4111-a3e5-13f45aa712ff admin admin] SCRIPT_NAME: `/identity` {{(pid=71938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 24 16:29:58.137727 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfe51165-63c0-4111-a3e5-13f45aa712ff admin admin] PATH_INFO: `/v3/domains/default` {{(pid=71938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 24 16:29:58.138968 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfe51165-63c0-4111-a3e5-13f45aa712ff admin admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=71938) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:442}} Nov 24 16:29:58.168057 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfe51165-63c0-4111-a3e5-13f45aa712ff admin admin] RBAC: Authorization granted {{(pid=71938) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 24 16:29:58.169799 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: [pid: 71938|app: 0|req: 91/181] 10.222.0.53 () {56 vars in 1120 bytes} [Wed Nov 24 16:29:58 2021] GET /identity/v3/domains/default => generated 199 bytes in 50 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 24 16:29:58.176598 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ca6dace-1755-4096-a482-8a3d1a9c58a7 None None] Authenticating user token {{(pid=71939) process_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 24 16:29:58.185887 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ca6dace-1755-4096-a482-8a3d1a9c58a7 None None] Validating token access rules against request {{(pid=71939) validate_allowed_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 24 16:29:58.190163 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b61b9b6-4ead-487d-9307-2b6228ff58cc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f2ba2e8375b4e8c8792ee1e22b60427', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '00a5583c7b7443e98e7a1d31a0b638dc', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=71939) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 24 16:29:58.190825 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b61b9b6-4ead-487d-9307-2b6228ff58cc admin admin] REQUEST_METHOD: `POST` {{(pid=71939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 24 16:29:58.191165 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b61b9b6-4ead-487d-9307-2b6228ff58cc admin admin] SCRIPT_NAME: `/identity` {{(pid=71939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 24 16:29:58.191495 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b61b9b6-4ead-487d-9307-2b6228ff58cc admin admin] PATH_INFO: `/v3/projects` {{(pid=71939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 24 16:29:58.192236 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b61b9b6-4ead-487d-9307-2b6228ff58cc admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=71939) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:442}} Nov 24 16:29:58.220766 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b61b9b6-4ead-487d-9307-2b6228ff58cc admin admin] RBAC: Authorization granted {{(pid=71939) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 24 16:29:58.247542 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: [pid: 71939|app: 0|req: 91/182] 10.222.0.53 () {60 vars in 1152 bytes} [Wed Nov 24 16:29:58 2021] POST /identity/v3/projects => generated 302 bytes in 71 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 24 16:30:00.269232 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e505e14-824d-47a7-8336-93de6479a4e5 None None] REQUEST_METHOD: `GET` {{(pid=71938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 24 16:30:00.269782 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e505e14-824d-47a7-8336-93de6479a4e5 None None] SCRIPT_NAME: `/identity` {{(pid=71938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 24 16:30:00.269888 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e505e14-824d-47a7-8336-93de6479a4e5 None None] PATH_INFO: `/` {{(pid=71938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 24 16:30:00.271768 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: [pid: 71938|app: 0|req: 92/183] 10.222.0.53 () {54 vars in 915 bytes} [Wed Nov 24 16:30:00 2021] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 24 16:30:00.277919 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f753f44c-3df7-470f-8acc-ca24dca90398 None None] REQUEST_METHOD: `POST` {{(pid=71939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 24 16:30:00.279023 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f753f44c-3df7-470f-8acc-ca24dca90398 None None] SCRIPT_NAME: `/identity` {{(pid=71939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 24 16:30:00.279023 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f753f44c-3df7-470f-8acc-ca24dca90398 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=71939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 24 16:30:00.302679 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.auth.core [None req-f753f44c-3df7-470f-8acc-ca24dca90398 None None] MFA Rules not processed for user `0f2ba2e8375b4e8c8792ee1e22b60427`. Rule list: `[]` (Enabled: `True`). {{(pid=71939) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:442}} Nov 24 16:30:00.303914 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.fernet_utils [None req-f753f44c-3df7-470f-8acc-ca24dca90398 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=71939) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:289}} Nov 24 16:30:00.378406 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: [pid: 71939|app: 0|req: 92/184] 10.222.0.53 () {58 vars in 1013 bytes} [Wed Nov 24 16:30:00 2021] POST /identity/v3/auth/tokens => generated 1067 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 24 16:30:00.402548 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-998440be-a0b0-43c0-b59f-955c432f6c16 None None] REQUEST_METHOD: `POST` {{(pid=71938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 24 16:30:00.403039 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-998440be-a0b0-43c0-b59f-955c432f6c16 None None] SCRIPT_NAME: `/identity` {{(pid=71938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 24 16:30:00.403344 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-998440be-a0b0-43c0-b59f-955c432f6c16 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=71938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 24 16:30:00.427527 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.auth.core [None req-998440be-a0b0-43c0-b59f-955c432f6c16 None None] MFA Rules not processed for user `0f2ba2e8375b4e8c8792ee1e22b60427`. Rule list: `[]` (Enabled: `True`). {{(pid=71938) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:442}} Nov 24 16:30:00.428777 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.fernet_utils [None req-998440be-a0b0-43c0-b59f-955c432f6c16 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=71938) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:289}} Nov 24 16:30:00.436119 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: [pid: 71938|app: 0|req: 93/185] 10.222.0.53 () {58 vars in 1013 bytes} [Wed Nov 24 16:30:00 2021] POST /identity/v3/auth/tokens => generated 1067 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 24 16:30:00.442657 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f753f44c-3df7-470f-8acc-ca24dca90398 None None] Authenticating user token {{(pid=71939) process_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 24 16:30:00.452682 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f753f44c-3df7-470f-8acc-ca24dca90398 None None] Validating token access rules against request {{(pid=71939) validate_allowed_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 24 16:30:00.457932 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a38667ac-6d80-406b-9829-5f3b4015d73b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f2ba2e8375b4e8c8792ee1e22b60427', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '00a5583c7b7443e98e7a1d31a0b638dc', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=71939) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 24 16:30:00.458791 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a38667ac-6d80-406b-9829-5f3b4015d73b admin admin] REQUEST_METHOD: `GET` {{(pid=71939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 24 16:30:00.459133 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a38667ac-6d80-406b-9829-5f3b4015d73b admin admin] SCRIPT_NAME: `/identity` {{(pid=71939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 24 16:30:00.459470 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a38667ac-6d80-406b-9829-5f3b4015d73b admin admin] PATH_INFO: `/v3/domains/default` {{(pid=71939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 24 16:30:00.460677 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a38667ac-6d80-406b-9829-5f3b4015d73b admin admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=71939) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:442}} Nov 24 16:30:00.489128 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a38667ac-6d80-406b-9829-5f3b4015d73b admin admin] RBAC: Authorization granted {{(pid=71939) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 24 16:30:00.490811 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: [pid: 71939|app: 0|req: 93/186] 10.222.0.53 () {56 vars in 1120 bytes} [Wed Nov 24 16:30:00 2021] GET /identity/v3/domains/default => generated 199 bytes in 49 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 24 16:30:00.496726 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-998440be-a0b0-43c0-b59f-955c432f6c16 None None] Authenticating user token {{(pid=71938) process_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 24 16:30:00.506590 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-998440be-a0b0-43c0-b59f-955c432f6c16 None None] Validating token access rules against request {{(pid=71938) validate_allowed_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 24 16:30:00.510889 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e00d89e4-cbaf-4f03-84e2-3d66ca892020 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f2ba2e8375b4e8c8792ee1e22b60427', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '00a5583c7b7443e98e7a1d31a0b638dc', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=71938) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 24 16:30:00.511563 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e00d89e4-cbaf-4f03-84e2-3d66ca892020 admin admin] REQUEST_METHOD: `POST` {{(pid=71938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 24 16:30:00.511903 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e00d89e4-cbaf-4f03-84e2-3d66ca892020 admin admin] SCRIPT_NAME: `/identity` {{(pid=71938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 24 16:30:00.512235 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e00d89e4-cbaf-4f03-84e2-3d66ca892020 admin admin] PATH_INFO: `/v3/users` {{(pid=71938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 24 16:30:00.513002 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e00d89e4-cbaf-4f03-84e2-3d66ca892020 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=71938) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:442}} Nov 24 16:30:00.542315 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e00d89e4-cbaf-4f03-84e2-3d66ca892020 admin admin] RBAC: Authorization granted {{(pid=71938) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 24 16:30:00.560412 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: [pid: 71938|app: 0|req: 94/187] 10.222.0.53 () {60 vars in 1144 bytes} [Wed Nov 24 16:30:00 2021] POST /identity/v3/users => generated 283 bytes in 64 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 24 16:30:02.631486 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c1612f0-cdd8-48e8-bf4b-9a5d23e0f007 None None] REQUEST_METHOD: `GET` {{(pid=71939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 24 16:30:02.631974 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c1612f0-cdd8-48e8-bf4b-9a5d23e0f007 None None] SCRIPT_NAME: `/identity` {{(pid=71939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 24 16:30:02.632149 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c1612f0-cdd8-48e8-bf4b-9a5d23e0f007 None None] PATH_INFO: `/` {{(pid=71939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 24 16:30:02.633975 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: [pid: 71939|app: 0|req: 94/188] 10.222.0.53 () {54 vars in 915 bytes} [Wed Nov 24 16:30:02 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 24 16:30:02.639587 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f421d5c3-4d27-4980-9961-cca2be74d3f9 None None] REQUEST_METHOD: `POST` {{(pid=71938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 24 16:30:02.639942 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f421d5c3-4d27-4980-9961-cca2be74d3f9 None None] SCRIPT_NAME: `/identity` {{(pid=71938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 24 16:30:02.640275 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f421d5c3-4d27-4980-9961-cca2be74d3f9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=71938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 24 16:30:02.666675 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.auth.core [None req-f421d5c3-4d27-4980-9961-cca2be74d3f9 None None] MFA Rules not processed for user `0f2ba2e8375b4e8c8792ee1e22b60427`. Rule list: `[]` (Enabled: `True`). {{(pid=71938) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:442}} Nov 24 16:30:02.667891 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.fernet_utils [None req-f421d5c3-4d27-4980-9961-cca2be74d3f9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=71938) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:289}} Nov 24 16:30:02.676159 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: [pid: 71938|app: 0|req: 95/189] 10.222.0.53 () {58 vars in 1013 bytes} [Wed Nov 24 16:30:02 2021] POST /identity/v3/auth/tokens => generated 1067 bytes in 38 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 24 16:30:02.699277 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f325046d-5c57-4c55-995a-8820cb215914 None None] REQUEST_METHOD: `POST` {{(pid=71939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 24 16:30:02.699787 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f325046d-5c57-4c55-995a-8820cb215914 None None] SCRIPT_NAME: `/identity` {{(pid=71939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 24 16:30:02.700120 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f325046d-5c57-4c55-995a-8820cb215914 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=71939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 24 16:30:02.724750 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.auth.core [None req-f325046d-5c57-4c55-995a-8820cb215914 None None] MFA Rules not processed for user `0f2ba2e8375b4e8c8792ee1e22b60427`. Rule list: `[]` (Enabled: `True`). {{(pid=71939) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:442}} Nov 24 16:30:02.725993 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.fernet_utils [None req-f325046d-5c57-4c55-995a-8820cb215914 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=71939) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:289}} Nov 24 16:30:02.733369 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: [pid: 71939|app: 0|req: 95/190] 10.222.0.53 () {58 vars in 1013 bytes} [Wed Nov 24 16:30:02 2021] POST /identity/v3/auth/tokens => generated 1067 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 24 16:30:02.739882 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f421d5c3-4d27-4980-9961-cca2be74d3f9 None None] Authenticating user token {{(pid=71938) process_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 24 16:30:02.749768 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f421d5c3-4d27-4980-9961-cca2be74d3f9 None None] Validating token access rules against request {{(pid=71938) validate_allowed_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 24 16:30:02.754521 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99b1aacd-d3fd-410b-bd1e-26b33482d451 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f2ba2e8375b4e8c8792ee1e22b60427', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '00a5583c7b7443e98e7a1d31a0b638dc', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=71938) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 24 16:30:02.755371 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99b1aacd-d3fd-410b-bd1e-26b33482d451 admin admin] REQUEST_METHOD: `GET` {{(pid=71938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 24 16:30:02.755722 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99b1aacd-d3fd-410b-bd1e-26b33482d451 admin admin] SCRIPT_NAME: `/identity` {{(pid=71938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 24 16:30:02.755996 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99b1aacd-d3fd-410b-bd1e-26b33482d451 admin admin] PATH_INFO: `/v3/roles/member` {{(pid=71938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 24 16:30:02.768476 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99b1aacd-d3fd-410b-bd1e-26b33482d451 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=71938) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:401}} Nov 24 16:30:02.776223 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: WARNING keystone.server.flask.application [None req-99b1aacd-d3fd-410b-bd1e-26b33482d451 admin admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Nov 24 16:30:02.777451 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: [pid: 71938|app: 0|req: 96/191] 10.222.0.53 () {56 vars in 1111 bytes} [Wed Nov 24 16:30:02 2021] GET /identity/v3/roles/member => generated 84 bytes in 38 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Nov 24 16:30:02.784952 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f325046d-5c57-4c55-995a-8820cb215914 None None] Authenticating user token {{(pid=71939) process_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 24 16:30:02.794666 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f325046d-5c57-4c55-995a-8820cb215914 None None] Validating token access rules against request {{(pid=71939) validate_allowed_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 24 16:30:02.799935 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b18acd13-9728-4e40-97e9-254c6da8688d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f2ba2e8375b4e8c8792ee1e22b60427', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '00a5583c7b7443e98e7a1d31a0b638dc', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=71939) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 24 16:30:02.800703 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b18acd13-9728-4e40-97e9-254c6da8688d admin admin] REQUEST_METHOD: `GET` {{(pid=71939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 24 16:30:02.801045 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b18acd13-9728-4e40-97e9-254c6da8688d admin admin] SCRIPT_NAME: `/identity` {{(pid=71939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 24 16:30:02.801381 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b18acd13-9728-4e40-97e9-254c6da8688d admin admin] PATH_INFO: `/v3/roles` {{(pid=71939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 24 16:30:02.802276 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b18acd13-9728-4e40-97e9-254c6da8688d admin admin] RBAC: Adding query filter params (name=member) {{(pid=71939) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:161}} Nov 24 16:30:02.802711 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b18acd13-9728-4e40-97e9-254c6da8688d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=71939) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:442}} Nov 24 16:30:02.831978 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b18acd13-9728-4e40-97e9-254c6da8688d admin admin] RBAC: Authorization granted {{(pid=71939) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 24 16:30:02.841645 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: [pid: 71939|app: 0|req: 96/192] 10.222.0.53 () {56 vars in 1113 bytes} [Wed Nov 24 16:30:02 2021] GET /identity/v3/roles?name=member => generated 341 bytes in 57 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 24 16:30:02.848236 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99b1aacd-d3fd-410b-bd1e-26b33482d451 admin admin] Authenticating user token {{(pid=71938) process_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 24 16:30:02.939650 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99b1aacd-d3fd-410b-bd1e-26b33482d451 admin admin] Validating token access rules against request {{(pid=71938) validate_allowed_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 24 16:30:02.943986 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bde05c28-f4d1-483f-afb6-c6e546c27371 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f2ba2e8375b4e8c8792ee1e22b60427', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '00a5583c7b7443e98e7a1d31a0b638dc', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=71938) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 24 16:30:02.944868 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bde05c28-f4d1-483f-afb6-c6e546c27371 admin admin] REQUEST_METHOD: `GET` {{(pid=71938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 24 16:30:02.945205 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bde05c28-f4d1-483f-afb6-c6e546c27371 admin admin] SCRIPT_NAME: `/identity` {{(pid=71938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 24 16:30:02.945536 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bde05c28-f4d1-483f-afb6-c6e546c27371 admin admin] PATH_INFO: `/v3/users/00c86a8d8abf438f80ab7423cb0e9a4c` {{(pid=71938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 24 16:30:02.966153 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bde05c28-f4d1-483f-afb6-c6e546c27371 admin admin] RBAC: Authorizing `identity:get_user(user_id=00c86a8d8abf438f80ab7423cb0e9a4c)` {{(pid=71938) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:442}} Nov 24 16:30:02.995425 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bde05c28-f4d1-483f-afb6-c6e546c27371 admin admin] RBAC: Authorization granted {{(pid=71938) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 24 16:30:02.997134 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: [pid: 71938|app: 0|req: 97/193] 10.222.0.53 () {56 vars in 1189 bytes} [Wed Nov 24 16:30:02 2021] GET /identity/v3/users/00c86a8d8abf438f80ab7423cb0e9a4c => generated 283 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 24 16:30:03.003142 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b18acd13-9728-4e40-97e9-254c6da8688d admin admin] Authenticating user token {{(pid=71939) process_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 24 16:30:03.013210 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b18acd13-9728-4e40-97e9-254c6da8688d admin admin] Validating token access rules against request {{(pid=71939) validate_allowed_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 24 16:30:03.017457 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fe235a7-283c-4194-8146-5f59765d9343 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f2ba2e8375b4e8c8792ee1e22b60427', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '00a5583c7b7443e98e7a1d31a0b638dc', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=71939) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 24 16:30:03.018700 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fe235a7-283c-4194-8146-5f59765d9343 admin admin] REQUEST_METHOD: `GET` {{(pid=71939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 24 16:30:03.019356 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fe235a7-283c-4194-8146-5f59765d9343 admin admin] SCRIPT_NAME: `/identity` {{(pid=71939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 24 16:30:03.019356 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fe235a7-283c-4194-8146-5f59765d9343 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=71939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 24 16:30:03.028143 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fe235a7-283c-4194-8146-5f59765d9343 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=71939) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:442}} Nov 24 16:30:03.056795 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fe235a7-283c-4194-8146-5f59765d9343 admin admin] RBAC: Authorization granted {{(pid=71939) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 24 16:30:03.066460 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: [pid: 71939|app: 0|req: 97/194] 10.222.0.53 () {58 vars in 1315 bytes} [Wed Nov 24 16:30:03 2021] GET /identity/v3/auth/tokens => generated 1067 bytes in 64 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 24 16:30:03.072503 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bde05c28-f4d1-483f-afb6-c6e546c27371 admin admin] Authenticating user token {{(pid=71938) process_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 24 16:30:03.083214 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bde05c28-f4d1-483f-afb6-c6e546c27371 admin admin] Validating token access rules against request {{(pid=71938) validate_allowed_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 24 16:30:03.087532 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-487ab131-b7d9-4d08-bec5-5e853dbb2caa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f2ba2e8375b4e8c8792ee1e22b60427', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '00a5583c7b7443e98e7a1d31a0b638dc', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=71938) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 24 16:30:03.088411 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-487ab131-b7d9-4d08-bec5-5e853dbb2caa admin admin] REQUEST_METHOD: `GET` {{(pid=71938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 24 16:30:03.088750 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-487ab131-b7d9-4d08-bec5-5e853dbb2caa admin admin] SCRIPT_NAME: `/identity` {{(pid=71938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 24 16:30:03.089082 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-487ab131-b7d9-4d08-bec5-5e853dbb2caa admin admin] PATH_INFO: `/v3/projects/7cdfba1dd86043ea9b1cf6498535c213` {{(pid=71938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 24 16:30:03.090331 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-487ab131-b7d9-4d08-bec5-5e853dbb2caa admin admin] RBAC: Authorizing `identity:get_project(project_id=7cdfba1dd86043ea9b1cf6498535c213)` {{(pid=71938) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:442}} Nov 24 16:30:03.119474 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-487ab131-b7d9-4d08-bec5-5e853dbb2caa admin admin] RBAC: Authorization granted {{(pid=71938) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 24 16:30:03.121213 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: [pid: 71938|app: 0|req: 98/195] 10.222.0.53 () {56 vars in 1198 bytes} [Wed Nov 24 16:30:03 2021] GET /identity/v3/projects/7cdfba1dd86043ea9b1cf6498535c213 => generated 302 bytes in 49 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 24 16:30:03.127506 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fe235a7-283c-4194-8146-5f59765d9343 admin admin] Authenticating user token {{(pid=71939) process_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 24 16:30:03.136740 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fe235a7-283c-4194-8146-5f59765d9343 admin admin] Validating token access rules against request {{(pid=71939) validate_allowed_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 24 16:30:03.140962 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0bb50ee-3120-4a0e-a454-2c6e9cf29efc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f2ba2e8375b4e8c8792ee1e22b60427', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '00a5583c7b7443e98e7a1d31a0b638dc', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=71939) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 24 16:30:03.141619 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0bb50ee-3120-4a0e-a454-2c6e9cf29efc admin admin] REQUEST_METHOD: `GET` {{(pid=71939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 24 16:30:03.141956 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0bb50ee-3120-4a0e-a454-2c6e9cf29efc admin admin] SCRIPT_NAME: `/identity` {{(pid=71939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 24 16:30:03.142315 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0bb50ee-3120-4a0e-a454-2c6e9cf29efc admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=71939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 24 16:30:03.143718 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0bb50ee-3120-4a0e-a454-2c6e9cf29efc admin admin] RBAC: Adding query filter params (role.id=912ab5f10fa5477da74acf239f07604e, scope.project.id=7cdfba1dd86043ea9b1cf6498535c213, user.id=00c86a8d8abf438f80ab7423cb0e9a4c) {{(pid=71939) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:161}} Nov 24 16:30:03.144077 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0bb50ee-3120-4a0e-a454-2c6e9cf29efc admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=71939) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:442}} Nov 24 16:30:03.173020 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0bb50ee-3120-4a0e-a454-2c6e9cf29efc admin admin] RBAC: Authorization granted {{(pid=71939) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 24 16:30:03.179380 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: [pid: 71939|app: 0|req: 98/196] 10.222.0.53 () {56 vars in 1386 bytes} [Wed Nov 24 16:30:03 2021] GET /identity/v3/role_assignments?user.id=00c86a8d8abf438f80ab7423cb0e9a4c&scope.project.id=7cdfba1dd86043ea9b1cf6498535c213&role.id=912ab5f10fa5477da74acf239f07604e => generated 259 bytes in 52 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 24 16:30:05.162683 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-943d5ed3-e248-440a-a702-b920be2f21fd None None] REQUEST_METHOD: `GET` {{(pid=71938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 24 16:30:05.163225 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-943d5ed3-e248-440a-a702-b920be2f21fd None None] SCRIPT_NAME: `/identity` {{(pid=71938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 24 16:30:05.163319 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-943d5ed3-e248-440a-a702-b920be2f21fd None None] PATH_INFO: `/` {{(pid=71938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 24 16:30:05.165361 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: [pid: 71938|app: 0|req: 99/197] 10.222.0.53 () {54 vars in 915 bytes} [Wed Nov 24 16:30:05 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 24 16:30:05.171060 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9b0ab62-eb62-4822-aebb-7dd513d7276e None None] REQUEST_METHOD: `POST` {{(pid=71939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 24 16:30:05.171412 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9b0ab62-eb62-4822-aebb-7dd513d7276e None None] SCRIPT_NAME: `/identity` {{(pid=71939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 24 16:30:05.171752 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9b0ab62-eb62-4822-aebb-7dd513d7276e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=71939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 24 16:30:05.196826 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.auth.core [None req-d9b0ab62-eb62-4822-aebb-7dd513d7276e None None] MFA Rules not processed for user `0f2ba2e8375b4e8c8792ee1e22b60427`. Rule list: `[]` (Enabled: `True`). {{(pid=71939) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:442}} Nov 24 16:30:05.198058 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.fernet_utils [None req-d9b0ab62-eb62-4822-aebb-7dd513d7276e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=71939) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:289}} Nov 24 16:30:05.205747 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: [pid: 71939|app: 0|req: 99/198] 10.222.0.53 () {58 vars in 1013 bytes} [Wed Nov 24 16:30:05 2021] POST /identity/v3/auth/tokens => generated 1067 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 24 16:30:05.228108 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25173d1d-d113-4c61-8ca2-a185baac85e1 None None] REQUEST_METHOD: `POST` {{(pid=71938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 24 16:30:05.228457 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25173d1d-d113-4c61-8ca2-a185baac85e1 None None] SCRIPT_NAME: `/identity` {{(pid=71938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 24 16:30:05.228794 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25173d1d-d113-4c61-8ca2-a185baac85e1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=71938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 24 16:30:05.253328 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.auth.core [None req-25173d1d-d113-4c61-8ca2-a185baac85e1 None None] MFA Rules not processed for user `0f2ba2e8375b4e8c8792ee1e22b60427`. Rule list: `[]` (Enabled: `True`). {{(pid=71938) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:442}} Nov 24 16:30:05.254583 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.fernet_utils [None req-25173d1d-d113-4c61-8ca2-a185baac85e1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=71938) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:289}} Nov 24 16:30:05.261565 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: [pid: 71938|app: 0|req: 100/199] 10.222.0.53 () {58 vars in 1013 bytes} [Wed Nov 24 16:30:05 2021] POST /identity/v3/auth/tokens => generated 1067 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 24 16:30:05.269728 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9b0ab62-eb62-4822-aebb-7dd513d7276e None None] Authenticating user token {{(pid=71939) process_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 24 16:30:05.279891 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9b0ab62-eb62-4822-aebb-7dd513d7276e None None] Validating token access rules against request {{(pid=71939) validate_allowed_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 24 16:30:05.284164 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f7d1e2f-749f-4208-9fa4-b4a68652a74a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f2ba2e8375b4e8c8792ee1e22b60427', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '00a5583c7b7443e98e7a1d31a0b638dc', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=71939) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 24 16:30:05.284987 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f7d1e2f-749f-4208-9fa4-b4a68652a74a admin admin] REQUEST_METHOD: `GET` {{(pid=71939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 24 16:30:05.285331 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f7d1e2f-749f-4208-9fa4-b4a68652a74a admin admin] SCRIPT_NAME: `/identity` {{(pid=71939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 24 16:30:05.285674 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f7d1e2f-749f-4208-9fa4-b4a68652a74a admin admin] PATH_INFO: `/v3/roles/member` {{(pid=71939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 24 16:30:05.298366 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f7d1e2f-749f-4208-9fa4-b4a68652a74a admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=71939) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:401}} Nov 24 16:30:05.306378 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: WARNING keystone.server.flask.application [None req-4f7d1e2f-749f-4208-9fa4-b4a68652a74a admin admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Nov 24 16:30:05.307617 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: [pid: 71939|app: 0|req: 100/200] 10.222.0.53 () {56 vars in 1111 bytes} [Wed Nov 24 16:30:05 2021] GET /identity/v3/roles/member => generated 84 bytes in 39 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 24 16:30:05.315238 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25173d1d-d113-4c61-8ca2-a185baac85e1 None None] Authenticating user token {{(pid=71938) process_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 24 16:30:05.324512 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25173d1d-d113-4c61-8ca2-a185baac85e1 None None] Validating token access rules against request {{(pid=71938) validate_allowed_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 24 16:30:05.329601 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29b631ef-3090-4ab0-a08f-eab7454fcbb9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f2ba2e8375b4e8c8792ee1e22b60427', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '00a5583c7b7443e98e7a1d31a0b638dc', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=71938) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 24 16:30:05.330330 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29b631ef-3090-4ab0-a08f-eab7454fcbb9 admin admin] REQUEST_METHOD: `GET` {{(pid=71938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 24 16:30:05.330667 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29b631ef-3090-4ab0-a08f-eab7454fcbb9 admin admin] SCRIPT_NAME: `/identity` {{(pid=71938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 24 16:30:05.330998 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29b631ef-3090-4ab0-a08f-eab7454fcbb9 admin admin] PATH_INFO: `/v3/roles` {{(pid=71938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 24 16:30:05.331810 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29b631ef-3090-4ab0-a08f-eab7454fcbb9 admin admin] RBAC: Adding query filter params (name=member) {{(pid=71938) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:161}} Nov 24 16:30:05.332488 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29b631ef-3090-4ab0-a08f-eab7454fcbb9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=71938) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:442}} Nov 24 16:30:05.360724 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29b631ef-3090-4ab0-a08f-eab7454fcbb9 admin admin] RBAC: Authorization granted {{(pid=71938) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 24 16:30:05.370976 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: [pid: 71938|app: 0|req: 101/201] 10.222.0.53 () {56 vars in 1113 bytes} [Wed Nov 24 16:30:05 2021] GET /identity/v3/roles?name=member => generated 341 bytes in 57 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 24 16:30:05.377755 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f7d1e2f-749f-4208-9fa4-b4a68652a74a admin admin] Authenticating user token {{(pid=71939) process_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 24 16:30:05.388388 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f7d1e2f-749f-4208-9fa4-b4a68652a74a admin admin] Validating token access rules against request {{(pid=71939) validate_allowed_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 24 16:30:05.392772 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d459a4b2-be2c-4dfe-8aca-eb4fd92d9978 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f2ba2e8375b4e8c8792ee1e22b60427', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '00a5583c7b7443e98e7a1d31a0b638dc', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=71939) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 24 16:30:05.393668 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d459a4b2-be2c-4dfe-8aca-eb4fd92d9978 admin admin] REQUEST_METHOD: `GET` {{(pid=71939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 24 16:30:05.394012 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d459a4b2-be2c-4dfe-8aca-eb4fd92d9978 admin admin] SCRIPT_NAME: `/identity` {{(pid=71939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 24 16:30:05.394412 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d459a4b2-be2c-4dfe-8aca-eb4fd92d9978 admin admin] PATH_INFO: `/v3/users/00c86a8d8abf438f80ab7423cb0e9a4c` {{(pid=71939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 24 16:30:05.395650 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d459a4b2-be2c-4dfe-8aca-eb4fd92d9978 admin admin] RBAC: Authorizing `identity:get_user(user_id=00c86a8d8abf438f80ab7423cb0e9a4c)` {{(pid=71939) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:442}} Nov 24 16:30:05.424918 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d459a4b2-be2c-4dfe-8aca-eb4fd92d9978 admin admin] RBAC: Authorization granted {{(pid=71939) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 24 16:30:05.426611 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: [pid: 71939|app: 0|req: 101/202] 10.222.0.53 () {56 vars in 1189 bytes} [Wed Nov 24 16:30:05 2021] GET /identity/v3/users/00c86a8d8abf438f80ab7423cb0e9a4c => generated 283 bytes in 50 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 24 16:30:05.432684 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29b631ef-3090-4ab0-a08f-eab7454fcbb9 admin admin] Authenticating user token {{(pid=71938) process_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 24 16:30:05.443545 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29b631ef-3090-4ab0-a08f-eab7454fcbb9 admin admin] Validating token access rules against request {{(pid=71938) validate_allowed_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 24 16:30:05.447826 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1994c076-2801-494f-8bb0-efec57b06117 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f2ba2e8375b4e8c8792ee1e22b60427', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '00a5583c7b7443e98e7a1d31a0b638dc', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=71938) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 24 16:30:05.448714 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1994c076-2801-494f-8bb0-efec57b06117 admin admin] REQUEST_METHOD: `GET` {{(pid=71938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 24 16:30:05.449061 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1994c076-2801-494f-8bb0-efec57b06117 admin admin] SCRIPT_NAME: `/identity` {{(pid=71938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 24 16:30:05.449398 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1994c076-2801-494f-8bb0-efec57b06117 admin admin] PATH_INFO: `/v3/projects/7cdfba1dd86043ea9b1cf6498535c213` {{(pid=71938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 24 16:30:05.450652 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1994c076-2801-494f-8bb0-efec57b06117 admin admin] RBAC: Authorizing `identity:get_project(project_id=7cdfba1dd86043ea9b1cf6498535c213)` {{(pid=71938) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:442}} Nov 24 16:30:05.479510 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1994c076-2801-494f-8bb0-efec57b06117 admin admin] RBAC: Authorization granted {{(pid=71938) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 24 16:30:05.481330 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: [pid: 71938|app: 0|req: 102/203] 10.222.0.53 () {56 vars in 1198 bytes} [Wed Nov 24 16:30:05 2021] GET /identity/v3/projects/7cdfba1dd86043ea9b1cf6498535c213 => generated 302 bytes in 49 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 24 16:30:05.489384 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d459a4b2-be2c-4dfe-8aca-eb4fd92d9978 admin admin] Authenticating user token {{(pid=71939) process_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 24 16:30:05.501343 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d459a4b2-be2c-4dfe-8aca-eb4fd92d9978 admin admin] Validating token access rules against request {{(pid=71939) validate_allowed_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 24 16:30:05.506236 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff687709-9b1c-4501-9fd1-01ec00624539 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f2ba2e8375b4e8c8792ee1e22b60427', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '00a5583c7b7443e98e7a1d31a0b638dc', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=71939) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 24 16:30:05.507128 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff687709-9b1c-4501-9fd1-01ec00624539 admin admin] REQUEST_METHOD: `PUT` {{(pid=71939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 24 16:30:05.507465 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff687709-9b1c-4501-9fd1-01ec00624539 admin admin] SCRIPT_NAME: `/identity` {{(pid=71939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 24 16:30:05.507797 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff687709-9b1c-4501-9fd1-01ec00624539 admin admin] PATH_INFO: `/v3/projects/7cdfba1dd86043ea9b1cf6498535c213/users/00c86a8d8abf438f80ab7423cb0e9a4c/roles/912ab5f10fa5477da74acf239f07604e` {{(pid=71939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 24 16:30:05.509721 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff687709-9b1c-4501-9fd1-01ec00624539 admin admin] RBAC: Authorizing `identity:create_grant(project_id=7cdfba1dd86043ea9b1cf6498535c213, user_id=00c86a8d8abf438f80ab7423cb0e9a4c, role_id=912ab5f10fa5477da74acf239f07604e)` {{(pid=71939) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:442}} Nov 24 16:30:05.539019 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff687709-9b1c-4501-9fd1-01ec00624539 admin admin] RBAC: Authorization granted {{(pid=71939) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 24 16:30:05.551040 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: [pid: 71939|app: 0|req: 102/204] 10.222.0.53 () {58 vars in 1451 bytes} [Wed Nov 24 16:30:05 2021] PUT /identity/v3/projects/7cdfba1dd86043ea9b1cf6498535c213/users/00c86a8d8abf438f80ab7423cb0e9a4c/roles/912ab5f10fa5477da74acf239f07604e => generated 0 bytes in 63 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 24 16:30:07.570421 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-287001bc-bb43-49d8-87b3-b81dff6649a8 None None] REQUEST_METHOD: `GET` {{(pid=71938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 24 16:30:07.570938 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-287001bc-bb43-49d8-87b3-b81dff6649a8 None None] SCRIPT_NAME: `/identity` {{(pid=71938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 24 16:30:07.571047 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-287001bc-bb43-49d8-87b3-b81dff6649a8 None None] PATH_INFO: `/` {{(pid=71938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 24 16:30:07.572820 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: [pid: 71938|app: 0|req: 103/205] 10.222.0.53 () {54 vars in 915 bytes} [Wed Nov 24 16:30:07 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 24 16:30:07.578337 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de195663-edaa-4c78-907d-498955a22f7d None None] REQUEST_METHOD: `POST` {{(pid=71939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 24 16:30:07.578956 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de195663-edaa-4c78-907d-498955a22f7d None None] SCRIPT_NAME: `/identity` {{(pid=71939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 24 16:30:07.579300 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de195663-edaa-4c78-907d-498955a22f7d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=71939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 24 16:30:07.603784 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.auth.core [None req-de195663-edaa-4c78-907d-498955a22f7d None None] MFA Rules not processed for user `0f2ba2e8375b4e8c8792ee1e22b60427`. Rule list: `[]` (Enabled: `True`). {{(pid=71939) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:442}} Nov 24 16:30:07.605858 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.fernet_utils [None req-de195663-edaa-4c78-907d-498955a22f7d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=71939) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:289}} Nov 24 16:30:07.682044 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: [pid: 71939|app: 0|req: 103/206] 10.222.0.53 () {58 vars in 1013 bytes} [Wed Nov 24 16:30:07 2021] POST /identity/v3/auth/tokens => generated 1067 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 24 16:30:07.704388 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-659d4b6a-93a0-4543-a314-ad6ccdcadae5 None None] REQUEST_METHOD: `POST` {{(pid=71938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 24 16:30:07.704739 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-659d4b6a-93a0-4543-a314-ad6ccdcadae5 None None] SCRIPT_NAME: `/identity` {{(pid=71938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 24 16:30:07.705719 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-659d4b6a-93a0-4543-a314-ad6ccdcadae5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=71938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 24 16:30:07.733007 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.auth.core [None req-659d4b6a-93a0-4543-a314-ad6ccdcadae5 None None] MFA Rules not processed for user `0f2ba2e8375b4e8c8792ee1e22b60427`. Rule list: `[]` (Enabled: `True`). {{(pid=71938) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:442}} Nov 24 16:30:07.734599 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.fernet_utils [None req-659d4b6a-93a0-4543-a314-ad6ccdcadae5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=71938) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:289}} Nov 24 16:30:07.742007 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: [pid: 71938|app: 0|req: 104/207] 10.222.0.53 () {58 vars in 1013 bytes} [Wed Nov 24 16:30:07 2021] POST /identity/v3/auth/tokens => generated 1067 bytes in 39 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 24 16:30:07.747825 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de195663-edaa-4c78-907d-498955a22f7d None None] Authenticating user token {{(pid=71939) process_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 24 16:30:07.757896 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de195663-edaa-4c78-907d-498955a22f7d None None] Validating token access rules against request {{(pid=71939) validate_allowed_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 24 16:30:07.762377 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-925b8b5e-c42f-4b96-9145-99bf877d0cb8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f2ba2e8375b4e8c8792ee1e22b60427', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '00a5583c7b7443e98e7a1d31a0b638dc', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=71939) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 24 16:30:07.763191 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-925b8b5e-c42f-4b96-9145-99bf877d0cb8 admin admin] REQUEST_METHOD: `GET` {{(pid=71939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 24 16:30:07.763530 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-925b8b5e-c42f-4b96-9145-99bf877d0cb8 admin admin] SCRIPT_NAME: `/identity` {{(pid=71939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 24 16:30:07.763859 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-925b8b5e-c42f-4b96-9145-99bf877d0cb8 admin admin] PATH_INFO: `/v3/roles/member` {{(pid=71939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 24 16:30:07.776294 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-925b8b5e-c42f-4b96-9145-99bf877d0cb8 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=71939) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:401}} Nov 24 16:30:07.783674 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: WARNING keystone.server.flask.application [None req-925b8b5e-c42f-4b96-9145-99bf877d0cb8 admin admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Nov 24 16:30:07.784858 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: [pid: 71939|app: 0|req: 104/208] 10.222.0.53 () {56 vars in 1111 bytes} [Wed Nov 24 16:30:07 2021] GET /identity/v3/roles/member => generated 84 bytes in 38 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 24 16:30:07.791431 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-659d4b6a-93a0-4543-a314-ad6ccdcadae5 None None] Authenticating user token {{(pid=71938) process_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 24 16:30:07.800774 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-659d4b6a-93a0-4543-a314-ad6ccdcadae5 None None] Validating token access rules against request {{(pid=71938) validate_allowed_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 24 16:30:07.805055 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91e49996-125c-415d-b687-74aa72fbcfea admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f2ba2e8375b4e8c8792ee1e22b60427', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '00a5583c7b7443e98e7a1d31a0b638dc', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=71938) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 24 16:30:07.805727 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91e49996-125c-415d-b687-74aa72fbcfea admin admin] REQUEST_METHOD: `GET` {{(pid=71938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 24 16:30:07.806098 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91e49996-125c-415d-b687-74aa72fbcfea admin admin] SCRIPT_NAME: `/identity` {{(pid=71938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 24 16:30:07.806436 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91e49996-125c-415d-b687-74aa72fbcfea admin admin] PATH_INFO: `/v3/roles` {{(pid=71938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 24 16:30:07.807245 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91e49996-125c-415d-b687-74aa72fbcfea admin admin] RBAC: Adding query filter params (name=member) {{(pid=71938) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:161}} Nov 24 16:30:07.807599 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91e49996-125c-415d-b687-74aa72fbcfea admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=71938) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:442}} Nov 24 16:30:07.837080 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91e49996-125c-415d-b687-74aa72fbcfea admin admin] RBAC: Authorization granted {{(pid=71938) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 24 16:30:07.846335 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: [pid: 71938|app: 0|req: 105/209] 10.222.0.53 () {56 vars in 1113 bytes} [Wed Nov 24 16:30:07 2021] GET /identity/v3/roles?name=member => generated 341 bytes in 55 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 24 16:30:07.852185 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-925b8b5e-c42f-4b96-9145-99bf877d0cb8 admin admin] Authenticating user token {{(pid=71939) process_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 24 16:30:07.864295 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-925b8b5e-c42f-4b96-9145-99bf877d0cb8 admin admin] Validating token access rules against request {{(pid=71939) validate_allowed_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 24 16:30:07.868581 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c070930e-f6fb-4789-99b8-7e9c9bf551a8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f2ba2e8375b4e8c8792ee1e22b60427', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '00a5583c7b7443e98e7a1d31a0b638dc', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=71939) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 24 16:30:07.869464 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c070930e-f6fb-4789-99b8-7e9c9bf551a8 admin admin] REQUEST_METHOD: `GET` {{(pid=71939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 24 16:30:07.869793 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c070930e-f6fb-4789-99b8-7e9c9bf551a8 admin admin] SCRIPT_NAME: `/identity` {{(pid=71939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 24 16:30:07.870151 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c070930e-f6fb-4789-99b8-7e9c9bf551a8 admin admin] PATH_INFO: `/v3/users/00c86a8d8abf438f80ab7423cb0e9a4c` {{(pid=71939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 24 16:30:07.871360 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c070930e-f6fb-4789-99b8-7e9c9bf551a8 admin admin] RBAC: Authorizing `identity:get_user(user_id=00c86a8d8abf438f80ab7423cb0e9a4c)` {{(pid=71939) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:442}} Nov 24 16:30:07.901792 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c070930e-f6fb-4789-99b8-7e9c9bf551a8 admin admin] RBAC: Authorization granted {{(pid=71939) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 24 16:30:07.903577 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: [pid: 71939|app: 0|req: 105/210] 10.222.0.53 () {56 vars in 1189 bytes} [Wed Nov 24 16:30:07 2021] GET /identity/v3/users/00c86a8d8abf438f80ab7423cb0e9a4c => generated 283 bytes in 52 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 24 16:30:07.909647 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91e49996-125c-415d-b687-74aa72fbcfea admin admin] Authenticating user token {{(pid=71938) process_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 24 16:30:07.921001 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91e49996-125c-415d-b687-74aa72fbcfea admin admin] Validating token access rules against request {{(pid=71938) validate_allowed_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 24 16:30:07.925329 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b6d20cc-3306-4cc9-a385-eb31327a4468 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f2ba2e8375b4e8c8792ee1e22b60427', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '00a5583c7b7443e98e7a1d31a0b638dc', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=71938) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 24 16:30:07.925986 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b6d20cc-3306-4cc9-a385-eb31327a4468 admin admin] REQUEST_METHOD: `GET` {{(pid=71938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 24 16:30:07.926391 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b6d20cc-3306-4cc9-a385-eb31327a4468 admin admin] SCRIPT_NAME: `/identity` {{(pid=71938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 24 16:30:07.926723 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b6d20cc-3306-4cc9-a385-eb31327a4468 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=71938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 24 16:30:07.935362 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b6d20cc-3306-4cc9-a385-eb31327a4468 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=71938) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:442}} Nov 24 16:30:07.964973 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b6d20cc-3306-4cc9-a385-eb31327a4468 admin admin] RBAC: Authorization granted {{(pid=71938) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 24 16:30:07.974954 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: [pid: 71938|app: 0|req: 106/211] 10.222.0.53 () {58 vars in 1315 bytes} [Wed Nov 24 16:30:07 2021] GET /identity/v3/auth/tokens => generated 1067 bytes in 66 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 24 16:30:07.981084 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c070930e-f6fb-4789-99b8-7e9c9bf551a8 admin admin] Authenticating user token {{(pid=71939) process_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 24 16:30:07.991161 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c070930e-f6fb-4789-99b8-7e9c9bf551a8 admin admin] Validating token access rules against request {{(pid=71939) validate_allowed_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 24 16:30:07.995394 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-308125d3-b806-4e8c-a1cb-3d4ad423570b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f2ba2e8375b4e8c8792ee1e22b60427', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '00a5583c7b7443e98e7a1d31a0b638dc', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=71939) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 24 16:30:07.996264 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-308125d3-b806-4e8c-a1cb-3d4ad423570b admin admin] REQUEST_METHOD: `GET` {{(pid=71939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 24 16:30:07.996605 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-308125d3-b806-4e8c-a1cb-3d4ad423570b admin admin] SCRIPT_NAME: `/identity` {{(pid=71939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 24 16:30:07.996944 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-308125d3-b806-4e8c-a1cb-3d4ad423570b admin admin] PATH_INFO: `/v3/projects/7cdfba1dd86043ea9b1cf6498535c213` {{(pid=71939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 24 16:30:07.998178 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-308125d3-b806-4e8c-a1cb-3d4ad423570b admin admin] RBAC: Authorizing `identity:get_project(project_id=7cdfba1dd86043ea9b1cf6498535c213)` {{(pid=71939) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:442}} Nov 24 16:30:08.027860 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-308125d3-b806-4e8c-a1cb-3d4ad423570b admin admin] RBAC: Authorization granted {{(pid=71939) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 24 16:30:08.029636 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: [pid: 71939|app: 0|req: 106/212] 10.222.0.53 () {56 vars in 1198 bytes} [Wed Nov 24 16:30:07 2021] GET /identity/v3/projects/7cdfba1dd86043ea9b1cf6498535c213 => generated 302 bytes in 49 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 24 16:30:08.036060 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b6d20cc-3306-4cc9-a385-eb31327a4468 admin admin] Authenticating user token {{(pid=71938) process_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 24 16:30:08.045558 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b6d20cc-3306-4cc9-a385-eb31327a4468 admin admin] Validating token access rules against request {{(pid=71938) validate_allowed_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 24 16:30:08.050055 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dbdfb59-e044-4cfe-b063-95dc790e9e22 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f2ba2e8375b4e8c8792ee1e22b60427', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '00a5583c7b7443e98e7a1d31a0b638dc', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=71938) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 24 16:30:08.050710 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dbdfb59-e044-4cfe-b063-95dc790e9e22 admin admin] REQUEST_METHOD: `GET` {{(pid=71938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 24 16:30:08.051052 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dbdfb59-e044-4cfe-b063-95dc790e9e22 admin admin] SCRIPT_NAME: `/identity` {{(pid=71938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 24 16:30:08.051386 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dbdfb59-e044-4cfe-b063-95dc790e9e22 admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=71938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 24 16:30:08.052286 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1dbdfb59-e044-4cfe-b063-95dc790e9e22 admin admin] RBAC: Adding query filter params (role.id=912ab5f10fa5477da74acf239f07604e, scope.project.id=7cdfba1dd86043ea9b1cf6498535c213, user.id=00c86a8d8abf438f80ab7423cb0e9a4c) {{(pid=71938) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:161}} Nov 24 16:30:08.052646 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1dbdfb59-e044-4cfe-b063-95dc790e9e22 admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=71938) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:442}} Nov 24 16:30:08.082410 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1dbdfb59-e044-4cfe-b063-95dc790e9e22 admin admin] RBAC: Authorization granted {{(pid=71938) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 24 16:30:08.089092 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: [pid: 71938|app: 0|req: 107/213] 10.222.0.53 () {56 vars in 1386 bytes} [Wed Nov 24 16:30:08 2021] GET /identity/v3/role_assignments?user.id=00c86a8d8abf438f80ab7423cb0e9a4c&scope.project.id=7cdfba1dd86043ea9b1cf6498535c213&role.id=912ab5f10fa5477da74acf239f07604e => generated 608 bytes in 54 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 24 16:30:10.164181 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-659a7be4-7752-433c-9f9c-c44c9155273e None None] REQUEST_METHOD: `GET` {{(pid=71939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 24 16:30:10.164713 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-659a7be4-7752-433c-9f9c-c44c9155273e None None] SCRIPT_NAME: `/identity` {{(pid=71939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 24 16:30:10.164842 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-659a7be4-7752-433c-9f9c-c44c9155273e None None] PATH_INFO: `/` {{(pid=71939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 24 16:30:10.166719 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: [pid: 71939|app: 0|req: 107/214] 10.222.0.53 () {54 vars in 915 bytes} [Wed Nov 24 16:30:10 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 24 16:30:10.172197 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f658f87-720c-4110-830b-4a6f4e72e639 None None] REQUEST_METHOD: `POST` {{(pid=71938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 24 16:30:10.172545 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f658f87-720c-4110-830b-4a6f4e72e639 None None] SCRIPT_NAME: `/identity` {{(pid=71938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 24 16:30:10.172881 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f658f87-720c-4110-830b-4a6f4e72e639 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=71938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 24 16:30:10.196631 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.auth.core [None req-1f658f87-720c-4110-830b-4a6f4e72e639 None None] MFA Rules not processed for user `0f2ba2e8375b4e8c8792ee1e22b60427`. Rule list: `[]` (Enabled: `True`). {{(pid=71938) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:442}} Nov 24 16:30:10.197826 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.fernet_utils [None req-1f658f87-720c-4110-830b-4a6f4e72e639 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=71938) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:289}} Nov 24 16:30:10.205770 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: [pid: 71938|app: 0|req: 108/215] 10.222.0.53 () {58 vars in 1013 bytes} [Wed Nov 24 16:30:10 2021] POST /identity/v3/auth/tokens => generated 1067 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 24 16:30:10.227676 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70731970-c347-477a-ae6e-51ce3211bbe0 None None] REQUEST_METHOD: `POST` {{(pid=71939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 24 16:30:10.228022 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70731970-c347-477a-ae6e-51ce3211bbe0 None None] SCRIPT_NAME: `/identity` {{(pid=71939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 24 16:30:10.228357 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70731970-c347-477a-ae6e-51ce3211bbe0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=71939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 24 16:30:10.251216 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.auth.core [None req-70731970-c347-477a-ae6e-51ce3211bbe0 None None] MFA Rules not processed for user `0f2ba2e8375b4e8c8792ee1e22b60427`. Rule list: `[]` (Enabled: `True`). {{(pid=71939) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:442}} Nov 24 16:30:10.252925 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.fernet_utils [None req-70731970-c347-477a-ae6e-51ce3211bbe0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=71939) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:289}} Nov 24 16:30:10.259884 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: [pid: 71939|app: 0|req: 108/216] 10.222.0.53 () {58 vars in 1013 bytes} [Wed Nov 24 16:30:10 2021] POST /identity/v3/auth/tokens => generated 1067 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 24 16:30:10.265786 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f658f87-720c-4110-830b-4a6f4e72e639 None None] Authenticating user token {{(pid=71938) process_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 24 16:30:10.278470 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f658f87-720c-4110-830b-4a6f4e72e639 None None] Validating token access rules against request {{(pid=71938) validate_allowed_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 24 16:30:10.284443 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8890e002-67cd-4246-b77f-4bff4a490a4a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f2ba2e8375b4e8c8792ee1e22b60427', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '00a5583c7b7443e98e7a1d31a0b638dc', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=71938) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 24 16:30:10.285686 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8890e002-67cd-4246-b77f-4bff4a490a4a admin admin] REQUEST_METHOD: `GET` {{(pid=71938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 24 16:30:10.286093 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8890e002-67cd-4246-b77f-4bff4a490a4a admin admin] SCRIPT_NAME: `/identity` {{(pid=71938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 24 16:30:10.286432 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8890e002-67cd-4246-b77f-4bff4a490a4a admin admin] PATH_INFO: `/v3/roles/admin` {{(pid=71938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 24 16:30:10.299306 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8890e002-67cd-4246-b77f-4bff4a490a4a admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=71938) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:401}} Nov 24 16:30:10.307140 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: WARNING keystone.server.flask.application [None req-8890e002-67cd-4246-b77f-4bff4a490a4a admin admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Nov 24 16:30:10.308701 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: [pid: 71938|app: 0|req: 109/217] 10.222.0.53 () {56 vars in 1108 bytes} [Wed Nov 24 16:30:10 2021] GET /identity/v3/roles/admin => generated 83 bytes in 44 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 24 16:30:10.315952 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70731970-c347-477a-ae6e-51ce3211bbe0 None None] Authenticating user token {{(pid=71939) process_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 24 16:30:10.325050 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70731970-c347-477a-ae6e-51ce3211bbe0 None None] Validating token access rules against request {{(pid=71939) validate_allowed_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 24 16:30:10.330653 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c6997a4-ad6c-4a19-bdc8-e5902909b4a8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f2ba2e8375b4e8c8792ee1e22b60427', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '00a5583c7b7443e98e7a1d31a0b638dc', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=71939) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 24 16:30:10.331327 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c6997a4-ad6c-4a19-bdc8-e5902909b4a8 admin admin] REQUEST_METHOD: `GET` {{(pid=71939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 24 16:30:10.331668 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c6997a4-ad6c-4a19-bdc8-e5902909b4a8 admin admin] SCRIPT_NAME: `/identity` {{(pid=71939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 24 16:30:10.332001 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c6997a4-ad6c-4a19-bdc8-e5902909b4a8 admin admin] PATH_INFO: `/v3/roles` {{(pid=71939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 24 16:30:10.332803 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c6997a4-ad6c-4a19-bdc8-e5902909b4a8 admin admin] RBAC: Adding query filter params (name=admin) {{(pid=71939) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:161}} Nov 24 16:30:10.333151 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c6997a4-ad6c-4a19-bdc8-e5902909b4a8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=71939) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:442}} Nov 24 16:30:10.360942 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c6997a4-ad6c-4a19-bdc8-e5902909b4a8 admin admin] RBAC: Authorization granted {{(pid=71939) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 24 16:30:10.370444 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: [pid: 71939|app: 0|req: 109/218] 10.222.0.53 () {56 vars in 1111 bytes} [Wed Nov 24 16:30:10 2021] GET /identity/v3/roles?name=admin => generated 339 bytes in 55 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 24 16:30:10.376095 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8890e002-67cd-4246-b77f-4bff4a490a4a admin admin] Authenticating user token {{(pid=71938) process_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 24 16:30:10.386825 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8890e002-67cd-4246-b77f-4bff4a490a4a admin admin] Validating token access rules against request {{(pid=71938) validate_allowed_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 24 16:30:10.390972 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48a3340a-8f1b-49fa-a428-258cd3173249 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f2ba2e8375b4e8c8792ee1e22b60427', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '00a5583c7b7443e98e7a1d31a0b638dc', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=71938) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 24 16:30:10.391841 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48a3340a-8f1b-49fa-a428-258cd3173249 admin admin] REQUEST_METHOD: `GET` {{(pid=71938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 24 16:30:10.392174 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48a3340a-8f1b-49fa-a428-258cd3173249 admin admin] SCRIPT_NAME: `/identity` {{(pid=71938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 24 16:30:10.392502 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48a3340a-8f1b-49fa-a428-258cd3173249 admin admin] PATH_INFO: `/v3/users/0f2ba2e8375b4e8c8792ee1e22b60427` {{(pid=71938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 24 16:30:10.394133 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48a3340a-8f1b-49fa-a428-258cd3173249 admin admin] RBAC: Authorizing `identity:get_user(user_id=0f2ba2e8375b4e8c8792ee1e22b60427)` {{(pid=71938) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:442}} Nov 24 16:30:10.421801 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48a3340a-8f1b-49fa-a428-258cd3173249 admin admin] RBAC: Authorization granted {{(pid=71938) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 24 16:30:10.423372 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: [pid: 71938|app: 0|req: 110/219] 10.222.0.53 () {56 vars in 1189 bytes} [Wed Nov 24 16:30:10 2021] GET /identity/v3/users/0f2ba2e8375b4e8c8792ee1e22b60427 => generated 247 bytes in 48 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 24 16:30:10.429587 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c6997a4-ad6c-4a19-bdc8-e5902909b4a8 admin admin] Authenticating user token {{(pid=71939) process_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 24 16:30:10.440127 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c6997a4-ad6c-4a19-bdc8-e5902909b4a8 admin admin] Validating token access rules against request {{(pid=71939) validate_allowed_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 24 16:30:10.444334 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-593e8b11-99d4-4e06-87ef-8988f39f56ae admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f2ba2e8375b4e8c8792ee1e22b60427', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '00a5583c7b7443e98e7a1d31a0b638dc', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=71939) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 24 16:30:10.444982 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-593e8b11-99d4-4e06-87ef-8988f39f56ae admin admin] REQUEST_METHOD: `GET` {{(pid=71939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 24 16:30:10.445329 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-593e8b11-99d4-4e06-87ef-8988f39f56ae admin admin] SCRIPT_NAME: `/identity` {{(pid=71939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 24 16:30:10.445667 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-593e8b11-99d4-4e06-87ef-8988f39f56ae admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=71939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 24 16:30:10.453973 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-593e8b11-99d4-4e06-87ef-8988f39f56ae admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=71939) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:442}} Nov 24 16:30:10.481951 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-593e8b11-99d4-4e06-87ef-8988f39f56ae admin admin] RBAC: Authorization granted {{(pid=71939) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 24 16:30:10.491391 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: [pid: 71939|app: 0|req: 110/220] 10.222.0.53 () {58 vars in 1315 bytes} [Wed Nov 24 16:30:10 2021] GET /identity/v3/auth/tokens => generated 1067 bytes in 62 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 24 16:30:10.496878 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48a3340a-8f1b-49fa-a428-258cd3173249 admin admin] Authenticating user token {{(pid=71938) process_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 24 16:30:10.507093 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48a3340a-8f1b-49fa-a428-258cd3173249 admin admin] Validating token access rules against request {{(pid=71938) validate_allowed_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 24 16:30:10.511223 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-392ba7b1-34bb-4fc8-8337-a234673dfe9f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f2ba2e8375b4e8c8792ee1e22b60427', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '00a5583c7b7443e98e7a1d31a0b638dc', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=71938) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 24 16:30:10.512079 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-392ba7b1-34bb-4fc8-8337-a234673dfe9f admin admin] REQUEST_METHOD: `GET` {{(pid=71938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 24 16:30:10.512412 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-392ba7b1-34bb-4fc8-8337-a234673dfe9f admin admin] SCRIPT_NAME: `/identity` {{(pid=71938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 24 16:30:10.512737 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-392ba7b1-34bb-4fc8-8337-a234673dfe9f admin admin] PATH_INFO: `/v3/projects/7cdfba1dd86043ea9b1cf6498535c213` {{(pid=71938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 24 16:30:10.513931 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-392ba7b1-34bb-4fc8-8337-a234673dfe9f admin admin] RBAC: Authorizing `identity:get_project(project_id=7cdfba1dd86043ea9b1cf6498535c213)` {{(pid=71938) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:442}} Nov 24 16:30:10.542354 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-392ba7b1-34bb-4fc8-8337-a234673dfe9f admin admin] RBAC: Authorization granted {{(pid=71938) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 24 16:30:10.543973 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: [pid: 71938|app: 0|req: 111/221] 10.222.0.53 () {56 vars in 1198 bytes} [Wed Nov 24 16:30:10 2021] GET /identity/v3/projects/7cdfba1dd86043ea9b1cf6498535c213 => generated 302 bytes in 48 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 24 16:30:10.550152 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-593e8b11-99d4-4e06-87ef-8988f39f56ae admin admin] Authenticating user token {{(pid=71939) process_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 24 16:30:10.558969 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-593e8b11-99d4-4e06-87ef-8988f39f56ae admin admin] Validating token access rules against request {{(pid=71939) validate_allowed_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 24 16:30:10.563374 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca62742e-812b-4c8f-aea8-6da4646b650d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f2ba2e8375b4e8c8792ee1e22b60427', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '00a5583c7b7443e98e7a1d31a0b638dc', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=71939) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 24 16:30:10.564012 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca62742e-812b-4c8f-aea8-6da4646b650d admin admin] REQUEST_METHOD: `GET` {{(pid=71939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 24 16:30:10.564932 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca62742e-812b-4c8f-aea8-6da4646b650d admin admin] SCRIPT_NAME: `/identity` {{(pid=71939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 24 16:30:10.565272 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca62742e-812b-4c8f-aea8-6da4646b650d admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=71939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 24 16:30:10.566185 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca62742e-812b-4c8f-aea8-6da4646b650d admin admin] RBAC: Adding query filter params (role.id=5611724e350b41e19921b5961a342582, scope.project.id=7cdfba1dd86043ea9b1cf6498535c213, user.id=0f2ba2e8375b4e8c8792ee1e22b60427) {{(pid=71939) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:161}} Nov 24 16:30:10.566547 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca62742e-812b-4c8f-aea8-6da4646b650d admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=71939) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:442}} Nov 24 16:30:10.606745 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca62742e-812b-4c8f-aea8-6da4646b650d admin admin] RBAC: Authorization granted {{(pid=71939) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 24 16:30:10.615559 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: [pid: 71939|app: 0|req: 111/222] 10.222.0.53 () {56 vars in 1386 bytes} [Wed Nov 24 16:30:10 2021] GET /identity/v3/role_assignments?user.id=0f2ba2e8375b4e8c8792ee1e22b60427&scope.project.id=7cdfba1dd86043ea9b1cf6498535c213&role.id=5611724e350b41e19921b5961a342582 => generated 259 bytes in 66 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 24 16:30:12.567686 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c99549a0-c4f2-4d7a-a685-00074628c905 None None] REQUEST_METHOD: `GET` {{(pid=71938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 24 16:30:12.568181 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c99549a0-c4f2-4d7a-a685-00074628c905 None None] SCRIPT_NAME: `/identity` {{(pid=71938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 24 16:30:12.568287 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c99549a0-c4f2-4d7a-a685-00074628c905 None None] PATH_INFO: `/` {{(pid=71938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 24 16:30:12.570093 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: [pid: 71938|app: 0|req: 112/223] 10.222.0.53 () {54 vars in 915 bytes} [Wed Nov 24 16:30:12 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 24 16:30:12.575476 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5c45687-524b-4e75-a4e6-c1e3140c4bdf None None] REQUEST_METHOD: `POST` {{(pid=71939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 24 16:30:12.576057 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5c45687-524b-4e75-a4e6-c1e3140c4bdf None None] SCRIPT_NAME: `/identity` {{(pid=71939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 24 16:30:12.576168 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5c45687-524b-4e75-a4e6-c1e3140c4bdf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=71939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 24 16:30:12.600194 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.auth.core [None req-c5c45687-524b-4e75-a4e6-c1e3140c4bdf None None] MFA Rules not processed for user `0f2ba2e8375b4e8c8792ee1e22b60427`. Rule list: `[]` (Enabled: `True`). {{(pid=71939) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:442}} Nov 24 16:30:12.601412 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.fernet_utils [None req-c5c45687-524b-4e75-a4e6-c1e3140c4bdf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=71939) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:289}} Nov 24 16:30:12.608413 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: [pid: 71939|app: 0|req: 112/224] 10.222.0.53 () {58 vars in 1013 bytes} [Wed Nov 24 16:30:12 2021] POST /identity/v3/auth/tokens => generated 1067 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 24 16:30:12.630868 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bcef230-cb31-44cd-bf2c-866dcc400208 None None] REQUEST_METHOD: `POST` {{(pid=71938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 24 16:30:12.631266 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bcef230-cb31-44cd-bf2c-866dcc400208 None None] SCRIPT_NAME: `/identity` {{(pid=71938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 24 16:30:12.631650 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bcef230-cb31-44cd-bf2c-866dcc400208 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=71938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 24 16:30:12.656071 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.auth.core [None req-7bcef230-cb31-44cd-bf2c-866dcc400208 None None] MFA Rules not processed for user `0f2ba2e8375b4e8c8792ee1e22b60427`. Rule list: `[]` (Enabled: `True`). {{(pid=71938) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:442}} Nov 24 16:30:12.657280 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.fernet_utils [None req-7bcef230-cb31-44cd-bf2c-866dcc400208 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=71938) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:289}} Nov 24 16:30:12.664365 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: [pid: 71938|app: 0|req: 113/225] 10.222.0.53 () {58 vars in 1013 bytes} [Wed Nov 24 16:30:12 2021] POST /identity/v3/auth/tokens => generated 1067 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 24 16:30:12.670497 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5c45687-524b-4e75-a4e6-c1e3140c4bdf None None] Authenticating user token {{(pid=71939) process_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 24 16:30:12.680199 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5c45687-524b-4e75-a4e6-c1e3140c4bdf None None] Validating token access rules against request {{(pid=71939) validate_allowed_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 24 16:30:12.684416 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e902a527-4009-4e8f-aa01-ecf6ca630c1b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f2ba2e8375b4e8c8792ee1e22b60427', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '00a5583c7b7443e98e7a1d31a0b638dc', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=71939) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 24 16:30:12.685223 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e902a527-4009-4e8f-aa01-ecf6ca630c1b admin admin] REQUEST_METHOD: `GET` {{(pid=71939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 24 16:30:12.685568 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e902a527-4009-4e8f-aa01-ecf6ca630c1b admin admin] SCRIPT_NAME: `/identity` {{(pid=71939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 24 16:30:12.685902 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e902a527-4009-4e8f-aa01-ecf6ca630c1b admin admin] PATH_INFO: `/v3/roles/admin` {{(pid=71939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 24 16:30:12.698215 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e902a527-4009-4e8f-aa01-ecf6ca630c1b admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=71939) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:401}} Nov 24 16:30:12.705758 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: WARNING keystone.server.flask.application [None req-e902a527-4009-4e8f-aa01-ecf6ca630c1b admin admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Nov 24 16:30:12.706956 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: [pid: 71939|app: 0|req: 113/226] 10.222.0.53 () {56 vars in 1108 bytes} [Wed Nov 24 16:30:12 2021] GET /identity/v3/roles/admin => generated 83 bytes in 37 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 24 16:30:12.713102 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bcef230-cb31-44cd-bf2c-866dcc400208 None None] Authenticating user token {{(pid=71938) process_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 24 16:30:12.722061 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bcef230-cb31-44cd-bf2c-866dcc400208 None None] Validating token access rules against request {{(pid=71938) validate_allowed_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 24 16:30:12.726222 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc15ea23-bf3c-467f-92b2-da65103d2c2c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f2ba2e8375b4e8c8792ee1e22b60427', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '00a5583c7b7443e98e7a1d31a0b638dc', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=71938) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 24 16:30:12.726882 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc15ea23-bf3c-467f-92b2-da65103d2c2c admin admin] REQUEST_METHOD: `GET` {{(pid=71938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 24 16:30:12.727219 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc15ea23-bf3c-467f-92b2-da65103d2c2c admin admin] SCRIPT_NAME: `/identity` {{(pid=71938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 24 16:30:12.727551 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc15ea23-bf3c-467f-92b2-da65103d2c2c admin admin] PATH_INFO: `/v3/roles` {{(pid=71938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 24 16:30:12.728387 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc15ea23-bf3c-467f-92b2-da65103d2c2c admin admin] RBAC: Adding query filter params (name=admin) {{(pid=71938) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:161}} Nov 24 16:30:12.728737 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc15ea23-bf3c-467f-92b2-da65103d2c2c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=71938) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:442}} Nov 24 16:30:12.757749 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc15ea23-bf3c-467f-92b2-da65103d2c2c admin admin] RBAC: Authorization granted {{(pid=71938) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 24 16:30:12.766589 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: [pid: 71938|app: 0|req: 114/227] 10.222.0.53 () {56 vars in 1111 bytes} [Wed Nov 24 16:30:12 2021] GET /identity/v3/roles?name=admin => generated 339 bytes in 54 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 24 16:30:12.772076 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e902a527-4009-4e8f-aa01-ecf6ca630c1b admin admin] Authenticating user token {{(pid=71939) process_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 24 16:30:12.782214 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e902a527-4009-4e8f-aa01-ecf6ca630c1b admin admin] Validating token access rules against request {{(pid=71939) validate_allowed_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 24 16:30:12.786505 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb57fd74-eff4-4698-b5a1-c7dccaffbfb0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f2ba2e8375b4e8c8792ee1e22b60427', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '00a5583c7b7443e98e7a1d31a0b638dc', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=71939) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 24 16:30:12.787373 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb57fd74-eff4-4698-b5a1-c7dccaffbfb0 admin admin] REQUEST_METHOD: `GET` {{(pid=71939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 24 16:30:12.787713 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb57fd74-eff4-4698-b5a1-c7dccaffbfb0 admin admin] SCRIPT_NAME: `/identity` {{(pid=71939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 24 16:30:12.788048 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb57fd74-eff4-4698-b5a1-c7dccaffbfb0 admin admin] PATH_INFO: `/v3/users/0f2ba2e8375b4e8c8792ee1e22b60427` {{(pid=71939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 24 16:30:12.789247 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb57fd74-eff4-4698-b5a1-c7dccaffbfb0 admin admin] RBAC: Authorizing `identity:get_user(user_id=0f2ba2e8375b4e8c8792ee1e22b60427)` {{(pid=71939) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:442}} Nov 24 16:30:12.818356 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb57fd74-eff4-4698-b5a1-c7dccaffbfb0 admin admin] RBAC: Authorization granted {{(pid=71939) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 24 16:30:12.819865 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: [pid: 71939|app: 0|req: 114/228] 10.222.0.53 () {56 vars in 1189 bytes} [Wed Nov 24 16:30:12 2021] GET /identity/v3/users/0f2ba2e8375b4e8c8792ee1e22b60427 => generated 247 bytes in 48 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 24 16:30:12.825134 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc15ea23-bf3c-467f-92b2-da65103d2c2c admin admin] Authenticating user token {{(pid=71938) process_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 24 16:30:12.834899 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc15ea23-bf3c-467f-92b2-da65103d2c2c admin admin] Validating token access rules against request {{(pid=71938) validate_allowed_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 24 16:30:12.838989 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40a8a6c9-c677-4ce0-ba05-95349ac506f5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f2ba2e8375b4e8c8792ee1e22b60427', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '00a5583c7b7443e98e7a1d31a0b638dc', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=71938) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 24 16:30:12.839839 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40a8a6c9-c677-4ce0-ba05-95349ac506f5 admin admin] REQUEST_METHOD: `GET` {{(pid=71938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 24 16:30:12.840172 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40a8a6c9-c677-4ce0-ba05-95349ac506f5 admin admin] SCRIPT_NAME: `/identity` {{(pid=71938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 24 16:30:12.840499 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40a8a6c9-c677-4ce0-ba05-95349ac506f5 admin admin] PATH_INFO: `/v3/projects/7cdfba1dd86043ea9b1cf6498535c213` {{(pid=71938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 24 16:30:12.841679 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40a8a6c9-c677-4ce0-ba05-95349ac506f5 admin admin] RBAC: Authorizing `identity:get_project(project_id=7cdfba1dd86043ea9b1cf6498535c213)` {{(pid=71938) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:442}} Nov 24 16:30:12.870539 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40a8a6c9-c677-4ce0-ba05-95349ac506f5 admin admin] RBAC: Authorization granted {{(pid=71938) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 24 16:30:12.872322 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: [pid: 71938|app: 0|req: 115/229] 10.222.0.53 () {56 vars in 1198 bytes} [Wed Nov 24 16:30:12 2021] GET /identity/v3/projects/7cdfba1dd86043ea9b1cf6498535c213 => generated 302 bytes in 47 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 24 16:30:12.878255 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb57fd74-eff4-4698-b5a1-c7dccaffbfb0 admin admin] Authenticating user token {{(pid=71939) process_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 24 16:30:12.887885 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb57fd74-eff4-4698-b5a1-c7dccaffbfb0 admin admin] Validating token access rules against request {{(pid=71939) validate_allowed_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 24 16:30:12.892074 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5eaf43a-66f8-46a9-a686-fa1c82abb7b5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f2ba2e8375b4e8c8792ee1e22b60427', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '00a5583c7b7443e98e7a1d31a0b638dc', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=71939) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 24 16:30:12.892959 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5eaf43a-66f8-46a9-a686-fa1c82abb7b5 admin admin] REQUEST_METHOD: `PUT` {{(pid=71939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 24 16:30:12.893295 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5eaf43a-66f8-46a9-a686-fa1c82abb7b5 admin admin] SCRIPT_NAME: `/identity` {{(pid=71939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 24 16:30:12.893627 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5eaf43a-66f8-46a9-a686-fa1c82abb7b5 admin admin] PATH_INFO: `/v3/projects/7cdfba1dd86043ea9b1cf6498535c213/users/0f2ba2e8375b4e8c8792ee1e22b60427/roles/5611724e350b41e19921b5961a342582` {{(pid=71939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 24 16:30:12.895579 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5eaf43a-66f8-46a9-a686-fa1c82abb7b5 admin admin] RBAC: Authorizing `identity:create_grant(project_id=7cdfba1dd86043ea9b1cf6498535c213, user_id=0f2ba2e8375b4e8c8792ee1e22b60427, role_id=5611724e350b41e19921b5961a342582)` {{(pid=71939) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:442}} Nov 24 16:30:12.924930 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5eaf43a-66f8-46a9-a686-fa1c82abb7b5 admin admin] RBAC: Authorization granted {{(pid=71939) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 24 16:30:12.935509 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: [pid: 71939|app: 0|req: 115/230] 10.222.0.53 () {58 vars in 1451 bytes} [Wed Nov 24 16:30:12 2021] PUT /identity/v3/projects/7cdfba1dd86043ea9b1cf6498535c213/users/0f2ba2e8375b4e8c8792ee1e22b60427/roles/5611724e350b41e19921b5961a342582 => generated 0 bytes in 58 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 24 16:30:14.901550 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4844289-4eb4-4328-80b9-afef49596867 None None] REQUEST_METHOD: `GET` {{(pid=71938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 24 16:30:14.902084 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4844289-4eb4-4328-80b9-afef49596867 None None] SCRIPT_NAME: `/identity` {{(pid=71938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 24 16:30:14.902210 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4844289-4eb4-4328-80b9-afef49596867 None None] PATH_INFO: `/` {{(pid=71938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 24 16:30:14.904076 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: [pid: 71938|app: 0|req: 116/231] 10.222.0.53 () {54 vars in 915 bytes} [Wed Nov 24 16:30:14 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 24 16:30:14.909533 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5303c65b-f156-46b0-b583-05dfdfc163e5 None None] REQUEST_METHOD: `POST` {{(pid=71939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 24 16:30:14.909890 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5303c65b-f156-46b0-b583-05dfdfc163e5 None None] SCRIPT_NAME: `/identity` {{(pid=71939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 24 16:30:14.910268 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5303c65b-f156-46b0-b583-05dfdfc163e5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=71939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 24 16:30:14.933978 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.auth.core [None req-5303c65b-f156-46b0-b583-05dfdfc163e5 None None] MFA Rules not processed for user `0f2ba2e8375b4e8c8792ee1e22b60427`. Rule list: `[]` (Enabled: `True`). {{(pid=71939) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:442}} Nov 24 16:30:14.935306 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.fernet_utils [None req-5303c65b-f156-46b0-b583-05dfdfc163e5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=71939) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:289}} Nov 24 16:30:15.001496 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: [pid: 71939|app: 0|req: 116/232] 10.222.0.53 () {58 vars in 1013 bytes} [Wed Nov 24 16:30:14 2021] POST /identity/v3/auth/tokens => generated 1067 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 24 16:30:15.023962 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b20e1014-fefb-40c9-bfb1-62b92f332aa3 None None] REQUEST_METHOD: `POST` {{(pid=71938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 24 16:30:15.024310 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b20e1014-fefb-40c9-bfb1-62b92f332aa3 None None] SCRIPT_NAME: `/identity` {{(pid=71938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 24 16:30:15.024643 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b20e1014-fefb-40c9-bfb1-62b92f332aa3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=71938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 24 16:30:15.047974 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.auth.core [None req-b20e1014-fefb-40c9-bfb1-62b92f332aa3 None None] MFA Rules not processed for user `0f2ba2e8375b4e8c8792ee1e22b60427`. Rule list: `[]` (Enabled: `True`). {{(pid=71938) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:442}} Nov 24 16:30:15.049182 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.fernet_utils [None req-b20e1014-fefb-40c9-bfb1-62b92f332aa3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=71938) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:289}} Nov 24 16:30:15.056968 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: [pid: 71938|app: 0|req: 117/233] 10.222.0.53 () {58 vars in 1013 bytes} [Wed Nov 24 16:30:15 2021] POST /identity/v3/auth/tokens => generated 1067 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 24 16:30:15.062649 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5303c65b-f156-46b0-b583-05dfdfc163e5 None None] Authenticating user token {{(pid=71939) process_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 24 16:30:15.072743 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5303c65b-f156-46b0-b583-05dfdfc163e5 None None] Validating token access rules against request {{(pid=71939) validate_allowed_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 24 16:30:15.076931 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4aab616-9807-45fa-bfb7-44831dde4fc4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f2ba2e8375b4e8c8792ee1e22b60427', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '00a5583c7b7443e98e7a1d31a0b638dc', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=71939) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 24 16:30:15.077737 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4aab616-9807-45fa-bfb7-44831dde4fc4 admin admin] REQUEST_METHOD: `GET` {{(pid=71939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 24 16:30:15.078093 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4aab616-9807-45fa-bfb7-44831dde4fc4 admin admin] SCRIPT_NAME: `/identity` {{(pid=71939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 24 16:30:15.078423 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4aab616-9807-45fa-bfb7-44831dde4fc4 admin admin] PATH_INFO: `/v3/roles/admin` {{(pid=71939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 24 16:30:15.090295 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4aab616-9807-45fa-bfb7-44831dde4fc4 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=71939) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:401}} Nov 24 16:30:15.097569 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: WARNING keystone.server.flask.application [None req-e4aab616-9807-45fa-bfb7-44831dde4fc4 admin admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Nov 24 16:30:15.098788 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: [pid: 71939|app: 0|req: 117/234] 10.222.0.53 () {56 vars in 1108 bytes} [Wed Nov 24 16:30:15 2021] GET /identity/v3/roles/admin => generated 83 bytes in 37 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 24 16:30:15.105272 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b20e1014-fefb-40c9-bfb1-62b92f332aa3 None None] Authenticating user token {{(pid=71938) process_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 24 16:30:15.114898 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b20e1014-fefb-40c9-bfb1-62b92f332aa3 None None] Validating token access rules against request {{(pid=71938) validate_allowed_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 24 16:30:15.119163 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bad8194-e6b3-4e17-8794-a128f45cb052 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f2ba2e8375b4e8c8792ee1e22b60427', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '00a5583c7b7443e98e7a1d31a0b638dc', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=71938) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 24 16:30:15.119827 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bad8194-e6b3-4e17-8794-a128f45cb052 admin admin] REQUEST_METHOD: `GET` {{(pid=71938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 24 16:30:15.120161 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bad8194-e6b3-4e17-8794-a128f45cb052 admin admin] SCRIPT_NAME: `/identity` {{(pid=71938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 24 16:30:15.120490 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bad8194-e6b3-4e17-8794-a128f45cb052 admin admin] PATH_INFO: `/v3/roles` {{(pid=71938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 24 16:30:15.121286 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bad8194-e6b3-4e17-8794-a128f45cb052 admin admin] RBAC: Adding query filter params (name=admin) {{(pid=71938) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:161}} Nov 24 16:30:15.121634 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bad8194-e6b3-4e17-8794-a128f45cb052 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=71938) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:442}} Nov 24 16:30:15.150326 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bad8194-e6b3-4e17-8794-a128f45cb052 admin admin] RBAC: Authorization granted {{(pid=71938) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 24 16:30:15.160902 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: [pid: 71938|app: 0|req: 118/235] 10.222.0.53 () {56 vars in 1111 bytes} [Wed Nov 24 16:30:15 2021] GET /identity/v3/roles?name=admin => generated 339 bytes in 56 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 24 16:30:15.166600 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4aab616-9807-45fa-bfb7-44831dde4fc4 admin admin] Authenticating user token {{(pid=71939) process_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 24 16:30:15.177552 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4aab616-9807-45fa-bfb7-44831dde4fc4 admin admin] Validating token access rules against request {{(pid=71939) validate_allowed_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 24 16:30:15.181835 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-680570d8-0e12-4f69-a058-2d702eccd472 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f2ba2e8375b4e8c8792ee1e22b60427', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '00a5583c7b7443e98e7a1d31a0b638dc', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=71939) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 24 16:30:15.182771 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-680570d8-0e12-4f69-a058-2d702eccd472 admin admin] REQUEST_METHOD: `GET` {{(pid=71939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 24 16:30:15.183111 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-680570d8-0e12-4f69-a058-2d702eccd472 admin admin] SCRIPT_NAME: `/identity` {{(pid=71939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 24 16:30:15.183445 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-680570d8-0e12-4f69-a058-2d702eccd472 admin admin] PATH_INFO: `/v3/users/0f2ba2e8375b4e8c8792ee1e22b60427` {{(pid=71939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 24 16:30:15.184667 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-680570d8-0e12-4f69-a058-2d702eccd472 admin admin] RBAC: Authorizing `identity:get_user(user_id=0f2ba2e8375b4e8c8792ee1e22b60427)` {{(pid=71939) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:442}} Nov 24 16:30:15.213951 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-680570d8-0e12-4f69-a058-2d702eccd472 admin admin] RBAC: Authorization granted {{(pid=71939) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 24 16:30:15.215643 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: [pid: 71939|app: 0|req: 118/236] 10.222.0.53 () {56 vars in 1189 bytes} [Wed Nov 24 16:30:15 2021] GET /identity/v3/users/0f2ba2e8375b4e8c8792ee1e22b60427 => generated 247 bytes in 50 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 24 16:30:15.221758 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bad8194-e6b3-4e17-8794-a128f45cb052 admin admin] Authenticating user token {{(pid=71938) process_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 24 16:30:15.232163 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bad8194-e6b3-4e17-8794-a128f45cb052 admin admin] Validating token access rules against request {{(pid=71938) validate_allowed_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 24 16:30:15.236361 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7439333-315f-4394-9f70-7b47aae50f4c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f2ba2e8375b4e8c8792ee1e22b60427', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '00a5583c7b7443e98e7a1d31a0b638dc', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=71938) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 24 16:30:15.237000 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7439333-315f-4394-9f70-7b47aae50f4c admin admin] REQUEST_METHOD: `GET` {{(pid=71938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 24 16:30:15.237335 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7439333-315f-4394-9f70-7b47aae50f4c admin admin] SCRIPT_NAME: `/identity` {{(pid=71938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 24 16:30:15.238287 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7439333-315f-4394-9f70-7b47aae50f4c admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=71938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 24 16:30:15.246280 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7439333-315f-4394-9f70-7b47aae50f4c admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=71938) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:442}} Nov 24 16:30:15.274418 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7439333-315f-4394-9f70-7b47aae50f4c admin admin] RBAC: Authorization granted {{(pid=71938) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 24 16:30:15.283215 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: [pid: 71938|app: 0|req: 119/237] 10.222.0.53 () {58 vars in 1315 bytes} [Wed Nov 24 16:30:15 2021] GET /identity/v3/auth/tokens => generated 1067 bytes in 62 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 24 16:30:15.289344 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-680570d8-0e12-4f69-a058-2d702eccd472 admin admin] Authenticating user token {{(pid=71939) process_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 24 16:30:15.299227 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-680570d8-0e12-4f69-a058-2d702eccd472 admin admin] Validating token access rules against request {{(pid=71939) validate_allowed_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 24 16:30:15.304050 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9efabb92-c152-44af-80db-891037128ab1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f2ba2e8375b4e8c8792ee1e22b60427', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '00a5583c7b7443e98e7a1d31a0b638dc', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=71939) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 24 16:30:15.304915 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9efabb92-c152-44af-80db-891037128ab1 admin admin] REQUEST_METHOD: `GET` {{(pid=71939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 24 16:30:15.305259 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9efabb92-c152-44af-80db-891037128ab1 admin admin] SCRIPT_NAME: `/identity` {{(pid=71939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 24 16:30:15.305595 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9efabb92-c152-44af-80db-891037128ab1 admin admin] PATH_INFO: `/v3/projects/7cdfba1dd86043ea9b1cf6498535c213` {{(pid=71939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 24 16:30:15.306825 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9efabb92-c152-44af-80db-891037128ab1 admin admin] RBAC: Authorizing `identity:get_project(project_id=7cdfba1dd86043ea9b1cf6498535c213)` {{(pid=71939) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:442}} Nov 24 16:30:15.335840 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9efabb92-c152-44af-80db-891037128ab1 admin admin] RBAC: Authorization granted {{(pid=71939) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 24 16:30:15.337476 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: [pid: 71939|app: 0|req: 119/238] 10.222.0.53 () {56 vars in 1198 bytes} [Wed Nov 24 16:30:15 2021] GET /identity/v3/projects/7cdfba1dd86043ea9b1cf6498535c213 => generated 302 bytes in 49 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 24 16:30:15.343381 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7439333-315f-4394-9f70-7b47aae50f4c admin admin] Authenticating user token {{(pid=71938) process_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 24 16:30:15.352874 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7439333-315f-4394-9f70-7b47aae50f4c admin admin] Validating token access rules against request {{(pid=71938) validate_allowed_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 24 16:30:15.357106 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4fa1329-7227-460a-8b3b-6c21d764331e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f2ba2e8375b4e8c8792ee1e22b60427', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '00a5583c7b7443e98e7a1d31a0b638dc', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=71938) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 24 16:30:15.357750 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4fa1329-7227-460a-8b3b-6c21d764331e admin admin] REQUEST_METHOD: `GET` {{(pid=71938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 24 16:30:15.358114 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4fa1329-7227-460a-8b3b-6c21d764331e admin admin] SCRIPT_NAME: `/identity` {{(pid=71938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 24 16:30:15.358451 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4fa1329-7227-460a-8b3b-6c21d764331e admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=71938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 24 16:30:15.359333 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4fa1329-7227-460a-8b3b-6c21d764331e admin admin] RBAC: Adding query filter params (role.id=5611724e350b41e19921b5961a342582, scope.project.id=7cdfba1dd86043ea9b1cf6498535c213, user.id=0f2ba2e8375b4e8c8792ee1e22b60427) {{(pid=71938) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:161}} Nov 24 16:30:15.359686 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4fa1329-7227-460a-8b3b-6c21d764331e admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=71938) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:442}} Nov 24 16:30:15.388394 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4fa1329-7227-460a-8b3b-6c21d764331e admin admin] RBAC: Authorization granted {{(pid=71938) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 24 16:30:15.394353 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: [pid: 71938|app: 0|req: 120/239] 10.222.0.53 () {56 vars in 1386 bytes} [Wed Nov 24 16:30:15 2021] GET /identity/v3/role_assignments?user.id=0f2ba2e8375b4e8c8792ee1e22b60427&scope.project.id=7cdfba1dd86043ea9b1cf6498535c213&role.id=5611724e350b41e19921b5961a342582 => generated 608 bytes in 51 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 24 16:30:17.433447 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24c40dd4-1796-4f92-b23f-100b4e0049e1 None None] REQUEST_METHOD: `GET` {{(pid=71939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 24 16:30:17.433977 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24c40dd4-1796-4f92-b23f-100b4e0049e1 None None] SCRIPT_NAME: `/identity` {{(pid=71939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 24 16:30:17.434142 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24c40dd4-1796-4f92-b23f-100b4e0049e1 None None] PATH_INFO: `/` {{(pid=71939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 24 16:30:17.435979 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: [pid: 71939|app: 0|req: 120/240] 10.222.0.53 () {54 vars in 915 bytes} [Wed Nov 24 16:30:17 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 24 16:30:17.442189 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3894a202-ddbb-4690-8560-ddca2eef699a None None] REQUEST_METHOD: `POST` {{(pid=71938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 24 16:30:17.442538 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3894a202-ddbb-4690-8560-ddca2eef699a None None] SCRIPT_NAME: `/identity` {{(pid=71938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 24 16:30:17.442873 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3894a202-ddbb-4690-8560-ddca2eef699a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=71938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 24 16:30:17.467364 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.auth.core [None req-3894a202-ddbb-4690-8560-ddca2eef699a None None] MFA Rules not processed for user `0f2ba2e8375b4e8c8792ee1e22b60427`. Rule list: `[]` (Enabled: `True`). {{(pid=71938) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:442}} Nov 24 16:30:17.468515 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.fernet_utils [None req-3894a202-ddbb-4690-8560-ddca2eef699a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=71938) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:289}} Nov 24 16:30:17.476183 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: [pid: 71938|app: 0|req: 121/241] 10.222.0.53 () {58 vars in 1013 bytes} [Wed Nov 24 16:30:17 2021] POST /identity/v3/auth/tokens => generated 1067 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 24 16:30:17.498592 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a53fcbcd-4147-477b-9188-80445e2ea9b0 None None] REQUEST_METHOD: `POST` {{(pid=71939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 24 16:30:17.498942 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a53fcbcd-4147-477b-9188-80445e2ea9b0 None None] SCRIPT_NAME: `/identity` {{(pid=71939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 24 16:30:17.499280 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a53fcbcd-4147-477b-9188-80445e2ea9b0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=71939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 24 16:30:17.522528 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.auth.core [None req-a53fcbcd-4147-477b-9188-80445e2ea9b0 None None] MFA Rules not processed for user `0f2ba2e8375b4e8c8792ee1e22b60427`. Rule list: `[]` (Enabled: `True`). {{(pid=71939) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:442}} Nov 24 16:30:17.523742 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.fernet_utils [None req-a53fcbcd-4147-477b-9188-80445e2ea9b0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=71939) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:289}} Nov 24 16:30:17.530763 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: [pid: 71939|app: 0|req: 121/242] 10.222.0.53 () {58 vars in 1013 bytes} [Wed Nov 24 16:30:17 2021] POST /identity/v3/auth/tokens => generated 1067 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 24 16:30:17.536632 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3894a202-ddbb-4690-8560-ddca2eef699a None None] Authenticating user token {{(pid=71938) process_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 24 16:30:17.546312 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3894a202-ddbb-4690-8560-ddca2eef699a None None] Validating token access rules against request {{(pid=71938) validate_allowed_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 24 16:30:17.551098 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-317563f7-cba6-410b-8f6f-f20007c715ce admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f2ba2e8375b4e8c8792ee1e22b60427', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '00a5583c7b7443e98e7a1d31a0b638dc', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=71938) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 24 16:30:17.551913 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-317563f7-cba6-410b-8f6f-f20007c715ce admin admin] REQUEST_METHOD: `GET` {{(pid=71938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 24 16:30:17.552253 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-317563f7-cba6-410b-8f6f-f20007c715ce admin admin] SCRIPT_NAME: `/identity` {{(pid=71938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 24 16:30:17.552586 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-317563f7-cba6-410b-8f6f-f20007c715ce admin admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=71938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 24 16:30:17.564244 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-317563f7-cba6-410b-8f6f-f20007c715ce admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=71938) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:401}} Nov 24 16:30:17.572003 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: WARNING keystone.server.flask.application [None req-317563f7-cba6-410b-8f6f-f20007c715ce admin admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Nov 24 16:30:17.573160 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: [pid: 71938|app: 0|req: 122/243] 10.222.0.53 () {56 vars in 1126 bytes} [Wed Nov 24 16:30:17 2021] GET /identity/v3/roles/anotherrole => generated 89 bytes in 37 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 24 16:30:17.579536 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a53fcbcd-4147-477b-9188-80445e2ea9b0 None None] Authenticating user token {{(pid=71939) process_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 24 16:30:17.588491 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a53fcbcd-4147-477b-9188-80445e2ea9b0 None None] Validating token access rules against request {{(pid=71939) validate_allowed_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 24 16:30:17.592754 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca722d33-b465-4858-a985-03446fca5c39 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f2ba2e8375b4e8c8792ee1e22b60427', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '00a5583c7b7443e98e7a1d31a0b638dc', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=71939) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 24 16:30:17.593411 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca722d33-b465-4858-a985-03446fca5c39 admin admin] REQUEST_METHOD: `GET` {{(pid=71939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 24 16:30:17.593755 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca722d33-b465-4858-a985-03446fca5c39 admin admin] SCRIPT_NAME: `/identity` {{(pid=71939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 24 16:30:17.594119 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca722d33-b465-4858-a985-03446fca5c39 admin admin] PATH_INFO: `/v3/roles` {{(pid=71939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 24 16:30:17.594928 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca722d33-b465-4858-a985-03446fca5c39 admin admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=71939) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:161}} Nov 24 16:30:17.595281 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca722d33-b465-4858-a985-03446fca5c39 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=71939) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:442}} Nov 24 16:30:17.624244 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca722d33-b465-4858-a985-03446fca5c39 admin admin] RBAC: Authorization granted {{(pid=71939) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 24 16:30:17.632931 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: [pid: 71939|app: 0|req: 122/244] 10.222.0.53 () {56 vars in 1123 bytes} [Wed Nov 24 16:30:17 2021] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 54 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 24 16:30:17.638376 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-317563f7-cba6-410b-8f6f-f20007c715ce admin admin] Authenticating user token {{(pid=71938) process_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 24 16:30:17.648431 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-317563f7-cba6-410b-8f6f-f20007c715ce admin admin] Validating token access rules against request {{(pid=71938) validate_allowed_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 24 16:30:17.652595 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1b3de66-e84d-4895-98bd-1ad1abd1d922 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f2ba2e8375b4e8c8792ee1e22b60427', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '00a5583c7b7443e98e7a1d31a0b638dc', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=71938) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 24 16:30:17.653659 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1b3de66-e84d-4895-98bd-1ad1abd1d922 admin admin] REQUEST_METHOD: `GET` {{(pid=71938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 24 16:30:17.653785 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1b3de66-e84d-4895-98bd-1ad1abd1d922 admin admin] SCRIPT_NAME: `/identity` {{(pid=71938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 24 16:30:17.654129 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1b3de66-e84d-4895-98bd-1ad1abd1d922 admin admin] PATH_INFO: `/v3/users/00c86a8d8abf438f80ab7423cb0e9a4c` {{(pid=71938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 24 16:30:17.655883 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1b3de66-e84d-4895-98bd-1ad1abd1d922 admin admin] RBAC: Authorizing `identity:get_user(user_id=00c86a8d8abf438f80ab7423cb0e9a4c)` {{(pid=71938) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:442}} Nov 24 16:30:17.685619 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1b3de66-e84d-4895-98bd-1ad1abd1d922 admin admin] RBAC: Authorization granted {{(pid=71938) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 24 16:30:17.687210 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: [pid: 71938|app: 0|req: 123/245] 10.222.0.53 () {56 vars in 1189 bytes} [Wed Nov 24 16:30:17 2021] GET /identity/v3/users/00c86a8d8abf438f80ab7423cb0e9a4c => generated 283 bytes in 49 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 24 16:30:17.692578 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca722d33-b465-4858-a985-03446fca5c39 admin admin] Authenticating user token {{(pid=71939) process_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 24 16:30:17.702186 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca722d33-b465-4858-a985-03446fca5c39 admin admin] Validating token access rules against request {{(pid=71939) validate_allowed_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 24 16:30:17.706723 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8101162-a5bb-404b-a6d9-9aed82595700 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f2ba2e8375b4e8c8792ee1e22b60427', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '00a5583c7b7443e98e7a1d31a0b638dc', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=71939) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 24 16:30:17.707360 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8101162-a5bb-404b-a6d9-9aed82595700 admin admin] REQUEST_METHOD: `GET` {{(pid=71939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 24 16:30:17.707700 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8101162-a5bb-404b-a6d9-9aed82595700 admin admin] SCRIPT_NAME: `/identity` {{(pid=71939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 24 16:30:17.708034 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8101162-a5bb-404b-a6d9-9aed82595700 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=71939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 24 16:30:17.716111 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8101162-a5bb-404b-a6d9-9aed82595700 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=71939) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:442}} Nov 24 16:30:17.745100 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8101162-a5bb-404b-a6d9-9aed82595700 admin admin] RBAC: Authorization granted {{(pid=71939) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 24 16:30:17.755979 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: [pid: 71939|app: 0|req: 123/246] 10.222.0.53 () {58 vars in 1315 bytes} [Wed Nov 24 16:30:17 2021] GET /identity/v3/auth/tokens => generated 1067 bytes in 64 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 24 16:30:17.761750 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1b3de66-e84d-4895-98bd-1ad1abd1d922 admin admin] Authenticating user token {{(pid=71938) process_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 24 16:30:17.771657 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1b3de66-e84d-4895-98bd-1ad1abd1d922 admin admin] Validating token access rules against request {{(pid=71938) validate_allowed_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 24 16:30:17.775798 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a4bac1f-0392-415a-9036-7fdce59b9034 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f2ba2e8375b4e8c8792ee1e22b60427', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '00a5583c7b7443e98e7a1d31a0b638dc', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=71938) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 24 16:30:17.776658 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a4bac1f-0392-415a-9036-7fdce59b9034 admin admin] REQUEST_METHOD: `GET` {{(pid=71938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 24 16:30:17.776988 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a4bac1f-0392-415a-9036-7fdce59b9034 admin admin] SCRIPT_NAME: `/identity` {{(pid=71938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 24 16:30:17.777314 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a4bac1f-0392-415a-9036-7fdce59b9034 admin admin] PATH_INFO: `/v3/projects/7cdfba1dd86043ea9b1cf6498535c213` {{(pid=71938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 24 16:30:17.778819 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a4bac1f-0392-415a-9036-7fdce59b9034 admin admin] RBAC: Authorizing `identity:get_project(project_id=7cdfba1dd86043ea9b1cf6498535c213)` {{(pid=71938) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:442}} Nov 24 16:30:17.807923 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a4bac1f-0392-415a-9036-7fdce59b9034 admin admin] RBAC: Authorization granted {{(pid=71938) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 24 16:30:17.809563 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: [pid: 71938|app: 0|req: 124/247] 10.222.0.53 () {56 vars in 1198 bytes} [Wed Nov 24 16:30:17 2021] GET /identity/v3/projects/7cdfba1dd86043ea9b1cf6498535c213 => generated 302 bytes in 48 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 24 16:30:17.815407 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8101162-a5bb-404b-a6d9-9aed82595700 admin admin] Authenticating user token {{(pid=71939) process_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 24 16:30:17.824396 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8101162-a5bb-404b-a6d9-9aed82595700 admin admin] Validating token access rules against request {{(pid=71939) validate_allowed_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 24 16:30:17.828935 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f82a185-d4e2-42b3-a32a-d242032b0080 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f2ba2e8375b4e8c8792ee1e22b60427', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '00a5583c7b7443e98e7a1d31a0b638dc', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=71939) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 24 16:30:17.829584 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f82a185-d4e2-42b3-a32a-d242032b0080 admin admin] REQUEST_METHOD: `GET` {{(pid=71939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 24 16:30:17.829928 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f82a185-d4e2-42b3-a32a-d242032b0080 admin admin] SCRIPT_NAME: `/identity` {{(pid=71939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 24 16:30:17.830295 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f82a185-d4e2-42b3-a32a-d242032b0080 admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=71939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 24 16:30:17.831187 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f82a185-d4e2-42b3-a32a-d242032b0080 admin admin] RBAC: Adding query filter params (role.id=0de27ef8b6e744cda429a0d133117dcd, scope.project.id=7cdfba1dd86043ea9b1cf6498535c213, user.id=00c86a8d8abf438f80ab7423cb0e9a4c) {{(pid=71939) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:161}} Nov 24 16:30:17.832057 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f82a185-d4e2-42b3-a32a-d242032b0080 admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=71939) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:442}} Nov 24 16:30:17.860747 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f82a185-d4e2-42b3-a32a-d242032b0080 admin admin] RBAC: Authorization granted {{(pid=71939) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 24 16:30:17.866306 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: [pid: 71939|app: 0|req: 124/248] 10.222.0.53 () {56 vars in 1386 bytes} [Wed Nov 24 16:30:17 2021] GET /identity/v3/role_assignments?user.id=00c86a8d8abf438f80ab7423cb0e9a4c&scope.project.id=7cdfba1dd86043ea9b1cf6498535c213&role.id=0de27ef8b6e744cda429a0d133117dcd => generated 259 bytes in 51 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 24 16:30:19.819875 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33cf6913-9ecd-46ff-b317-68f3218a86b4 None None] REQUEST_METHOD: `GET` {{(pid=71938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 24 16:30:19.820421 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33cf6913-9ecd-46ff-b317-68f3218a86b4 None None] SCRIPT_NAME: `/identity` {{(pid=71938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 24 16:30:19.820511 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33cf6913-9ecd-46ff-b317-68f3218a86b4 None None] PATH_INFO: `/` {{(pid=71938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 24 16:30:19.822371 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: [pid: 71938|app: 0|req: 125/249] 10.222.0.53 () {54 vars in 915 bytes} [Wed Nov 24 16:30:19 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 24 16:30:19.827865 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c568156-8590-4587-89fb-d6cc60fd7cf9 None None] REQUEST_METHOD: `POST` {{(pid=71939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 24 16:30:19.828214 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c568156-8590-4587-89fb-d6cc60fd7cf9 None None] SCRIPT_NAME: `/identity` {{(pid=71939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 24 16:30:19.828818 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c568156-8590-4587-89fb-d6cc60fd7cf9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=71939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 24 16:30:19.852633 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.auth.core [None req-7c568156-8590-4587-89fb-d6cc60fd7cf9 None None] MFA Rules not processed for user `0f2ba2e8375b4e8c8792ee1e22b60427`. Rule list: `[]` (Enabled: `True`). {{(pid=71939) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:442}} Nov 24 16:30:19.853846 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.fernet_utils [None req-7c568156-8590-4587-89fb-d6cc60fd7cf9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=71939) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:289}} Nov 24 16:30:19.860913 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: [pid: 71939|app: 0|req: 125/250] 10.222.0.53 () {58 vars in 1013 bytes} [Wed Nov 24 16:30:19 2021] POST /identity/v3/auth/tokens => generated 1067 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 24 16:30:19.883756 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-110e6358-e3b7-4d4f-b5b1-56811cf7b7aa None None] REQUEST_METHOD: `POST` {{(pid=71938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 24 16:30:19.884099 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-110e6358-e3b7-4d4f-b5b1-56811cf7b7aa None None] SCRIPT_NAME: `/identity` {{(pid=71938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 24 16:30:19.884436 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-110e6358-e3b7-4d4f-b5b1-56811cf7b7aa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=71938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 24 16:30:19.908636 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.auth.core [None req-110e6358-e3b7-4d4f-b5b1-56811cf7b7aa None None] MFA Rules not processed for user `0f2ba2e8375b4e8c8792ee1e22b60427`. Rule list: `[]` (Enabled: `True`). {{(pid=71938) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:442}} Nov 24 16:30:19.909894 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.fernet_utils [None req-110e6358-e3b7-4d4f-b5b1-56811cf7b7aa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=71938) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:289}} Nov 24 16:30:19.917200 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: [pid: 71938|app: 0|req: 126/251] 10.222.0.53 () {58 vars in 1013 bytes} [Wed Nov 24 16:30:19 2021] POST /identity/v3/auth/tokens => generated 1067 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 24 16:30:19.923145 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c568156-8590-4587-89fb-d6cc60fd7cf9 None None] Authenticating user token {{(pid=71939) process_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 24 16:30:19.935738 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c568156-8590-4587-89fb-d6cc60fd7cf9 None None] Validating token access rules against request {{(pid=71939) validate_allowed_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 24 16:30:19.941895 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5865bbee-10dc-489f-b18b-185cf928d9b6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f2ba2e8375b4e8c8792ee1e22b60427', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '00a5583c7b7443e98e7a1d31a0b638dc', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=71939) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 24 16:30:19.943425 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5865bbee-10dc-489f-b18b-185cf928d9b6 admin admin] REQUEST_METHOD: `GET` {{(pid=71939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 24 16:30:19.943770 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5865bbee-10dc-489f-b18b-185cf928d9b6 admin admin] SCRIPT_NAME: `/identity` {{(pid=71939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 24 16:30:19.944109 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5865bbee-10dc-489f-b18b-185cf928d9b6 admin admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=71939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 24 16:30:19.956927 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5865bbee-10dc-489f-b18b-185cf928d9b6 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=71939) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:401}} Nov 24 16:30:19.964787 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: WARNING keystone.server.flask.application [None req-5865bbee-10dc-489f-b18b-185cf928d9b6 admin admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Nov 24 16:30:19.965993 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: [pid: 71939|app: 0|req: 126/252] 10.222.0.53 () {56 vars in 1126 bytes} [Wed Nov 24 16:30:19 2021] GET /identity/v3/roles/anotherrole => generated 89 bytes in 43 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 24 16:30:19.972670 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-110e6358-e3b7-4d4f-b5b1-56811cf7b7aa None None] Authenticating user token {{(pid=71938) process_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 24 16:30:19.981878 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-110e6358-e3b7-4d4f-b5b1-56811cf7b7aa None None] Validating token access rules against request {{(pid=71938) validate_allowed_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 24 16:30:19.986177 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eaa0855d-4432-46bb-9b97-60449385288d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f2ba2e8375b4e8c8792ee1e22b60427', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '00a5583c7b7443e98e7a1d31a0b638dc', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=71938) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 24 16:30:19.986846 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaa0855d-4432-46bb-9b97-60449385288d admin admin] REQUEST_METHOD: `GET` {{(pid=71938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 24 16:30:19.987189 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaa0855d-4432-46bb-9b97-60449385288d admin admin] SCRIPT_NAME: `/identity` {{(pid=71938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 24 16:30:19.987532 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaa0855d-4432-46bb-9b97-60449385288d admin admin] PATH_INFO: `/v3/roles` {{(pid=71938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 24 16:30:19.988340 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eaa0855d-4432-46bb-9b97-60449385288d admin admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=71938) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:161}} Nov 24 16:30:19.988692 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eaa0855d-4432-46bb-9b97-60449385288d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=71938) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:442}} Nov 24 16:30:20.017273 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eaa0855d-4432-46bb-9b97-60449385288d admin admin] RBAC: Authorization granted {{(pid=71938) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 24 16:30:20.026994 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: [pid: 71938|app: 0|req: 127/253] 10.222.0.53 () {56 vars in 1123 bytes} [Wed Nov 24 16:30:19 2021] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 55 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 24 16:30:20.032791 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5865bbee-10dc-489f-b18b-185cf928d9b6 admin admin] Authenticating user token {{(pid=71939) process_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 24 16:30:20.043231 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5865bbee-10dc-489f-b18b-185cf928d9b6 admin admin] Validating token access rules against request {{(pid=71939) validate_allowed_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 24 16:30:20.047422 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b09f151-eea0-40bf-90e8-326d180e35c5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f2ba2e8375b4e8c8792ee1e22b60427', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '00a5583c7b7443e98e7a1d31a0b638dc', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=71939) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 24 16:30:20.048294 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b09f151-eea0-40bf-90e8-326d180e35c5 admin admin] REQUEST_METHOD: `GET` {{(pid=71939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 24 16:30:20.048632 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b09f151-eea0-40bf-90e8-326d180e35c5 admin admin] SCRIPT_NAME: `/identity` {{(pid=71939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 24 16:30:20.048964 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b09f151-eea0-40bf-90e8-326d180e35c5 admin admin] PATH_INFO: `/v3/users/00c86a8d8abf438f80ab7423cb0e9a4c` {{(pid=71939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 24 16:30:20.050210 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b09f151-eea0-40bf-90e8-326d180e35c5 admin admin] RBAC: Authorizing `identity:get_user(user_id=00c86a8d8abf438f80ab7423cb0e9a4c)` {{(pid=71939) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:442}} Nov 24 16:30:20.079662 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b09f151-eea0-40bf-90e8-326d180e35c5 admin admin] RBAC: Authorization granted {{(pid=71939) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 24 16:30:20.081969 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: [pid: 71939|app: 0|req: 127/254] 10.222.0.53 () {56 vars in 1189 bytes} [Wed Nov 24 16:30:20 2021] GET /identity/v3/users/00c86a8d8abf438f80ab7423cb0e9a4c => generated 283 bytes in 49 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 24 16:30:20.089314 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eaa0855d-4432-46bb-9b97-60449385288d admin admin] Authenticating user token {{(pid=71938) process_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 24 16:30:20.099500 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eaa0855d-4432-46bb-9b97-60449385288d admin admin] Validating token access rules against request {{(pid=71938) validate_allowed_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 24 16:30:20.103895 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-331325ce-9511-460d-83b9-a3202710d266 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f2ba2e8375b4e8c8792ee1e22b60427', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '00a5583c7b7443e98e7a1d31a0b638dc', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=71938) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 24 16:30:20.104779 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-331325ce-9511-460d-83b9-a3202710d266 admin admin] REQUEST_METHOD: `GET` {{(pid=71938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 24 16:30:20.105120 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-331325ce-9511-460d-83b9-a3202710d266 admin admin] SCRIPT_NAME: `/identity` {{(pid=71938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 24 16:30:20.105458 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-331325ce-9511-460d-83b9-a3202710d266 admin admin] PATH_INFO: `/v3/projects/7cdfba1dd86043ea9b1cf6498535c213` {{(pid=71938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 24 16:30:20.106705 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-331325ce-9511-460d-83b9-a3202710d266 admin admin] RBAC: Authorizing `identity:get_project(project_id=7cdfba1dd86043ea9b1cf6498535c213)` {{(pid=71938) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:442}} Nov 24 16:30:20.136668 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-331325ce-9511-460d-83b9-a3202710d266 admin admin] RBAC: Authorization granted {{(pid=71938) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 24 16:30:20.138536 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: [pid: 71938|app: 0|req: 128/255] 10.222.0.53 () {56 vars in 1198 bytes} [Wed Nov 24 16:30:20 2021] GET /identity/v3/projects/7cdfba1dd86043ea9b1cf6498535c213 => generated 302 bytes in 50 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 24 16:30:20.144682 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b09f151-eea0-40bf-90e8-326d180e35c5 admin admin] Authenticating user token {{(pid=71939) process_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 24 16:30:20.155326 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b09f151-eea0-40bf-90e8-326d180e35c5 admin admin] Validating token access rules against request {{(pid=71939) validate_allowed_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 24 16:30:20.160946 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87666b95-b5cc-47af-b634-7f148f5eaa10 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f2ba2e8375b4e8c8792ee1e22b60427', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '00a5583c7b7443e98e7a1d31a0b638dc', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=71939) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 24 16:30:20.161865 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87666b95-b5cc-47af-b634-7f148f5eaa10 admin admin] REQUEST_METHOD: `PUT` {{(pid=71939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 24 16:30:20.162260 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87666b95-b5cc-47af-b634-7f148f5eaa10 admin admin] SCRIPT_NAME: `/identity` {{(pid=71939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 24 16:30:20.162603 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87666b95-b5cc-47af-b634-7f148f5eaa10 admin admin] PATH_INFO: `/v3/projects/7cdfba1dd86043ea9b1cf6498535c213/users/00c86a8d8abf438f80ab7423cb0e9a4c/roles/0de27ef8b6e744cda429a0d133117dcd` {{(pid=71939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 24 16:30:20.164834 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87666b95-b5cc-47af-b634-7f148f5eaa10 admin admin] RBAC: Authorizing `identity:create_grant(project_id=7cdfba1dd86043ea9b1cf6498535c213, user_id=00c86a8d8abf438f80ab7423cb0e9a4c, role_id=0de27ef8b6e744cda429a0d133117dcd)` {{(pid=71939) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:442}} Nov 24 16:30:20.195330 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87666b95-b5cc-47af-b634-7f148f5eaa10 admin admin] RBAC: Authorization granted {{(pid=71939) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 24 16:30:20.212317 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: [pid: 71939|app: 0|req: 128/256] 10.222.0.53 () {58 vars in 1451 bytes} [Wed Nov 24 16:30:20 2021] PUT /identity/v3/projects/7cdfba1dd86043ea9b1cf6498535c213/users/00c86a8d8abf438f80ab7423cb0e9a4c/roles/0de27ef8b6e744cda429a0d133117dcd => generated 0 bytes in 68 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 24 16:30:22.198102 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae3bb266-c8c9-45fb-891a-6d2fa06e5a89 None None] REQUEST_METHOD: `GET` {{(pid=71938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 24 16:30:22.198661 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae3bb266-c8c9-45fb-891a-6d2fa06e5a89 None None] SCRIPT_NAME: `/identity` {{(pid=71938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 24 16:30:22.198750 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae3bb266-c8c9-45fb-891a-6d2fa06e5a89 None None] PATH_INFO: `/` {{(pid=71938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 24 16:30:22.200607 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: [pid: 71938|app: 0|req: 129/257] 10.222.0.53 () {54 vars in 915 bytes} [Wed Nov 24 16:30:22 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 24 16:30:22.206602 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce8074a7-7430-4f45-8333-21e99e245abb None None] REQUEST_METHOD: `POST` {{(pid=71939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 24 16:30:22.206957 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce8074a7-7430-4f45-8333-21e99e245abb None None] SCRIPT_NAME: `/identity` {{(pid=71939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 24 16:30:22.207307 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce8074a7-7430-4f45-8333-21e99e245abb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=71939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 24 16:30:22.231222 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.auth.core [None req-ce8074a7-7430-4f45-8333-21e99e245abb None None] MFA Rules not processed for user `0f2ba2e8375b4e8c8792ee1e22b60427`. Rule list: `[]` (Enabled: `True`). {{(pid=71939) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:442}} Nov 24 16:30:22.232490 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.fernet_utils [None req-ce8074a7-7430-4f45-8333-21e99e245abb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=71939) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:289}} Nov 24 16:30:22.301529 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: [pid: 71939|app: 0|req: 129/258] 10.222.0.53 () {58 vars in 1013 bytes} [Wed Nov 24 16:30:22 2021] POST /identity/v3/auth/tokens => generated 1067 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 24 16:30:22.324776 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad945d29-755c-4fa2-b934-9de76119f6a3 None None] REQUEST_METHOD: `POST` {{(pid=71938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 24 16:30:22.325120 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad945d29-755c-4fa2-b934-9de76119f6a3 None None] SCRIPT_NAME: `/identity` {{(pid=71938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 24 16:30:22.325459 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad945d29-755c-4fa2-b934-9de76119f6a3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=71938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 24 16:30:22.350670 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.auth.core [None req-ad945d29-755c-4fa2-b934-9de76119f6a3 None None] MFA Rules not processed for user `0f2ba2e8375b4e8c8792ee1e22b60427`. Rule list: `[]` (Enabled: `True`). {{(pid=71938) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:442}} Nov 24 16:30:22.351874 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.fernet_utils [None req-ad945d29-755c-4fa2-b934-9de76119f6a3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=71938) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:289}} Nov 24 16:30:22.358923 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: [pid: 71938|app: 0|req: 130/259] 10.222.0.53 () {58 vars in 1013 bytes} [Wed Nov 24 16:30:22 2021] POST /identity/v3/auth/tokens => generated 1067 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 24 16:30:22.364671 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce8074a7-7430-4f45-8333-21e99e245abb None None] Authenticating user token {{(pid=71939) process_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 24 16:30:22.374257 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce8074a7-7430-4f45-8333-21e99e245abb None None] Validating token access rules against request {{(pid=71939) validate_allowed_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 24 16:30:22.378473 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7aa19b91-b142-4f08-ad25-b7f56d5ccf88 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f2ba2e8375b4e8c8792ee1e22b60427', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '00a5583c7b7443e98e7a1d31a0b638dc', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=71939) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 24 16:30:22.379292 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7aa19b91-b142-4f08-ad25-b7f56d5ccf88 admin admin] REQUEST_METHOD: `GET` {{(pid=71939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 24 16:30:22.379632 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7aa19b91-b142-4f08-ad25-b7f56d5ccf88 admin admin] SCRIPT_NAME: `/identity` {{(pid=71939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 24 16:30:22.379965 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7aa19b91-b142-4f08-ad25-b7f56d5ccf88 admin admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=71939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 24 16:30:22.391615 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7aa19b91-b142-4f08-ad25-b7f56d5ccf88 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=71939) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:401}} Nov 24 16:30:22.399943 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: WARNING keystone.server.flask.application [None req-7aa19b91-b142-4f08-ad25-b7f56d5ccf88 admin admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Nov 24 16:30:22.401116 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: [pid: 71939|app: 0|req: 130/260] 10.222.0.53 () {56 vars in 1126 bytes} [Wed Nov 24 16:30:22 2021] GET /identity/v3/roles/anotherrole => generated 89 bytes in 37 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 24 16:30:22.407305 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad945d29-755c-4fa2-b934-9de76119f6a3 None None] Authenticating user token {{(pid=71938) process_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 24 16:30:22.417006 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad945d29-755c-4fa2-b934-9de76119f6a3 None None] Validating token access rules against request {{(pid=71938) validate_allowed_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 24 16:30:22.421277 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94bc4070-b7b1-4fe9-b65e-6d6e9736faff admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f2ba2e8375b4e8c8792ee1e22b60427', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '00a5583c7b7443e98e7a1d31a0b638dc', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=71938) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 24 16:30:22.421948 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94bc4070-b7b1-4fe9-b65e-6d6e9736faff admin admin] REQUEST_METHOD: `GET` {{(pid=71938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 24 16:30:22.422318 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94bc4070-b7b1-4fe9-b65e-6d6e9736faff admin admin] SCRIPT_NAME: `/identity` {{(pid=71938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 24 16:30:22.422659 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94bc4070-b7b1-4fe9-b65e-6d6e9736faff admin admin] PATH_INFO: `/v3/roles` {{(pid=71938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 24 16:30:22.423467 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94bc4070-b7b1-4fe9-b65e-6d6e9736faff admin admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=71938) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:161}} Nov 24 16:30:22.423822 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94bc4070-b7b1-4fe9-b65e-6d6e9736faff admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=71938) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:442}} Nov 24 16:30:22.451971 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94bc4070-b7b1-4fe9-b65e-6d6e9736faff admin admin] RBAC: Authorization granted {{(pid=71938) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 24 16:30:22.461604 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: [pid: 71938|app: 0|req: 131/261] 10.222.0.53 () {56 vars in 1123 bytes} [Wed Nov 24 16:30:22 2021] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 55 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 24 16:30:22.467323 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7aa19b91-b142-4f08-ad25-b7f56d5ccf88 admin admin] Authenticating user token {{(pid=71939) process_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 24 16:30:22.478190 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7aa19b91-b142-4f08-ad25-b7f56d5ccf88 admin admin] Validating token access rules against request {{(pid=71939) validate_allowed_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 24 16:30:22.482570 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-154478ce-96cd-4261-bff0-fb6ea1523dbe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f2ba2e8375b4e8c8792ee1e22b60427', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '00a5583c7b7443e98e7a1d31a0b638dc', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=71939) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 24 16:30:22.483437 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-154478ce-96cd-4261-bff0-fb6ea1523dbe admin admin] REQUEST_METHOD: `GET` {{(pid=71939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 24 16:30:22.483780 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-154478ce-96cd-4261-bff0-fb6ea1523dbe admin admin] SCRIPT_NAME: `/identity` {{(pid=71939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 24 16:30:22.484113 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-154478ce-96cd-4261-bff0-fb6ea1523dbe admin admin] PATH_INFO: `/v3/users/00c86a8d8abf438f80ab7423cb0e9a4c` {{(pid=71939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 24 16:30:22.485330 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-154478ce-96cd-4261-bff0-fb6ea1523dbe admin admin] RBAC: Authorizing `identity:get_user(user_id=00c86a8d8abf438f80ab7423cb0e9a4c)` {{(pid=71939) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:442}} Nov 24 16:30:22.514213 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-154478ce-96cd-4261-bff0-fb6ea1523dbe admin admin] RBAC: Authorization granted {{(pid=71939) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 24 16:30:22.515849 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: [pid: 71939|app: 0|req: 131/262] 10.222.0.53 () {56 vars in 1189 bytes} [Wed Nov 24 16:30:22 2021] GET /identity/v3/users/00c86a8d8abf438f80ab7423cb0e9a4c => generated 283 bytes in 49 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 24 16:30:22.522164 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94bc4070-b7b1-4fe9-b65e-6d6e9736faff admin admin] Authenticating user token {{(pid=71938) process_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 24 16:30:22.532066 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94bc4070-b7b1-4fe9-b65e-6d6e9736faff admin admin] Validating token access rules against request {{(pid=71938) validate_allowed_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 24 16:30:22.536990 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-105ca28e-3761-4807-982c-9fdc1e2d03be admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f2ba2e8375b4e8c8792ee1e22b60427', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '00a5583c7b7443e98e7a1d31a0b638dc', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=71938) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 24 16:30:22.537644 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-105ca28e-3761-4807-982c-9fdc1e2d03be admin admin] REQUEST_METHOD: `GET` {{(pid=71938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 24 16:30:22.537988 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-105ca28e-3761-4807-982c-9fdc1e2d03be admin admin] SCRIPT_NAME: `/identity` {{(pid=71938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 24 16:30:22.538376 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-105ca28e-3761-4807-982c-9fdc1e2d03be admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=71938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 24 16:30:22.546726 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-105ca28e-3761-4807-982c-9fdc1e2d03be admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=71938) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:442}} Nov 24 16:30:22.583670 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-105ca28e-3761-4807-982c-9fdc1e2d03be admin admin] RBAC: Authorization granted {{(pid=71938) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 24 16:30:22.596275 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: [pid: 71938|app: 0|req: 132/263] 10.222.0.53 () {58 vars in 1315 bytes} [Wed Nov 24 16:30:22 2021] GET /identity/v3/auth/tokens => generated 1067 bytes in 75 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 24 16:30:22.603742 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-154478ce-96cd-4261-bff0-fb6ea1523dbe admin admin] Authenticating user token {{(pid=71939) process_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 24 16:30:22.614812 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-154478ce-96cd-4261-bff0-fb6ea1523dbe admin admin] Validating token access rules against request {{(pid=71939) validate_allowed_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 24 16:30:22.619878 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31c37b4e-4f88-4e75-aa88-278a293f4785 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f2ba2e8375b4e8c8792ee1e22b60427', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '00a5583c7b7443e98e7a1d31a0b638dc', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=71939) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 24 16:30:22.620981 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31c37b4e-4f88-4e75-aa88-278a293f4785 admin admin] REQUEST_METHOD: `GET` {{(pid=71939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 24 16:30:22.621235 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31c37b4e-4f88-4e75-aa88-278a293f4785 admin admin] SCRIPT_NAME: `/identity` {{(pid=71939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 24 16:30:22.621575 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31c37b4e-4f88-4e75-aa88-278a293f4785 admin admin] PATH_INFO: `/v3/projects/7cdfba1dd86043ea9b1cf6498535c213` {{(pid=71939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 24 16:30:22.623347 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31c37b4e-4f88-4e75-aa88-278a293f4785 admin admin] RBAC: Authorizing `identity:get_project(project_id=7cdfba1dd86043ea9b1cf6498535c213)` {{(pid=71939) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:442}} Nov 24 16:30:22.655542 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31c37b4e-4f88-4e75-aa88-278a293f4785 admin admin] RBAC: Authorization granted {{(pid=71939) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 24 16:30:22.657376 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: [pid: 71939|app: 0|req: 132/264] 10.222.0.53 () {56 vars in 1198 bytes} [Wed Nov 24 16:30:22 2021] GET /identity/v3/projects/7cdfba1dd86043ea9b1cf6498535c213 => generated 302 bytes in 54 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 24 16:30:22.664337 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-105ca28e-3761-4807-982c-9fdc1e2d03be admin admin] Authenticating user token {{(pid=71938) process_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 24 16:30:22.673800 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-105ca28e-3761-4807-982c-9fdc1e2d03be admin admin] Validating token access rules against request {{(pid=71938) validate_allowed_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 24 16:30:22.678057 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b81a51ec-498f-465a-98b6-be2543357d6d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f2ba2e8375b4e8c8792ee1e22b60427', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '00a5583c7b7443e98e7a1d31a0b638dc', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=71938) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 24 16:30:22.678744 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b81a51ec-498f-465a-98b6-be2543357d6d admin admin] REQUEST_METHOD: `GET` {{(pid=71938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 24 16:30:22.679084 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b81a51ec-498f-465a-98b6-be2543357d6d admin admin] SCRIPT_NAME: `/identity` {{(pid=71938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 24 16:30:22.679423 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b81a51ec-498f-465a-98b6-be2543357d6d admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=71938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 24 16:30:22.680309 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b81a51ec-498f-465a-98b6-be2543357d6d admin admin] RBAC: Adding query filter params (role.id=0de27ef8b6e744cda429a0d133117dcd, scope.project.id=7cdfba1dd86043ea9b1cf6498535c213, user.id=00c86a8d8abf438f80ab7423cb0e9a4c) {{(pid=71938) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:161}} Nov 24 16:30:22.680667 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b81a51ec-498f-465a-98b6-be2543357d6d admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=71938) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:442}} Nov 24 16:30:22.711009 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b81a51ec-498f-465a-98b6-be2543357d6d admin admin] RBAC: Authorization granted {{(pid=71938) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 24 16:30:22.717766 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: [pid: 71938|app: 0|req: 133/265] 10.222.0.53 () {56 vars in 1386 bytes} [Wed Nov 24 16:30:22 2021] GET /identity/v3/role_assignments?user.id=00c86a8d8abf438f80ab7423cb0e9a4c&scope.project.id=7cdfba1dd86043ea9b1cf6498535c213&role.id=0de27ef8b6e744cda429a0d133117dcd => generated 608 bytes in 54 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 24 16:30:24.755512 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51467f80-bbe5-4252-bdbe-0c5a6a1f9916 None None] REQUEST_METHOD: `GET` {{(pid=71939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 24 16:30:24.756030 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51467f80-bbe5-4252-bdbe-0c5a6a1f9916 None None] SCRIPT_NAME: `/identity` {{(pid=71939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 24 16:30:24.756177 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51467f80-bbe5-4252-bdbe-0c5a6a1f9916 None None] PATH_INFO: `/` {{(pid=71939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 24 16:30:24.757995 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: [pid: 71939|app: 0|req: 133/266] 10.222.0.53 () {54 vars in 915 bytes} [Wed Nov 24 16:30:24 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 24 16:30:24.763430 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e43dfb5d-a708-4186-8217-53f929d32488 None None] REQUEST_METHOD: `POST` {{(pid=71938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 24 16:30:24.763784 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e43dfb5d-a708-4186-8217-53f929d32488 None None] SCRIPT_NAME: `/identity` {{(pid=71938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 24 16:30:24.764121 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e43dfb5d-a708-4186-8217-53f929d32488 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=71938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 24 16:30:24.788490 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.auth.core [None req-e43dfb5d-a708-4186-8217-53f929d32488 None None] MFA Rules not processed for user `0f2ba2e8375b4e8c8792ee1e22b60427`. Rule list: `[]` (Enabled: `True`). {{(pid=71938) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:442}} Nov 24 16:30:24.789716 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.fernet_utils [None req-e43dfb5d-a708-4186-8217-53f929d32488 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=71938) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:289}} Nov 24 16:30:24.796841 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: [pid: 71938|app: 0|req: 134/267] 10.222.0.53 () {58 vars in 1013 bytes} [Wed Nov 24 16:30:24 2021] POST /identity/v3/auth/tokens => generated 1067 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 24 16:30:24.820188 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c932fd6-16db-4acc-a4d5-a15a0a2dffdf None None] REQUEST_METHOD: `POST` {{(pid=71939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 24 16:30:24.820592 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c932fd6-16db-4acc-a4d5-a15a0a2dffdf None None] SCRIPT_NAME: `/identity` {{(pid=71939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 24 16:30:24.820840 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c932fd6-16db-4acc-a4d5-a15a0a2dffdf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=71939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 24 16:30:24.846138 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.auth.core [None req-1c932fd6-16db-4acc-a4d5-a15a0a2dffdf None None] MFA Rules not processed for user `0f2ba2e8375b4e8c8792ee1e22b60427`. Rule list: `[]` (Enabled: `True`). {{(pid=71939) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:442}} Nov 24 16:30:24.847408 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.fernet_utils [None req-1c932fd6-16db-4acc-a4d5-a15a0a2dffdf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=71939) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:289}} Nov 24 16:30:24.854490 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: [pid: 71939|app: 0|req: 134/268] 10.222.0.53 () {58 vars in 1013 bytes} [Wed Nov 24 16:30:24 2021] POST /identity/v3/auth/tokens => generated 1067 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 24 16:30:24.860673 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e43dfb5d-a708-4186-8217-53f929d32488 None None] Authenticating user token {{(pid=71938) process_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 24 16:30:24.871064 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e43dfb5d-a708-4186-8217-53f929d32488 None None] Validating token access rules against request {{(pid=71938) validate_allowed_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 24 16:30:24.875313 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b24d6072-1f05-47d7-8c88-db2d5e8e058d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f2ba2e8375b4e8c8792ee1e22b60427', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '00a5583c7b7443e98e7a1d31a0b638dc', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=71938) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 24 16:30:24.876123 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b24d6072-1f05-47d7-8c88-db2d5e8e058d admin admin] REQUEST_METHOD: `GET` {{(pid=71938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 24 16:30:24.876465 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b24d6072-1f05-47d7-8c88-db2d5e8e058d admin admin] SCRIPT_NAME: `/identity` {{(pid=71938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 24 16:30:24.876807 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b24d6072-1f05-47d7-8c88-db2d5e8e058d admin admin] PATH_INFO: `/v3/domains/default` {{(pid=71938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 24 16:30:24.879505 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b24d6072-1f05-47d7-8c88-db2d5e8e058d admin admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=71938) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:442}} Nov 24 16:30:24.907719 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b24d6072-1f05-47d7-8c88-db2d5e8e058d admin admin] RBAC: Authorization granted {{(pid=71938) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 24 16:30:24.909394 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: [pid: 71938|app: 0|req: 135/269] 10.222.0.53 () {56 vars in 1120 bytes} [Wed Nov 24 16:30:24 2021] GET /identity/v3/domains/default => generated 199 bytes in 49 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 24 16:30:24.915336 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c932fd6-16db-4acc-a4d5-a15a0a2dffdf None None] Authenticating user token {{(pid=71939) process_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 24 16:30:24.924820 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c932fd6-16db-4acc-a4d5-a15a0a2dffdf None None] Validating token access rules against request {{(pid=71939) validate_allowed_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 24 16:30:24.929632 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d9ebb91-b3a4-4394-a77c-cf9ea3a531f8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f2ba2e8375b4e8c8792ee1e22b60427', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '00a5583c7b7443e98e7a1d31a0b638dc', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=71939) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 24 16:30:24.930352 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d9ebb91-b3a4-4394-a77c-cf9ea3a531f8 admin admin] REQUEST_METHOD: `POST` {{(pid=71939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 24 16:30:24.930692 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d9ebb91-b3a4-4394-a77c-cf9ea3a531f8 admin admin] SCRIPT_NAME: `/identity` {{(pid=71939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 24 16:30:24.931028 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d9ebb91-b3a4-4394-a77c-cf9ea3a531f8 admin admin] PATH_INFO: `/v3/groups` {{(pid=71939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 24 16:30:24.931769 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d9ebb91-b3a4-4394-a77c-cf9ea3a531f8 admin admin] RBAC: Authorizing `identity:create_group()` {{(pid=71939) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:442}} Nov 24 16:30:24.959978 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: WARNING py.warnings [None req-6d9ebb91-b3a4-4394-a77c-cf9ea3a531f8 admin admin] /usr/local/lib/python3.6/dist-packages/oslo_policy/policy.py:1018: UserWarning: Policy identity:create_group failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Nov 24 16:30:24.959978 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: warnings.warn(msg) Nov 24 16:30:24.959978 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: Nov 24 16:30:24.961332 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d9ebb91-b3a4-4394-a77c-cf9ea3a531f8 admin admin] RBAC: Authorization granted {{(pid=71939) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 24 16:30:24.976958 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: [pid: 71939|app: 0|req: 135/270] 10.222.0.53 () {60 vars in 1146 bytes} [Wed Nov 24 16:30:24 2021] POST /identity/v3/groups => generated 229 bytes in 62 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 24 16:30:27.000529 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa95b165-1dd3-4739-bf62-47064c6348e8 None None] REQUEST_METHOD: `GET` {{(pid=71938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 24 16:30:27.001083 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa95b165-1dd3-4739-bf62-47064c6348e8 None None] SCRIPT_NAME: `/identity` {{(pid=71938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 24 16:30:27.001179 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa95b165-1dd3-4739-bf62-47064c6348e8 None None] PATH_INFO: `/` {{(pid=71938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 24 16:30:27.003096 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: [pid: 71938|app: 0|req: 136/271] 10.222.0.53 () {54 vars in 915 bytes} [Wed Nov 24 16:30:26 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 24 16:30:27.008860 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc83b677-8cf6-43f6-abe8-f3a42444c5ea None None] REQUEST_METHOD: `POST` {{(pid=71939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 24 16:30:27.009205 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc83b677-8cf6-43f6-abe8-f3a42444c5ea None None] SCRIPT_NAME: `/identity` {{(pid=71939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 24 16:30:27.009553 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc83b677-8cf6-43f6-abe8-f3a42444c5ea None None] PATH_INFO: `/v3/auth/tokens` {{(pid=71939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 24 16:30:27.033641 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.auth.core [None req-dc83b677-8cf6-43f6-abe8-f3a42444c5ea None None] MFA Rules not processed for user `0f2ba2e8375b4e8c8792ee1e22b60427`. Rule list: `[]` (Enabled: `True`). {{(pid=71939) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:442}} Nov 24 16:30:27.035469 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.fernet_utils [None req-dc83b677-8cf6-43f6-abe8-f3a42444c5ea None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=71939) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:289}} Nov 24 16:30:27.043033 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: [pid: 71939|app: 0|req: 136/272] 10.222.0.53 () {58 vars in 1013 bytes} [Wed Nov 24 16:30:27 2021] POST /identity/v3/auth/tokens => generated 1067 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 24 16:30:27.065137 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86f8a934-3314-41c9-afe8-d5d02a286a39 None None] REQUEST_METHOD: `POST` {{(pid=71938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 24 16:30:27.065479 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86f8a934-3314-41c9-afe8-d5d02a286a39 None None] SCRIPT_NAME: `/identity` {{(pid=71938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 24 16:30:27.065819 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86f8a934-3314-41c9-afe8-d5d02a286a39 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=71938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 24 16:30:27.090648 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.auth.core [None req-86f8a934-3314-41c9-afe8-d5d02a286a39 None None] MFA Rules not processed for user `0f2ba2e8375b4e8c8792ee1e22b60427`. Rule list: `[]` (Enabled: `True`). {{(pid=71938) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:442}} Nov 24 16:30:27.091896 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.fernet_utils [None req-86f8a934-3314-41c9-afe8-d5d02a286a39 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=71938) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:289}} Nov 24 16:30:27.099812 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: [pid: 71938|app: 0|req: 137/273] 10.222.0.53 () {58 vars in 1013 bytes} [Wed Nov 24 16:30:27 2021] POST /identity/v3/auth/tokens => generated 1067 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 24 16:30:27.105618 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc83b677-8cf6-43f6-abe8-f3a42444c5ea None None] Authenticating user token {{(pid=71939) process_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 24 16:30:27.115250 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc83b677-8cf6-43f6-abe8-f3a42444c5ea None None] Validating token access rules against request {{(pid=71939) validate_allowed_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 24 16:30:27.119423 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-307a155c-3160-4dd6-b5ca-1596d2b61364 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f2ba2e8375b4e8c8792ee1e22b60427', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '00a5583c7b7443e98e7a1d31a0b638dc', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=71939) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 24 16:30:27.120235 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-307a155c-3160-4dd6-b5ca-1596d2b61364 admin admin] REQUEST_METHOD: `GET` {{(pid=71939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 24 16:30:27.120574 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-307a155c-3160-4dd6-b5ca-1596d2b61364 admin admin] SCRIPT_NAME: `/identity` {{(pid=71939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 24 16:30:27.120906 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-307a155c-3160-4dd6-b5ca-1596d2b61364 admin admin] PATH_INFO: `/v3/domains/default` {{(pid=71939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 24 16:30:27.122101 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-307a155c-3160-4dd6-b5ca-1596d2b61364 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=71939) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:442}} Nov 24 16:30:27.150751 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-307a155c-3160-4dd6-b5ca-1596d2b61364 admin admin] RBAC: Authorization granted {{(pid=71939) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 24 16:30:27.152488 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: [pid: 71939|app: 0|req: 137/274] 10.222.0.53 () {56 vars in 1120 bytes} [Wed Nov 24 16:30:27 2021] GET /identity/v3/domains/default => generated 199 bytes in 47 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 24 16:30:27.158582 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86f8a934-3314-41c9-afe8-d5d02a286a39 None None] Authenticating user token {{(pid=71938) process_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 24 16:30:27.168771 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86f8a934-3314-41c9-afe8-d5d02a286a39 None None] Validating token access rules against request {{(pid=71938) validate_allowed_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 24 16:30:27.173223 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c19518fb-bc22-44d0-ae25-fca6dea5aeec admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f2ba2e8375b4e8c8792ee1e22b60427', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '00a5583c7b7443e98e7a1d31a0b638dc', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=71938) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 24 16:30:27.173926 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c19518fb-bc22-44d0-ae25-fca6dea5aeec admin admin] REQUEST_METHOD: `POST` {{(pid=71938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 24 16:30:27.174300 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c19518fb-bc22-44d0-ae25-fca6dea5aeec admin admin] SCRIPT_NAME: `/identity` {{(pid=71938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 24 16:30:27.174636 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c19518fb-bc22-44d0-ae25-fca6dea5aeec admin admin] PATH_INFO: `/v3/groups` {{(pid=71938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 24 16:30:27.175401 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c19518fb-bc22-44d0-ae25-fca6dea5aeec admin admin] RBAC: Authorizing `identity:create_group()` {{(pid=71938) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:442}} Nov 24 16:30:27.203942 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: WARNING py.warnings [None req-c19518fb-bc22-44d0-ae25-fca6dea5aeec admin admin] /usr/local/lib/python3.6/dist-packages/oslo_policy/policy.py:1018: UserWarning: Policy identity:create_group failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Nov 24 16:30:27.203942 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: warnings.warn(msg) Nov 24 16:30:27.203942 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: Nov 24 16:30:27.205339 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c19518fb-bc22-44d0-ae25-fca6dea5aeec admin admin] RBAC: Authorization granted {{(pid=71938) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 24 16:30:27.221602 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: [pid: 71938|app: 0|req: 138/275] 10.222.0.53 () {60 vars in 1146 bytes} [Wed Nov 24 16:30:27 2021] POST /identity/v3/groups => generated 226 bytes in 64 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 24 16:30:29.229073 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58e549fc-78b3-4b3a-88a5-6183b30ad6d7 None None] REQUEST_METHOD: `GET` {{(pid=71939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 24 16:30:29.229512 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58e549fc-78b3-4b3a-88a5-6183b30ad6d7 None None] SCRIPT_NAME: `/identity` {{(pid=71939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 24 16:30:29.229740 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58e549fc-78b3-4b3a-88a5-6183b30ad6d7 None None] PATH_INFO: `/` {{(pid=71939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 24 16:30:29.231713 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: [pid: 71939|app: 0|req: 138/276] 10.222.0.53 () {54 vars in 915 bytes} [Wed Nov 24 16:30:29 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 24 16:30:29.237861 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-754ad80f-b422-48d5-9452-754ef12cbefa None None] REQUEST_METHOD: `POST` {{(pid=71938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 24 16:30:29.238259 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-754ad80f-b422-48d5-9452-754ef12cbefa None None] SCRIPT_NAME: `/identity` {{(pid=71938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 24 16:30:29.238599 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-754ad80f-b422-48d5-9452-754ef12cbefa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=71938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 24 16:30:29.262517 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.auth.core [None req-754ad80f-b422-48d5-9452-754ef12cbefa None None] MFA Rules not processed for user `0f2ba2e8375b4e8c8792ee1e22b60427`. Rule list: `[]` (Enabled: `True`). {{(pid=71938) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:442}} Nov 24 16:30:29.263684 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.fernet_utils [None req-754ad80f-b422-48d5-9452-754ef12cbefa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=71938) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:289}} Nov 24 16:30:29.270875 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: [pid: 71938|app: 0|req: 139/277] 10.222.0.53 () {58 vars in 1013 bytes} [Wed Nov 24 16:30:29 2021] POST /identity/v3/auth/tokens => generated 1067 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 24 16:30:29.292937 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6744bb9-9385-4b7f-afef-0fa05eb23461 None None] REQUEST_METHOD: `POST` {{(pid=71939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 24 16:30:29.293291 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6744bb9-9385-4b7f-afef-0fa05eb23461 None None] SCRIPT_NAME: `/identity` {{(pid=71939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 24 16:30:29.293641 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6744bb9-9385-4b7f-afef-0fa05eb23461 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=71939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 24 16:30:29.318141 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.auth.core [None req-a6744bb9-9385-4b7f-afef-0fa05eb23461 None None] MFA Rules not processed for user `0f2ba2e8375b4e8c8792ee1e22b60427`. Rule list: `[]` (Enabled: `True`). {{(pid=71939) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:442}} Nov 24 16:30:29.319360 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.fernet_utils [None req-a6744bb9-9385-4b7f-afef-0fa05eb23461 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=71939) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:289}} Nov 24 16:30:29.326403 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: [pid: 71939|app: 0|req: 139/278] 10.222.0.53 () {58 vars in 1013 bytes} [Wed Nov 24 16:30:29 2021] POST /identity/v3/auth/tokens => generated 1067 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 24 16:30:29.332871 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-754ad80f-b422-48d5-9452-754ef12cbefa None None] Authenticating user token {{(pid=71938) process_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 24 16:30:29.343021 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-754ad80f-b422-48d5-9452-754ef12cbefa None None] Validating token access rules against request {{(pid=71938) validate_allowed_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 24 16:30:29.347282 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-156184e5-21db-4391-9750-6d4fed4e2e18 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f2ba2e8375b4e8c8792ee1e22b60427', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '00a5583c7b7443e98e7a1d31a0b638dc', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=71938) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 24 16:30:29.348093 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-156184e5-21db-4391-9750-6d4fed4e2e18 admin admin] REQUEST_METHOD: `GET` {{(pid=71938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 24 16:30:29.348429 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-156184e5-21db-4391-9750-6d4fed4e2e18 admin admin] SCRIPT_NAME: `/identity` {{(pid=71938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 24 16:30:29.348762 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-156184e5-21db-4391-9750-6d4fed4e2e18 admin admin] PATH_INFO: `/v3/roles/member` {{(pid=71938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 24 16:30:29.360464 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-156184e5-21db-4391-9750-6d4fed4e2e18 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=71938) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:401}} Nov 24 16:30:29.368473 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: WARNING keystone.server.flask.application [None req-156184e5-21db-4391-9750-6d4fed4e2e18 admin admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Nov 24 16:30:29.369647 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: [pid: 71938|app: 0|req: 140/279] 10.222.0.53 () {56 vars in 1111 bytes} [Wed Nov 24 16:30:29 2021] GET /identity/v3/roles/member => generated 84 bytes in 37 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 24 16:30:29.375914 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6744bb9-9385-4b7f-afef-0fa05eb23461 None None] Authenticating user token {{(pid=71939) process_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 24 16:30:29.385551 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6744bb9-9385-4b7f-afef-0fa05eb23461 None None] Validating token access rules against request {{(pid=71939) validate_allowed_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 24 16:30:29.389888 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49f6a643-e67c-4630-bdab-2187e75673aa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f2ba2e8375b4e8c8792ee1e22b60427', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '00a5583c7b7443e98e7a1d31a0b638dc', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=71939) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 24 16:30:29.390598 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49f6a643-e67c-4630-bdab-2187e75673aa admin admin] REQUEST_METHOD: `GET` {{(pid=71939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 24 16:30:29.390942 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49f6a643-e67c-4630-bdab-2187e75673aa admin admin] SCRIPT_NAME: `/identity` {{(pid=71939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 24 16:30:29.391276 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49f6a643-e67c-4630-bdab-2187e75673aa admin admin] PATH_INFO: `/v3/roles` {{(pid=71939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 24 16:30:29.392096 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49f6a643-e67c-4630-bdab-2187e75673aa admin admin] RBAC: Adding query filter params (name=member) {{(pid=71939) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:161}} Nov 24 16:30:29.392450 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49f6a643-e67c-4630-bdab-2187e75673aa admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=71939) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:442}} Nov 24 16:30:29.420236 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49f6a643-e67c-4630-bdab-2187e75673aa admin admin] RBAC: Authorization granted {{(pid=71939) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 24 16:30:29.429803 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: [pid: 71939|app: 0|req: 140/280] 10.222.0.53 () {56 vars in 1113 bytes} [Wed Nov 24 16:30:29 2021] GET /identity/v3/roles?name=member => generated 341 bytes in 54 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 24 16:30:29.435824 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-156184e5-21db-4391-9750-6d4fed4e2e18 admin admin] Authenticating user token {{(pid=71938) process_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 24 16:30:29.446650 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-156184e5-21db-4391-9750-6d4fed4e2e18 admin admin] Validating token access rules against request {{(pid=71938) validate_allowed_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 24 16:30:29.450889 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66ed3ac5-33b5-44fe-ac29-521056b0a895 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f2ba2e8375b4e8c8792ee1e22b60427', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '00a5583c7b7443e98e7a1d31a0b638dc', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=71938) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 24 16:30:29.451532 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66ed3ac5-33b5-44fe-ac29-521056b0a895 admin admin] REQUEST_METHOD: `GET` {{(pid=71938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 24 16:30:29.451870 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66ed3ac5-33b5-44fe-ac29-521056b0a895 admin admin] SCRIPT_NAME: `/identity` {{(pid=71938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 24 16:30:29.452203 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66ed3ac5-33b5-44fe-ac29-521056b0a895 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=71938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 24 16:30:29.460486 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66ed3ac5-33b5-44fe-ac29-521056b0a895 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=71938) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:442}} Nov 24 16:30:29.489787 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66ed3ac5-33b5-44fe-ac29-521056b0a895 admin admin] RBAC: Authorization granted {{(pid=71938) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 24 16:30:29.498585 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: [pid: 71938|app: 0|req: 141/281] 10.222.0.53 () {58 vars in 1315 bytes} [Wed Nov 24 16:30:29 2021] GET /identity/v3/auth/tokens => generated 1067 bytes in 63 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 24 16:30:29.504097 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49f6a643-e67c-4630-bdab-2187e75673aa admin admin] Authenticating user token {{(pid=71939) process_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 24 16:30:29.513707 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49f6a643-e67c-4630-bdab-2187e75673aa admin admin] Validating token access rules against request {{(pid=71939) validate_allowed_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 24 16:30:29.517933 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7e59f27-ff50-4b01-ad5e-9c5b50a22e42 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f2ba2e8375b4e8c8792ee1e22b60427', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '00a5583c7b7443e98e7a1d31a0b638dc', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=71939) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 24 16:30:29.518830 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7e59f27-ff50-4b01-ad5e-9c5b50a22e42 admin admin] REQUEST_METHOD: `GET` {{(pid=71939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 24 16:30:29.519176 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7e59f27-ff50-4b01-ad5e-9c5b50a22e42 admin admin] SCRIPT_NAME: `/identity` {{(pid=71939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 24 16:30:29.519513 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7e59f27-ff50-4b01-ad5e-9c5b50a22e42 admin admin] PATH_INFO: `/v3/projects/6a75e77ca1684c808c57b448b83e73d2` {{(pid=71939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 24 16:30:29.520715 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7e59f27-ff50-4b01-ad5e-9c5b50a22e42 admin admin] RBAC: Authorizing `identity:get_project(project_id=6a75e77ca1684c808c57b448b83e73d2)` {{(pid=71939) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:442}} Nov 24 16:30:29.549761 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7e59f27-ff50-4b01-ad5e-9c5b50a22e42 admin admin] RBAC: Authorization granted {{(pid=71939) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 24 16:30:29.552104 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: [pid: 71939|app: 0|req: 141/282] 10.222.0.53 () {56 vars in 1198 bytes} [Wed Nov 24 16:30:29 2021] GET /identity/v3/projects/6a75e77ca1684c808c57b448b83e73d2 => generated 298 bytes in 48 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 24 16:30:29.559091 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66ed3ac5-33b5-44fe-ac29-521056b0a895 admin admin] Authenticating user token {{(pid=71938) process_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 24 16:30:29.567970 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66ed3ac5-33b5-44fe-ac29-521056b0a895 admin admin] Validating token access rules against request {{(pid=71938) validate_allowed_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 24 16:30:29.572196 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d92414b-e9a3-4eec-9dce-3433045f031d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f2ba2e8375b4e8c8792ee1e22b60427', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '00a5583c7b7443e98e7a1d31a0b638dc', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=71938) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 24 16:30:29.573051 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d92414b-e9a3-4eec-9dce-3433045f031d admin admin] REQUEST_METHOD: `GET` {{(pid=71938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 24 16:30:29.573389 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d92414b-e9a3-4eec-9dce-3433045f031d admin admin] SCRIPT_NAME: `/identity` {{(pid=71938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 24 16:30:29.573721 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d92414b-e9a3-4eec-9dce-3433045f031d admin admin] PATH_INFO: `/v3/groups/16b7d0bfc00f4d7d9d1a855e2b730299` {{(pid=71938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 24 16:30:29.578934 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d92414b-e9a3-4eec-9dce-3433045f031d admin admin] RBAC: Authorizing `identity:get_group(group_id=16b7d0bfc00f4d7d9d1a855e2b730299)` {{(pid=71938) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:442}} Nov 24 16:30:29.606727 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: WARNING py.warnings [None req-1d92414b-e9a3-4eec-9dce-3433045f031d admin admin] /usr/local/lib/python3.6/dist-packages/oslo_policy/policy.py:1018: UserWarning: Policy identity:get_group failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Nov 24 16:30:29.606727 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: warnings.warn(msg) Nov 24 16:30:29.606727 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: Nov 24 16:30:29.608061 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d92414b-e9a3-4eec-9dce-3433045f031d admin admin] RBAC: Authorization granted {{(pid=71938) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 24 16:30:29.609631 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: [pid: 71938|app: 0|req: 142/283] 10.222.0.53 () {56 vars in 1192 bytes} [Wed Nov 24 16:30:29 2021] GET /identity/v3/groups/16b7d0bfc00f4d7d9d1a855e2b730299 => generated 226 bytes in 51 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Nov 24 16:30:29.615760 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7e59f27-ff50-4b01-ad5e-9c5b50a22e42 admin admin] Authenticating user token {{(pid=71939) process_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 24 16:30:29.625463 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7e59f27-ff50-4b01-ad5e-9c5b50a22e42 admin admin] Validating token access rules against request {{(pid=71939) validate_allowed_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 24 16:30:29.629679 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e2963b7-1b46-493e-b056-3cf6f27ca466 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f2ba2e8375b4e8c8792ee1e22b60427', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '00a5583c7b7443e98e7a1d31a0b638dc', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=71939) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 24 16:30:29.630349 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e2963b7-1b46-493e-b056-3cf6f27ca466 admin admin] REQUEST_METHOD: `GET` {{(pid=71939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 24 16:30:29.630689 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e2963b7-1b46-493e-b056-3cf6f27ca466 admin admin] SCRIPT_NAME: `/identity` {{(pid=71939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 24 16:30:29.631024 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e2963b7-1b46-493e-b056-3cf6f27ca466 admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=71939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 24 16:30:29.631906 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e2963b7-1b46-493e-b056-3cf6f27ca466 admin admin] RBAC: Adding query filter params (group.id=16b7d0bfc00f4d7d9d1a855e2b730299, role.id=912ab5f10fa5477da74acf239f07604e, scope.project.id=6a75e77ca1684c808c57b448b83e73d2) {{(pid=71939) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:161}} Nov 24 16:30:29.632265 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e2963b7-1b46-493e-b056-3cf6f27ca466 admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=71939) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:442}} Nov 24 16:30:29.661267 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e2963b7-1b46-493e-b056-3cf6f27ca466 admin admin] RBAC: Authorization granted {{(pid=71939) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 24 16:30:29.666815 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: [pid: 71939|app: 0|req: 142/284] 10.222.0.53 () {56 vars in 1388 bytes} [Wed Nov 24 16:30:29 2021] GET /identity/v3/role_assignments?group.id=16b7d0bfc00f4d7d9d1a855e2b730299&scope.project.id=6a75e77ca1684c808c57b448b83e73d2&role.id=912ab5f10fa5477da74acf239f07604e => generated 260 bytes in 51 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 24 16:30:31.625591 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-011bdad5-c79f-4c1d-8289-f2217ec7c09b None None] REQUEST_METHOD: `GET` {{(pid=71938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 24 16:30:31.626117 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-011bdad5-c79f-4c1d-8289-f2217ec7c09b None None] SCRIPT_NAME: `/identity` {{(pid=71938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 24 16:30:31.626291 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-011bdad5-c79f-4c1d-8289-f2217ec7c09b None None] PATH_INFO: `/` {{(pid=71938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 24 16:30:31.628764 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: [pid: 71938|app: 0|req: 143/285] 10.222.0.53 () {54 vars in 915 bytes} [Wed Nov 24 16:30:31 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 24 16:30:31.634447 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c40574cc-9a31-4414-a73f-ca6e7cbec03f None None] REQUEST_METHOD: `POST` {{(pid=71939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 24 16:30:31.634799 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c40574cc-9a31-4414-a73f-ca6e7cbec03f None None] SCRIPT_NAME: `/identity` {{(pid=71939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 24 16:30:31.635138 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c40574cc-9a31-4414-a73f-ca6e7cbec03f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=71939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 24 16:30:31.658480 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.auth.core [None req-c40574cc-9a31-4414-a73f-ca6e7cbec03f None None] MFA Rules not processed for user `0f2ba2e8375b4e8c8792ee1e22b60427`. Rule list: `[]` (Enabled: `True`). {{(pid=71939) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:442}} Nov 24 16:30:31.659718 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.fernet_utils [None req-c40574cc-9a31-4414-a73f-ca6e7cbec03f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=71939) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:289}} Nov 24 16:30:31.666755 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: [pid: 71939|app: 0|req: 143/286] 10.222.0.53 () {58 vars in 1013 bytes} [Wed Nov 24 16:30:31 2021] POST /identity/v3/auth/tokens => generated 1067 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 24 16:30:31.688670 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d39a42a-1ec8-448d-a093-86dbc839c926 None None] REQUEST_METHOD: `POST` {{(pid=71938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 24 16:30:31.689021 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d39a42a-1ec8-448d-a093-86dbc839c926 None None] SCRIPT_NAME: `/identity` {{(pid=71938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 24 16:30:31.689436 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d39a42a-1ec8-448d-a093-86dbc839c926 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=71938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 24 16:30:31.713466 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.auth.core [None req-3d39a42a-1ec8-448d-a093-86dbc839c926 None None] MFA Rules not processed for user `0f2ba2e8375b4e8c8792ee1e22b60427`. Rule list: `[]` (Enabled: `True`). {{(pid=71938) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:442}} Nov 24 16:30:31.714690 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.fernet_utils [None req-3d39a42a-1ec8-448d-a093-86dbc839c926 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=71938) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:289}} Nov 24 16:30:31.722370 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: [pid: 71938|app: 0|req: 144/287] 10.222.0.53 () {58 vars in 1013 bytes} [Wed Nov 24 16:30:31 2021] POST /identity/v3/auth/tokens => generated 1067 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 24 16:30:31.727930 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c40574cc-9a31-4414-a73f-ca6e7cbec03f None None] Authenticating user token {{(pid=71939) process_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 24 16:30:31.741134 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c40574cc-9a31-4414-a73f-ca6e7cbec03f None None] Validating token access rules against request {{(pid=71939) validate_allowed_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 24 16:30:31.745345 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd394e21-372b-46ba-b41f-8ba685b37daa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f2ba2e8375b4e8c8792ee1e22b60427', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '00a5583c7b7443e98e7a1d31a0b638dc', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=71939) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 24 16:30:31.746185 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd394e21-372b-46ba-b41f-8ba685b37daa admin admin] REQUEST_METHOD: `GET` {{(pid=71939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 24 16:30:31.746535 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd394e21-372b-46ba-b41f-8ba685b37daa admin admin] SCRIPT_NAME: `/identity` {{(pid=71939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 24 16:30:31.747060 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd394e21-372b-46ba-b41f-8ba685b37daa admin admin] PATH_INFO: `/v3/roles/member` {{(pid=71939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 24 16:30:31.758839 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd394e21-372b-46ba-b41f-8ba685b37daa admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=71939) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:401}} Nov 24 16:30:31.766270 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: WARNING keystone.server.flask.application [None req-fd394e21-372b-46ba-b41f-8ba685b37daa admin admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Nov 24 16:30:31.767451 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: [pid: 71939|app: 0|req: 144/288] 10.222.0.53 () {56 vars in 1111 bytes} [Wed Nov 24 16:30:31 2021] GET /identity/v3/roles/member => generated 84 bytes in 40 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 24 16:30:31.773545 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d39a42a-1ec8-448d-a093-86dbc839c926 None None] Authenticating user token {{(pid=71938) process_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 24 16:30:31.782658 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d39a42a-1ec8-448d-a093-86dbc839c926 None None] Validating token access rules against request {{(pid=71938) validate_allowed_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 24 16:30:31.787389 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1456c85-aab5-42c5-b46b-cfc8365462cc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f2ba2e8375b4e8c8792ee1e22b60427', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '00a5583c7b7443e98e7a1d31a0b638dc', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=71938) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 24 16:30:31.788050 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1456c85-aab5-42c5-b46b-cfc8365462cc admin admin] REQUEST_METHOD: `GET` {{(pid=71938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 24 16:30:31.788389 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1456c85-aab5-42c5-b46b-cfc8365462cc admin admin] SCRIPT_NAME: `/identity` {{(pid=71938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 24 16:30:31.788722 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1456c85-aab5-42c5-b46b-cfc8365462cc admin admin] PATH_INFO: `/v3/roles` {{(pid=71938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 24 16:30:31.789522 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1456c85-aab5-42c5-b46b-cfc8365462cc admin admin] RBAC: Adding query filter params (name=member) {{(pid=71938) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:161}} Nov 24 16:30:31.789874 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1456c85-aab5-42c5-b46b-cfc8365462cc admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=71938) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:442}} Nov 24 16:30:31.819753 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1456c85-aab5-42c5-b46b-cfc8365462cc admin admin] RBAC: Authorization granted {{(pid=71938) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 24 16:30:31.829203 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: [pid: 71938|app: 0|req: 145/289] 10.222.0.53 () {56 vars in 1113 bytes} [Wed Nov 24 16:30:31 2021] GET /identity/v3/roles?name=member => generated 341 bytes in 56 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 24 16:30:31.835035 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd394e21-372b-46ba-b41f-8ba685b37daa admin admin] Authenticating user token {{(pid=71939) process_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 24 16:30:31.845282 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd394e21-372b-46ba-b41f-8ba685b37daa admin admin] Validating token access rules against request {{(pid=71939) validate_allowed_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 24 16:30:31.850348 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a98c42fa-75d1-436d-b6da-04261c7e745b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f2ba2e8375b4e8c8792ee1e22b60427', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '00a5583c7b7443e98e7a1d31a0b638dc', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=71939) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 24 16:30:31.851088 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a98c42fa-75d1-436d-b6da-04261c7e745b admin admin] REQUEST_METHOD: `GET` {{(pid=71939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 24 16:30:31.851423 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a98c42fa-75d1-436d-b6da-04261c7e745b admin admin] SCRIPT_NAME: `/identity` {{(pid=71939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 24 16:30:31.851755 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a98c42fa-75d1-436d-b6da-04261c7e745b admin admin] PATH_INFO: `/v3/groups/16b7d0bfc00f4d7d9d1a855e2b730299` {{(pid=71939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 24 16:30:31.852964 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a98c42fa-75d1-436d-b6da-04261c7e745b admin admin] RBAC: Authorizing `identity:get_group(group_id=16b7d0bfc00f4d7d9d1a855e2b730299)` {{(pid=71939) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:442}} Nov 24 16:30:31.880715 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: WARNING py.warnings [None req-a98c42fa-75d1-436d-b6da-04261c7e745b admin admin] /usr/local/lib/python3.6/dist-packages/oslo_policy/policy.py:1018: UserWarning: Policy identity:get_group failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Nov 24 16:30:31.880715 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: warnings.warn(msg) Nov 24 16:30:31.880715 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: Nov 24 16:30:31.882004 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a98c42fa-75d1-436d-b6da-04261c7e745b admin admin] RBAC: Authorization granted {{(pid=71939) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 24 16:30:31.883608 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: [pid: 71939|app: 0|req: 145/290] 10.222.0.53 () {56 vars in 1192 bytes} [Wed Nov 24 16:30:31 2021] GET /identity/v3/groups/16b7d0bfc00f4d7d9d1a855e2b730299 => generated 226 bytes in 49 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 24 16:30:31.889213 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1456c85-aab5-42c5-b46b-cfc8365462cc admin admin] Authenticating user token {{(pid=71938) process_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 24 16:30:31.899790 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1456c85-aab5-42c5-b46b-cfc8365462cc admin admin] Validating token access rules against request {{(pid=71938) validate_allowed_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 24 16:30:31.903977 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-460ce53a-7a2d-42be-983b-78a075daab88 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f2ba2e8375b4e8c8792ee1e22b60427', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '00a5583c7b7443e98e7a1d31a0b638dc', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=71938) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 24 16:30:31.904851 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-460ce53a-7a2d-42be-983b-78a075daab88 admin admin] REQUEST_METHOD: `GET` {{(pid=71938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 24 16:30:31.905198 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-460ce53a-7a2d-42be-983b-78a075daab88 admin admin] SCRIPT_NAME: `/identity` {{(pid=71938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 24 16:30:31.905530 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-460ce53a-7a2d-42be-983b-78a075daab88 admin admin] PATH_INFO: `/v3/projects/6a75e77ca1684c808c57b448b83e73d2` {{(pid=71938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 24 16:30:31.906750 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-460ce53a-7a2d-42be-983b-78a075daab88 admin admin] RBAC: Authorizing `identity:get_project(project_id=6a75e77ca1684c808c57b448b83e73d2)` {{(pid=71938) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:442}} Nov 24 16:30:31.936277 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-460ce53a-7a2d-42be-983b-78a075daab88 admin admin] RBAC: Authorization granted {{(pid=71938) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 24 16:30:31.937923 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: [pid: 71938|app: 0|req: 146/291] 10.222.0.53 () {56 vars in 1198 bytes} [Wed Nov 24 16:30:31 2021] GET /identity/v3/projects/6a75e77ca1684c808c57b448b83e73d2 => generated 298 bytes in 49 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 24 16:30:31.943557 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a98c42fa-75d1-436d-b6da-04261c7e745b admin admin] Authenticating user token {{(pid=71939) process_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 24 16:30:31.953568 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a98c42fa-75d1-436d-b6da-04261c7e745b admin admin] Validating token access rules against request {{(pid=71939) validate_allowed_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 24 16:30:31.957913 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e091437c-836f-46ed-80be-1542cd79dcc9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f2ba2e8375b4e8c8792ee1e22b60427', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '00a5583c7b7443e98e7a1d31a0b638dc', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=71939) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 24 16:30:31.958829 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e091437c-836f-46ed-80be-1542cd79dcc9 admin admin] REQUEST_METHOD: `PUT` {{(pid=71939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 24 16:30:31.959177 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e091437c-836f-46ed-80be-1542cd79dcc9 admin admin] SCRIPT_NAME: `/identity` {{(pid=71939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 24 16:30:31.959514 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e091437c-836f-46ed-80be-1542cd79dcc9 admin admin] PATH_INFO: `/v3/projects/6a75e77ca1684c808c57b448b83e73d2/groups/16b7d0bfc00f4d7d9d1a855e2b730299/roles/912ab5f10fa5477da74acf239f07604e` {{(pid=71939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 24 16:30:31.961444 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e091437c-836f-46ed-80be-1542cd79dcc9 admin admin] RBAC: Authorizing `identity:create_grant(project_id=6a75e77ca1684c808c57b448b83e73d2, group_id=16b7d0bfc00f4d7d9d1a855e2b730299, role_id=912ab5f10fa5477da74acf239f07604e)` {{(pid=71939) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:442}} Nov 24 16:30:31.991451 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e091437c-836f-46ed-80be-1542cd79dcc9 admin admin] RBAC: Authorization granted {{(pid=71939) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 24 16:30:32.002390 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: [pid: 71939|app: 0|req: 146/292] 10.222.0.53 () {58 vars in 1454 bytes} [Wed Nov 24 16:30:31 2021] PUT /identity/v3/projects/6a75e77ca1684c808c57b448b83e73d2/groups/16b7d0bfc00f4d7d9d1a855e2b730299/roles/912ab5f10fa5477da74acf239f07604e => generated 0 bytes in 59 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 24 16:30:33.994901 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc0ee6be-29e6-4020-b0e4-9b317136214f None None] REQUEST_METHOD: `GET` {{(pid=71938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 24 16:30:33.995447 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc0ee6be-29e6-4020-b0e4-9b317136214f None None] SCRIPT_NAME: `/identity` {{(pid=71938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 24 16:30:33.995537 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc0ee6be-29e6-4020-b0e4-9b317136214f None None] PATH_INFO: `/` {{(pid=71938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 24 16:30:33.997368 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: [pid: 71938|app: 0|req: 147/293] 10.222.0.53 () {54 vars in 915 bytes} [Wed Nov 24 16:30:33 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 24 16:30:34.003063 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2432f6e4-d3a6-46a4-a9a5-c94c5bc8621a None None] REQUEST_METHOD: `POST` {{(pid=71939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 24 16:30:34.003565 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2432f6e4-d3a6-46a4-a9a5-c94c5bc8621a None None] SCRIPT_NAME: `/identity` {{(pid=71939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 24 16:30:34.003916 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2432f6e4-d3a6-46a4-a9a5-c94c5bc8621a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=71939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 24 16:30:34.026916 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.auth.core [None req-2432f6e4-d3a6-46a4-a9a5-c94c5bc8621a None None] MFA Rules not processed for user `0f2ba2e8375b4e8c8792ee1e22b60427`. Rule list: `[]` (Enabled: `True`). {{(pid=71939) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:442}} Nov 24 16:30:34.028140 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.fernet_utils [None req-2432f6e4-d3a6-46a4-a9a5-c94c5bc8621a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=71939) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:289}} Nov 24 16:30:34.099683 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: [pid: 71939|app: 0|req: 147/294] 10.222.0.53 () {58 vars in 1013 bytes} [Wed Nov 24 16:30:34 2021] POST /identity/v3/auth/tokens => generated 1067 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 24 16:30:34.128163 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb595a1a-ac52-47ef-ab31-dce0a51067ee None None] REQUEST_METHOD: `POST` {{(pid=71938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 24 16:30:34.128511 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb595a1a-ac52-47ef-ab31-dce0a51067ee None None] SCRIPT_NAME: `/identity` {{(pid=71938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 24 16:30:34.128848 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb595a1a-ac52-47ef-ab31-dce0a51067ee None None] PATH_INFO: `/v3/auth/tokens` {{(pid=71938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 24 16:30:34.152152 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.auth.core [None req-fb595a1a-ac52-47ef-ab31-dce0a51067ee None None] MFA Rules not processed for user `0f2ba2e8375b4e8c8792ee1e22b60427`. Rule list: `[]` (Enabled: `True`). {{(pid=71938) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:442}} Nov 24 16:30:34.153363 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.fernet_utils [None req-fb595a1a-ac52-47ef-ab31-dce0a51067ee None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=71938) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:289}} Nov 24 16:30:34.160956 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: [pid: 71938|app: 0|req: 148/295] 10.222.0.53 () {58 vars in 1013 bytes} [Wed Nov 24 16:30:34 2021] POST /identity/v3/auth/tokens => generated 1067 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 24 16:30:34.166559 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2432f6e4-d3a6-46a4-a9a5-c94c5bc8621a None None] Authenticating user token {{(pid=71939) process_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 24 16:30:34.176851 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2432f6e4-d3a6-46a4-a9a5-c94c5bc8621a None None] Validating token access rules against request {{(pid=71939) validate_allowed_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 24 16:30:34.181079 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68a0a739-8f73-46b3-a6b9-f37e7dfdf98b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f2ba2e8375b4e8c8792ee1e22b60427', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '00a5583c7b7443e98e7a1d31a0b638dc', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=71939) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 24 16:30:34.181895 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68a0a739-8f73-46b3-a6b9-f37e7dfdf98b admin admin] REQUEST_METHOD: `GET` {{(pid=71939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 24 16:30:34.182285 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68a0a739-8f73-46b3-a6b9-f37e7dfdf98b admin admin] SCRIPT_NAME: `/identity` {{(pid=71939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 24 16:30:34.182620 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68a0a739-8f73-46b3-a6b9-f37e7dfdf98b admin admin] PATH_INFO: `/v3/roles/member` {{(pid=71939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 24 16:30:34.194492 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68a0a739-8f73-46b3-a6b9-f37e7dfdf98b admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=71939) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:401}} Nov 24 16:30:34.201890 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: WARNING keystone.server.flask.application [None req-68a0a739-8f73-46b3-a6b9-f37e7dfdf98b admin admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Nov 24 16:30:34.203111 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: [pid: 71939|app: 0|req: 148/296] 10.222.0.53 () {56 vars in 1111 bytes} [Wed Nov 24 16:30:34 2021] GET /identity/v3/roles/member => generated 84 bytes in 37 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 24 16:30:34.210054 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb595a1a-ac52-47ef-ab31-dce0a51067ee None None] Authenticating user token {{(pid=71938) process_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 24 16:30:34.219162 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb595a1a-ac52-47ef-ab31-dce0a51067ee None None] Validating token access rules against request {{(pid=71938) validate_allowed_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 24 16:30:34.223868 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23569675-991a-4046-93ce-212b3a60e5c2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f2ba2e8375b4e8c8792ee1e22b60427', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '00a5583c7b7443e98e7a1d31a0b638dc', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=71938) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 24 16:30:34.224528 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23569675-991a-4046-93ce-212b3a60e5c2 admin admin] REQUEST_METHOD: `GET` {{(pid=71938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 24 16:30:34.224863 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23569675-991a-4046-93ce-212b3a60e5c2 admin admin] SCRIPT_NAME: `/identity` {{(pid=71938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 24 16:30:34.225192 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23569675-991a-4046-93ce-212b3a60e5c2 admin admin] PATH_INFO: `/v3/roles` {{(pid=71938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 24 16:30:34.225991 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23569675-991a-4046-93ce-212b3a60e5c2 admin admin] RBAC: Adding query filter params (name=member) {{(pid=71938) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:161}} Nov 24 16:30:34.226384 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23569675-991a-4046-93ce-212b3a60e5c2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=71938) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:442}} Nov 24 16:30:34.254927 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23569675-991a-4046-93ce-212b3a60e5c2 admin admin] RBAC: Authorization granted {{(pid=71938) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 24 16:30:34.263714 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: [pid: 71938|app: 0|req: 149/297] 10.222.0.53 () {56 vars in 1113 bytes} [Wed Nov 24 16:30:34 2021] GET /identity/v3/roles?name=member => generated 341 bytes in 54 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 24 16:30:34.269483 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68a0a739-8f73-46b3-a6b9-f37e7dfdf98b admin admin] Authenticating user token {{(pid=71939) process_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 24 16:30:34.279729 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68a0a739-8f73-46b3-a6b9-f37e7dfdf98b admin admin] Validating token access rules against request {{(pid=71939) validate_allowed_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 24 16:30:34.283924 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15ed597f-bc85-47ab-b4ac-041ec92e4267 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f2ba2e8375b4e8c8792ee1e22b60427', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '00a5583c7b7443e98e7a1d31a0b638dc', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=71939) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 24 16:30:34.285066 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15ed597f-bc85-47ab-b4ac-041ec92e4267 admin admin] REQUEST_METHOD: `GET` {{(pid=71939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 24 16:30:34.285409 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15ed597f-bc85-47ab-b4ac-041ec92e4267 admin admin] SCRIPT_NAME: `/identity` {{(pid=71939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 24 16:30:34.285745 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15ed597f-bc85-47ab-b4ac-041ec92e4267 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=71939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 24 16:30:34.293725 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15ed597f-bc85-47ab-b4ac-041ec92e4267 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=71939) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:442}} Nov 24 16:30:34.322315 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15ed597f-bc85-47ab-b4ac-041ec92e4267 admin admin] RBAC: Authorization granted {{(pid=71939) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 24 16:30:34.332265 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: [pid: 71939|app: 0|req: 149/298] 10.222.0.53 () {58 vars in 1315 bytes} [Wed Nov 24 16:30:34 2021] GET /identity/v3/auth/tokens => generated 1067 bytes in 63 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 24 16:30:34.337922 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23569675-991a-4046-93ce-212b3a60e5c2 admin admin] Authenticating user token {{(pid=71938) process_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 24 16:30:34.348897 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23569675-991a-4046-93ce-212b3a60e5c2 admin admin] Validating token access rules against request {{(pid=71938) validate_allowed_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 24 16:30:34.353323 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9147a66e-2194-4a55-8527-de2bead71011 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f2ba2e8375b4e8c8792ee1e22b60427', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '00a5583c7b7443e98e7a1d31a0b638dc', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=71938) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 24 16:30:34.354221 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9147a66e-2194-4a55-8527-de2bead71011 admin admin] REQUEST_METHOD: `GET` {{(pid=71938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 24 16:30:34.354559 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9147a66e-2194-4a55-8527-de2bead71011 admin admin] SCRIPT_NAME: `/identity` {{(pid=71938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 24 16:30:34.354889 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9147a66e-2194-4a55-8527-de2bead71011 admin admin] PATH_INFO: `/v3/projects/6a75e77ca1684c808c57b448b83e73d2` {{(pid=71938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 24 16:30:34.356086 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9147a66e-2194-4a55-8527-de2bead71011 admin admin] RBAC: Authorizing `identity:get_project(project_id=6a75e77ca1684c808c57b448b83e73d2)` {{(pid=71938) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:442}} Nov 24 16:30:34.386045 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9147a66e-2194-4a55-8527-de2bead71011 admin admin] RBAC: Authorization granted {{(pid=71938) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 24 16:30:34.387824 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: [pid: 71938|app: 0|req: 150/299] 10.222.0.53 () {56 vars in 1198 bytes} [Wed Nov 24 16:30:34 2021] GET /identity/v3/projects/6a75e77ca1684c808c57b448b83e73d2 => generated 298 bytes in 50 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 24 16:30:34.394269 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15ed597f-bc85-47ab-b4ac-041ec92e4267 admin admin] Authenticating user token {{(pid=71939) process_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 24 16:30:34.403433 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15ed597f-bc85-47ab-b4ac-041ec92e4267 admin admin] Validating token access rules against request {{(pid=71939) validate_allowed_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 24 16:30:34.407636 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-548c0924-7c17-4b05-9edc-916df245bb53 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f2ba2e8375b4e8c8792ee1e22b60427', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '00a5583c7b7443e98e7a1d31a0b638dc', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=71939) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 24 16:30:34.408499 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-548c0924-7c17-4b05-9edc-916df245bb53 admin admin] REQUEST_METHOD: `GET` {{(pid=71939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 24 16:30:34.408831 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-548c0924-7c17-4b05-9edc-916df245bb53 admin admin] SCRIPT_NAME: `/identity` {{(pid=71939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 24 16:30:34.409768 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-548c0924-7c17-4b05-9edc-916df245bb53 admin admin] PATH_INFO: `/v3/groups/16b7d0bfc00f4d7d9d1a855e2b730299` {{(pid=71939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 24 16:30:34.410986 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-548c0924-7c17-4b05-9edc-916df245bb53 admin admin] RBAC: Authorizing `identity:get_group(group_id=16b7d0bfc00f4d7d9d1a855e2b730299)` {{(pid=71939) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:442}} Nov 24 16:30:34.439012 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-548c0924-7c17-4b05-9edc-916df245bb53 admin admin] RBAC: Authorization granted {{(pid=71939) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 24 16:30:34.440595 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: [pid: 71939|app: 0|req: 150/300] 10.222.0.53 () {56 vars in 1192 bytes} [Wed Nov 24 16:30:34 2021] GET /identity/v3/groups/16b7d0bfc00f4d7d9d1a855e2b730299 => generated 226 bytes in 47 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 24 16:30:34.446373 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9147a66e-2194-4a55-8527-de2bead71011 admin admin] Authenticating user token {{(pid=71938) process_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 24 16:30:34.456991 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9147a66e-2194-4a55-8527-de2bead71011 admin admin] Validating token access rules against request {{(pid=71938) validate_allowed_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 24 16:30:34.461296 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eac00e6b-6c72-4edf-8033-fa9064dddaed admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f2ba2e8375b4e8c8792ee1e22b60427', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '00a5583c7b7443e98e7a1d31a0b638dc', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=71938) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 24 16:30:34.461941 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eac00e6b-6c72-4edf-8033-fa9064dddaed admin admin] REQUEST_METHOD: `GET` {{(pid=71938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 24 16:30:34.462334 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eac00e6b-6c72-4edf-8033-fa9064dddaed admin admin] SCRIPT_NAME: `/identity` {{(pid=71938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 24 16:30:34.462669 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eac00e6b-6c72-4edf-8033-fa9064dddaed admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=71938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 24 16:30:34.463557 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eac00e6b-6c72-4edf-8033-fa9064dddaed admin admin] RBAC: Adding query filter params (group.id=16b7d0bfc00f4d7d9d1a855e2b730299, role.id=912ab5f10fa5477da74acf239f07604e, scope.project.id=6a75e77ca1684c808c57b448b83e73d2) {{(pid=71938) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:161}} Nov 24 16:30:34.463923 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eac00e6b-6c72-4edf-8033-fa9064dddaed admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=71938) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:442}} Nov 24 16:30:34.492913 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eac00e6b-6c72-4edf-8033-fa9064dddaed admin admin] RBAC: Authorization granted {{(pid=71938) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 24 16:30:34.498991 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: [pid: 71938|app: 0|req: 151/301] 10.222.0.53 () {56 vars in 1388 bytes} [Wed Nov 24 16:30:34 2021] GET /identity/v3/role_assignments?group.id=16b7d0bfc00f4d7d9d1a855e2b730299&scope.project.id=6a75e77ca1684c808c57b448b83e73d2&role.id=912ab5f10fa5477da74acf239f07604e => generated 611 bytes in 53 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 24 16:30:36.474093 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7f0f067-c7c9-4244-b50d-70e980934a53 None None] REQUEST_METHOD: `GET` {{(pid=71939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 24 16:30:36.474595 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7f0f067-c7c9-4244-b50d-70e980934a53 None None] SCRIPT_NAME: `/identity` {{(pid=71939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 24 16:30:36.474681 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7f0f067-c7c9-4244-b50d-70e980934a53 None None] PATH_INFO: `/` {{(pid=71939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 24 16:30:36.476516 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: [pid: 71939|app: 0|req: 151/302] 10.222.0.53 () {54 vars in 915 bytes} [Wed Nov 24 16:30:36 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 24 16:30:36.482134 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4758381e-40d5-4fc0-b7ad-44d0682612b7 None None] REQUEST_METHOD: `POST` {{(pid=71938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 24 16:30:36.482482 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4758381e-40d5-4fc0-b7ad-44d0682612b7 None None] SCRIPT_NAME: `/identity` {{(pid=71938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 24 16:30:36.482812 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4758381e-40d5-4fc0-b7ad-44d0682612b7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=71938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 24 16:30:36.506474 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.auth.core [None req-4758381e-40d5-4fc0-b7ad-44d0682612b7 None None] MFA Rules not processed for user `0f2ba2e8375b4e8c8792ee1e22b60427`. Rule list: `[]` (Enabled: `True`). {{(pid=71938) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:442}} Nov 24 16:30:36.507677 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.fernet_utils [None req-4758381e-40d5-4fc0-b7ad-44d0682612b7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=71938) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:289}} Nov 24 16:30:36.514662 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: [pid: 71938|app: 0|req: 152/303] 10.222.0.53 () {58 vars in 1013 bytes} [Wed Nov 24 16:30:36 2021] POST /identity/v3/auth/tokens => generated 1067 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 24 16:30:36.537343 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93dc4a86-1105-46cc-b830-f679e19801f4 None None] REQUEST_METHOD: `POST` {{(pid=71939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 24 16:30:36.537688 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93dc4a86-1105-46cc-b830-f679e19801f4 None None] SCRIPT_NAME: `/identity` {{(pid=71939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 24 16:30:36.538083 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93dc4a86-1105-46cc-b830-f679e19801f4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=71939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 24 16:30:36.562100 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.auth.core [None req-93dc4a86-1105-46cc-b830-f679e19801f4 None None] MFA Rules not processed for user `0f2ba2e8375b4e8c8792ee1e22b60427`. Rule list: `[]` (Enabled: `True`). {{(pid=71939) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:442}} Nov 24 16:30:36.563306 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.fernet_utils [None req-93dc4a86-1105-46cc-b830-f679e19801f4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=71939) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:289}} Nov 24 16:30:36.570868 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: [pid: 71939|app: 0|req: 152/304] 10.222.0.53 () {58 vars in 1013 bytes} [Wed Nov 24 16:30:36 2021] POST /identity/v3/auth/tokens => generated 1067 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Nov 24 16:30:36.576377 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4758381e-40d5-4fc0-b7ad-44d0682612b7 None None] Authenticating user token {{(pid=71938) process_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 24 16:30:36.586929 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4758381e-40d5-4fc0-b7ad-44d0682612b7 None None] Validating token access rules against request {{(pid=71938) validate_allowed_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 24 16:30:36.591112 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58fb98b6-242d-42ba-b522-df24560c16e9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f2ba2e8375b4e8c8792ee1e22b60427', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '00a5583c7b7443e98e7a1d31a0b638dc', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=71938) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 24 16:30:36.591976 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58fb98b6-242d-42ba-b522-df24560c16e9 admin admin] REQUEST_METHOD: `GET` {{(pid=71938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 24 16:30:36.592321 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58fb98b6-242d-42ba-b522-df24560c16e9 admin admin] SCRIPT_NAME: `/identity` {{(pid=71938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 24 16:30:36.592657 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58fb98b6-242d-42ba-b522-df24560c16e9 admin admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=71938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 24 16:30:36.604498 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58fb98b6-242d-42ba-b522-df24560c16e9 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=71938) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:401}} Nov 24 16:30:36.612811 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: WARNING keystone.server.flask.application [None req-58fb98b6-242d-42ba-b522-df24560c16e9 admin admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Nov 24 16:30:36.614104 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: [pid: 71938|app: 0|req: 153/305] 10.222.0.53 () {56 vars in 1126 bytes} [Wed Nov 24 16:30:36 2021] GET /identity/v3/roles/anotherrole => generated 89 bytes in 38 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 24 16:30:36.620233 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93dc4a86-1105-46cc-b830-f679e19801f4 None None] Authenticating user token {{(pid=71939) process_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 24 16:30:36.629797 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93dc4a86-1105-46cc-b830-f679e19801f4 None None] Validating token access rules against request {{(pid=71939) validate_allowed_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 24 16:30:36.633988 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bca6d8e2-fec2-4c2b-9d7b-8d224715ac6e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f2ba2e8375b4e8c8792ee1e22b60427', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '00a5583c7b7443e98e7a1d31a0b638dc', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=71939) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 24 16:30:36.634705 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bca6d8e2-fec2-4c2b-9d7b-8d224715ac6e admin admin] REQUEST_METHOD: `GET` {{(pid=71939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 24 16:30:36.635047 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bca6d8e2-fec2-4c2b-9d7b-8d224715ac6e admin admin] SCRIPT_NAME: `/identity` {{(pid=71939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 24 16:30:36.635386 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bca6d8e2-fec2-4c2b-9d7b-8d224715ac6e admin admin] PATH_INFO: `/v3/roles` {{(pid=71939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 24 16:30:36.636185 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bca6d8e2-fec2-4c2b-9d7b-8d224715ac6e admin admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=71939) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:161}} Nov 24 16:30:36.636539 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bca6d8e2-fec2-4c2b-9d7b-8d224715ac6e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=71939) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:442}} Nov 24 16:30:36.664366 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bca6d8e2-fec2-4c2b-9d7b-8d224715ac6e admin admin] RBAC: Authorization granted {{(pid=71939) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 24 16:30:36.673051 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: [pid: 71939|app: 0|req: 153/306] 10.222.0.53 () {56 vars in 1123 bytes} [Wed Nov 24 16:30:36 2021] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 53 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 24 16:30:36.679134 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58fb98b6-242d-42ba-b522-df24560c16e9 admin admin] Authenticating user token {{(pid=71938) process_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 24 16:30:36.689270 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58fb98b6-242d-42ba-b522-df24560c16e9 admin admin] Validating token access rules against request {{(pid=71938) validate_allowed_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 24 16:30:36.693949 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-250b5730-e0de-48c4-8f07-a7de6078b8bd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f2ba2e8375b4e8c8792ee1e22b60427', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '00a5583c7b7443e98e7a1d31a0b638dc', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=71938) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 24 16:30:36.694632 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-250b5730-e0de-48c4-8f07-a7de6078b8bd admin admin] REQUEST_METHOD: `GET` {{(pid=71938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 24 16:30:36.694969 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-250b5730-e0de-48c4-8f07-a7de6078b8bd admin admin] SCRIPT_NAME: `/identity` {{(pid=71938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 24 16:30:36.695303 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-250b5730-e0de-48c4-8f07-a7de6078b8bd admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=71938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 24 16:30:36.703695 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-250b5730-e0de-48c4-8f07-a7de6078b8bd admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=71938) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:442}} Nov 24 16:30:36.731961 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-250b5730-e0de-48c4-8f07-a7de6078b8bd admin admin] RBAC: Authorization granted {{(pid=71938) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 24 16:30:36.741224 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: [pid: 71938|app: 0|req: 154/307] 10.222.0.53 () {58 vars in 1315 bytes} [Wed Nov 24 16:30:36 2021] GET /identity/v3/auth/tokens => generated 1067 bytes in 63 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Nov 24 16:30:36.746856 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bca6d8e2-fec2-4c2b-9d7b-8d224715ac6e admin admin] Authenticating user token {{(pid=71939) process_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 24 16:30:36.757176 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bca6d8e2-fec2-4c2b-9d7b-8d224715ac6e admin admin] Validating token access rules against request {{(pid=71939) validate_allowed_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 24 16:30:36.761397 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74fc5ea1-8dac-4a91-bb79-1b17be7775c5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f2ba2e8375b4e8c8792ee1e22b60427', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '00a5583c7b7443e98e7a1d31a0b638dc', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=71939) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 24 16:30:36.762291 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74fc5ea1-8dac-4a91-bb79-1b17be7775c5 admin admin] REQUEST_METHOD: `GET` {{(pid=71939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 24 16:30:36.762630 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74fc5ea1-8dac-4a91-bb79-1b17be7775c5 admin admin] SCRIPT_NAME: `/identity` {{(pid=71939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 24 16:30:36.762963 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74fc5ea1-8dac-4a91-bb79-1b17be7775c5 admin admin] PATH_INFO: `/v3/projects/6a75e77ca1684c808c57b448b83e73d2` {{(pid=71939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 24 16:30:36.764159 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74fc5ea1-8dac-4a91-bb79-1b17be7775c5 admin admin] RBAC: Authorizing `identity:get_project(project_id=6a75e77ca1684c808c57b448b83e73d2)` {{(pid=71939) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:442}} Nov 24 16:30:36.792348 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74fc5ea1-8dac-4a91-bb79-1b17be7775c5 admin admin] RBAC: Authorization granted {{(pid=71939) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 24 16:30:36.793965 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: [pid: 71939|app: 0|req: 154/308] 10.222.0.53 () {56 vars in 1198 bytes} [Wed Nov 24 16:30:36 2021] GET /identity/v3/projects/6a75e77ca1684c808c57b448b83e73d2 => generated 298 bytes in 48 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 24 16:30:36.799278 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-250b5730-e0de-48c4-8f07-a7de6078b8bd admin admin] Authenticating user token {{(pid=71938) process_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 24 16:30:36.808596 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-250b5730-e0de-48c4-8f07-a7de6078b8bd admin admin] Validating token access rules against request {{(pid=71938) validate_allowed_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 24 16:30:36.812797 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-703d2c5d-0ebb-49d8-92b1-b2f46fa0b3fe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f2ba2e8375b4e8c8792ee1e22b60427', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '00a5583c7b7443e98e7a1d31a0b638dc', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=71938) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 24 16:30:36.813653 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-703d2c5d-0ebb-49d8-92b1-b2f46fa0b3fe admin admin] REQUEST_METHOD: `GET` {{(pid=71938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 24 16:30:36.813993 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-703d2c5d-0ebb-49d8-92b1-b2f46fa0b3fe admin admin] SCRIPT_NAME: `/identity` {{(pid=71938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 24 16:30:36.814376 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-703d2c5d-0ebb-49d8-92b1-b2f46fa0b3fe admin admin] PATH_INFO: `/v3/groups/16b7d0bfc00f4d7d9d1a855e2b730299` {{(pid=71938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 24 16:30:36.816146 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-703d2c5d-0ebb-49d8-92b1-b2f46fa0b3fe admin admin] RBAC: Authorizing `identity:get_group(group_id=16b7d0bfc00f4d7d9d1a855e2b730299)` {{(pid=71938) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:442}} Nov 24 16:30:36.844657 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-703d2c5d-0ebb-49d8-92b1-b2f46fa0b3fe admin admin] RBAC: Authorization granted {{(pid=71938) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 24 16:30:36.846239 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: [pid: 71938|app: 0|req: 155/309] 10.222.0.53 () {56 vars in 1192 bytes} [Wed Nov 24 16:30:36 2021] GET /identity/v3/groups/16b7d0bfc00f4d7d9d1a855e2b730299 => generated 226 bytes in 47 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 24 16:30:36.851932 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74fc5ea1-8dac-4a91-bb79-1b17be7775c5 admin admin] Authenticating user token {{(pid=71939) process_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 24 16:30:36.861514 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74fc5ea1-8dac-4a91-bb79-1b17be7775c5 admin admin] Validating token access rules against request {{(pid=71939) validate_allowed_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 24 16:30:36.866293 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b84fa2c-64f6-4b27-a73b-ff99b55b47c0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f2ba2e8375b4e8c8792ee1e22b60427', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '00a5583c7b7443e98e7a1d31a0b638dc', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=71939) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 24 16:30:36.866935 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b84fa2c-64f6-4b27-a73b-ff99b55b47c0 admin admin] REQUEST_METHOD: `GET` {{(pid=71939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 24 16:30:36.867279 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b84fa2c-64f6-4b27-a73b-ff99b55b47c0 admin admin] SCRIPT_NAME: `/identity` {{(pid=71939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 24 16:30:36.867618 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b84fa2c-64f6-4b27-a73b-ff99b55b47c0 admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=71939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 24 16:30:36.868499 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b84fa2c-64f6-4b27-a73b-ff99b55b47c0 admin admin] RBAC: Adding query filter params (group.id=16b7d0bfc00f4d7d9d1a855e2b730299, role.id=0de27ef8b6e744cda429a0d133117dcd, scope.project.id=6a75e77ca1684c808c57b448b83e73d2) {{(pid=71939) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:161}} Nov 24 16:30:36.868861 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b84fa2c-64f6-4b27-a73b-ff99b55b47c0 admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=71939) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:442}} Nov 24 16:30:36.897566 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b84fa2c-64f6-4b27-a73b-ff99b55b47c0 admin admin] RBAC: Authorization granted {{(pid=71939) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 24 16:30:36.903176 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: [pid: 71939|app: 0|req: 155/310] 10.222.0.53 () {56 vars in 1388 bytes} [Wed Nov 24 16:30:36 2021] GET /identity/v3/role_assignments?group.id=16b7d0bfc00f4d7d9d1a855e2b730299&scope.project.id=6a75e77ca1684c808c57b448b83e73d2&role.id=0de27ef8b6e744cda429a0d133117dcd => generated 260 bytes in 52 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 24 16:30:38.974356 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2a27814-b81f-417b-9f02-a03f6f2318d6 None None] REQUEST_METHOD: `GET` {{(pid=71938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 24 16:30:38.975030 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2a27814-b81f-417b-9f02-a03f6f2318d6 None None] SCRIPT_NAME: `/identity` {{(pid=71938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 24 16:30:38.975367 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2a27814-b81f-417b-9f02-a03f6f2318d6 None None] PATH_INFO: `/` {{(pid=71938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 24 16:30:38.977212 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: [pid: 71938|app: 0|req: 156/311] 10.222.0.53 () {54 vars in 915 bytes} [Wed Nov 24 16:30:38 2021] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 24 16:30:38.982879 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4af1856f-57da-422f-bf70-b8513674c081 None None] REQUEST_METHOD: `POST` {{(pid=71939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 24 16:30:38.983228 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4af1856f-57da-422f-bf70-b8513674c081 None None] SCRIPT_NAME: `/identity` {{(pid=71939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 24 16:30:38.983564 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4af1856f-57da-422f-bf70-b8513674c081 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=71939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 24 16:30:39.006559 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.auth.core [None req-4af1856f-57da-422f-bf70-b8513674c081 None None] MFA Rules not processed for user `0f2ba2e8375b4e8c8792ee1e22b60427`. Rule list: `[]` (Enabled: `True`). {{(pid=71939) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:442}} Nov 24 16:30:39.007766 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.fernet_utils [None req-4af1856f-57da-422f-bf70-b8513674c081 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=71939) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:289}} Nov 24 16:30:39.014858 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: [pid: 71939|app: 0|req: 156/312] 10.222.0.53 () {58 vars in 1013 bytes} [Wed Nov 24 16:30:38 2021] POST /identity/v3/auth/tokens => generated 1067 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 24 16:30:39.037324 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca682d1d-553a-4f19-a01e-9db9c8d8cf18 None None] REQUEST_METHOD: `POST` {{(pid=71938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 24 16:30:39.037676 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca682d1d-553a-4f19-a01e-9db9c8d8cf18 None None] SCRIPT_NAME: `/identity` {{(pid=71938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 24 16:30:39.038015 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca682d1d-553a-4f19-a01e-9db9c8d8cf18 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=71938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 24 16:30:39.061318 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.auth.core [None req-ca682d1d-553a-4f19-a01e-9db9c8d8cf18 None None] MFA Rules not processed for user `0f2ba2e8375b4e8c8792ee1e22b60427`. Rule list: `[]` (Enabled: `True`). {{(pid=71938) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:442}} Nov 24 16:30:39.062559 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.fernet_utils [None req-ca682d1d-553a-4f19-a01e-9db9c8d8cf18 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=71938) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:289}} Nov 24 16:30:39.069611 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: [pid: 71938|app: 0|req: 157/313] 10.222.0.53 () {58 vars in 1013 bytes} [Wed Nov 24 16:30:39 2021] POST /identity/v3/auth/tokens => generated 1067 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 24 16:30:39.075229 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4af1856f-57da-422f-bf70-b8513674c081 None None] Authenticating user token {{(pid=71939) process_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 24 16:30:39.085572 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4af1856f-57da-422f-bf70-b8513674c081 None None] Validating token access rules against request {{(pid=71939) validate_allowed_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 24 16:30:39.089808 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c046c30f-035d-4b2a-83da-8d72cffc9a91 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f2ba2e8375b4e8c8792ee1e22b60427', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '00a5583c7b7443e98e7a1d31a0b638dc', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=71939) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 24 16:30:39.090661 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c046c30f-035d-4b2a-83da-8d72cffc9a91 admin admin] REQUEST_METHOD: `GET` {{(pid=71939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 24 16:30:39.090998 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c046c30f-035d-4b2a-83da-8d72cffc9a91 admin admin] SCRIPT_NAME: `/identity` {{(pid=71939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 24 16:30:39.091330 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c046c30f-035d-4b2a-83da-8d72cffc9a91 admin admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=71939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 24 16:30:39.104954 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c046c30f-035d-4b2a-83da-8d72cffc9a91 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=71939) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:401}} Nov 24 16:30:39.112757 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: WARNING keystone.server.flask.application [None req-c046c30f-035d-4b2a-83da-8d72cffc9a91 admin admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Nov 24 16:30:39.113957 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: [pid: 71939|app: 0|req: 157/314] 10.222.0.53 () {56 vars in 1126 bytes} [Wed Nov 24 16:30:39 2021] GET /identity/v3/roles/anotherrole => generated 89 bytes in 39 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 24 16:30:39.120493 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca682d1d-553a-4f19-a01e-9db9c8d8cf18 None None] Authenticating user token {{(pid=71938) process_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 24 16:30:39.129754 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca682d1d-553a-4f19-a01e-9db9c8d8cf18 None None] Validating token access rules against request {{(pid=71938) validate_allowed_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 24 16:30:39.134079 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1edd093-860c-43fa-9785-498571d8ccea admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f2ba2e8375b4e8c8792ee1e22b60427', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '00a5583c7b7443e98e7a1d31a0b638dc', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=71938) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 24 16:30:39.134766 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1edd093-860c-43fa-9785-498571d8ccea admin admin] REQUEST_METHOD: `GET` {{(pid=71938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 24 16:30:39.135111 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1edd093-860c-43fa-9785-498571d8ccea admin admin] SCRIPT_NAME: `/identity` {{(pid=71938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 24 16:30:39.135456 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1edd093-860c-43fa-9785-498571d8ccea admin admin] PATH_INFO: `/v3/roles` {{(pid=71938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 24 16:30:39.136268 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1edd093-860c-43fa-9785-498571d8ccea admin admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=71938) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:161}} Nov 24 16:30:39.136625 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1edd093-860c-43fa-9785-498571d8ccea admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=71938) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:442}} Nov 24 16:30:39.165853 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1edd093-860c-43fa-9785-498571d8ccea admin admin] RBAC: Authorization granted {{(pid=71938) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 24 16:30:39.175447 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: [pid: 71938|app: 0|req: 158/315] 10.222.0.53 () {56 vars in 1123 bytes} [Wed Nov 24 16:30:39 2021] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 55 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 24 16:30:39.181537 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c046c30f-035d-4b2a-83da-8d72cffc9a91 admin admin] Authenticating user token {{(pid=71939) process_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 24 16:30:39.192825 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c046c30f-035d-4b2a-83da-8d72cffc9a91 admin admin] Validating token access rules against request {{(pid=71939) validate_allowed_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 24 16:30:39.197112 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eed75011-d95c-412c-90b9-4df35fa5ed15 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f2ba2e8375b4e8c8792ee1e22b60427', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '00a5583c7b7443e98e7a1d31a0b638dc', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=71939) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 24 16:30:39.197975 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eed75011-d95c-412c-90b9-4df35fa5ed15 admin admin] REQUEST_METHOD: `GET` {{(pid=71939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 24 16:30:39.198356 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eed75011-d95c-412c-90b9-4df35fa5ed15 admin admin] SCRIPT_NAME: `/identity` {{(pid=71939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 24 16:30:39.198688 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eed75011-d95c-412c-90b9-4df35fa5ed15 admin admin] PATH_INFO: `/v3/groups/16b7d0bfc00f4d7d9d1a855e2b730299` {{(pid=71939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 24 16:30:39.199866 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eed75011-d95c-412c-90b9-4df35fa5ed15 admin admin] RBAC: Authorizing `identity:get_group(group_id=16b7d0bfc00f4d7d9d1a855e2b730299)` {{(pid=71939) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:442}} Nov 24 16:30:39.229341 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eed75011-d95c-412c-90b9-4df35fa5ed15 admin admin] RBAC: Authorization granted {{(pid=71939) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 24 16:30:39.230941 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: [pid: 71939|app: 0|req: 158/316] 10.222.0.53 () {56 vars in 1192 bytes} [Wed Nov 24 16:30:39 2021] GET /identity/v3/groups/16b7d0bfc00f4d7d9d1a855e2b730299 => generated 226 bytes in 50 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 24 16:30:39.236857 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1edd093-860c-43fa-9785-498571d8ccea admin admin] Authenticating user token {{(pid=71938) process_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 24 16:30:39.249717 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1edd093-860c-43fa-9785-498571d8ccea admin admin] Validating token access rules against request {{(pid=71938) validate_allowed_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 24 16:30:39.254017 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54681ef5-227d-4791-b257-abba30df6012 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f2ba2e8375b4e8c8792ee1e22b60427', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '00a5583c7b7443e98e7a1d31a0b638dc', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=71938) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 24 16:30:39.254934 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54681ef5-227d-4791-b257-abba30df6012 admin admin] REQUEST_METHOD: `GET` {{(pid=71938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 24 16:30:39.255276 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54681ef5-227d-4791-b257-abba30df6012 admin admin] SCRIPT_NAME: `/identity` {{(pid=71938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 24 16:30:39.255612 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54681ef5-227d-4791-b257-abba30df6012 admin admin] PATH_INFO: `/v3/projects/6a75e77ca1684c808c57b448b83e73d2` {{(pid=71938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 24 16:30:39.256832 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54681ef5-227d-4791-b257-abba30df6012 admin admin] RBAC: Authorizing `identity:get_project(project_id=6a75e77ca1684c808c57b448b83e73d2)` {{(pid=71938) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:442}} Nov 24 16:30:39.285993 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54681ef5-227d-4791-b257-abba30df6012 admin admin] RBAC: Authorization granted {{(pid=71938) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 24 16:30:39.287778 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: [pid: 71938|app: 0|req: 159/317] 10.222.0.53 () {56 vars in 1198 bytes} [Wed Nov 24 16:30:39 2021] GET /identity/v3/projects/6a75e77ca1684c808c57b448b83e73d2 => generated 298 bytes in 51 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 24 16:30:39.293717 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eed75011-d95c-412c-90b9-4df35fa5ed15 admin admin] Authenticating user token {{(pid=71939) process_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 24 16:30:39.304423 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eed75011-d95c-412c-90b9-4df35fa5ed15 admin admin] Validating token access rules against request {{(pid=71939) validate_allowed_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 24 16:30:39.308606 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60c24c08-8975-4c61-bce4-0a119a9c9cb2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f2ba2e8375b4e8c8792ee1e22b60427', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '00a5583c7b7443e98e7a1d31a0b638dc', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=71939) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 24 16:30:39.309493 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60c24c08-8975-4c61-bce4-0a119a9c9cb2 admin admin] REQUEST_METHOD: `PUT` {{(pid=71939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 24 16:30:39.309827 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60c24c08-8975-4c61-bce4-0a119a9c9cb2 admin admin] SCRIPT_NAME: `/identity` {{(pid=71939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 24 16:30:39.310187 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60c24c08-8975-4c61-bce4-0a119a9c9cb2 admin admin] PATH_INFO: `/v3/projects/6a75e77ca1684c808c57b448b83e73d2/groups/16b7d0bfc00f4d7d9d1a855e2b730299/roles/0de27ef8b6e744cda429a0d133117dcd` {{(pid=71939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 24 16:30:39.312326 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60c24c08-8975-4c61-bce4-0a119a9c9cb2 admin admin] RBAC: Authorizing `identity:create_grant(project_id=6a75e77ca1684c808c57b448b83e73d2, group_id=16b7d0bfc00f4d7d9d1a855e2b730299, role_id=0de27ef8b6e744cda429a0d133117dcd)` {{(pid=71939) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:442}} Nov 24 16:30:39.341940 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60c24c08-8975-4c61-bce4-0a119a9c9cb2 admin admin] RBAC: Authorization granted {{(pid=71939) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 24 16:30:39.354564 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: [pid: 71939|app: 0|req: 159/318] 10.222.0.53 () {58 vars in 1454 bytes} [Wed Nov 24 16:30:39 2021] PUT /identity/v3/projects/6a75e77ca1684c808c57b448b83e73d2/groups/16b7d0bfc00f4d7d9d1a855e2b730299/roles/0de27ef8b6e744cda429a0d133117dcd => generated 0 bytes in 61 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 24 16:30:41.352043 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db7cc5ec-5245-4dac-a78c-a9f4a3f1207a None None] REQUEST_METHOD: `GET` {{(pid=71938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 24 16:30:41.352550 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db7cc5ec-5245-4dac-a78c-a9f4a3f1207a None None] SCRIPT_NAME: `/identity` {{(pid=71938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 24 16:30:41.352671 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db7cc5ec-5245-4dac-a78c-a9f4a3f1207a None None] PATH_INFO: `/` {{(pid=71938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 24 16:30:41.354555 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: [pid: 71938|app: 0|req: 160/319] 10.222.0.53 () {54 vars in 915 bytes} [Wed Nov 24 16:30:41 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 24 16:30:41.360494 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e094ac5-6823-42c7-8d07-067676715e54 None None] REQUEST_METHOD: `POST` {{(pid=71939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 24 16:30:41.360677 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e094ac5-6823-42c7-8d07-067676715e54 None None] SCRIPT_NAME: `/identity` {{(pid=71939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 24 16:30:41.361019 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e094ac5-6823-42c7-8d07-067676715e54 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=71939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 24 16:30:41.385259 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.auth.core [None req-8e094ac5-6823-42c7-8d07-067676715e54 None None] MFA Rules not processed for user `0f2ba2e8375b4e8c8792ee1e22b60427`. Rule list: `[]` (Enabled: `True`). {{(pid=71939) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:442}} Nov 24 16:30:41.386511 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.fernet_utils [None req-8e094ac5-6823-42c7-8d07-067676715e54 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=71939) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:289}} Nov 24 16:30:41.451770 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: [pid: 71939|app: 0|req: 160/320] 10.222.0.53 () {58 vars in 1013 bytes} [Wed Nov 24 16:30:41 2021] POST /identity/v3/auth/tokens => generated 1067 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 24 16:30:41.475112 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8946954-33c7-4016-8ca8-e07b19fe7cdf None None] REQUEST_METHOD: `POST` {{(pid=71938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 24 16:30:41.475396 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8946954-33c7-4016-8ca8-e07b19fe7cdf None None] SCRIPT_NAME: `/identity` {{(pid=71938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 24 16:30:41.475742 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8946954-33c7-4016-8ca8-e07b19fe7cdf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=71938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 24 16:30:41.505722 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.auth.core [None req-b8946954-33c7-4016-8ca8-e07b19fe7cdf None None] MFA Rules not processed for user `0f2ba2e8375b4e8c8792ee1e22b60427`. Rule list: `[]` (Enabled: `True`). {{(pid=71938) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:442}} Nov 24 16:30:41.508278 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.fernet_utils [None req-b8946954-33c7-4016-8ca8-e07b19fe7cdf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=71938) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:289}} Nov 24 16:30:41.517928 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: [pid: 71938|app: 0|req: 161/321] 10.222.0.53 () {58 vars in 1013 bytes} [Wed Nov 24 16:30:41 2021] POST /identity/v3/auth/tokens => generated 1067 bytes in 44 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 24 16:30:41.524071 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e094ac5-6823-42c7-8d07-067676715e54 None None] Authenticating user token {{(pid=71939) process_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 24 16:30:41.533688 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e094ac5-6823-42c7-8d07-067676715e54 None None] Validating token access rules against request {{(pid=71939) validate_allowed_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 24 16:30:41.538450 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-166cfdc3-304f-49b2-ac95-665f12d9d220 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f2ba2e8375b4e8c8792ee1e22b60427', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '00a5583c7b7443e98e7a1d31a0b638dc', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=71939) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 24 16:30:41.539269 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-166cfdc3-304f-49b2-ac95-665f12d9d220 admin admin] REQUEST_METHOD: `GET` {{(pid=71939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 24 16:30:41.539610 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-166cfdc3-304f-49b2-ac95-665f12d9d220 admin admin] SCRIPT_NAME: `/identity` {{(pid=71939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 24 16:30:41.539965 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-166cfdc3-304f-49b2-ac95-665f12d9d220 admin admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=71939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 24 16:30:41.552305 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-166cfdc3-304f-49b2-ac95-665f12d9d220 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=71939) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:401}} Nov 24 16:30:41.560077 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: WARNING keystone.server.flask.application [None req-166cfdc3-304f-49b2-ac95-665f12d9d220 admin admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Nov 24 16:30:41.561163 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: [pid: 71939|app: 0|req: 161/322] 10.222.0.53 () {56 vars in 1126 bytes} [Wed Nov 24 16:30:41 2021] GET /identity/v3/roles/anotherrole => generated 89 bytes in 38 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 24 16:30:41.567468 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8946954-33c7-4016-8ca8-e07b19fe7cdf None None] Authenticating user token {{(pid=71938) process_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 24 16:30:41.576496 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8946954-33c7-4016-8ca8-e07b19fe7cdf None None] Validating token access rules against request {{(pid=71938) validate_allowed_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 24 16:30:41.580977 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4cc6d69-2a98-4837-9a9b-4fb4809ea85a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f2ba2e8375b4e8c8792ee1e22b60427', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '00a5583c7b7443e98e7a1d31a0b638dc', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=71938) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 24 16:30:41.581639 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4cc6d69-2a98-4837-9a9b-4fb4809ea85a admin admin] REQUEST_METHOD: `GET` {{(pid=71938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 24 16:30:41.581975 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4cc6d69-2a98-4837-9a9b-4fb4809ea85a admin admin] SCRIPT_NAME: `/identity` {{(pid=71938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 24 16:30:41.582333 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4cc6d69-2a98-4837-9a9b-4fb4809ea85a admin admin] PATH_INFO: `/v3/roles` {{(pid=71938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 24 16:30:41.583134 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4cc6d69-2a98-4837-9a9b-4fb4809ea85a admin admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=71938) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:161}} Nov 24 16:30:41.583482 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4cc6d69-2a98-4837-9a9b-4fb4809ea85a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=71938) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:442}} Nov 24 16:30:41.612537 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4cc6d69-2a98-4837-9a9b-4fb4809ea85a admin admin] RBAC: Authorization granted {{(pid=71938) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 24 16:30:41.621211 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: [pid: 71938|app: 0|req: 162/323] 10.222.0.53 () {56 vars in 1123 bytes} [Wed Nov 24 16:30:41 2021] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 54 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 24 16:30:41.626737 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-166cfdc3-304f-49b2-ac95-665f12d9d220 admin admin] Authenticating user token {{(pid=71939) process_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 24 16:30:41.636895 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-166cfdc3-304f-49b2-ac95-665f12d9d220 admin admin] Validating token access rules against request {{(pid=71939) validate_allowed_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 24 16:30:41.641121 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed1491dd-6150-4ba1-aa35-99d48e74ea11 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f2ba2e8375b4e8c8792ee1e22b60427', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '00a5583c7b7443e98e7a1d31a0b638dc', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=71939) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 24 16:30:41.641757 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed1491dd-6150-4ba1-aa35-99d48e74ea11 admin admin] REQUEST_METHOD: `GET` {{(pid=71939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 24 16:30:41.642130 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed1491dd-6150-4ba1-aa35-99d48e74ea11 admin admin] SCRIPT_NAME: `/identity` {{(pid=71939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 24 16:30:41.642469 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed1491dd-6150-4ba1-aa35-99d48e74ea11 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=71939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 24 16:30:41.651120 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed1491dd-6150-4ba1-aa35-99d48e74ea11 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=71939) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:442}} Nov 24 16:30:41.681045 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed1491dd-6150-4ba1-aa35-99d48e74ea11 admin admin] RBAC: Authorization granted {{(pid=71939) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 24 16:30:41.690051 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: [pid: 71939|app: 0|req: 162/324] 10.222.0.53 () {58 vars in 1315 bytes} [Wed Nov 24 16:30:41 2021] GET /identity/v3/auth/tokens => generated 1067 bytes in 64 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 24 16:30:41.695657 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4cc6d69-2a98-4837-9a9b-4fb4809ea85a admin admin] Authenticating user token {{(pid=71938) process_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 24 16:30:41.705556 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4cc6d69-2a98-4837-9a9b-4fb4809ea85a admin admin] Validating token access rules against request {{(pid=71938) validate_allowed_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 24 16:30:41.709940 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74760a3b-d9e7-4d32-91ce-a6af70eebfca admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f2ba2e8375b4e8c8792ee1e22b60427', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '00a5583c7b7443e98e7a1d31a0b638dc', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=71938) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 24 16:30:41.710869 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74760a3b-d9e7-4d32-91ce-a6af70eebfca admin admin] REQUEST_METHOD: `GET` {{(pid=71938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 24 16:30:41.711209 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74760a3b-d9e7-4d32-91ce-a6af70eebfca admin admin] SCRIPT_NAME: `/identity` {{(pid=71938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 24 16:30:41.711546 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74760a3b-d9e7-4d32-91ce-a6af70eebfca admin admin] PATH_INFO: `/v3/projects/6a75e77ca1684c808c57b448b83e73d2` {{(pid=71938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 24 16:30:41.712751 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74760a3b-d9e7-4d32-91ce-a6af70eebfca admin admin] RBAC: Authorizing `identity:get_project(project_id=6a75e77ca1684c808c57b448b83e73d2)` {{(pid=71938) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:442}} Nov 24 16:30:41.742663 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74760a3b-d9e7-4d32-91ce-a6af70eebfca admin admin] RBAC: Authorization granted {{(pid=71938) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 24 16:30:41.744294 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: [pid: 71938|app: 0|req: 163/325] 10.222.0.53 () {56 vars in 1198 bytes} [Wed Nov 24 16:30:41 2021] GET /identity/v3/projects/6a75e77ca1684c808c57b448b83e73d2 => generated 298 bytes in 49 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 24 16:30:41.750042 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed1491dd-6150-4ba1-aa35-99d48e74ea11 admin admin] Authenticating user token {{(pid=71939) process_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 24 16:30:41.759538 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed1491dd-6150-4ba1-aa35-99d48e74ea11 admin admin] Validating token access rules against request {{(pid=71939) validate_allowed_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 24 16:30:41.763940 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-413d83c7-a085-46ca-b6c5-1c6d05da239f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f2ba2e8375b4e8c8792ee1e22b60427', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '00a5583c7b7443e98e7a1d31a0b638dc', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=71939) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 24 16:30:41.764804 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-413d83c7-a085-46ca-b6c5-1c6d05da239f admin admin] REQUEST_METHOD: `GET` {{(pid=71939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 24 16:30:41.765142 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-413d83c7-a085-46ca-b6c5-1c6d05da239f admin admin] SCRIPT_NAME: `/identity` {{(pid=71939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 24 16:30:41.765477 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-413d83c7-a085-46ca-b6c5-1c6d05da239f admin admin] PATH_INFO: `/v3/groups/16b7d0bfc00f4d7d9d1a855e2b730299` {{(pid=71939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 24 16:30:41.766689 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-413d83c7-a085-46ca-b6c5-1c6d05da239f admin admin] RBAC: Authorizing `identity:get_group(group_id=16b7d0bfc00f4d7d9d1a855e2b730299)` {{(pid=71939) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:442}} Nov 24 16:30:41.795380 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-413d83c7-a085-46ca-b6c5-1c6d05da239f admin admin] RBAC: Authorization granted {{(pid=71939) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 24 16:30:41.796953 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: [pid: 71939|app: 0|req: 163/326] 10.222.0.53 () {56 vars in 1192 bytes} [Wed Nov 24 16:30:41 2021] GET /identity/v3/groups/16b7d0bfc00f4d7d9d1a855e2b730299 => generated 226 bytes in 47 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 24 16:30:41.803384 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74760a3b-d9e7-4d32-91ce-a6af70eebfca admin admin] Authenticating user token {{(pid=71938) process_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 24 16:30:41.813210 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74760a3b-d9e7-4d32-91ce-a6af70eebfca admin admin] Validating token access rules against request {{(pid=71938) validate_allowed_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 24 16:30:41.817432 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eaa3c2f5-5a56-4342-8e15-903c18cfe065 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f2ba2e8375b4e8c8792ee1e22b60427', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '00a5583c7b7443e98e7a1d31a0b638dc', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=71938) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 24 16:30:41.818106 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaa3c2f5-5a56-4342-8e15-903c18cfe065 admin admin] REQUEST_METHOD: `GET` {{(pid=71938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 24 16:30:41.818450 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaa3c2f5-5a56-4342-8e15-903c18cfe065 admin admin] SCRIPT_NAME: `/identity` {{(pid=71938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 24 16:30:41.818783 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaa3c2f5-5a56-4342-8e15-903c18cfe065 admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=71938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 24 16:30:41.819666 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eaa3c2f5-5a56-4342-8e15-903c18cfe065 admin admin] RBAC: Adding query filter params (group.id=16b7d0bfc00f4d7d9d1a855e2b730299, role.id=0de27ef8b6e744cda429a0d133117dcd, scope.project.id=6a75e77ca1684c808c57b448b83e73d2) {{(pid=71938) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:161}} Nov 24 16:30:41.820029 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eaa3c2f5-5a56-4342-8e15-903c18cfe065 admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=71938) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:442}} Nov 24 16:30:41.849825 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eaa3c2f5-5a56-4342-8e15-903c18cfe065 admin admin] RBAC: Authorization granted {{(pid=71938) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 24 16:30:41.856343 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: [pid: 71938|app: 0|req: 164/327] 10.222.0.53 () {56 vars in 1388 bytes} [Wed Nov 24 16:30:41 2021] GET /identity/v3/role_assignments?group.id=16b7d0bfc00f4d7d9d1a855e2b730299&scope.project.id=6a75e77ca1684c808c57b448b83e73d2&role.id=0de27ef8b6e744cda429a0d133117dcd => generated 611 bytes in 53 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 24 16:30:43.841987 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b4bf684-bc7c-4cb9-b83f-93738c0f3e5b None None] REQUEST_METHOD: `GET` {{(pid=71939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 24 16:30:43.842552 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b4bf684-bc7c-4cb9-b83f-93738c0f3e5b None None] SCRIPT_NAME: `/identity` {{(pid=71939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 24 16:30:43.842702 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b4bf684-bc7c-4cb9-b83f-93738c0f3e5b None None] PATH_INFO: `/` {{(pid=71939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 24 16:30:43.844536 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: [pid: 71939|app: 0|req: 164/328] 10.222.0.53 () {54 vars in 915 bytes} [Wed Nov 24 16:30:43 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 24 16:30:43.851053 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8fca72d-8836-4afb-a293-e93588cc5124 None None] REQUEST_METHOD: `POST` {{(pid=71938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 24 16:30:43.851644 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8fca72d-8836-4afb-a293-e93588cc5124 None None] SCRIPT_NAME: `/identity` {{(pid=71938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 24 16:30:43.852213 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8fca72d-8836-4afb-a293-e93588cc5124 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=71938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 24 16:30:43.876965 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.auth.core [None req-d8fca72d-8836-4afb-a293-e93588cc5124 None None] MFA Rules not processed for user `0f2ba2e8375b4e8c8792ee1e22b60427`. Rule list: `[]` (Enabled: `True`). {{(pid=71938) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:442}} Nov 24 16:30:43.878734 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.fernet_utils [None req-d8fca72d-8836-4afb-a293-e93588cc5124 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=71938) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:289}} Nov 24 16:30:43.885754 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: [pid: 71938|app: 0|req: 165/329] 10.222.0.53 () {58 vars in 1013 bytes} [Wed Nov 24 16:30:43 2021] POST /identity/v3/auth/tokens => generated 1067 bytes in 37 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 24 16:30:43.908673 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8240f925-da30-4977-b46c-354d997188f8 None None] REQUEST_METHOD: `POST` {{(pid=71939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 24 16:30:43.909073 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8240f925-da30-4977-b46c-354d997188f8 None None] SCRIPT_NAME: `/identity` {{(pid=71939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 24 16:30:43.909413 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8240f925-da30-4977-b46c-354d997188f8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=71939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 24 16:30:43.933041 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.auth.core [None req-8240f925-da30-4977-b46c-354d997188f8 None None] MFA Rules not processed for user `0f2ba2e8375b4e8c8792ee1e22b60427`. Rule list: `[]` (Enabled: `True`). {{(pid=71939) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:442}} Nov 24 16:30:43.934297 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.fernet_utils [None req-8240f925-da30-4977-b46c-354d997188f8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=71939) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:289}} Nov 24 16:30:43.942532 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: [pid: 71939|app: 0|req: 165/330] 10.222.0.53 () {58 vars in 1013 bytes} [Wed Nov 24 16:30:43 2021] POST /identity/v3/auth/tokens => generated 1067 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 24 16:30:43.948294 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8fca72d-8836-4afb-a293-e93588cc5124 None None] Authenticating user token {{(pid=71938) process_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 24 16:30:43.958973 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8fca72d-8836-4afb-a293-e93588cc5124 None None] Validating token access rules against request {{(pid=71938) validate_allowed_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 24 16:30:43.963199 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-657f1ba7-b9d7-4fa0-9ced-4e3b1a83b04b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f2ba2e8375b4e8c8792ee1e22b60427', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '00a5583c7b7443e98e7a1d31a0b638dc', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=71938) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 24 16:30:43.964009 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-657f1ba7-b9d7-4fa0-9ced-4e3b1a83b04b admin admin] REQUEST_METHOD: `GET` {{(pid=71938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 24 16:30:43.964349 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-657f1ba7-b9d7-4fa0-9ced-4e3b1a83b04b admin admin] SCRIPT_NAME: `/identity` {{(pid=71938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 24 16:30:43.964682 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-657f1ba7-b9d7-4fa0-9ced-4e3b1a83b04b admin admin] PATH_INFO: `/v3/roles/member` {{(pid=71938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 24 16:30:43.977570 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-657f1ba7-b9d7-4fa0-9ced-4e3b1a83b04b admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=71938) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:401}} Nov 24 16:30:43.985021 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: WARNING keystone.server.flask.application [None req-657f1ba7-b9d7-4fa0-9ced-4e3b1a83b04b admin admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Nov 24 16:30:43.986263 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: [pid: 71938|app: 0|req: 166/331] 10.222.0.53 () {56 vars in 1111 bytes} [Wed Nov 24 16:30:43 2021] GET /identity/v3/roles/member => generated 84 bytes in 39 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 24 16:30:43.992908 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8240f925-da30-4977-b46c-354d997188f8 None None] Authenticating user token {{(pid=71939) process_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 24 16:30:44.002236 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8240f925-da30-4977-b46c-354d997188f8 None None] Validating token access rules against request {{(pid=71939) validate_allowed_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 24 16:30:44.007070 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48b14324-f722-4319-a161-1b7b928d65fc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f2ba2e8375b4e8c8792ee1e22b60427', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '00a5583c7b7443e98e7a1d31a0b638dc', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=71939) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 24 16:30:44.007744 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48b14324-f722-4319-a161-1b7b928d65fc admin admin] REQUEST_METHOD: `GET` {{(pid=71939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 24 16:30:44.008084 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48b14324-f722-4319-a161-1b7b928d65fc admin admin] SCRIPT_NAME: `/identity` {{(pid=71939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 24 16:30:44.008417 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48b14324-f722-4319-a161-1b7b928d65fc admin admin] PATH_INFO: `/v3/roles` {{(pid=71939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 24 16:30:44.009226 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48b14324-f722-4319-a161-1b7b928d65fc admin admin] RBAC: Adding query filter params (name=member) {{(pid=71939) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:161}} Nov 24 16:30:44.009577 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48b14324-f722-4319-a161-1b7b928d65fc admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=71939) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:442}} Nov 24 16:30:44.038020 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48b14324-f722-4319-a161-1b7b928d65fc admin admin] RBAC: Authorization granted {{(pid=71939) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 24 16:30:44.047296 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: [pid: 71939|app: 0|req: 166/332] 10.222.0.53 () {56 vars in 1113 bytes} [Wed Nov 24 16:30:43 2021] GET /identity/v3/roles?name=member => generated 341 bytes in 55 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 24 16:30:44.053164 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-657f1ba7-b9d7-4fa0-9ced-4e3b1a83b04b admin admin] Authenticating user token {{(pid=71938) process_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 24 16:30:44.063495 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-657f1ba7-b9d7-4fa0-9ced-4e3b1a83b04b admin admin] Validating token access rules against request {{(pid=71938) validate_allowed_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 24 16:30:44.070691 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2897210-e956-4162-a308-e490db3097d3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f2ba2e8375b4e8c8792ee1e22b60427', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '00a5583c7b7443e98e7a1d31a0b638dc', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=71938) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 24 16:30:44.071450 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2897210-e956-4162-a308-e490db3097d3 admin admin] REQUEST_METHOD: `GET` {{(pid=71938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 24 16:30:44.071868 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2897210-e956-4162-a308-e490db3097d3 admin admin] SCRIPT_NAME: `/identity` {{(pid=71938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 24 16:30:44.072281 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2897210-e956-4162-a308-e490db3097d3 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=71938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 24 16:30:44.081591 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2897210-e956-4162-a308-e490db3097d3 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=71938) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:442}} Nov 24 16:30:44.109773 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2897210-e956-4162-a308-e490db3097d3 admin admin] RBAC: Authorization granted {{(pid=71938) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 24 16:30:44.119276 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: [pid: 71938|app: 0|req: 167/333] 10.222.0.53 () {58 vars in 1315 bytes} [Wed Nov 24 16:30:44 2021] GET /identity/v3/auth/tokens => generated 1067 bytes in 67 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 24 16:30:44.125731 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48b14324-f722-4319-a161-1b7b928d65fc admin admin] Authenticating user token {{(pid=71939) process_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 24 16:30:44.136336 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48b14324-f722-4319-a161-1b7b928d65fc admin admin] Validating token access rules against request {{(pid=71939) validate_allowed_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 24 16:30:44.140711 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-348e2ff7-83ba-4a39-a960-d1ceb376dd1f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f2ba2e8375b4e8c8792ee1e22b60427', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '00a5583c7b7443e98e7a1d31a0b638dc', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=71939) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 24 16:30:44.141583 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-348e2ff7-83ba-4a39-a960-d1ceb376dd1f admin admin] REQUEST_METHOD: `GET` {{(pid=71939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 24 16:30:44.141924 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-348e2ff7-83ba-4a39-a960-d1ceb376dd1f admin admin] SCRIPT_NAME: `/identity` {{(pid=71939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 24 16:30:44.142289 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-348e2ff7-83ba-4a39-a960-d1ceb376dd1f admin admin] PATH_INFO: `/v3/projects/7cdfba1dd86043ea9b1cf6498535c213` {{(pid=71939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 24 16:30:44.143502 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-348e2ff7-83ba-4a39-a960-d1ceb376dd1f admin admin] RBAC: Authorizing `identity:get_project(project_id=7cdfba1dd86043ea9b1cf6498535c213)` {{(pid=71939) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:442}} Nov 24 16:30:44.172050 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-348e2ff7-83ba-4a39-a960-d1ceb376dd1f admin admin] RBAC: Authorization granted {{(pid=71939) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 24 16:30:44.173871 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: [pid: 71939|app: 0|req: 167/334] 10.222.0.53 () {56 vars in 1198 bytes} [Wed Nov 24 16:30:44 2021] GET /identity/v3/projects/7cdfba1dd86043ea9b1cf6498535c213 => generated 302 bytes in 49 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 24 16:30:44.180420 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2897210-e956-4162-a308-e490db3097d3 admin admin] Authenticating user token {{(pid=71938) process_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 24 16:30:44.190734 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2897210-e956-4162-a308-e490db3097d3 admin admin] Validating token access rules against request {{(pid=71938) validate_allowed_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 24 16:30:44.195386 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30a81bea-c83b-4a05-9433-052387422112 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f2ba2e8375b4e8c8792ee1e22b60427', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '00a5583c7b7443e98e7a1d31a0b638dc', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=71938) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 24 16:30:44.196265 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30a81bea-c83b-4a05-9433-052387422112 admin admin] REQUEST_METHOD: `GET` {{(pid=71938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 24 16:30:44.196604 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30a81bea-c83b-4a05-9433-052387422112 admin admin] SCRIPT_NAME: `/identity` {{(pid=71938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 24 16:30:44.196936 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30a81bea-c83b-4a05-9433-052387422112 admin admin] PATH_INFO: `/v3/groups/16b7d0bfc00f4d7d9d1a855e2b730299` {{(pid=71938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 24 16:30:44.198185 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30a81bea-c83b-4a05-9433-052387422112 admin admin] RBAC: Authorizing `identity:get_group(group_id=16b7d0bfc00f4d7d9d1a855e2b730299)` {{(pid=71938) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:442}} Nov 24 16:30:44.227073 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30a81bea-c83b-4a05-9433-052387422112 admin admin] RBAC: Authorization granted {{(pid=71938) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 24 16:30:44.228772 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: [pid: 71938|app: 0|req: 168/335] 10.222.0.53 () {56 vars in 1192 bytes} [Wed Nov 24 16:30:44 2021] GET /identity/v3/groups/16b7d0bfc00f4d7d9d1a855e2b730299 => generated 226 bytes in 49 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 24 16:30:44.235012 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-348e2ff7-83ba-4a39-a960-d1ceb376dd1f admin admin] Authenticating user token {{(pid=71939) process_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 24 16:30:44.245584 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-348e2ff7-83ba-4a39-a960-d1ceb376dd1f admin admin] Validating token access rules against request {{(pid=71939) validate_allowed_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 24 16:30:44.249947 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aba5b0a0-be44-42bd-93b0-080342ead63b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f2ba2e8375b4e8c8792ee1e22b60427', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '00a5583c7b7443e98e7a1d31a0b638dc', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=71939) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 24 16:30:44.250645 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aba5b0a0-be44-42bd-93b0-080342ead63b admin admin] REQUEST_METHOD: `GET` {{(pid=71939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 24 16:30:44.250989 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aba5b0a0-be44-42bd-93b0-080342ead63b admin admin] SCRIPT_NAME: `/identity` {{(pid=71939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 24 16:30:44.251326 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aba5b0a0-be44-42bd-93b0-080342ead63b admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=71939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 24 16:30:44.252217 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aba5b0a0-be44-42bd-93b0-080342ead63b admin admin] RBAC: Adding query filter params (group.id=16b7d0bfc00f4d7d9d1a855e2b730299, role.id=912ab5f10fa5477da74acf239f07604e, scope.project.id=7cdfba1dd86043ea9b1cf6498535c213) {{(pid=71939) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:161}} Nov 24 16:30:44.253141 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aba5b0a0-be44-42bd-93b0-080342ead63b admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=71939) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:442}} Nov 24 16:30:44.281307 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aba5b0a0-be44-42bd-93b0-080342ead63b admin admin] RBAC: Authorization granted {{(pid=71939) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 24 16:30:44.287168 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: [pid: 71939|app: 0|req: 168/336] 10.222.0.53 () {56 vars in 1388 bytes} [Wed Nov 24 16:30:44 2021] GET /identity/v3/role_assignments?group.id=16b7d0bfc00f4d7d9d1a855e2b730299&scope.project.id=7cdfba1dd86043ea9b1cf6498535c213&role.id=912ab5f10fa5477da74acf239f07604e => generated 260 bytes in 53 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 24 16:30:46.265314 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13e0f30d-20f5-4cae-848b-d1516df3942d None None] REQUEST_METHOD: `GET` {{(pid=71938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 24 16:30:46.265825 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13e0f30d-20f5-4cae-848b-d1516df3942d None None] SCRIPT_NAME: `/identity` {{(pid=71938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 24 16:30:46.265979 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13e0f30d-20f5-4cae-848b-d1516df3942d None None] PATH_INFO: `/` {{(pid=71938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 24 16:30:46.267849 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: [pid: 71938|app: 0|req: 169/337] 10.222.0.53 () {54 vars in 915 bytes} [Wed Nov 24 16:30:46 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 24 16:30:46.275608 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7384449f-9e34-4eed-9932-05d443b50233 None None] REQUEST_METHOD: `POST` {{(pid=71939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 24 16:30:46.275964 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7384449f-9e34-4eed-9932-05d443b50233 None None] SCRIPT_NAME: `/identity` {{(pid=71939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 24 16:30:46.276301 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7384449f-9e34-4eed-9932-05d443b50233 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=71939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 24 16:30:46.299774 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.auth.core [None req-7384449f-9e34-4eed-9932-05d443b50233 None None] MFA Rules not processed for user `0f2ba2e8375b4e8c8792ee1e22b60427`. Rule list: `[]` (Enabled: `True`). {{(pid=71939) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:442}} Nov 24 16:30:46.300987 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.fernet_utils [None req-7384449f-9e34-4eed-9932-05d443b50233 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=71939) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:289}} Nov 24 16:30:46.307998 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: [pid: 71939|app: 0|req: 169/338] 10.222.0.53 () {58 vars in 1013 bytes} [Wed Nov 24 16:30:46 2021] POST /identity/v3/auth/tokens => generated 1067 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 24 16:30:46.332002 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0520cc61-407d-48ed-b0ed-5395c01d5520 None None] REQUEST_METHOD: `POST` {{(pid=71938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 24 16:30:46.332342 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0520cc61-407d-48ed-b0ed-5395c01d5520 None None] SCRIPT_NAME: `/identity` {{(pid=71938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 24 16:30:46.332681 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0520cc61-407d-48ed-b0ed-5395c01d5520 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=71938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 24 16:30:46.357770 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.auth.core [None req-0520cc61-407d-48ed-b0ed-5395c01d5520 None None] MFA Rules not processed for user `0f2ba2e8375b4e8c8792ee1e22b60427`. Rule list: `[]` (Enabled: `True`). {{(pid=71938) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:442}} Nov 24 16:30:46.359024 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.fernet_utils [None req-0520cc61-407d-48ed-b0ed-5395c01d5520 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=71938) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:289}} Nov 24 16:30:46.366824 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: [pid: 71938|app: 0|req: 170/339] 10.222.0.53 () {58 vars in 1013 bytes} [Wed Nov 24 16:30:46 2021] POST /identity/v3/auth/tokens => generated 1067 bytes in 37 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 24 16:30:46.372663 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7384449f-9e34-4eed-9932-05d443b50233 None None] Authenticating user token {{(pid=71939) process_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 24 16:30:46.383117 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7384449f-9e34-4eed-9932-05d443b50233 None None] Validating token access rules against request {{(pid=71939) validate_allowed_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 24 16:30:46.387312 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f791f535-fd7c-4dbb-b154-b2b2ddf24274 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f2ba2e8375b4e8c8792ee1e22b60427', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '00a5583c7b7443e98e7a1d31a0b638dc', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=71939) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 24 16:30:46.388124 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f791f535-fd7c-4dbb-b154-b2b2ddf24274 admin admin] REQUEST_METHOD: `GET` {{(pid=71939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 24 16:30:46.388471 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f791f535-fd7c-4dbb-b154-b2b2ddf24274 admin admin] SCRIPT_NAME: `/identity` {{(pid=71939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 24 16:30:46.388810 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f791f535-fd7c-4dbb-b154-b2b2ddf24274 admin admin] PATH_INFO: `/v3/roles/member` {{(pid=71939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 24 16:30:46.400677 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f791f535-fd7c-4dbb-b154-b2b2ddf24274 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=71939) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:401}} Nov 24 16:30:46.408103 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: WARNING keystone.server.flask.application [None req-f791f535-fd7c-4dbb-b154-b2b2ddf24274 admin admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Nov 24 16:30:46.409386 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: [pid: 71939|app: 0|req: 170/340] 10.222.0.53 () {56 vars in 1111 bytes} [Wed Nov 24 16:30:46 2021] GET /identity/v3/roles/member => generated 84 bytes in 37 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 24 16:30:46.415949 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0520cc61-407d-48ed-b0ed-5395c01d5520 None None] Authenticating user token {{(pid=71938) process_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 24 16:30:46.425545 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0520cc61-407d-48ed-b0ed-5395c01d5520 None None] Validating token access rules against request {{(pid=71938) validate_allowed_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 24 16:30:46.429738 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-810d32a1-e73e-4c67-b88c-584121e1e4ce admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f2ba2e8375b4e8c8792ee1e22b60427', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '00a5583c7b7443e98e7a1d31a0b638dc', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=71938) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 24 16:30:46.430432 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-810d32a1-e73e-4c67-b88c-584121e1e4ce admin admin] REQUEST_METHOD: `GET` {{(pid=71938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 24 16:30:46.430767 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-810d32a1-e73e-4c67-b88c-584121e1e4ce admin admin] SCRIPT_NAME: `/identity` {{(pid=71938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 24 16:30:46.431096 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-810d32a1-e73e-4c67-b88c-584121e1e4ce admin admin] PATH_INFO: `/v3/roles` {{(pid=71938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 24 16:30:46.431896 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-810d32a1-e73e-4c67-b88c-584121e1e4ce admin admin] RBAC: Adding query filter params (name=member) {{(pid=71938) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:161}} Nov 24 16:30:46.432239 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-810d32a1-e73e-4c67-b88c-584121e1e4ce admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=71938) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:442}} Nov 24 16:30:46.461614 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-810d32a1-e73e-4c67-b88c-584121e1e4ce admin admin] RBAC: Authorization granted {{(pid=71938) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 24 16:30:46.471195 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: [pid: 71938|app: 0|req: 171/341] 10.222.0.53 () {56 vars in 1113 bytes} [Wed Nov 24 16:30:46 2021] GET /identity/v3/roles?name=member => generated 341 bytes in 56 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 24 16:30:46.477311 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f791f535-fd7c-4dbb-b154-b2b2ddf24274 admin admin] Authenticating user token {{(pid=71939) process_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 24 16:30:46.488344 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f791f535-fd7c-4dbb-b154-b2b2ddf24274 admin admin] Validating token access rules against request {{(pid=71939) validate_allowed_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 24 16:30:46.492555 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0cfdd3f-001b-42cf-a408-39ac6d2b29d6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f2ba2e8375b4e8c8792ee1e22b60427', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '00a5583c7b7443e98e7a1d31a0b638dc', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=71939) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 24 16:30:46.493420 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0cfdd3f-001b-42cf-a408-39ac6d2b29d6 admin admin] REQUEST_METHOD: `GET` {{(pid=71939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 24 16:30:46.493760 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0cfdd3f-001b-42cf-a408-39ac6d2b29d6 admin admin] SCRIPT_NAME: `/identity` {{(pid=71939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 24 16:30:46.494144 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0cfdd3f-001b-42cf-a408-39ac6d2b29d6 admin admin] PATH_INFO: `/v3/groups/16b7d0bfc00f4d7d9d1a855e2b730299` {{(pid=71939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 24 16:30:46.495323 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0cfdd3f-001b-42cf-a408-39ac6d2b29d6 admin admin] RBAC: Authorizing `identity:get_group(group_id=16b7d0bfc00f4d7d9d1a855e2b730299)` {{(pid=71939) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:442}} Nov 24 16:30:46.524207 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0cfdd3f-001b-42cf-a408-39ac6d2b29d6 admin admin] RBAC: Authorization granted {{(pid=71939) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 24 16:30:46.525884 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: [pid: 71939|app: 0|req: 171/342] 10.222.0.53 () {56 vars in 1192 bytes} [Wed Nov 24 16:30:46 2021] GET /identity/v3/groups/16b7d0bfc00f4d7d9d1a855e2b730299 => generated 226 bytes in 49 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 24 16:30:46.532032 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-810d32a1-e73e-4c67-b88c-584121e1e4ce admin admin] Authenticating user token {{(pid=71938) process_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 24 16:30:46.542292 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-810d32a1-e73e-4c67-b88c-584121e1e4ce admin admin] Validating token access rules against request {{(pid=71938) validate_allowed_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 24 16:30:46.547082 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1e341f8-78ed-4d66-93c6-dab74471036e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f2ba2e8375b4e8c8792ee1e22b60427', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '00a5583c7b7443e98e7a1d31a0b638dc', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=71938) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 24 16:30:46.547967 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1e341f8-78ed-4d66-93c6-dab74471036e admin admin] REQUEST_METHOD: `GET` {{(pid=71938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 24 16:30:46.548328 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1e341f8-78ed-4d66-93c6-dab74471036e admin admin] SCRIPT_NAME: `/identity` {{(pid=71938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 24 16:30:46.548641 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1e341f8-78ed-4d66-93c6-dab74471036e admin admin] PATH_INFO: `/v3/projects/7cdfba1dd86043ea9b1cf6498535c213` {{(pid=71938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 24 16:30:46.550397 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1e341f8-78ed-4d66-93c6-dab74471036e admin admin] RBAC: Authorizing `identity:get_project(project_id=7cdfba1dd86043ea9b1cf6498535c213)` {{(pid=71938) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:442}} Nov 24 16:30:46.580101 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1e341f8-78ed-4d66-93c6-dab74471036e admin admin] RBAC: Authorization granted {{(pid=71938) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 24 16:30:46.581868 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: [pid: 71938|app: 0|req: 172/343] 10.222.0.53 () {56 vars in 1198 bytes} [Wed Nov 24 16:30:46 2021] GET /identity/v3/projects/7cdfba1dd86043ea9b1cf6498535c213 => generated 302 bytes in 50 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 24 16:30:46.588087 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0cfdd3f-001b-42cf-a408-39ac6d2b29d6 admin admin] Authenticating user token {{(pid=71939) process_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 24 16:30:46.598199 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0cfdd3f-001b-42cf-a408-39ac6d2b29d6 admin admin] Validating token access rules against request {{(pid=71939) validate_allowed_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 24 16:30:46.602374 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3bf8331-0313-4324-87fd-7927e0aad082 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f2ba2e8375b4e8c8792ee1e22b60427', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '00a5583c7b7443e98e7a1d31a0b638dc', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=71939) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 24 16:30:46.603267 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3bf8331-0313-4324-87fd-7927e0aad082 admin admin] REQUEST_METHOD: `PUT` {{(pid=71939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 24 16:30:46.603608 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3bf8331-0313-4324-87fd-7927e0aad082 admin admin] SCRIPT_NAME: `/identity` {{(pid=71939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 24 16:30:46.603944 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3bf8331-0313-4324-87fd-7927e0aad082 admin admin] PATH_INFO: `/v3/projects/7cdfba1dd86043ea9b1cf6498535c213/groups/16b7d0bfc00f4d7d9d1a855e2b730299/roles/912ab5f10fa5477da74acf239f07604e` {{(pid=71939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 24 16:30:46.605849 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3bf8331-0313-4324-87fd-7927e0aad082 admin admin] RBAC: Authorizing `identity:create_grant(project_id=7cdfba1dd86043ea9b1cf6498535c213, group_id=16b7d0bfc00f4d7d9d1a855e2b730299, role_id=912ab5f10fa5477da74acf239f07604e)` {{(pid=71939) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:442}} Nov 24 16:30:46.635976 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3bf8331-0313-4324-87fd-7927e0aad082 admin admin] RBAC: Authorization granted {{(pid=71939) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 24 16:30:46.648109 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: [pid: 71939|app: 0|req: 172/344] 10.222.0.53 () {58 vars in 1454 bytes} [Wed Nov 24 16:30:46 2021] PUT /identity/v3/projects/7cdfba1dd86043ea9b1cf6498535c213/groups/16b7d0bfc00f4d7d9d1a855e2b730299/roles/912ab5f10fa5477da74acf239f07604e => generated 0 bytes in 61 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Nov 24 16:30:48.633132 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79186d9d-c4a3-452d-869a-05fe36eab1a4 None None] REQUEST_METHOD: `GET` {{(pid=71938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 24 16:30:48.633642 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79186d9d-c4a3-452d-869a-05fe36eab1a4 None None] SCRIPT_NAME: `/identity` {{(pid=71938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 24 16:30:48.633746 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79186d9d-c4a3-452d-869a-05fe36eab1a4 None None] PATH_INFO: `/` {{(pid=71938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 24 16:30:48.635615 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: [pid: 71938|app: 0|req: 173/345] 10.222.0.53 () {54 vars in 915 bytes} [Wed Nov 24 16:30:48 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 24 16:30:48.641243 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c46b5e3c-e26b-4e20-8a2c-a74d5a628c81 None None] REQUEST_METHOD: `POST` {{(pid=71939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 24 16:30:48.641588 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c46b5e3c-e26b-4e20-8a2c-a74d5a628c81 None None] SCRIPT_NAME: `/identity` {{(pid=71939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 24 16:30:48.641926 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c46b5e3c-e26b-4e20-8a2c-a74d5a628c81 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=71939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 24 16:30:48.666922 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.auth.core [None req-c46b5e3c-e26b-4e20-8a2c-a74d5a628c81 None None] MFA Rules not processed for user `0f2ba2e8375b4e8c8792ee1e22b60427`. Rule list: `[]` (Enabled: `True`). {{(pid=71939) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:442}} Nov 24 16:30:48.668160 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.fernet_utils [None req-c46b5e3c-e26b-4e20-8a2c-a74d5a628c81 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=71939) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:289}} Nov 24 16:30:48.736982 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: [pid: 71939|app: 0|req: 173/346] 10.222.0.53 () {58 vars in 1013 bytes} [Wed Nov 24 16:30:48 2021] POST /identity/v3/auth/tokens => generated 1067 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 24 16:30:48.758871 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-130eec79-2079-46c7-b779-00d5b8c09f96 None None] REQUEST_METHOD: `POST` {{(pid=71938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 24 16:30:48.759212 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-130eec79-2079-46c7-b779-00d5b8c09f96 None None] SCRIPT_NAME: `/identity` {{(pid=71938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 24 16:30:48.759621 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-130eec79-2079-46c7-b779-00d5b8c09f96 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=71938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 24 16:30:48.783288 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.auth.core [None req-130eec79-2079-46c7-b779-00d5b8c09f96 None None] MFA Rules not processed for user `0f2ba2e8375b4e8c8792ee1e22b60427`. Rule list: `[]` (Enabled: `True`). {{(pid=71938) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:442}} Nov 24 16:30:48.785122 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.fernet_utils [None req-130eec79-2079-46c7-b779-00d5b8c09f96 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=71938) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:289}} Nov 24 16:30:48.792052 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: [pid: 71938|app: 0|req: 174/347] 10.222.0.53 () {58 vars in 1013 bytes} [Wed Nov 24 16:30:48 2021] POST /identity/v3/auth/tokens => generated 1067 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 24 16:30:48.797730 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c46b5e3c-e26b-4e20-8a2c-a74d5a628c81 None None] Authenticating user token {{(pid=71939) process_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 24 16:30:48.807379 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c46b5e3c-e26b-4e20-8a2c-a74d5a628c81 None None] Validating token access rules against request {{(pid=71939) validate_allowed_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 24 16:30:48.811655 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b752ecf9-4a03-480e-b150-1ff7bec4c09a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f2ba2e8375b4e8c8792ee1e22b60427', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '00a5583c7b7443e98e7a1d31a0b638dc', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=71939) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 24 16:30:48.812469 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b752ecf9-4a03-480e-b150-1ff7bec4c09a admin admin] REQUEST_METHOD: `GET` {{(pid=71939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 24 16:30:48.812809 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b752ecf9-4a03-480e-b150-1ff7bec4c09a admin admin] SCRIPT_NAME: `/identity` {{(pid=71939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 24 16:30:48.813142 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b752ecf9-4a03-480e-b150-1ff7bec4c09a admin admin] PATH_INFO: `/v3/roles/member` {{(pid=71939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 24 16:30:48.825030 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b752ecf9-4a03-480e-b150-1ff7bec4c09a admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=71939) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:401}} Nov 24 16:30:48.833306 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: WARNING keystone.server.flask.application [None req-b752ecf9-4a03-480e-b150-1ff7bec4c09a admin admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Nov 24 16:30:48.834536 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: [pid: 71939|app: 0|req: 174/348] 10.222.0.53 () {56 vars in 1111 bytes} [Wed Nov 24 16:30:48 2021] GET /identity/v3/roles/member => generated 84 bytes in 37 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 24 16:30:48.840958 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-130eec79-2079-46c7-b779-00d5b8c09f96 None None] Authenticating user token {{(pid=71938) process_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 24 16:30:48.850746 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-130eec79-2079-46c7-b779-00d5b8c09f96 None None] Validating token access rules against request {{(pid=71938) validate_allowed_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 24 16:30:48.855056 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abc432d2-6833-465f-ae1e-9ae8b41f012c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f2ba2e8375b4e8c8792ee1e22b60427', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '00a5583c7b7443e98e7a1d31a0b638dc', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=71938) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 24 16:30:48.855722 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abc432d2-6833-465f-ae1e-9ae8b41f012c admin admin] REQUEST_METHOD: `GET` {{(pid=71938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 24 16:30:48.856056 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abc432d2-6833-465f-ae1e-9ae8b41f012c admin admin] SCRIPT_NAME: `/identity` {{(pid=71938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 24 16:30:48.856385 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abc432d2-6833-465f-ae1e-9ae8b41f012c admin admin] PATH_INFO: `/v3/roles` {{(pid=71938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 24 16:30:48.857184 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abc432d2-6833-465f-ae1e-9ae8b41f012c admin admin] RBAC: Adding query filter params (name=member) {{(pid=71938) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:161}} Nov 24 16:30:48.857531 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abc432d2-6833-465f-ae1e-9ae8b41f012c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=71938) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:442}} Nov 24 16:30:48.885472 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abc432d2-6833-465f-ae1e-9ae8b41f012c admin admin] RBAC: Authorization granted {{(pid=71938) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 24 16:30:48.895222 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: [pid: 71938|app: 0|req: 175/349] 10.222.0.53 () {56 vars in 1113 bytes} [Wed Nov 24 16:30:48 2021] GET /identity/v3/roles?name=member => generated 341 bytes in 55 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 24 16:30:48.901511 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b752ecf9-4a03-480e-b150-1ff7bec4c09a admin admin] Authenticating user token {{(pid=71939) process_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 24 16:30:48.914153 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b752ecf9-4a03-480e-b150-1ff7bec4c09a admin admin] Validating token access rules against request {{(pid=71939) validate_allowed_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 24 16:30:48.918901 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81471790-1a49-4ce7-b4b1-172ba209fc77 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f2ba2e8375b4e8c8792ee1e22b60427', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '00a5583c7b7443e98e7a1d31a0b638dc', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=71939) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 24 16:30:48.919687 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81471790-1a49-4ce7-b4b1-172ba209fc77 admin admin] REQUEST_METHOD: `GET` {{(pid=71939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 24 16:30:48.920033 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81471790-1a49-4ce7-b4b1-172ba209fc77 admin admin] SCRIPT_NAME: `/identity` {{(pid=71939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 24 16:30:48.920367 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81471790-1a49-4ce7-b4b1-172ba209fc77 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=71939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 24 16:30:48.929035 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81471790-1a49-4ce7-b4b1-172ba209fc77 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=71939) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:442}} Nov 24 16:30:48.958671 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81471790-1a49-4ce7-b4b1-172ba209fc77 admin admin] RBAC: Authorization granted {{(pid=71939) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 24 16:30:48.967918 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: [pid: 71939|app: 0|req: 175/350] 10.222.0.53 () {58 vars in 1315 bytes} [Wed Nov 24 16:30:48 2021] GET /identity/v3/auth/tokens => generated 1067 bytes in 67 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 24 16:30:48.973985 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abc432d2-6833-465f-ae1e-9ae8b41f012c admin admin] Authenticating user token {{(pid=71938) process_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 24 16:30:48.983859 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abc432d2-6833-465f-ae1e-9ae8b41f012c admin admin] Validating token access rules against request {{(pid=71938) validate_allowed_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 24 16:30:48.988161 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efb5e5b3-f3f1-4769-9e9f-bd8edc117aa7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f2ba2e8375b4e8c8792ee1e22b60427', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '00a5583c7b7443e98e7a1d31a0b638dc', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=71938) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 24 16:30:48.989048 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efb5e5b3-f3f1-4769-9e9f-bd8edc117aa7 admin admin] REQUEST_METHOD: `GET` {{(pid=71938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 24 16:30:48.989383 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efb5e5b3-f3f1-4769-9e9f-bd8edc117aa7 admin admin] SCRIPT_NAME: `/identity` {{(pid=71938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 24 16:30:48.989714 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efb5e5b3-f3f1-4769-9e9f-bd8edc117aa7 admin admin] PATH_INFO: `/v3/projects/7cdfba1dd86043ea9b1cf6498535c213` {{(pid=71938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 24 16:30:48.991053 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efb5e5b3-f3f1-4769-9e9f-bd8edc117aa7 admin admin] RBAC: Authorizing `identity:get_project(project_id=7cdfba1dd86043ea9b1cf6498535c213)` {{(pid=71938) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:442}} Nov 24 16:30:49.021825 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efb5e5b3-f3f1-4769-9e9f-bd8edc117aa7 admin admin] RBAC: Authorization granted {{(pid=71938) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 24 16:30:49.023759 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: [pid: 71938|app: 0|req: 176/351] 10.222.0.53 () {56 vars in 1198 bytes} [Wed Nov 24 16:30:48 2021] GET /identity/v3/projects/7cdfba1dd86043ea9b1cf6498535c213 => generated 302 bytes in 50 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 24 16:30:49.029911 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81471790-1a49-4ce7-b4b1-172ba209fc77 admin admin] Authenticating user token {{(pid=71939) process_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 24 16:30:49.039978 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81471790-1a49-4ce7-b4b1-172ba209fc77 admin admin] Validating token access rules against request {{(pid=71939) validate_allowed_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 24 16:30:49.045421 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d85738b1-9867-479b-a372-3315148dd735 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f2ba2e8375b4e8c8792ee1e22b60427', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '00a5583c7b7443e98e7a1d31a0b638dc', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=71939) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 24 16:30:49.046334 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d85738b1-9867-479b-a372-3315148dd735 admin admin] REQUEST_METHOD: `GET` {{(pid=71939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 24 16:30:49.046675 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d85738b1-9867-479b-a372-3315148dd735 admin admin] SCRIPT_NAME: `/identity` {{(pid=71939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 24 16:30:49.047004 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d85738b1-9867-479b-a372-3315148dd735 admin admin] PATH_INFO: `/v3/groups/16b7d0bfc00f4d7d9d1a855e2b730299` {{(pid=71939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 24 16:30:49.048203 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d85738b1-9867-479b-a372-3315148dd735 admin admin] RBAC: Authorizing `identity:get_group(group_id=16b7d0bfc00f4d7d9d1a855e2b730299)` {{(pid=71939) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:442}} Nov 24 16:30:49.077204 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d85738b1-9867-479b-a372-3315148dd735 admin admin] RBAC: Authorization granted {{(pid=71939) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 24 16:30:49.079100 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: [pid: 71939|app: 0|req: 176/352] 10.222.0.53 () {56 vars in 1192 bytes} [Wed Nov 24 16:30:49 2021] GET /identity/v3/groups/16b7d0bfc00f4d7d9d1a855e2b730299 => generated 226 bytes in 50 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 24 16:30:49.086165 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efb5e5b3-f3f1-4769-9e9f-bd8edc117aa7 admin admin] Authenticating user token {{(pid=71938) process_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 24 16:30:49.096200 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efb5e5b3-f3f1-4769-9e9f-bd8edc117aa7 admin admin] Validating token access rules against request {{(pid=71938) validate_allowed_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 24 16:30:49.100486 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a08eb21f-9b55-40e1-b5cb-9fa0aa078c06 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f2ba2e8375b4e8c8792ee1e22b60427', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '00a5583c7b7443e98e7a1d31a0b638dc', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=71938) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 24 16:30:49.101148 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a08eb21f-9b55-40e1-b5cb-9fa0aa078c06 admin admin] REQUEST_METHOD: `GET` {{(pid=71938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 24 16:30:49.101489 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a08eb21f-9b55-40e1-b5cb-9fa0aa078c06 admin admin] SCRIPT_NAME: `/identity` {{(pid=71938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 24 16:30:49.101830 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a08eb21f-9b55-40e1-b5cb-9fa0aa078c06 admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=71938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 24 16:30:49.102756 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a08eb21f-9b55-40e1-b5cb-9fa0aa078c06 admin admin] RBAC: Adding query filter params (group.id=16b7d0bfc00f4d7d9d1a855e2b730299, role.id=912ab5f10fa5477da74acf239f07604e, scope.project.id=7cdfba1dd86043ea9b1cf6498535c213) {{(pid=71938) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:161}} Nov 24 16:30:49.103121 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a08eb21f-9b55-40e1-b5cb-9fa0aa078c06 admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=71938) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:442}} Nov 24 16:30:49.131996 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a08eb21f-9b55-40e1-b5cb-9fa0aa078c06 admin admin] RBAC: Authorization granted {{(pid=71938) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 24 16:30:49.138513 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: [pid: 71938|app: 0|req: 177/353] 10.222.0.53 () {56 vars in 1388 bytes} [Wed Nov 24 16:30:49 2021] GET /identity/v3/role_assignments?group.id=16b7d0bfc00f4d7d9d1a855e2b730299&scope.project.id=7cdfba1dd86043ea9b1cf6498535c213&role.id=912ab5f10fa5477da74acf239f07604e => generated 611 bytes in 53 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 24 16:30:51.164989 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7f13d16-aeed-439a-8661-3a3116a165d7 None None] REQUEST_METHOD: `GET` {{(pid=71939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 24 16:30:51.165508 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7f13d16-aeed-439a-8661-3a3116a165d7 None None] SCRIPT_NAME: `/identity` {{(pid=71939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 24 16:30:51.165651 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7f13d16-aeed-439a-8661-3a3116a165d7 None None] PATH_INFO: `/` {{(pid=71939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 24 16:30:51.167541 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: [pid: 71939|app: 0|req: 177/354] 10.222.0.53 () {54 vars in 915 bytes} [Wed Nov 24 16:30:51 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 24 16:30:51.173224 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c409e410-108c-4cb1-bce8-643fa3b2bad1 None None] REQUEST_METHOD: `POST` {{(pid=71938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 24 16:30:51.173573 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c409e410-108c-4cb1-bce8-643fa3b2bad1 None None] SCRIPT_NAME: `/identity` {{(pid=71938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 24 16:30:51.173907 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c409e410-108c-4cb1-bce8-643fa3b2bad1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=71938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 24 16:30:51.198313 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.auth.core [None req-c409e410-108c-4cb1-bce8-643fa3b2bad1 None None] MFA Rules not processed for user `0f2ba2e8375b4e8c8792ee1e22b60427`. Rule list: `[]` (Enabled: `True`). {{(pid=71938) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:442}} Nov 24 16:30:51.199518 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.fernet_utils [None req-c409e410-108c-4cb1-bce8-643fa3b2bad1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=71938) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:289}} Nov 24 16:30:51.206826 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: [pid: 71938|app: 0|req: 178/355] 10.222.0.53 () {58 vars in 1013 bytes} [Wed Nov 24 16:30:51 2021] POST /identity/v3/auth/tokens => generated 1067 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 24 16:30:51.229753 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32cf6dcd-fffd-450f-9b05-aab905773aba None None] REQUEST_METHOD: `POST` {{(pid=71939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 24 16:30:51.230125 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32cf6dcd-fffd-450f-9b05-aab905773aba None None] SCRIPT_NAME: `/identity` {{(pid=71939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 24 16:30:51.230470 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32cf6dcd-fffd-450f-9b05-aab905773aba None None] PATH_INFO: `/v3/auth/tokens` {{(pid=71939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 24 16:30:51.255192 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.auth.core [None req-32cf6dcd-fffd-450f-9b05-aab905773aba None None] MFA Rules not processed for user `0f2ba2e8375b4e8c8792ee1e22b60427`. Rule list: `[]` (Enabled: `True`). {{(pid=71939) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:442}} Nov 24 16:30:51.256449 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.fernet_utils [None req-32cf6dcd-fffd-450f-9b05-aab905773aba None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=71939) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:289}} Nov 24 16:30:51.263663 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: [pid: 71939|app: 0|req: 178/356] 10.222.0.53 () {58 vars in 1013 bytes} [Wed Nov 24 16:30:51 2021] POST /identity/v3/auth/tokens => generated 1067 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 24 16:30:51.269564 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c409e410-108c-4cb1-bce8-643fa3b2bad1 None None] Authenticating user token {{(pid=71938) process_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 24 16:30:51.279742 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c409e410-108c-4cb1-bce8-643fa3b2bad1 None None] Validating token access rules against request {{(pid=71938) validate_allowed_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 24 16:30:51.284729 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41277976-1a33-4d5a-a4ec-74f2fc3230f8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f2ba2e8375b4e8c8792ee1e22b60427', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '00a5583c7b7443e98e7a1d31a0b638dc', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=71938) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 24 16:30:51.285554 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41277976-1a33-4d5a-a4ec-74f2fc3230f8 admin admin] REQUEST_METHOD: `GET` {{(pid=71938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 24 16:30:51.285890 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41277976-1a33-4d5a-a4ec-74f2fc3230f8 admin admin] SCRIPT_NAME: `/identity` {{(pid=71938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 24 16:30:51.286243 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41277976-1a33-4d5a-a4ec-74f2fc3230f8 admin admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=71938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 24 16:30:51.298603 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41277976-1a33-4d5a-a4ec-74f2fc3230f8 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=71938) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:401}} Nov 24 16:30:51.306889 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: WARNING keystone.server.flask.application [None req-41277976-1a33-4d5a-a4ec-74f2fc3230f8 admin admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Nov 24 16:30:51.308106 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: [pid: 71938|app: 0|req: 179/357] 10.222.0.53 () {56 vars in 1126 bytes} [Wed Nov 24 16:30:51 2021] GET /identity/v3/roles/anotherrole => generated 89 bytes in 39 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 24 16:30:51.314833 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32cf6dcd-fffd-450f-9b05-aab905773aba None None] Authenticating user token {{(pid=71939) process_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 24 16:30:51.324015 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32cf6dcd-fffd-450f-9b05-aab905773aba None None] Validating token access rules against request {{(pid=71939) validate_allowed_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 24 16:30:51.328914 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-217cfa61-a459-4df7-beb9-f520b0cae70f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f2ba2e8375b4e8c8792ee1e22b60427', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '00a5583c7b7443e98e7a1d31a0b638dc', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=71939) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 24 16:30:51.329587 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-217cfa61-a459-4df7-beb9-f520b0cae70f admin admin] REQUEST_METHOD: `GET` {{(pid=71939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 24 16:30:51.329920 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-217cfa61-a459-4df7-beb9-f520b0cae70f admin admin] SCRIPT_NAME: `/identity` {{(pid=71939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 24 16:30:51.330298 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-217cfa61-a459-4df7-beb9-f520b0cae70f admin admin] PATH_INFO: `/v3/roles` {{(pid=71939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 24 16:30:51.331110 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-217cfa61-a459-4df7-beb9-f520b0cae70f admin admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=71939) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:161}} Nov 24 16:30:51.331459 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-217cfa61-a459-4df7-beb9-f520b0cae70f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=71939) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:442}} Nov 24 16:30:51.359706 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-217cfa61-a459-4df7-beb9-f520b0cae70f admin admin] RBAC: Authorization granted {{(pid=71939) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 24 16:30:51.369496 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: [pid: 71939|app: 0|req: 179/358] 10.222.0.53 () {56 vars in 1123 bytes} [Wed Nov 24 16:30:51 2021] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 55 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 24 16:30:51.375898 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41277976-1a33-4d5a-a4ec-74f2fc3230f8 admin admin] Authenticating user token {{(pid=71938) process_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 24 16:30:51.386274 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41277976-1a33-4d5a-a4ec-74f2fc3230f8 admin admin] Validating token access rules against request {{(pid=71938) validate_allowed_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 24 16:30:51.390482 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bc96679-2eb6-4e65-bc96-669526da465d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f2ba2e8375b4e8c8792ee1e22b60427', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '00a5583c7b7443e98e7a1d31a0b638dc', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=71938) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 24 16:30:51.391123 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bc96679-2eb6-4e65-bc96-669526da465d admin admin] REQUEST_METHOD: `GET` {{(pid=71938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 24 16:30:51.391463 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bc96679-2eb6-4e65-bc96-669526da465d admin admin] SCRIPT_NAME: `/identity` {{(pid=71938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 24 16:30:51.391796 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bc96679-2eb6-4e65-bc96-669526da465d admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=71938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 24 16:30:51.400523 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bc96679-2eb6-4e65-bc96-669526da465d admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=71938) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:442}} Nov 24 16:30:51.429611 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bc96679-2eb6-4e65-bc96-669526da465d admin admin] RBAC: Authorization granted {{(pid=71938) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 24 16:30:51.439392 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: [pid: 71938|app: 0|req: 180/359] 10.222.0.53 () {58 vars in 1315 bytes} [Wed Nov 24 16:30:51 2021] GET /identity/v3/auth/tokens => generated 1067 bytes in 64 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 24 16:30:51.445531 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-217cfa61-a459-4df7-beb9-f520b0cae70f admin admin] Authenticating user token {{(pid=71939) process_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 24 16:30:51.455693 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-217cfa61-a459-4df7-beb9-f520b0cae70f admin admin] Validating token access rules against request {{(pid=71939) validate_allowed_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 24 16:30:51.460015 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b074312-49a2-4764-bd93-eeb0a31b7138 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f2ba2e8375b4e8c8792ee1e22b60427', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '00a5583c7b7443e98e7a1d31a0b638dc', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=71939) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 24 16:30:51.460894 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b074312-49a2-4764-bd93-eeb0a31b7138 admin admin] REQUEST_METHOD: `GET` {{(pid=71939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 24 16:30:51.461235 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b074312-49a2-4764-bd93-eeb0a31b7138 admin admin] SCRIPT_NAME: `/identity` {{(pid=71939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 24 16:30:51.461569 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b074312-49a2-4764-bd93-eeb0a31b7138 admin admin] PATH_INFO: `/v3/projects/7cdfba1dd86043ea9b1cf6498535c213` {{(pid=71939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 24 16:30:51.462794 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b074312-49a2-4764-bd93-eeb0a31b7138 admin admin] RBAC: Authorizing `identity:get_project(project_id=7cdfba1dd86043ea9b1cf6498535c213)` {{(pid=71939) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:442}} Nov 24 16:30:51.492393 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b074312-49a2-4764-bd93-eeb0a31b7138 admin admin] RBAC: Authorization granted {{(pid=71939) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 24 16:30:51.494143 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: [pid: 71939|app: 0|req: 180/360] 10.222.0.53 () {56 vars in 1198 bytes} [Wed Nov 24 16:30:51 2021] GET /identity/v3/projects/7cdfba1dd86043ea9b1cf6498535c213 => generated 302 bytes in 49 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 24 16:30:51.500070 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bc96679-2eb6-4e65-bc96-669526da465d admin admin] Authenticating user token {{(pid=71938) process_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 24 16:30:51.509319 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bc96679-2eb6-4e65-bc96-669526da465d admin admin] Validating token access rules against request {{(pid=71938) validate_allowed_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 24 16:30:51.513803 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-553093e2-aa9e-4a79-8343-6203a02210c9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f2ba2e8375b4e8c8792ee1e22b60427', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '00a5583c7b7443e98e7a1d31a0b638dc', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=71938) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 24 16:30:51.514755 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-553093e2-aa9e-4a79-8343-6203a02210c9 admin admin] REQUEST_METHOD: `GET` {{(pid=71938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 24 16:30:51.515033 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-553093e2-aa9e-4a79-8343-6203a02210c9 admin admin] SCRIPT_NAME: `/identity` {{(pid=71938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 24 16:30:51.515360 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-553093e2-aa9e-4a79-8343-6203a02210c9 admin admin] PATH_INFO: `/v3/groups/16b7d0bfc00f4d7d9d1a855e2b730299` {{(pid=71938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 24 16:30:51.516535 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-553093e2-aa9e-4a79-8343-6203a02210c9 admin admin] RBAC: Authorizing `identity:get_group(group_id=16b7d0bfc00f4d7d9d1a855e2b730299)` {{(pid=71938) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:442}} Nov 24 16:30:51.545457 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-553093e2-aa9e-4a79-8343-6203a02210c9 admin admin] RBAC: Authorization granted {{(pid=71938) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 24 16:30:51.547138 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: [pid: 71938|app: 0|req: 181/361] 10.222.0.53 () {56 vars in 1192 bytes} [Wed Nov 24 16:30:51 2021] GET /identity/v3/groups/16b7d0bfc00f4d7d9d1a855e2b730299 => generated 226 bytes in 48 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 24 16:30:51.553859 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b074312-49a2-4764-bd93-eeb0a31b7138 admin admin] Authenticating user token {{(pid=71939) process_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 24 16:30:51.563752 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b074312-49a2-4764-bd93-eeb0a31b7138 admin admin] Validating token access rules against request {{(pid=71939) validate_allowed_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 24 16:30:51.567950 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9952870-d3f0-4b20-b445-bfbdce6a7d00 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f2ba2e8375b4e8c8792ee1e22b60427', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '00a5583c7b7443e98e7a1d31a0b638dc', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=71939) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 24 16:30:51.568600 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9952870-d3f0-4b20-b445-bfbdce6a7d00 admin admin] REQUEST_METHOD: `GET` {{(pid=71939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 24 16:30:51.568937 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9952870-d3f0-4b20-b445-bfbdce6a7d00 admin admin] SCRIPT_NAME: `/identity` {{(pid=71939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 24 16:30:51.569269 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9952870-d3f0-4b20-b445-bfbdce6a7d00 admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=71939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 24 16:30:51.570181 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9952870-d3f0-4b20-b445-bfbdce6a7d00 admin admin] RBAC: Adding query filter params (group.id=16b7d0bfc00f4d7d9d1a855e2b730299, role.id=0de27ef8b6e744cda429a0d133117dcd, scope.project.id=7cdfba1dd86043ea9b1cf6498535c213) {{(pid=71939) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:161}} Nov 24 16:30:51.570542 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9952870-d3f0-4b20-b445-bfbdce6a7d00 admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=71939) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:442}} Nov 24 16:30:51.600173 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9952870-d3f0-4b20-b445-bfbdce6a7d00 admin admin] RBAC: Authorization granted {{(pid=71939) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 24 16:30:51.606198 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: [pid: 71939|app: 0|req: 181/362] 10.222.0.53 () {56 vars in 1388 bytes} [Wed Nov 24 16:30:51 2021] GET /identity/v3/role_assignments?group.id=16b7d0bfc00f4d7d9d1a855e2b730299&scope.project.id=7cdfba1dd86043ea9b1cf6498535c213&role.id=0de27ef8b6e744cda429a0d133117dcd => generated 260 bytes in 53 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 24 16:30:53.614515 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56e46414-eb8b-4cb3-9310-fab650b9db7c None None] REQUEST_METHOD: `GET` {{(pid=71938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 24 16:30:53.615022 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56e46414-eb8b-4cb3-9310-fab650b9db7c None None] SCRIPT_NAME: `/identity` {{(pid=71938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 24 16:30:53.615148 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56e46414-eb8b-4cb3-9310-fab650b9db7c None None] PATH_INFO: `/` {{(pid=71938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 24 16:30:53.616924 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: [pid: 71938|app: 0|req: 182/363] 10.222.0.53 () {54 vars in 915 bytes} [Wed Nov 24 16:30:53 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 24 16:30:53.624076 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a79c6ee3-df72-4d5f-8256-49759c78eed8 None None] REQUEST_METHOD: `POST` {{(pid=71939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 24 16:30:53.624426 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a79c6ee3-df72-4d5f-8256-49759c78eed8 None None] SCRIPT_NAME: `/identity` {{(pid=71939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 24 16:30:53.624767 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a79c6ee3-df72-4d5f-8256-49759c78eed8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=71939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 24 16:30:53.650617 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.auth.core [None req-a79c6ee3-df72-4d5f-8256-49759c78eed8 None None] MFA Rules not processed for user `0f2ba2e8375b4e8c8792ee1e22b60427`. Rule list: `[]` (Enabled: `True`). {{(pid=71939) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:442}} Nov 24 16:30:53.651856 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.fernet_utils [None req-a79c6ee3-df72-4d5f-8256-49759c78eed8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=71939) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:289}} Nov 24 16:30:53.659255 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: [pid: 71939|app: 0|req: 182/364] 10.222.0.53 () {58 vars in 1013 bytes} [Wed Nov 24 16:30:53 2021] POST /identity/v3/auth/tokens => generated 1067 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 24 16:30:53.681434 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f283d83-1fec-4d9b-bf67-39c74567b306 None None] REQUEST_METHOD: `POST` {{(pid=71938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 24 16:30:53.681839 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f283d83-1fec-4d9b-bf67-39c74567b306 None None] SCRIPT_NAME: `/identity` {{(pid=71938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 24 16:30:53.682224 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f283d83-1fec-4d9b-bf67-39c74567b306 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=71938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 24 16:30:53.707429 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.auth.core [None req-2f283d83-1fec-4d9b-bf67-39c74567b306 None None] MFA Rules not processed for user `0f2ba2e8375b4e8c8792ee1e22b60427`. Rule list: `[]` (Enabled: `True`). {{(pid=71938) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:442}} Nov 24 16:30:53.708660 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.fernet_utils [None req-2f283d83-1fec-4d9b-bf67-39c74567b306 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=71938) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:289}} Nov 24 16:30:53.716020 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: [pid: 71938|app: 0|req: 183/365] 10.222.0.53 () {58 vars in 1013 bytes} [Wed Nov 24 16:30:53 2021] POST /identity/v3/auth/tokens => generated 1067 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 24 16:30:53.722057 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a79c6ee3-df72-4d5f-8256-49759c78eed8 None None] Authenticating user token {{(pid=71939) process_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 24 16:30:53.732027 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a79c6ee3-df72-4d5f-8256-49759c78eed8 None None] Validating token access rules against request {{(pid=71939) validate_allowed_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 24 16:30:53.736472 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f28e6cb9-28df-4c8e-8b74-0bca3daa1059 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f2ba2e8375b4e8c8792ee1e22b60427', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '00a5583c7b7443e98e7a1d31a0b638dc', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=71939) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 24 16:30:53.737301 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f28e6cb9-28df-4c8e-8b74-0bca3daa1059 admin admin] REQUEST_METHOD: `GET` {{(pid=71939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 24 16:30:53.737637 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f28e6cb9-28df-4c8e-8b74-0bca3daa1059 admin admin] SCRIPT_NAME: `/identity` {{(pid=71939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 24 16:30:53.737967 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f28e6cb9-28df-4c8e-8b74-0bca3daa1059 admin admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=71939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 24 16:30:53.750519 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f28e6cb9-28df-4c8e-8b74-0bca3daa1059 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=71939) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:401}} Nov 24 16:30:53.758903 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: WARNING keystone.server.flask.application [None req-f28e6cb9-28df-4c8e-8b74-0bca3daa1059 admin admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Nov 24 16:30:53.760348 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: [pid: 71939|app: 0|req: 183/366] 10.222.0.53 () {56 vars in 1126 bytes} [Wed Nov 24 16:30:53 2021] GET /identity/v3/roles/anotherrole => generated 89 bytes in 39 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 24 16:30:53.766868 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f283d83-1fec-4d9b-bf67-39c74567b306 None None] Authenticating user token {{(pid=71938) process_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 24 16:30:53.776876 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f283d83-1fec-4d9b-bf67-39c74567b306 None None] Validating token access rules against request {{(pid=71938) validate_allowed_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 24 16:30:53.781609 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b6ff112-d199-4dd1-851c-dbd04126dbed admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f2ba2e8375b4e8c8792ee1e22b60427', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '00a5583c7b7443e98e7a1d31a0b638dc', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=71938) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 24 16:30:53.782328 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b6ff112-d199-4dd1-851c-dbd04126dbed admin admin] REQUEST_METHOD: `GET` {{(pid=71938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 24 16:30:53.782650 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b6ff112-d199-4dd1-851c-dbd04126dbed admin admin] SCRIPT_NAME: `/identity` {{(pid=71938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 24 16:30:53.782984 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b6ff112-d199-4dd1-851c-dbd04126dbed admin admin] PATH_INFO: `/v3/roles` {{(pid=71938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 24 16:30:53.783829 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b6ff112-d199-4dd1-851c-dbd04126dbed admin admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=71938) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:161}} Nov 24 16:30:53.784184 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b6ff112-d199-4dd1-851c-dbd04126dbed admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=71938) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:442}} Nov 24 16:30:53.813120 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b6ff112-d199-4dd1-851c-dbd04126dbed admin admin] RBAC: Authorization granted {{(pid=71938) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 24 16:30:53.823165 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: [pid: 71938|app: 0|req: 184/367] 10.222.0.53 () {56 vars in 1123 bytes} [Wed Nov 24 16:30:53 2021] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 57 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 24 16:30:53.829498 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f28e6cb9-28df-4c8e-8b74-0bca3daa1059 admin admin] Authenticating user token {{(pid=71939) process_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 24 16:30:53.840979 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f28e6cb9-28df-4c8e-8b74-0bca3daa1059 admin admin] Validating token access rules against request {{(pid=71939) validate_allowed_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 24 16:30:53.845589 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d5562fe-3bab-409d-b0a7-03c0795fd870 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f2ba2e8375b4e8c8792ee1e22b60427', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '00a5583c7b7443e98e7a1d31a0b638dc', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=71939) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 24 16:30:53.846589 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d5562fe-3bab-409d-b0a7-03c0795fd870 admin admin] REQUEST_METHOD: `GET` {{(pid=71939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 24 16:30:53.846932 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d5562fe-3bab-409d-b0a7-03c0795fd870 admin admin] SCRIPT_NAME: `/identity` {{(pid=71939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 24 16:30:53.847270 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d5562fe-3bab-409d-b0a7-03c0795fd870 admin admin] PATH_INFO: `/v3/groups/16b7d0bfc00f4d7d9d1a855e2b730299` {{(pid=71939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 24 16:30:53.848460 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d5562fe-3bab-409d-b0a7-03c0795fd870 admin admin] RBAC: Authorizing `identity:get_group(group_id=16b7d0bfc00f4d7d9d1a855e2b730299)` {{(pid=71939) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:442}} Nov 24 16:30:53.880349 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d5562fe-3bab-409d-b0a7-03c0795fd870 admin admin] RBAC: Authorization granted {{(pid=71939) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 24 16:30:53.885534 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: [pid: 71939|app: 0|req: 184/368] 10.222.0.53 () {56 vars in 1192 bytes} [Wed Nov 24 16:30:53 2021] GET /identity/v3/groups/16b7d0bfc00f4d7d9d1a855e2b730299 => generated 226 bytes in 55 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 24 16:30:53.891179 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b6ff112-d199-4dd1-851c-dbd04126dbed admin admin] Authenticating user token {{(pid=71938) process_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 24 16:30:53.901216 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b6ff112-d199-4dd1-851c-dbd04126dbed admin admin] Validating token access rules against request {{(pid=71938) validate_allowed_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 24 16:30:53.905485 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3414c2a7-f096-4d37-949f-98658776d50b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f2ba2e8375b4e8c8792ee1e22b60427', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '00a5583c7b7443e98e7a1d31a0b638dc', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=71938) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 24 16:30:53.906398 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3414c2a7-f096-4d37-949f-98658776d50b admin admin] REQUEST_METHOD: `GET` {{(pid=71938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 24 16:30:53.906740 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3414c2a7-f096-4d37-949f-98658776d50b admin admin] SCRIPT_NAME: `/identity` {{(pid=71938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 24 16:30:53.907073 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3414c2a7-f096-4d37-949f-98658776d50b admin admin] PATH_INFO: `/v3/projects/7cdfba1dd86043ea9b1cf6498535c213` {{(pid=71938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 24 16:30:53.908395 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3414c2a7-f096-4d37-949f-98658776d50b admin admin] RBAC: Authorizing `identity:get_project(project_id=7cdfba1dd86043ea9b1cf6498535c213)` {{(pid=71938) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:442}} Nov 24 16:30:53.943748 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3414c2a7-f096-4d37-949f-98658776d50b admin admin] RBAC: Authorization granted {{(pid=71938) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 24 16:30:53.945598 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: [pid: 71938|app: 0|req: 185/369] 10.222.0.53 () {56 vars in 1198 bytes} [Wed Nov 24 16:30:53 2021] GET /identity/v3/projects/7cdfba1dd86043ea9b1cf6498535c213 => generated 302 bytes in 55 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Nov 24 16:30:53.952015 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d5562fe-3bab-409d-b0a7-03c0795fd870 admin admin] Authenticating user token {{(pid=71939) process_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 24 16:30:53.962663 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d5562fe-3bab-409d-b0a7-03c0795fd870 admin admin] Validating token access rules against request {{(pid=71939) validate_allowed_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 24 16:30:53.967180 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87ba2c8f-d4ee-4fdc-b290-70ef6ae13da1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f2ba2e8375b4e8c8792ee1e22b60427', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '00a5583c7b7443e98e7a1d31a0b638dc', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=71939) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 24 16:30:53.968108 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87ba2c8f-d4ee-4fdc-b290-70ef6ae13da1 admin admin] REQUEST_METHOD: `PUT` {{(pid=71939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 24 16:30:53.968446 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87ba2c8f-d4ee-4fdc-b290-70ef6ae13da1 admin admin] SCRIPT_NAME: `/identity` {{(pid=71939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 24 16:30:53.968779 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87ba2c8f-d4ee-4fdc-b290-70ef6ae13da1 admin admin] PATH_INFO: `/v3/projects/7cdfba1dd86043ea9b1cf6498535c213/groups/16b7d0bfc00f4d7d9d1a855e2b730299/roles/0de27ef8b6e744cda429a0d133117dcd` {{(pid=71939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 24 16:30:53.971339 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87ba2c8f-d4ee-4fdc-b290-70ef6ae13da1 admin admin] RBAC: Authorizing `identity:create_grant(project_id=7cdfba1dd86043ea9b1cf6498535c213, group_id=16b7d0bfc00f4d7d9d1a855e2b730299, role_id=0de27ef8b6e744cda429a0d133117dcd)` {{(pid=71939) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:442}} Nov 24 16:30:54.002926 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87ba2c8f-d4ee-4fdc-b290-70ef6ae13da1 admin admin] RBAC: Authorization granted {{(pid=71939) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 24 16:30:54.014765 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: [pid: 71939|app: 0|req: 185/370] 10.222.0.53 () {58 vars in 1454 bytes} [Wed Nov 24 16:30:53 2021] PUT /identity/v3/projects/7cdfba1dd86043ea9b1cf6498535c213/groups/16b7d0bfc00f4d7d9d1a855e2b730299/roles/0de27ef8b6e744cda429a0d133117dcd => generated 0 bytes in 63 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Nov 24 16:30:56.030561 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8815276-f080-4552-8991-773ce7e86337 None None] REQUEST_METHOD: `GET` {{(pid=71938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 24 16:30:56.031098 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8815276-f080-4552-8991-773ce7e86337 None None] SCRIPT_NAME: `/identity` {{(pid=71938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 24 16:30:56.031277 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8815276-f080-4552-8991-773ce7e86337 None None] PATH_INFO: `/` {{(pid=71938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 24 16:30:56.033046 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: [pid: 71938|app: 0|req: 186/371] 10.222.0.53 () {54 vars in 915 bytes} [Wed Nov 24 16:30:56 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 24 16:30:56.038732 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e9f8bff-509f-458e-a41e-48919ef27587 None None] REQUEST_METHOD: `POST` {{(pid=71939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 24 16:30:56.039082 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e9f8bff-509f-458e-a41e-48919ef27587 None None] SCRIPT_NAME: `/identity` {{(pid=71939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 24 16:30:56.039417 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e9f8bff-509f-458e-a41e-48919ef27587 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=71939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 24 16:30:56.063290 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.auth.core [None req-4e9f8bff-509f-458e-a41e-48919ef27587 None None] MFA Rules not processed for user `0f2ba2e8375b4e8c8792ee1e22b60427`. Rule list: `[]` (Enabled: `True`). {{(pid=71939) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:442}} Nov 24 16:30:56.064503 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.fernet_utils [None req-4e9f8bff-509f-458e-a41e-48919ef27587 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=71939) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:289}} Nov 24 16:30:56.133031 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: [pid: 71939|app: 0|req: 186/372] 10.222.0.53 () {58 vars in 1013 bytes} [Wed Nov 24 16:30:56 2021] POST /identity/v3/auth/tokens => generated 1067 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 24 16:30:56.159018 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaa32b8a-5bec-428c-8445-c4cfd7ca7c5b None None] REQUEST_METHOD: `POST` {{(pid=71938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 24 16:30:56.159367 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaa32b8a-5bec-428c-8445-c4cfd7ca7c5b None None] SCRIPT_NAME: `/identity` {{(pid=71938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 24 16:30:56.159729 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaa32b8a-5bec-428c-8445-c4cfd7ca7c5b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=71938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 24 16:30:56.184086 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.auth.core [None req-aaa32b8a-5bec-428c-8445-c4cfd7ca7c5b None None] MFA Rules not processed for user `0f2ba2e8375b4e8c8792ee1e22b60427`. Rule list: `[]` (Enabled: `True`). {{(pid=71938) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:442}} Nov 24 16:30:56.185306 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.fernet_utils [None req-aaa32b8a-5bec-428c-8445-c4cfd7ca7c5b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=71938) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:289}} Nov 24 16:30:56.194038 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: [pid: 71938|app: 0|req: 187/373] 10.222.0.53 () {58 vars in 1013 bytes} [Wed Nov 24 16:30:56 2021] POST /identity/v3/auth/tokens => generated 1067 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 24 16:30:56.199895 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e9f8bff-509f-458e-a41e-48919ef27587 None None] Authenticating user token {{(pid=71939) process_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 24 16:30:56.211240 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e9f8bff-509f-458e-a41e-48919ef27587 None None] Validating token access rules against request {{(pid=71939) validate_allowed_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 24 16:30:56.215513 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8214ad1f-acaf-4a1a-a9e9-8f44b965ed27 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f2ba2e8375b4e8c8792ee1e22b60427', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '00a5583c7b7443e98e7a1d31a0b638dc', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=71939) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 24 16:30:56.216339 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8214ad1f-acaf-4a1a-a9e9-8f44b965ed27 admin admin] REQUEST_METHOD: `GET` {{(pid=71939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 24 16:30:56.216683 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8214ad1f-acaf-4a1a-a9e9-8f44b965ed27 admin admin] SCRIPT_NAME: `/identity` {{(pid=71939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 24 16:30:56.217026 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8214ad1f-acaf-4a1a-a9e9-8f44b965ed27 admin admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=71939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 24 16:30:56.228801 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8214ad1f-acaf-4a1a-a9e9-8f44b965ed27 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=71939) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:401}} Nov 24 16:30:56.237057 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: WARNING keystone.server.flask.application [None req-8214ad1f-acaf-4a1a-a9e9-8f44b965ed27 admin admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Nov 24 16:30:56.238288 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: [pid: 71939|app: 0|req: 187/374] 10.222.0.53 () {56 vars in 1126 bytes} [Wed Nov 24 16:30:56 2021] GET /identity/v3/roles/anotherrole => generated 89 bytes in 39 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 24 16:30:56.244773 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aaa32b8a-5bec-428c-8445-c4cfd7ca7c5b None None] Authenticating user token {{(pid=71938) process_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 24 16:30:56.255266 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aaa32b8a-5bec-428c-8445-c4cfd7ca7c5b None None] Validating token access rules against request {{(pid=71938) validate_allowed_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 24 16:30:56.259521 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77c7bc4e-6481-4803-9e9f-86cd2e53f7b5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f2ba2e8375b4e8c8792ee1e22b60427', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '00a5583c7b7443e98e7a1d31a0b638dc', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=71938) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 24 16:30:56.260187 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77c7bc4e-6481-4803-9e9f-86cd2e53f7b5 admin admin] REQUEST_METHOD: `GET` {{(pid=71938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 24 16:30:56.260522 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77c7bc4e-6481-4803-9e9f-86cd2e53f7b5 admin admin] SCRIPT_NAME: `/identity` {{(pid=71938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 24 16:30:56.260848 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77c7bc4e-6481-4803-9e9f-86cd2e53f7b5 admin admin] PATH_INFO: `/v3/roles` {{(pid=71938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 24 16:30:56.261662 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77c7bc4e-6481-4803-9e9f-86cd2e53f7b5 admin admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=71938) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:161}} Nov 24 16:30:56.262037 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77c7bc4e-6481-4803-9e9f-86cd2e53f7b5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=71938) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:442}} Nov 24 16:30:56.293219 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77c7bc4e-6481-4803-9e9f-86cd2e53f7b5 admin admin] RBAC: Authorization granted {{(pid=71938) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 24 16:30:56.303193 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: [pid: 71938|app: 0|req: 188/375] 10.222.0.53 () {56 vars in 1123 bytes} [Wed Nov 24 16:30:56 2021] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 59 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 24 16:30:56.309396 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8214ad1f-acaf-4a1a-a9e9-8f44b965ed27 admin admin] Authenticating user token {{(pid=71939) process_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 24 16:30:56.320909 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8214ad1f-acaf-4a1a-a9e9-8f44b965ed27 admin admin] Validating token access rules against request {{(pid=71939) validate_allowed_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 24 16:30:56.325119 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9272b69e-016d-4b23-bd04-53ed1661810f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f2ba2e8375b4e8c8792ee1e22b60427', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '00a5583c7b7443e98e7a1d31a0b638dc', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=71939) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 24 16:30:56.325760 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9272b69e-016d-4b23-bd04-53ed1661810f admin admin] REQUEST_METHOD: `GET` {{(pid=71939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 24 16:30:56.326136 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9272b69e-016d-4b23-bd04-53ed1661810f admin admin] SCRIPT_NAME: `/identity` {{(pid=71939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 24 16:30:56.326475 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9272b69e-016d-4b23-bd04-53ed1661810f admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=71939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 24 16:30:56.335916 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9272b69e-016d-4b23-bd04-53ed1661810f admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=71939) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:442}} Nov 24 16:30:56.364426 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9272b69e-016d-4b23-bd04-53ed1661810f admin admin] RBAC: Authorization granted {{(pid=71939) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 24 16:30:56.373609 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: [pid: 71939|app: 0|req: 188/376] 10.222.0.53 () {58 vars in 1315 bytes} [Wed Nov 24 16:30:56 2021] GET /identity/v3/auth/tokens => generated 1067 bytes in 65 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 24 16:30:56.380440 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77c7bc4e-6481-4803-9e9f-86cd2e53f7b5 admin admin] Authenticating user token {{(pid=71938) process_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 24 16:30:56.390449 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77c7bc4e-6481-4803-9e9f-86cd2e53f7b5 admin admin] Validating token access rules against request {{(pid=71938) validate_allowed_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 24 16:30:56.394667 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf845ee6-e1d5-4965-9fc0-6b75b86d9686 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f2ba2e8375b4e8c8792ee1e22b60427', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '00a5583c7b7443e98e7a1d31a0b638dc', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=71938) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 24 16:30:56.395542 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf845ee6-e1d5-4965-9fc0-6b75b86d9686 admin admin] REQUEST_METHOD: `GET` {{(pid=71938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 24 16:30:56.395886 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf845ee6-e1d5-4965-9fc0-6b75b86d9686 admin admin] SCRIPT_NAME: `/identity` {{(pid=71938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 24 16:30:56.396224 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf845ee6-e1d5-4965-9fc0-6b75b86d9686 admin admin] PATH_INFO: `/v3/projects/7cdfba1dd86043ea9b1cf6498535c213` {{(pid=71938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 24 16:30:56.397432 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf845ee6-e1d5-4965-9fc0-6b75b86d9686 admin admin] RBAC: Authorizing `identity:get_project(project_id=7cdfba1dd86043ea9b1cf6498535c213)` {{(pid=71938) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:442}} Nov 24 16:30:56.426668 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf845ee6-e1d5-4965-9fc0-6b75b86d9686 admin admin] RBAC: Authorization granted {{(pid=71938) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 24 16:30:56.428376 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: [pid: 71938|app: 0|req: 189/377] 10.222.0.53 () {56 vars in 1198 bytes} [Wed Nov 24 16:30:56 2021] GET /identity/v3/projects/7cdfba1dd86043ea9b1cf6498535c213 => generated 302 bytes in 48 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 24 16:30:56.434273 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9272b69e-016d-4b23-bd04-53ed1661810f admin admin] Authenticating user token {{(pid=71939) process_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 24 16:30:56.444258 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9272b69e-016d-4b23-bd04-53ed1661810f admin admin] Validating token access rules against request {{(pid=71939) validate_allowed_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 24 16:30:56.448593 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d028af62-ea63-41db-b1f8-8edf8ddce692 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f2ba2e8375b4e8c8792ee1e22b60427', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '00a5583c7b7443e98e7a1d31a0b638dc', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=71939) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 24 16:30:56.449463 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d028af62-ea63-41db-b1f8-8edf8ddce692 admin admin] REQUEST_METHOD: `GET` {{(pid=71939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 24 16:30:56.449805 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d028af62-ea63-41db-b1f8-8edf8ddce692 admin admin] SCRIPT_NAME: `/identity` {{(pid=71939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 24 16:30:56.450172 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d028af62-ea63-41db-b1f8-8edf8ddce692 admin admin] PATH_INFO: `/v3/groups/16b7d0bfc00f4d7d9d1a855e2b730299` {{(pid=71939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 24 16:30:56.451383 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d028af62-ea63-41db-b1f8-8edf8ddce692 admin admin] RBAC: Authorizing `identity:get_group(group_id=16b7d0bfc00f4d7d9d1a855e2b730299)` {{(pid=71939) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:442}} Nov 24 16:30:56.480369 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d028af62-ea63-41db-b1f8-8edf8ddce692 admin admin] RBAC: Authorization granted {{(pid=71939) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 24 16:30:56.481980 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: [pid: 71939|app: 0|req: 189/378] 10.222.0.53 () {56 vars in 1192 bytes} [Wed Nov 24 16:30:56 2021] GET /identity/v3/groups/16b7d0bfc00f4d7d9d1a855e2b730299 => generated 226 bytes in 48 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 24 16:30:56.488719 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf845ee6-e1d5-4965-9fc0-6b75b86d9686 admin admin] Authenticating user token {{(pid=71938) process_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 24 16:30:56.498704 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf845ee6-e1d5-4965-9fc0-6b75b86d9686 admin admin] Validating token access rules against request {{(pid=71938) validate_allowed_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 24 16:30:56.502909 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65a06e26-00be-485d-ab14-8f6dc168d44b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f2ba2e8375b4e8c8792ee1e22b60427', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '00a5583c7b7443e98e7a1d31a0b638dc', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=71938) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 24 16:30:56.503563 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65a06e26-00be-485d-ab14-8f6dc168d44b admin admin] REQUEST_METHOD: `GET` {{(pid=71938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 24 16:30:56.503898 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65a06e26-00be-485d-ab14-8f6dc168d44b admin admin] SCRIPT_NAME: `/identity` {{(pid=71938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 24 16:30:56.504228 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65a06e26-00be-485d-ab14-8f6dc168d44b admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=71938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 24 16:30:56.505119 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65a06e26-00be-485d-ab14-8f6dc168d44b admin admin] RBAC: Adding query filter params (group.id=16b7d0bfc00f4d7d9d1a855e2b730299, role.id=0de27ef8b6e744cda429a0d133117dcd, scope.project.id=7cdfba1dd86043ea9b1cf6498535c213) {{(pid=71938) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:161}} Nov 24 16:30:56.505483 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65a06e26-00be-485d-ab14-8f6dc168d44b admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=71938) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:442}} Nov 24 16:30:56.534314 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65a06e26-00be-485d-ab14-8f6dc168d44b admin admin] RBAC: Authorization granted {{(pid=71938) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 24 16:30:56.540568 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: [pid: 71938|app: 0|req: 190/379] 10.222.0.53 () {56 vars in 1388 bytes} [Wed Nov 24 16:30:56 2021] GET /identity/v3/role_assignments?group.id=16b7d0bfc00f4d7d9d1a855e2b730299&scope.project.id=7cdfba1dd86043ea9b1cf6498535c213&role.id=0de27ef8b6e744cda429a0d133117dcd => generated 611 bytes in 52 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 24 16:30:58.544045 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae4141c5-8cdd-4518-afd3-ad99b795d869 None None] REQUEST_METHOD: `GET` {{(pid=71939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 24 16:30:58.544554 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae4141c5-8cdd-4518-afd3-ad99b795d869 None None] SCRIPT_NAME: `/identity` {{(pid=71939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 24 16:30:58.544642 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae4141c5-8cdd-4518-afd3-ad99b795d869 None None] PATH_INFO: `/` {{(pid=71939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 24 16:30:58.546460 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: [pid: 71939|app: 0|req: 190/380] 10.222.0.53 () {54 vars in 915 bytes} [Wed Nov 24 16:30:58 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 24 16:30:58.552109 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58e76ab3-036b-48db-a61b-2e875515e209 None None] REQUEST_METHOD: `POST` {{(pid=71938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 24 16:30:58.552465 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58e76ab3-036b-48db-a61b-2e875515e209 None None] SCRIPT_NAME: `/identity` {{(pid=71938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 24 16:30:58.552805 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58e76ab3-036b-48db-a61b-2e875515e209 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=71938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 24 16:30:58.576269 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.auth.core [None req-58e76ab3-036b-48db-a61b-2e875515e209 None None] MFA Rules not processed for user `0f2ba2e8375b4e8c8792ee1e22b60427`. Rule list: `[]` (Enabled: `True`). {{(pid=71938) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:442}} Nov 24 16:30:58.577542 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.fernet_utils [None req-58e76ab3-036b-48db-a61b-2e875515e209 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=71938) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:289}} Nov 24 16:30:58.585443 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: [pid: 71938|app: 0|req: 191/381] 10.222.0.53 () {58 vars in 1013 bytes} [Wed Nov 24 16:30:58 2021] POST /identity/v3/auth/tokens => generated 1067 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 24 16:30:58.608059 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e3e59c1-ef48-4149-8a18-585de2d18d1b None None] REQUEST_METHOD: `POST` {{(pid=71939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 24 16:30:58.608411 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e3e59c1-ef48-4149-8a18-585de2d18d1b None None] SCRIPT_NAME: `/identity` {{(pid=71939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 24 16:30:58.608753 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e3e59c1-ef48-4149-8a18-585de2d18d1b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=71939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 24 16:30:58.631888 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.auth.core [None req-9e3e59c1-ef48-4149-8a18-585de2d18d1b None None] MFA Rules not processed for user `0f2ba2e8375b4e8c8792ee1e22b60427`. Rule list: `[]` (Enabled: `True`). {{(pid=71939) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:442}} Nov 24 16:30:58.633100 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.fernet_utils [None req-9e3e59c1-ef48-4149-8a18-585de2d18d1b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=71939) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:289}} Nov 24 16:30:58.640147 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: [pid: 71939|app: 0|req: 191/382] 10.222.0.53 () {58 vars in 1013 bytes} [Wed Nov 24 16:30:58 2021] POST /identity/v3/auth/tokens => generated 1067 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 24 16:30:58.646282 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58e76ab3-036b-48db-a61b-2e875515e209 None None] Authenticating user token {{(pid=71938) process_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 24 16:30:58.656068 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58e76ab3-036b-48db-a61b-2e875515e209 None None] Validating token access rules against request {{(pid=71938) validate_allowed_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 24 16:30:58.660886 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e55fe122-55bb-40a8-af5b-209cd9a027f1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f2ba2e8375b4e8c8792ee1e22b60427', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '00a5583c7b7443e98e7a1d31a0b638dc', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=71938) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 24 16:30:58.661734 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e55fe122-55bb-40a8-af5b-209cd9a027f1 admin admin] REQUEST_METHOD: `GET` {{(pid=71938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 24 16:30:58.662170 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e55fe122-55bb-40a8-af5b-209cd9a027f1 admin admin] SCRIPT_NAME: `/identity` {{(pid=71938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 24 16:30:58.662456 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e55fe122-55bb-40a8-af5b-209cd9a027f1 admin admin] PATH_INFO: `/v3/roles/admin` {{(pid=71938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 24 16:30:58.674275 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e55fe122-55bb-40a8-af5b-209cd9a027f1 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=71938) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:401}} Nov 24 16:30:58.681679 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: WARNING keystone.server.flask.application [None req-e55fe122-55bb-40a8-af5b-209cd9a027f1 admin admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Nov 24 16:30:58.682898 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: [pid: 71938|app: 0|req: 192/383] 10.222.0.53 () {56 vars in 1108 bytes} [Wed Nov 24 16:30:58 2021] GET /identity/v3/roles/admin => generated 83 bytes in 37 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 24 16:30:58.689374 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e3e59c1-ef48-4149-8a18-585de2d18d1b None None] Authenticating user token {{(pid=71939) process_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 24 16:30:58.699011 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e3e59c1-ef48-4149-8a18-585de2d18d1b None None] Validating token access rules against request {{(pid=71939) validate_allowed_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 24 16:30:58.703468 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f980bde-640f-4e42-be5e-edbba8a10516 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f2ba2e8375b4e8c8792ee1e22b60427', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '00a5583c7b7443e98e7a1d31a0b638dc', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=71939) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 24 16:30:58.704133 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f980bde-640f-4e42-be5e-edbba8a10516 admin admin] REQUEST_METHOD: `GET` {{(pid=71939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 24 16:30:58.704476 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f980bde-640f-4e42-be5e-edbba8a10516 admin admin] SCRIPT_NAME: `/identity` {{(pid=71939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 24 16:30:58.704811 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f980bde-640f-4e42-be5e-edbba8a10516 admin admin] PATH_INFO: `/v3/roles` {{(pid=71939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 24 16:30:58.706249 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f980bde-640f-4e42-be5e-edbba8a10516 admin admin] RBAC: Adding query filter params (name=admin) {{(pid=71939) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:161}} Nov 24 16:30:58.706599 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f980bde-640f-4e42-be5e-edbba8a10516 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=71939) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:442}} Nov 24 16:30:58.735124 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f980bde-640f-4e42-be5e-edbba8a10516 admin admin] RBAC: Authorization granted {{(pid=71939) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 24 16:30:58.745300 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: [pid: 71939|app: 0|req: 192/384] 10.222.0.53 () {56 vars in 1111 bytes} [Wed Nov 24 16:30:58 2021] GET /identity/v3/roles?name=admin => generated 339 bytes in 56 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 24 16:30:58.752310 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e55fe122-55bb-40a8-af5b-209cd9a027f1 admin admin] Authenticating user token {{(pid=71938) process_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 24 16:30:58.762677 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e55fe122-55bb-40a8-af5b-209cd9a027f1 admin admin] Validating token access rules against request {{(pid=71938) validate_allowed_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 24 16:30:58.767031 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bce2d9d-4233-4fb1-b01f-8eac9bd7c6b6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f2ba2e8375b4e8c8792ee1e22b60427', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '00a5583c7b7443e98e7a1d31a0b638dc', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=71938) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 24 16:30:58.767669 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bce2d9d-4233-4fb1-b01f-8eac9bd7c6b6 admin admin] REQUEST_METHOD: `GET` {{(pid=71938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 24 16:30:58.768003 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bce2d9d-4233-4fb1-b01f-8eac9bd7c6b6 admin admin] SCRIPT_NAME: `/identity` {{(pid=71938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 24 16:30:58.768332 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bce2d9d-4233-4fb1-b01f-8eac9bd7c6b6 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=71938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 24 16:30:58.776416 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bce2d9d-4233-4fb1-b01f-8eac9bd7c6b6 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=71938) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:442}} Nov 24 16:30:58.805466 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bce2d9d-4233-4fb1-b01f-8eac9bd7c6b6 admin admin] RBAC: Authorization granted {{(pid=71938) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 24 16:30:58.814639 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: [pid: 71938|app: 0|req: 193/385] 10.222.0.53 () {58 vars in 1315 bytes} [Wed Nov 24 16:30:58 2021] GET /identity/v3/auth/tokens => generated 1067 bytes in 63 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 24 16:30:58.820633 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f980bde-640f-4e42-be5e-edbba8a10516 admin admin] Authenticating user token {{(pid=71939) process_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 24 16:30:58.830878 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f980bde-640f-4e42-be5e-edbba8a10516 admin admin] Validating token access rules against request {{(pid=71939) validate_allowed_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 24 16:30:58.835101 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c609d6a0-e262-4010-9b11-4acbd75af854 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f2ba2e8375b4e8c8792ee1e22b60427', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '00a5583c7b7443e98e7a1d31a0b638dc', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=71939) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 24 16:30:58.835980 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c609d6a0-e262-4010-9b11-4acbd75af854 admin admin] REQUEST_METHOD: `GET` {{(pid=71939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 24 16:30:58.836321 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c609d6a0-e262-4010-9b11-4acbd75af854 admin admin] SCRIPT_NAME: `/identity` {{(pid=71939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 24 16:30:58.836659 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c609d6a0-e262-4010-9b11-4acbd75af854 admin admin] PATH_INFO: `/v3/projects/00a5583c7b7443e98e7a1d31a0b638dc` {{(pid=71939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 24 16:30:58.837876 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c609d6a0-e262-4010-9b11-4acbd75af854 admin admin] RBAC: Authorizing `identity:get_project(project_id=00a5583c7b7443e98e7a1d31a0b638dc)` {{(pid=71939) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:442}} Nov 24 16:30:58.867073 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c609d6a0-e262-4010-9b11-4acbd75af854 admin admin] RBAC: Authorization granted {{(pid=71939) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 24 16:30:58.868747 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: [pid: 71939|app: 0|req: 193/386] 10.222.0.53 () {56 vars in 1198 bytes} [Wed Nov 24 16:30:58 2021] GET /identity/v3/projects/00a5583c7b7443e98e7a1d31a0b638dc => generated 344 bytes in 49 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 24 16:30:58.874462 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bce2d9d-4233-4fb1-b01f-8eac9bd7c6b6 admin admin] Authenticating user token {{(pid=71938) process_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 24 16:30:58.883490 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bce2d9d-4233-4fb1-b01f-8eac9bd7c6b6 admin admin] Validating token access rules against request {{(pid=71938) validate_allowed_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 24 16:30:58.887679 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbd4d599-b7ec-4db9-a8dc-968963e6585f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f2ba2e8375b4e8c8792ee1e22b60427', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '00a5583c7b7443e98e7a1d31a0b638dc', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=71938) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 24 16:30:58.888527 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbd4d599-b7ec-4db9-a8dc-968963e6585f admin admin] REQUEST_METHOD: `GET` {{(pid=71938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 24 16:30:58.888862 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbd4d599-b7ec-4db9-a8dc-968963e6585f admin admin] SCRIPT_NAME: `/identity` {{(pid=71938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 24 16:30:58.889192 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbd4d599-b7ec-4db9-a8dc-968963e6585f admin admin] PATH_INFO: `/v3/groups/32ac22a27a764512a3a0cc1ca0720acd` {{(pid=71938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 24 16:30:58.894245 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbd4d599-b7ec-4db9-a8dc-968963e6585f admin admin] RBAC: Authorizing `identity:get_group(group_id=32ac22a27a764512a3a0cc1ca0720acd)` {{(pid=71938) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:442}} Nov 24 16:30:58.923018 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbd4d599-b7ec-4db9-a8dc-968963e6585f admin admin] RBAC: Authorization granted {{(pid=71938) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 24 16:30:58.925314 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: [pid: 71938|app: 0|req: 194/387] 10.222.0.53 () {56 vars in 1192 bytes} [Wed Nov 24 16:30:58 2021] GET /identity/v3/groups/32ac22a27a764512a3a0cc1ca0720acd => generated 229 bytes in 51 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 24 16:30:58.933493 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c609d6a0-e262-4010-9b11-4acbd75af854 admin admin] Authenticating user token {{(pid=71939) process_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 24 16:30:58.943542 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c609d6a0-e262-4010-9b11-4acbd75af854 admin admin] Validating token access rules against request {{(pid=71939) validate_allowed_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 24 16:30:58.947772 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc9f0653-f2ca-4b40-93cd-c9e17dbb7471 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f2ba2e8375b4e8c8792ee1e22b60427', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '00a5583c7b7443e98e7a1d31a0b638dc', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=71939) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 24 16:30:58.948438 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc9f0653-f2ca-4b40-93cd-c9e17dbb7471 admin admin] REQUEST_METHOD: `GET` {{(pid=71939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 24 16:30:58.948771 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc9f0653-f2ca-4b40-93cd-c9e17dbb7471 admin admin] SCRIPT_NAME: `/identity` {{(pid=71939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 24 16:30:58.949104 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc9f0653-f2ca-4b40-93cd-c9e17dbb7471 admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=71939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 24 16:30:58.949994 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc9f0653-f2ca-4b40-93cd-c9e17dbb7471 admin admin] RBAC: Adding query filter params (group.id=32ac22a27a764512a3a0cc1ca0720acd, role.id=5611724e350b41e19921b5961a342582, scope.project.id=00a5583c7b7443e98e7a1d31a0b638dc) {{(pid=71939) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:161}} Nov 24 16:30:58.950394 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc9f0653-f2ca-4b40-93cd-c9e17dbb7471 admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=71939) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:442}} Nov 24 16:30:58.980388 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc9f0653-f2ca-4b40-93cd-c9e17dbb7471 admin admin] RBAC: Authorization granted {{(pid=71939) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 24 16:30:58.987239 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: [pid: 71939|app: 0|req: 194/388] 10.222.0.53 () {56 vars in 1388 bytes} [Wed Nov 24 16:30:58 2021] GET /identity/v3/role_assignments?group.id=32ac22a27a764512a3a0cc1ca0720acd&scope.project.id=00a5583c7b7443e98e7a1d31a0b638dc&role.id=5611724e350b41e19921b5961a342582 => generated 260 bytes in 54 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 24 16:31:00.969044 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87a805f5-7f72-4c3a-b54a-2a701a5df76a None None] REQUEST_METHOD: `GET` {{(pid=71938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 24 16:31:00.969591 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87a805f5-7f72-4c3a-b54a-2a701a5df76a None None] SCRIPT_NAME: `/identity` {{(pid=71938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 24 16:31:00.969686 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87a805f5-7f72-4c3a-b54a-2a701a5df76a None None] PATH_INFO: `/` {{(pid=71938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 24 16:31:00.971644 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: [pid: 71938|app: 0|req: 195/389] 10.222.0.53 () {54 vars in 915 bytes} [Wed Nov 24 16:31:00 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 24 16:31:00.977128 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f40eae39-f188-4152-bd74-6c40ce39b640 None None] REQUEST_METHOD: `POST` {{(pid=71939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 24 16:31:00.977488 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f40eae39-f188-4152-bd74-6c40ce39b640 None None] SCRIPT_NAME: `/identity` {{(pid=71939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 24 16:31:00.977831 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f40eae39-f188-4152-bd74-6c40ce39b640 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=71939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 24 16:31:01.001243 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.auth.core [None req-f40eae39-f188-4152-bd74-6c40ce39b640 None None] MFA Rules not processed for user `0f2ba2e8375b4e8c8792ee1e22b60427`. Rule list: `[]` (Enabled: `True`). {{(pid=71939) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:442}} Nov 24 16:31:01.003073 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.fernet_utils [None req-f40eae39-f188-4152-bd74-6c40ce39b640 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=71939) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:289}} Nov 24 16:31:01.010300 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: [pid: 71939|app: 0|req: 195/390] 10.222.0.53 () {58 vars in 1013 bytes} [Wed Nov 24 16:31:00 2021] POST /identity/v3/auth/tokens => generated 1067 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 24 16:31:01.037604 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a699eb3d-59b9-4a46-af97-c9bc1590970b None None] REQUEST_METHOD: `POST` {{(pid=71938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 24 16:31:01.037958 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a699eb3d-59b9-4a46-af97-c9bc1590970b None None] SCRIPT_NAME: `/identity` {{(pid=71938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 24 16:31:01.038341 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a699eb3d-59b9-4a46-af97-c9bc1590970b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=71938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 24 16:31:01.061719 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.auth.core [None req-a699eb3d-59b9-4a46-af97-c9bc1590970b None None] MFA Rules not processed for user `0f2ba2e8375b4e8c8792ee1e22b60427`. Rule list: `[]` (Enabled: `True`). {{(pid=71938) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:442}} Nov 24 16:31:01.062963 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.fernet_utils [None req-a699eb3d-59b9-4a46-af97-c9bc1590970b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=71938) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:289}} Nov 24 16:31:01.070609 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: [pid: 71938|app: 0|req: 196/391] 10.222.0.53 () {58 vars in 1013 bytes} [Wed Nov 24 16:31:01 2021] POST /identity/v3/auth/tokens => generated 1067 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 24 16:31:01.076330 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f40eae39-f188-4152-bd74-6c40ce39b640 None None] Authenticating user token {{(pid=71939) process_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 24 16:31:01.086787 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f40eae39-f188-4152-bd74-6c40ce39b640 None None] Validating token access rules against request {{(pid=71939) validate_allowed_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 24 16:31:01.090967 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c021ac1a-aba4-48f1-a478-657701b3ff7f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f2ba2e8375b4e8c8792ee1e22b60427', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '00a5583c7b7443e98e7a1d31a0b638dc', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=71939) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 24 16:31:01.091776 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c021ac1a-aba4-48f1-a478-657701b3ff7f admin admin] REQUEST_METHOD: `GET` {{(pid=71939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 24 16:31:01.092115 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c021ac1a-aba4-48f1-a478-657701b3ff7f admin admin] SCRIPT_NAME: `/identity` {{(pid=71939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 24 16:31:01.092449 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c021ac1a-aba4-48f1-a478-657701b3ff7f admin admin] PATH_INFO: `/v3/roles/admin` {{(pid=71939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 24 16:31:01.104134 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c021ac1a-aba4-48f1-a478-657701b3ff7f admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=71939) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:401}} Nov 24 16:31:01.111493 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: WARNING keystone.server.flask.application [None req-c021ac1a-aba4-48f1-a478-657701b3ff7f admin admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Nov 24 16:31:01.112659 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: [pid: 71939|app: 0|req: 196/392] 10.222.0.53 () {56 vars in 1108 bytes} [Wed Nov 24 16:31:01 2021] GET /identity/v3/roles/admin => generated 83 bytes in 37 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 24 16:31:01.118782 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a699eb3d-59b9-4a46-af97-c9bc1590970b None None] Authenticating user token {{(pid=71938) process_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 24 16:31:01.128395 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a699eb3d-59b9-4a46-af97-c9bc1590970b None None] Validating token access rules against request {{(pid=71938) validate_allowed_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 24 16:31:01.132620 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03b98766-bc7c-4b76-bebe-b4b10c5f46ed admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f2ba2e8375b4e8c8792ee1e22b60427', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '00a5583c7b7443e98e7a1d31a0b638dc', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=71938) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 24 16:31:01.133284 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03b98766-bc7c-4b76-bebe-b4b10c5f46ed admin admin] REQUEST_METHOD: `GET` {{(pid=71938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 24 16:31:01.133628 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03b98766-bc7c-4b76-bebe-b4b10c5f46ed admin admin] SCRIPT_NAME: `/identity` {{(pid=71938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 24 16:31:01.133964 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03b98766-bc7c-4b76-bebe-b4b10c5f46ed admin admin] PATH_INFO: `/v3/roles` {{(pid=71938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 24 16:31:01.134816 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03b98766-bc7c-4b76-bebe-b4b10c5f46ed admin admin] RBAC: Adding query filter params (name=admin) {{(pid=71938) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:161}} Nov 24 16:31:01.135173 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03b98766-bc7c-4b76-bebe-b4b10c5f46ed admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=71938) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:442}} Nov 24 16:31:01.164380 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03b98766-bc7c-4b76-bebe-b4b10c5f46ed admin admin] RBAC: Authorization granted {{(pid=71938) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 24 16:31:01.173773 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: [pid: 71938|app: 0|req: 197/393] 10.222.0.53 () {56 vars in 1111 bytes} [Wed Nov 24 16:31:01 2021] GET /identity/v3/roles?name=admin => generated 339 bytes in 55 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 24 16:31:01.179650 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c021ac1a-aba4-48f1-a478-657701b3ff7f admin admin] Authenticating user token {{(pid=71939) process_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 24 16:31:01.190745 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c021ac1a-aba4-48f1-a478-657701b3ff7f admin admin] Validating token access rules against request {{(pid=71939) validate_allowed_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 24 16:31:01.194952 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c690d19-91a5-44a9-af43-d3d76ec694f0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f2ba2e8375b4e8c8792ee1e22b60427', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '00a5583c7b7443e98e7a1d31a0b638dc', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=71939) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 24 16:31:01.195818 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c690d19-91a5-44a9-af43-d3d76ec694f0 admin admin] REQUEST_METHOD: `GET` {{(pid=71939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 24 16:31:01.196159 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c690d19-91a5-44a9-af43-d3d76ec694f0 admin admin] SCRIPT_NAME: `/identity` {{(pid=71939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 24 16:31:01.196490 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c690d19-91a5-44a9-af43-d3d76ec694f0 admin admin] PATH_INFO: `/v3/groups/32ac22a27a764512a3a0cc1ca0720acd` {{(pid=71939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 24 16:31:01.197655 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c690d19-91a5-44a9-af43-d3d76ec694f0 admin admin] RBAC: Authorizing `identity:get_group(group_id=32ac22a27a764512a3a0cc1ca0720acd)` {{(pid=71939) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:442}} Nov 24 16:31:01.227673 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c690d19-91a5-44a9-af43-d3d76ec694f0 admin admin] RBAC: Authorization granted {{(pid=71939) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 24 16:31:01.229261 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: [pid: 71939|app: 0|req: 197/394] 10.222.0.53 () {56 vars in 1192 bytes} [Wed Nov 24 16:31:01 2021] GET /identity/v3/groups/32ac22a27a764512a3a0cc1ca0720acd => generated 229 bytes in 50 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 24 16:31:01.235134 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03b98766-bc7c-4b76-bebe-b4b10c5f46ed admin admin] Authenticating user token {{(pid=71938) process_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 24 16:31:01.245134 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03b98766-bc7c-4b76-bebe-b4b10c5f46ed admin admin] Validating token access rules against request {{(pid=71938) validate_allowed_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 24 16:31:01.249284 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d0678da-d40f-4ac0-984c-be1e9fc74b2d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f2ba2e8375b4e8c8792ee1e22b60427', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '00a5583c7b7443e98e7a1d31a0b638dc', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=71938) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 24 16:31:01.250201 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d0678da-d40f-4ac0-984c-be1e9fc74b2d admin admin] REQUEST_METHOD: `GET` {{(pid=71938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 24 16:31:01.250540 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d0678da-d40f-4ac0-984c-be1e9fc74b2d admin admin] SCRIPT_NAME: `/identity` {{(pid=71938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 24 16:31:01.250869 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d0678da-d40f-4ac0-984c-be1e9fc74b2d admin admin] PATH_INFO: `/v3/projects/00a5583c7b7443e98e7a1d31a0b638dc` {{(pid=71938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 24 16:31:01.252563 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d0678da-d40f-4ac0-984c-be1e9fc74b2d admin admin] RBAC: Authorizing `identity:get_project(project_id=00a5583c7b7443e98e7a1d31a0b638dc)` {{(pid=71938) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:442}} Nov 24 16:31:01.281360 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d0678da-d40f-4ac0-984c-be1e9fc74b2d admin admin] RBAC: Authorization granted {{(pid=71938) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 24 16:31:01.283063 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: [pid: 71938|app: 0|req: 198/395] 10.222.0.53 () {56 vars in 1198 bytes} [Wed Nov 24 16:31:01 2021] GET /identity/v3/projects/00a5583c7b7443e98e7a1d31a0b638dc => generated 344 bytes in 48 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 24 16:31:01.289003 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c690d19-91a5-44a9-af43-d3d76ec694f0 admin admin] Authenticating user token {{(pid=71939) process_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 24 16:31:01.298936 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c690d19-91a5-44a9-af43-d3d76ec694f0 admin admin] Validating token access rules against request {{(pid=71939) validate_allowed_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 24 16:31:01.303173 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ecf7f88-b7ca-4673-af69-18d1602aa109 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f2ba2e8375b4e8c8792ee1e22b60427', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '00a5583c7b7443e98e7a1d31a0b638dc', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=71939) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 24 16:31:01.304070 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ecf7f88-b7ca-4673-af69-18d1602aa109 admin admin] REQUEST_METHOD: `PUT` {{(pid=71939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 24 16:31:01.304413 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ecf7f88-b7ca-4673-af69-18d1602aa109 admin admin] SCRIPT_NAME: `/identity` {{(pid=71939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 24 16:31:01.304915 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ecf7f88-b7ca-4673-af69-18d1602aa109 admin admin] PATH_INFO: `/v3/projects/00a5583c7b7443e98e7a1d31a0b638dc/groups/32ac22a27a764512a3a0cc1ca0720acd/roles/5611724e350b41e19921b5961a342582` {{(pid=71939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 24 16:31:01.306825 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ecf7f88-b7ca-4673-af69-18d1602aa109 admin admin] RBAC: Authorizing `identity:create_grant(project_id=00a5583c7b7443e98e7a1d31a0b638dc, group_id=32ac22a27a764512a3a0cc1ca0720acd, role_id=5611724e350b41e19921b5961a342582)` {{(pid=71939) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:442}} Nov 24 16:31:01.338906 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ecf7f88-b7ca-4673-af69-18d1602aa109 admin admin] RBAC: Authorization granted {{(pid=71939) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 24 16:31:01.350951 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: [pid: 71939|app: 0|req: 198/396] 10.222.0.53 () {58 vars in 1454 bytes} [Wed Nov 24 16:31:01 2021] PUT /identity/v3/projects/00a5583c7b7443e98e7a1d31a0b638dc/groups/32ac22a27a764512a3a0cc1ca0720acd/roles/5611724e350b41e19921b5961a342582 => generated 0 bytes in 62 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 24 16:31:03.303586 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32d59485-3c5c-48b8-9a16-8828e4ca2177 None None] REQUEST_METHOD: `GET` {{(pid=71938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 24 16:31:03.304127 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32d59485-3c5c-48b8-9a16-8828e4ca2177 None None] SCRIPT_NAME: `/identity` {{(pid=71938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 24 16:31:03.304239 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32d59485-3c5c-48b8-9a16-8828e4ca2177 None None] PATH_INFO: `/` {{(pid=71938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 24 16:31:03.306068 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: [pid: 71938|app: 0|req: 199/397] 10.222.0.53 () {54 vars in 915 bytes} [Wed Nov 24 16:31:03 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 24 16:31:03.312089 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65371c08-9a99-465d-8ad5-86a2b828ad1f None None] REQUEST_METHOD: `POST` {{(pid=71939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 24 16:31:03.312443 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65371c08-9a99-465d-8ad5-86a2b828ad1f None None] SCRIPT_NAME: `/identity` {{(pid=71939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 24 16:31:03.312784 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65371c08-9a99-465d-8ad5-86a2b828ad1f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=71939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 24 16:31:03.339277 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.auth.core [None req-65371c08-9a99-465d-8ad5-86a2b828ad1f None None] MFA Rules not processed for user `0f2ba2e8375b4e8c8792ee1e22b60427`. Rule list: `[]` (Enabled: `True`). {{(pid=71939) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:442}} Nov 24 16:31:03.340515 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.fernet_utils [None req-65371c08-9a99-465d-8ad5-86a2b828ad1f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=71939) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:289}} Nov 24 16:31:03.414705 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: [pid: 71939|app: 0|req: 199/398] 10.222.0.53 () {58 vars in 1013 bytes} [Wed Nov 24 16:31:03 2021] POST /identity/v3/auth/tokens => generated 1067 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 24 16:31:03.440133 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50a41738-6c3c-4b04-a116-cc9a3ebffb7a None None] REQUEST_METHOD: `POST` {{(pid=71938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 24 16:31:03.440668 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50a41738-6c3c-4b04-a116-cc9a3ebffb7a None None] SCRIPT_NAME: `/identity` {{(pid=71938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 24 16:31:03.441153 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50a41738-6c3c-4b04-a116-cc9a3ebffb7a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=71938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 24 16:31:03.469684 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.auth.core [None req-50a41738-6c3c-4b04-a116-cc9a3ebffb7a None None] MFA Rules not processed for user `0f2ba2e8375b4e8c8792ee1e22b60427`. Rule list: `[]` (Enabled: `True`). {{(pid=71938) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:442}} Nov 24 16:31:03.471506 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.fernet_utils [None req-50a41738-6c3c-4b04-a116-cc9a3ebffb7a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=71938) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:289}} Nov 24 16:31:03.480471 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: [pid: 71938|app: 0|req: 200/399] 10.222.0.53 () {58 vars in 1013 bytes} [Wed Nov 24 16:31:03 2021] POST /identity/v3/auth/tokens => generated 1067 bytes in 42 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Nov 24 16:31:03.488285 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65371c08-9a99-465d-8ad5-86a2b828ad1f None None] Authenticating user token {{(pid=71939) process_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 24 16:31:03.500346 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65371c08-9a99-465d-8ad5-86a2b828ad1f None None] Validating token access rules against request {{(pid=71939) validate_allowed_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 24 16:31:03.506144 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9ed7fff-d098-41d5-b088-e649cf1a88fa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f2ba2e8375b4e8c8792ee1e22b60427', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '00a5583c7b7443e98e7a1d31a0b638dc', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=71939) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 24 16:31:03.507295 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9ed7fff-d098-41d5-b088-e649cf1a88fa admin admin] REQUEST_METHOD: `GET` {{(pid=71939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 24 16:31:03.507648 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9ed7fff-d098-41d5-b088-e649cf1a88fa admin admin] SCRIPT_NAME: `/identity` {{(pid=71939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 24 16:31:03.508075 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9ed7fff-d098-41d5-b088-e649cf1a88fa admin admin] PATH_INFO: `/v3/roles/admin` {{(pid=71939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 24 16:31:03.536608 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9ed7fff-d098-41d5-b088-e649cf1a88fa admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=71939) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:401}} Nov 24 16:31:03.544353 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: WARNING keystone.server.flask.application [None req-e9ed7fff-d098-41d5-b088-e649cf1a88fa admin admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Nov 24 16:31:03.545697 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: [pid: 71939|app: 0|req: 200/400] 10.222.0.53 () {56 vars in 1108 bytes} [Wed Nov 24 16:31:03 2021] GET /identity/v3/roles/admin => generated 83 bytes in 59 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Nov 24 16:31:03.557236 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50a41738-6c3c-4b04-a116-cc9a3ebffb7a None None] Authenticating user token {{(pid=71938) process_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 24 16:31:03.573299 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50a41738-6c3c-4b04-a116-cc9a3ebffb7a None None] Validating token access rules against request {{(pid=71938) validate_allowed_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 24 16:31:03.580863 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76ba47b6-4db9-46bb-a30d-3cd630ce4638 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f2ba2e8375b4e8c8792ee1e22b60427', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '00a5583c7b7443e98e7a1d31a0b638dc', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=71938) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 24 16:31:03.581978 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76ba47b6-4db9-46bb-a30d-3cd630ce4638 admin admin] REQUEST_METHOD: `GET` {{(pid=71938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 24 16:31:03.582568 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76ba47b6-4db9-46bb-a30d-3cd630ce4638 admin admin] SCRIPT_NAME: `/identity` {{(pid=71938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 24 16:31:03.583056 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76ba47b6-4db9-46bb-a30d-3cd630ce4638 admin admin] PATH_INFO: `/v3/roles` {{(pid=71938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 24 16:31:03.584322 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76ba47b6-4db9-46bb-a30d-3cd630ce4638 admin admin] RBAC: Adding query filter params (name=admin) {{(pid=71938) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:161}} Nov 24 16:31:03.584850 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76ba47b6-4db9-46bb-a30d-3cd630ce4638 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=71938) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:442}} Nov 24 16:31:03.617652 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76ba47b6-4db9-46bb-a30d-3cd630ce4638 admin admin] RBAC: Authorization granted {{(pid=71938) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 24 16:31:03.628449 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: [pid: 71938|app: 0|req: 201/401] 10.222.0.53 () {56 vars in 1111 bytes} [Wed Nov 24 16:31:03 2021] GET /identity/v3/roles?name=admin => generated 339 bytes in 72 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 24 16:31:03.635650 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9ed7fff-d098-41d5-b088-e649cf1a88fa admin admin] Authenticating user token {{(pid=71939) process_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 24 16:31:03.649890 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9ed7fff-d098-41d5-b088-e649cf1a88fa admin admin] Validating token access rules against request {{(pid=71939) validate_allowed_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 24 16:31:03.657535 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8743a55a-2b25-4946-be45-532fb45d103f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f2ba2e8375b4e8c8792ee1e22b60427', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '00a5583c7b7443e98e7a1d31a0b638dc', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=71939) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 24 16:31:03.659144 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8743a55a-2b25-4946-be45-532fb45d103f admin admin] REQUEST_METHOD: `GET` {{(pid=71939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 24 16:31:03.659506 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8743a55a-2b25-4946-be45-532fb45d103f admin admin] SCRIPT_NAME: `/identity` {{(pid=71939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 24 16:31:03.659848 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8743a55a-2b25-4946-be45-532fb45d103f admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=71939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 24 16:31:03.670594 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8743a55a-2b25-4946-be45-532fb45d103f admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=71939) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:442}} Nov 24 16:31:03.699263 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8743a55a-2b25-4946-be45-532fb45d103f admin admin] RBAC: Authorization granted {{(pid=71939) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 24 16:31:03.710094 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: [pid: 71939|app: 0|req: 201/402] 10.222.0.53 () {58 vars in 1315 bytes} [Wed Nov 24 16:31:03 2021] GET /identity/v3/auth/tokens => generated 1067 bytes in 76 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 24 16:31:03.716138 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76ba47b6-4db9-46bb-a30d-3cd630ce4638 admin admin] Authenticating user token {{(pid=71938) process_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 24 16:31:03.726892 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76ba47b6-4db9-46bb-a30d-3cd630ce4638 admin admin] Validating token access rules against request {{(pid=71938) validate_allowed_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 24 16:31:03.731057 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d30ca86-6414-43a9-b0a9-3d91cc2009be admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f2ba2e8375b4e8c8792ee1e22b60427', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '00a5583c7b7443e98e7a1d31a0b638dc', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=71938) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 24 16:31:03.731937 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d30ca86-6414-43a9-b0a9-3d91cc2009be admin admin] REQUEST_METHOD: `GET` {{(pid=71938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 24 16:31:03.732275 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d30ca86-6414-43a9-b0a9-3d91cc2009be admin admin] SCRIPT_NAME: `/identity` {{(pid=71938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 24 16:31:03.732607 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d30ca86-6414-43a9-b0a9-3d91cc2009be admin admin] PATH_INFO: `/v3/projects/00a5583c7b7443e98e7a1d31a0b638dc` {{(pid=71938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 24 16:31:03.733828 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d30ca86-6414-43a9-b0a9-3d91cc2009be admin admin] RBAC: Authorizing `identity:get_project(project_id=00a5583c7b7443e98e7a1d31a0b638dc)` {{(pid=71938) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:442}} Nov 24 16:31:03.762494 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d30ca86-6414-43a9-b0a9-3d91cc2009be admin admin] RBAC: Authorization granted {{(pid=71938) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 24 16:31:03.764253 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: [pid: 71938|app: 0|req: 202/403] 10.222.0.53 () {56 vars in 1198 bytes} [Wed Nov 24 16:31:03 2021] GET /identity/v3/projects/00a5583c7b7443e98e7a1d31a0b638dc => generated 344 bytes in 49 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 24 16:31:03.770806 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8743a55a-2b25-4946-be45-532fb45d103f admin admin] Authenticating user token {{(pid=71939) process_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 24 16:31:03.782063 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8743a55a-2b25-4946-be45-532fb45d103f admin admin] Validating token access rules against request {{(pid=71939) validate_allowed_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 24 16:31:03.790218 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ece1f1d-7bea-4407-a1d9-ccdbb638a86d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f2ba2e8375b4e8c8792ee1e22b60427', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '00a5583c7b7443e98e7a1d31a0b638dc', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=71939) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 24 16:31:03.791417 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ece1f1d-7bea-4407-a1d9-ccdbb638a86d admin admin] REQUEST_METHOD: `GET` {{(pid=71939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 24 16:31:03.791635 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ece1f1d-7bea-4407-a1d9-ccdbb638a86d admin admin] SCRIPT_NAME: `/identity` {{(pid=71939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 24 16:31:03.791985 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ece1f1d-7bea-4407-a1d9-ccdbb638a86d admin admin] PATH_INFO: `/v3/groups/32ac22a27a764512a3a0cc1ca0720acd` {{(pid=71939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 24 16:31:03.793260 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ece1f1d-7bea-4407-a1d9-ccdbb638a86d admin admin] RBAC: Authorizing `identity:get_group(group_id=32ac22a27a764512a3a0cc1ca0720acd)` {{(pid=71939) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:442}} Nov 24 16:31:03.828278 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ece1f1d-7bea-4407-a1d9-ccdbb638a86d admin admin] RBAC: Authorization granted {{(pid=71939) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 24 16:31:03.830597 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: [pid: 71939|app: 0|req: 202/404] 10.222.0.53 () {56 vars in 1192 bytes} [Wed Nov 24 16:31:03 2021] GET /identity/v3/groups/32ac22a27a764512a3a0cc1ca0720acd => generated 229 bytes in 60 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 24 16:31:03.837122 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d30ca86-6414-43a9-b0a9-3d91cc2009be admin admin] Authenticating user token {{(pid=71938) process_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 24 16:31:03.849715 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d30ca86-6414-43a9-b0a9-3d91cc2009be admin admin] Validating token access rules against request {{(pid=71938) validate_allowed_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 24 16:31:03.856024 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18633df7-fef1-404e-ae9c-f887b9a81711 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f2ba2e8375b4e8c8792ee1e22b60427', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '00a5583c7b7443e98e7a1d31a0b638dc', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=71938) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 24 16:31:03.857145 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18633df7-fef1-404e-ae9c-f887b9a81711 admin admin] REQUEST_METHOD: `GET` {{(pid=71938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 24 16:31:03.857621 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18633df7-fef1-404e-ae9c-f887b9a81711 admin admin] SCRIPT_NAME: `/identity` {{(pid=71938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 24 16:31:03.858286 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18633df7-fef1-404e-ae9c-f887b9a81711 admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=71938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 24 16:31:03.860326 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18633df7-fef1-404e-ae9c-f887b9a81711 admin admin] RBAC: Adding query filter params (group.id=32ac22a27a764512a3a0cc1ca0720acd, role.id=5611724e350b41e19921b5961a342582, scope.project.id=00a5583c7b7443e98e7a1d31a0b638dc) {{(pid=71938) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:161}} Nov 24 16:31:03.860955 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18633df7-fef1-404e-ae9c-f887b9a81711 admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=71938) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:442}} Nov 24 16:31:03.915208 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18633df7-fef1-404e-ae9c-f887b9a81711 admin admin] RBAC: Authorization granted {{(pid=71938) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 24 16:31:03.926060 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: [pid: 71938|app: 0|req: 203/405] 10.222.0.53 () {56 vars in 1388 bytes} [Wed Nov 24 16:31:03 2021] GET /identity/v3/role_assignments?group.id=32ac22a27a764512a3a0cc1ca0720acd&scope.project.id=00a5583c7b7443e98e7a1d31a0b638dc&role.id=5611724e350b41e19921b5961a342582 => generated 611 bytes in 89 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 24 16:31:05.998260 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99463e09-31e6-45fc-8f19-4fb35bf18f54 None None] REQUEST_METHOD: `GET` {{(pid=71939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 24 16:31:05.998821 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99463e09-31e6-45fc-8f19-4fb35bf18f54 None None] SCRIPT_NAME: `/identity` {{(pid=71939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 24 16:31:05.998913 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99463e09-31e6-45fc-8f19-4fb35bf18f54 None None] PATH_INFO: `/` {{(pid=71939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 24 16:31:06.000711 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: [pid: 71939|app: 0|req: 203/406] 10.222.0.53 () {54 vars in 915 bytes} [Wed Nov 24 16:31:05 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 24 16:31:06.006316 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cbf46d7-bbd0-48e1-9ac5-a2cd063ba1c7 None None] REQUEST_METHOD: `POST` {{(pid=71938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 24 16:31:06.006670 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cbf46d7-bbd0-48e1-9ac5-a2cd063ba1c7 None None] SCRIPT_NAME: `/identity` {{(pid=71938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 24 16:31:06.007011 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cbf46d7-bbd0-48e1-9ac5-a2cd063ba1c7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=71938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 24 16:31:06.031281 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.auth.core [None req-2cbf46d7-bbd0-48e1-9ac5-a2cd063ba1c7 None None] MFA Rules not processed for user `0f2ba2e8375b4e8c8792ee1e22b60427`. Rule list: `[]` (Enabled: `True`). {{(pid=71938) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:442}} Nov 24 16:31:06.032499 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.fernet_utils [None req-2cbf46d7-bbd0-48e1-9ac5-a2cd063ba1c7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=71938) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:289}} Nov 24 16:31:06.040304 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: [pid: 71938|app: 0|req: 204/407] 10.222.0.53 () {58 vars in 1013 bytes} [Wed Nov 24 16:31:06 2021] POST /identity/v3/auth/tokens => generated 1067 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 24 16:31:06.063121 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbc02bff-b8b4-4655-a967-919542c4a99e None None] REQUEST_METHOD: `POST` {{(pid=71939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 24 16:31:06.063466 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbc02bff-b8b4-4655-a967-919542c4a99e None None] SCRIPT_NAME: `/identity` {{(pid=71939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 24 16:31:06.063804 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbc02bff-b8b4-4655-a967-919542c4a99e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=71939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 24 16:31:06.088082 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.auth.core [None req-bbc02bff-b8b4-4655-a967-919542c4a99e None None] MFA Rules not processed for user `0f2ba2e8375b4e8c8792ee1e22b60427`. Rule list: `[]` (Enabled: `True`). {{(pid=71939) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:442}} Nov 24 16:31:06.089298 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.fernet_utils [None req-bbc02bff-b8b4-4655-a967-919542c4a99e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=71939) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:289}} Nov 24 16:31:06.097317 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: [pid: 71939|app: 0|req: 204/408] 10.222.0.53 () {58 vars in 1013 bytes} [Wed Nov 24 16:31:06 2021] POST /identity/v3/auth/tokens => generated 1067 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 24 16:31:06.103135 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cbf46d7-bbd0-48e1-9ac5-a2cd063ba1c7 None None] Authenticating user token {{(pid=71938) process_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 24 16:31:06.118850 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cbf46d7-bbd0-48e1-9ac5-a2cd063ba1c7 None None] Validating token access rules against request {{(pid=71938) validate_allowed_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 24 16:31:06.123033 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00e3f6bb-0c5c-47f6-8532-21897291f9a0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f2ba2e8375b4e8c8792ee1e22b60427', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '00a5583c7b7443e98e7a1d31a0b638dc', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=71938) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 24 16:31:06.123847 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00e3f6bb-0c5c-47f6-8532-21897291f9a0 admin admin] REQUEST_METHOD: `GET` {{(pid=71938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 24 16:31:06.124186 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00e3f6bb-0c5c-47f6-8532-21897291f9a0 admin admin] SCRIPT_NAME: `/identity` {{(pid=71938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 24 16:31:06.124523 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00e3f6bb-0c5c-47f6-8532-21897291f9a0 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=71938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 24 16:31:06.136865 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00e3f6bb-0c5c-47f6-8532-21897291f9a0 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=71938) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:442}} Nov 24 16:31:06.166257 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00e3f6bb-0c5c-47f6-8532-21897291f9a0 admin admin] RBAC: Authorization granted {{(pid=71938) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 24 16:31:06.185608 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: WARNING keystone.server.flask.application [None req-00e3f6bb-0c5c-47f6-8532-21897291f9a0 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Nov 24 16:31:06.186925 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: [pid: 71938|app: 0|req: 205/409] 10.222.0.53 () {56 vars in 1120 bytes} [Wed Nov 24 16:31:06 2021] GET /identity/v3/domains/Default => generated 87 bytes in 84 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 24 16:31:06.194307 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbc02bff-b8b4-4655-a967-919542c4a99e None None] Authenticating user token {{(pid=71939) process_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 24 16:31:06.203941 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbc02bff-b8b4-4655-a967-919542c4a99e None None] Validating token access rules against request {{(pid=71939) validate_allowed_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 24 16:31:06.208946 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb68a9e9-19f6-491f-b6ed-a8a4ba108798 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f2ba2e8375b4e8c8792ee1e22b60427', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '00a5583c7b7443e98e7a1d31a0b638dc', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=71939) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 24 16:31:06.209655 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb68a9e9-19f6-491f-b6ed-a8a4ba108798 admin admin] REQUEST_METHOD: `GET` {{(pid=71939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 24 16:31:06.209998 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb68a9e9-19f6-491f-b6ed-a8a4ba108798 admin admin] SCRIPT_NAME: `/identity` {{(pid=71939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 24 16:31:06.210361 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb68a9e9-19f6-491f-b6ed-a8a4ba108798 admin admin] PATH_INFO: `/v3/domains` {{(pid=71939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 24 16:31:06.211160 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb68a9e9-19f6-491f-b6ed-a8a4ba108798 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=71939) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:161}} Nov 24 16:31:06.211510 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb68a9e9-19f6-491f-b6ed-a8a4ba108798 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=71939) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:442}} Nov 24 16:31:06.238914 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: WARNING py.warnings [None req-bb68a9e9-19f6-491f-b6ed-a8a4ba108798 admin admin] /usr/local/lib/python3.6/dist-packages/oslo_policy/policy.py:1018: UserWarning: Policy identity:list_domains failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 24 16:31:06.238914 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: warnings.warn(msg) Nov 24 16:31:06.238914 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: Nov 24 16:31:06.239986 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb68a9e9-19f6-491f-b6ed-a8a4ba108798 admin admin] RBAC: Authorization granted {{(pid=71939) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 24 16:31:06.255331 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: [pid: 71939|app: 0|req: 205/410] 10.222.0.53 () {56 vars in 1121 bytes} [Wed Nov 24 16:31:06 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 62 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 24 16:31:06.261204 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00e3f6bb-0c5c-47f6-8532-21897291f9a0 admin admin] Authenticating user token {{(pid=71938) process_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 24 16:31:06.273948 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00e3f6bb-0c5c-47f6-8532-21897291f9a0 admin admin] Validating token access rules against request {{(pid=71938) validate_allowed_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 24 16:31:06.278187 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfbc1d58-0065-4201-9530-dbc827432219 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f2ba2e8375b4e8c8792ee1e22b60427', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '00a5583c7b7443e98e7a1d31a0b638dc', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=71938) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 24 16:31:06.278864 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfbc1d58-0065-4201-9530-dbc827432219 admin admin] REQUEST_METHOD: `POST` {{(pid=71938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 24 16:31:06.279204 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfbc1d58-0065-4201-9530-dbc827432219 admin admin] SCRIPT_NAME: `/identity` {{(pid=71938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 24 16:31:06.279540 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfbc1d58-0065-4201-9530-dbc827432219 admin admin] PATH_INFO: `/v3/users` {{(pid=71938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 24 16:31:06.280277 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfbc1d58-0065-4201-9530-dbc827432219 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=71938) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:442}} Nov 24 16:31:06.309189 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfbc1d58-0065-4201-9530-dbc827432219 admin admin] RBAC: Authorization granted {{(pid=71938) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 24 16:31:06.339614 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: [pid: 71938|app: 0|req: 206/411] 10.222.0.53 () {60 vars in 1143 bytes} [Wed Nov 24 16:31:06 2021] POST /identity/v3/users => generated 246 bytes in 79 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 24 16:31:08.392266 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-223d07f1-2a8e-482b-9bf0-a7d08a0a1640 None None] REQUEST_METHOD: `GET` {{(pid=71939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 24 16:31:08.392826 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-223d07f1-2a8e-482b-9bf0-a7d08a0a1640 None None] SCRIPT_NAME: `/identity` {{(pid=71939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 24 16:31:08.392962 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-223d07f1-2a8e-482b-9bf0-a7d08a0a1640 None None] PATH_INFO: `/` {{(pid=71939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 24 16:31:08.394863 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: [pid: 71939|app: 0|req: 206/412] 10.222.0.53 () {54 vars in 915 bytes} [Wed Nov 24 16:31:08 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 24 16:31:08.401961 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e9b18ea-cf4f-4a09-8201-4d9821a85f39 None None] REQUEST_METHOD: `POST` {{(pid=71938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 24 16:31:08.402525 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e9b18ea-cf4f-4a09-8201-4d9821a85f39 None None] SCRIPT_NAME: `/identity` {{(pid=71938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 24 16:31:08.403123 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e9b18ea-cf4f-4a09-8201-4d9821a85f39 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=71938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 24 16:31:08.427767 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.auth.core [None req-6e9b18ea-cf4f-4a09-8201-4d9821a85f39 None None] MFA Rules not processed for user `0f2ba2e8375b4e8c8792ee1e22b60427`. Rule list: `[]` (Enabled: `True`). {{(pid=71938) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:442}} Nov 24 16:31:08.429023 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.fernet_utils [None req-6e9b18ea-cf4f-4a09-8201-4d9821a85f39 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=71938) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:289}} Nov 24 16:31:08.436225 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: [pid: 71938|app: 0|req: 207/413] 10.222.0.53 () {58 vars in 1013 bytes} [Wed Nov 24 16:31:08 2021] POST /identity/v3/auth/tokens => generated 1067 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 24 16:31:08.459392 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c483159c-8c21-4931-8c77-0800c1f9d5a3 None None] REQUEST_METHOD: `POST` {{(pid=71939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 24 16:31:08.459739 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c483159c-8c21-4931-8c77-0800c1f9d5a3 None None] SCRIPT_NAME: `/identity` {{(pid=71939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 24 16:31:08.460077 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c483159c-8c21-4931-8c77-0800c1f9d5a3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=71939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 24 16:31:08.483406 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.auth.core [None req-c483159c-8c21-4931-8c77-0800c1f9d5a3 None None] MFA Rules not processed for user `0f2ba2e8375b4e8c8792ee1e22b60427`. Rule list: `[]` (Enabled: `True`). {{(pid=71939) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:442}} Nov 24 16:31:08.484568 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.fernet_utils [None req-c483159c-8c21-4931-8c77-0800c1f9d5a3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=71939) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:289}} Nov 24 16:31:08.492247 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: [pid: 71939|app: 0|req: 207/414] 10.222.0.53 () {58 vars in 1013 bytes} [Wed Nov 24 16:31:08 2021] POST /identity/v3/auth/tokens => generated 1067 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 24 16:31:08.497645 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e9b18ea-cf4f-4a09-8201-4d9821a85f39 None None] Authenticating user token {{(pid=71938) process_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 24 16:31:08.507219 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e9b18ea-cf4f-4a09-8201-4d9821a85f39 None None] Validating token access rules against request {{(pid=71938) validate_allowed_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 24 16:31:08.511531 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20aa2af7-8fa6-4b01-85bb-fe16c5fc950a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f2ba2e8375b4e8c8792ee1e22b60427', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '00a5583c7b7443e98e7a1d31a0b638dc', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=71938) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 24 16:31:08.512353 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20aa2af7-8fa6-4b01-85bb-fe16c5fc950a admin admin] REQUEST_METHOD: `GET` {{(pid=71938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 24 16:31:08.512698 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20aa2af7-8fa6-4b01-85bb-fe16c5fc950a admin admin] SCRIPT_NAME: `/identity` {{(pid=71938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 24 16:31:08.513030 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20aa2af7-8fa6-4b01-85bb-fe16c5fc950a admin admin] PATH_INFO: `/v3/roles/service` {{(pid=71938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 24 16:31:08.524962 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20aa2af7-8fa6-4b01-85bb-fe16c5fc950a admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=71938) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:401}} Nov 24 16:31:08.532563 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: WARNING keystone.server.flask.application [None req-20aa2af7-8fa6-4b01-85bb-fe16c5fc950a admin admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Nov 24 16:31:08.534381 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: [pid: 71938|app: 0|req: 208/415] 10.222.0.53 () {56 vars in 1114 bytes} [Wed Nov 24 16:31:08 2021] GET /identity/v3/roles/service => generated 85 bytes in 37 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 24 16:31:08.541146 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c483159c-8c21-4931-8c77-0800c1f9d5a3 None None] Authenticating user token {{(pid=71939) process_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 24 16:31:08.551070 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c483159c-8c21-4931-8c77-0800c1f9d5a3 None None] Validating token access rules against request {{(pid=71939) validate_allowed_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 24 16:31:08.555260 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe8a53e0-4d3a-43f9-a51d-2f350ef1aeac admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f2ba2e8375b4e8c8792ee1e22b60427', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '00a5583c7b7443e98e7a1d31a0b638dc', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=71939) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 24 16:31:08.555925 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe8a53e0-4d3a-43f9-a51d-2f350ef1aeac admin admin] REQUEST_METHOD: `GET` {{(pid=71939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 24 16:31:08.556261 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe8a53e0-4d3a-43f9-a51d-2f350ef1aeac admin admin] SCRIPT_NAME: `/identity` {{(pid=71939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 24 16:31:08.556588 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe8a53e0-4d3a-43f9-a51d-2f350ef1aeac admin admin] PATH_INFO: `/v3/roles` {{(pid=71939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 24 16:31:08.557395 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe8a53e0-4d3a-43f9-a51d-2f350ef1aeac admin admin] RBAC: Adding query filter params (name=service) {{(pid=71939) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:161}} Nov 24 16:31:08.557744 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe8a53e0-4d3a-43f9-a51d-2f350ef1aeac admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=71939) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:442}} Nov 24 16:31:08.585672 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe8a53e0-4d3a-43f9-a51d-2f350ef1aeac admin admin] RBAC: Authorization granted {{(pid=71939) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 24 16:31:08.594368 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: [pid: 71939|app: 0|req: 208/416] 10.222.0.53 () {56 vars in 1115 bytes} [Wed Nov 24 16:31:08 2021] GET /identity/v3/roles?name=service => generated 326 bytes in 54 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 24 16:31:08.600660 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20aa2af7-8fa6-4b01-85bb-fe16c5fc950a admin admin] Authenticating user token {{(pid=71938) process_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 24 16:31:08.611040 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20aa2af7-8fa6-4b01-85bb-fe16c5fc950a admin admin] Validating token access rules against request {{(pid=71938) validate_allowed_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 24 16:31:08.615880 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db0a141c-ad0b-4c8a-b9b8-b288561e0bf4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f2ba2e8375b4e8c8792ee1e22b60427', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '00a5583c7b7443e98e7a1d31a0b638dc', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=71938) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 24 16:31:08.616685 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db0a141c-ad0b-4c8a-b9b8-b288561e0bf4 admin admin] REQUEST_METHOD: `GET` {{(pid=71938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 24 16:31:08.617028 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db0a141c-ad0b-4c8a-b9b8-b288561e0bf4 admin admin] SCRIPT_NAME: `/identity` {{(pid=71938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 24 16:31:08.617364 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db0a141c-ad0b-4c8a-b9b8-b288561e0bf4 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=71938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 24 16:31:08.629256 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db0a141c-ad0b-4c8a-b9b8-b288561e0bf4 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=71938) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:442}} Nov 24 16:31:08.664274 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db0a141c-ad0b-4c8a-b9b8-b288561e0bf4 admin admin] RBAC: Authorization granted {{(pid=71938) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 24 16:31:08.689327 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: WARNING keystone.server.flask.application [None req-db0a141c-ad0b-4c8a-b9b8-b288561e0bf4 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Nov 24 16:31:08.690578 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: [pid: 71938|app: 0|req: 209/417] 10.222.0.53 () {56 vars in 1120 bytes} [Wed Nov 24 16:31:08 2021] GET /identity/v3/domains/Default => generated 87 bytes in 90 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 24 16:31:08.696773 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe8a53e0-4d3a-43f9-a51d-2f350ef1aeac admin admin] Authenticating user token {{(pid=71939) process_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 24 16:31:08.707132 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe8a53e0-4d3a-43f9-a51d-2f350ef1aeac admin admin] Validating token access rules against request {{(pid=71939) validate_allowed_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 24 16:31:08.711369 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3191d5c-399b-4c37-bfa1-400ec611aef7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f2ba2e8375b4e8c8792ee1e22b60427', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '00a5583c7b7443e98e7a1d31a0b638dc', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=71939) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 24 16:31:08.712033 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3191d5c-399b-4c37-bfa1-400ec611aef7 admin admin] REQUEST_METHOD: `GET` {{(pid=71939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 24 16:31:08.712379 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3191d5c-399b-4c37-bfa1-400ec611aef7 admin admin] SCRIPT_NAME: `/identity` {{(pid=71939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 24 16:31:08.712716 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3191d5c-399b-4c37-bfa1-400ec611aef7 admin admin] PATH_INFO: `/v3/domains` {{(pid=71939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 24 16:31:08.713502 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3191d5c-399b-4c37-bfa1-400ec611aef7 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=71939) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:161}} Nov 24 16:31:08.713854 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3191d5c-399b-4c37-bfa1-400ec611aef7 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=71939) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:442}} Nov 24 16:31:08.743315 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3191d5c-399b-4c37-bfa1-400ec611aef7 admin admin] RBAC: Authorization granted {{(pid=71939) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 24 16:31:08.756444 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: [pid: 71939|app: 0|req: 209/418] 10.222.0.53 () {56 vars in 1121 bytes} [Wed Nov 24 16:31:08 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 60 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 24 16:31:08.762088 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db0a141c-ad0b-4c8a-b9b8-b288561e0bf4 admin admin] Authenticating user token {{(pid=71938) process_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 24 16:31:08.771772 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db0a141c-ad0b-4c8a-b9b8-b288561e0bf4 admin admin] Validating token access rules against request {{(pid=71938) validate_allowed_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 24 16:31:08.775925 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a63f542-a03b-4342-a03c-0bfc7b0fc258 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f2ba2e8375b4e8c8792ee1e22b60427', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '00a5583c7b7443e98e7a1d31a0b638dc', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=71938) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 24 16:31:08.776723 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a63f542-a03b-4342-a03c-0bfc7b0fc258 admin admin] REQUEST_METHOD: `GET` {{(pid=71938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 24 16:31:08.777060 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a63f542-a03b-4342-a03c-0bfc7b0fc258 admin admin] SCRIPT_NAME: `/identity` {{(pid=71938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 24 16:31:08.777388 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a63f542-a03b-4342-a03c-0bfc7b0fc258 admin admin] PATH_INFO: `/v3/users/nova` {{(pid=71938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 24 16:31:08.791025 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a63f542-a03b-4342-a03c-0bfc7b0fc258 admin admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=71938) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:442}} Nov 24 16:31:08.820061 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a63f542-a03b-4342-a03c-0bfc7b0fc258 admin admin] RBAC: Authorization granted {{(pid=71938) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 24 16:31:08.839716 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: WARNING keystone.server.flask.application [None req-1a63f542-a03b-4342-a03c-0bfc7b0fc258 admin admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Nov 24 16:31:08.840862 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: [pid: 71938|app: 0|req: 210/419] 10.222.0.53 () {56 vars in 1105 bytes} [Wed Nov 24 16:31:08 2021] GET /identity/v3/users/nova => generated 82 bytes in 79 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 24 16:31:08.847043 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3191d5c-399b-4c37-bfa1-400ec611aef7 admin admin] Authenticating user token {{(pid=71939) process_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 24 16:31:08.856740 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3191d5c-399b-4c37-bfa1-400ec611aef7 admin admin] Validating token access rules against request {{(pid=71939) validate_allowed_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 24 16:31:08.860946 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-323e85cc-f908-4d0a-8b9b-1ebd9bea344f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f2ba2e8375b4e8c8792ee1e22b60427', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '00a5583c7b7443e98e7a1d31a0b638dc', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=71939) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 24 16:31:08.861615 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-323e85cc-f908-4d0a-8b9b-1ebd9bea344f admin admin] REQUEST_METHOD: `GET` {{(pid=71939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 24 16:31:08.861957 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-323e85cc-f908-4d0a-8b9b-1ebd9bea344f admin admin] SCRIPT_NAME: `/identity` {{(pid=71939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 24 16:31:08.862317 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-323e85cc-f908-4d0a-8b9b-1ebd9bea344f admin admin] PATH_INFO: `/v3/users` {{(pid=71939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 24 16:31:08.863218 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-323e85cc-f908-4d0a-8b9b-1ebd9bea344f admin admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=71939) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:161}} Nov 24 16:31:08.863583 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-323e85cc-f908-4d0a-8b9b-1ebd9bea344f admin admin] RBAC: Authorizing `identity:list_users()` {{(pid=71939) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:442}} Nov 24 16:31:08.890951 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: WARNING py.warnings [None req-323e85cc-f908-4d0a-8b9b-1ebd9bea344f admin admin] /usr/local/lib/python3.6/dist-packages/oslo_policy/policy.py:1018: UserWarning: Policy identity:list_users failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Nov 24 16:31:08.890951 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: warnings.warn(msg) Nov 24 16:31:08.890951 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: Nov 24 16:31:08.892253 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-323e85cc-f908-4d0a-8b9b-1ebd9bea344f admin admin] RBAC: Authorization granted {{(pid=71939) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 24 16:31:08.925013 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: [pid: 71939|app: 0|req: 210/420] 10.222.0.53 () {56 vars in 1145 bytes} [Wed Nov 24 16:31:08 2021] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 79 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 24 16:31:08.931007 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a63f542-a03b-4342-a03c-0bfc7b0fc258 admin admin] Authenticating user token {{(pid=71938) process_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 24 16:31:08.940688 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a63f542-a03b-4342-a03c-0bfc7b0fc258 admin admin] Validating token access rules against request {{(pid=71938) validate_allowed_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 24 16:31:08.944780 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ffca552-876a-4e83-b3f1-93f12089cdc5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f2ba2e8375b4e8c8792ee1e22b60427', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '00a5583c7b7443e98e7a1d31a0b638dc', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=71938) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 24 16:31:08.945419 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ffca552-876a-4e83-b3f1-93f12089cdc5 admin admin] REQUEST_METHOD: `GET` {{(pid=71938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 24 16:31:08.945754 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ffca552-876a-4e83-b3f1-93f12089cdc5 admin admin] SCRIPT_NAME: `/identity` {{(pid=71938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 24 16:31:08.946113 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ffca552-876a-4e83-b3f1-93f12089cdc5 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=71938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 24 16:31:08.955696 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ffca552-876a-4e83-b3f1-93f12089cdc5 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=71938) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:442}} Nov 24 16:31:08.984806 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ffca552-876a-4e83-b3f1-93f12089cdc5 admin admin] RBAC: Authorization granted {{(pid=71938) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 24 16:31:08.999648 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: [pid: 71938|app: 0|req: 211/421] 10.222.0.53 () {58 vars in 1315 bytes} [Wed Nov 24 16:31:08 2021] GET /identity/v3/auth/tokens => generated 1067 bytes in 69 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 24 16:31:09.006939 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-323e85cc-f908-4d0a-8b9b-1ebd9bea344f admin admin] Authenticating user token {{(pid=71939) process_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 24 16:31:09.017027 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-323e85cc-f908-4d0a-8b9b-1ebd9bea344f admin admin] Validating token access rules against request {{(pid=71939) validate_allowed_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 24 16:31:09.021711 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2484a98a-9fdc-4193-b56d-7d6fac8ecbde admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f2ba2e8375b4e8c8792ee1e22b60427', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '00a5583c7b7443e98e7a1d31a0b638dc', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=71939) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 24 16:31:09.022574 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2484a98a-9fdc-4193-b56d-7d6fac8ecbde admin admin] REQUEST_METHOD: `GET` {{(pid=71939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 24 16:31:09.022920 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2484a98a-9fdc-4193-b56d-7d6fac8ecbde admin admin] SCRIPT_NAME: `/identity` {{(pid=71939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 24 16:31:09.023251 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2484a98a-9fdc-4193-b56d-7d6fac8ecbde admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=71939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 24 16:31:09.036088 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2484a98a-9fdc-4193-b56d-7d6fac8ecbde admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=71939) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:442}} Nov 24 16:31:09.064353 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2484a98a-9fdc-4193-b56d-7d6fac8ecbde admin admin] RBAC: Authorization granted {{(pid=71939) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 24 16:31:09.084350 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: WARNING keystone.server.flask.application [None req-2484a98a-9fdc-4193-b56d-7d6fac8ecbde admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Nov 24 16:31:09.085574 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: [pid: 71939|app: 0|req: 211/422] 10.222.0.53 () {56 vars in 1120 bytes} [Wed Nov 24 16:31:09 2021] GET /identity/v3/domains/Default => generated 87 bytes in 79 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 24 16:31:09.091594 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ffca552-876a-4e83-b3f1-93f12089cdc5 admin admin] Authenticating user token {{(pid=71938) process_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 24 16:31:09.101350 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ffca552-876a-4e83-b3f1-93f12089cdc5 admin admin] Validating token access rules against request {{(pid=71938) validate_allowed_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 24 16:31:09.105537 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ff4ab5b-b249-4e60-93f8-6dc5339cc02c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f2ba2e8375b4e8c8792ee1e22b60427', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '00a5583c7b7443e98e7a1d31a0b638dc', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=71938) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 24 16:31:09.106250 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ff4ab5b-b249-4e60-93f8-6dc5339cc02c admin admin] REQUEST_METHOD: `GET` {{(pid=71938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 24 16:31:09.106590 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ff4ab5b-b249-4e60-93f8-6dc5339cc02c admin admin] SCRIPT_NAME: `/identity` {{(pid=71938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 24 16:31:09.106915 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ff4ab5b-b249-4e60-93f8-6dc5339cc02c admin admin] PATH_INFO: `/v3/domains` {{(pid=71938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 24 16:31:09.107685 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ff4ab5b-b249-4e60-93f8-6dc5339cc02c admin admin] RBAC: Adding query filter params (name=Default) {{(pid=71938) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:161}} Nov 24 16:31:09.108030 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ff4ab5b-b249-4e60-93f8-6dc5339cc02c admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=71938) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:442}} Nov 24 16:31:09.136097 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ff4ab5b-b249-4e60-93f8-6dc5339cc02c admin admin] RBAC: Authorization granted {{(pid=71938) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 24 16:31:09.151903 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: [pid: 71938|app: 0|req: 212/423] 10.222.0.53 () {56 vars in 1121 bytes} [Wed Nov 24 16:31:09 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 61 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 24 16:31:09.157807 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2484a98a-9fdc-4193-b56d-7d6fac8ecbde admin admin] Authenticating user token {{(pid=71939) process_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 24 16:31:09.168350 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2484a98a-9fdc-4193-b56d-7d6fac8ecbde admin admin] Validating token access rules against request {{(pid=71939) validate_allowed_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 24 16:31:09.172646 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cebc228e-3ffb-4fae-97ad-f4fdc2641bbe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f2ba2e8375b4e8c8792ee1e22b60427', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '00a5583c7b7443e98e7a1d31a0b638dc', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=71939) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 24 16:31:09.173453 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cebc228e-3ffb-4fae-97ad-f4fdc2641bbe admin admin] REQUEST_METHOD: `GET` {{(pid=71939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 24 16:31:09.173792 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cebc228e-3ffb-4fae-97ad-f4fdc2641bbe admin admin] SCRIPT_NAME: `/identity` {{(pid=71939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 24 16:31:09.174164 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cebc228e-3ffb-4fae-97ad-f4fdc2641bbe admin admin] PATH_INFO: `/v3/projects/service` {{(pid=71939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 24 16:31:09.183389 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cebc228e-3ffb-4fae-97ad-f4fdc2641bbe admin admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=71939) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:442}} Nov 24 16:31:09.213309 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cebc228e-3ffb-4fae-97ad-f4fdc2641bbe admin admin] RBAC: Authorization granted {{(pid=71939) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 24 16:31:09.229314 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: WARNING keystone.server.flask.application [None req-cebc228e-3ffb-4fae-97ad-f4fdc2641bbe admin admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Nov 24 16:31:09.230604 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: [pid: 71939|app: 0|req: 212/424] 10.222.0.53 () {56 vars in 1123 bytes} [Wed Nov 24 16:31:09 2021] GET /identity/v3/projects/service => generated 88 bytes in 73 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 24 16:31:09.236729 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ff4ab5b-b249-4e60-93f8-6dc5339cc02c admin admin] Authenticating user token {{(pid=71938) process_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 24 16:31:09.247213 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ff4ab5b-b249-4e60-93f8-6dc5339cc02c admin admin] Validating token access rules against request {{(pid=71938) validate_allowed_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 24 16:31:09.251550 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-811cc09a-5ffe-40d1-a409-aa232cb12304 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f2ba2e8375b4e8c8792ee1e22b60427', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '00a5583c7b7443e98e7a1d31a0b638dc', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=71938) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 24 16:31:09.252699 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-811cc09a-5ffe-40d1-a409-aa232cb12304 admin admin] REQUEST_METHOD: `GET` {{(pid=71938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 24 16:31:09.253032 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-811cc09a-5ffe-40d1-a409-aa232cb12304 admin admin] SCRIPT_NAME: `/identity` {{(pid=71938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 24 16:31:09.253361 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-811cc09a-5ffe-40d1-a409-aa232cb12304 admin admin] PATH_INFO: `/v3/projects` {{(pid=71938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 24 16:31:09.254237 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-811cc09a-5ffe-40d1-a409-aa232cb12304 admin admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=71938) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:161}} Nov 24 16:31:09.254592 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-811cc09a-5ffe-40d1-a409-aa232cb12304 admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=71938) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:442}} Nov 24 16:31:09.283119 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: WARNING py.warnings [None req-811cc09a-5ffe-40d1-a409-aa232cb12304 admin admin] /usr/local/lib/python3.6/dist-packages/oslo_policy/policy.py:1018: UserWarning: Policy identity:list_projects failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Nov 24 16:31:09.283119 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: warnings.warn(msg) Nov 24 16:31:09.283119 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: Nov 24 16:31:09.284436 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-811cc09a-5ffe-40d1-a409-aa232cb12304 admin admin] RBAC: Authorization granted {{(pid=71938) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 24 16:31:09.299782 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: [pid: 71938|app: 0|req: 213/425] 10.222.0.53 () {56 vars in 1160 bytes} [Wed Nov 24 16:31:09 2021] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 64 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 24 16:31:09.306104 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cebc228e-3ffb-4fae-97ad-f4fdc2641bbe admin admin] Authenticating user token {{(pid=71939) process_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 24 16:31:09.317218 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cebc228e-3ffb-4fae-97ad-f4fdc2641bbe admin admin] Validating token access rules against request {{(pid=71939) validate_allowed_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 24 16:31:09.322596 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce58dc22-0b5b-443d-98f3-99f9c740cae5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f2ba2e8375b4e8c8792ee1e22b60427', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '00a5583c7b7443e98e7a1d31a0b638dc', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=71939) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 24 16:31:09.322746 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce58dc22-0b5b-443d-98f3-99f9c740cae5 admin admin] REQUEST_METHOD: `GET` {{(pid=71939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 24 16:31:09.322975 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce58dc22-0b5b-443d-98f3-99f9c740cae5 admin admin] SCRIPT_NAME: `/identity` {{(pid=71939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 24 16:31:09.323706 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce58dc22-0b5b-443d-98f3-99f9c740cae5 admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=71939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 24 16:31:09.324641 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce58dc22-0b5b-443d-98f3-99f9c740cae5 admin admin] RBAC: Adding query filter params (role.id=2d4a51004ce34308a7a33e68bf2cfc74, scope.project.id=3b3940d4ae1c4177ae29c02377bb4b0b, user.id=3e196802d4d5432482b6d2eabc25f74e) {{(pid=71939) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:161}} Nov 24 16:31:09.324641 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce58dc22-0b5b-443d-98f3-99f9c740cae5 admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=71939) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:442}} Nov 24 16:31:09.364346 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce58dc22-0b5b-443d-98f3-99f9c740cae5 admin admin] RBAC: Authorization granted {{(pid=71939) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 24 16:31:09.374622 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: [pid: 71939|app: 0|req: 213/426] 10.222.0.53 () {56 vars in 1386 bytes} [Wed Nov 24 16:31:09 2021] GET /identity/v3/role_assignments?user.id=3e196802d4d5432482b6d2eabc25f74e&scope.project.id=3b3940d4ae1c4177ae29c02377bb4b0b&role.id=2d4a51004ce34308a7a33e68bf2cfc74 => generated 259 bytes in 69 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 24 16:31:11.328661 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-926a543b-e206-4788-946a-31a9ce763a5e None None] REQUEST_METHOD: `GET` {{(pid=71938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 24 16:31:11.329189 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-926a543b-e206-4788-946a-31a9ce763a5e None None] SCRIPT_NAME: `/identity` {{(pid=71938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 24 16:31:11.329292 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-926a543b-e206-4788-946a-31a9ce763a5e None None] PATH_INFO: `/` {{(pid=71938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 24 16:31:11.331712 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: [pid: 71938|app: 0|req: 214/427] 10.222.0.53 () {54 vars in 915 bytes} [Wed Nov 24 16:31:11 2021] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 24 16:31:11.337116 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4e87514-cf56-43c9-91cf-2c6abfa258f9 None None] REQUEST_METHOD: `POST` {{(pid=71939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 24 16:31:11.337462 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4e87514-cf56-43c9-91cf-2c6abfa258f9 None None] SCRIPT_NAME: `/identity` {{(pid=71939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 24 16:31:11.337794 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4e87514-cf56-43c9-91cf-2c6abfa258f9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=71939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 24 16:31:11.364138 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.auth.core [None req-f4e87514-cf56-43c9-91cf-2c6abfa258f9 None None] MFA Rules not processed for user `0f2ba2e8375b4e8c8792ee1e22b60427`. Rule list: `[]` (Enabled: `True`). {{(pid=71939) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:442}} Nov 24 16:31:11.365371 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.fernet_utils [None req-f4e87514-cf56-43c9-91cf-2c6abfa258f9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=71939) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:289}} Nov 24 16:31:11.372889 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: [pid: 71939|app: 0|req: 214/428] 10.222.0.53 () {58 vars in 1013 bytes} [Wed Nov 24 16:31:11 2021] POST /identity/v3/auth/tokens => generated 1067 bytes in 37 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 24 16:31:11.396383 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61f35f03-4e0f-4b11-a26b-ad421a5e20d6 None None] REQUEST_METHOD: `POST` {{(pid=71938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 24 16:31:11.396901 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61f35f03-4e0f-4b11-a26b-ad421a5e20d6 None None] SCRIPT_NAME: `/identity` {{(pid=71938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 24 16:31:11.397411 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61f35f03-4e0f-4b11-a26b-ad421a5e20d6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=71938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 24 16:31:11.422527 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.auth.core [None req-61f35f03-4e0f-4b11-a26b-ad421a5e20d6 None None] MFA Rules not processed for user `0f2ba2e8375b4e8c8792ee1e22b60427`. Rule list: `[]` (Enabled: `True`). {{(pid=71938) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:442}} Nov 24 16:31:11.423742 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.fernet_utils [None req-61f35f03-4e0f-4b11-a26b-ad421a5e20d6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=71938) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:289}} Nov 24 16:31:11.430995 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: [pid: 71938|app: 0|req: 215/429] 10.222.0.53 () {58 vars in 1013 bytes} [Wed Nov 24 16:31:11 2021] POST /identity/v3/auth/tokens => generated 1067 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 24 16:31:11.436784 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4e87514-cf56-43c9-91cf-2c6abfa258f9 None None] Authenticating user token {{(pid=71939) process_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 24 16:31:11.453120 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4e87514-cf56-43c9-91cf-2c6abfa258f9 None None] Validating token access rules against request {{(pid=71939) validate_allowed_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 24 16:31:11.458452 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a944e09-0982-4834-a603-923558ed1d86 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f2ba2e8375b4e8c8792ee1e22b60427', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '00a5583c7b7443e98e7a1d31a0b638dc', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=71939) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 24 16:31:11.459267 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a944e09-0982-4834-a603-923558ed1d86 admin admin] REQUEST_METHOD: `GET` {{(pid=71939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 24 16:31:11.459614 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a944e09-0982-4834-a603-923558ed1d86 admin admin] SCRIPT_NAME: `/identity` {{(pid=71939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 24 16:31:11.459955 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a944e09-0982-4834-a603-923558ed1d86 admin admin] PATH_INFO: `/v3/roles/service` {{(pid=71939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 24 16:31:11.471892 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a944e09-0982-4834-a603-923558ed1d86 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=71939) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:401}} Nov 24 16:31:11.479274 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: WARNING keystone.server.flask.application [None req-1a944e09-0982-4834-a603-923558ed1d86 admin admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Nov 24 16:31:11.480454 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: [pid: 71939|app: 0|req: 215/430] 10.222.0.53 () {56 vars in 1114 bytes} [Wed Nov 24 16:31:11 2021] GET /identity/v3/roles/service => generated 85 bytes in 44 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 24 16:31:11.486927 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61f35f03-4e0f-4b11-a26b-ad421a5e20d6 None None] Authenticating user token {{(pid=71938) process_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 24 16:31:11.495971 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61f35f03-4e0f-4b11-a26b-ad421a5e20d6 None None] Validating token access rules against request {{(pid=71938) validate_allowed_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 24 16:31:11.500191 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8989629f-5a91-4335-828d-6ecec94c9e34 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f2ba2e8375b4e8c8792ee1e22b60427', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '00a5583c7b7443e98e7a1d31a0b638dc', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=71938) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 24 16:31:11.500859 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8989629f-5a91-4335-828d-6ecec94c9e34 admin admin] REQUEST_METHOD: `GET` {{(pid=71938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 24 16:31:11.501200 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8989629f-5a91-4335-828d-6ecec94c9e34 admin admin] SCRIPT_NAME: `/identity` {{(pid=71938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 24 16:31:11.501533 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8989629f-5a91-4335-828d-6ecec94c9e34 admin admin] PATH_INFO: `/v3/roles` {{(pid=71938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 24 16:31:11.502879 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8989629f-5a91-4335-828d-6ecec94c9e34 admin admin] RBAC: Adding query filter params (name=service) {{(pid=71938) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:161}} Nov 24 16:31:11.503228 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8989629f-5a91-4335-828d-6ecec94c9e34 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=71938) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:442}} Nov 24 16:31:11.531811 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8989629f-5a91-4335-828d-6ecec94c9e34 admin admin] RBAC: Authorization granted {{(pid=71938) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 24 16:31:11.540635 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: [pid: 71938|app: 0|req: 216/431] 10.222.0.53 () {56 vars in 1115 bytes} [Wed Nov 24 16:31:11 2021] GET /identity/v3/roles?name=service => generated 326 bytes in 54 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 24 16:31:11.546348 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a944e09-0982-4834-a603-923558ed1d86 admin admin] Authenticating user token {{(pid=71939) process_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 24 16:31:11.556772 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a944e09-0982-4834-a603-923558ed1d86 admin admin] Validating token access rules against request {{(pid=71939) validate_allowed_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 24 16:31:11.560969 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a1ab67d-603a-4502-a71c-82b6bc5b9456 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f2ba2e8375b4e8c8792ee1e22b60427', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '00a5583c7b7443e98e7a1d31a0b638dc', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=71939) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 24 16:31:11.561769 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a1ab67d-603a-4502-a71c-82b6bc5b9456 admin admin] REQUEST_METHOD: `GET` {{(pid=71939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 24 16:31:11.562136 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a1ab67d-603a-4502-a71c-82b6bc5b9456 admin admin] SCRIPT_NAME: `/identity` {{(pid=71939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 24 16:31:11.562473 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a1ab67d-603a-4502-a71c-82b6bc5b9456 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=71939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 24 16:31:11.574715 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a1ab67d-603a-4502-a71c-82b6bc5b9456 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=71939) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:442}} Nov 24 16:31:11.603718 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a1ab67d-603a-4502-a71c-82b6bc5b9456 admin admin] RBAC: Authorization granted {{(pid=71939) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 24 16:31:11.622502 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: WARNING keystone.server.flask.application [None req-0a1ab67d-603a-4502-a71c-82b6bc5b9456 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Nov 24 16:31:11.623665 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: [pid: 71939|app: 0|req: 216/432] 10.222.0.53 () {56 vars in 1120 bytes} [Wed Nov 24 16:31:11 2021] GET /identity/v3/domains/Default => generated 87 bytes in 78 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 24 16:31:11.631337 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8989629f-5a91-4335-828d-6ecec94c9e34 admin admin] Authenticating user token {{(pid=71938) process_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 24 16:31:11.641090 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8989629f-5a91-4335-828d-6ecec94c9e34 admin admin] Validating token access rules against request {{(pid=71938) validate_allowed_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 24 16:31:11.645766 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bde23606-ca71-4082-838d-8e995d67f291 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f2ba2e8375b4e8c8792ee1e22b60427', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '00a5583c7b7443e98e7a1d31a0b638dc', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=71938) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 24 16:31:11.646459 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bde23606-ca71-4082-838d-8e995d67f291 admin admin] REQUEST_METHOD: `GET` {{(pid=71938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 24 16:31:11.646796 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bde23606-ca71-4082-838d-8e995d67f291 admin admin] SCRIPT_NAME: `/identity` {{(pid=71938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 24 16:31:11.647128 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bde23606-ca71-4082-838d-8e995d67f291 admin admin] PATH_INFO: `/v3/domains` {{(pid=71938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 24 16:31:11.647899 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bde23606-ca71-4082-838d-8e995d67f291 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=71938) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:161}} Nov 24 16:31:11.648246 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bde23606-ca71-4082-838d-8e995d67f291 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=71938) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:442}} Nov 24 16:31:11.676107 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bde23606-ca71-4082-838d-8e995d67f291 admin admin] RBAC: Authorization granted {{(pid=71938) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 24 16:31:11.690733 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: [pid: 71938|app: 0|req: 217/433] 10.222.0.53 () {56 vars in 1121 bytes} [Wed Nov 24 16:31:11 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 60 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 24 16:31:11.696816 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a1ab67d-603a-4502-a71c-82b6bc5b9456 admin admin] Authenticating user token {{(pid=71939) process_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 24 16:31:11.710638 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a1ab67d-603a-4502-a71c-82b6bc5b9456 admin admin] Validating token access rules against request {{(pid=71939) validate_allowed_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 24 16:31:11.715102 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-436a1b39-1177-484e-b351-71a1f6755c5e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f2ba2e8375b4e8c8792ee1e22b60427', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '00a5583c7b7443e98e7a1d31a0b638dc', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=71939) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 24 16:31:11.715918 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-436a1b39-1177-484e-b351-71a1f6755c5e admin admin] REQUEST_METHOD: `GET` {{(pid=71939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 24 16:31:11.716311 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-436a1b39-1177-484e-b351-71a1f6755c5e admin admin] SCRIPT_NAME: `/identity` {{(pid=71939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 24 16:31:11.716642 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-436a1b39-1177-484e-b351-71a1f6755c5e admin admin] PATH_INFO: `/v3/users/nova` {{(pid=71939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 24 16:31:11.730320 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-436a1b39-1177-484e-b351-71a1f6755c5e admin admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=71939) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:442}} Nov 24 16:31:11.758833 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-436a1b39-1177-484e-b351-71a1f6755c5e admin admin] RBAC: Authorization granted {{(pid=71939) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 24 16:31:11.778624 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: WARNING keystone.server.flask.application [None req-436a1b39-1177-484e-b351-71a1f6755c5e admin admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Nov 24 16:31:11.779791 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: [pid: 71939|app: 0|req: 217/434] 10.222.0.53 () {56 vars in 1105 bytes} [Wed Nov 24 16:31:11 2021] GET /identity/v3/users/nova => generated 82 bytes in 84 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 24 16:31:11.785755 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bde23606-ca71-4082-838d-8e995d67f291 admin admin] Authenticating user token {{(pid=71938) process_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 24 16:31:11.795494 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bde23606-ca71-4082-838d-8e995d67f291 admin admin] Validating token access rules against request {{(pid=71938) validate_allowed_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 24 16:31:11.799804 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da6abf0a-30d8-41f0-8f04-b8dee4910a30 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f2ba2e8375b4e8c8792ee1e22b60427', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '00a5583c7b7443e98e7a1d31a0b638dc', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=71938) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 24 16:31:11.800485 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da6abf0a-30d8-41f0-8f04-b8dee4910a30 admin admin] REQUEST_METHOD: `GET` {{(pid=71938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 24 16:31:11.800846 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da6abf0a-30d8-41f0-8f04-b8dee4910a30 admin admin] SCRIPT_NAME: `/identity` {{(pid=71938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 24 16:31:11.801181 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da6abf0a-30d8-41f0-8f04-b8dee4910a30 admin admin] PATH_INFO: `/v3/users` {{(pid=71938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 24 16:31:11.802115 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da6abf0a-30d8-41f0-8f04-b8dee4910a30 admin admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=71938) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:161}} Nov 24 16:31:11.802476 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da6abf0a-30d8-41f0-8f04-b8dee4910a30 admin admin] RBAC: Authorizing `identity:list_users()` {{(pid=71938) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:442}} Nov 24 16:31:11.831646 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: WARNING py.warnings [None req-da6abf0a-30d8-41f0-8f04-b8dee4910a30 admin admin] /usr/local/lib/python3.6/dist-packages/oslo_policy/policy.py:1018: UserWarning: Policy identity:list_users failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Nov 24 16:31:11.831646 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: warnings.warn(msg) Nov 24 16:31:11.831646 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: Nov 24 16:31:11.832936 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da6abf0a-30d8-41f0-8f04-b8dee4910a30 admin admin] RBAC: Authorization granted {{(pid=71938) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 24 16:31:11.864368 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: [pid: 71938|app: 0|req: 218/435] 10.222.0.53 () {56 vars in 1145 bytes} [Wed Nov 24 16:31:11 2021] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 79 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 24 16:31:11.869987 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-436a1b39-1177-484e-b351-71a1f6755c5e admin admin] Authenticating user token {{(pid=71939) process_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 24 16:31:11.880272 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-436a1b39-1177-484e-b351-71a1f6755c5e admin admin] Validating token access rules against request {{(pid=71939) validate_allowed_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 24 16:31:11.884467 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c663398c-9f00-40d2-a0a6-c198781c2ccc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f2ba2e8375b4e8c8792ee1e22b60427', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '00a5583c7b7443e98e7a1d31a0b638dc', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=71939) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 24 16:31:11.885260 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c663398c-9f00-40d2-a0a6-c198781c2ccc admin admin] REQUEST_METHOD: `GET` {{(pid=71939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 24 16:31:11.885595 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c663398c-9f00-40d2-a0a6-c198781c2ccc admin admin] SCRIPT_NAME: `/identity` {{(pid=71939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 24 16:31:11.885922 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c663398c-9f00-40d2-a0a6-c198781c2ccc admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=71939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 24 16:31:11.898355 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c663398c-9f00-40d2-a0a6-c198781c2ccc admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=71939) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:442}} Nov 24 16:31:11.926807 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c663398c-9f00-40d2-a0a6-c198781c2ccc admin admin] RBAC: Authorization granted {{(pid=71939) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 24 16:31:11.945805 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: WARNING keystone.server.flask.application [None req-c663398c-9f00-40d2-a0a6-c198781c2ccc admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Nov 24 16:31:11.947026 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: [pid: 71939|app: 0|req: 218/436] 10.222.0.53 () {56 vars in 1120 bytes} [Wed Nov 24 16:31:11 2021] GET /identity/v3/domains/Default => generated 87 bytes in 78 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 24 16:31:11.953225 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da6abf0a-30d8-41f0-8f04-b8dee4910a30 admin admin] Authenticating user token {{(pid=71938) process_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 24 16:31:11.966270 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da6abf0a-30d8-41f0-8f04-b8dee4910a30 admin admin] Validating token access rules against request {{(pid=71938) validate_allowed_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 24 16:31:11.970850 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87b1a48e-8455-4094-be9d-68b0aa45380c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f2ba2e8375b4e8c8792ee1e22b60427', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '00a5583c7b7443e98e7a1d31a0b638dc', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=71938) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 24 16:31:11.971514 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87b1a48e-8455-4094-be9d-68b0aa45380c admin admin] REQUEST_METHOD: `GET` {{(pid=71938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 24 16:31:11.971853 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87b1a48e-8455-4094-be9d-68b0aa45380c admin admin] SCRIPT_NAME: `/identity` {{(pid=71938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 24 16:31:11.972185 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87b1a48e-8455-4094-be9d-68b0aa45380c admin admin] PATH_INFO: `/v3/domains` {{(pid=71938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 24 16:31:11.972966 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87b1a48e-8455-4094-be9d-68b0aa45380c admin admin] RBAC: Adding query filter params (name=Default) {{(pid=71938) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:161}} Nov 24 16:31:11.973317 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87b1a48e-8455-4094-be9d-68b0aa45380c admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=71938) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:442}} Nov 24 16:31:12.004624 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87b1a48e-8455-4094-be9d-68b0aa45380c admin admin] RBAC: Authorization granted {{(pid=71938) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 24 16:31:12.018721 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: [pid: 71938|app: 0|req: 219/437] 10.222.0.53 () {56 vars in 1121 bytes} [Wed Nov 24 16:31:11 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 66 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 24 16:31:12.025096 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c663398c-9f00-40d2-a0a6-c198781c2ccc admin admin] Authenticating user token {{(pid=71939) process_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 24 16:31:12.035296 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c663398c-9f00-40d2-a0a6-c198781c2ccc admin admin] Validating token access rules against request {{(pid=71939) validate_allowed_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 24 16:31:12.040035 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae7ec273-8528-4aee-a280-2543cb6bd684 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f2ba2e8375b4e8c8792ee1e22b60427', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '00a5583c7b7443e98e7a1d31a0b638dc', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=71939) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 24 16:31:12.041238 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae7ec273-8528-4aee-a280-2543cb6bd684 admin admin] REQUEST_METHOD: `GET` {{(pid=71939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 24 16:31:12.041583 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae7ec273-8528-4aee-a280-2543cb6bd684 admin admin] SCRIPT_NAME: `/identity` {{(pid=71939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 24 16:31:12.041917 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae7ec273-8528-4aee-a280-2543cb6bd684 admin admin] PATH_INFO: `/v3/projects/service` {{(pid=71939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 24 16:31:12.052455 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae7ec273-8528-4aee-a280-2543cb6bd684 admin admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=71939) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:442}} Nov 24 16:31:12.081849 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae7ec273-8528-4aee-a280-2543cb6bd684 admin admin] RBAC: Authorization granted {{(pid=71939) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 24 16:31:12.097006 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: WARNING keystone.server.flask.application [None req-ae7ec273-8528-4aee-a280-2543cb6bd684 admin admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Nov 24 16:31:12.098204 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: [pid: 71939|app: 0|req: 219/438] 10.222.0.53 () {56 vars in 1123 bytes} [Wed Nov 24 16:31:12 2021] GET /identity/v3/projects/service => generated 88 bytes in 74 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 24 16:31:12.104440 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87b1a48e-8455-4094-be9d-68b0aa45380c admin admin] Authenticating user token {{(pid=71938) process_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 24 16:31:12.114997 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87b1a48e-8455-4094-be9d-68b0aa45380c admin admin] Validating token access rules against request {{(pid=71938) validate_allowed_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 24 16:31:12.119235 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a3fbdd8-370d-4936-8bd7-93115e69160a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f2ba2e8375b4e8c8792ee1e22b60427', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '00a5583c7b7443e98e7a1d31a0b638dc', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=71938) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 24 16:31:12.119896 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a3fbdd8-370d-4936-8bd7-93115e69160a admin admin] REQUEST_METHOD: `GET` {{(pid=71938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 24 16:31:12.120239 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a3fbdd8-370d-4936-8bd7-93115e69160a admin admin] SCRIPT_NAME: `/identity` {{(pid=71938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 24 16:31:12.120734 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a3fbdd8-370d-4936-8bd7-93115e69160a admin admin] PATH_INFO: `/v3/projects` {{(pid=71938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 24 16:31:12.121580 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a3fbdd8-370d-4936-8bd7-93115e69160a admin admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=71938) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:161}} Nov 24 16:31:12.121937 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a3fbdd8-370d-4936-8bd7-93115e69160a admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=71938) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:442}} Nov 24 16:31:12.151244 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a3fbdd8-370d-4936-8bd7-93115e69160a admin admin] RBAC: Authorization granted {{(pid=71938) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 24 16:31:12.165001 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: [pid: 71938|app: 0|req: 220/439] 10.222.0.53 () {56 vars in 1160 bytes} [Wed Nov 24 16:31:12 2021] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 61 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 24 16:31:12.170883 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae7ec273-8528-4aee-a280-2543cb6bd684 admin admin] Authenticating user token {{(pid=71939) process_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 24 16:31:12.181222 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae7ec273-8528-4aee-a280-2543cb6bd684 admin admin] Validating token access rules against request {{(pid=71939) validate_allowed_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 24 16:31:12.185530 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb1dbc25-e0bd-4939-80f4-fe32bd5e20c3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f2ba2e8375b4e8c8792ee1e22b60427', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '00a5583c7b7443e98e7a1d31a0b638dc', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=71939) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 24 16:31:12.186476 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb1dbc25-e0bd-4939-80f4-fe32bd5e20c3 admin admin] REQUEST_METHOD: `PUT` {{(pid=71939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 24 16:31:12.186816 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb1dbc25-e0bd-4939-80f4-fe32bd5e20c3 admin admin] SCRIPT_NAME: `/identity` {{(pid=71939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 24 16:31:12.187151 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb1dbc25-e0bd-4939-80f4-fe32bd5e20c3 admin admin] PATH_INFO: `/v3/projects/3b3940d4ae1c4177ae29c02377bb4b0b/users/3e196802d4d5432482b6d2eabc25f74e/roles/2d4a51004ce34308a7a33e68bf2cfc74` {{(pid=71939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 24 16:31:12.210166 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb1dbc25-e0bd-4939-80f4-fe32bd5e20c3 admin admin] RBAC: Authorizing `identity:create_grant(project_id=3b3940d4ae1c4177ae29c02377bb4b0b, user_id=3e196802d4d5432482b6d2eabc25f74e, role_id=2d4a51004ce34308a7a33e68bf2cfc74)` {{(pid=71939) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:442}} Nov 24 16:31:12.240320 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb1dbc25-e0bd-4939-80f4-fe32bd5e20c3 admin admin] RBAC: Authorization granted {{(pid=71939) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 24 16:31:12.251641 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: [pid: 71939|app: 0|req: 220/440] 10.222.0.53 () {58 vars in 1451 bytes} [Wed Nov 24 16:31:12 2021] PUT /identity/v3/projects/3b3940d4ae1c4177ae29c02377bb4b0b/users/3e196802d4d5432482b6d2eabc25f74e/roles/2d4a51004ce34308a7a33e68bf2cfc74 => generated 0 bytes in 81 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 24 16:31:14.236734 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fcef070-ce5a-48f7-b8c1-93a708e482d5 None None] REQUEST_METHOD: `GET` {{(pid=71938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 24 16:31:14.237240 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fcef070-ce5a-48f7-b8c1-93a708e482d5 None None] SCRIPT_NAME: `/identity` {{(pid=71938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 24 16:31:14.237505 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fcef070-ce5a-48f7-b8c1-93a708e482d5 None None] PATH_INFO: `/` {{(pid=71938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 24 16:31:14.239438 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: [pid: 71938|app: 0|req: 221/441] 10.222.0.53 () {54 vars in 915 bytes} [Wed Nov 24 16:31:14 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 24 16:31:14.245036 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae9706d6-cf76-41f4-bc4c-037030db7d96 None None] REQUEST_METHOD: `POST` {{(pid=71939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 24 16:31:14.245390 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae9706d6-cf76-41f4-bc4c-037030db7d96 None None] SCRIPT_NAME: `/identity` {{(pid=71939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 24 16:31:14.245731 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae9706d6-cf76-41f4-bc4c-037030db7d96 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=71939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 24 16:31:14.271993 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.auth.core [None req-ae9706d6-cf76-41f4-bc4c-037030db7d96 None None] MFA Rules not processed for user `0f2ba2e8375b4e8c8792ee1e22b60427`. Rule list: `[]` (Enabled: `True`). {{(pid=71939) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:442}} Nov 24 16:31:14.273215 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.fernet_utils [None req-ae9706d6-cf76-41f4-bc4c-037030db7d96 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=71939) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:289}} Nov 24 16:31:14.341863 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: [pid: 71939|app: 0|req: 221/442] 10.222.0.53 () {58 vars in 1013 bytes} [Wed Nov 24 16:31:14 2021] POST /identity/v3/auth/tokens => generated 1067 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 24 16:31:14.364585 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8837e27a-939e-46f8-a776-718c7a9bb472 None None] REQUEST_METHOD: `POST` {{(pid=71938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 24 16:31:14.364934 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8837e27a-939e-46f8-a776-718c7a9bb472 None None] SCRIPT_NAME: `/identity` {{(pid=71938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 24 16:31:14.365272 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8837e27a-939e-46f8-a776-718c7a9bb472 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=71938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 24 16:31:14.390392 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.auth.core [None req-8837e27a-939e-46f8-a776-718c7a9bb472 None None] MFA Rules not processed for user `0f2ba2e8375b4e8c8792ee1e22b60427`. Rule list: `[]` (Enabled: `True`). {{(pid=71938) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:442}} Nov 24 16:31:14.391610 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.fernet_utils [None req-8837e27a-939e-46f8-a776-718c7a9bb472 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=71938) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:289}} Nov 24 16:31:14.399807 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: [pid: 71938|app: 0|req: 222/443] 10.222.0.53 () {58 vars in 1013 bytes} [Wed Nov 24 16:31:14 2021] POST /identity/v3/auth/tokens => generated 1067 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 24 16:31:14.406447 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae9706d6-cf76-41f4-bc4c-037030db7d96 None None] Authenticating user token {{(pid=71939) process_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 24 16:31:14.418321 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae9706d6-cf76-41f4-bc4c-037030db7d96 None None] Validating token access rules against request {{(pid=71939) validate_allowed_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 24 16:31:14.423299 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b411bfd-ed1d-4faf-9bcc-d7b2b2af15fb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f2ba2e8375b4e8c8792ee1e22b60427', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '00a5583c7b7443e98e7a1d31a0b638dc', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=71939) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 24 16:31:14.424714 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b411bfd-ed1d-4faf-9bcc-d7b2b2af15fb admin admin] REQUEST_METHOD: `GET` {{(pid=71939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 24 16:31:14.425328 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b411bfd-ed1d-4faf-9bcc-d7b2b2af15fb admin admin] SCRIPT_NAME: `/identity` {{(pid=71939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 24 16:31:14.425685 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b411bfd-ed1d-4faf-9bcc-d7b2b2af15fb admin admin] PATH_INFO: `/v3/roles/service` {{(pid=71939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 24 16:31:14.438383 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b411bfd-ed1d-4faf-9bcc-d7b2b2af15fb admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=71939) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:401}} Nov 24 16:31:14.449145 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: WARNING keystone.server.flask.application [None req-7b411bfd-ed1d-4faf-9bcc-d7b2b2af15fb admin admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Nov 24 16:31:14.450404 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: [pid: 71939|app: 0|req: 222/444] 10.222.0.53 () {56 vars in 1114 bytes} [Wed Nov 24 16:31:14 2021] GET /identity/v3/roles/service => generated 85 bytes in 45 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 24 16:31:14.457861 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8837e27a-939e-46f8-a776-718c7a9bb472 None None] Authenticating user token {{(pid=71938) process_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 24 16:31:14.469153 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8837e27a-939e-46f8-a776-718c7a9bb472 None None] Validating token access rules against request {{(pid=71938) validate_allowed_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 24 16:31:14.474061 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bab9879d-55a5-4fa8-bd8f-3bdbd8082101 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f2ba2e8375b4e8c8792ee1e22b60427', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '00a5583c7b7443e98e7a1d31a0b638dc', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=71938) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 24 16:31:14.474748 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bab9879d-55a5-4fa8-bd8f-3bdbd8082101 admin admin] REQUEST_METHOD: `GET` {{(pid=71938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 24 16:31:14.475088 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bab9879d-55a5-4fa8-bd8f-3bdbd8082101 admin admin] SCRIPT_NAME: `/identity` {{(pid=71938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 24 16:31:14.475423 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bab9879d-55a5-4fa8-bd8f-3bdbd8082101 admin admin] PATH_INFO: `/v3/roles` {{(pid=71938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 24 16:31:14.476233 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bab9879d-55a5-4fa8-bd8f-3bdbd8082101 admin admin] RBAC: Adding query filter params (name=service) {{(pid=71938) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:161}} Nov 24 16:31:14.476587 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bab9879d-55a5-4fa8-bd8f-3bdbd8082101 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=71938) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:442}} Nov 24 16:31:14.513936 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bab9879d-55a5-4fa8-bd8f-3bdbd8082101 admin admin] RBAC: Authorization granted {{(pid=71938) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 24 16:31:14.528767 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: [pid: 71938|app: 0|req: 223/445] 10.222.0.53 () {56 vars in 1115 bytes} [Wed Nov 24 16:31:14 2021] GET /identity/v3/roles?name=service => generated 326 bytes in 71 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 24 16:31:14.534673 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b411bfd-ed1d-4faf-9bcc-d7b2b2af15fb admin admin] Authenticating user token {{(pid=71939) process_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 24 16:31:14.545324 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b411bfd-ed1d-4faf-9bcc-d7b2b2af15fb admin admin] Validating token access rules against request {{(pid=71939) validate_allowed_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 24 16:31:14.549996 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2ac5124-a403-4d8d-b4b4-e8803f628126 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f2ba2e8375b4e8c8792ee1e22b60427', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '00a5583c7b7443e98e7a1d31a0b638dc', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=71939) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 24 16:31:14.550833 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2ac5124-a403-4d8d-b4b4-e8803f628126 admin admin] REQUEST_METHOD: `GET` {{(pid=71939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 24 16:31:14.551170 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2ac5124-a403-4d8d-b4b4-e8803f628126 admin admin] SCRIPT_NAME: `/identity` {{(pid=71939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 24 16:31:14.551497 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2ac5124-a403-4d8d-b4b4-e8803f628126 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=71939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 24 16:31:14.563426 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2ac5124-a403-4d8d-b4b4-e8803f628126 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=71939) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:442}} Nov 24 16:31:14.593784 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2ac5124-a403-4d8d-b4b4-e8803f628126 admin admin] RBAC: Authorization granted {{(pid=71939) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 24 16:31:14.613376 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: WARNING keystone.server.flask.application [None req-f2ac5124-a403-4d8d-b4b4-e8803f628126 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Nov 24 16:31:14.614643 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: [pid: 71939|app: 0|req: 223/446] 10.222.0.53 () {56 vars in 1120 bytes} [Wed Nov 24 16:31:14 2021] GET /identity/v3/domains/Default => generated 87 bytes in 81 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 24 16:31:14.620673 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bab9879d-55a5-4fa8-bd8f-3bdbd8082101 admin admin] Authenticating user token {{(pid=71938) process_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 24 16:31:14.631659 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bab9879d-55a5-4fa8-bd8f-3bdbd8082101 admin admin] Validating token access rules against request {{(pid=71938) validate_allowed_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 24 16:31:14.635920 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0eba96a1-2bc8-470f-97b9-60ce42b471b7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f2ba2e8375b4e8c8792ee1e22b60427', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '00a5583c7b7443e98e7a1d31a0b638dc', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=71938) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 24 16:31:14.636584 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0eba96a1-2bc8-470f-97b9-60ce42b471b7 admin admin] REQUEST_METHOD: `GET` {{(pid=71938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 24 16:31:14.636922 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0eba96a1-2bc8-470f-97b9-60ce42b471b7 admin admin] SCRIPT_NAME: `/identity` {{(pid=71938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 24 16:31:14.637253 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0eba96a1-2bc8-470f-97b9-60ce42b471b7 admin admin] PATH_INFO: `/v3/domains` {{(pid=71938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 24 16:31:14.638076 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0eba96a1-2bc8-470f-97b9-60ce42b471b7 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=71938) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:161}} Nov 24 16:31:14.638403 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0eba96a1-2bc8-470f-97b9-60ce42b471b7 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=71938) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:442}} Nov 24 16:31:14.667730 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0eba96a1-2bc8-470f-97b9-60ce42b471b7 admin admin] RBAC: Authorization granted {{(pid=71938) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 24 16:31:14.681678 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: [pid: 71938|app: 0|req: 224/447] 10.222.0.53 () {56 vars in 1121 bytes} [Wed Nov 24 16:31:14 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 62 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 24 16:31:14.687521 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2ac5124-a403-4d8d-b4b4-e8803f628126 admin admin] Authenticating user token {{(pid=71939) process_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 24 16:31:14.698386 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2ac5124-a403-4d8d-b4b4-e8803f628126 admin admin] Validating token access rules against request {{(pid=71939) validate_allowed_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 24 16:31:14.702600 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f8d68fb-610d-4d17-99a8-005d7061651b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f2ba2e8375b4e8c8792ee1e22b60427', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '00a5583c7b7443e98e7a1d31a0b638dc', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=71939) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 24 16:31:14.703669 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f8d68fb-610d-4d17-99a8-005d7061651b admin admin] REQUEST_METHOD: `GET` {{(pid=71939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 24 16:31:14.704008 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f8d68fb-610d-4d17-99a8-005d7061651b admin admin] SCRIPT_NAME: `/identity` {{(pid=71939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 24 16:31:14.704343 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f8d68fb-610d-4d17-99a8-005d7061651b admin admin] PATH_INFO: `/v3/users/nova` {{(pid=71939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 24 16:31:14.721986 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f8d68fb-610d-4d17-99a8-005d7061651b admin admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=71939) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:442}} Nov 24 16:31:14.754672 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f8d68fb-610d-4d17-99a8-005d7061651b admin admin] RBAC: Authorization granted {{(pid=71939) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 24 16:31:14.775073 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: WARNING keystone.server.flask.application [None req-5f8d68fb-610d-4d17-99a8-005d7061651b admin admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Nov 24 16:31:14.776371 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: [pid: 71939|app: 0|req: 224/448] 10.222.0.53 () {56 vars in 1105 bytes} [Wed Nov 24 16:31:14 2021] GET /identity/v3/users/nova => generated 82 bytes in 89 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 24 16:31:14.782474 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0eba96a1-2bc8-470f-97b9-60ce42b471b7 admin admin] Authenticating user token {{(pid=71938) process_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 24 16:31:14.792435 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0eba96a1-2bc8-470f-97b9-60ce42b471b7 admin admin] Validating token access rules against request {{(pid=71938) validate_allowed_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 24 16:31:14.796866 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5755614a-265d-4d06-85a7-15bf08c5d3b2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f2ba2e8375b4e8c8792ee1e22b60427', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '00a5583c7b7443e98e7a1d31a0b638dc', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=71938) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 24 16:31:14.797539 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5755614a-265d-4d06-85a7-15bf08c5d3b2 admin admin] REQUEST_METHOD: `GET` {{(pid=71938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 24 16:31:14.797876 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5755614a-265d-4d06-85a7-15bf08c5d3b2 admin admin] SCRIPT_NAME: `/identity` {{(pid=71938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 24 16:31:14.798277 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5755614a-265d-4d06-85a7-15bf08c5d3b2 admin admin] PATH_INFO: `/v3/users` {{(pid=71938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 24 16:31:14.799182 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5755614a-265d-4d06-85a7-15bf08c5d3b2 admin admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=71938) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:161}} Nov 24 16:31:14.799538 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5755614a-265d-4d06-85a7-15bf08c5d3b2 admin admin] RBAC: Authorizing `identity:list_users()` {{(pid=71938) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:442}} Nov 24 16:31:14.828854 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5755614a-265d-4d06-85a7-15bf08c5d3b2 admin admin] RBAC: Authorization granted {{(pid=71938) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 24 16:31:14.860627 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: [pid: 71938|app: 0|req: 225/449] 10.222.0.53 () {56 vars in 1145 bytes} [Wed Nov 24 16:31:14 2021] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 79 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 24 16:31:14.867070 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f8d68fb-610d-4d17-99a8-005d7061651b admin admin] Authenticating user token {{(pid=71939) process_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 24 16:31:14.878430 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f8d68fb-610d-4d17-99a8-005d7061651b admin admin] Validating token access rules against request {{(pid=71939) validate_allowed_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 24 16:31:14.882684 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8740e8aa-52bf-492b-98ce-f12e9306a6a1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f2ba2e8375b4e8c8792ee1e22b60427', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '00a5583c7b7443e98e7a1d31a0b638dc', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=71939) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 24 16:31:14.883327 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8740e8aa-52bf-492b-98ce-f12e9306a6a1 admin admin] REQUEST_METHOD: `GET` {{(pid=71939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 24 16:31:14.883662 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8740e8aa-52bf-492b-98ce-f12e9306a6a1 admin admin] SCRIPT_NAME: `/identity` {{(pid=71939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 24 16:31:14.883995 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8740e8aa-52bf-492b-98ce-f12e9306a6a1 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=71939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 24 16:31:14.892481 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8740e8aa-52bf-492b-98ce-f12e9306a6a1 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=71939) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:442}} Nov 24 16:31:14.922043 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8740e8aa-52bf-492b-98ce-f12e9306a6a1 admin admin] RBAC: Authorization granted {{(pid=71939) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 24 16:31:14.932497 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: [pid: 71939|app: 0|req: 225/450] 10.222.0.53 () {58 vars in 1315 bytes} [Wed Nov 24 16:31:14 2021] GET /identity/v3/auth/tokens => generated 1067 bytes in 66 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 24 16:31:14.938439 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5755614a-265d-4d06-85a7-15bf08c5d3b2 admin admin] Authenticating user token {{(pid=71938) process_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 24 16:31:14.948930 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5755614a-265d-4d06-85a7-15bf08c5d3b2 admin admin] Validating token access rules against request {{(pid=71938) validate_allowed_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 24 16:31:14.953442 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-407dcb65-5995-4f4b-99e1-d6415570c88c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f2ba2e8375b4e8c8792ee1e22b60427', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '00a5583c7b7443e98e7a1d31a0b638dc', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=71938) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 24 16:31:14.954422 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-407dcb65-5995-4f4b-99e1-d6415570c88c admin admin] REQUEST_METHOD: `GET` {{(pid=71938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 24 16:31:14.954764 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-407dcb65-5995-4f4b-99e1-d6415570c88c admin admin] SCRIPT_NAME: `/identity` {{(pid=71938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 24 16:31:14.955098 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-407dcb65-5995-4f4b-99e1-d6415570c88c admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=71938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 24 16:31:14.967512 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-407dcb65-5995-4f4b-99e1-d6415570c88c admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=71938) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:442}} Nov 24 16:31:14.997095 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-407dcb65-5995-4f4b-99e1-d6415570c88c admin admin] RBAC: Authorization granted {{(pid=71938) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 24 16:31:15.017109 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: WARNING keystone.server.flask.application [None req-407dcb65-5995-4f4b-99e1-d6415570c88c admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Nov 24 16:31:15.018368 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: [pid: 71938|app: 0|req: 226/451] 10.222.0.53 () {56 vars in 1120 bytes} [Wed Nov 24 16:31:14 2021] GET /identity/v3/domains/Default => generated 87 bytes in 81 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 24 16:31:15.025732 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8740e8aa-52bf-492b-98ce-f12e9306a6a1 admin admin] Authenticating user token {{(pid=71939) process_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 24 16:31:15.035754 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8740e8aa-52bf-492b-98ce-f12e9306a6a1 admin admin] Validating token access rules against request {{(pid=71939) validate_allowed_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 24 16:31:15.040071 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-728c045b-5e7f-41fa-8b07-f3107dfe0d4b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f2ba2e8375b4e8c8792ee1e22b60427', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '00a5583c7b7443e98e7a1d31a0b638dc', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=71939) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 24 16:31:15.040784 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-728c045b-5e7f-41fa-8b07-f3107dfe0d4b admin admin] REQUEST_METHOD: `GET` {{(pid=71939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 24 16:31:15.041133 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-728c045b-5e7f-41fa-8b07-f3107dfe0d4b admin admin] SCRIPT_NAME: `/identity` {{(pid=71939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 24 16:31:15.041472 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-728c045b-5e7f-41fa-8b07-f3107dfe0d4b admin admin] PATH_INFO: `/v3/domains` {{(pid=71939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 24 16:31:15.042285 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-728c045b-5e7f-41fa-8b07-f3107dfe0d4b admin admin] RBAC: Adding query filter params (name=Default) {{(pid=71939) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:161}} Nov 24 16:31:15.042797 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-728c045b-5e7f-41fa-8b07-f3107dfe0d4b admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=71939) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:442}} Nov 24 16:31:15.071666 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-728c045b-5e7f-41fa-8b07-f3107dfe0d4b admin admin] RBAC: Authorization granted {{(pid=71939) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 24 16:31:15.085422 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: [pid: 71939|app: 0|req: 226/452] 10.222.0.53 () {56 vars in 1121 bytes} [Wed Nov 24 16:31:15 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 60 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 24 16:31:15.091185 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-407dcb65-5995-4f4b-99e1-d6415570c88c admin admin] Authenticating user token {{(pid=71938) process_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 24 16:31:15.100961 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-407dcb65-5995-4f4b-99e1-d6415570c88c admin admin] Validating token access rules against request {{(pid=71938) validate_allowed_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 24 16:31:15.105114 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dcbcc42-b04d-405d-86ad-6903dfa40679 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f2ba2e8375b4e8c8792ee1e22b60427', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '00a5583c7b7443e98e7a1d31a0b638dc', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=71938) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 24 16:31:15.105909 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dcbcc42-b04d-405d-86ad-6903dfa40679 admin admin] REQUEST_METHOD: `GET` {{(pid=71938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 24 16:31:15.106296 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dcbcc42-b04d-405d-86ad-6903dfa40679 admin admin] SCRIPT_NAME: `/identity` {{(pid=71938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 24 16:31:15.106623 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dcbcc42-b04d-405d-86ad-6903dfa40679 admin admin] PATH_INFO: `/v3/projects/service` {{(pid=71938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 24 16:31:15.116328 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6dcbcc42-b04d-405d-86ad-6903dfa40679 admin admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=71938) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:442}} Nov 24 16:31:15.145257 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6dcbcc42-b04d-405d-86ad-6903dfa40679 admin admin] RBAC: Authorization granted {{(pid=71938) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 24 16:31:15.161006 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: WARNING keystone.server.flask.application [None req-6dcbcc42-b04d-405d-86ad-6903dfa40679 admin admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Nov 24 16:31:15.162167 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: [pid: 71938|app: 0|req: 227/453] 10.222.0.53 () {56 vars in 1123 bytes} [Wed Nov 24 16:31:15 2021] GET /identity/v3/projects/service => generated 88 bytes in 71 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 24 16:31:15.168029 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-728c045b-5e7f-41fa-8b07-f3107dfe0d4b admin admin] Authenticating user token {{(pid=71939) process_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 24 16:31:15.178492 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-728c045b-5e7f-41fa-8b07-f3107dfe0d4b admin admin] Validating token access rules against request {{(pid=71939) validate_allowed_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 24 16:31:15.182700 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9227cb6-6e3b-4bcb-baef-aec7ee6effc4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f2ba2e8375b4e8c8792ee1e22b60427', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '00a5583c7b7443e98e7a1d31a0b638dc', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=71939) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 24 16:31:15.183366 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9227cb6-6e3b-4bcb-baef-aec7ee6effc4 admin admin] REQUEST_METHOD: `GET` {{(pid=71939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 24 16:31:15.183704 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9227cb6-6e3b-4bcb-baef-aec7ee6effc4 admin admin] SCRIPT_NAME: `/identity` {{(pid=71939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 24 16:31:15.184045 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9227cb6-6e3b-4bcb-baef-aec7ee6effc4 admin admin] PATH_INFO: `/v3/projects` {{(pid=71939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 24 16:31:15.184911 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9227cb6-6e3b-4bcb-baef-aec7ee6effc4 admin admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=71939) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:161}} Nov 24 16:31:15.185259 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9227cb6-6e3b-4bcb-baef-aec7ee6effc4 admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=71939) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:442}} Nov 24 16:31:15.213527 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: WARNING py.warnings [None req-a9227cb6-6e3b-4bcb-baef-aec7ee6effc4 admin admin] /usr/local/lib/python3.6/dist-packages/oslo_policy/policy.py:1018: UserWarning: Policy identity:list_projects failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Nov 24 16:31:15.213527 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: warnings.warn(msg) Nov 24 16:31:15.213527 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: Nov 24 16:31:15.214773 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9227cb6-6e3b-4bcb-baef-aec7ee6effc4 admin admin] RBAC: Authorization granted {{(pid=71939) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 24 16:31:15.229150 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: [pid: 71939|app: 0|req: 227/454] 10.222.0.53 () {56 vars in 1160 bytes} [Wed Nov 24 16:31:15 2021] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 62 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 24 16:31:15.235306 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dcbcc42-b04d-405d-86ad-6903dfa40679 admin admin] Authenticating user token {{(pid=71938) process_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 24 16:31:15.245717 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dcbcc42-b04d-405d-86ad-6903dfa40679 admin admin] Validating token access rules against request {{(pid=71938) validate_allowed_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 24 16:31:15.249970 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f696b0e5-33ad-4e8f-bba8-9b69cc62f265 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f2ba2e8375b4e8c8792ee1e22b60427', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '00a5583c7b7443e98e7a1d31a0b638dc', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=71938) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 24 16:31:15.250609 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f696b0e5-33ad-4e8f-bba8-9b69cc62f265 admin admin] REQUEST_METHOD: `GET` {{(pid=71938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 24 16:31:15.250953 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f696b0e5-33ad-4e8f-bba8-9b69cc62f265 admin admin] SCRIPT_NAME: `/identity` {{(pid=71938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 24 16:31:15.251289 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f696b0e5-33ad-4e8f-bba8-9b69cc62f265 admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=71938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 24 16:31:15.252175 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f696b0e5-33ad-4e8f-bba8-9b69cc62f265 admin admin] RBAC: Adding query filter params (role.id=2d4a51004ce34308a7a33e68bf2cfc74, scope.project.id=3b3940d4ae1c4177ae29c02377bb4b0b, user.id=3e196802d4d5432482b6d2eabc25f74e) {{(pid=71938) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:161}} Nov 24 16:31:15.252538 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f696b0e5-33ad-4e8f-bba8-9b69cc62f265 admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=71938) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:442}} Nov 24 16:31:15.280812 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f696b0e5-33ad-4e8f-bba8-9b69cc62f265 admin admin] RBAC: Authorization granted {{(pid=71938) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 24 16:31:15.287373 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: [pid: 71938|app: 0|req: 228/455] 10.222.0.53 () {56 vars in 1386 bytes} [Wed Nov 24 16:31:15 2021] GET /identity/v3/role_assignments?user.id=3e196802d4d5432482b6d2eabc25f74e&scope.project.id=3b3940d4ae1c4177ae29c02377bb4b0b&role.id=2d4a51004ce34308a7a33e68bf2cfc74 => generated 608 bytes in 53 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 24 16:31:17.321176 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c84578af-7809-411e-a160-7640bfb6333c None None] REQUEST_METHOD: `GET` {{(pid=71939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 24 16:31:17.321692 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c84578af-7809-411e-a160-7640bfb6333c None None] SCRIPT_NAME: `/identity` {{(pid=71939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 24 16:31:17.321852 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c84578af-7809-411e-a160-7640bfb6333c None None] PATH_INFO: `/` {{(pid=71939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 24 16:31:17.323722 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: [pid: 71939|app: 0|req: 228/456] 10.222.0.53 () {54 vars in 915 bytes} [Wed Nov 24 16:31:17 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 24 16:31:17.330558 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de9331ac-6972-4c38-941f-a27e5ec4035b None None] REQUEST_METHOD: `POST` {{(pid=71938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 24 16:31:17.330910 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de9331ac-6972-4c38-941f-a27e5ec4035b None None] SCRIPT_NAME: `/identity` {{(pid=71938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 24 16:31:17.331249 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de9331ac-6972-4c38-941f-a27e5ec4035b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=71938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 24 16:31:17.355196 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.auth.core [None req-de9331ac-6972-4c38-941f-a27e5ec4035b None None] MFA Rules not processed for user `0f2ba2e8375b4e8c8792ee1e22b60427`. Rule list: `[]` (Enabled: `True`). {{(pid=71938) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:442}} Nov 24 16:31:17.356422 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.fernet_utils [None req-de9331ac-6972-4c38-941f-a27e5ec4035b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=71938) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:289}} Nov 24 16:31:17.363603 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: [pid: 71938|app: 0|req: 229/457] 10.222.0.53 () {58 vars in 1013 bytes} [Wed Nov 24 16:31:17 2021] POST /identity/v3/auth/tokens => generated 1067 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 24 16:31:17.385599 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af71f624-86e1-4be5-938a-ec9dbf686fe9 None None] REQUEST_METHOD: `POST` {{(pid=71939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 24 16:31:17.385944 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af71f624-86e1-4be5-938a-ec9dbf686fe9 None None] SCRIPT_NAME: `/identity` {{(pid=71939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 24 16:31:17.386329 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af71f624-86e1-4be5-938a-ec9dbf686fe9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=71939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 24 16:31:17.411008 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.auth.core [None req-af71f624-86e1-4be5-938a-ec9dbf686fe9 None None] MFA Rules not processed for user `0f2ba2e8375b4e8c8792ee1e22b60427`. Rule list: `[]` (Enabled: `True`). {{(pid=71939) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:442}} Nov 24 16:31:17.412210 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.fernet_utils [None req-af71f624-86e1-4be5-938a-ec9dbf686fe9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=71939) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:289}} Nov 24 16:31:17.419448 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: [pid: 71939|app: 0|req: 229/458] 10.222.0.53 () {58 vars in 1013 bytes} [Wed Nov 24 16:31:17 2021] POST /identity/v3/auth/tokens => generated 1067 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 24 16:31:17.424855 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de9331ac-6972-4c38-941f-a27e5ec4035b None None] Authenticating user token {{(pid=71938) process_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 24 16:31:17.434419 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de9331ac-6972-4c38-941f-a27e5ec4035b None None] Validating token access rules against request {{(pid=71938) validate_allowed_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 24 16:31:17.438579 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f9e7510-f17b-4ce5-b517-7d2d5321e017 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f2ba2e8375b4e8c8792ee1e22b60427', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '00a5583c7b7443e98e7a1d31a0b638dc', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=71938) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 24 16:31:17.439917 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f9e7510-f17b-4ce5-b517-7d2d5321e017 admin admin] REQUEST_METHOD: `GET` {{(pid=71938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 24 16:31:17.440259 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f9e7510-f17b-4ce5-b517-7d2d5321e017 admin admin] SCRIPT_NAME: `/identity` {{(pid=71938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 24 16:31:17.440594 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f9e7510-f17b-4ce5-b517-7d2d5321e017 admin admin] PATH_INFO: `/v3/roles/admin` {{(pid=71938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 24 16:31:17.452298 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f9e7510-f17b-4ce5-b517-7d2d5321e017 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=71938) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:401}} Nov 24 16:31:17.460520 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: WARNING keystone.server.flask.application [None req-0f9e7510-f17b-4ce5-b517-7d2d5321e017 admin admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Nov 24 16:31:17.461686 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: [pid: 71938|app: 0|req: 230/459] 10.222.0.53 () {56 vars in 1108 bytes} [Wed Nov 24 16:31:17 2021] GET /identity/v3/roles/admin => generated 83 bytes in 37 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 24 16:31:17.467725 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af71f624-86e1-4be5-938a-ec9dbf686fe9 None None] Authenticating user token {{(pid=71939) process_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 24 16:31:17.476501 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af71f624-86e1-4be5-938a-ec9dbf686fe9 None None] Validating token access rules against request {{(pid=71939) validate_allowed_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 24 16:31:17.480594 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4085cee0-e4a5-481f-993a-0a3df33d668c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f2ba2e8375b4e8c8792ee1e22b60427', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '00a5583c7b7443e98e7a1d31a0b638dc', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=71939) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 24 16:31:17.481242 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4085cee0-e4a5-481f-993a-0a3df33d668c admin admin] REQUEST_METHOD: `GET` {{(pid=71939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 24 16:31:17.481580 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4085cee0-e4a5-481f-993a-0a3df33d668c admin admin] SCRIPT_NAME: `/identity` {{(pid=71939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 24 16:31:17.481908 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4085cee0-e4a5-481f-993a-0a3df33d668c admin admin] PATH_INFO: `/v3/roles` {{(pid=71939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 24 16:31:17.482747 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4085cee0-e4a5-481f-993a-0a3df33d668c admin admin] RBAC: Adding query filter params (name=admin) {{(pid=71939) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:161}} Nov 24 16:31:17.483094 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4085cee0-e4a5-481f-993a-0a3df33d668c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=71939) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:442}} Nov 24 16:31:17.511292 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4085cee0-e4a5-481f-993a-0a3df33d668c admin admin] RBAC: Authorization granted {{(pid=71939) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 24 16:31:17.520722 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: [pid: 71939|app: 0|req: 230/460] 10.222.0.53 () {56 vars in 1111 bytes} [Wed Nov 24 16:31:17 2021] GET /identity/v3/roles?name=admin => generated 339 bytes in 53 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 24 16:31:17.526305 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f9e7510-f17b-4ce5-b517-7d2d5321e017 admin admin] Authenticating user token {{(pid=71938) process_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 24 16:31:17.536658 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f9e7510-f17b-4ce5-b517-7d2d5321e017 admin admin] Validating token access rules against request {{(pid=71938) validate_allowed_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 24 16:31:17.540865 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5414b727-0c11-49bd-9b71-58778302227d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f2ba2e8375b4e8c8792ee1e22b60427', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '00a5583c7b7443e98e7a1d31a0b638dc', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=71938) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 24 16:31:17.541658 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5414b727-0c11-49bd-9b71-58778302227d admin admin] REQUEST_METHOD: `GET` {{(pid=71938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 24 16:31:17.542058 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5414b727-0c11-49bd-9b71-58778302227d admin admin] SCRIPT_NAME: `/identity` {{(pid=71938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 24 16:31:17.542515 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5414b727-0c11-49bd-9b71-58778302227d admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=71938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 24 16:31:17.554194 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5414b727-0c11-49bd-9b71-58778302227d admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=71938) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:442}} Nov 24 16:31:17.583938 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5414b727-0c11-49bd-9b71-58778302227d admin admin] RBAC: Authorization granted {{(pid=71938) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 24 16:31:17.603220 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: WARNING keystone.server.flask.application [None req-5414b727-0c11-49bd-9b71-58778302227d admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Nov 24 16:31:17.604404 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: [pid: 71938|app: 0|req: 231/461] 10.222.0.53 () {56 vars in 1120 bytes} [Wed Nov 24 16:31:17 2021] GET /identity/v3/domains/Default => generated 87 bytes in 79 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 24 16:31:17.610286 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4085cee0-e4a5-481f-993a-0a3df33d668c admin admin] Authenticating user token {{(pid=71939) process_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 24 16:31:17.620054 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4085cee0-e4a5-481f-993a-0a3df33d668c admin admin] Validating token access rules against request {{(pid=71939) validate_allowed_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 24 16:31:17.624605 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ba7d6d1-2906-4dfc-b1d7-c3e9e3fd99dd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f2ba2e8375b4e8c8792ee1e22b60427', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '00a5583c7b7443e98e7a1d31a0b638dc', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=71939) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 24 16:31:17.625266 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ba7d6d1-2906-4dfc-b1d7-c3e9e3fd99dd admin admin] REQUEST_METHOD: `GET` {{(pid=71939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 24 16:31:17.625610 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ba7d6d1-2906-4dfc-b1d7-c3e9e3fd99dd admin admin] SCRIPT_NAME: `/identity` {{(pid=71939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 24 16:31:17.625946 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ba7d6d1-2906-4dfc-b1d7-c3e9e3fd99dd admin admin] PATH_INFO: `/v3/domains` {{(pid=71939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 24 16:31:17.627260 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ba7d6d1-2906-4dfc-b1d7-c3e9e3fd99dd admin admin] RBAC: Adding query filter params (name=Default) {{(pid=71939) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:161}} Nov 24 16:31:17.627613 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ba7d6d1-2906-4dfc-b1d7-c3e9e3fd99dd admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=71939) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:442}} Nov 24 16:31:17.656450 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ba7d6d1-2906-4dfc-b1d7-c3e9e3fd99dd admin admin] RBAC: Authorization granted {{(pid=71939) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 24 16:31:17.669596 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: [pid: 71939|app: 0|req: 231/462] 10.222.0.53 () {56 vars in 1121 bytes} [Wed Nov 24 16:31:17 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 60 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 24 16:31:17.675160 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5414b727-0c11-49bd-9b71-58778302227d admin admin] Authenticating user token {{(pid=71938) process_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 24 16:31:17.684958 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5414b727-0c11-49bd-9b71-58778302227d admin admin] Validating token access rules against request {{(pid=71938) validate_allowed_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 24 16:31:17.689658 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30097653-7091-4f21-9e8c-5415ae0b30a2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f2ba2e8375b4e8c8792ee1e22b60427', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '00a5583c7b7443e98e7a1d31a0b638dc', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=71938) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 24 16:31:17.690632 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30097653-7091-4f21-9e8c-5415ae0b30a2 admin admin] REQUEST_METHOD: `GET` {{(pid=71938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 24 16:31:17.690972 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30097653-7091-4f21-9e8c-5415ae0b30a2 admin admin] SCRIPT_NAME: `/identity` {{(pid=71938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 24 16:31:17.691301 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30097653-7091-4f21-9e8c-5415ae0b30a2 admin admin] PATH_INFO: `/v3/users/nova` {{(pid=71938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 24 16:31:17.705496 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30097653-7091-4f21-9e8c-5415ae0b30a2 admin admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=71938) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:442}} Nov 24 16:31:17.735270 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30097653-7091-4f21-9e8c-5415ae0b30a2 admin admin] RBAC: Authorization granted {{(pid=71938) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 24 16:31:17.754882 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: WARNING keystone.server.flask.application [None req-30097653-7091-4f21-9e8c-5415ae0b30a2 admin admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Nov 24 16:31:17.756034 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: [pid: 71938|app: 0|req: 232/463] 10.222.0.53 () {56 vars in 1105 bytes} [Wed Nov 24 16:31:17 2021] GET /identity/v3/users/nova => generated 82 bytes in 81 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 24 16:31:17.761868 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ba7d6d1-2906-4dfc-b1d7-c3e9e3fd99dd admin admin] Authenticating user token {{(pid=71939) process_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 24 16:31:17.772325 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ba7d6d1-2906-4dfc-b1d7-c3e9e3fd99dd admin admin] Validating token access rules against request {{(pid=71939) validate_allowed_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 24 16:31:17.776526 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49441c01-818b-4802-b26f-8dfbae931799 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f2ba2e8375b4e8c8792ee1e22b60427', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '00a5583c7b7443e98e7a1d31a0b638dc', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=71939) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 24 16:31:17.777194 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49441c01-818b-4802-b26f-8dfbae931799 admin admin] REQUEST_METHOD: `GET` {{(pid=71939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 24 16:31:17.777534 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49441c01-818b-4802-b26f-8dfbae931799 admin admin] SCRIPT_NAME: `/identity` {{(pid=71939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 24 16:31:17.777870 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49441c01-818b-4802-b26f-8dfbae931799 admin admin] PATH_INFO: `/v3/users` {{(pid=71939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 24 16:31:17.778794 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49441c01-818b-4802-b26f-8dfbae931799 admin admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=71939) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:161}} Nov 24 16:31:17.779150 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49441c01-818b-4802-b26f-8dfbae931799 admin admin] RBAC: Authorizing `identity:list_users()` {{(pid=71939) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:442}} Nov 24 16:31:17.807256 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49441c01-818b-4802-b26f-8dfbae931799 admin admin] RBAC: Authorization granted {{(pid=71939) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 24 16:31:17.838628 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: [pid: 71939|app: 0|req: 232/464] 10.222.0.53 () {56 vars in 1145 bytes} [Wed Nov 24 16:31:17 2021] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 77 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 24 16:31:17.844257 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30097653-7091-4f21-9e8c-5415ae0b30a2 admin admin] Authenticating user token {{(pid=71938) process_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 24 16:31:17.854107 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30097653-7091-4f21-9e8c-5415ae0b30a2 admin admin] Validating token access rules against request {{(pid=71938) validate_allowed_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 24 16:31:17.858550 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b8b9fee-a2be-4415-85d1-2d9e895d8f0a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f2ba2e8375b4e8c8792ee1e22b60427', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '00a5583c7b7443e98e7a1d31a0b638dc', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=71938) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 24 16:31:17.859192 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b8b9fee-a2be-4415-85d1-2d9e895d8f0a admin admin] REQUEST_METHOD: `GET` {{(pid=71938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 24 16:31:17.859532 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b8b9fee-a2be-4415-85d1-2d9e895d8f0a admin admin] SCRIPT_NAME: `/identity` {{(pid=71938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 24 16:31:17.859864 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b8b9fee-a2be-4415-85d1-2d9e895d8f0a admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=71938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 24 16:31:17.869365 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b8b9fee-a2be-4415-85d1-2d9e895d8f0a admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=71938) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:442}} Nov 24 16:31:17.898080 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b8b9fee-a2be-4415-85d1-2d9e895d8f0a admin admin] RBAC: Authorization granted {{(pid=71938) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 24 16:31:17.907167 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: [pid: 71938|app: 0|req: 233/465] 10.222.0.53 () {58 vars in 1315 bytes} [Wed Nov 24 16:31:17 2021] GET /identity/v3/auth/tokens => generated 1067 bytes in 63 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 24 16:31:17.912881 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49441c01-818b-4802-b26f-8dfbae931799 admin admin] Authenticating user token {{(pid=71939) process_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 24 16:31:17.922592 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49441c01-818b-4802-b26f-8dfbae931799 admin admin] Validating token access rules against request {{(pid=71939) validate_allowed_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 24 16:31:17.927316 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-582e405a-a136-4223-bbe1-ce0e1de28b72 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f2ba2e8375b4e8c8792ee1e22b60427', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '00a5583c7b7443e98e7a1d31a0b638dc', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=71939) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 24 16:31:17.928118 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-582e405a-a136-4223-bbe1-ce0e1de28b72 admin admin] REQUEST_METHOD: `GET` {{(pid=71939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 24 16:31:17.928457 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-582e405a-a136-4223-bbe1-ce0e1de28b72 admin admin] SCRIPT_NAME: `/identity` {{(pid=71939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 24 16:31:17.928792 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-582e405a-a136-4223-bbe1-ce0e1de28b72 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=71939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 24 16:31:17.941291 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-582e405a-a136-4223-bbe1-ce0e1de28b72 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=71939) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:442}} Nov 24 16:31:17.969532 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-582e405a-a136-4223-bbe1-ce0e1de28b72 admin admin] RBAC: Authorization granted {{(pid=71939) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 24 16:31:17.989375 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: WARNING keystone.server.flask.application [None req-582e405a-a136-4223-bbe1-ce0e1de28b72 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Nov 24 16:31:17.990766 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: [pid: 71939|app: 0|req: 233/466] 10.222.0.53 () {56 vars in 1120 bytes} [Wed Nov 24 16:31:17 2021] GET /identity/v3/domains/Default => generated 87 bytes in 78 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 24 16:31:17.997800 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b8b9fee-a2be-4415-85d1-2d9e895d8f0a admin admin] Authenticating user token {{(pid=71938) process_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 24 16:31:18.007632 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b8b9fee-a2be-4415-85d1-2d9e895d8f0a admin admin] Validating token access rules against request {{(pid=71938) validate_allowed_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 24 16:31:18.012188 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73b0f6e4-2388-4202-b8ca-a034218282c6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f2ba2e8375b4e8c8792ee1e22b60427', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '00a5583c7b7443e98e7a1d31a0b638dc', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=71938) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 24 16:31:18.012860 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73b0f6e4-2388-4202-b8ca-a034218282c6 admin admin] REQUEST_METHOD: `GET` {{(pid=71938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 24 16:31:18.013202 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73b0f6e4-2388-4202-b8ca-a034218282c6 admin admin] SCRIPT_NAME: `/identity` {{(pid=71938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 24 16:31:18.013539 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73b0f6e4-2388-4202-b8ca-a034218282c6 admin admin] PATH_INFO: `/v3/domains` {{(pid=71938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 24 16:31:18.014371 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73b0f6e4-2388-4202-b8ca-a034218282c6 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=71938) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:161}} Nov 24 16:31:18.014728 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73b0f6e4-2388-4202-b8ca-a034218282c6 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=71938) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:442}} Nov 24 16:31:18.043132 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73b0f6e4-2388-4202-b8ca-a034218282c6 admin admin] RBAC: Authorization granted {{(pid=71938) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 24 16:31:18.056617 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: [pid: 71938|app: 0|req: 234/467] 10.222.0.53 () {56 vars in 1121 bytes} [Wed Nov 24 16:31:17 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 59 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 24 16:31:18.062288 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-582e405a-a136-4223-bbe1-ce0e1de28b72 admin admin] Authenticating user token {{(pid=71939) process_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 24 16:31:18.072515 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-582e405a-a136-4223-bbe1-ce0e1de28b72 admin admin] Validating token access rules against request {{(pid=71939) validate_allowed_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 24 16:31:18.076679 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebaaf342-a7f9-4a23-9845-ab5f7a0f3909 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f2ba2e8375b4e8c8792ee1e22b60427', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '00a5583c7b7443e98e7a1d31a0b638dc', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=71939) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 24 16:31:18.077474 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebaaf342-a7f9-4a23-9845-ab5f7a0f3909 admin admin] REQUEST_METHOD: `GET` {{(pid=71939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 24 16:31:18.078091 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebaaf342-a7f9-4a23-9845-ab5f7a0f3909 admin admin] SCRIPT_NAME: `/identity` {{(pid=71939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 24 16:31:18.078407 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebaaf342-a7f9-4a23-9845-ab5f7a0f3909 admin admin] PATH_INFO: `/v3/projects/service` {{(pid=71939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 24 16:31:18.087468 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebaaf342-a7f9-4a23-9845-ab5f7a0f3909 admin admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=71939) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:442}} Nov 24 16:31:18.116019 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebaaf342-a7f9-4a23-9845-ab5f7a0f3909 admin admin] RBAC: Authorization granted {{(pid=71939) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 24 16:31:18.131282 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: WARNING keystone.server.flask.application [None req-ebaaf342-a7f9-4a23-9845-ab5f7a0f3909 admin admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Nov 24 16:31:18.132418 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: [pid: 71939|app: 0|req: 234/468] 10.222.0.53 () {56 vars in 1123 bytes} [Wed Nov 24 16:31:18 2021] GET /identity/v3/projects/service => generated 88 bytes in 71 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 24 16:31:18.138256 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73b0f6e4-2388-4202-b8ca-a034218282c6 admin admin] Authenticating user token {{(pid=71938) process_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 24 16:31:18.147989 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73b0f6e4-2388-4202-b8ca-a034218282c6 admin admin] Validating token access rules against request {{(pid=71938) validate_allowed_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 24 16:31:18.152243 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8803c4e-3164-4005-96de-effa8b97fe4b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f2ba2e8375b4e8c8792ee1e22b60427', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '00a5583c7b7443e98e7a1d31a0b638dc', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=71938) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 24 16:31:18.152903 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8803c4e-3164-4005-96de-effa8b97fe4b admin admin] REQUEST_METHOD: `GET` {{(pid=71938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 24 16:31:18.153242 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8803c4e-3164-4005-96de-effa8b97fe4b admin admin] SCRIPT_NAME: `/identity` {{(pid=71938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 24 16:31:18.153574 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8803c4e-3164-4005-96de-effa8b97fe4b admin admin] PATH_INFO: `/v3/projects` {{(pid=71938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 24 16:31:18.154453 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8803c4e-3164-4005-96de-effa8b97fe4b admin admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=71938) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:161}} Nov 24 16:31:18.154814 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8803c4e-3164-4005-96de-effa8b97fe4b admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=71938) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:442}} Nov 24 16:31:18.183913 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8803c4e-3164-4005-96de-effa8b97fe4b admin admin] RBAC: Authorization granted {{(pid=71938) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 24 16:31:18.198883 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: [pid: 71938|app: 0|req: 235/469] 10.222.0.53 () {56 vars in 1160 bytes} [Wed Nov 24 16:31:18 2021] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 61 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 24 16:31:18.205324 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebaaf342-a7f9-4a23-9845-ab5f7a0f3909 admin admin] Authenticating user token {{(pid=71939) process_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 24 16:31:18.215231 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebaaf342-a7f9-4a23-9845-ab5f7a0f3909 admin admin] Validating token access rules against request {{(pid=71939) validate_allowed_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 24 16:31:18.219346 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad41f5ab-409e-4cf7-b725-77455cdf7602 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f2ba2e8375b4e8c8792ee1e22b60427', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '00a5583c7b7443e98e7a1d31a0b638dc', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=71939) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 24 16:31:18.219991 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad41f5ab-409e-4cf7-b725-77455cdf7602 admin admin] REQUEST_METHOD: `GET` {{(pid=71939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 24 16:31:18.220908 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad41f5ab-409e-4cf7-b725-77455cdf7602 admin admin] SCRIPT_NAME: `/identity` {{(pid=71939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 24 16:31:18.221179 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad41f5ab-409e-4cf7-b725-77455cdf7602 admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=71939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 24 16:31:18.222089 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad41f5ab-409e-4cf7-b725-77455cdf7602 admin admin] RBAC: Adding query filter params (role.id=5611724e350b41e19921b5961a342582, scope.project.id=3b3940d4ae1c4177ae29c02377bb4b0b, user.id=3e196802d4d5432482b6d2eabc25f74e) {{(pid=71939) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:161}} Nov 24 16:31:18.222448 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad41f5ab-409e-4cf7-b725-77455cdf7602 admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=71939) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:442}} Nov 24 16:31:18.251347 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad41f5ab-409e-4cf7-b725-77455cdf7602 admin admin] RBAC: Authorization granted {{(pid=71939) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 24 16:31:18.257028 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: [pid: 71939|app: 0|req: 235/470] 10.222.0.53 () {56 vars in 1386 bytes} [Wed Nov 24 16:31:18 2021] GET /identity/v3/role_assignments?user.id=3e196802d4d5432482b6d2eabc25f74e&scope.project.id=3b3940d4ae1c4177ae29c02377bb4b0b&role.id=5611724e350b41e19921b5961a342582 => generated 259 bytes in 52 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 24 16:31:20.223320 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d12539b-ba21-4610-aeed-16e8b3f5f31f None None] REQUEST_METHOD: `GET` {{(pid=71938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 24 16:31:20.223756 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d12539b-ba21-4610-aeed-16e8b3f5f31f None None] SCRIPT_NAME: `/identity` {{(pid=71938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 24 16:31:20.223984 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d12539b-ba21-4610-aeed-16e8b3f5f31f None None] PATH_INFO: `/` {{(pid=71938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 24 16:31:20.225840 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: [pid: 71938|app: 0|req: 236/471] 10.222.0.53 () {54 vars in 915 bytes} [Wed Nov 24 16:31:20 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 24 16:31:20.231312 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d938a969-bf90-4fe8-a69c-10f7ef41c4bf None None] REQUEST_METHOD: `POST` {{(pid=71939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 24 16:31:20.231660 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d938a969-bf90-4fe8-a69c-10f7ef41c4bf None None] SCRIPT_NAME: `/identity` {{(pid=71939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 24 16:31:20.232006 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d938a969-bf90-4fe8-a69c-10f7ef41c4bf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=71939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 24 16:31:20.256482 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.auth.core [None req-d938a969-bf90-4fe8-a69c-10f7ef41c4bf None None] MFA Rules not processed for user `0f2ba2e8375b4e8c8792ee1e22b60427`. Rule list: `[]` (Enabled: `True`). {{(pid=71939) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:442}} Nov 24 16:31:20.257697 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.fernet_utils [None req-d938a969-bf90-4fe8-a69c-10f7ef41c4bf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=71939) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:289}} Nov 24 16:31:20.264697 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: [pid: 71939|app: 0|req: 236/472] 10.222.0.53 () {58 vars in 1013 bytes} [Wed Nov 24 16:31:20 2021] POST /identity/v3/auth/tokens => generated 1067 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 24 16:31:20.286186 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-708237ee-a7c6-4344-bd3a-b30b11f8242c None None] REQUEST_METHOD: `POST` {{(pid=71938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 24 16:31:20.286535 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-708237ee-a7c6-4344-bd3a-b30b11f8242c None None] SCRIPT_NAME: `/identity` {{(pid=71938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 24 16:31:20.286875 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-708237ee-a7c6-4344-bd3a-b30b11f8242c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=71938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 24 16:31:20.312667 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.auth.core [None req-708237ee-a7c6-4344-bd3a-b30b11f8242c None None] MFA Rules not processed for user `0f2ba2e8375b4e8c8792ee1e22b60427`. Rule list: `[]` (Enabled: `True`). {{(pid=71938) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:442}} Nov 24 16:31:20.313877 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.fernet_utils [None req-708237ee-a7c6-4344-bd3a-b30b11f8242c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=71938) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:289}} Nov 24 16:31:20.321548 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: [pid: 71938|app: 0|req: 237/473] 10.222.0.53 () {58 vars in 1013 bytes} [Wed Nov 24 16:31:20 2021] POST /identity/v3/auth/tokens => generated 1067 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 24 16:31:20.327047 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d938a969-bf90-4fe8-a69c-10f7ef41c4bf None None] Authenticating user token {{(pid=71939) process_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 24 16:31:20.337271 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d938a969-bf90-4fe8-a69c-10f7ef41c4bf None None] Validating token access rules against request {{(pid=71939) validate_allowed_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 24 16:31:20.341432 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca6e52eb-1356-4ae1-a50c-4f5a3bb94633 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f2ba2e8375b4e8c8792ee1e22b60427', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '00a5583c7b7443e98e7a1d31a0b638dc', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=71939) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 24 16:31:20.342265 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca6e52eb-1356-4ae1-a50c-4f5a3bb94633 admin admin] REQUEST_METHOD: `GET` {{(pid=71939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 24 16:31:20.342604 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca6e52eb-1356-4ae1-a50c-4f5a3bb94633 admin admin] SCRIPT_NAME: `/identity` {{(pid=71939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 24 16:31:20.342933 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca6e52eb-1356-4ae1-a50c-4f5a3bb94633 admin admin] PATH_INFO: `/v3/roles/admin` {{(pid=71939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 24 16:31:20.354546 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca6e52eb-1356-4ae1-a50c-4f5a3bb94633 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=71939) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:401}} Nov 24 16:31:20.362454 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: WARNING keystone.server.flask.application [None req-ca6e52eb-1356-4ae1-a50c-4f5a3bb94633 admin admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Nov 24 16:31:20.363616 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: [pid: 71939|app: 0|req: 237/474] 10.222.0.53 () {56 vars in 1108 bytes} [Wed Nov 24 16:31:20 2021] GET /identity/v3/roles/admin => generated 83 bytes in 37 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 24 16:31:20.369821 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-708237ee-a7c6-4344-bd3a-b30b11f8242c None None] Authenticating user token {{(pid=71938) process_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 24 16:31:20.379503 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-708237ee-a7c6-4344-bd3a-b30b11f8242c None None] Validating token access rules against request {{(pid=71938) validate_allowed_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 24 16:31:20.383758 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d997c2f-f3ba-43b7-97b7-287cc49da190 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f2ba2e8375b4e8c8792ee1e22b60427', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '00a5583c7b7443e98e7a1d31a0b638dc', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=71938) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 24 16:31:20.384420 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d997c2f-f3ba-43b7-97b7-287cc49da190 admin admin] REQUEST_METHOD: `GET` {{(pid=71938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 24 16:31:20.384760 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d997c2f-f3ba-43b7-97b7-287cc49da190 admin admin] SCRIPT_NAME: `/identity` {{(pid=71938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 24 16:31:20.385096 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d997c2f-f3ba-43b7-97b7-287cc49da190 admin admin] PATH_INFO: `/v3/roles` {{(pid=71938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 24 16:31:20.385983 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d997c2f-f3ba-43b7-97b7-287cc49da190 admin admin] RBAC: Adding query filter params (name=admin) {{(pid=71938) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:161}} Nov 24 16:31:20.386392 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d997c2f-f3ba-43b7-97b7-287cc49da190 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=71938) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:442}} Nov 24 16:31:20.414230 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d997c2f-f3ba-43b7-97b7-287cc49da190 admin admin] RBAC: Authorization granted {{(pid=71938) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 24 16:31:20.423196 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: [pid: 71938|app: 0|req: 238/475] 10.222.0.53 () {56 vars in 1111 bytes} [Wed Nov 24 16:31:20 2021] GET /identity/v3/roles?name=admin => generated 339 bytes in 54 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 24 16:31:20.429193 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca6e52eb-1356-4ae1-a50c-4f5a3bb94633 admin admin] Authenticating user token {{(pid=71939) process_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 24 16:31:20.440698 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca6e52eb-1356-4ae1-a50c-4f5a3bb94633 admin admin] Validating token access rules against request {{(pid=71939) validate_allowed_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 24 16:31:20.444843 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-868e8d0d-cab4-4824-8ff0-e9f5494f1343 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f2ba2e8375b4e8c8792ee1e22b60427', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '00a5583c7b7443e98e7a1d31a0b638dc', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=71939) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 24 16:31:20.445629 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-868e8d0d-cab4-4824-8ff0-e9f5494f1343 admin admin] REQUEST_METHOD: `GET` {{(pid=71939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 24 16:31:20.445965 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-868e8d0d-cab4-4824-8ff0-e9f5494f1343 admin admin] SCRIPT_NAME: `/identity` {{(pid=71939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 24 16:31:20.446345 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-868e8d0d-cab4-4824-8ff0-e9f5494f1343 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=71939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 24 16:31:20.458252 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-868e8d0d-cab4-4824-8ff0-e9f5494f1343 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=71939) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:442}} Nov 24 16:31:20.487859 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-868e8d0d-cab4-4824-8ff0-e9f5494f1343 admin admin] RBAC: Authorization granted {{(pid=71939) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 24 16:31:20.506629 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: WARNING keystone.server.flask.application [None req-868e8d0d-cab4-4824-8ff0-e9f5494f1343 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Nov 24 16:31:20.507781 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: [pid: 71939|app: 0|req: 238/476] 10.222.0.53 () {56 vars in 1120 bytes} [Wed Nov 24 16:31:20 2021] GET /identity/v3/domains/Default => generated 87 bytes in 79 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 24 16:31:20.513482 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d997c2f-f3ba-43b7-97b7-287cc49da190 admin admin] Authenticating user token {{(pid=71938) process_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 24 16:31:20.523349 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d997c2f-f3ba-43b7-97b7-287cc49da190 admin admin] Validating token access rules against request {{(pid=71938) validate_allowed_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 24 16:31:20.527586 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83309c25-12a8-4c2d-b30c-cb3304ea80fd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f2ba2e8375b4e8c8792ee1e22b60427', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '00a5583c7b7443e98e7a1d31a0b638dc', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=71938) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 24 16:31:20.528246 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83309c25-12a8-4c2d-b30c-cb3304ea80fd admin admin] REQUEST_METHOD: `GET` {{(pid=71938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 24 16:31:20.528585 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83309c25-12a8-4c2d-b30c-cb3304ea80fd admin admin] SCRIPT_NAME: `/identity` {{(pid=71938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 24 16:31:20.528920 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83309c25-12a8-4c2d-b30c-cb3304ea80fd admin admin] PATH_INFO: `/v3/domains` {{(pid=71938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 24 16:31:20.529695 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83309c25-12a8-4c2d-b30c-cb3304ea80fd admin admin] RBAC: Adding query filter params (name=Default) {{(pid=71938) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:161}} Nov 24 16:31:20.530077 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83309c25-12a8-4c2d-b30c-cb3304ea80fd admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=71938) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:442}} Nov 24 16:31:20.559551 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83309c25-12a8-4c2d-b30c-cb3304ea80fd admin admin] RBAC: Authorization granted {{(pid=71938) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 24 16:31:20.572858 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: [pid: 71938|app: 0|req: 239/477] 10.222.0.53 () {56 vars in 1121 bytes} [Wed Nov 24 16:31:20 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 60 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 24 16:31:20.578576 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-868e8d0d-cab4-4824-8ff0-e9f5494f1343 admin admin] Authenticating user token {{(pid=71939) process_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 24 16:31:20.588221 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-868e8d0d-cab4-4824-8ff0-e9f5494f1343 admin admin] Validating token access rules against request {{(pid=71939) validate_allowed_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 24 16:31:20.592371 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d403fb1-5047-4f94-bfcf-5e145b700766 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f2ba2e8375b4e8c8792ee1e22b60427', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '00a5583c7b7443e98e7a1d31a0b638dc', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=71939) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 24 16:31:20.593155 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d403fb1-5047-4f94-bfcf-5e145b700766 admin admin] REQUEST_METHOD: `GET` {{(pid=71939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 24 16:31:20.593491 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d403fb1-5047-4f94-bfcf-5e145b700766 admin admin] SCRIPT_NAME: `/identity` {{(pid=71939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 24 16:31:20.593821 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d403fb1-5047-4f94-bfcf-5e145b700766 admin admin] PATH_INFO: `/v3/users/nova` {{(pid=71939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 24 16:31:20.609868 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d403fb1-5047-4f94-bfcf-5e145b700766 admin admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=71939) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:442}} Nov 24 16:31:20.638549 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d403fb1-5047-4f94-bfcf-5e145b700766 admin admin] RBAC: Authorization granted {{(pid=71939) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 24 16:31:20.657546 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: WARNING keystone.server.flask.application [None req-8d403fb1-5047-4f94-bfcf-5e145b700766 admin admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Nov 24 16:31:20.659231 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: [pid: 71939|app: 0|req: 239/478] 10.222.0.53 () {56 vars in 1105 bytes} [Wed Nov 24 16:31:20 2021] GET /identity/v3/users/nova => generated 82 bytes in 81 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 24 16:31:20.664953 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83309c25-12a8-4c2d-b30c-cb3304ea80fd admin admin] Authenticating user token {{(pid=71938) process_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 24 16:31:20.675359 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83309c25-12a8-4c2d-b30c-cb3304ea80fd admin admin] Validating token access rules against request {{(pid=71938) validate_allowed_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 24 16:31:20.679567 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-877ec2e7-e0d4-4cd7-8366-467ac3b7b935 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f2ba2e8375b4e8c8792ee1e22b60427', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '00a5583c7b7443e98e7a1d31a0b638dc', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=71938) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 24 16:31:20.680239 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-877ec2e7-e0d4-4cd7-8366-467ac3b7b935 admin admin] REQUEST_METHOD: `GET` {{(pid=71938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 24 16:31:20.680579 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-877ec2e7-e0d4-4cd7-8366-467ac3b7b935 admin admin] SCRIPT_NAME: `/identity` {{(pid=71938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 24 16:31:20.680915 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-877ec2e7-e0d4-4cd7-8366-467ac3b7b935 admin admin] PATH_INFO: `/v3/users` {{(pid=71938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 24 16:31:20.681814 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-877ec2e7-e0d4-4cd7-8366-467ac3b7b935 admin admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=71938) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:161}} Nov 24 16:31:20.682204 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-877ec2e7-e0d4-4cd7-8366-467ac3b7b935 admin admin] RBAC: Authorizing `identity:list_users()` {{(pid=71938) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:442}} Nov 24 16:31:20.710889 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-877ec2e7-e0d4-4cd7-8366-467ac3b7b935 admin admin] RBAC: Authorization granted {{(pid=71938) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 24 16:31:20.742340 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: [pid: 71938|app: 0|req: 240/479] 10.222.0.53 () {56 vars in 1145 bytes} [Wed Nov 24 16:31:20 2021] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 78 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 24 16:31:20.747747 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d403fb1-5047-4f94-bfcf-5e145b700766 admin admin] Authenticating user token {{(pid=71939) process_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 24 16:31:20.757356 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d403fb1-5047-4f94-bfcf-5e145b700766 admin admin] Validating token access rules against request {{(pid=71939) validate_allowed_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 24 16:31:20.761443 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-245a5259-2993-4608-a9ce-98be96a31d92 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f2ba2e8375b4e8c8792ee1e22b60427', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '00a5583c7b7443e98e7a1d31a0b638dc', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=71939) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 24 16:31:20.762256 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-245a5259-2993-4608-a9ce-98be96a31d92 admin admin] REQUEST_METHOD: `GET` {{(pid=71939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 24 16:31:20.762590 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-245a5259-2993-4608-a9ce-98be96a31d92 admin admin] SCRIPT_NAME: `/identity` {{(pid=71939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 24 16:31:20.762917 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-245a5259-2993-4608-a9ce-98be96a31d92 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=71939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 24 16:31:20.775278 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-245a5259-2993-4608-a9ce-98be96a31d92 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=71939) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:442}} Nov 24 16:31:20.804125 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-245a5259-2993-4608-a9ce-98be96a31d92 admin admin] RBAC: Authorization granted {{(pid=71939) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 24 16:31:20.821956 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: WARNING keystone.server.flask.application [None req-245a5259-2993-4608-a9ce-98be96a31d92 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Nov 24 16:31:20.823107 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: [pid: 71939|app: 0|req: 240/480] 10.222.0.53 () {56 vars in 1120 bytes} [Wed Nov 24 16:31:20 2021] GET /identity/v3/domains/Default => generated 87 bytes in 76 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 24 16:31:20.828925 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-877ec2e7-e0d4-4cd7-8366-467ac3b7b935 admin admin] Authenticating user token {{(pid=71938) process_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 24 16:31:20.839443 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-877ec2e7-e0d4-4cd7-8366-467ac3b7b935 admin admin] Validating token access rules against request {{(pid=71938) validate_allowed_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 24 16:31:20.843450 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09090643-75da-4705-940c-a5335435e6c9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f2ba2e8375b4e8c8792ee1e22b60427', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '00a5583c7b7443e98e7a1d31a0b638dc', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=71938) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 24 16:31:20.844113 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09090643-75da-4705-940c-a5335435e6c9 admin admin] REQUEST_METHOD: `GET` {{(pid=71938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 24 16:31:20.844454 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09090643-75da-4705-940c-a5335435e6c9 admin admin] SCRIPT_NAME: `/identity` {{(pid=71938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 24 16:31:20.844792 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09090643-75da-4705-940c-a5335435e6c9 admin admin] PATH_INFO: `/v3/domains` {{(pid=71938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 24 16:31:20.846216 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09090643-75da-4705-940c-a5335435e6c9 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=71938) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:161}} Nov 24 16:31:20.846563 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09090643-75da-4705-940c-a5335435e6c9 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=71938) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:442}} Nov 24 16:31:20.874579 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09090643-75da-4705-940c-a5335435e6c9 admin admin] RBAC: Authorization granted {{(pid=71938) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 24 16:31:20.887053 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: [pid: 71938|app: 0|req: 241/481] 10.222.0.53 () {56 vars in 1121 bytes} [Wed Nov 24 16:31:20 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 59 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 24 16:31:20.892968 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-245a5259-2993-4608-a9ce-98be96a31d92 admin admin] Authenticating user token {{(pid=71939) process_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 24 16:31:20.902593 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-245a5259-2993-4608-a9ce-98be96a31d92 admin admin] Validating token access rules against request {{(pid=71939) validate_allowed_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 24 16:31:20.906762 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4960075-3360-408a-ad94-6380c5066ba3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f2ba2e8375b4e8c8792ee1e22b60427', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '00a5583c7b7443e98e7a1d31a0b638dc', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=71939) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 24 16:31:20.907548 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4960075-3360-408a-ad94-6380c5066ba3 admin admin] REQUEST_METHOD: `GET` {{(pid=71939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 24 16:31:20.908499 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4960075-3360-408a-ad94-6380c5066ba3 admin admin] SCRIPT_NAME: `/identity` {{(pid=71939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 24 16:31:20.908833 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4960075-3360-408a-ad94-6380c5066ba3 admin admin] PATH_INFO: `/v3/projects/service` {{(pid=71939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 24 16:31:20.918008 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4960075-3360-408a-ad94-6380c5066ba3 admin admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=71939) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:442}} Nov 24 16:31:20.946256 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4960075-3360-408a-ad94-6380c5066ba3 admin admin] RBAC: Authorization granted {{(pid=71939) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 24 16:31:20.961806 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: WARNING keystone.server.flask.application [None req-b4960075-3360-408a-ad94-6380c5066ba3 admin admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Nov 24 16:31:20.962974 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: [pid: 71939|app: 0|req: 241/482] 10.222.0.53 () {56 vars in 1123 bytes} [Wed Nov 24 16:31:20 2021] GET /identity/v3/projects/service => generated 88 bytes in 71 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 24 16:31:20.968539 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09090643-75da-4705-940c-a5335435e6c9 admin admin] Authenticating user token {{(pid=71938) process_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 24 16:31:20.978791 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09090643-75da-4705-940c-a5335435e6c9 admin admin] Validating token access rules against request {{(pid=71938) validate_allowed_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 24 16:31:20.982914 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f1c409f-47ce-4c7c-9267-5990fc3c1c3d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f2ba2e8375b4e8c8792ee1e22b60427', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '00a5583c7b7443e98e7a1d31a0b638dc', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=71938) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 24 16:31:20.983559 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f1c409f-47ce-4c7c-9267-5990fc3c1c3d admin admin] REQUEST_METHOD: `GET` {{(pid=71938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 24 16:31:20.983899 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f1c409f-47ce-4c7c-9267-5990fc3c1c3d admin admin] SCRIPT_NAME: `/identity` {{(pid=71938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 24 16:31:20.984226 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f1c409f-47ce-4c7c-9267-5990fc3c1c3d admin admin] PATH_INFO: `/v3/projects` {{(pid=71938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 24 16:31:20.985056 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f1c409f-47ce-4c7c-9267-5990fc3c1c3d admin admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=71938) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:161}} Nov 24 16:31:20.985408 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f1c409f-47ce-4c7c-9267-5990fc3c1c3d admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=71938) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:442}} Nov 24 16:31:21.013590 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f1c409f-47ce-4c7c-9267-5990fc3c1c3d admin admin] RBAC: Authorization granted {{(pid=71938) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 24 16:31:21.027924 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: [pid: 71938|app: 0|req: 242/483] 10.222.0.53 () {56 vars in 1160 bytes} [Wed Nov 24 16:31:20 2021] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 60 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 24 16:31:21.034545 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4960075-3360-408a-ad94-6380c5066ba3 admin admin] Authenticating user token {{(pid=71939) process_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 24 16:31:21.044815 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4960075-3360-408a-ad94-6380c5066ba3 admin admin] Validating token access rules against request {{(pid=71939) validate_allowed_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 24 16:31:21.048909 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a45eaef-7e92-4a35-a3c0-18b3d420e388 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f2ba2e8375b4e8c8792ee1e22b60427', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '00a5583c7b7443e98e7a1d31a0b638dc', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=71939) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 24 16:31:21.049888 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a45eaef-7e92-4a35-a3c0-18b3d420e388 admin admin] REQUEST_METHOD: `PUT` {{(pid=71939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 24 16:31:21.050266 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a45eaef-7e92-4a35-a3c0-18b3d420e388 admin admin] SCRIPT_NAME: `/identity` {{(pid=71939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 24 16:31:21.050595 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a45eaef-7e92-4a35-a3c0-18b3d420e388 admin admin] PATH_INFO: `/v3/projects/3b3940d4ae1c4177ae29c02377bb4b0b/users/3e196802d4d5432482b6d2eabc25f74e/roles/5611724e350b41e19921b5961a342582` {{(pid=71939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 24 16:31:21.052533 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a45eaef-7e92-4a35-a3c0-18b3d420e388 admin admin] RBAC: Authorizing `identity:create_grant(project_id=3b3940d4ae1c4177ae29c02377bb4b0b, user_id=3e196802d4d5432482b6d2eabc25f74e, role_id=5611724e350b41e19921b5961a342582)` {{(pid=71939) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:442}} Nov 24 16:31:21.083335 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a45eaef-7e92-4a35-a3c0-18b3d420e388 admin admin] RBAC: Authorization granted {{(pid=71939) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 24 16:31:21.094882 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: [pid: 71939|app: 0|req: 242/484] 10.222.0.53 () {58 vars in 1451 bytes} [Wed Nov 24 16:31:21 2021] PUT /identity/v3/projects/3b3940d4ae1c4177ae29c02377bb4b0b/users/3e196802d4d5432482b6d2eabc25f74e/roles/5611724e350b41e19921b5961a342582 => generated 0 bytes in 61 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 24 16:31:23.062631 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dae55b67-1ca3-49b0-91c6-cdc77458ee35 None None] REQUEST_METHOD: `GET` {{(pid=71938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 24 16:31:23.063178 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dae55b67-1ca3-49b0-91c6-cdc77458ee35 None None] SCRIPT_NAME: `/identity` {{(pid=71938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 24 16:31:23.063270 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dae55b67-1ca3-49b0-91c6-cdc77458ee35 None None] PATH_INFO: `/` {{(pid=71938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 24 16:31:23.065648 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: [pid: 71938|app: 0|req: 243/485] 10.222.0.53 () {54 vars in 915 bytes} [Wed Nov 24 16:31:23 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 24 16:31:23.071227 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4459c0bc-c950-4388-8bc9-9ad0d80c7c00 None None] REQUEST_METHOD: `POST` {{(pid=71939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 24 16:31:23.071582 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4459c0bc-c950-4388-8bc9-9ad0d80c7c00 None None] SCRIPT_NAME: `/identity` {{(pid=71939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 24 16:31:23.071918 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4459c0bc-c950-4388-8bc9-9ad0d80c7c00 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=71939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 24 16:31:23.096511 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.auth.core [None req-4459c0bc-c950-4388-8bc9-9ad0d80c7c00 None None] MFA Rules not processed for user `0f2ba2e8375b4e8c8792ee1e22b60427`. Rule list: `[]` (Enabled: `True`). {{(pid=71939) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:442}} Nov 24 16:31:23.097743 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.fernet_utils [None req-4459c0bc-c950-4388-8bc9-9ad0d80c7c00 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=71939) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:289}} Nov 24 16:31:23.163676 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: [pid: 71939|app: 0|req: 243/486] 10.222.0.53 () {58 vars in 1013 bytes} [Wed Nov 24 16:31:23 2021] POST /identity/v3/auth/tokens => generated 1067 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 24 16:31:23.186886 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d933b099-cb45-4602-ad6e-daacba39dc2a None None] REQUEST_METHOD: `POST` {{(pid=71938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 24 16:31:23.187335 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d933b099-cb45-4602-ad6e-daacba39dc2a None None] SCRIPT_NAME: `/identity` {{(pid=71938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 24 16:31:23.187752 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d933b099-cb45-4602-ad6e-daacba39dc2a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=71938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 24 16:31:23.211627 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.auth.core [None req-d933b099-cb45-4602-ad6e-daacba39dc2a None None] MFA Rules not processed for user `0f2ba2e8375b4e8c8792ee1e22b60427`. Rule list: `[]` (Enabled: `True`). {{(pid=71938) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:442}} Nov 24 16:31:23.212848 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.fernet_utils [None req-d933b099-cb45-4602-ad6e-daacba39dc2a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=71938) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:289}} Nov 24 16:31:23.220023 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: [pid: 71938|app: 0|req: 244/487] 10.222.0.53 () {58 vars in 1013 bytes} [Wed Nov 24 16:31:23 2021] POST /identity/v3/auth/tokens => generated 1067 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 24 16:31:23.225675 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4459c0bc-c950-4388-8bc9-9ad0d80c7c00 None None] Authenticating user token {{(pid=71939) process_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 24 16:31:23.235364 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4459c0bc-c950-4388-8bc9-9ad0d80c7c00 None None] Validating token access rules against request {{(pid=71939) validate_allowed_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 24 16:31:23.240096 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60973f08-9759-422e-b5a4-61279ba2b9aa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f2ba2e8375b4e8c8792ee1e22b60427', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '00a5583c7b7443e98e7a1d31a0b638dc', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=71939) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 24 16:31:23.240910 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60973f08-9759-422e-b5a4-61279ba2b9aa admin admin] REQUEST_METHOD: `GET` {{(pid=71939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 24 16:31:23.241254 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60973f08-9759-422e-b5a4-61279ba2b9aa admin admin] SCRIPT_NAME: `/identity` {{(pid=71939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 24 16:31:23.241590 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60973f08-9759-422e-b5a4-61279ba2b9aa admin admin] PATH_INFO: `/v3/roles/admin` {{(pid=71939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 24 16:31:23.253919 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60973f08-9759-422e-b5a4-61279ba2b9aa admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=71939) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:401}} Nov 24 16:31:23.261276 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: WARNING keystone.server.flask.application [None req-60973f08-9759-422e-b5a4-61279ba2b9aa admin admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Nov 24 16:31:23.262477 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: [pid: 71939|app: 0|req: 244/488] 10.222.0.53 () {56 vars in 1108 bytes} [Wed Nov 24 16:31:23 2021] GET /identity/v3/roles/admin => generated 83 bytes in 37 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 24 16:31:23.268606 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d933b099-cb45-4602-ad6e-daacba39dc2a None None] Authenticating user token {{(pid=71938) process_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 24 16:31:23.277602 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d933b099-cb45-4602-ad6e-daacba39dc2a None None] Validating token access rules against request {{(pid=71938) validate_allowed_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 24 16:31:23.281818 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36055f76-1ebb-4bcc-ac1e-b36847f29f05 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f2ba2e8375b4e8c8792ee1e22b60427', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '00a5583c7b7443e98e7a1d31a0b638dc', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=71938) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 24 16:31:23.282512 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36055f76-1ebb-4bcc-ac1e-b36847f29f05 admin admin] REQUEST_METHOD: `GET` {{(pid=71938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 24 16:31:23.282858 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36055f76-1ebb-4bcc-ac1e-b36847f29f05 admin admin] SCRIPT_NAME: `/identity` {{(pid=71938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 24 16:31:23.283196 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36055f76-1ebb-4bcc-ac1e-b36847f29f05 admin admin] PATH_INFO: `/v3/roles` {{(pid=71938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 24 16:31:23.284004 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36055f76-1ebb-4bcc-ac1e-b36847f29f05 admin admin] RBAC: Adding query filter params (name=admin) {{(pid=71938) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:161}} Nov 24 16:31:23.284360 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36055f76-1ebb-4bcc-ac1e-b36847f29f05 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=71938) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:442}} Nov 24 16:31:23.312962 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36055f76-1ebb-4bcc-ac1e-b36847f29f05 admin admin] RBAC: Authorization granted {{(pid=71938) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 24 16:31:23.322523 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: [pid: 71938|app: 0|req: 245/489] 10.222.0.53 () {56 vars in 1111 bytes} [Wed Nov 24 16:31:23 2021] GET /identity/v3/roles?name=admin => generated 339 bytes in 54 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 24 16:31:23.328701 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60973f08-9759-422e-b5a4-61279ba2b9aa admin admin] Authenticating user token {{(pid=71939) process_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 24 16:31:23.339559 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60973f08-9759-422e-b5a4-61279ba2b9aa admin admin] Validating token access rules against request {{(pid=71939) validate_allowed_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 24 16:31:23.343393 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e992916-b6b9-496c-b92e-ea1a4664df36 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f2ba2e8375b4e8c8792ee1e22b60427', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '00a5583c7b7443e98e7a1d31a0b638dc', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=71939) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 24 16:31:23.344172 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e992916-b6b9-496c-b92e-ea1a4664df36 admin admin] REQUEST_METHOD: `GET` {{(pid=71939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 24 16:31:23.344508 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e992916-b6b9-496c-b92e-ea1a4664df36 admin admin] SCRIPT_NAME: `/identity` {{(pid=71939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 24 16:31:23.344835 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e992916-b6b9-496c-b92e-ea1a4664df36 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=71939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 24 16:31:23.356683 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e992916-b6b9-496c-b92e-ea1a4664df36 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=71939) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:442}} Nov 24 16:31:23.386674 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e992916-b6b9-496c-b92e-ea1a4664df36 admin admin] RBAC: Authorization granted {{(pid=71939) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 24 16:31:23.406138 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: WARNING keystone.server.flask.application [None req-4e992916-b6b9-496c-b92e-ea1a4664df36 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Nov 24 16:31:23.407325 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: [pid: 71939|app: 0|req: 245/490] 10.222.0.53 () {56 vars in 1120 bytes} [Wed Nov 24 16:31:23 2021] GET /identity/v3/domains/Default => generated 87 bytes in 80 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 24 16:31:23.413227 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36055f76-1ebb-4bcc-ac1e-b36847f29f05 admin admin] Authenticating user token {{(pid=71938) process_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 24 16:31:23.423190 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36055f76-1ebb-4bcc-ac1e-b36847f29f05 admin admin] Validating token access rules against request {{(pid=71938) validate_allowed_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 24 16:31:23.427906 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b7a0e89-a21a-4cfc-9f04-0cfeac99a6ff admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f2ba2e8375b4e8c8792ee1e22b60427', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '00a5583c7b7443e98e7a1d31a0b638dc', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=71938) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 24 16:31:23.428564 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b7a0e89-a21a-4cfc-9f04-0cfeac99a6ff admin admin] REQUEST_METHOD: `GET` {{(pid=71938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 24 16:31:23.428900 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b7a0e89-a21a-4cfc-9f04-0cfeac99a6ff admin admin] SCRIPT_NAME: `/identity` {{(pid=71938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 24 16:31:23.429235 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b7a0e89-a21a-4cfc-9f04-0cfeac99a6ff admin admin] PATH_INFO: `/v3/domains` {{(pid=71938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 24 16:31:23.430017 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b7a0e89-a21a-4cfc-9f04-0cfeac99a6ff admin admin] RBAC: Adding query filter params (name=Default) {{(pid=71938) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:161}} Nov 24 16:31:23.430409 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b7a0e89-a21a-4cfc-9f04-0cfeac99a6ff admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=71938) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:442}} Nov 24 16:31:23.459399 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b7a0e89-a21a-4cfc-9f04-0cfeac99a6ff admin admin] RBAC: Authorization granted {{(pid=71938) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 24 16:31:23.474569 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: [pid: 71938|app: 0|req: 246/491] 10.222.0.53 () {56 vars in 1121 bytes} [Wed Nov 24 16:31:23 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 62 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 24 16:31:23.480122 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e992916-b6b9-496c-b92e-ea1a4664df36 admin admin] Authenticating user token {{(pid=71939) process_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 24 16:31:23.490591 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e992916-b6b9-496c-b92e-ea1a4664df36 admin admin] Validating token access rules against request {{(pid=71939) validate_allowed_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 24 16:31:23.494873 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35898e4d-272c-4458-b35d-e1c32066773b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f2ba2e8375b4e8c8792ee1e22b60427', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '00a5583c7b7443e98e7a1d31a0b638dc', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=71939) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 24 16:31:23.495669 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35898e4d-272c-4458-b35d-e1c32066773b admin admin] REQUEST_METHOD: `GET` {{(pid=71939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 24 16:31:23.496008 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35898e4d-272c-4458-b35d-e1c32066773b admin admin] SCRIPT_NAME: `/identity` {{(pid=71939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 24 16:31:23.496340 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35898e4d-272c-4458-b35d-e1c32066773b admin admin] PATH_INFO: `/v3/users/nova` {{(pid=71939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 24 16:31:23.509529 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35898e4d-272c-4458-b35d-e1c32066773b admin admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=71939) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:442}} Nov 24 16:31:23.538496 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35898e4d-272c-4458-b35d-e1c32066773b admin admin] RBAC: Authorization granted {{(pid=71939) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 24 16:31:23.558466 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: WARNING keystone.server.flask.application [None req-35898e4d-272c-4458-b35d-e1c32066773b admin admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Nov 24 16:31:23.559630 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: [pid: 71939|app: 0|req: 246/492] 10.222.0.53 () {56 vars in 1105 bytes} [Wed Nov 24 16:31:23 2021] GET /identity/v3/users/nova => generated 82 bytes in 80 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 24 16:31:23.565491 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b7a0e89-a21a-4cfc-9f04-0cfeac99a6ff admin admin] Authenticating user token {{(pid=71938) process_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 24 16:31:23.575243 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b7a0e89-a21a-4cfc-9f04-0cfeac99a6ff admin admin] Validating token access rules against request {{(pid=71938) validate_allowed_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 24 16:31:23.579655 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c037f67a-f73e-4f8e-a781-36d57fe9dc46 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f2ba2e8375b4e8c8792ee1e22b60427', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '00a5583c7b7443e98e7a1d31a0b638dc', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=71938) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 24 16:31:23.580315 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c037f67a-f73e-4f8e-a781-36d57fe9dc46 admin admin] REQUEST_METHOD: `GET` {{(pid=71938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 24 16:31:23.580653 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c037f67a-f73e-4f8e-a781-36d57fe9dc46 admin admin] SCRIPT_NAME: `/identity` {{(pid=71938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 24 16:31:23.580983 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c037f67a-f73e-4f8e-a781-36d57fe9dc46 admin admin] PATH_INFO: `/v3/users` {{(pid=71938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 24 16:31:23.581871 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c037f67a-f73e-4f8e-a781-36d57fe9dc46 admin admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=71938) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:161}} Nov 24 16:31:23.582260 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c037f67a-f73e-4f8e-a781-36d57fe9dc46 admin admin] RBAC: Authorizing `identity:list_users()` {{(pid=71938) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:442}} Nov 24 16:31:23.611723 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c037f67a-f73e-4f8e-a781-36d57fe9dc46 admin admin] RBAC: Authorization granted {{(pid=71938) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 24 16:31:23.643188 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: [pid: 71938|app: 0|req: 247/493] 10.222.0.53 () {56 vars in 1145 bytes} [Wed Nov 24 16:31:23 2021] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 78 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 24 16:31:23.649048 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35898e4d-272c-4458-b35d-e1c32066773b admin admin] Authenticating user token {{(pid=71939) process_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 24 16:31:23.658983 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35898e4d-272c-4458-b35d-e1c32066773b admin admin] Validating token access rules against request {{(pid=71939) validate_allowed_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 24 16:31:23.663205 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4233dfa-fda7-445b-9249-e2e37db62906 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f2ba2e8375b4e8c8792ee1e22b60427', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '00a5583c7b7443e98e7a1d31a0b638dc', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=71939) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 24 16:31:23.663848 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4233dfa-fda7-445b-9249-e2e37db62906 admin admin] REQUEST_METHOD: `GET` {{(pid=71939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 24 16:31:23.664190 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4233dfa-fda7-445b-9249-e2e37db62906 admin admin] SCRIPT_NAME: `/identity` {{(pid=71939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 24 16:31:23.664567 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4233dfa-fda7-445b-9249-e2e37db62906 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=71939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 24 16:31:23.673596 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4233dfa-fda7-445b-9249-e2e37db62906 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=71939) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:442}} Nov 24 16:31:23.702059 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4233dfa-fda7-445b-9249-e2e37db62906 admin admin] RBAC: Authorization granted {{(pid=71939) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 24 16:31:23.711839 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: [pid: 71939|app: 0|req: 247/494] 10.222.0.53 () {58 vars in 1315 bytes} [Wed Nov 24 16:31:23 2021] GET /identity/v3/auth/tokens => generated 1067 bytes in 63 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 24 16:31:23.717441 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c037f67a-f73e-4f8e-a781-36d57fe9dc46 admin admin] Authenticating user token {{(pid=71938) process_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 24 16:31:23.727264 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c037f67a-f73e-4f8e-a781-36d57fe9dc46 admin admin] Validating token access rules against request {{(pid=71938) validate_allowed_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 24 16:31:23.731520 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-278e73fe-3720-4051-ab2c-e2672e6b9e13 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f2ba2e8375b4e8c8792ee1e22b60427', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '00a5583c7b7443e98e7a1d31a0b638dc', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=71938) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 24 16:31:23.732328 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-278e73fe-3720-4051-ab2c-e2672e6b9e13 admin admin] REQUEST_METHOD: `GET` {{(pid=71938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 24 16:31:23.732673 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-278e73fe-3720-4051-ab2c-e2672e6b9e13 admin admin] SCRIPT_NAME: `/identity` {{(pid=71938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 24 16:31:23.733012 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-278e73fe-3720-4051-ab2c-e2672e6b9e13 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=71938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 24 16:31:23.745085 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-278e73fe-3720-4051-ab2c-e2672e6b9e13 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=71938) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:442}} Nov 24 16:31:23.774586 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-278e73fe-3720-4051-ab2c-e2672e6b9e13 admin admin] RBAC: Authorization granted {{(pid=71938) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 24 16:31:23.793303 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: WARNING keystone.server.flask.application [None req-278e73fe-3720-4051-ab2c-e2672e6b9e13 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Nov 24 16:31:23.794548 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: [pid: 71938|app: 0|req: 248/495] 10.222.0.53 () {56 vars in 1120 bytes} [Wed Nov 24 16:31:23 2021] GET /identity/v3/domains/Default => generated 87 bytes in 78 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 24 16:31:23.800456 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4233dfa-fda7-445b-9249-e2e37db62906 admin admin] Authenticating user token {{(pid=71939) process_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 24 16:31:23.809396 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4233dfa-fda7-445b-9249-e2e37db62906 admin admin] Validating token access rules against request {{(pid=71939) validate_allowed_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 24 16:31:23.813570 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ae42969-6cc0-47a5-ad9d-755f1dbec092 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f2ba2e8375b4e8c8792ee1e22b60427', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '00a5583c7b7443e98e7a1d31a0b638dc', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=71939) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 24 16:31:23.814759 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ae42969-6cc0-47a5-ad9d-755f1dbec092 admin admin] REQUEST_METHOD: `GET` {{(pid=71939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 24 16:31:23.815095 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ae42969-6cc0-47a5-ad9d-755f1dbec092 admin admin] SCRIPT_NAME: `/identity` {{(pid=71939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 24 16:31:23.815427 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ae42969-6cc0-47a5-ad9d-755f1dbec092 admin admin] PATH_INFO: `/v3/domains` {{(pid=71939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 24 16:31:23.816253 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ae42969-6cc0-47a5-ad9d-755f1dbec092 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=71939) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:161}} Nov 24 16:31:23.816557 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ae42969-6cc0-47a5-ad9d-755f1dbec092 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=71939) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:442}} Nov 24 16:31:23.845208 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ae42969-6cc0-47a5-ad9d-755f1dbec092 admin admin] RBAC: Authorization granted {{(pid=71939) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 24 16:31:23.857567 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: [pid: 71939|app: 0|req: 248/496] 10.222.0.53 () {56 vars in 1121 bytes} [Wed Nov 24 16:31:23 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 58 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 24 16:31:23.863727 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-278e73fe-3720-4051-ab2c-e2672e6b9e13 admin admin] Authenticating user token {{(pid=71938) process_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 24 16:31:23.873410 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-278e73fe-3720-4051-ab2c-e2672e6b9e13 admin admin] Validating token access rules against request {{(pid=71938) validate_allowed_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 24 16:31:23.878246 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08d49552-2c71-47c1-816a-16255cb9f887 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f2ba2e8375b4e8c8792ee1e22b60427', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '00a5583c7b7443e98e7a1d31a0b638dc', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=71938) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 24 16:31:23.879036 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08d49552-2c71-47c1-816a-16255cb9f887 admin admin] REQUEST_METHOD: `GET` {{(pid=71938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 24 16:31:23.879378 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08d49552-2c71-47c1-816a-16255cb9f887 admin admin] SCRIPT_NAME: `/identity` {{(pid=71938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 24 16:31:23.879707 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08d49552-2c71-47c1-816a-16255cb9f887 admin admin] PATH_INFO: `/v3/projects/service` {{(pid=71938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 24 16:31:23.888859 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08d49552-2c71-47c1-816a-16255cb9f887 admin admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=71938) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:442}} Nov 24 16:31:23.917223 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08d49552-2c71-47c1-816a-16255cb9f887 admin admin] RBAC: Authorization granted {{(pid=71938) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 24 16:31:23.932613 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: WARNING keystone.server.flask.application [None req-08d49552-2c71-47c1-816a-16255cb9f887 admin admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Nov 24 16:31:23.933768 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: [pid: 71938|app: 0|req: 249/497] 10.222.0.53 () {56 vars in 1123 bytes} [Wed Nov 24 16:31:23 2021] GET /identity/v3/projects/service => generated 88 bytes in 70 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 24 16:31:23.940081 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ae42969-6cc0-47a5-ad9d-755f1dbec092 admin admin] Authenticating user token {{(pid=71939) process_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 24 16:31:23.949813 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ae42969-6cc0-47a5-ad9d-755f1dbec092 admin admin] Validating token access rules against request {{(pid=71939) validate_allowed_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 24 16:31:23.954360 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb0a249b-04eb-422b-8b89-470bab0953b3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f2ba2e8375b4e8c8792ee1e22b60427', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '00a5583c7b7443e98e7a1d31a0b638dc', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=71939) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 24 16:31:23.955013 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb0a249b-04eb-422b-8b89-470bab0953b3 admin admin] REQUEST_METHOD: `GET` {{(pid=71939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 24 16:31:23.955354 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb0a249b-04eb-422b-8b89-470bab0953b3 admin admin] SCRIPT_NAME: `/identity` {{(pid=71939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 24 16:31:23.955692 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb0a249b-04eb-422b-8b89-470bab0953b3 admin admin] PATH_INFO: `/v3/projects` {{(pid=71939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 24 16:31:23.956537 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb0a249b-04eb-422b-8b89-470bab0953b3 admin admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=71939) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:161}} Nov 24 16:31:23.956892 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb0a249b-04eb-422b-8b89-470bab0953b3 admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=71939) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:442}} Nov 24 16:31:23.985236 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb0a249b-04eb-422b-8b89-470bab0953b3 admin admin] RBAC: Authorization granted {{(pid=71939) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 24 16:31:24.000699 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: [pid: 71939|app: 0|req: 249/498] 10.222.0.53 () {56 vars in 1160 bytes} [Wed Nov 24 16:31:23 2021] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 62 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 24 16:31:24.009838 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08d49552-2c71-47c1-816a-16255cb9f887 admin admin] Authenticating user token {{(pid=71938) process_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 24 16:31:24.020220 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08d49552-2c71-47c1-816a-16255cb9f887 admin admin] Validating token access rules against request {{(pid=71938) validate_allowed_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 24 16:31:24.024514 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd7f6869-439f-49a5-b897-1a0db0e54453 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f2ba2e8375b4e8c8792ee1e22b60427', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '00a5583c7b7443e98e7a1d31a0b638dc', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=71938) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 24 16:31:24.025174 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd7f6869-439f-49a5-b897-1a0db0e54453 admin admin] REQUEST_METHOD: `GET` {{(pid=71938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 24 16:31:24.025515 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd7f6869-439f-49a5-b897-1a0db0e54453 admin admin] SCRIPT_NAME: `/identity` {{(pid=71938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 24 16:31:24.025849 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd7f6869-439f-49a5-b897-1a0db0e54453 admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=71938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 24 16:31:24.026781 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd7f6869-439f-49a5-b897-1a0db0e54453 admin admin] RBAC: Adding query filter params (role.id=5611724e350b41e19921b5961a342582, scope.project.id=3b3940d4ae1c4177ae29c02377bb4b0b, user.id=3e196802d4d5432482b6d2eabc25f74e) {{(pid=71938) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:161}} Nov 24 16:31:24.027148 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd7f6869-439f-49a5-b897-1a0db0e54453 admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=71938) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:442}} Nov 24 16:31:24.056566 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd7f6869-439f-49a5-b897-1a0db0e54453 admin admin] RBAC: Authorization granted {{(pid=71938) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 24 16:31:24.063071 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: [pid: 71938|app: 0|req: 250/499] 10.222.0.53 () {56 vars in 1386 bytes} [Wed Nov 24 16:31:24 2021] GET /identity/v3/role_assignments?user.id=3e196802d4d5432482b6d2eabc25f74e&scope.project.id=3b3940d4ae1c4177ae29c02377bb4b0b&role.id=5611724e350b41e19921b5961a342582 => generated 608 bytes in 55 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 24 16:31:26.057206 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c150302a-4f2e-449b-ab48-591172994d6c None None] REQUEST_METHOD: `GET` {{(pid=71939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 24 16:31:26.057733 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c150302a-4f2e-449b-ab48-591172994d6c None None] SCRIPT_NAME: `/identity` {{(pid=71939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 24 16:31:26.057855 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c150302a-4f2e-449b-ab48-591172994d6c None None] PATH_INFO: `/` {{(pid=71939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 24 16:31:26.059706 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: [pid: 71939|app: 0|req: 250/500] 10.222.0.53 () {54 vars in 915 bytes} [Wed Nov 24 16:31:26 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 24 16:31:26.065311 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6842c2f-f4b9-48e6-9ffb-9db1adfaee71 None None] REQUEST_METHOD: `POST` {{(pid=71938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 24 16:31:26.065665 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6842c2f-f4b9-48e6-9ffb-9db1adfaee71 None None] SCRIPT_NAME: `/identity` {{(pid=71938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 24 16:31:26.066006 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6842c2f-f4b9-48e6-9ffb-9db1adfaee71 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=71938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 24 16:31:26.090431 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.auth.core [None req-f6842c2f-f4b9-48e6-9ffb-9db1adfaee71 None None] MFA Rules not processed for user `0f2ba2e8375b4e8c8792ee1e22b60427`. Rule list: `[]` (Enabled: `True`). {{(pid=71938) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:442}} Nov 24 16:31:26.091657 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.fernet_utils [None req-f6842c2f-f4b9-48e6-9ffb-9db1adfaee71 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=71938) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:289}} Nov 24 16:31:26.099218 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: [pid: 71938|app: 0|req: 251/501] 10.222.0.53 () {58 vars in 1013 bytes} [Wed Nov 24 16:31:26 2021] POST /identity/v3/auth/tokens => generated 1067 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 24 16:31:26.120806 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e014e5af-4a96-4610-ba36-8ac1b9d51446 None None] REQUEST_METHOD: `POST` {{(pid=71939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 24 16:31:26.121148 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e014e5af-4a96-4610-ba36-8ac1b9d51446 None None] SCRIPT_NAME: `/identity` {{(pid=71939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 24 16:31:26.121479 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e014e5af-4a96-4610-ba36-8ac1b9d51446 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=71939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 24 16:31:26.145380 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.auth.core [None req-e014e5af-4a96-4610-ba36-8ac1b9d51446 None None] MFA Rules not processed for user `0f2ba2e8375b4e8c8792ee1e22b60427`. Rule list: `[]` (Enabled: `True`). {{(pid=71939) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:442}} Nov 24 16:31:26.146638 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.fernet_utils [None req-e014e5af-4a96-4610-ba36-8ac1b9d51446 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=71939) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:289}} Nov 24 16:31:26.153562 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: [pid: 71939|app: 0|req: 251/502] 10.222.0.53 () {58 vars in 1013 bytes} [Wed Nov 24 16:31:26 2021] POST /identity/v3/auth/tokens => generated 1067 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 24 16:31:26.159972 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6842c2f-f4b9-48e6-9ffb-9db1adfaee71 None None] Authenticating user token {{(pid=71938) process_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 24 16:31:26.169671 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6842c2f-f4b9-48e6-9ffb-9db1adfaee71 None None] Validating token access rules against request {{(pid=71938) validate_allowed_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 24 16:31:26.173903 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8c77234-b6d3-4190-91e4-0047f01f2217 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f2ba2e8375b4e8c8792ee1e22b60427', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '00a5583c7b7443e98e7a1d31a0b638dc', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=71938) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 24 16:31:26.174759 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8c77234-b6d3-4190-91e4-0047f01f2217 admin admin] REQUEST_METHOD: `GET` {{(pid=71938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 24 16:31:26.175100 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8c77234-b6d3-4190-91e4-0047f01f2217 admin admin] SCRIPT_NAME: `/identity` {{(pid=71938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 24 16:31:26.175430 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8c77234-b6d3-4190-91e4-0047f01f2217 admin admin] PATH_INFO: `/v3/services/compute_legacy` {{(pid=71938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 24 16:31:26.176147 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8c77234-b6d3-4190-91e4-0047f01f2217 admin admin] RBAC: Authorizing `identity:get_service(service_id=compute_legacy)` {{(pid=71938) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:442}} Nov 24 16:31:26.204005 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: WARNING py.warnings [None req-d8c77234-b6d3-4190-91e4-0047f01f2217 admin admin] /usr/local/lib/python3.6/dist-packages/oslo_policy/policy.py:1018: UserWarning: Policy identity:get_service failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 24 16:31:26.204005 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: warnings.warn(msg) Nov 24 16:31:26.204005 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: Nov 24 16:31:26.205525 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8c77234-b6d3-4190-91e4-0047f01f2217 admin admin] RBAC: Authorization granted {{(pid=71938) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 24 16:31:26.218442 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: WARNING keystone.server.flask.application [None req-d8c77234-b6d3-4190-91e4-0047f01f2217 admin admin] Could not find service: compute_legacy.: keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Nov 24 16:31:26.219630 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: [pid: 71938|app: 0|req: 252/503] 10.222.0.53 () {56 vars in 1144 bytes} [Wed Nov 24 16:31:26 2021] GET /identity/v3/services/compute_legacy => generated 95 bytes in 60 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 24 16:31:26.226836 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e014e5af-4a96-4610-ba36-8ac1b9d51446 None None] Authenticating user token {{(pid=71939) process_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 24 16:31:26.236038 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e014e5af-4a96-4610-ba36-8ac1b9d51446 None None] Validating token access rules against request {{(pid=71939) validate_allowed_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 24 16:31:26.240313 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89276b68-4201-4837-9971-ef2453147ee4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f2ba2e8375b4e8c8792ee1e22b60427', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '00a5583c7b7443e98e7a1d31a0b638dc', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=71939) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 24 16:31:26.240980 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89276b68-4201-4837-9971-ef2453147ee4 admin admin] REQUEST_METHOD: `GET` {{(pid=71939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 24 16:31:26.241324 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89276b68-4201-4837-9971-ef2453147ee4 admin admin] SCRIPT_NAME: `/identity` {{(pid=71939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 24 16:31:26.241661 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89276b68-4201-4837-9971-ef2453147ee4 admin admin] PATH_INFO: `/v3/services` {{(pid=71939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 24 16:31:26.242473 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89276b68-4201-4837-9971-ef2453147ee4 admin admin] RBAC: Adding query filter params (name=compute_legacy) {{(pid=71939) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:161}} Nov 24 16:31:26.242828 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89276b68-4201-4837-9971-ef2453147ee4 admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=71939) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:442}} Nov 24 16:31:26.270628 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: WARNING py.warnings [None req-89276b68-4201-4837-9971-ef2453147ee4 admin admin] /usr/local/lib/python3.6/dist-packages/oslo_policy/policy.py:1018: UserWarning: Policy identity:list_services failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 24 16:31:26.270628 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: warnings.warn(msg) Nov 24 16:31:26.270628 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: Nov 24 16:31:26.271650 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89276b68-4201-4837-9971-ef2453147ee4 admin admin] RBAC: Authorization granted {{(pid=71939) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 24 16:31:26.276138 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: [pid: 71939|app: 0|req: 252/504] 10.222.0.53 () {56 vars in 1138 bytes} [Wed Nov 24 16:31:26 2021] GET /identity/v3/services?name=compute_legacy => generated 131 bytes in 50 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 24 16:31:26.281569 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8c77234-b6d3-4190-91e4-0047f01f2217 admin admin] Authenticating user token {{(pid=71938) process_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 24 16:31:26.291987 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8c77234-b6d3-4190-91e4-0047f01f2217 admin admin] Validating token access rules against request {{(pid=71938) validate_allowed_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 24 16:31:26.296193 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdf92cca-a289-4b34-9ca0-246148d03c62 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f2ba2e8375b4e8c8792ee1e22b60427', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '00a5583c7b7443e98e7a1d31a0b638dc', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=71938) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 24 16:31:26.296857 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdf92cca-a289-4b34-9ca0-246148d03c62 admin admin] REQUEST_METHOD: `GET` {{(pid=71938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 24 16:31:26.297198 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdf92cca-a289-4b34-9ca0-246148d03c62 admin admin] SCRIPT_NAME: `/identity` {{(pid=71938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 24 16:31:26.297529 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdf92cca-a289-4b34-9ca0-246148d03c62 admin admin] PATH_INFO: `/v3/services` {{(pid=71938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 24 16:31:26.298321 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdf92cca-a289-4b34-9ca0-246148d03c62 admin admin] RBAC: Adding query filter params (type=compute_legacy) {{(pid=71938) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:161}} Nov 24 16:31:26.298670 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdf92cca-a289-4b34-9ca0-246148d03c62 admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=71938) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:442}} Nov 24 16:31:26.326137 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: WARNING py.warnings [None req-bdf92cca-a289-4b34-9ca0-246148d03c62 admin admin] /usr/local/lib/python3.6/dist-packages/oslo_policy/policy.py:1018: UserWarning: Policy identity:list_services failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 24 16:31:26.326137 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: warnings.warn(msg) Nov 24 16:31:26.326137 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: Nov 24 16:31:26.327094 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdf92cca-a289-4b34-9ca0-246148d03c62 admin admin] RBAC: Authorization granted {{(pid=71938) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 24 16:31:26.333138 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: [pid: 71938|app: 0|req: 253/505] 10.222.0.53 () {56 vars in 1138 bytes} [Wed Nov 24 16:31:26 2021] GET /identity/v3/services?type=compute_legacy => generated 131 bytes in 52 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 24 16:31:28.349690 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39ede7ba-af68-49f8-9aab-2e397074d2df None None] REQUEST_METHOD: `GET` {{(pid=71939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 24 16:31:28.350406 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39ede7ba-af68-49f8-9aab-2e397074d2df None None] SCRIPT_NAME: `/identity` {{(pid=71939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 24 16:31:28.350406 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39ede7ba-af68-49f8-9aab-2e397074d2df None None] PATH_INFO: `/` {{(pid=71939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 24 16:31:28.352211 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: [pid: 71939|app: 0|req: 253/506] 10.222.0.53 () {54 vars in 915 bytes} [Wed Nov 24 16:31:28 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 24 16:31:28.358292 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-765bc470-eca6-482f-948e-8ccc1019d162 None None] REQUEST_METHOD: `POST` {{(pid=71938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 24 16:31:28.358648 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-765bc470-eca6-482f-948e-8ccc1019d162 None None] SCRIPT_NAME: `/identity` {{(pid=71938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 24 16:31:28.358974 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-765bc470-eca6-482f-948e-8ccc1019d162 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=71938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 24 16:31:28.386149 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.auth.core [None req-765bc470-eca6-482f-948e-8ccc1019d162 None None] MFA Rules not processed for user `0f2ba2e8375b4e8c8792ee1e22b60427`. Rule list: `[]` (Enabled: `True`). {{(pid=71938) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:442}} Nov 24 16:31:28.387369 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.fernet_utils [None req-765bc470-eca6-482f-948e-8ccc1019d162 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=71938) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:289}} Nov 24 16:31:28.394481 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: [pid: 71938|app: 0|req: 254/507] 10.222.0.53 () {58 vars in 1013 bytes} [Wed Nov 24 16:31:28 2021] POST /identity/v3/auth/tokens => generated 1067 bytes in 37 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 24 16:31:28.416122 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7efe042-6b1e-436c-9eb9-67f2089bb144 None None] REQUEST_METHOD: `POST` {{(pid=71939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 24 16:31:28.416480 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7efe042-6b1e-436c-9eb9-67f2089bb144 None None] SCRIPT_NAME: `/identity` {{(pid=71939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 24 16:31:28.416822 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7efe042-6b1e-436c-9eb9-67f2089bb144 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=71939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 24 16:31:28.443476 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.auth.core [None req-a7efe042-6b1e-436c-9eb9-67f2089bb144 None None] MFA Rules not processed for user `0f2ba2e8375b4e8c8792ee1e22b60427`. Rule list: `[]` (Enabled: `True`). {{(pid=71939) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:442}} Nov 24 16:31:28.444692 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.fernet_utils [None req-a7efe042-6b1e-436c-9eb9-67f2089bb144 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=71939) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:289}} Nov 24 16:31:28.451735 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: [pid: 71939|app: 0|req: 254/508] 10.222.0.53 () {58 vars in 1013 bytes} [Wed Nov 24 16:31:28 2021] POST /identity/v3/auth/tokens => generated 1067 bytes in 37 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 24 16:31:28.457538 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-765bc470-eca6-482f-948e-8ccc1019d162 None None] Authenticating user token {{(pid=71938) process_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 24 16:31:28.467101 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-765bc470-eca6-482f-948e-8ccc1019d162 None None] Validating token access rules against request {{(pid=71938) validate_allowed_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 24 16:31:28.471286 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84c0b46f-d924-441d-bf2e-e6585d3a998e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f2ba2e8375b4e8c8792ee1e22b60427', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '00a5583c7b7443e98e7a1d31a0b638dc', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=71938) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 24 16:31:28.471948 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84c0b46f-d924-441d-bf2e-e6585d3a998e admin admin] REQUEST_METHOD: `POST` {{(pid=71938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 24 16:31:28.472290 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84c0b46f-d924-441d-bf2e-e6585d3a998e admin admin] SCRIPT_NAME: `/identity` {{(pid=71938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 24 16:31:28.472626 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84c0b46f-d924-441d-bf2e-e6585d3a998e admin admin] PATH_INFO: `/v3/services` {{(pid=71938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 24 16:31:28.473391 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84c0b46f-d924-441d-bf2e-e6585d3a998e admin admin] RBAC: Authorizing `identity:create_service()` {{(pid=71938) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:442}} Nov 24 16:31:28.501253 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: WARNING py.warnings [None req-84c0b46f-d924-441d-bf2e-e6585d3a998e admin admin] /usr/local/lib/python3.6/dist-packages/oslo_policy/policy.py:1018: UserWarning: Policy identity:create_service failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 24 16:31:28.501253 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: warnings.warn(msg) Nov 24 16:31:28.501253 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: Nov 24 16:31:28.502900 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84c0b46f-d924-441d-bf2e-e6585d3a998e admin admin] RBAC: Authorization granted {{(pid=71938) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 24 16:31:28.515857 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: [pid: 71938|app: 0|req: 255/509] 10.222.0.53 () {60 vars in 1153 bytes} [Wed Nov 24 16:31:28 2021] POST /identity/v3/services => generated 269 bytes in 59 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 24 16:31:30.506924 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ae47f73-42a4-4940-a315-67659cda2fdb None None] REQUEST_METHOD: `GET` {{(pid=71939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 24 16:31:30.507468 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ae47f73-42a4-4940-a315-67659cda2fdb None None] SCRIPT_NAME: `/identity` {{(pid=71939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 24 16:31:30.507468 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ae47f73-42a4-4940-a315-67659cda2fdb None None] PATH_INFO: `/` {{(pid=71939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 24 16:31:30.509309 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: [pid: 71939|app: 0|req: 255/510] 10.222.0.53 () {54 vars in 915 bytes} [Wed Nov 24 16:31:30 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 24 16:31:30.515529 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c34d21c5-346a-4548-ae5a-8508951c15a6 None None] REQUEST_METHOD: `POST` {{(pid=71938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 24 16:31:30.515875 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c34d21c5-346a-4548-ae5a-8508951c15a6 None None] SCRIPT_NAME: `/identity` {{(pid=71938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 24 16:31:30.516209 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c34d21c5-346a-4548-ae5a-8508951c15a6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=71938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 24 16:31:30.541704 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.auth.core [None req-c34d21c5-346a-4548-ae5a-8508951c15a6 None None] MFA Rules not processed for user `0f2ba2e8375b4e8c8792ee1e22b60427`. Rule list: `[]` (Enabled: `True`). {{(pid=71938) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:442}} Nov 24 16:31:30.542967 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.fernet_utils [None req-c34d21c5-346a-4548-ae5a-8508951c15a6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=71938) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:289}} Nov 24 16:31:30.561128 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: [pid: 71938|app: 0|req: 256/511] 10.222.0.53 () {58 vars in 1013 bytes} [Wed Nov 24 16:31:30 2021] POST /identity/v3/auth/tokens => generated 1177 bytes in 47 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 24 16:31:30.584208 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83fc8e88-fe7d-4657-9e41-28fe0e60817b None None] REQUEST_METHOD: `POST` {{(pid=71939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 24 16:31:30.584633 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83fc8e88-fe7d-4657-9e41-28fe0e60817b None None] SCRIPT_NAME: `/identity` {{(pid=71939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 24 16:31:30.585112 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83fc8e88-fe7d-4657-9e41-28fe0e60817b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=71939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 24 16:31:30.609237 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.auth.core [None req-83fc8e88-fe7d-4657-9e41-28fe0e60817b None None] MFA Rules not processed for user `0f2ba2e8375b4e8c8792ee1e22b60427`. Rule list: `[]` (Enabled: `True`). {{(pid=71939) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:442}} Nov 24 16:31:30.610523 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.fernet_utils [None req-83fc8e88-fe7d-4657-9e41-28fe0e60817b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=71939) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:289}} Nov 24 16:31:30.617649 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: [pid: 71939|app: 0|req: 256/512] 10.222.0.53 () {58 vars in 1013 bytes} [Wed Nov 24 16:31:30 2021] POST /identity/v3/auth/tokens => generated 1177 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 24 16:31:30.623549 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c34d21c5-346a-4548-ae5a-8508951c15a6 None None] Authenticating user token {{(pid=71938) process_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 24 16:31:30.633397 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c34d21c5-346a-4548-ae5a-8508951c15a6 None None] Validating token access rules against request {{(pid=71938) validate_allowed_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 24 16:31:30.637884 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c19c8b14-cafb-4ea7-b16e-f43ce4924f9e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f2ba2e8375b4e8c8792ee1e22b60427', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '00a5583c7b7443e98e7a1d31a0b638dc', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=71938) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 24 16:31:30.638736 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c19c8b14-cafb-4ea7-b16e-f43ce4924f9e admin admin] REQUEST_METHOD: `GET` {{(pid=71938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 24 16:31:30.639079 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c19c8b14-cafb-4ea7-b16e-f43ce4924f9e admin admin] SCRIPT_NAME: `/identity` {{(pid=71938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 24 16:31:30.639414 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c19c8b14-cafb-4ea7-b16e-f43ce4924f9e admin admin] PATH_INFO: `/v3/services/compute_legacy` {{(pid=71938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 24 16:31:30.640129 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c19c8b14-cafb-4ea7-b16e-f43ce4924f9e admin admin] RBAC: Authorizing `identity:get_service(service_id=compute_legacy)` {{(pid=71938) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:442}} Nov 24 16:31:30.670287 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c19c8b14-cafb-4ea7-b16e-f43ce4924f9e admin admin] RBAC: Authorization granted {{(pid=71938) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 24 16:31:30.682953 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: WARNING keystone.server.flask.application [None req-c19c8b14-cafb-4ea7-b16e-f43ce4924f9e admin admin] Could not find service: compute_legacy.: keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Nov 24 16:31:30.684195 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: [pid: 71938|app: 0|req: 257/513] 10.222.0.53 () {56 vars in 1144 bytes} [Wed Nov 24 16:31:30 2021] GET /identity/v3/services/compute_legacy => generated 95 bytes in 61 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 24 16:31:30.691000 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83fc8e88-fe7d-4657-9e41-28fe0e60817b None None] Authenticating user token {{(pid=71939) process_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 24 16:31:30.700328 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83fc8e88-fe7d-4657-9e41-28fe0e60817b None None] Validating token access rules against request {{(pid=71939) validate_allowed_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 24 16:31:30.705453 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-813e8360-048f-4fc9-b67f-aa6f5516cb56 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f2ba2e8375b4e8c8792ee1e22b60427', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '00a5583c7b7443e98e7a1d31a0b638dc', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=71939) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 24 16:31:30.706149 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-813e8360-048f-4fc9-b67f-aa6f5516cb56 admin admin] REQUEST_METHOD: `GET` {{(pid=71939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 24 16:31:30.706491 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-813e8360-048f-4fc9-b67f-aa6f5516cb56 admin admin] SCRIPT_NAME: `/identity` {{(pid=71939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 24 16:31:30.706823 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-813e8360-048f-4fc9-b67f-aa6f5516cb56 admin admin] PATH_INFO: `/v3/services` {{(pid=71939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 24 16:31:30.707599 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-813e8360-048f-4fc9-b67f-aa6f5516cb56 admin admin] RBAC: Adding query filter params (name=compute_legacy) {{(pid=71939) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:161}} Nov 24 16:31:30.707949 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-813e8360-048f-4fc9-b67f-aa6f5516cb56 admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=71939) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:442}} Nov 24 16:31:30.736430 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-813e8360-048f-4fc9-b67f-aa6f5516cb56 admin admin] RBAC: Authorization granted {{(pid=71939) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 24 16:31:30.741617 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: [pid: 71939|app: 0|req: 257/514] 10.222.0.53 () {56 vars in 1138 bytes} [Wed Nov 24 16:31:30 2021] GET /identity/v3/services?name=compute_legacy => generated 131 bytes in 51 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 24 16:31:30.747681 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c19c8b14-cafb-4ea7-b16e-f43ce4924f9e admin admin] Authenticating user token {{(pid=71938) process_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 24 16:31:30.758003 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c19c8b14-cafb-4ea7-b16e-f43ce4924f9e admin admin] Validating token access rules against request {{(pid=71938) validate_allowed_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 24 16:31:30.762322 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b0dc636-c152-438b-a2a9-4cf8bbef8510 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f2ba2e8375b4e8c8792ee1e22b60427', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '00a5583c7b7443e98e7a1d31a0b638dc', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=71938) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 24 16:31:30.762996 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b0dc636-c152-438b-a2a9-4cf8bbef8510 admin admin] REQUEST_METHOD: `GET` {{(pid=71938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 24 16:31:30.763334 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b0dc636-c152-438b-a2a9-4cf8bbef8510 admin admin] SCRIPT_NAME: `/identity` {{(pid=71938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 24 16:31:30.763662 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b0dc636-c152-438b-a2a9-4cf8bbef8510 admin admin] PATH_INFO: `/v3/services` {{(pid=71938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 24 16:31:30.764426 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b0dc636-c152-438b-a2a9-4cf8bbef8510 admin admin] RBAC: Adding query filter params (type=compute_legacy) {{(pid=71938) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:161}} Nov 24 16:31:30.764772 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b0dc636-c152-438b-a2a9-4cf8bbef8510 admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=71938) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:442}} Nov 24 16:31:30.793914 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b0dc636-c152-438b-a2a9-4cf8bbef8510 admin admin] RBAC: Authorization granted {{(pid=71938) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 24 16:31:30.800665 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: [pid: 71938|app: 0|req: 258/515] 10.222.0.53 () {56 vars in 1138 bytes} [Wed Nov 24 16:31:30 2021] GET /identity/v3/services?type=compute_legacy => generated 386 bytes in 54 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 24 16:31:30.807625 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-813e8360-048f-4fc9-b67f-aa6f5516cb56 admin admin] Authenticating user token {{(pid=71939) process_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 24 16:31:30.818334 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-813e8360-048f-4fc9-b67f-aa6f5516cb56 admin admin] Validating token access rules against request {{(pid=71939) validate_allowed_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 24 16:31:30.823619 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-624c10cc-e67b-459b-81b6-6961c1535d3b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f2ba2e8375b4e8c8792ee1e22b60427', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '00a5583c7b7443e98e7a1d31a0b638dc', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=71939) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 24 16:31:30.824283 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-624c10cc-e67b-459b-81b6-6961c1535d3b admin admin] REQUEST_METHOD: `GET` {{(pid=71939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 24 16:31:30.824629 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-624c10cc-e67b-459b-81b6-6961c1535d3b admin admin] SCRIPT_NAME: `/identity` {{(pid=71939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 24 16:31:30.825022 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-624c10cc-e67b-459b-81b6-6961c1535d3b admin admin] PATH_INFO: `/v3/endpoints` {{(pid=71939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 24 16:31:30.826110 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-624c10cc-e67b-459b-81b6-6961c1535d3b admin admin] RBAC: Adding query filter params (interface=public, service_id=0b3f0144319449f3874a54322f4e09ae, region_id=RegionOne) {{(pid=71939) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:161}} Nov 24 16:31:30.826475 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-624c10cc-e67b-459b-81b6-6961c1535d3b admin admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=71939) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:442}} Nov 24 16:31:30.855038 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: WARNING py.warnings [None req-624c10cc-e67b-459b-81b6-6961c1535d3b admin admin] /usr/local/lib/python3.6/dist-packages/oslo_policy/policy.py:1018: UserWarning: Policy identity:list_endpoints failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 24 16:31:30.855038 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: warnings.warn(msg) Nov 24 16:31:30.855038 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: Nov 24 16:31:30.856046 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-624c10cc-e67b-459b-81b6-6961c1535d3b admin admin] RBAC: Authorization granted {{(pid=71939) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 24 16:31:30.863648 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: [pid: 71939|app: 0|req: 258/516] 10.222.0.53 () {56 vars in 1263 bytes} [Wed Nov 24 16:31:30 2021] GET /identity/v3/endpoints?service_id=0b3f0144319449f3874a54322f4e09ae&interface=public®ion_id=RegionOne => generated 194 bytes in 57 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 24 16:31:30.869573 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b0dc636-c152-438b-a2a9-4cf8bbef8510 admin admin] Authenticating user token {{(pid=71938) process_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 24 16:31:30.879308 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b0dc636-c152-438b-a2a9-4cf8bbef8510 admin admin] Validating token access rules against request {{(pid=71938) validate_allowed_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 24 16:31:30.883470 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87bc94fb-57ad-45b0-89d2-2db928490b64 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f2ba2e8375b4e8c8792ee1e22b60427', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '00a5583c7b7443e98e7a1d31a0b638dc', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=71938) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 24 16:31:30.884130 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87bc94fb-57ad-45b0-89d2-2db928490b64 admin admin] REQUEST_METHOD: `GET` {{(pid=71938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 24 16:31:30.884466 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87bc94fb-57ad-45b0-89d2-2db928490b64 admin admin] SCRIPT_NAME: `/identity` {{(pid=71938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 24 16:31:30.884797 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87bc94fb-57ad-45b0-89d2-2db928490b64 admin admin] PATH_INFO: `/v3/services` {{(pid=71938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 24 16:31:30.885527 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87bc94fb-57ad-45b0-89d2-2db928490b64 admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=71938) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:442}} Nov 24 16:31:30.914599 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87bc94fb-57ad-45b0-89d2-2db928490b64 admin admin] RBAC: Authorization granted {{(pid=71938) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 24 16:31:30.919576 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: [pid: 71938|app: 0|req: 259/517] 10.222.0.53 () {56 vars in 1099 bytes} [Wed Nov 24 16:31:30 2021] GET /identity/v3/services => generated 562 bytes in 51 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 24 16:31:32.890706 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cf5423a-069b-4dac-92a0-4241dc138327 None None] REQUEST_METHOD: `GET` {{(pid=71939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 24 16:31:32.891262 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cf5423a-069b-4dac-92a0-4241dc138327 None None] SCRIPT_NAME: `/identity` {{(pid=71939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 24 16:31:32.891378 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cf5423a-069b-4dac-92a0-4241dc138327 None None] PATH_INFO: `/` {{(pid=71939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 24 16:31:32.893721 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: [pid: 71939|app: 0|req: 259/518] 10.222.0.53 () {54 vars in 915 bytes} [Wed Nov 24 16:31:32 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 24 16:31:32.899561 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2655b58b-ce3b-4ecd-9e83-0be017a9c29f None None] REQUEST_METHOD: `POST` {{(pid=71938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 24 16:31:32.899916 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2655b58b-ce3b-4ecd-9e83-0be017a9c29f None None] SCRIPT_NAME: `/identity` {{(pid=71938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 24 16:31:32.900254 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2655b58b-ce3b-4ecd-9e83-0be017a9c29f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=71938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 24 16:31:32.924541 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.auth.core [None req-2655b58b-ce3b-4ecd-9e83-0be017a9c29f None None] MFA Rules not processed for user `0f2ba2e8375b4e8c8792ee1e22b60427`. Rule list: `[]` (Enabled: `True`). {{(pid=71938) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:442}} Nov 24 16:31:32.925764 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.fernet_utils [None req-2655b58b-ce3b-4ecd-9e83-0be017a9c29f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=71938) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:289}} Nov 24 16:31:32.932749 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: [pid: 71938|app: 0|req: 260/519] 10.222.0.53 () {58 vars in 1013 bytes} [Wed Nov 24 16:31:32 2021] POST /identity/v3/auth/tokens => generated 1177 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 24 16:31:32.955619 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54a4a708-094a-458b-be17-12814fe234ae None None] REQUEST_METHOD: `POST` {{(pid=71939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 24 16:31:32.955963 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54a4a708-094a-458b-be17-12814fe234ae None None] SCRIPT_NAME: `/identity` {{(pid=71939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 24 16:31:32.956303 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54a4a708-094a-458b-be17-12814fe234ae None None] PATH_INFO: `/v3/auth/tokens` {{(pid=71939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 24 16:31:32.980038 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.auth.core [None req-54a4a708-094a-458b-be17-12814fe234ae None None] MFA Rules not processed for user `0f2ba2e8375b4e8c8792ee1e22b60427`. Rule list: `[]` (Enabled: `True`). {{(pid=71939) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:442}} Nov 24 16:31:32.981253 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.fernet_utils [None req-54a4a708-094a-458b-be17-12814fe234ae None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=71939) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:289}} Nov 24 16:31:32.988286 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: [pid: 71939|app: 0|req: 260/520] 10.222.0.53 () {58 vars in 1013 bytes} [Wed Nov 24 16:31:32 2021] POST /identity/v3/auth/tokens => generated 1177 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 24 16:31:32.993695 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2655b58b-ce3b-4ecd-9e83-0be017a9c29f None None] Authenticating user token {{(pid=71938) process_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 24 16:31:33.003113 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2655b58b-ce3b-4ecd-9e83-0be017a9c29f None None] Validating token access rules against request {{(pid=71938) validate_allowed_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 24 16:31:33.007244 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-465c0bcc-d20c-4750-add3-c17f0666d87b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f2ba2e8375b4e8c8792ee1e22b60427', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '00a5583c7b7443e98e7a1d31a0b638dc', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=71938) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 24 16:31:33.008062 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-465c0bcc-d20c-4750-add3-c17f0666d87b admin admin] REQUEST_METHOD: `GET` {{(pid=71938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 24 16:31:33.008394 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-465c0bcc-d20c-4750-add3-c17f0666d87b admin admin] SCRIPT_NAME: `/identity` {{(pid=71938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 24 16:31:33.008724 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-465c0bcc-d20c-4750-add3-c17f0666d87b admin admin] PATH_INFO: `/v3/services/compute_legacy` {{(pid=71938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 24 16:31:33.009424 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-465c0bcc-d20c-4750-add3-c17f0666d87b admin admin] RBAC: Authorizing `identity:get_service(service_id=compute_legacy)` {{(pid=71938) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:442}} Nov 24 16:31:33.038858 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-465c0bcc-d20c-4750-add3-c17f0666d87b admin admin] RBAC: Authorization granted {{(pid=71938) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 24 16:31:33.051617 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: WARNING keystone.server.flask.application [None req-465c0bcc-d20c-4750-add3-c17f0666d87b admin admin] Could not find service: compute_legacy.: keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Nov 24 16:31:33.052865 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: [pid: 71938|app: 0|req: 261/521] 10.222.0.53 () {56 vars in 1144 bytes} [Wed Nov 24 16:31:32 2021] GET /identity/v3/services/compute_legacy => generated 95 bytes in 60 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 24 16:31:33.059562 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54a4a708-094a-458b-be17-12814fe234ae None None] Authenticating user token {{(pid=71939) process_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 24 16:31:33.068631 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54a4a708-094a-458b-be17-12814fe234ae None None] Validating token access rules against request {{(pid=71939) validate_allowed_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 24 16:31:33.072825 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b855448-c729-4b82-9ddf-78a6bf051d51 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f2ba2e8375b4e8c8792ee1e22b60427', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '00a5583c7b7443e98e7a1d31a0b638dc', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=71939) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 24 16:31:33.073482 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b855448-c729-4b82-9ddf-78a6bf051d51 admin admin] REQUEST_METHOD: `GET` {{(pid=71939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 24 16:31:33.073818 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b855448-c729-4b82-9ddf-78a6bf051d51 admin admin] SCRIPT_NAME: `/identity` {{(pid=71939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 24 16:31:33.074177 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b855448-c729-4b82-9ddf-78a6bf051d51 admin admin] PATH_INFO: `/v3/services` {{(pid=71939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 24 16:31:33.074938 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b855448-c729-4b82-9ddf-78a6bf051d51 admin admin] RBAC: Adding query filter params (name=compute_legacy) {{(pid=71939) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:161}} Nov 24 16:31:33.075285 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b855448-c729-4b82-9ddf-78a6bf051d51 admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=71939) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:442}} Nov 24 16:31:33.104246 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b855448-c729-4b82-9ddf-78a6bf051d51 admin admin] RBAC: Authorization granted {{(pid=71939) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 24 16:31:33.108684 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: [pid: 71939|app: 0|req: 261/522] 10.222.0.53 () {56 vars in 1138 bytes} [Wed Nov 24 16:31:33 2021] GET /identity/v3/services?name=compute_legacy => generated 131 bytes in 50 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 24 16:31:33.114343 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-465c0bcc-d20c-4750-add3-c17f0666d87b admin admin] Authenticating user token {{(pid=71938) process_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 24 16:31:33.124017 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-465c0bcc-d20c-4750-add3-c17f0666d87b admin admin] Validating token access rules against request {{(pid=71938) validate_allowed_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 24 16:31:33.128174 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f05e4b2-30f7-4f94-8835-90825b9a8a1f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f2ba2e8375b4e8c8792ee1e22b60427', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '00a5583c7b7443e98e7a1d31a0b638dc', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=71938) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 24 16:31:33.128827 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f05e4b2-30f7-4f94-8835-90825b9a8a1f admin admin] REQUEST_METHOD: `GET` {{(pid=71938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 24 16:31:33.129163 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f05e4b2-30f7-4f94-8835-90825b9a8a1f admin admin] SCRIPT_NAME: `/identity` {{(pid=71938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 24 16:31:33.129491 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f05e4b2-30f7-4f94-8835-90825b9a8a1f admin admin] PATH_INFO: `/v3/services` {{(pid=71938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 24 16:31:33.130269 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f05e4b2-30f7-4f94-8835-90825b9a8a1f admin admin] RBAC: Adding query filter params (type=compute_legacy) {{(pid=71938) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:161}} Nov 24 16:31:33.130619 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f05e4b2-30f7-4f94-8835-90825b9a8a1f admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=71938) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:442}} Nov 24 16:31:33.159894 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f05e4b2-30f7-4f94-8835-90825b9a8a1f admin admin] RBAC: Authorization granted {{(pid=71938) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 24 16:31:33.164887 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: [pid: 71938|app: 0|req: 262/523] 10.222.0.53 () {56 vars in 1138 bytes} [Wed Nov 24 16:31:33 2021] GET /identity/v3/services?type=compute_legacy => generated 386 bytes in 51 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 24 16:31:33.170905 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b855448-c729-4b82-9ddf-78a6bf051d51 admin admin] Authenticating user token {{(pid=71939) process_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 24 16:31:33.181048 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b855448-c729-4b82-9ddf-78a6bf051d51 admin admin] Validating token access rules against request {{(pid=71939) validate_allowed_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 24 16:31:33.185752 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47614901-5bc2-41ba-b08c-76247ddf2b4a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f2ba2e8375b4e8c8792ee1e22b60427', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '00a5583c7b7443e98e7a1d31a0b638dc', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=71939) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 24 16:31:33.186442 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47614901-5bc2-41ba-b08c-76247ddf2b4a admin admin] REQUEST_METHOD: `POST` {{(pid=71939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 24 16:31:33.186786 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47614901-5bc2-41ba-b08c-76247ddf2b4a admin admin] SCRIPT_NAME: `/identity` {{(pid=71939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 24 16:31:33.187120 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47614901-5bc2-41ba-b08c-76247ddf2b4a admin admin] PATH_INFO: `/v3/endpoints` {{(pid=71939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 24 16:31:33.187932 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47614901-5bc2-41ba-b08c-76247ddf2b4a admin admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=71939) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:442}} Nov 24 16:31:33.216514 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: WARNING py.warnings [None req-47614901-5bc2-41ba-b08c-76247ddf2b4a admin admin] /usr/local/lib/python3.6/dist-packages/oslo_policy/policy.py:1018: UserWarning: Policy identity:create_endpoint failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 24 16:31:33.216514 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: warnings.warn(msg) Nov 24 16:31:33.216514 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: Nov 24 16:31:33.217549 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47614901-5bc2-41ba-b08c-76247ddf2b4a admin admin] RBAC: Authorization granted {{(pid=71939) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 24 16:31:33.237797 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: [pid: 71939|app: 0|req: 262/524] 10.222.0.53 () {60 vars in 1156 bytes} [Wed Nov 24 16:31:33 2021] POST /identity/v3/endpoints => generated 347 bytes in 67 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 24 16:31:35.247969 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2886f4cd-fda0-4e54-bb2e-b239d102a260 None None] REQUEST_METHOD: `GET` {{(pid=71938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 24 16:31:35.248499 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2886f4cd-fda0-4e54-bb2e-b239d102a260 None None] SCRIPT_NAME: `/identity` {{(pid=71938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 24 16:31:35.248605 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2886f4cd-fda0-4e54-bb2e-b239d102a260 None None] PATH_INFO: `/` {{(pid=71938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 24 16:31:35.250534 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: [pid: 71938|app: 0|req: 263/525] 10.222.0.53 () {54 vars in 915 bytes} [Wed Nov 24 16:31:35 2021] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 24 16:31:35.256379 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6436d98-c453-4663-9f49-49149cc05584 None None] REQUEST_METHOD: `POST` {{(pid=71939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 24 16:31:35.256732 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6436d98-c453-4663-9f49-49149cc05584 None None] SCRIPT_NAME: `/identity` {{(pid=71939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 24 16:31:35.257069 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6436d98-c453-4663-9f49-49149cc05584 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=71939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 24 16:31:35.281016 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.auth.core [None req-f6436d98-c453-4663-9f49-49149cc05584 None None] MFA Rules not processed for user `0f2ba2e8375b4e8c8792ee1e22b60427`. Rule list: `[]` (Enabled: `True`). {{(pid=71939) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:442}} Nov 24 16:31:35.282266 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.fernet_utils [None req-f6436d98-c453-4663-9f49-49149cc05584 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=71939) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:289}} Nov 24 16:31:35.306016 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: [pid: 71939|app: 0|req: 263/526] 10.222.0.53 () {58 vars in 1013 bytes} [Wed Nov 24 16:31:35 2021] POST /identity/v3/auth/tokens => generated 1364 bytes in 50 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 24 16:31:35.328696 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32f3f435-4782-4fee-b96e-359f5d608457 None None] REQUEST_METHOD: `POST` {{(pid=71938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 24 16:31:35.329065 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32f3f435-4782-4fee-b96e-359f5d608457 None None] SCRIPT_NAME: `/identity` {{(pid=71938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 24 16:31:35.329912 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32f3f435-4782-4fee-b96e-359f5d608457 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=71938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 24 16:31:35.354370 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.auth.core [None req-32f3f435-4782-4fee-b96e-359f5d608457 None None] MFA Rules not processed for user `0f2ba2e8375b4e8c8792ee1e22b60427`. Rule list: `[]` (Enabled: `True`). {{(pid=71938) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:442}} Nov 24 16:31:35.355583 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.fernet_utils [None req-32f3f435-4782-4fee-b96e-359f5d608457 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=71938) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:289}} Nov 24 16:31:35.362829 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: [pid: 71938|app: 0|req: 264/527] 10.222.0.53 () {58 vars in 1013 bytes} [Wed Nov 24 16:31:35 2021] POST /identity/v3/auth/tokens => generated 1364 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 24 16:31:35.368837 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6436d98-c453-4663-9f49-49149cc05584 None None] Authenticating user token {{(pid=71939) process_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 24 16:31:35.378575 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6436d98-c453-4663-9f49-49149cc05584 None None] Validating token access rules against request {{(pid=71939) validate_allowed_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 24 16:31:35.382978 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a857ffc-4151-470b-b47f-1a66a8045a58 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f2ba2e8375b4e8c8792ee1e22b60427', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '00a5583c7b7443e98e7a1d31a0b638dc', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=71939) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 24 16:31:35.383786 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a857ffc-4151-470b-b47f-1a66a8045a58 admin admin] REQUEST_METHOD: `GET` {{(pid=71939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 24 16:31:35.384120 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a857ffc-4151-470b-b47f-1a66a8045a58 admin admin] SCRIPT_NAME: `/identity` {{(pid=71939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 24 16:31:35.384445 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a857ffc-4151-470b-b47f-1a66a8045a58 admin admin] PATH_INFO: `/v3/services/compute` {{(pid=71939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 24 16:31:35.385154 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a857ffc-4151-470b-b47f-1a66a8045a58 admin admin] RBAC: Authorizing `identity:get_service(service_id=compute)` {{(pid=71939) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:442}} Nov 24 16:31:35.413996 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: WARNING py.warnings [None req-9a857ffc-4151-470b-b47f-1a66a8045a58 admin admin] /usr/local/lib/python3.6/dist-packages/oslo_policy/policy.py:1018: UserWarning: Policy identity:get_service failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 24 16:31:35.413996 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: warnings.warn(msg) Nov 24 16:31:35.413996 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: Nov 24 16:31:35.415044 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a857ffc-4151-470b-b47f-1a66a8045a58 admin admin] RBAC: Authorization granted {{(pid=71939) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 24 16:31:35.427992 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: WARNING keystone.server.flask.application [None req-9a857ffc-4151-470b-b47f-1a66a8045a58 admin admin] Could not find service: compute.: keystone.exception.ServiceNotFound: Could not find service: compute. Nov 24 16:31:35.429232 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: [pid: 71939|app: 0|req: 264/528] 10.222.0.53 () {56 vars in 1123 bytes} [Wed Nov 24 16:31:35 2021] GET /identity/v3/services/compute => generated 88 bytes in 61 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 24 16:31:35.436110 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32f3f435-4782-4fee-b96e-359f5d608457 None None] Authenticating user token {{(pid=71938) process_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 24 16:31:35.446376 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32f3f435-4782-4fee-b96e-359f5d608457 None None] Validating token access rules against request {{(pid=71938) validate_allowed_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 24 16:31:35.450911 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03e247ab-d47d-4d68-9948-a6ed458c4f08 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f2ba2e8375b4e8c8792ee1e22b60427', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '00a5583c7b7443e98e7a1d31a0b638dc', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=71938) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 24 16:31:35.451585 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03e247ab-d47d-4d68-9948-a6ed458c4f08 admin admin] REQUEST_METHOD: `GET` {{(pid=71938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 24 16:31:35.451927 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03e247ab-d47d-4d68-9948-a6ed458c4f08 admin admin] SCRIPT_NAME: `/identity` {{(pid=71938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 24 16:31:35.452263 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03e247ab-d47d-4d68-9948-a6ed458c4f08 admin admin] PATH_INFO: `/v3/services` {{(pid=71938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 24 16:31:35.453296 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03e247ab-d47d-4d68-9948-a6ed458c4f08 admin admin] RBAC: Adding query filter params (name=compute) {{(pid=71938) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:161}} Nov 24 16:31:35.453647 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03e247ab-d47d-4d68-9948-a6ed458c4f08 admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=71938) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:442}} Nov 24 16:31:35.482517 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03e247ab-d47d-4d68-9948-a6ed458c4f08 admin admin] RBAC: Authorization granted {{(pid=71938) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 24 16:31:35.487631 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: [pid: 71938|app: 0|req: 265/529] 10.222.0.53 () {56 vars in 1124 bytes} [Wed Nov 24 16:31:35 2021] GET /identity/v3/services?name=compute => generated 124 bytes in 52 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 24 16:31:35.493785 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a857ffc-4151-470b-b47f-1a66a8045a58 admin admin] Authenticating user token {{(pid=71939) process_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 24 16:31:35.504475 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a857ffc-4151-470b-b47f-1a66a8045a58 admin admin] Validating token access rules against request {{(pid=71939) validate_allowed_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 24 16:31:35.508827 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc607dd1-ad0b-44be-b2da-09e629c0ccda admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f2ba2e8375b4e8c8792ee1e22b60427', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '00a5583c7b7443e98e7a1d31a0b638dc', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=71939) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 24 16:31:35.509494 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc607dd1-ad0b-44be-b2da-09e629c0ccda admin admin] REQUEST_METHOD: `GET` {{(pid=71939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 24 16:31:35.509831 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc607dd1-ad0b-44be-b2da-09e629c0ccda admin admin] SCRIPT_NAME: `/identity` {{(pid=71939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 24 16:31:35.510191 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc607dd1-ad0b-44be-b2da-09e629c0ccda admin admin] PATH_INFO: `/v3/services` {{(pid=71939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 24 16:31:35.510957 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc607dd1-ad0b-44be-b2da-09e629c0ccda admin admin] RBAC: Adding query filter params (type=compute) {{(pid=71939) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:161}} Nov 24 16:31:35.511303 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc607dd1-ad0b-44be-b2da-09e629c0ccda admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=71939) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:442}} Nov 24 16:31:35.539902 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc607dd1-ad0b-44be-b2da-09e629c0ccda admin admin] RBAC: Authorization granted {{(pid=71939) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 24 16:31:35.545388 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: [pid: 71939|app: 0|req: 265/530] 10.222.0.53 () {56 vars in 1124 bytes} [Wed Nov 24 16:31:35 2021] GET /identity/v3/services?type=compute => generated 124 bytes in 52 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 24 16:31:37.541165 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baa6f398-a794-454f-bfbe-db1fc91e3fae None None] REQUEST_METHOD: `GET` {{(pid=71938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 24 16:31:37.541689 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baa6f398-a794-454f-bfbe-db1fc91e3fae None None] SCRIPT_NAME: `/identity` {{(pid=71938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 24 16:31:37.541791 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baa6f398-a794-454f-bfbe-db1fc91e3fae None None] PATH_INFO: `/` {{(pid=71938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 24 16:31:37.543849 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: [pid: 71938|app: 0|req: 266/531] 10.222.0.53 () {54 vars in 915 bytes} [Wed Nov 24 16:31:37 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 24 16:31:37.549651 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0131c3d9-3431-4159-af29-165ef5a06747 None None] REQUEST_METHOD: `POST` {{(pid=71939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 24 16:31:37.549994 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0131c3d9-3431-4159-af29-165ef5a06747 None None] SCRIPT_NAME: `/identity` {{(pid=71939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 24 16:31:37.550378 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0131c3d9-3431-4159-af29-165ef5a06747 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=71939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 24 16:31:37.573824 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.auth.core [None req-0131c3d9-3431-4159-af29-165ef5a06747 None None] MFA Rules not processed for user `0f2ba2e8375b4e8c8792ee1e22b60427`. Rule list: `[]` (Enabled: `True`). {{(pid=71939) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:442}} Nov 24 16:31:37.575063 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.fernet_utils [None req-0131c3d9-3431-4159-af29-165ef5a06747 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=71939) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:289}} Nov 24 16:31:37.582897 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: [pid: 71939|app: 0|req: 266/532] 10.222.0.53 () {58 vars in 1013 bytes} [Wed Nov 24 16:31:37 2021] POST /identity/v3/auth/tokens => generated 1364 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 24 16:31:37.604941 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e28fd997-668a-4312-a061-34d354a6cccc None None] REQUEST_METHOD: `POST` {{(pid=71938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 24 16:31:37.605294 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e28fd997-668a-4312-a061-34d354a6cccc None None] SCRIPT_NAME: `/identity` {{(pid=71938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 24 16:31:37.605636 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e28fd997-668a-4312-a061-34d354a6cccc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=71938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 24 16:31:37.629055 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.auth.core [None req-e28fd997-668a-4312-a061-34d354a6cccc None None] MFA Rules not processed for user `0f2ba2e8375b4e8c8792ee1e22b60427`. Rule list: `[]` (Enabled: `True`). {{(pid=71938) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:442}} Nov 24 16:31:37.630290 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.fernet_utils [None req-e28fd997-668a-4312-a061-34d354a6cccc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=71938) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:289}} Nov 24 16:31:37.637320 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: [pid: 71938|app: 0|req: 267/533] 10.222.0.53 () {58 vars in 1013 bytes} [Wed Nov 24 16:31:37 2021] POST /identity/v3/auth/tokens => generated 1364 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 24 16:31:37.644018 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0131c3d9-3431-4159-af29-165ef5a06747 None None] Authenticating user token {{(pid=71939) process_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 24 16:31:37.653575 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0131c3d9-3431-4159-af29-165ef5a06747 None None] Validating token access rules against request {{(pid=71939) validate_allowed_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 24 16:31:37.659048 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fb9cc32-356e-4f5c-b6c0-99ed649e3a57 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f2ba2e8375b4e8c8792ee1e22b60427', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '00a5583c7b7443e98e7a1d31a0b638dc', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=71939) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 24 16:31:37.659717 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fb9cc32-356e-4f5c-b6c0-99ed649e3a57 admin admin] REQUEST_METHOD: `POST` {{(pid=71939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 24 16:31:37.660059 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fb9cc32-356e-4f5c-b6c0-99ed649e3a57 admin admin] SCRIPT_NAME: `/identity` {{(pid=71939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 24 16:31:37.660396 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fb9cc32-356e-4f5c-b6c0-99ed649e3a57 admin admin] PATH_INFO: `/v3/services` {{(pid=71939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 24 16:31:37.661171 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fb9cc32-356e-4f5c-b6c0-99ed649e3a57 admin admin] RBAC: Authorizing `identity:create_service()` {{(pid=71939) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:442}} Nov 24 16:31:37.688417 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: WARNING py.warnings [None req-4fb9cc32-356e-4f5c-b6c0-99ed649e3a57 admin admin] /usr/local/lib/python3.6/dist-packages/oslo_policy/policy.py:1018: UserWarning: Policy identity:create_service failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 24 16:31:37.688417 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: warnings.warn(msg) Nov 24 16:31:37.688417 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: Nov 24 16:31:37.689940 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fb9cc32-356e-4f5c-b6c0-99ed649e3a57 admin admin] RBAC: Authorization granted {{(pid=71939) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 24 16:31:37.702513 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: [pid: 71939|app: 0|req: 267/534] 10.222.0.53 () {60 vars in 1153 bytes} [Wed Nov 24 16:31:37 2021] POST /identity/v3/services => generated 242 bytes in 59 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 24 16:31:39.696022 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbeffdb0-fe69-4262-aae1-d7465a574a48 None None] REQUEST_METHOD: `GET` {{(pid=71938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 24 16:31:39.696569 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbeffdb0-fe69-4262-aae1-d7465a574a48 None None] SCRIPT_NAME: `/identity` {{(pid=71938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 24 16:31:39.696719 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbeffdb0-fe69-4262-aae1-d7465a574a48 None None] PATH_INFO: `/` {{(pid=71938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 24 16:31:39.698594 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: [pid: 71938|app: 0|req: 268/535] 10.222.0.53 () {54 vars in 915 bytes} [Wed Nov 24 16:31:39 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 24 16:31:39.705742 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ddf4332-18a5-4cbb-961f-b2303a66cbd2 None None] REQUEST_METHOD: `POST` {{(pid=71939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 24 16:31:39.706127 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ddf4332-18a5-4cbb-961f-b2303a66cbd2 None None] SCRIPT_NAME: `/identity` {{(pid=71939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 24 16:31:39.706475 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ddf4332-18a5-4cbb-961f-b2303a66cbd2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=71939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 24 16:31:39.741771 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.auth.core [None req-0ddf4332-18a5-4cbb-961f-b2303a66cbd2 None None] MFA Rules not processed for user `0f2ba2e8375b4e8c8792ee1e22b60427`. Rule list: `[]` (Enabled: `True`). {{(pid=71939) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:442}} Nov 24 16:31:39.743693 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.fernet_utils [None req-0ddf4332-18a5-4cbb-961f-b2303a66cbd2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=71939) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:289}} Nov 24 16:31:39.766414 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: [pid: 71939|app: 0|req: 268/536] 10.222.0.53 () {58 vars in 1013 bytes} [Wed Nov 24 16:31:39 2021] POST /identity/v3/auth/tokens => generated 1460 bytes in 62 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 24 16:31:39.794168 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de863140-4560-4dab-9823-77be2b4e6a36 None None] REQUEST_METHOD: `POST` {{(pid=71938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 24 16:31:39.794524 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de863140-4560-4dab-9823-77be2b4e6a36 None None] SCRIPT_NAME: `/identity` {{(pid=71938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 24 16:31:39.794866 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de863140-4560-4dab-9823-77be2b4e6a36 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=71938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 24 16:31:39.819204 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.auth.core [None req-de863140-4560-4dab-9823-77be2b4e6a36 None None] MFA Rules not processed for user `0f2ba2e8375b4e8c8792ee1e22b60427`. Rule list: `[]` (Enabled: `True`). {{(pid=71938) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:442}} Nov 24 16:31:39.820410 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.fernet_utils [None req-de863140-4560-4dab-9823-77be2b4e6a36 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=71938) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:289}} Nov 24 16:31:39.827516 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: [pid: 71938|app: 0|req: 269/537] 10.222.0.53 () {58 vars in 1013 bytes} [Wed Nov 24 16:31:39 2021] POST /identity/v3/auth/tokens => generated 1460 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 24 16:31:39.834537 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ddf4332-18a5-4cbb-961f-b2303a66cbd2 None None] Authenticating user token {{(pid=71939) process_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 24 16:31:39.844271 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ddf4332-18a5-4cbb-961f-b2303a66cbd2 None None] Validating token access rules against request {{(pid=71939) validate_allowed_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 24 16:31:39.848577 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5630873d-91e6-4017-a75c-ecbf51c235c4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f2ba2e8375b4e8c8792ee1e22b60427', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '00a5583c7b7443e98e7a1d31a0b638dc', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=71939) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 24 16:31:39.849379 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5630873d-91e6-4017-a75c-ecbf51c235c4 admin admin] REQUEST_METHOD: `GET` {{(pid=71939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 24 16:31:39.849719 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5630873d-91e6-4017-a75c-ecbf51c235c4 admin admin] SCRIPT_NAME: `/identity` {{(pid=71939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 24 16:31:39.850062 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5630873d-91e6-4017-a75c-ecbf51c235c4 admin admin] PATH_INFO: `/v3/services/compute` {{(pid=71939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 24 16:31:39.850807 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5630873d-91e6-4017-a75c-ecbf51c235c4 admin admin] RBAC: Authorizing `identity:get_service(service_id=compute)` {{(pid=71939) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:442}} Nov 24 16:31:39.879996 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5630873d-91e6-4017-a75c-ecbf51c235c4 admin admin] RBAC: Authorization granted {{(pid=71939) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 24 16:31:39.891636 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: WARNING keystone.server.flask.application [None req-5630873d-91e6-4017-a75c-ecbf51c235c4 admin admin] Could not find service: compute.: keystone.exception.ServiceNotFound: Could not find service: compute. Nov 24 16:31:39.892781 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: [pid: 71939|app: 0|req: 269/538] 10.222.0.53 () {56 vars in 1123 bytes} [Wed Nov 24 16:31:39 2021] GET /identity/v3/services/compute => generated 88 bytes in 59 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 24 16:31:39.899152 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de863140-4560-4dab-9823-77be2b4e6a36 None None] Authenticating user token {{(pid=71938) process_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 24 16:31:39.908197 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de863140-4560-4dab-9823-77be2b4e6a36 None None] Validating token access rules against request {{(pid=71938) validate_allowed_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 24 16:31:39.912505 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86cdab81-8724-4809-ae0d-5ad52373a711 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f2ba2e8375b4e8c8792ee1e22b60427', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '00a5583c7b7443e98e7a1d31a0b638dc', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=71938) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 24 16:31:39.913168 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86cdab81-8724-4809-ae0d-5ad52373a711 admin admin] REQUEST_METHOD: `GET` {{(pid=71938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 24 16:31:39.913511 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86cdab81-8724-4809-ae0d-5ad52373a711 admin admin] SCRIPT_NAME: `/identity` {{(pid=71938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 24 16:31:39.913846 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86cdab81-8724-4809-ae0d-5ad52373a711 admin admin] PATH_INFO: `/v3/services` {{(pid=71938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 24 16:31:39.914670 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86cdab81-8724-4809-ae0d-5ad52373a711 admin admin] RBAC: Adding query filter params (name=compute) {{(pid=71938) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:161}} Nov 24 16:31:39.915026 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86cdab81-8724-4809-ae0d-5ad52373a711 admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=71938) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:442}} Nov 24 16:31:39.944207 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86cdab81-8724-4809-ae0d-5ad52373a711 admin admin] RBAC: Authorization granted {{(pid=71938) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 24 16:31:39.949319 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: [pid: 71938|app: 0|req: 270/539] 10.222.0.53 () {56 vars in 1124 bytes} [Wed Nov 24 16:31:39 2021] GET /identity/v3/services?name=compute => generated 124 bytes in 51 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 24 16:31:39.955428 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5630873d-91e6-4017-a75c-ecbf51c235c4 admin admin] Authenticating user token {{(pid=71939) process_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 24 16:31:39.965127 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5630873d-91e6-4017-a75c-ecbf51c235c4 admin admin] Validating token access rules against request {{(pid=71939) validate_allowed_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 24 16:31:39.969269 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0afdc948-8d34-4332-9451-eae905a029cb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f2ba2e8375b4e8c8792ee1e22b60427', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '00a5583c7b7443e98e7a1d31a0b638dc', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=71939) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 24 16:31:39.970531 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0afdc948-8d34-4332-9451-eae905a029cb admin admin] REQUEST_METHOD: `GET` {{(pid=71939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 24 16:31:39.970868 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0afdc948-8d34-4332-9451-eae905a029cb admin admin] SCRIPT_NAME: `/identity` {{(pid=71939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 24 16:31:39.971192 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0afdc948-8d34-4332-9451-eae905a029cb admin admin] PATH_INFO: `/v3/services` {{(pid=71939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 24 16:31:39.971954 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0afdc948-8d34-4332-9451-eae905a029cb admin admin] RBAC: Adding query filter params (type=compute) {{(pid=71939) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:161}} Nov 24 16:31:39.972302 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0afdc948-8d34-4332-9451-eae905a029cb admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=71939) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:442}} Nov 24 16:31:40.000771 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0afdc948-8d34-4332-9451-eae905a029cb admin admin] RBAC: Authorization granted {{(pid=71939) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 24 16:31:40.005621 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: [pid: 71939|app: 0|req: 270/540] 10.222.0.53 () {56 vars in 1124 bytes} [Wed Nov 24 16:31:39 2021] GET /identity/v3/services?type=compute => generated 352 bytes in 51 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 24 16:31:40.011450 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86cdab81-8724-4809-ae0d-5ad52373a711 admin admin] Authenticating user token {{(pid=71938) process_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 24 16:31:40.021098 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86cdab81-8724-4809-ae0d-5ad52373a711 admin admin] Validating token access rules against request {{(pid=71938) validate_allowed_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 24 16:31:40.025287 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac3dcc77-00a5-4d39-9e0a-c26d41150791 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f2ba2e8375b4e8c8792ee1e22b60427', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '00a5583c7b7443e98e7a1d31a0b638dc', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=71938) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 24 16:31:40.025937 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac3dcc77-00a5-4d39-9e0a-c26d41150791 admin admin] REQUEST_METHOD: `GET` {{(pid=71938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 24 16:31:40.026302 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac3dcc77-00a5-4d39-9e0a-c26d41150791 admin admin] SCRIPT_NAME: `/identity` {{(pid=71938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 24 16:31:40.026634 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac3dcc77-00a5-4d39-9e0a-c26d41150791 admin admin] PATH_INFO: `/v3/endpoints` {{(pid=71938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 24 16:31:40.027478 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac3dcc77-00a5-4d39-9e0a-c26d41150791 admin admin] RBAC: Adding query filter params (interface=public, service_id=abc75198acab4bf3b7ab2316ec97b13e, region_id=RegionOne) {{(pid=71938) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:161}} Nov 24 16:31:40.027836 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac3dcc77-00a5-4d39-9e0a-c26d41150791 admin admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=71938) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:442}} Nov 24 16:31:40.056331 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: WARNING py.warnings [None req-ac3dcc77-00a5-4d39-9e0a-c26d41150791 admin admin] /usr/local/lib/python3.6/dist-packages/oslo_policy/policy.py:1018: UserWarning: Policy identity:list_endpoints failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 24 16:31:40.056331 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: warnings.warn(msg) Nov 24 16:31:40.056331 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: Nov 24 16:31:40.057330 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac3dcc77-00a5-4d39-9e0a-c26d41150791 admin admin] RBAC: Authorization granted {{(pid=71938) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 24 16:31:40.063521 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: [pid: 71938|app: 0|req: 271/541] 10.222.0.53 () {56 vars in 1263 bytes} [Wed Nov 24 16:31:40 2021] GET /identity/v3/endpoints?service_id=abc75198acab4bf3b7ab2316ec97b13e&interface=public®ion_id=RegionOne => generated 194 bytes in 53 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 24 16:31:40.073555 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0afdc948-8d34-4332-9451-eae905a029cb admin admin] Authenticating user token {{(pid=71939) process_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 24 16:31:40.090003 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0afdc948-8d34-4332-9451-eae905a029cb admin admin] Validating token access rules against request {{(pid=71939) validate_allowed_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 24 16:31:40.095450 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d888fbd-d939-4bbf-b241-ff035b252782 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f2ba2e8375b4e8c8792ee1e22b60427', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '00a5583c7b7443e98e7a1d31a0b638dc', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=71939) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 24 16:31:40.096201 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d888fbd-d939-4bbf-b241-ff035b252782 admin admin] REQUEST_METHOD: `GET` {{(pid=71939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 24 16:31:40.096538 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d888fbd-d939-4bbf-b241-ff035b252782 admin admin] SCRIPT_NAME: `/identity` {{(pid=71939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 24 16:31:40.096870 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d888fbd-d939-4bbf-b241-ff035b252782 admin admin] PATH_INFO: `/v3/services` {{(pid=71939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 24 16:31:40.097663 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d888fbd-d939-4bbf-b241-ff035b252782 admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=71939) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:442}} Nov 24 16:31:40.126110 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d888fbd-d939-4bbf-b241-ff035b252782 admin admin] RBAC: Authorization granted {{(pid=71939) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 24 16:31:40.131791 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: [pid: 71939|app: 0|req: 271/542] 10.222.0.53 () {56 vars in 1099 bytes} [Wed Nov 24 16:31:40 2021] GET /identity/v3/services => generated 792 bytes in 59 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 24 16:31:42.116414 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1084618c-d5c1-406c-a50b-afe3a7d57638 None None] REQUEST_METHOD: `GET` {{(pid=71938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 24 16:31:42.116966 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1084618c-d5c1-406c-a50b-afe3a7d57638 None None] SCRIPT_NAME: `/identity` {{(pid=71938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 24 16:31:42.117076 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1084618c-d5c1-406c-a50b-afe3a7d57638 None None] PATH_INFO: `/` {{(pid=71938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 24 16:31:42.118938 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: [pid: 71938|app: 0|req: 272/543] 10.222.0.53 () {54 vars in 915 bytes} [Wed Nov 24 16:31:42 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 24 16:31:42.129775 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e03b622-fb25-45fd-9bd2-a8d867c678bc None None] REQUEST_METHOD: `POST` {{(pid=71939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 24 16:31:42.130198 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e03b622-fb25-45fd-9bd2-a8d867c678bc None None] SCRIPT_NAME: `/identity` {{(pid=71939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 24 16:31:42.130798 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e03b622-fb25-45fd-9bd2-a8d867c678bc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=71939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 24 16:31:42.155027 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.auth.core [None req-1e03b622-fb25-45fd-9bd2-a8d867c678bc None None] MFA Rules not processed for user `0f2ba2e8375b4e8c8792ee1e22b60427`. Rule list: `[]` (Enabled: `True`). {{(pid=71939) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:442}} Nov 24 16:31:42.156244 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.fernet_utils [None req-1e03b622-fb25-45fd-9bd2-a8d867c678bc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=71939) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:289}} Nov 24 16:31:42.163924 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: [pid: 71939|app: 0|req: 272/544] 10.222.0.53 () {58 vars in 1013 bytes} [Wed Nov 24 16:31:42 2021] POST /identity/v3/auth/tokens => generated 1460 bytes in 40 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 24 16:31:42.186267 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d23bb9f6-0cd0-44a2-afa4-c036bc36c11d None None] REQUEST_METHOD: `POST` {{(pid=71938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 24 16:31:42.186612 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d23bb9f6-0cd0-44a2-afa4-c036bc36c11d None None] SCRIPT_NAME: `/identity` {{(pid=71938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 24 16:31:42.186947 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d23bb9f6-0cd0-44a2-afa4-c036bc36c11d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=71938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 24 16:31:42.211593 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.auth.core [None req-d23bb9f6-0cd0-44a2-afa4-c036bc36c11d None None] MFA Rules not processed for user `0f2ba2e8375b4e8c8792ee1e22b60427`. Rule list: `[]` (Enabled: `True`). {{(pid=71938) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:442}} Nov 24 16:31:42.212801 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.fernet_utils [None req-d23bb9f6-0cd0-44a2-afa4-c036bc36c11d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=71938) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:289}} Nov 24 16:31:42.219904 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: [pid: 71938|app: 0|req: 273/545] 10.222.0.53 () {58 vars in 1013 bytes} [Wed Nov 24 16:31:42 2021] POST /identity/v3/auth/tokens => generated 1460 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 24 16:31:42.225679 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e03b622-fb25-45fd-9bd2-a8d867c678bc None None] Authenticating user token {{(pid=71939) process_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 24 16:31:42.235403 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e03b622-fb25-45fd-9bd2-a8d867c678bc None None] Validating token access rules against request {{(pid=71939) validate_allowed_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 24 16:31:42.239562 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b3ab802-e77e-42ee-8ba7-5e64c03decaa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f2ba2e8375b4e8c8792ee1e22b60427', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '00a5583c7b7443e98e7a1d31a0b638dc', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=71939) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 24 16:31:42.240367 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b3ab802-e77e-42ee-8ba7-5e64c03decaa admin admin] REQUEST_METHOD: `GET` {{(pid=71939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 24 16:31:42.240704 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b3ab802-e77e-42ee-8ba7-5e64c03decaa admin admin] SCRIPT_NAME: `/identity` {{(pid=71939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 24 16:31:42.241032 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b3ab802-e77e-42ee-8ba7-5e64c03decaa admin admin] PATH_INFO: `/v3/services/compute` {{(pid=71939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 24 16:31:42.241735 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b3ab802-e77e-42ee-8ba7-5e64c03decaa admin admin] RBAC: Authorizing `identity:get_service(service_id=compute)` {{(pid=71939) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:442}} Nov 24 16:31:42.270628 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b3ab802-e77e-42ee-8ba7-5e64c03decaa admin admin] RBAC: Authorization granted {{(pid=71939) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 24 16:31:42.281981 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: WARNING keystone.server.flask.application [None req-2b3ab802-e77e-42ee-8ba7-5e64c03decaa admin admin] Could not find service: compute.: keystone.exception.ServiceNotFound: Could not find service: compute. Nov 24 16:31:42.283175 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: [pid: 71939|app: 0|req: 273/546] 10.222.0.53 () {56 vars in 1123 bytes} [Wed Nov 24 16:31:42 2021] GET /identity/v3/services/compute => generated 88 bytes in 58 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 24 16:31:42.289590 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d23bb9f6-0cd0-44a2-afa4-c036bc36c11d None None] Authenticating user token {{(pid=71938) process_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 24 16:31:42.298727 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d23bb9f6-0cd0-44a2-afa4-c036bc36c11d None None] Validating token access rules against request {{(pid=71938) validate_allowed_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 24 16:31:42.302960 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c34afb7-f1fb-4a49-8e7a-cbedb10730c4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f2ba2e8375b4e8c8792ee1e22b60427', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '00a5583c7b7443e98e7a1d31a0b638dc', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=71938) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 24 16:31:42.303623 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c34afb7-f1fb-4a49-8e7a-cbedb10730c4 admin admin] REQUEST_METHOD: `GET` {{(pid=71938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 24 16:31:42.303962 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c34afb7-f1fb-4a49-8e7a-cbedb10730c4 admin admin] SCRIPT_NAME: `/identity` {{(pid=71938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 24 16:31:42.304297 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c34afb7-f1fb-4a49-8e7a-cbedb10730c4 admin admin] PATH_INFO: `/v3/services` {{(pid=71938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 24 16:31:42.305064 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c34afb7-f1fb-4a49-8e7a-cbedb10730c4 admin admin] RBAC: Adding query filter params (name=compute) {{(pid=71938) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:161}} Nov 24 16:31:42.305416 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c34afb7-f1fb-4a49-8e7a-cbedb10730c4 admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=71938) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:442}} Nov 24 16:31:42.335324 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c34afb7-f1fb-4a49-8e7a-cbedb10730c4 admin admin] RBAC: Authorization granted {{(pid=71938) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 24 16:31:42.339944 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: [pid: 71938|app: 0|req: 274/547] 10.222.0.53 () {56 vars in 1124 bytes} [Wed Nov 24 16:31:42 2021] GET /identity/v3/services?name=compute => generated 124 bytes in 51 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 24 16:31:42.345691 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b3ab802-e77e-42ee-8ba7-5e64c03decaa admin admin] Authenticating user token {{(pid=71939) process_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 24 16:31:42.355503 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b3ab802-e77e-42ee-8ba7-5e64c03decaa admin admin] Validating token access rules against request {{(pid=71939) validate_allowed_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 24 16:31:42.359703 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a194d671-f242-43fd-afad-86e09c5206a0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f2ba2e8375b4e8c8792ee1e22b60427', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '00a5583c7b7443e98e7a1d31a0b638dc', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=71939) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 24 16:31:42.360386 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a194d671-f242-43fd-afad-86e09c5206a0 admin admin] REQUEST_METHOD: `GET` {{(pid=71939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 24 16:31:42.360720 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a194d671-f242-43fd-afad-86e09c5206a0 admin admin] SCRIPT_NAME: `/identity` {{(pid=71939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 24 16:31:42.361050 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a194d671-f242-43fd-afad-86e09c5206a0 admin admin] PATH_INFO: `/v3/services` {{(pid=71939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 24 16:31:42.361808 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a194d671-f242-43fd-afad-86e09c5206a0 admin admin] RBAC: Adding query filter params (type=compute) {{(pid=71939) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:161}} Nov 24 16:31:42.362187 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a194d671-f242-43fd-afad-86e09c5206a0 admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=71939) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:442}} Nov 24 16:31:42.390669 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a194d671-f242-43fd-afad-86e09c5206a0 admin admin] RBAC: Authorization granted {{(pid=71939) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 24 16:31:42.396402 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: [pid: 71939|app: 0|req: 274/548] 10.222.0.53 () {56 vars in 1124 bytes} [Wed Nov 24 16:31:42 2021] GET /identity/v3/services?type=compute => generated 352 bytes in 51 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 24 16:31:42.402526 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c34afb7-f1fb-4a49-8e7a-cbedb10730c4 admin admin] Authenticating user token {{(pid=71938) process_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 24 16:31:42.418352 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c34afb7-f1fb-4a49-8e7a-cbedb10730c4 admin admin] Validating token access rules against request {{(pid=71938) validate_allowed_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 24 16:31:42.423067 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dab804fb-659d-4109-aa58-78cf99dbba29 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f2ba2e8375b4e8c8792ee1e22b60427', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '00a5583c7b7443e98e7a1d31a0b638dc', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=71938) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 24 16:31:42.423746 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dab804fb-659d-4109-aa58-78cf99dbba29 admin admin] REQUEST_METHOD: `POST` {{(pid=71938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 24 16:31:42.424091 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dab804fb-659d-4109-aa58-78cf99dbba29 admin admin] SCRIPT_NAME: `/identity` {{(pid=71938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 24 16:31:42.424443 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dab804fb-659d-4109-aa58-78cf99dbba29 admin admin] PATH_INFO: `/v3/endpoints` {{(pid=71938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 24 16:31:42.425251 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dab804fb-659d-4109-aa58-78cf99dbba29 admin admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=71938) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:442}} Nov 24 16:31:42.461680 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: WARNING py.warnings [None req-dab804fb-659d-4109-aa58-78cf99dbba29 admin admin] /usr/local/lib/python3.6/dist-packages/oslo_policy/policy.py:1018: UserWarning: Policy identity:create_endpoint failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 24 16:31:42.461680 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: warnings.warn(msg) Nov 24 16:31:42.461680 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: Nov 24 16:31:42.462722 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dab804fb-659d-4109-aa58-78cf99dbba29 admin admin] RBAC: Authorization granted {{(pid=71938) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 24 16:31:42.481146 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: [pid: 71938|app: 0|req: 275/549] 10.222.0.53 () {60 vars in 1156 bytes} [Wed Nov 24 16:31:42 2021] POST /identity/v3/endpoints => generated 334 bytes in 79 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 24 16:31:44.531494 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-480ae3da-cbe9-4bf3-b0b1-169a6457bcca None None] REQUEST_METHOD: `GET` {{(pid=71939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 24 16:31:44.531986 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-480ae3da-cbe9-4bf3-b0b1-169a6457bcca None None] SCRIPT_NAME: `/identity` {{(pid=71939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 24 16:31:44.532090 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-480ae3da-cbe9-4bf3-b0b1-169a6457bcca None None] PATH_INFO: `/` {{(pid=71939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 24 16:31:44.533897 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: [pid: 71939|app: 0|req: 275/550] 10.222.0.53 () {54 vars in 915 bytes} [Wed Nov 24 16:31:44 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 24 16:31:44.539342 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-916fcede-cbfd-402f-9838-967e0224e32c None None] REQUEST_METHOD: `POST` {{(pid=71938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 24 16:31:44.539689 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-916fcede-cbfd-402f-9838-967e0224e32c None None] SCRIPT_NAME: `/identity` {{(pid=71938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 24 16:31:44.540021 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-916fcede-cbfd-402f-9838-967e0224e32c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=71938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 24 16:31:44.563167 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.auth.core [None req-916fcede-cbfd-402f-9838-967e0224e32c None None] MFA Rules not processed for user `0f2ba2e8375b4e8c8792ee1e22b60427`. Rule list: `[]` (Enabled: `True`). {{(pid=71938) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:442}} Nov 24 16:31:44.564922 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.fernet_utils [None req-916fcede-cbfd-402f-9838-967e0224e32c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=71938) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:289}} Nov 24 16:31:44.582561 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: [pid: 71938|app: 0|req: 276/551] 10.222.0.53 () {58 vars in 1013 bytes} [Wed Nov 24 16:31:44 2021] POST /identity/v3/auth/tokens => generated 1616 bytes in 44 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 24 16:31:44.604429 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad556d7f-9030-497d-9bf7-99bc491b4c28 None None] REQUEST_METHOD: `POST` {{(pid=71939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 24 16:31:44.604784 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad556d7f-9030-497d-9bf7-99bc491b4c28 None None] SCRIPT_NAME: `/identity` {{(pid=71939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 24 16:31:44.605128 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad556d7f-9030-497d-9bf7-99bc491b4c28 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=71939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 24 16:31:44.629175 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.auth.core [None req-ad556d7f-9030-497d-9bf7-99bc491b4c28 None None] MFA Rules not processed for user `0f2ba2e8375b4e8c8792ee1e22b60427`. Rule list: `[]` (Enabled: `True`). {{(pid=71939) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:442}} Nov 24 16:31:44.630427 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.fernet_utils [None req-ad556d7f-9030-497d-9bf7-99bc491b4c28 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=71939) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:289}} Nov 24 16:31:44.637573 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: [pid: 71939|app: 0|req: 276/552] 10.222.0.53 () {58 vars in 1013 bytes} [Wed Nov 24 16:31:44 2021] POST /identity/v3/auth/tokens => generated 1616 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 24 16:31:44.644177 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-916fcede-cbfd-402f-9838-967e0224e32c None None] Authenticating user token {{(pid=71938) process_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 24 16:31:44.653800 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-916fcede-cbfd-402f-9838-967e0224e32c None None] Validating token access rules against request {{(pid=71938) validate_allowed_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 24 16:31:44.658279 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03df86cb-63a8-4ea6-a53e-2a4cedc08bf1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f2ba2e8375b4e8c8792ee1e22b60427', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '00a5583c7b7443e98e7a1d31a0b638dc', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=71938) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 24 16:31:44.659106 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03df86cb-63a8-4ea6-a53e-2a4cedc08bf1 admin admin] REQUEST_METHOD: `GET` {{(pid=71938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 24 16:31:44.659446 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03df86cb-63a8-4ea6-a53e-2a4cedc08bf1 admin admin] SCRIPT_NAME: `/identity` {{(pid=71938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 24 16:31:44.659780 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03df86cb-63a8-4ea6-a53e-2a4cedc08bf1 admin admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=71938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 24 16:31:44.671462 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03df86cb-63a8-4ea6-a53e-2a4cedc08bf1 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=71938) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:401}} Nov 24 16:31:44.679323 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: WARNING keystone.server.flask.application [None req-03df86cb-63a8-4ea6-a53e-2a4cedc08bf1 admin admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Nov 24 16:31:44.680501 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: [pid: 71938|app: 0|req: 277/553] 10.222.0.53 () {56 vars in 1132 bytes} [Wed Nov 24 16:31:44 2021] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 37 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 24 16:31:44.686836 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad556d7f-9030-497d-9bf7-99bc491b4c28 None None] Authenticating user token {{(pid=71939) process_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 24 16:31:44.696403 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad556d7f-9030-497d-9bf7-99bc491b4c28 None None] Validating token access rules against request {{(pid=71939) validate_allowed_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 24 16:31:44.701805 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47b1e6dc-9419-4b0b-bff9-23269c40fbd4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f2ba2e8375b4e8c8792ee1e22b60427', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '00a5583c7b7443e98e7a1d31a0b638dc', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=71939) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 24 16:31:44.702780 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47b1e6dc-9419-4b0b-bff9-23269c40fbd4 admin admin] REQUEST_METHOD: `GET` {{(pid=71939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 24 16:31:44.703132 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47b1e6dc-9419-4b0b-bff9-23269c40fbd4 admin admin] SCRIPT_NAME: `/identity` {{(pid=71939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 24 16:31:44.703466 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47b1e6dc-9419-4b0b-bff9-23269c40fbd4 admin admin] PATH_INFO: `/v3/roles` {{(pid=71939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 24 16:31:44.704878 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47b1e6dc-9419-4b0b-bff9-23269c40fbd4 admin admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=71939) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:161}} Nov 24 16:31:44.705233 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47b1e6dc-9419-4b0b-bff9-23269c40fbd4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=71939) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:442}} Nov 24 16:31:44.733608 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47b1e6dc-9419-4b0b-bff9-23269c40fbd4 admin admin] RBAC: Authorization granted {{(pid=71939) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 24 16:31:44.743869 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: [pid: 71939|app: 0|req: 277/554] 10.222.0.53 () {56 vars in 1127 bytes} [Wed Nov 24 16:31:44 2021] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 58 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 24 16:31:44.749552 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03df86cb-63a8-4ea6-a53e-2a4cedc08bf1 admin admin] Authenticating user token {{(pid=71938) process_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 24 16:31:44.759834 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03df86cb-63a8-4ea6-a53e-2a4cedc08bf1 admin admin] Validating token access rules against request {{(pid=71938) validate_allowed_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 24 16:31:44.764067 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e269832-7e4d-47ff-bb2a-164269fe25e8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f2ba2e8375b4e8c8792ee1e22b60427', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '00a5583c7b7443e98e7a1d31a0b638dc', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=71938) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 24 16:31:44.764861 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e269832-7e4d-47ff-bb2a-164269fe25e8 admin admin] REQUEST_METHOD: `GET` {{(pid=71938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 24 16:31:44.765197 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e269832-7e4d-47ff-bb2a-164269fe25e8 admin admin] SCRIPT_NAME: `/identity` {{(pid=71938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 24 16:31:44.765528 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e269832-7e4d-47ff-bb2a-164269fe25e8 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=71938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 24 16:31:44.777073 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e269832-7e4d-47ff-bb2a-164269fe25e8 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=71938) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:442}} Nov 24 16:31:44.806379 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e269832-7e4d-47ff-bb2a-164269fe25e8 admin admin] RBAC: Authorization granted {{(pid=71938) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 24 16:31:44.824860 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: WARNING keystone.server.flask.application [None req-4e269832-7e4d-47ff-bb2a-164269fe25e8 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Nov 24 16:31:44.825996 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: [pid: 71938|app: 0|req: 278/555] 10.222.0.53 () {56 vars in 1120 bytes} [Wed Nov 24 16:31:44 2021] GET /identity/v3/domains/Default => generated 87 bytes in 77 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 24 16:31:44.832516 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47b1e6dc-9419-4b0b-bff9-23269c40fbd4 admin admin] Authenticating user token {{(pid=71939) process_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 24 16:31:44.842216 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47b1e6dc-9419-4b0b-bff9-23269c40fbd4 admin admin] Validating token access rules against request {{(pid=71939) validate_allowed_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 24 16:31:44.847180 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83d14720-db0d-4345-b802-90371acc37bb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f2ba2e8375b4e8c8792ee1e22b60427', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '00a5583c7b7443e98e7a1d31a0b638dc', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=71939) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 24 16:31:44.847833 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83d14720-db0d-4345-b802-90371acc37bb admin admin] REQUEST_METHOD: `GET` {{(pid=71939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 24 16:31:44.848175 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83d14720-db0d-4345-b802-90371acc37bb admin admin] SCRIPT_NAME: `/identity` {{(pid=71939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 24 16:31:44.848509 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83d14720-db0d-4345-b802-90371acc37bb admin admin] PATH_INFO: `/v3/domains` {{(pid=71939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 24 16:31:44.849280 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83d14720-db0d-4345-b802-90371acc37bb admin admin] RBAC: Adding query filter params (name=Default) {{(pid=71939) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:161}} Nov 24 16:31:44.849630 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83d14720-db0d-4345-b802-90371acc37bb admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=71939) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:442}} Nov 24 16:31:44.877553 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83d14720-db0d-4345-b802-90371acc37bb admin admin] RBAC: Authorization granted {{(pid=71939) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 24 16:31:44.890694 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: [pid: 71939|app: 0|req: 278/556] 10.222.0.53 () {56 vars in 1121 bytes} [Wed Nov 24 16:31:44 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 59 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 24 16:31:44.896732 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e269832-7e4d-47ff-bb2a-164269fe25e8 admin admin] Authenticating user token {{(pid=71938) process_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 24 16:31:44.906547 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e269832-7e4d-47ff-bb2a-164269fe25e8 admin admin] Validating token access rules against request {{(pid=71938) validate_allowed_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 24 16:31:44.911376 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-578750eb-0de6-41a8-a1d9-773f2bdb99a2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f2ba2e8375b4e8c8792ee1e22b60427', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '00a5583c7b7443e98e7a1d31a0b638dc', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=71938) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 24 16:31:44.912177 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-578750eb-0de6-41a8-a1d9-773f2bdb99a2 admin admin] REQUEST_METHOD: `GET` {{(pid=71938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 24 16:31:44.912519 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-578750eb-0de6-41a8-a1d9-773f2bdb99a2 admin admin] SCRIPT_NAME: `/identity` {{(pid=71938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 24 16:31:44.912853 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-578750eb-0de6-41a8-a1d9-773f2bdb99a2 admin admin] PATH_INFO: `/v3/users/nova` {{(pid=71938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 24 16:31:44.926140 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-578750eb-0de6-41a8-a1d9-773f2bdb99a2 admin admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=71938) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:442}} Nov 24 16:31:44.955613 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-578750eb-0de6-41a8-a1d9-773f2bdb99a2 admin admin] RBAC: Authorization granted {{(pid=71938) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 24 16:31:44.975817 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: WARNING keystone.server.flask.application [None req-578750eb-0de6-41a8-a1d9-773f2bdb99a2 admin admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Nov 24 16:31:44.977009 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: [pid: 71938|app: 0|req: 279/557] 10.222.0.53 () {56 vars in 1105 bytes} [Wed Nov 24 16:31:44 2021] GET /identity/v3/users/nova => generated 82 bytes in 81 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 24 16:31:44.982862 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83d14720-db0d-4345-b802-90371acc37bb admin admin] Authenticating user token {{(pid=71939) process_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 24 16:31:44.992697 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83d14720-db0d-4345-b802-90371acc37bb admin admin] Validating token access rules against request {{(pid=71939) validate_allowed_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 24 16:31:44.996963 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38dbea31-a6ba-4e26-92ac-356f643d31b2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f2ba2e8375b4e8c8792ee1e22b60427', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '00a5583c7b7443e98e7a1d31a0b638dc', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=71939) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 24 16:31:44.997631 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38dbea31-a6ba-4e26-92ac-356f643d31b2 admin admin] REQUEST_METHOD: `GET` {{(pid=71939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 24 16:31:44.997975 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38dbea31-a6ba-4e26-92ac-356f643d31b2 admin admin] SCRIPT_NAME: `/identity` {{(pid=71939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 24 16:31:44.998344 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38dbea31-a6ba-4e26-92ac-356f643d31b2 admin admin] PATH_INFO: `/v3/users` {{(pid=71939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 24 16:31:44.999241 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38dbea31-a6ba-4e26-92ac-356f643d31b2 admin admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=71939) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:161}} Nov 24 16:31:44.999599 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38dbea31-a6ba-4e26-92ac-356f643d31b2 admin admin] RBAC: Authorizing `identity:list_users()` {{(pid=71939) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:442}} Nov 24 16:31:45.028514 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38dbea31-a6ba-4e26-92ac-356f643d31b2 admin admin] RBAC: Authorization granted {{(pid=71939) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 24 16:31:45.060357 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: [pid: 71939|app: 0|req: 279/558] 10.222.0.53 () {56 vars in 1145 bytes} [Wed Nov 24 16:31:44 2021] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 78 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 24 16:31:45.066309 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-578750eb-0de6-41a8-a1d9-773f2bdb99a2 admin admin] Authenticating user token {{(pid=71938) process_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 24 16:31:45.076228 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-578750eb-0de6-41a8-a1d9-773f2bdb99a2 admin admin] Validating token access rules against request {{(pid=71938) validate_allowed_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 24 16:31:45.081357 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e4ae160-44ca-4ca5-b374-a150e293149a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f2ba2e8375b4e8c8792ee1e22b60427', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '00a5583c7b7443e98e7a1d31a0b638dc', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=71938) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 24 16:31:45.082003 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e4ae160-44ca-4ca5-b374-a150e293149a admin admin] REQUEST_METHOD: `GET` {{(pid=71938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 24 16:31:45.082387 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e4ae160-44ca-4ca5-b374-a150e293149a admin admin] SCRIPT_NAME: `/identity` {{(pid=71938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 24 16:31:45.082718 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e4ae160-44ca-4ca5-b374-a150e293149a admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=71938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 24 16:31:45.090808 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e4ae160-44ca-4ca5-b374-a150e293149a admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=71938) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:442}} Nov 24 16:31:45.119831 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e4ae160-44ca-4ca5-b374-a150e293149a admin admin] RBAC: Authorization granted {{(pid=71938) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 24 16:31:45.128904 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: [pid: 71938|app: 0|req: 280/559] 10.222.0.53 () {58 vars in 1315 bytes} [Wed Nov 24 16:31:45 2021] GET /identity/v3/auth/tokens => generated 1616 bytes in 63 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 24 16:31:45.134741 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38dbea31-a6ba-4e26-92ac-356f643d31b2 admin admin] Authenticating user token {{(pid=71939) process_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 24 16:31:45.145054 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38dbea31-a6ba-4e26-92ac-356f643d31b2 admin admin] Validating token access rules against request {{(pid=71939) validate_allowed_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 24 16:31:45.149284 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2e25884-9fef-4584-8cd8-5085834e6d70 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f2ba2e8375b4e8c8792ee1e22b60427', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '00a5583c7b7443e98e7a1d31a0b638dc', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=71939) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 24 16:31:45.150125 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2e25884-9fef-4584-8cd8-5085834e6d70 admin admin] REQUEST_METHOD: `GET` {{(pid=71939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 24 16:31:45.150470 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2e25884-9fef-4584-8cd8-5085834e6d70 admin admin] SCRIPT_NAME: `/identity` {{(pid=71939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 24 16:31:45.150806 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2e25884-9fef-4584-8cd8-5085834e6d70 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=71939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 24 16:31:45.163805 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2e25884-9fef-4584-8cd8-5085834e6d70 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=71939) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:442}} Nov 24 16:31:45.192716 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2e25884-9fef-4584-8cd8-5085834e6d70 admin admin] RBAC: Authorization granted {{(pid=71939) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 24 16:31:45.212523 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: WARNING keystone.server.flask.application [None req-d2e25884-9fef-4584-8cd8-5085834e6d70 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Nov 24 16:31:45.213844 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: [pid: 71939|app: 0|req: 280/560] 10.222.0.53 () {56 vars in 1120 bytes} [Wed Nov 24 16:31:45 2021] GET /identity/v3/domains/Default => generated 87 bytes in 80 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 24 16:31:45.219836 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e4ae160-44ca-4ca5-b374-a150e293149a admin admin] Authenticating user token {{(pid=71938) process_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 24 16:31:45.228864 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e4ae160-44ca-4ca5-b374-a150e293149a admin admin] Validating token access rules against request {{(pid=71938) validate_allowed_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 24 16:31:45.233088 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc1ee9f3-4599-4416-bc15-9919dc33df88 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f2ba2e8375b4e8c8792ee1e22b60427', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '00a5583c7b7443e98e7a1d31a0b638dc', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=71938) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 24 16:31:45.233788 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc1ee9f3-4599-4416-bc15-9919dc33df88 admin admin] REQUEST_METHOD: `GET` {{(pid=71938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 24 16:31:45.234152 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc1ee9f3-4599-4416-bc15-9919dc33df88 admin admin] SCRIPT_NAME: `/identity` {{(pid=71938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 24 16:31:45.234485 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc1ee9f3-4599-4416-bc15-9919dc33df88 admin admin] PATH_INFO: `/v3/domains` {{(pid=71938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 24 16:31:45.235261 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc1ee9f3-4599-4416-bc15-9919dc33df88 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=71938) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:161}} Nov 24 16:31:45.235604 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc1ee9f3-4599-4416-bc15-9919dc33df88 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=71938) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:442}} Nov 24 16:31:45.263952 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc1ee9f3-4599-4416-bc15-9919dc33df88 admin admin] RBAC: Authorization granted {{(pid=71938) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 24 16:31:45.277605 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: [pid: 71938|app: 0|req: 281/561] 10.222.0.53 () {56 vars in 1121 bytes} [Wed Nov 24 16:31:45 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 58 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 24 16:31:45.283252 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2e25884-9fef-4584-8cd8-5085834e6d70 admin admin] Authenticating user token {{(pid=71939) process_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 24 16:31:45.293011 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2e25884-9fef-4584-8cd8-5085834e6d70 admin admin] Validating token access rules against request {{(pid=71939) validate_allowed_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 24 16:31:45.297181 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-500f5156-19c8-4c32-be36-cc137c446770 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f2ba2e8375b4e8c8792ee1e22b60427', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '00a5583c7b7443e98e7a1d31a0b638dc', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=71939) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 24 16:31:45.297970 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-500f5156-19c8-4c32-be36-cc137c446770 admin admin] REQUEST_METHOD: `GET` {{(pid=71939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 24 16:31:45.298338 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-500f5156-19c8-4c32-be36-cc137c446770 admin admin] SCRIPT_NAME: `/identity` {{(pid=71939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 24 16:31:45.298670 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-500f5156-19c8-4c32-be36-cc137c446770 admin admin] PATH_INFO: `/v3/projects/service` {{(pid=71939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 24 16:31:45.310003 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-500f5156-19c8-4c32-be36-cc137c446770 admin admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=71939) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:442}} Nov 24 16:31:45.339829 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-500f5156-19c8-4c32-be36-cc137c446770 admin admin] RBAC: Authorization granted {{(pid=71939) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 24 16:31:45.355033 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: WARNING keystone.server.flask.application [None req-500f5156-19c8-4c32-be36-cc137c446770 admin admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Nov 24 16:31:45.356181 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: [pid: 71939|app: 0|req: 281/562] 10.222.0.53 () {56 vars in 1123 bytes} [Wed Nov 24 16:31:45 2021] GET /identity/v3/projects/service => generated 88 bytes in 73 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 24 16:31:45.362735 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc1ee9f3-4599-4416-bc15-9919dc33df88 admin admin] Authenticating user token {{(pid=71938) process_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 24 16:31:45.372559 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc1ee9f3-4599-4416-bc15-9919dc33df88 admin admin] Validating token access rules against request {{(pid=71938) validate_allowed_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 24 16:31:45.376775 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8666643d-3dfe-461e-9379-24bd214a773e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f2ba2e8375b4e8c8792ee1e22b60427', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '00a5583c7b7443e98e7a1d31a0b638dc', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=71938) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 24 16:31:45.377431 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8666643d-3dfe-461e-9379-24bd214a773e admin admin] REQUEST_METHOD: `GET` {{(pid=71938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 24 16:31:45.377764 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8666643d-3dfe-461e-9379-24bd214a773e admin admin] SCRIPT_NAME: `/identity` {{(pid=71938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 24 16:31:45.378124 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8666643d-3dfe-461e-9379-24bd214a773e admin admin] PATH_INFO: `/v3/projects` {{(pid=71938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 24 16:31:45.379189 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8666643d-3dfe-461e-9379-24bd214a773e admin admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=71938) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:161}} Nov 24 16:31:45.379459 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8666643d-3dfe-461e-9379-24bd214a773e admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=71938) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:442}} Nov 24 16:31:45.408510 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8666643d-3dfe-461e-9379-24bd214a773e admin admin] RBAC: Authorization granted {{(pid=71938) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 24 16:31:45.424399 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: [pid: 71938|app: 0|req: 282/563] 10.222.0.53 () {56 vars in 1160 bytes} [Wed Nov 24 16:31:45 2021] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 62 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 24 16:31:45.430396 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-500f5156-19c8-4c32-be36-cc137c446770 admin admin] Authenticating user token {{(pid=71939) process_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 24 16:31:45.440230 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-500f5156-19c8-4c32-be36-cc137c446770 admin admin] Validating token access rules against request {{(pid=71939) validate_allowed_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 24 16:31:45.444497 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9defdade-4a50-49b6-811c-fcde17d83c83 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f2ba2e8375b4e8c8792ee1e22b60427', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '00a5583c7b7443e98e7a1d31a0b638dc', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=71939) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 24 16:31:45.445145 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9defdade-4a50-49b6-811c-fcde17d83c83 admin admin] REQUEST_METHOD: `GET` {{(pid=71939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 24 16:31:45.445483 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9defdade-4a50-49b6-811c-fcde17d83c83 admin admin] SCRIPT_NAME: `/identity` {{(pid=71939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 24 16:31:45.445815 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9defdade-4a50-49b6-811c-fcde17d83c83 admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=71939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 24 16:31:45.446737 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9defdade-4a50-49b6-811c-fcde17d83c83 admin admin] RBAC: Adding query filter params (role.id=27a0b92630d549249a3beada0d8379f5, scope.project.id=3b3940d4ae1c4177ae29c02377bb4b0b, user.id=3e196802d4d5432482b6d2eabc25f74e) {{(pid=71939) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:161}} Nov 24 16:31:45.447098 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9defdade-4a50-49b6-811c-fcde17d83c83 admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=71939) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:442}} Nov 24 16:31:45.476160 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9defdade-4a50-49b6-811c-fcde17d83c83 admin admin] RBAC: Authorization granted {{(pid=71939) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 24 16:31:45.481864 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: [pid: 71939|app: 0|req: 282/564] 10.222.0.53 () {56 vars in 1386 bytes} [Wed Nov 24 16:31:45 2021] GET /identity/v3/role_assignments?user.id=3e196802d4d5432482b6d2eabc25f74e&scope.project.id=3b3940d4ae1c4177ae29c02377bb4b0b&role.id=27a0b92630d549249a3beada0d8379f5 => generated 259 bytes in 52 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 24 16:31:47.420720 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0cc234c-e6d4-4f03-8cb4-10d7e7a16353 None None] REQUEST_METHOD: `GET` {{(pid=71938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 24 16:31:47.421236 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0cc234c-e6d4-4f03-8cb4-10d7e7a16353 None None] SCRIPT_NAME: `/identity` {{(pid=71938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 24 16:31:47.421362 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0cc234c-e6d4-4f03-8cb4-10d7e7a16353 None None] PATH_INFO: `/` {{(pid=71938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 24 16:31:47.423728 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: [pid: 71938|app: 0|req: 283/565] 10.222.0.53 () {54 vars in 915 bytes} [Wed Nov 24 16:31:47 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 24 16:31:47.429757 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-831ee98e-4f77-41af-b224-0b481bc01df1 None None] REQUEST_METHOD: `POST` {{(pid=71939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 24 16:31:47.430426 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-831ee98e-4f77-41af-b224-0b481bc01df1 None None] SCRIPT_NAME: `/identity` {{(pid=71939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 24 16:31:47.430988 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-831ee98e-4f77-41af-b224-0b481bc01df1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=71939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 24 16:31:47.455218 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.auth.core [None req-831ee98e-4f77-41af-b224-0b481bc01df1 None None] MFA Rules not processed for user `0f2ba2e8375b4e8c8792ee1e22b60427`. Rule list: `[]` (Enabled: `True`). {{(pid=71939) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:442}} Nov 24 16:31:47.456447 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.fernet_utils [None req-831ee98e-4f77-41af-b224-0b481bc01df1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=71939) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:289}} Nov 24 16:31:47.463640 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: [pid: 71939|app: 0|req: 283/566] 10.222.0.53 () {58 vars in 1013 bytes} [Wed Nov 24 16:31:47 2021] POST /identity/v3/auth/tokens => generated 1616 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 24 16:31:47.486732 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72ddc862-0d1a-441f-8682-b510c0443053 None None] REQUEST_METHOD: `POST` {{(pid=71938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 24 16:31:47.487069 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72ddc862-0d1a-441f-8682-b510c0443053 None None] SCRIPT_NAME: `/identity` {{(pid=71938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 24 16:31:47.487397 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72ddc862-0d1a-441f-8682-b510c0443053 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=71938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 24 16:31:47.510349 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.auth.core [None req-72ddc862-0d1a-441f-8682-b510c0443053 None None] MFA Rules not processed for user `0f2ba2e8375b4e8c8792ee1e22b60427`. Rule list: `[]` (Enabled: `True`). {{(pid=71938) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:442}} Nov 24 16:31:47.511546 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.fernet_utils [None req-72ddc862-0d1a-441f-8682-b510c0443053 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=71938) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:289}} Nov 24 16:31:47.518596 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: [pid: 71938|app: 0|req: 284/567] 10.222.0.53 () {58 vars in 1013 bytes} [Wed Nov 24 16:31:47 2021] POST /identity/v3/auth/tokens => generated 1616 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 24 16:31:47.524430 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-831ee98e-4f77-41af-b224-0b481bc01df1 None None] Authenticating user token {{(pid=71939) process_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 24 16:31:47.534529 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-831ee98e-4f77-41af-b224-0b481bc01df1 None None] Validating token access rules against request {{(pid=71939) validate_allowed_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 24 16:31:47.538744 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3777607-afde-4b64-bba9-3c964539051f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f2ba2e8375b4e8c8792ee1e22b60427', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '00a5583c7b7443e98e7a1d31a0b638dc', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=71939) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 24 16:31:47.539595 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3777607-afde-4b64-bba9-3c964539051f admin admin] REQUEST_METHOD: `GET` {{(pid=71939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 24 16:31:47.539934 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3777607-afde-4b64-bba9-3c964539051f admin admin] SCRIPT_NAME: `/identity` {{(pid=71939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 24 16:31:47.540262 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3777607-afde-4b64-bba9-3c964539051f admin admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=71939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 24 16:31:47.552490 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3777607-afde-4b64-bba9-3c964539051f admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=71939) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:401}} Nov 24 16:31:47.560314 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: WARNING keystone.server.flask.application [None req-f3777607-afde-4b64-bba9-3c964539051f admin admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Nov 24 16:31:47.561495 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: [pid: 71939|app: 0|req: 284/568] 10.222.0.53 () {56 vars in 1132 bytes} [Wed Nov 24 16:31:47 2021] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 38 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 24 16:31:47.567920 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72ddc862-0d1a-441f-8682-b510c0443053 None None] Authenticating user token {{(pid=71938) process_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 24 16:31:47.577117 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72ddc862-0d1a-441f-8682-b510c0443053 None None] Validating token access rules against request {{(pid=71938) validate_allowed_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 24 16:31:47.581703 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6293b03-dd1c-4de0-bfbc-4903964a78c2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f2ba2e8375b4e8c8792ee1e22b60427', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '00a5583c7b7443e98e7a1d31a0b638dc', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=71938) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 24 16:31:47.582425 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6293b03-dd1c-4de0-bfbc-4903964a78c2 admin admin] REQUEST_METHOD: `GET` {{(pid=71938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 24 16:31:47.582762 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6293b03-dd1c-4de0-bfbc-4903964a78c2 admin admin] SCRIPT_NAME: `/identity` {{(pid=71938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 24 16:31:47.583090 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6293b03-dd1c-4de0-bfbc-4903964a78c2 admin admin] PATH_INFO: `/v3/roles` {{(pid=71938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 24 16:31:47.583889 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6293b03-dd1c-4de0-bfbc-4903964a78c2 admin admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=71938) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:161}} Nov 24 16:31:47.584238 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6293b03-dd1c-4de0-bfbc-4903964a78c2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=71938) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:442}} Nov 24 16:31:47.613465 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6293b03-dd1c-4de0-bfbc-4903964a78c2 admin admin] RBAC: Authorization granted {{(pid=71938) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 24 16:31:47.622419 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: [pid: 71938|app: 0|req: 285/569] 10.222.0.53 () {56 vars in 1127 bytes} [Wed Nov 24 16:31:47 2021] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 55 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 24 16:31:47.628162 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3777607-afde-4b64-bba9-3c964539051f admin admin] Authenticating user token {{(pid=71939) process_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 24 16:31:47.638847 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3777607-afde-4b64-bba9-3c964539051f admin admin] Validating token access rules against request {{(pid=71939) validate_allowed_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 24 16:31:47.643077 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7afbb6c-fceb-4d28-abb2-cae576d49c99 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f2ba2e8375b4e8c8792ee1e22b60427', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '00a5583c7b7443e98e7a1d31a0b638dc', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=71939) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 24 16:31:47.643883 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7afbb6c-fceb-4d28-abb2-cae576d49c99 admin admin] REQUEST_METHOD: `GET` {{(pid=71939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 24 16:31:47.644225 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7afbb6c-fceb-4d28-abb2-cae576d49c99 admin admin] SCRIPT_NAME: `/identity` {{(pid=71939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 24 16:31:47.644557 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7afbb6c-fceb-4d28-abb2-cae576d49c99 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=71939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 24 16:31:47.657766 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7afbb6c-fceb-4d28-abb2-cae576d49c99 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=71939) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:442}} Nov 24 16:31:47.686560 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7afbb6c-fceb-4d28-abb2-cae576d49c99 admin admin] RBAC: Authorization granted {{(pid=71939) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 24 16:31:47.705993 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: WARNING keystone.server.flask.application [None req-c7afbb6c-fceb-4d28-abb2-cae576d49c99 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Nov 24 16:31:47.707207 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: [pid: 71939|app: 0|req: 285/570] 10.222.0.53 () {56 vars in 1120 bytes} [Wed Nov 24 16:31:47 2021] GET /identity/v3/domains/Default => generated 87 bytes in 80 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 24 16:31:47.713232 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6293b03-dd1c-4de0-bfbc-4903964a78c2 admin admin] Authenticating user token {{(pid=71938) process_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 24 16:31:47.723717 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6293b03-dd1c-4de0-bfbc-4903964a78c2 admin admin] Validating token access rules against request {{(pid=71938) validate_allowed_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 24 16:31:47.727919 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8981d5d3-9cea-4f27-afb9-fe4034daf462 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f2ba2e8375b4e8c8792ee1e22b60427', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '00a5583c7b7443e98e7a1d31a0b638dc', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=71938) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 24 16:31:47.728574 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8981d5d3-9cea-4f27-afb9-fe4034daf462 admin admin] REQUEST_METHOD: `GET` {{(pid=71938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 24 16:31:47.728913 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8981d5d3-9cea-4f27-afb9-fe4034daf462 admin admin] SCRIPT_NAME: `/identity` {{(pid=71938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 24 16:31:47.729246 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8981d5d3-9cea-4f27-afb9-fe4034daf462 admin admin] PATH_INFO: `/v3/domains` {{(pid=71938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 24 16:31:47.730040 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8981d5d3-9cea-4f27-afb9-fe4034daf462 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=71938) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:161}} Nov 24 16:31:47.730400 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8981d5d3-9cea-4f27-afb9-fe4034daf462 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=71938) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:442}} Nov 24 16:31:47.759097 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8981d5d3-9cea-4f27-afb9-fe4034daf462 admin admin] RBAC: Authorization granted {{(pid=71938) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 24 16:31:47.772994 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: [pid: 71938|app: 0|req: 286/571] 10.222.0.53 () {56 vars in 1121 bytes} [Wed Nov 24 16:31:47 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 60 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 24 16:31:47.779217 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7afbb6c-fceb-4d28-abb2-cae576d49c99 admin admin] Authenticating user token {{(pid=71939) process_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 24 16:31:47.792176 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7afbb6c-fceb-4d28-abb2-cae576d49c99 admin admin] Validating token access rules against request {{(pid=71939) validate_allowed_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 24 16:31:47.796430 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cca44e20-9340-4787-bc9d-ba82b4de9e87 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f2ba2e8375b4e8c8792ee1e22b60427', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '00a5583c7b7443e98e7a1d31a0b638dc', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=71939) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 24 16:31:47.797239 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cca44e20-9340-4787-bc9d-ba82b4de9e87 admin admin] REQUEST_METHOD: `GET` {{(pid=71939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 24 16:31:47.797580 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cca44e20-9340-4787-bc9d-ba82b4de9e87 admin admin] SCRIPT_NAME: `/identity` {{(pid=71939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 24 16:31:47.798499 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cca44e20-9340-4787-bc9d-ba82b4de9e87 admin admin] PATH_INFO: `/v3/users/nova` {{(pid=71939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 24 16:31:47.812448 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cca44e20-9340-4787-bc9d-ba82b4de9e87 admin admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=71939) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:442}} Nov 24 16:31:47.841611 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cca44e20-9340-4787-bc9d-ba82b4de9e87 admin admin] RBAC: Authorization granted {{(pid=71939) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 24 16:31:47.861764 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: WARNING keystone.server.flask.application [None req-cca44e20-9340-4787-bc9d-ba82b4de9e87 admin admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Nov 24 16:31:47.862971 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: [pid: 71939|app: 0|req: 286/572] 10.222.0.53 () {56 vars in 1105 bytes} [Wed Nov 24 16:31:47 2021] GET /identity/v3/users/nova => generated 82 bytes in 85 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 24 16:31:47.869160 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8981d5d3-9cea-4f27-afb9-fe4034daf462 admin admin] Authenticating user token {{(pid=71938) process_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 24 16:31:47.879459 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8981d5d3-9cea-4f27-afb9-fe4034daf462 admin admin] Validating token access rules against request {{(pid=71938) validate_allowed_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 24 16:31:47.883176 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fabc04de-3c07-4059-a05c-ea11841ed630 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f2ba2e8375b4e8c8792ee1e22b60427', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '00a5583c7b7443e98e7a1d31a0b638dc', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=71938) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 24 16:31:47.883840 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fabc04de-3c07-4059-a05c-ea11841ed630 admin admin] REQUEST_METHOD: `GET` {{(pid=71938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 24 16:31:47.884627 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fabc04de-3c07-4059-a05c-ea11841ed630 admin admin] SCRIPT_NAME: `/identity` {{(pid=71938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 24 16:31:47.884627 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fabc04de-3c07-4059-a05c-ea11841ed630 admin admin] PATH_INFO: `/v3/users` {{(pid=71938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 24 16:31:47.885366 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fabc04de-3c07-4059-a05c-ea11841ed630 admin admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=71938) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:161}} Nov 24 16:31:47.885719 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fabc04de-3c07-4059-a05c-ea11841ed630 admin admin] RBAC: Authorizing `identity:list_users()` {{(pid=71938) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:442}} Nov 24 16:31:47.915041 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fabc04de-3c07-4059-a05c-ea11841ed630 admin admin] RBAC: Authorization granted {{(pid=71938) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 24 16:31:47.945336 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: [pid: 71938|app: 0|req: 287/573] 10.222.0.53 () {56 vars in 1145 bytes} [Wed Nov 24 16:31:47 2021] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 77 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 24 16:31:47.951289 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cca44e20-9340-4787-bc9d-ba82b4de9e87 admin admin] Authenticating user token {{(pid=71939) process_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 24 16:31:47.962233 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cca44e20-9340-4787-bc9d-ba82b4de9e87 admin admin] Validating token access rules against request {{(pid=71939) validate_allowed_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 24 16:31:47.966492 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a27fa501-a284-43a7-a8f9-7550434324fd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f2ba2e8375b4e8c8792ee1e22b60427', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '00a5583c7b7443e98e7a1d31a0b638dc', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=71939) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 24 16:31:47.967294 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a27fa501-a284-43a7-a8f9-7550434324fd admin admin] REQUEST_METHOD: `GET` {{(pid=71939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 24 16:31:47.967635 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a27fa501-a284-43a7-a8f9-7550434324fd admin admin] SCRIPT_NAME: `/identity` {{(pid=71939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 24 16:31:47.967967 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a27fa501-a284-43a7-a8f9-7550434324fd admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=71939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 24 16:31:47.981173 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a27fa501-a284-43a7-a8f9-7550434324fd admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=71939) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:442}} Nov 24 16:31:48.009226 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a27fa501-a284-43a7-a8f9-7550434324fd admin admin] RBAC: Authorization granted {{(pid=71939) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 24 16:31:48.028608 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: WARNING keystone.server.flask.application [None req-a27fa501-a284-43a7-a8f9-7550434324fd admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Nov 24 16:31:48.029837 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: [pid: 71939|app: 0|req: 287/574] 10.222.0.53 () {56 vars in 1120 bytes} [Wed Nov 24 16:31:47 2021] GET /identity/v3/domains/Default => generated 87 bytes in 79 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 24 16:31:48.038207 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fabc04de-3c07-4059-a05c-ea11841ed630 admin admin] Authenticating user token {{(pid=71938) process_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 24 16:31:48.048995 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fabc04de-3c07-4059-a05c-ea11841ed630 admin admin] Validating token access rules against request {{(pid=71938) validate_allowed_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 24 16:31:48.053373 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-594e4416-f4ee-40b1-9764-9c953d70750e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f2ba2e8375b4e8c8792ee1e22b60427', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '00a5583c7b7443e98e7a1d31a0b638dc', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=71938) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 24 16:31:48.054058 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-594e4416-f4ee-40b1-9764-9c953d70750e admin admin] REQUEST_METHOD: `GET` {{(pid=71938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 24 16:31:48.054434 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-594e4416-f4ee-40b1-9764-9c953d70750e admin admin] SCRIPT_NAME: `/identity` {{(pid=71938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 24 16:31:48.054769 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-594e4416-f4ee-40b1-9764-9c953d70750e admin admin] PATH_INFO: `/v3/domains` {{(pid=71938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 24 16:31:48.055554 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-594e4416-f4ee-40b1-9764-9c953d70750e admin admin] RBAC: Adding query filter params (name=Default) {{(pid=71938) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:161}} Nov 24 16:31:48.055909 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-594e4416-f4ee-40b1-9764-9c953d70750e admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=71938) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:442}} Nov 24 16:31:48.084780 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-594e4416-f4ee-40b1-9764-9c953d70750e admin admin] RBAC: Authorization granted {{(pid=71938) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 24 16:31:48.098373 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: [pid: 71938|app: 0|req: 288/575] 10.222.0.53 () {56 vars in 1121 bytes} [Wed Nov 24 16:31:48 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 61 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 24 16:31:48.106582 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a27fa501-a284-43a7-a8f9-7550434324fd admin admin] Authenticating user token {{(pid=71939) process_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 24 16:31:48.117480 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a27fa501-a284-43a7-a8f9-7550434324fd admin admin] Validating token access rules against request {{(pid=71939) validate_allowed_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 24 16:31:48.121934 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91aecb1c-cf94-428f-9393-c97426d31fe4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f2ba2e8375b4e8c8792ee1e22b60427', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '00a5583c7b7443e98e7a1d31a0b638dc', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=71939) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 24 16:31:48.122783 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91aecb1c-cf94-428f-9393-c97426d31fe4 admin admin] REQUEST_METHOD: `GET` {{(pid=71939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 24 16:31:48.123120 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91aecb1c-cf94-428f-9393-c97426d31fe4 admin admin] SCRIPT_NAME: `/identity` {{(pid=71939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 24 16:31:48.123458 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91aecb1c-cf94-428f-9393-c97426d31fe4 admin admin] PATH_INFO: `/v3/projects/service` {{(pid=71939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 24 16:31:48.132789 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91aecb1c-cf94-428f-9393-c97426d31fe4 admin admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=71939) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:442}} Nov 24 16:31:48.162116 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91aecb1c-cf94-428f-9393-c97426d31fe4 admin admin] RBAC: Authorization granted {{(pid=71939) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 24 16:31:48.177719 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: WARNING keystone.server.flask.application [None req-91aecb1c-cf94-428f-9393-c97426d31fe4 admin admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Nov 24 16:31:48.180346 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: [pid: 71939|app: 0|req: 288/576] 10.222.0.53 () {56 vars in 1123 bytes} [Wed Nov 24 16:31:48 2021] GET /identity/v3/projects/service => generated 88 bytes in 74 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 24 16:31:48.186588 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-594e4416-f4ee-40b1-9764-9c953d70750e admin admin] Authenticating user token {{(pid=71938) process_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 24 16:31:48.197025 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-594e4416-f4ee-40b1-9764-9c953d70750e admin admin] Validating token access rules against request {{(pid=71938) validate_allowed_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 24 16:31:48.201249 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb7ccaf7-3de1-4bc2-a02a-f230adb7b603 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f2ba2e8375b4e8c8792ee1e22b60427', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '00a5583c7b7443e98e7a1d31a0b638dc', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=71938) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 24 16:31:48.201908 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb7ccaf7-3de1-4bc2-a02a-f230adb7b603 admin admin] REQUEST_METHOD: `GET` {{(pid=71938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 24 16:31:48.202269 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb7ccaf7-3de1-4bc2-a02a-f230adb7b603 admin admin] SCRIPT_NAME: `/identity` {{(pid=71938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 24 16:31:48.202857 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb7ccaf7-3de1-4bc2-a02a-f230adb7b603 admin admin] PATH_INFO: `/v3/projects` {{(pid=71938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 24 16:31:48.203695 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb7ccaf7-3de1-4bc2-a02a-f230adb7b603 admin admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=71938) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:161}} Nov 24 16:31:48.204693 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb7ccaf7-3de1-4bc2-a02a-f230adb7b603 admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=71938) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:442}} Nov 24 16:31:48.233171 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb7ccaf7-3de1-4bc2-a02a-f230adb7b603 admin admin] RBAC: Authorization granted {{(pid=71938) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 24 16:31:48.246976 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: [pid: 71938|app: 0|req: 289/577] 10.222.0.53 () {56 vars in 1160 bytes} [Wed Nov 24 16:31:48 2021] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 61 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 24 16:31:48.253634 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91aecb1c-cf94-428f-9393-c97426d31fe4 admin admin] Authenticating user token {{(pid=71939) process_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 24 16:31:48.263722 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91aecb1c-cf94-428f-9393-c97426d31fe4 admin admin] Validating token access rules against request {{(pid=71939) validate_allowed_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 24 16:31:48.269364 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a595755d-a9c7-42ff-bb60-ec92324347e2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f2ba2e8375b4e8c8792ee1e22b60427', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '00a5583c7b7443e98e7a1d31a0b638dc', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=71939) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 24 16:31:48.270520 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a595755d-a9c7-42ff-bb60-ec92324347e2 admin admin] REQUEST_METHOD: `PUT` {{(pid=71939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 24 16:31:48.270641 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a595755d-a9c7-42ff-bb60-ec92324347e2 admin admin] SCRIPT_NAME: `/identity` {{(pid=71939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 24 16:31:48.270930 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a595755d-a9c7-42ff-bb60-ec92324347e2 admin admin] PATH_INFO: `/v3/projects/3b3940d4ae1c4177ae29c02377bb4b0b/users/3e196802d4d5432482b6d2eabc25f74e/roles/27a0b92630d549249a3beada0d8379f5` {{(pid=71939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 24 16:31:48.273115 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a595755d-a9c7-42ff-bb60-ec92324347e2 admin admin] RBAC: Authorizing `identity:create_grant(project_id=3b3940d4ae1c4177ae29c02377bb4b0b, user_id=3e196802d4d5432482b6d2eabc25f74e, role_id=27a0b92630d549249a3beada0d8379f5)` {{(pid=71939) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:442}} Nov 24 16:31:48.302204 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a595755d-a9c7-42ff-bb60-ec92324347e2 admin admin] RBAC: Authorization granted {{(pid=71939) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 24 16:31:48.314843 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: [pid: 71939|app: 0|req: 289/578] 10.222.0.53 () {58 vars in 1451 bytes} [Wed Nov 24 16:31:48 2021] PUT /identity/v3/projects/3b3940d4ae1c4177ae29c02377bb4b0b/users/3e196802d4d5432482b6d2eabc25f74e/roles/27a0b92630d549249a3beada0d8379f5 => generated 0 bytes in 62 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 24 16:31:50.281141 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5af7f796-87c5-4183-9111-6e0c741f9cf7 None None] REQUEST_METHOD: `GET` {{(pid=71938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 24 16:31:50.281652 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5af7f796-87c5-4183-9111-6e0c741f9cf7 None None] SCRIPT_NAME: `/identity` {{(pid=71938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 24 16:31:50.281836 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5af7f796-87c5-4183-9111-6e0c741f9cf7 None None] PATH_INFO: `/` {{(pid=71938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 24 16:31:50.284367 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: [pid: 71938|app: 0|req: 290/579] 10.222.0.53 () {54 vars in 915 bytes} [Wed Nov 24 16:31:50 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 24 16:31:50.292053 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8334244-3c23-4c4b-bde7-9f50e8283e9a None None] REQUEST_METHOD: `POST` {{(pid=71939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 24 16:31:50.292408 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8334244-3c23-4c4b-bde7-9f50e8283e9a None None] SCRIPT_NAME: `/identity` {{(pid=71939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 24 16:31:50.292747 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8334244-3c23-4c4b-bde7-9f50e8283e9a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=71939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 24 16:31:50.316189 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.auth.core [None req-c8334244-3c23-4c4b-bde7-9f50e8283e9a None None] MFA Rules not processed for user `0f2ba2e8375b4e8c8792ee1e22b60427`. Rule list: `[]` (Enabled: `True`). {{(pid=71939) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:442}} Nov 24 16:31:50.317423 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.fernet_utils [None req-c8334244-3c23-4c4b-bde7-9f50e8283e9a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=71939) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:289}} Nov 24 16:31:50.385588 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: [pid: 71939|app: 0|req: 290/580] 10.222.0.53 () {58 vars in 1013 bytes} [Wed Nov 24 16:31:50 2021] POST /identity/v3/auth/tokens => generated 1616 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 24 16:31:50.408631 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a4fc27b-d9fa-48cd-b961-26480a74365c None None] REQUEST_METHOD: `POST` {{(pid=71938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 24 16:31:50.409018 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a4fc27b-d9fa-48cd-b961-26480a74365c None None] SCRIPT_NAME: `/identity` {{(pid=71938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 24 16:31:50.409403 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a4fc27b-d9fa-48cd-b961-26480a74365c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=71938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 24 16:31:50.432260 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.auth.core [None req-0a4fc27b-d9fa-48cd-b961-26480a74365c None None] MFA Rules not processed for user `0f2ba2e8375b4e8c8792ee1e22b60427`. Rule list: `[]` (Enabled: `True`). {{(pid=71938) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:442}} Nov 24 16:31:50.433467 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.fernet_utils [None req-0a4fc27b-d9fa-48cd-b961-26480a74365c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=71938) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:289}} Nov 24 16:31:50.441113 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: [pid: 71938|app: 0|req: 291/581] 10.222.0.53 () {58 vars in 1013 bytes} [Wed Nov 24 16:31:50 2021] POST /identity/v3/auth/tokens => generated 1616 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 24 16:31:50.446644 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8334244-3c23-4c4b-bde7-9f50e8283e9a None None] Authenticating user token {{(pid=71939) process_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 24 16:31:50.456895 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8334244-3c23-4c4b-bde7-9f50e8283e9a None None] Validating token access rules against request {{(pid=71939) validate_allowed_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 24 16:31:50.461120 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4982fff4-e846-4fd7-bcbe-b1a065016073 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f2ba2e8375b4e8c8792ee1e22b60427', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '00a5583c7b7443e98e7a1d31a0b638dc', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=71939) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 24 16:31:50.461937 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4982fff4-e846-4fd7-bcbe-b1a065016073 admin admin] REQUEST_METHOD: `GET` {{(pid=71939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 24 16:31:50.462305 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4982fff4-e846-4fd7-bcbe-b1a065016073 admin admin] SCRIPT_NAME: `/identity` {{(pid=71939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 24 16:31:50.462637 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4982fff4-e846-4fd7-bcbe-b1a065016073 admin admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=71939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 24 16:31:50.474278 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4982fff4-e846-4fd7-bcbe-b1a065016073 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=71939) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:401}} Nov 24 16:31:50.481953 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: WARNING keystone.server.flask.application [None req-4982fff4-e846-4fd7-bcbe-b1a065016073 admin admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Nov 24 16:31:50.483132 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: [pid: 71939|app: 0|req: 291/582] 10.222.0.53 () {56 vars in 1132 bytes} [Wed Nov 24 16:31:50 2021] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 37 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 24 16:31:50.489439 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a4fc27b-d9fa-48cd-b961-26480a74365c None None] Authenticating user token {{(pid=71938) process_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 24 16:31:50.498474 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a4fc27b-d9fa-48cd-b961-26480a74365c None None] Validating token access rules against request {{(pid=71938) validate_allowed_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 24 16:31:50.503256 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8bf4f31-8876-42ef-bd81-5bf206296286 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f2ba2e8375b4e8c8792ee1e22b60427', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '00a5583c7b7443e98e7a1d31a0b638dc', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=71938) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 24 16:31:50.503916 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8bf4f31-8876-42ef-bd81-5bf206296286 admin admin] REQUEST_METHOD: `GET` {{(pid=71938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 24 16:31:50.504258 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8bf4f31-8876-42ef-bd81-5bf206296286 admin admin] SCRIPT_NAME: `/identity` {{(pid=71938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 24 16:31:50.504595 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8bf4f31-8876-42ef-bd81-5bf206296286 admin admin] PATH_INFO: `/v3/roles` {{(pid=71938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 24 16:31:50.505398 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8bf4f31-8876-42ef-bd81-5bf206296286 admin admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=71938) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:161}} Nov 24 16:31:50.505751 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8bf4f31-8876-42ef-bd81-5bf206296286 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=71938) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:442}} Nov 24 16:31:50.534433 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8bf4f31-8876-42ef-bd81-5bf206296286 admin admin] RBAC: Authorization granted {{(pid=71938) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 24 16:31:50.543606 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: [pid: 71938|app: 0|req: 292/583] 10.222.0.53 () {56 vars in 1127 bytes} [Wed Nov 24 16:31:50 2021] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 55 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 24 16:31:50.549635 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4982fff4-e846-4fd7-bcbe-b1a065016073 admin admin] Authenticating user token {{(pid=71939) process_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 24 16:31:50.559892 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4982fff4-e846-4fd7-bcbe-b1a065016073 admin admin] Validating token access rules against request {{(pid=71939) validate_allowed_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 24 16:31:50.564663 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5342833-cfee-4390-94b3-162bfce3770c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f2ba2e8375b4e8c8792ee1e22b60427', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '00a5583c7b7443e98e7a1d31a0b638dc', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=71939) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 24 16:31:50.565453 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5342833-cfee-4390-94b3-162bfce3770c admin admin] REQUEST_METHOD: `GET` {{(pid=71939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 24 16:31:50.565793 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5342833-cfee-4390-94b3-162bfce3770c admin admin] SCRIPT_NAME: `/identity` {{(pid=71939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 24 16:31:50.566151 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5342833-cfee-4390-94b3-162bfce3770c admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=71939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 24 16:31:50.577998 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5342833-cfee-4390-94b3-162bfce3770c admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=71939) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:442}} Nov 24 16:31:50.606664 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5342833-cfee-4390-94b3-162bfce3770c admin admin] RBAC: Authorization granted {{(pid=71939) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 24 16:31:50.625581 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: WARNING keystone.server.flask.application [None req-f5342833-cfee-4390-94b3-162bfce3770c admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Nov 24 16:31:50.627244 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: [pid: 71939|app: 0|req: 292/584] 10.222.0.53 () {56 vars in 1120 bytes} [Wed Nov 24 16:31:50 2021] GET /identity/v3/domains/Default => generated 87 bytes in 78 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 24 16:31:50.632991 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8bf4f31-8876-42ef-bd81-5bf206296286 admin admin] Authenticating user token {{(pid=71938) process_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 24 16:31:50.643349 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8bf4f31-8876-42ef-bd81-5bf206296286 admin admin] Validating token access rules against request {{(pid=71938) validate_allowed_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 24 16:31:50.647634 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e3d7359-9276-4619-92a4-9893df634387 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f2ba2e8375b4e8c8792ee1e22b60427', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '00a5583c7b7443e98e7a1d31a0b638dc', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=71938) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 24 16:31:50.648295 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e3d7359-9276-4619-92a4-9893df634387 admin admin] REQUEST_METHOD: `GET` {{(pid=71938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 24 16:31:50.648636 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e3d7359-9276-4619-92a4-9893df634387 admin admin] SCRIPT_NAME: `/identity` {{(pid=71938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 24 16:31:50.648979 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e3d7359-9276-4619-92a4-9893df634387 admin admin] PATH_INFO: `/v3/domains` {{(pid=71938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 24 16:31:50.649758 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e3d7359-9276-4619-92a4-9893df634387 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=71938) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:161}} Nov 24 16:31:50.650139 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e3d7359-9276-4619-92a4-9893df634387 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=71938) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:442}} Nov 24 16:31:50.678159 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e3d7359-9276-4619-92a4-9893df634387 admin admin] RBAC: Authorization granted {{(pid=71938) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 24 16:31:50.691962 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: [pid: 71938|app: 0|req: 293/585] 10.222.0.53 () {56 vars in 1121 bytes} [Wed Nov 24 16:31:50 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 59 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 24 16:31:50.697439 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5342833-cfee-4390-94b3-162bfce3770c admin admin] Authenticating user token {{(pid=71939) process_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 24 16:31:50.708244 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5342833-cfee-4390-94b3-162bfce3770c admin admin] Validating token access rules against request {{(pid=71939) validate_allowed_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 24 16:31:50.712545 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a51860dc-d374-42de-85e5-50fab1173aa0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f2ba2e8375b4e8c8792ee1e22b60427', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '00a5583c7b7443e98e7a1d31a0b638dc', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=71939) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 24 16:31:50.713336 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a51860dc-d374-42de-85e5-50fab1173aa0 admin admin] REQUEST_METHOD: `GET` {{(pid=71939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 24 16:31:50.713677 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a51860dc-d374-42de-85e5-50fab1173aa0 admin admin] SCRIPT_NAME: `/identity` {{(pid=71939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 24 16:31:50.714010 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a51860dc-d374-42de-85e5-50fab1173aa0 admin admin] PATH_INFO: `/v3/users/nova` {{(pid=71939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 24 16:31:50.730013 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a51860dc-d374-42de-85e5-50fab1173aa0 admin admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=71939) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:442}} Nov 24 16:31:50.758595 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a51860dc-d374-42de-85e5-50fab1173aa0 admin admin] RBAC: Authorization granted {{(pid=71939) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 24 16:31:50.778557 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: WARNING keystone.server.flask.application [None req-a51860dc-d374-42de-85e5-50fab1173aa0 admin admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Nov 24 16:31:50.779726 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: [pid: 71939|app: 0|req: 293/586] 10.222.0.53 () {56 vars in 1105 bytes} [Wed Nov 24 16:31:50 2021] GET /identity/v3/users/nova => generated 82 bytes in 83 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 24 16:31:50.785674 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e3d7359-9276-4619-92a4-9893df634387 admin admin] Authenticating user token {{(pid=71938) process_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 24 16:31:50.795514 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e3d7359-9276-4619-92a4-9893df634387 admin admin] Validating token access rules against request {{(pid=71938) validate_allowed_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 24 16:31:50.806395 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f783da07-5f48-4290-8498-78ee119622f9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f2ba2e8375b4e8c8792ee1e22b60427', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '00a5583c7b7443e98e7a1d31a0b638dc', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=71938) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 24 16:31:50.807071 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f783da07-5f48-4290-8498-78ee119622f9 admin admin] REQUEST_METHOD: `GET` {{(pid=71938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 24 16:31:50.807410 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f783da07-5f48-4290-8498-78ee119622f9 admin admin] SCRIPT_NAME: `/identity` {{(pid=71938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 24 16:31:50.807740 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f783da07-5f48-4290-8498-78ee119622f9 admin admin] PATH_INFO: `/v3/users` {{(pid=71938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 24 16:31:50.808638 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f783da07-5f48-4290-8498-78ee119622f9 admin admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=71938) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:161}} Nov 24 16:31:50.809033 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f783da07-5f48-4290-8498-78ee119622f9 admin admin] RBAC: Authorizing `identity:list_users()` {{(pid=71938) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:442}} Nov 24 16:31:50.838913 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f783da07-5f48-4290-8498-78ee119622f9 admin admin] RBAC: Authorization granted {{(pid=71938) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 24 16:31:50.870018 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: [pid: 71938|app: 0|req: 294/587] 10.222.0.53 () {56 vars in 1145 bytes} [Wed Nov 24 16:31:50 2021] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 85 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 24 16:31:50.876733 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a51860dc-d374-42de-85e5-50fab1173aa0 admin admin] Authenticating user token {{(pid=71939) process_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 24 16:31:50.886703 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a51860dc-d374-42de-85e5-50fab1173aa0 admin admin] Validating token access rules against request {{(pid=71939) validate_allowed_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 24 16:31:50.890906 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d6eeebf-54ff-4a21-a07d-169aabd30fb7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f2ba2e8375b4e8c8792ee1e22b60427', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '00a5583c7b7443e98e7a1d31a0b638dc', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=71939) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 24 16:31:50.891552 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d6eeebf-54ff-4a21-a07d-169aabd30fb7 admin admin] REQUEST_METHOD: `GET` {{(pid=71939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 24 16:31:50.891890 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d6eeebf-54ff-4a21-a07d-169aabd30fb7 admin admin] SCRIPT_NAME: `/identity` {{(pid=71939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 24 16:31:50.892222 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d6eeebf-54ff-4a21-a07d-169aabd30fb7 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=71939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 24 16:31:50.900287 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d6eeebf-54ff-4a21-a07d-169aabd30fb7 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=71939) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:442}} Nov 24 16:31:50.928687 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d6eeebf-54ff-4a21-a07d-169aabd30fb7 admin admin] RBAC: Authorization granted {{(pid=71939) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 24 16:31:50.937873 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: [pid: 71939|app: 0|req: 294/588] 10.222.0.53 () {58 vars in 1315 bytes} [Wed Nov 24 16:31:50 2021] GET /identity/v3/auth/tokens => generated 1616 bytes in 62 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 24 16:31:50.944767 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f783da07-5f48-4290-8498-78ee119622f9 admin admin] Authenticating user token {{(pid=71938) process_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 24 16:31:50.954999 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f783da07-5f48-4290-8498-78ee119622f9 admin admin] Validating token access rules against request {{(pid=71938) validate_allowed_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 24 16:31:50.959236 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-467de970-1eed-4d38-9f05-ec5ef283efc2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f2ba2e8375b4e8c8792ee1e22b60427', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '00a5583c7b7443e98e7a1d31a0b638dc', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=71938) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 24 16:31:50.960039 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-467de970-1eed-4d38-9f05-ec5ef283efc2 admin admin] REQUEST_METHOD: `GET` {{(pid=71938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 24 16:31:50.960373 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-467de970-1eed-4d38-9f05-ec5ef283efc2 admin admin] SCRIPT_NAME: `/identity` {{(pid=71938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 24 16:31:50.960703 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-467de970-1eed-4d38-9f05-ec5ef283efc2 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=71938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 24 16:31:50.973308 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-467de970-1eed-4d38-9f05-ec5ef283efc2 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=71938) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:442}} Nov 24 16:31:51.002911 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-467de970-1eed-4d38-9f05-ec5ef283efc2 admin admin] RBAC: Authorization granted {{(pid=71938) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 24 16:31:51.021777 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: WARNING keystone.server.flask.application [None req-467de970-1eed-4d38-9f05-ec5ef283efc2 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Nov 24 16:31:51.023049 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: [pid: 71938|app: 0|req: 295/589] 10.222.0.53 () {56 vars in 1120 bytes} [Wed Nov 24 16:31:50 2021] GET /identity/v3/domains/Default => generated 87 bytes in 79 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 24 16:31:51.029096 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d6eeebf-54ff-4a21-a07d-169aabd30fb7 admin admin] Authenticating user token {{(pid=71939) process_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 24 16:31:51.038361 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d6eeebf-54ff-4a21-a07d-169aabd30fb7 admin admin] Validating token access rules against request {{(pid=71939) validate_allowed_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 24 16:31:51.043091 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f14d167-f51d-4f0e-8516-74136517141d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f2ba2e8375b4e8c8792ee1e22b60427', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '00a5583c7b7443e98e7a1d31a0b638dc', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=71939) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 24 16:31:51.043397 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f14d167-f51d-4f0e-8516-74136517141d admin admin] REQUEST_METHOD: `GET` {{(pid=71939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 24 16:31:51.043738 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f14d167-f51d-4f0e-8516-74136517141d admin admin] SCRIPT_NAME: `/identity` {{(pid=71939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 24 16:31:51.044076 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f14d167-f51d-4f0e-8516-74136517141d admin admin] PATH_INFO: `/v3/domains` {{(pid=71939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 24 16:31:51.044866 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f14d167-f51d-4f0e-8516-74136517141d admin admin] RBAC: Adding query filter params (name=Default) {{(pid=71939) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:161}} Nov 24 16:31:51.045218 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f14d167-f51d-4f0e-8516-74136517141d admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=71939) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:442}} Nov 24 16:31:51.074214 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f14d167-f51d-4f0e-8516-74136517141d admin admin] RBAC: Authorization granted {{(pid=71939) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 24 16:31:51.088424 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: [pid: 71939|app: 0|req: 295/590] 10.222.0.53 () {56 vars in 1121 bytes} [Wed Nov 24 16:31:51 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 60 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 24 16:31:51.094578 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-467de970-1eed-4d38-9f05-ec5ef283efc2 admin admin] Authenticating user token {{(pid=71938) process_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 24 16:31:51.104516 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-467de970-1eed-4d38-9f05-ec5ef283efc2 admin admin] Validating token access rules against request {{(pid=71938) validate_allowed_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 24 16:31:51.108891 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c94dca59-14b7-4d9c-8037-8b420fc9bfee admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f2ba2e8375b4e8c8792ee1e22b60427', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '00a5583c7b7443e98e7a1d31a0b638dc', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=71938) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 24 16:31:51.109697 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c94dca59-14b7-4d9c-8037-8b420fc9bfee admin admin] REQUEST_METHOD: `GET` {{(pid=71938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 24 16:31:51.110562 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c94dca59-14b7-4d9c-8037-8b420fc9bfee admin admin] SCRIPT_NAME: `/identity` {{(pid=71938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 24 16:31:51.110895 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c94dca59-14b7-4d9c-8037-8b420fc9bfee admin admin] PATH_INFO: `/v3/projects/service` {{(pid=71938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 24 16:31:51.120254 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c94dca59-14b7-4d9c-8037-8b420fc9bfee admin admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=71938) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:442}} Nov 24 16:31:51.149442 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c94dca59-14b7-4d9c-8037-8b420fc9bfee admin admin] RBAC: Authorization granted {{(pid=71938) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 24 16:31:51.165005 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: WARNING keystone.server.flask.application [None req-c94dca59-14b7-4d9c-8037-8b420fc9bfee admin admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Nov 24 16:31:51.166462 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: [pid: 71938|app: 0|req: 296/591] 10.222.0.53 () {56 vars in 1123 bytes} [Wed Nov 24 16:31:51 2021] GET /identity/v3/projects/service => generated 88 bytes in 72 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 24 16:31:51.173260 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f14d167-f51d-4f0e-8516-74136517141d admin admin] Authenticating user token {{(pid=71939) process_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 24 16:31:51.183371 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f14d167-f51d-4f0e-8516-74136517141d admin admin] Validating token access rules against request {{(pid=71939) validate_allowed_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 24 16:31:51.187651 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dad00666-d31d-483d-948e-8a1aeaa67d98 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f2ba2e8375b4e8c8792ee1e22b60427', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '00a5583c7b7443e98e7a1d31a0b638dc', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=71939) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 24 16:31:51.188913 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dad00666-d31d-483d-948e-8a1aeaa67d98 admin admin] REQUEST_METHOD: `GET` {{(pid=71939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 24 16:31:51.189232 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dad00666-d31d-483d-948e-8a1aeaa67d98 admin admin] SCRIPT_NAME: `/identity` {{(pid=71939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 24 16:31:51.189563 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dad00666-d31d-483d-948e-8a1aeaa67d98 admin admin] PATH_INFO: `/v3/projects` {{(pid=71939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 24 16:31:51.190466 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dad00666-d31d-483d-948e-8a1aeaa67d98 admin admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=71939) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:161}} Nov 24 16:31:51.190826 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dad00666-d31d-483d-948e-8a1aeaa67d98 admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=71939) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:442}} Nov 24 16:31:51.220375 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dad00666-d31d-483d-948e-8a1aeaa67d98 admin admin] RBAC: Authorization granted {{(pid=71939) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 24 16:31:51.234930 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: [pid: 71939|app: 0|req: 296/592] 10.222.0.53 () {56 vars in 1160 bytes} [Wed Nov 24 16:31:51 2021] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 63 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 24 16:31:51.241886 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c94dca59-14b7-4d9c-8037-8b420fc9bfee admin admin] Authenticating user token {{(pid=71938) process_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 24 16:31:51.251940 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c94dca59-14b7-4d9c-8037-8b420fc9bfee admin admin] Validating token access rules against request {{(pid=71938) validate_allowed_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 24 16:31:51.256233 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a12402cf-22c8-4883-abbc-689fd4dc49d0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f2ba2e8375b4e8c8792ee1e22b60427', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '00a5583c7b7443e98e7a1d31a0b638dc', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=71938) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 24 16:31:51.256850 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a12402cf-22c8-4883-abbc-689fd4dc49d0 admin admin] REQUEST_METHOD: `GET` {{(pid=71938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 24 16:31:51.257191 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a12402cf-22c8-4883-abbc-689fd4dc49d0 admin admin] SCRIPT_NAME: `/identity` {{(pid=71938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 24 16:31:51.257526 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a12402cf-22c8-4883-abbc-689fd4dc49d0 admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=71938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 24 16:31:51.258492 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a12402cf-22c8-4883-abbc-689fd4dc49d0 admin admin] RBAC: Adding query filter params (role.id=27a0b92630d549249a3beada0d8379f5, scope.project.id=3b3940d4ae1c4177ae29c02377bb4b0b, user.id=3e196802d4d5432482b6d2eabc25f74e) {{(pid=71938) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:161}} Nov 24 16:31:51.258858 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a12402cf-22c8-4883-abbc-689fd4dc49d0 admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=71938) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:442}} Nov 24 16:31:51.287944 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a12402cf-22c8-4883-abbc-689fd4dc49d0 admin admin] RBAC: Authorization granted {{(pid=71938) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 24 16:31:51.295713 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: [pid: 71938|app: 0|req: 297/593] 10.222.0.53 () {56 vars in 1386 bytes} [Wed Nov 24 16:31:51 2021] GET /identity/v3/role_assignments?user.id=3e196802d4d5432482b6d2eabc25f74e&scope.project.id=3b3940d4ae1c4177ae29c02377bb4b0b&role.id=27a0b92630d549249a3beada0d8379f5 => generated 608 bytes in 54 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 24 16:31:53.383161 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83f70d51-0f4f-4512-abf4-d08abb65a6ae None None] REQUEST_METHOD: `GET` {{(pid=71939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 24 16:31:53.383819 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83f70d51-0f4f-4512-abf4-d08abb65a6ae None None] SCRIPT_NAME: `/identity` {{(pid=71939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 24 16:31:53.383819 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83f70d51-0f4f-4512-abf4-d08abb65a6ae None None] PATH_INFO: `/` {{(pid=71939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 24 16:31:53.385665 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: [pid: 71939|app: 0|req: 297/594] 10.222.0.53 () {54 vars in 915 bytes} [Wed Nov 24 16:31:53 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 24 16:31:53.391891 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-474ee8d9-d5dd-4891-8785-92c505d88893 None None] REQUEST_METHOD: `POST` {{(pid=71938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 24 16:31:53.392246 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-474ee8d9-d5dd-4891-8785-92c505d88893 None None] SCRIPT_NAME: `/identity` {{(pid=71938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 24 16:31:53.392579 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-474ee8d9-d5dd-4891-8785-92c505d88893 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=71938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 24 16:31:53.418777 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.auth.core [None req-474ee8d9-d5dd-4891-8785-92c505d88893 None None] MFA Rules not processed for user `0f2ba2e8375b4e8c8792ee1e22b60427`. Rule list: `[]` (Enabled: `True`). {{(pid=71938) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:442}} Nov 24 16:31:53.420007 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.fernet_utils [None req-474ee8d9-d5dd-4891-8785-92c505d88893 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=71938) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:289}} Nov 24 16:31:53.427173 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: [pid: 71938|app: 0|req: 298/595] 10.222.0.53 () {58 vars in 1013 bytes} [Wed Nov 24 16:31:53 2021] POST /identity/v3/auth/tokens => generated 1616 bytes in 37 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 24 16:31:53.449909 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d92217f6-00af-494e-9127-060e8f0cc000 None None] REQUEST_METHOD: `POST` {{(pid=71939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 24 16:31:53.450302 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d92217f6-00af-494e-9127-060e8f0cc000 None None] SCRIPT_NAME: `/identity` {{(pid=71939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 24 16:31:53.450637 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d92217f6-00af-494e-9127-060e8f0cc000 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=71939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 24 16:31:53.474334 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.auth.core [None req-d92217f6-00af-494e-9127-060e8f0cc000 None None] MFA Rules not processed for user `0f2ba2e8375b4e8c8792ee1e22b60427`. Rule list: `[]` (Enabled: `True`). {{(pid=71939) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:442}} Nov 24 16:31:53.475486 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.fernet_utils [None req-d92217f6-00af-494e-9127-060e8f0cc000 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=71939) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:289}} Nov 24 16:31:53.482443 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: [pid: 71939|app: 0|req: 298/596] 10.222.0.53 () {58 vars in 1013 bytes} [Wed Nov 24 16:31:53 2021] POST /identity/v3/auth/tokens => generated 1616 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 24 16:31:53.489754 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-474ee8d9-d5dd-4891-8785-92c505d88893 None None] Authenticating user token {{(pid=71938) process_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 24 16:31:53.499614 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-474ee8d9-d5dd-4891-8785-92c505d88893 None None] Validating token access rules against request {{(pid=71938) validate_allowed_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 24 16:31:53.504364 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f971d618-7d5f-47f8-8f74-c62124dbc37b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f2ba2e8375b4e8c8792ee1e22b60427', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '00a5583c7b7443e98e7a1d31a0b638dc', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=71938) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 24 16:31:53.505173 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f971d618-7d5f-47f8-8f74-c62124dbc37b admin admin] REQUEST_METHOD: `GET` {{(pid=71938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 24 16:31:53.505512 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f971d618-7d5f-47f8-8f74-c62124dbc37b admin admin] SCRIPT_NAME: `/identity` {{(pid=71938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 24 16:31:53.505838 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f971d618-7d5f-47f8-8f74-c62124dbc37b admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=71938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 24 16:31:53.519698 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f971d618-7d5f-47f8-8f74-c62124dbc37b admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=71938) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:442}} Nov 24 16:31:53.548002 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f971d618-7d5f-47f8-8f74-c62124dbc37b admin admin] RBAC: Authorization granted {{(pid=71938) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 24 16:31:53.567721 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: WARNING keystone.server.flask.application [None req-f971d618-7d5f-47f8-8f74-c62124dbc37b admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Nov 24 16:31:53.568964 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: [pid: 71938|app: 0|req: 299/597] 10.222.0.53 () {56 vars in 1120 bytes} [Wed Nov 24 16:31:53 2021] GET /identity/v3/domains/Default => generated 87 bytes in 80 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 24 16:31:53.576085 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d92217f6-00af-494e-9127-060e8f0cc000 None None] Authenticating user token {{(pid=71939) process_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 24 16:31:53.586261 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d92217f6-00af-494e-9127-060e8f0cc000 None None] Validating token access rules against request {{(pid=71939) validate_allowed_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 24 16:31:53.590510 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f32d587-e839-47e1-8720-575010017e0b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f2ba2e8375b4e8c8792ee1e22b60427', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '00a5583c7b7443e98e7a1d31a0b638dc', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=71939) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 24 16:31:53.591177 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f32d587-e839-47e1-8720-575010017e0b admin admin] REQUEST_METHOD: `GET` {{(pid=71939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 24 16:31:53.591519 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f32d587-e839-47e1-8720-575010017e0b admin admin] SCRIPT_NAME: `/identity` {{(pid=71939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 24 16:31:53.591855 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f32d587-e839-47e1-8720-575010017e0b admin admin] PATH_INFO: `/v3/domains` {{(pid=71939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 24 16:31:53.592640 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f32d587-e839-47e1-8720-575010017e0b admin admin] RBAC: Adding query filter params (name=Default) {{(pid=71939) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:161}} Nov 24 16:31:53.592994 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f32d587-e839-47e1-8720-575010017e0b admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=71939) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:442}} Nov 24 16:31:53.620968 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f32d587-e839-47e1-8720-575010017e0b admin admin] RBAC: Authorization granted {{(pid=71939) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 24 16:31:53.635028 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: [pid: 71939|app: 0|req: 299/598] 10.222.0.53 () {56 vars in 1121 bytes} [Wed Nov 24 16:31:53 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 60 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 24 16:31:53.640841 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f971d618-7d5f-47f8-8f74-c62124dbc37b admin admin] Authenticating user token {{(pid=71938) process_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 24 16:31:53.651358 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f971d618-7d5f-47f8-8f74-c62124dbc37b admin admin] Validating token access rules against request {{(pid=71938) validate_allowed_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 24 16:31:53.655660 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b315a663-2c86-4ecf-ba69-d6ad9c94837d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f2ba2e8375b4e8c8792ee1e22b60427', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '00a5583c7b7443e98e7a1d31a0b638dc', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=71938) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 24 16:31:53.656330 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b315a663-2c86-4ecf-ba69-d6ad9c94837d admin admin] REQUEST_METHOD: `POST` {{(pid=71938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 24 16:31:53.656671 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b315a663-2c86-4ecf-ba69-d6ad9c94837d admin admin] SCRIPT_NAME: `/identity` {{(pid=71938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 24 16:31:53.657006 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b315a663-2c86-4ecf-ba69-d6ad9c94837d admin admin] PATH_INFO: `/v3/users` {{(pid=71938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 24 16:31:53.657737 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b315a663-2c86-4ecf-ba69-d6ad9c94837d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=71938) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:442}} Nov 24 16:31:53.686176 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b315a663-2c86-4ecf-ba69-d6ad9c94837d admin admin] RBAC: Authorization granted {{(pid=71938) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 24 16:31:53.706185 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: [pid: 71938|app: 0|req: 300/599] 10.222.0.53 () {60 vars in 1143 bytes} [Wed Nov 24 16:31:53 2021] POST /identity/v3/users => generated 248 bytes in 66 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 24 16:31:55.757931 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d50b7484-8483-4b47-82c6-19fee6b67d68 None None] REQUEST_METHOD: `GET` {{(pid=71939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 24 16:31:55.758490 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d50b7484-8483-4b47-82c6-19fee6b67d68 None None] SCRIPT_NAME: `/identity` {{(pid=71939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 24 16:31:55.758616 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d50b7484-8483-4b47-82c6-19fee6b67d68 None None] PATH_INFO: `/` {{(pid=71939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 24 16:31:55.760466 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: [pid: 71939|app: 0|req: 300/600] 10.222.0.53 () {54 vars in 915 bytes} [Wed Nov 24 16:31:55 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 24 16:31:55.766383 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a38fa0f6-650e-4a5f-8ce1-551c49b3a2d8 None None] REQUEST_METHOD: `POST` {{(pid=71938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 24 16:31:55.766729 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a38fa0f6-650e-4a5f-8ce1-551c49b3a2d8 None None] SCRIPT_NAME: `/identity` {{(pid=71938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 24 16:31:55.767064 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a38fa0f6-650e-4a5f-8ce1-551c49b3a2d8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=71938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 24 16:31:55.790704 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.auth.core [None req-a38fa0f6-650e-4a5f-8ce1-551c49b3a2d8 None None] MFA Rules not processed for user `0f2ba2e8375b4e8c8792ee1e22b60427`. Rule list: `[]` (Enabled: `True`). {{(pid=71938) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:442}} Nov 24 16:31:55.791929 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.fernet_utils [None req-a38fa0f6-650e-4a5f-8ce1-551c49b3a2d8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=71938) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:289}} Nov 24 16:31:55.799065 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: [pid: 71938|app: 0|req: 301/601] 10.222.0.53 () {58 vars in 1013 bytes} [Wed Nov 24 16:31:55 2021] POST /identity/v3/auth/tokens => generated 1616 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 24 16:31:55.823527 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-333c0042-1331-4365-bc79-e17a3daf2f98 None None] REQUEST_METHOD: `POST` {{(pid=71939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 24 16:31:55.823875 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-333c0042-1331-4365-bc79-e17a3daf2f98 None None] SCRIPT_NAME: `/identity` {{(pid=71939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 24 16:31:55.824206 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-333c0042-1331-4365-bc79-e17a3daf2f98 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=71939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 24 16:31:55.848257 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.auth.core [None req-333c0042-1331-4365-bc79-e17a3daf2f98 None None] MFA Rules not processed for user `0f2ba2e8375b4e8c8792ee1e22b60427`. Rule list: `[]` (Enabled: `True`). {{(pid=71939) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:442}} Nov 24 16:31:55.849483 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.fernet_utils [None req-333c0042-1331-4365-bc79-e17a3daf2f98 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=71939) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:289}} Nov 24 16:31:55.856734 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: [pid: 71939|app: 0|req: 301/602] 10.222.0.53 () {58 vars in 1013 bytes} [Wed Nov 24 16:31:55 2021] POST /identity/v3/auth/tokens => generated 1616 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 24 16:31:55.862930 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a38fa0f6-650e-4a5f-8ce1-551c49b3a2d8 None None] Authenticating user token {{(pid=71938) process_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 24 16:31:55.872605 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a38fa0f6-650e-4a5f-8ce1-551c49b3a2d8 None None] Validating token access rules against request {{(pid=71938) validate_allowed_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 24 16:31:55.877468 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42e092f3-d04d-49de-a7cd-bca68ba6886e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f2ba2e8375b4e8c8792ee1e22b60427', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '00a5583c7b7443e98e7a1d31a0b638dc', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=71938) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 24 16:31:55.878635 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42e092f3-d04d-49de-a7cd-bca68ba6886e admin admin] REQUEST_METHOD: `GET` {{(pid=71938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 24 16:31:55.878967 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42e092f3-d04d-49de-a7cd-bca68ba6886e admin admin] SCRIPT_NAME: `/identity` {{(pid=71938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 24 16:31:55.879453 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42e092f3-d04d-49de-a7cd-bca68ba6886e admin admin] PATH_INFO: `/v3/roles/service` {{(pid=71938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 24 16:31:55.892447 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42e092f3-d04d-49de-a7cd-bca68ba6886e admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=71938) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:401}} Nov 24 16:31:55.899999 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: WARNING keystone.server.flask.application [None req-42e092f3-d04d-49de-a7cd-bca68ba6886e admin admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Nov 24 16:31:55.901237 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: [pid: 71938|app: 0|req: 302/603] 10.222.0.53 () {56 vars in 1114 bytes} [Wed Nov 24 16:31:55 2021] GET /identity/v3/roles/service => generated 85 bytes in 39 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 24 16:31:55.908126 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-333c0042-1331-4365-bc79-e17a3daf2f98 None None] Authenticating user token {{(pid=71939) process_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 24 16:31:55.917385 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-333c0042-1331-4365-bc79-e17a3daf2f98 None None] Validating token access rules against request {{(pid=71939) validate_allowed_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 24 16:31:55.921737 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16938b74-e694-4056-adcd-7497e6a9f9e3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f2ba2e8375b4e8c8792ee1e22b60427', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '00a5583c7b7443e98e7a1d31a0b638dc', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=71939) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 24 16:31:55.922429 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16938b74-e694-4056-adcd-7497e6a9f9e3 admin admin] REQUEST_METHOD: `GET` {{(pid=71939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 24 16:31:55.922769 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16938b74-e694-4056-adcd-7497e6a9f9e3 admin admin] SCRIPT_NAME: `/identity` {{(pid=71939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 24 16:31:55.923103 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16938b74-e694-4056-adcd-7497e6a9f9e3 admin admin] PATH_INFO: `/v3/roles` {{(pid=71939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 24 16:31:55.923920 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16938b74-e694-4056-adcd-7497e6a9f9e3 admin admin] RBAC: Adding query filter params (name=service) {{(pid=71939) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:161}} Nov 24 16:31:55.924270 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16938b74-e694-4056-adcd-7497e6a9f9e3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=71939) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:442}} Nov 24 16:31:55.953335 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16938b74-e694-4056-adcd-7497e6a9f9e3 admin admin] RBAC: Authorization granted {{(pid=71939) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 24 16:31:55.963549 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: [pid: 71939|app: 0|req: 302/604] 10.222.0.53 () {56 vars in 1115 bytes} [Wed Nov 24 16:31:55 2021] GET /identity/v3/roles?name=service => generated 326 bytes in 56 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 24 16:31:55.969704 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42e092f3-d04d-49de-a7cd-bca68ba6886e admin admin] Authenticating user token {{(pid=71938) process_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 24 16:31:55.980488 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42e092f3-d04d-49de-a7cd-bca68ba6886e admin admin] Validating token access rules against request {{(pid=71938) validate_allowed_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 24 16:31:55.985636 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6eb69e1c-9af6-409f-943f-71a84da65507 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f2ba2e8375b4e8c8792ee1e22b60427', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '00a5583c7b7443e98e7a1d31a0b638dc', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=71938) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 24 16:31:55.986470 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6eb69e1c-9af6-409f-943f-71a84da65507 admin admin] REQUEST_METHOD: `GET` {{(pid=71938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 24 16:31:55.986809 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6eb69e1c-9af6-409f-943f-71a84da65507 admin admin] SCRIPT_NAME: `/identity` {{(pid=71938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 24 16:31:55.987139 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6eb69e1c-9af6-409f-943f-71a84da65507 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=71938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 24 16:31:55.999326 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6eb69e1c-9af6-409f-943f-71a84da65507 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=71938) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:442}} Nov 24 16:31:56.029272 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6eb69e1c-9af6-409f-943f-71a84da65507 admin admin] RBAC: Authorization granted {{(pid=71938) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 24 16:31:56.049619 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: WARNING keystone.server.flask.application [None req-6eb69e1c-9af6-409f-943f-71a84da65507 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Nov 24 16:31:56.050997 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: [pid: 71938|app: 0|req: 303/605] 10.222.0.53 () {56 vars in 1120 bytes} [Wed Nov 24 16:31:55 2021] GET /identity/v3/domains/Default => generated 87 bytes in 82 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 24 16:31:56.057609 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16938b74-e694-4056-adcd-7497e6a9f9e3 admin admin] Authenticating user token {{(pid=71939) process_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 24 16:31:56.068594 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16938b74-e694-4056-adcd-7497e6a9f9e3 admin admin] Validating token access rules against request {{(pid=71939) validate_allowed_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 24 16:31:56.072988 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2eb42dba-cdc3-4308-bf58-6197e8173408 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f2ba2e8375b4e8c8792ee1e22b60427', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '00a5583c7b7443e98e7a1d31a0b638dc', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=71939) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 24 16:31:56.073663 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2eb42dba-cdc3-4308-bf58-6197e8173408 admin admin] REQUEST_METHOD: `GET` {{(pid=71939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 24 16:31:56.074007 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2eb42dba-cdc3-4308-bf58-6197e8173408 admin admin] SCRIPT_NAME: `/identity` {{(pid=71939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 24 16:31:56.074391 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2eb42dba-cdc3-4308-bf58-6197e8173408 admin admin] PATH_INFO: `/v3/domains` {{(pid=71939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 24 16:31:56.075351 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2eb42dba-cdc3-4308-bf58-6197e8173408 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=71939) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:161}} Nov 24 16:31:56.075814 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2eb42dba-cdc3-4308-bf58-6197e8173408 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=71939) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:442}} Nov 24 16:31:56.104929 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2eb42dba-cdc3-4308-bf58-6197e8173408 admin admin] RBAC: Authorization granted {{(pid=71939) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 24 16:31:56.119985 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: [pid: 71939|app: 0|req: 303/606] 10.222.0.53 () {56 vars in 1121 bytes} [Wed Nov 24 16:31:56 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 63 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 24 16:31:56.126999 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6eb69e1c-9af6-409f-943f-71a84da65507 admin admin] Authenticating user token {{(pid=71938) process_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 24 16:31:56.137093 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6eb69e1c-9af6-409f-943f-71a84da65507 admin admin] Validating token access rules against request {{(pid=71938) validate_allowed_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 24 16:31:56.141314 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b3bed5e-3a4f-4a4c-80ff-3877aa3ec8e1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f2ba2e8375b4e8c8792ee1e22b60427', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '00a5583c7b7443e98e7a1d31a0b638dc', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=71938) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 24 16:31:56.142154 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b3bed5e-3a4f-4a4c-80ff-3877aa3ec8e1 admin admin] REQUEST_METHOD: `GET` {{(pid=71938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 24 16:31:56.142502 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b3bed5e-3a4f-4a4c-80ff-3877aa3ec8e1 admin admin] SCRIPT_NAME: `/identity` {{(pid=71938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 24 16:31:56.142844 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b3bed5e-3a4f-4a4c-80ff-3877aa3ec8e1 admin admin] PATH_INFO: `/v3/users/glance` {{(pid=71938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 24 16:31:56.156401 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b3bed5e-3a4f-4a4c-80ff-3877aa3ec8e1 admin admin] RBAC: Authorizing `identity:get_user(user_id=glance)` {{(pid=71938) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:442}} Nov 24 16:31:56.185826 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b3bed5e-3a4f-4a4c-80ff-3877aa3ec8e1 admin admin] RBAC: Authorization granted {{(pid=71938) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 24 16:31:56.207856 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: WARNING keystone.server.flask.application [None req-8b3bed5e-3a4f-4a4c-80ff-3877aa3ec8e1 admin admin] Could not find user: glance.: keystone.exception.UserNotFound: Could not find user: glance. Nov 24 16:31:56.209333 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: [pid: 71938|app: 0|req: 304/607] 10.222.0.53 () {56 vars in 1111 bytes} [Wed Nov 24 16:31:56 2021] GET /identity/v3/users/glance => generated 84 bytes in 83 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 24 16:31:56.215271 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2eb42dba-cdc3-4308-bf58-6197e8173408 admin admin] Authenticating user token {{(pid=71939) process_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 24 16:31:56.225370 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2eb42dba-cdc3-4308-bf58-6197e8173408 admin admin] Validating token access rules against request {{(pid=71939) validate_allowed_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 24 16:31:56.229640 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d5755ae-631a-47d0-9152-a27bb845326d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f2ba2e8375b4e8c8792ee1e22b60427', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '00a5583c7b7443e98e7a1d31a0b638dc', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=71939) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 24 16:31:56.230348 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d5755ae-631a-47d0-9152-a27bb845326d admin admin] REQUEST_METHOD: `GET` {{(pid=71939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 24 16:31:56.230694 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d5755ae-631a-47d0-9152-a27bb845326d admin admin] SCRIPT_NAME: `/identity` {{(pid=71939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 24 16:31:56.231041 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d5755ae-631a-47d0-9152-a27bb845326d admin admin] PATH_INFO: `/v3/users` {{(pid=71939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 24 16:31:56.231942 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d5755ae-631a-47d0-9152-a27bb845326d admin admin] RBAC: Adding query filter params (domain_id=default, name=glance) {{(pid=71939) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:161}} Nov 24 16:31:56.232298 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d5755ae-631a-47d0-9152-a27bb845326d admin admin] RBAC: Authorizing `identity:list_users()` {{(pid=71939) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:442}} Nov 24 16:31:56.261986 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d5755ae-631a-47d0-9152-a27bb845326d admin admin] RBAC: Authorization granted {{(pid=71939) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 24 16:31:56.293482 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: [pid: 71939|app: 0|req: 304/608] 10.222.0.53 () {56 vars in 1149 bytes} [Wed Nov 24 16:31:56 2021] GET /identity/v3/users?domain_id=default&name=glance => generated 372 bytes in 79 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 24 16:31:56.300082 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b3bed5e-3a4f-4a4c-80ff-3877aa3ec8e1 admin admin] Authenticating user token {{(pid=71938) process_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 24 16:31:56.310133 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b3bed5e-3a4f-4a4c-80ff-3877aa3ec8e1 admin admin] Validating token access rules against request {{(pid=71938) validate_allowed_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 24 16:31:56.314482 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b57a368e-e881-4657-af0c-7f542bf82143 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f2ba2e8375b4e8c8792ee1e22b60427', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '00a5583c7b7443e98e7a1d31a0b638dc', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=71938) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 24 16:31:56.315134 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b57a368e-e881-4657-af0c-7f542bf82143 admin admin] REQUEST_METHOD: `GET` {{(pid=71938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 24 16:31:56.315473 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b57a368e-e881-4657-af0c-7f542bf82143 admin admin] SCRIPT_NAME: `/identity` {{(pid=71938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 24 16:31:56.315806 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b57a368e-e881-4657-af0c-7f542bf82143 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=71938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 24 16:31:56.325056 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b57a368e-e881-4657-af0c-7f542bf82143 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=71938) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:442}} Nov 24 16:31:56.355279 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b57a368e-e881-4657-af0c-7f542bf82143 admin admin] RBAC: Authorization granted {{(pid=71938) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 24 16:31:56.365121 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: [pid: 71938|app: 0|req: 305/609] 10.222.0.53 () {58 vars in 1315 bytes} [Wed Nov 24 16:31:56 2021] GET /identity/v3/auth/tokens => generated 1616 bytes in 66 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 24 16:31:56.371363 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d5755ae-631a-47d0-9152-a27bb845326d admin admin] Authenticating user token {{(pid=71939) process_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 24 16:31:56.381373 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d5755ae-631a-47d0-9152-a27bb845326d admin admin] Validating token access rules against request {{(pid=71939) validate_allowed_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 24 16:31:56.385664 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d91f036-7c1c-4451-af2c-79c0dbd5ed42 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f2ba2e8375b4e8c8792ee1e22b60427', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '00a5583c7b7443e98e7a1d31a0b638dc', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=71939) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 24 16:31:56.386526 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d91f036-7c1c-4451-af2c-79c0dbd5ed42 admin admin] REQUEST_METHOD: `GET` {{(pid=71939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 24 16:31:56.386869 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d91f036-7c1c-4451-af2c-79c0dbd5ed42 admin admin] SCRIPT_NAME: `/identity` {{(pid=71939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 24 16:31:56.387206 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d91f036-7c1c-4451-af2c-79c0dbd5ed42 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=71939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 24 16:31:56.400099 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d91f036-7c1c-4451-af2c-79c0dbd5ed42 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=71939) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:442}} Nov 24 16:31:56.429043 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d91f036-7c1c-4451-af2c-79c0dbd5ed42 admin admin] RBAC: Authorization granted {{(pid=71939) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 24 16:31:56.448633 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: WARNING keystone.server.flask.application [None req-2d91f036-7c1c-4451-af2c-79c0dbd5ed42 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Nov 24 16:31:56.449870 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: [pid: 71939|app: 0|req: 305/610] 10.222.0.53 () {56 vars in 1120 bytes} [Wed Nov 24 16:31:56 2021] GET /identity/v3/domains/Default => generated 87 bytes in 79 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 24 16:31:56.456916 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b57a368e-e881-4657-af0c-7f542bf82143 admin admin] Authenticating user token {{(pid=71938) process_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 24 16:31:56.466237 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b57a368e-e881-4657-af0c-7f542bf82143 admin admin] Validating token access rules against request {{(pid=71938) validate_allowed_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 24 16:31:56.472644 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35e5414d-f269-4d11-9393-0b4013dd0e9e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f2ba2e8375b4e8c8792ee1e22b60427', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '00a5583c7b7443e98e7a1d31a0b638dc', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=71938) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 24 16:31:56.473776 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35e5414d-f269-4d11-9393-0b4013dd0e9e admin admin] REQUEST_METHOD: `GET` {{(pid=71938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 24 16:31:56.474414 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35e5414d-f269-4d11-9393-0b4013dd0e9e admin admin] SCRIPT_NAME: `/identity` {{(pid=71938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 24 16:31:56.474899 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35e5414d-f269-4d11-9393-0b4013dd0e9e admin admin] PATH_INFO: `/v3/domains` {{(pid=71938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 24 16:31:56.475773 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35e5414d-f269-4d11-9393-0b4013dd0e9e admin admin] RBAC: Adding query filter params (name=Default) {{(pid=71938) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:161}} Nov 24 16:31:56.476144 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35e5414d-f269-4d11-9393-0b4013dd0e9e admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=71938) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:442}} Nov 24 16:31:56.505581 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35e5414d-f269-4d11-9393-0b4013dd0e9e admin admin] RBAC: Authorization granted {{(pid=71938) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 24 16:31:56.519651 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: [pid: 71938|app: 0|req: 306/611] 10.222.0.53 () {56 vars in 1121 bytes} [Wed Nov 24 16:31:56 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 63 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 24 16:31:56.525766 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d91f036-7c1c-4451-af2c-79c0dbd5ed42 admin admin] Authenticating user token {{(pid=71939) process_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 24 16:31:56.535901 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d91f036-7c1c-4451-af2c-79c0dbd5ed42 admin admin] Validating token access rules against request {{(pid=71939) validate_allowed_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 24 16:31:56.540114 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2b570da-8492-41af-b694-bf69dd9449ed admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f2ba2e8375b4e8c8792ee1e22b60427', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '00a5583c7b7443e98e7a1d31a0b638dc', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=71939) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 24 16:31:56.540924 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2b570da-8492-41af-b694-bf69dd9449ed admin admin] REQUEST_METHOD: `GET` {{(pid=71939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 24 16:31:56.541263 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2b570da-8492-41af-b694-bf69dd9449ed admin admin] SCRIPT_NAME: `/identity` {{(pid=71939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 24 16:31:56.541596 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2b570da-8492-41af-b694-bf69dd9449ed admin admin] PATH_INFO: `/v3/projects/service` {{(pid=71939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 24 16:31:56.551062 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2b570da-8492-41af-b694-bf69dd9449ed admin admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=71939) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:442}} Nov 24 16:31:56.580749 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2b570da-8492-41af-b694-bf69dd9449ed admin admin] RBAC: Authorization granted {{(pid=71939) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 24 16:31:56.596689 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: WARNING keystone.server.flask.application [None req-c2b570da-8492-41af-b694-bf69dd9449ed admin admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Nov 24 16:31:56.597913 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: [pid: 71939|app: 0|req: 306/612] 10.222.0.53 () {56 vars in 1123 bytes} [Wed Nov 24 16:31:56 2021] GET /identity/v3/projects/service => generated 88 bytes in 73 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 24 16:31:56.604144 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35e5414d-f269-4d11-9393-0b4013dd0e9e admin admin] Authenticating user token {{(pid=71938) process_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 24 16:31:56.615349 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35e5414d-f269-4d11-9393-0b4013dd0e9e admin admin] Validating token access rules against request {{(pid=71938) validate_allowed_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 24 16:31:56.619769 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-234ba258-b9b8-402e-a246-7c907bf4900a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f2ba2e8375b4e8c8792ee1e22b60427', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '00a5583c7b7443e98e7a1d31a0b638dc', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=71938) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 24 16:31:56.620436 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-234ba258-b9b8-402e-a246-7c907bf4900a admin admin] REQUEST_METHOD: `GET` {{(pid=71938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 24 16:31:56.620780 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-234ba258-b9b8-402e-a246-7c907bf4900a admin admin] SCRIPT_NAME: `/identity` {{(pid=71938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 24 16:31:56.621120 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-234ba258-b9b8-402e-a246-7c907bf4900a admin admin] PATH_INFO: `/v3/projects` {{(pid=71938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 24 16:31:56.621976 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-234ba258-b9b8-402e-a246-7c907bf4900a admin admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=71938) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:161}} Nov 24 16:31:56.622382 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-234ba258-b9b8-402e-a246-7c907bf4900a admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=71938) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:442}} Nov 24 16:31:56.651880 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-234ba258-b9b8-402e-a246-7c907bf4900a admin admin] RBAC: Authorization granted {{(pid=71938) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 24 16:31:56.666072 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: [pid: 71938|app: 0|req: 307/613] 10.222.0.53 () {56 vars in 1160 bytes} [Wed Nov 24 16:31:56 2021] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 62 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 24 16:31:56.672427 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2b570da-8492-41af-b694-bf69dd9449ed admin admin] Authenticating user token {{(pid=71939) process_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 24 16:31:56.682679 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2b570da-8492-41af-b694-bf69dd9449ed admin admin] Validating token access rules against request {{(pid=71939) validate_allowed_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 24 16:31:56.686963 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39284b25-8536-4d50-bc16-020bdbca304e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f2ba2e8375b4e8c8792ee1e22b60427', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '00a5583c7b7443e98e7a1d31a0b638dc', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=71939) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 24 16:31:56.687623 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39284b25-8536-4d50-bc16-020bdbca304e admin admin] REQUEST_METHOD: `GET` {{(pid=71939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 24 16:31:56.687962 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39284b25-8536-4d50-bc16-020bdbca304e admin admin] SCRIPT_NAME: `/identity` {{(pid=71939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 24 16:31:56.688808 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39284b25-8536-4d50-bc16-020bdbca304e admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=71939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 24 16:31:56.689699 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39284b25-8536-4d50-bc16-020bdbca304e admin admin] RBAC: Adding query filter params (role.id=2d4a51004ce34308a7a33e68bf2cfc74, scope.project.id=3b3940d4ae1c4177ae29c02377bb4b0b, user.id=af9e91f8d56c491d99fab4346754ce2e) {{(pid=71939) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:161}} Nov 24 16:31:56.690077 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39284b25-8536-4d50-bc16-020bdbca304e admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=71939) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:442}} Nov 24 16:31:56.719181 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39284b25-8536-4d50-bc16-020bdbca304e admin admin] RBAC: Authorization granted {{(pid=71939) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 24 16:31:56.725173 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: [pid: 71939|app: 0|req: 307/614] 10.222.0.53 () {56 vars in 1386 bytes} [Wed Nov 24 16:31:56 2021] GET /identity/v3/role_assignments?user.id=af9e91f8d56c491d99fab4346754ce2e&scope.project.id=3b3940d4ae1c4177ae29c02377bb4b0b&role.id=2d4a51004ce34308a7a33e68bf2cfc74 => generated 259 bytes in 53 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 24 16:31:58.709105 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d86a0d2b-be80-4c1d-86ea-9cfbdd3e649a None None] REQUEST_METHOD: `GET` {{(pid=71938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 24 16:31:58.709728 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d86a0d2b-be80-4c1d-86ea-9cfbdd3e649a None None] SCRIPT_NAME: `/identity` {{(pid=71938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 24 16:31:58.709728 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d86a0d2b-be80-4c1d-86ea-9cfbdd3e649a None None] PATH_INFO: `/` {{(pid=71938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 24 16:31:58.711669 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: [pid: 71938|app: 0|req: 308/615] 10.222.0.53 () {54 vars in 915 bytes} [Wed Nov 24 16:31:58 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 24 16:31:58.717199 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e74fa5a6-b5d2-4660-ae59-7840edca695e None None] REQUEST_METHOD: `POST` {{(pid=71939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 24 16:31:58.717588 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e74fa5a6-b5d2-4660-ae59-7840edca695e None None] SCRIPT_NAME: `/identity` {{(pid=71939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 24 16:31:58.717923 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e74fa5a6-b5d2-4660-ae59-7840edca695e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=71939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 24 16:31:58.742608 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.auth.core [None req-e74fa5a6-b5d2-4660-ae59-7840edca695e None None] MFA Rules not processed for user `0f2ba2e8375b4e8c8792ee1e22b60427`. Rule list: `[]` (Enabled: `True`). {{(pid=71939) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:442}} Nov 24 16:31:58.743842 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.fernet_utils [None req-e74fa5a6-b5d2-4660-ae59-7840edca695e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=71939) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:289}} Nov 24 16:31:58.751945 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: [pid: 71939|app: 0|req: 308/616] 10.222.0.53 () {58 vars in 1013 bytes} [Wed Nov 24 16:31:58 2021] POST /identity/v3/auth/tokens => generated 1616 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 24 16:31:58.773932 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62080a7f-ab8e-4494-a50f-d329a4a58dfa None None] REQUEST_METHOD: `POST` {{(pid=71938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 24 16:31:58.774330 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62080a7f-ab8e-4494-a50f-d329a4a58dfa None None] SCRIPT_NAME: `/identity` {{(pid=71938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 24 16:31:58.774664 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62080a7f-ab8e-4494-a50f-d329a4a58dfa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=71938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 24 16:31:58.799126 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.auth.core [None req-62080a7f-ab8e-4494-a50f-d329a4a58dfa None None] MFA Rules not processed for user `0f2ba2e8375b4e8c8792ee1e22b60427`. Rule list: `[]` (Enabled: `True`). {{(pid=71938) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:442}} Nov 24 16:31:58.800346 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.fernet_utils [None req-62080a7f-ab8e-4494-a50f-d329a4a58dfa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=71938) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:289}} Nov 24 16:31:58.807502 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: [pid: 71938|app: 0|req: 309/617] 10.222.0.53 () {58 vars in 1013 bytes} [Wed Nov 24 16:31:58 2021] POST /identity/v3/auth/tokens => generated 1616 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 24 16:31:58.813604 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e74fa5a6-b5d2-4660-ae59-7840edca695e None None] Authenticating user token {{(pid=71939) process_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 24 16:31:58.823496 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e74fa5a6-b5d2-4660-ae59-7840edca695e None None] Validating token access rules against request {{(pid=71939) validate_allowed_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 24 16:31:58.828101 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95fb72e8-a6c5-43ab-89c6-e7739d3762d9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f2ba2e8375b4e8c8792ee1e22b60427', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '00a5583c7b7443e98e7a1d31a0b638dc', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=71939) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 24 16:31:58.828927 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95fb72e8-a6c5-43ab-89c6-e7739d3762d9 admin admin] REQUEST_METHOD: `GET` {{(pid=71939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 24 16:31:58.829266 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95fb72e8-a6c5-43ab-89c6-e7739d3762d9 admin admin] SCRIPT_NAME: `/identity` {{(pid=71939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 24 16:31:58.829600 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95fb72e8-a6c5-43ab-89c6-e7739d3762d9 admin admin] PATH_INFO: `/v3/roles/service` {{(pid=71939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 24 16:31:58.841836 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95fb72e8-a6c5-43ab-89c6-e7739d3762d9 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=71939) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:401}} Nov 24 16:31:58.849937 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: WARNING keystone.server.flask.application [None req-95fb72e8-a6c5-43ab-89c6-e7739d3762d9 admin admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Nov 24 16:31:58.851186 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: [pid: 71939|app: 0|req: 309/618] 10.222.0.53 () {56 vars in 1114 bytes} [Wed Nov 24 16:31:58 2021] GET /identity/v3/roles/service => generated 85 bytes in 38 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 24 16:31:58.857929 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62080a7f-ab8e-4494-a50f-d329a4a58dfa None None] Authenticating user token {{(pid=71938) process_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 24 16:31:58.872224 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62080a7f-ab8e-4494-a50f-d329a4a58dfa None None] Validating token access rules against request {{(pid=71938) validate_allowed_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 24 16:31:58.877350 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9f61c7f-49f5-436d-97de-cc6bc42bda13 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f2ba2e8375b4e8c8792ee1e22b60427', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '00a5583c7b7443e98e7a1d31a0b638dc', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=71938) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 24 16:31:58.878050 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9f61c7f-49f5-436d-97de-cc6bc42bda13 admin admin] REQUEST_METHOD: `GET` {{(pid=71938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 24 16:31:58.878402 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9f61c7f-49f5-436d-97de-cc6bc42bda13 admin admin] SCRIPT_NAME: `/identity` {{(pid=71938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 24 16:31:58.878736 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9f61c7f-49f5-436d-97de-cc6bc42bda13 admin admin] PATH_INFO: `/v3/roles` {{(pid=71938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 24 16:31:58.879542 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9f61c7f-49f5-436d-97de-cc6bc42bda13 admin admin] RBAC: Adding query filter params (name=service) {{(pid=71938) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:161}} Nov 24 16:31:58.879906 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9f61c7f-49f5-436d-97de-cc6bc42bda13 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=71938) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:442}} Nov 24 16:31:58.908460 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9f61c7f-49f5-436d-97de-cc6bc42bda13 admin admin] RBAC: Authorization granted {{(pid=71938) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 24 16:31:58.917377 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: [pid: 71938|app: 0|req: 310/619] 10.222.0.53 () {56 vars in 1115 bytes} [Wed Nov 24 16:31:58 2021] GET /identity/v3/roles?name=service => generated 326 bytes in 60 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 24 16:31:58.923783 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95fb72e8-a6c5-43ab-89c6-e7739d3762d9 admin admin] Authenticating user token {{(pid=71939) process_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 24 16:31:58.937699 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95fb72e8-a6c5-43ab-89c6-e7739d3762d9 admin admin] Validating token access rules against request {{(pid=71939) validate_allowed_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 24 16:31:58.941893 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-962f2ab4-7956-428e-a2cb-e6ef70562cad admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f2ba2e8375b4e8c8792ee1e22b60427', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '00a5583c7b7443e98e7a1d31a0b638dc', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=71939) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 24 16:31:58.942717 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-962f2ab4-7956-428e-a2cb-e6ef70562cad admin admin] REQUEST_METHOD: `GET` {{(pid=71939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 24 16:31:58.943053 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-962f2ab4-7956-428e-a2cb-e6ef70562cad admin admin] SCRIPT_NAME: `/identity` {{(pid=71939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 24 16:31:58.943382 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-962f2ab4-7956-428e-a2cb-e6ef70562cad admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=71939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 24 16:31:58.955246 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-962f2ab4-7956-428e-a2cb-e6ef70562cad admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=71939) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:442}} Nov 24 16:31:58.983950 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-962f2ab4-7956-428e-a2cb-e6ef70562cad admin admin] RBAC: Authorization granted {{(pid=71939) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 24 16:31:59.003792 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: WARNING keystone.server.flask.application [None req-962f2ab4-7956-428e-a2cb-e6ef70562cad admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Nov 24 16:31:59.004993 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: [pid: 71939|app: 0|req: 310/620] 10.222.0.53 () {56 vars in 1120 bytes} [Wed Nov 24 16:31:58 2021] GET /identity/v3/domains/Default => generated 87 bytes in 82 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 24 16:31:59.011111 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9f61c7f-49f5-436d-97de-cc6bc42bda13 admin admin] Authenticating user token {{(pid=71938) process_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 24 16:31:59.021038 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9f61c7f-49f5-436d-97de-cc6bc42bda13 admin admin] Validating token access rules against request {{(pid=71938) validate_allowed_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 24 16:31:59.025249 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73d9a0a7-d6e3-4d74-884a-babe4c872e2c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f2ba2e8375b4e8c8792ee1e22b60427', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '00a5583c7b7443e98e7a1d31a0b638dc', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=71938) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 24 16:31:59.025913 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73d9a0a7-d6e3-4d74-884a-babe4c872e2c admin admin] REQUEST_METHOD: `GET` {{(pid=71938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 24 16:31:59.026329 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73d9a0a7-d6e3-4d74-884a-babe4c872e2c admin admin] SCRIPT_NAME: `/identity` {{(pid=71938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 24 16:31:59.026668 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73d9a0a7-d6e3-4d74-884a-babe4c872e2c admin admin] PATH_INFO: `/v3/domains` {{(pid=71938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 24 16:31:59.027450 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73d9a0a7-d6e3-4d74-884a-babe4c872e2c admin admin] RBAC: Adding query filter params (name=Default) {{(pid=71938) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:161}} Nov 24 16:31:59.027804 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73d9a0a7-d6e3-4d74-884a-babe4c872e2c admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=71938) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:442}} Nov 24 16:31:59.057028 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73d9a0a7-d6e3-4d74-884a-babe4c872e2c admin admin] RBAC: Authorization granted {{(pid=71938) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 24 16:31:59.073810 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: [pid: 71938|app: 0|req: 311/621] 10.222.0.53 () {56 vars in 1121 bytes} [Wed Nov 24 16:31:59 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 60 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 24 16:31:59.076947 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-962f2ab4-7956-428e-a2cb-e6ef70562cad admin admin] Authenticating user token {{(pid=71939) process_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 24 16:31:59.087584 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-962f2ab4-7956-428e-a2cb-e6ef70562cad admin admin] Validating token access rules against request {{(pid=71939) validate_allowed_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 24 16:31:59.091884 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44293d2e-264e-4fe2-a623-edcb5e8b0cf1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f2ba2e8375b4e8c8792ee1e22b60427', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '00a5583c7b7443e98e7a1d31a0b638dc', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=71939) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 24 16:31:59.092688 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44293d2e-264e-4fe2-a623-edcb5e8b0cf1 admin admin] REQUEST_METHOD: `GET` {{(pid=71939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 24 16:31:59.093022 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44293d2e-264e-4fe2-a623-edcb5e8b0cf1 admin admin] SCRIPT_NAME: `/identity` {{(pid=71939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 24 16:31:59.093350 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44293d2e-264e-4fe2-a623-edcb5e8b0cf1 admin admin] PATH_INFO: `/v3/users/glance` {{(pid=71939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 24 16:31:59.107280 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44293d2e-264e-4fe2-a623-edcb5e8b0cf1 admin admin] RBAC: Authorizing `identity:get_user(user_id=glance)` {{(pid=71939) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:442}} Nov 24 16:31:59.135752 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44293d2e-264e-4fe2-a623-edcb5e8b0cf1 admin admin] RBAC: Authorization granted {{(pid=71939) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 24 16:31:59.156180 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: WARNING keystone.server.flask.application [None req-44293d2e-264e-4fe2-a623-edcb5e8b0cf1 admin admin] Could not find user: glance.: keystone.exception.UserNotFound: Could not find user: glance. Nov 24 16:31:59.157947 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: [pid: 71939|app: 0|req: 311/622] 10.222.0.53 () {56 vars in 1111 bytes} [Wed Nov 24 16:31:59 2021] GET /identity/v3/users/glance => generated 84 bytes in 82 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 24 16:31:59.164607 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73d9a0a7-d6e3-4d74-884a-babe4c872e2c admin admin] Authenticating user token {{(pid=71938) process_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 24 16:31:59.175872 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73d9a0a7-d6e3-4d74-884a-babe4c872e2c admin admin] Validating token access rules against request {{(pid=71938) validate_allowed_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 24 16:31:59.180185 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-950ce2d9-79f6-4823-afa5-f387fce059a1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f2ba2e8375b4e8c8792ee1e22b60427', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '00a5583c7b7443e98e7a1d31a0b638dc', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=71938) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 24 16:31:59.180983 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-950ce2d9-79f6-4823-afa5-f387fce059a1 admin admin] REQUEST_METHOD: `GET` {{(pid=71938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 24 16:31:59.181325 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-950ce2d9-79f6-4823-afa5-f387fce059a1 admin admin] SCRIPT_NAME: `/identity` {{(pid=71938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 24 16:31:59.181657 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-950ce2d9-79f6-4823-afa5-f387fce059a1 admin admin] PATH_INFO: `/v3/users` {{(pid=71938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 24 16:31:59.182605 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-950ce2d9-79f6-4823-afa5-f387fce059a1 admin admin] RBAC: Adding query filter params (domain_id=default, name=glance) {{(pid=71938) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:161}} Nov 24 16:31:59.182964 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-950ce2d9-79f6-4823-afa5-f387fce059a1 admin admin] RBAC: Authorizing `identity:list_users()` {{(pid=71938) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:442}} Nov 24 16:31:59.212476 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-950ce2d9-79f6-4823-afa5-f387fce059a1 admin admin] RBAC: Authorization granted {{(pid=71938) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 24 16:31:59.246787 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: [pid: 71938|app: 0|req: 312/623] 10.222.0.53 () {56 vars in 1149 bytes} [Wed Nov 24 16:31:59 2021] GET /identity/v3/users?domain_id=default&name=glance => generated 372 bytes in 83 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 24 16:31:59.252732 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44293d2e-264e-4fe2-a623-edcb5e8b0cf1 admin admin] Authenticating user token {{(pid=71939) process_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 24 16:31:59.262668 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44293d2e-264e-4fe2-a623-edcb5e8b0cf1 admin admin] Validating token access rules against request {{(pid=71939) validate_allowed_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 24 16:31:59.267365 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dec8b7a5-41bb-45e4-8ee1-f723c7e0739f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f2ba2e8375b4e8c8792ee1e22b60427', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '00a5583c7b7443e98e7a1d31a0b638dc', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=71939) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 24 16:31:59.268163 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dec8b7a5-41bb-45e4-8ee1-f723c7e0739f admin admin] REQUEST_METHOD: `GET` {{(pid=71939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 24 16:31:59.268501 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dec8b7a5-41bb-45e4-8ee1-f723c7e0739f admin admin] SCRIPT_NAME: `/identity` {{(pid=71939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 24 16:31:59.268834 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dec8b7a5-41bb-45e4-8ee1-f723c7e0739f admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=71939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 24 16:31:59.282336 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dec8b7a5-41bb-45e4-8ee1-f723c7e0739f admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=71939) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:442}} Nov 24 16:31:59.310360 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dec8b7a5-41bb-45e4-8ee1-f723c7e0739f admin admin] RBAC: Authorization granted {{(pid=71939) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 24 16:31:59.330258 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: WARNING keystone.server.flask.application [None req-dec8b7a5-41bb-45e4-8ee1-f723c7e0739f admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Nov 24 16:31:59.331457 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: [pid: 71939|app: 0|req: 312/624] 10.222.0.53 () {56 vars in 1120 bytes} [Wed Nov 24 16:31:59 2021] GET /identity/v3/domains/Default => generated 87 bytes in 79 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 24 16:31:59.337493 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-950ce2d9-79f6-4823-afa5-f387fce059a1 admin admin] Authenticating user token {{(pid=71938) process_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 24 16:31:59.348253 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-950ce2d9-79f6-4823-afa5-f387fce059a1 admin admin] Validating token access rules against request {{(pid=71938) validate_allowed_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 24 16:31:59.352623 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25251883-40c1-411f-ba98-33a28cf440a8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f2ba2e8375b4e8c8792ee1e22b60427', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '00a5583c7b7443e98e7a1d31a0b638dc', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=71938) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 24 16:31:59.353286 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25251883-40c1-411f-ba98-33a28cf440a8 admin admin] REQUEST_METHOD: `GET` {{(pid=71938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 24 16:31:59.353626 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25251883-40c1-411f-ba98-33a28cf440a8 admin admin] SCRIPT_NAME: `/identity` {{(pid=71938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 24 16:31:59.353961 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25251883-40c1-411f-ba98-33a28cf440a8 admin admin] PATH_INFO: `/v3/domains` {{(pid=71938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 24 16:31:59.354776 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25251883-40c1-411f-ba98-33a28cf440a8 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=71938) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:161}} Nov 24 16:31:59.355136 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25251883-40c1-411f-ba98-33a28cf440a8 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=71938) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:442}} Nov 24 16:31:59.383258 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25251883-40c1-411f-ba98-33a28cf440a8 admin admin] RBAC: Authorization granted {{(pid=71938) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 24 16:31:59.396743 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: [pid: 71938|app: 0|req: 313/625] 10.222.0.53 () {56 vars in 1121 bytes} [Wed Nov 24 16:31:59 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 60 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 24 16:31:59.402805 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dec8b7a5-41bb-45e4-8ee1-f723c7e0739f admin admin] Authenticating user token {{(pid=71939) process_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 24 16:31:59.413333 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dec8b7a5-41bb-45e4-8ee1-f723c7e0739f admin admin] Validating token access rules against request {{(pid=71939) validate_allowed_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 24 16:31:59.417570 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f696a664-06e6-4de9-a3f6-b3e39343ff6c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f2ba2e8375b4e8c8792ee1e22b60427', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '00a5583c7b7443e98e7a1d31a0b638dc', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=71939) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 24 16:31:59.418404 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f696a664-06e6-4de9-a3f6-b3e39343ff6c admin admin] REQUEST_METHOD: `GET` {{(pid=71939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 24 16:31:59.418743 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f696a664-06e6-4de9-a3f6-b3e39343ff6c admin admin] SCRIPT_NAME: `/identity` {{(pid=71939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 24 16:31:59.419074 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f696a664-06e6-4de9-a3f6-b3e39343ff6c admin admin] PATH_INFO: `/v3/projects/service` {{(pid=71939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 24 16:31:59.428402 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f696a664-06e6-4de9-a3f6-b3e39343ff6c admin admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=71939) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:442}} Nov 24 16:31:59.457997 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f696a664-06e6-4de9-a3f6-b3e39343ff6c admin admin] RBAC: Authorization granted {{(pid=71939) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 24 16:31:59.473377 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: WARNING keystone.server.flask.application [None req-f696a664-06e6-4de9-a3f6-b3e39343ff6c admin admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Nov 24 16:31:59.474620 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: [pid: 71939|app: 0|req: 313/626] 10.222.0.53 () {56 vars in 1123 bytes} [Wed Nov 24 16:31:59 2021] GET /identity/v3/projects/service => generated 88 bytes in 72 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 24 16:31:59.480857 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25251883-40c1-411f-ba98-33a28cf440a8 admin admin] Authenticating user token {{(pid=71938) process_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 24 16:31:59.490934 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25251883-40c1-411f-ba98-33a28cf440a8 admin admin] Validating token access rules against request {{(pid=71938) validate_allowed_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 24 16:31:59.495190 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-782d4b18-27dc-4229-8e2d-5fd3b11677c0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f2ba2e8375b4e8c8792ee1e22b60427', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '00a5583c7b7443e98e7a1d31a0b638dc', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=71938) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 24 16:31:59.495849 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-782d4b18-27dc-4229-8e2d-5fd3b11677c0 admin admin] REQUEST_METHOD: `GET` {{(pid=71938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 24 16:31:59.496189 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-782d4b18-27dc-4229-8e2d-5fd3b11677c0 admin admin] SCRIPT_NAME: `/identity` {{(pid=71938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 24 16:31:59.496523 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-782d4b18-27dc-4229-8e2d-5fd3b11677c0 admin admin] PATH_INFO: `/v3/projects` {{(pid=71938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 24 16:31:59.497418 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-782d4b18-27dc-4229-8e2d-5fd3b11677c0 admin admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=71938) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:161}} Nov 24 16:31:59.497730 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-782d4b18-27dc-4229-8e2d-5fd3b11677c0 admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=71938) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:442}} Nov 24 16:31:59.527769 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-782d4b18-27dc-4229-8e2d-5fd3b11677c0 admin admin] RBAC: Authorization granted {{(pid=71938) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 24 16:31:59.541932 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: [pid: 71938|app: 0|req: 314/627] 10.222.0.53 () {56 vars in 1160 bytes} [Wed Nov 24 16:31:59 2021] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 62 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 24 16:31:59.548253 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f696a664-06e6-4de9-a3f6-b3e39343ff6c admin admin] Authenticating user token {{(pid=71939) process_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 24 16:31:59.558224 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f696a664-06e6-4de9-a3f6-b3e39343ff6c admin admin] Validating token access rules against request {{(pid=71939) validate_allowed_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 24 16:31:59.562440 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22cbce3d-c40e-4a04-bef5-b25531235bb4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f2ba2e8375b4e8c8792ee1e22b60427', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '00a5583c7b7443e98e7a1d31a0b638dc', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=71939) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 24 16:31:59.563845 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22cbce3d-c40e-4a04-bef5-b25531235bb4 admin admin] REQUEST_METHOD: `PUT` {{(pid=71939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 24 16:31:59.564184 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22cbce3d-c40e-4a04-bef5-b25531235bb4 admin admin] SCRIPT_NAME: `/identity` {{(pid=71939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 24 16:31:59.564515 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22cbce3d-c40e-4a04-bef5-b25531235bb4 admin admin] PATH_INFO: `/v3/projects/3b3940d4ae1c4177ae29c02377bb4b0b/users/af9e91f8d56c491d99fab4346754ce2e/roles/2d4a51004ce34308a7a33e68bf2cfc74` {{(pid=71939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 24 16:31:59.586592 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22cbce3d-c40e-4a04-bef5-b25531235bb4 admin admin] RBAC: Authorizing `identity:create_grant(project_id=3b3940d4ae1c4177ae29c02377bb4b0b, user_id=af9e91f8d56c491d99fab4346754ce2e, role_id=2d4a51004ce34308a7a33e68bf2cfc74)` {{(pid=71939) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:442}} Nov 24 16:31:59.619792 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22cbce3d-c40e-4a04-bef5-b25531235bb4 admin admin] RBAC: Authorization granted {{(pid=71939) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 24 16:31:59.632118 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: [pid: 71939|app: 0|req: 314/628] 10.222.0.53 () {58 vars in 1451 bytes} [Wed Nov 24 16:31:59 2021] PUT /identity/v3/projects/3b3940d4ae1c4177ae29c02377bb4b0b/users/af9e91f8d56c491d99fab4346754ce2e/roles/2d4a51004ce34308a7a33e68bf2cfc74 => generated 0 bytes in 84 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 24 16:32:01.644354 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-887a77e4-b0aa-4c88-95f8-496ee2d648d9 None None] REQUEST_METHOD: `GET` {{(pid=71938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 24 16:32:01.644927 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-887a77e4-b0aa-4c88-95f8-496ee2d648d9 None None] SCRIPT_NAME: `/identity` {{(pid=71938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 24 16:32:01.645042 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-887a77e4-b0aa-4c88-95f8-496ee2d648d9 None None] PATH_INFO: `/` {{(pid=71938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 24 16:32:01.646877 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: [pid: 71938|app: 0|req: 315/629] 10.222.0.53 () {54 vars in 915 bytes} [Wed Nov 24 16:32:01 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 24 16:32:01.652629 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e7469f3-f700-4e02-a3a0-61e0b38a713e None None] REQUEST_METHOD: `POST` {{(pid=71939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 24 16:32:01.652981 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e7469f3-f700-4e02-a3a0-61e0b38a713e None None] SCRIPT_NAME: `/identity` {{(pid=71939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 24 16:32:01.653324 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e7469f3-f700-4e02-a3a0-61e0b38a713e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=71939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 24 16:32:01.677266 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.auth.core [None req-7e7469f3-f700-4e02-a3a0-61e0b38a713e None None] MFA Rules not processed for user `0f2ba2e8375b4e8c8792ee1e22b60427`. Rule list: `[]` (Enabled: `True`). {{(pid=71939) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:442}} Nov 24 16:32:01.678521 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.fernet_utils [None req-7e7469f3-f700-4e02-a3a0-61e0b38a713e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=71939) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:289}} Nov 24 16:32:01.753135 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: [pid: 71939|app: 0|req: 315/630] 10.222.0.53 () {58 vars in 1013 bytes} [Wed Nov 24 16:32:01 2021] POST /identity/v3/auth/tokens => generated 1616 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 24 16:32:01.775449 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ef6badf-6931-40c4-94bf-03edf3ae38e7 None None] REQUEST_METHOD: `POST` {{(pid=71938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 24 16:32:01.775803 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ef6badf-6931-40c4-94bf-03edf3ae38e7 None None] SCRIPT_NAME: `/identity` {{(pid=71938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 24 16:32:01.776144 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ef6badf-6931-40c4-94bf-03edf3ae38e7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=71938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 24 16:32:01.800307 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.auth.core [None req-1ef6badf-6931-40c4-94bf-03edf3ae38e7 None None] MFA Rules not processed for user `0f2ba2e8375b4e8c8792ee1e22b60427`. Rule list: `[]` (Enabled: `True`). {{(pid=71938) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:442}} Nov 24 16:32:01.801550 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.fernet_utils [None req-1ef6badf-6931-40c4-94bf-03edf3ae38e7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=71938) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:289}} Nov 24 16:32:01.809591 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: [pid: 71938|app: 0|req: 316/631] 10.222.0.53 () {58 vars in 1013 bytes} [Wed Nov 24 16:32:01 2021] POST /identity/v3/auth/tokens => generated 1616 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 24 16:32:01.815561 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e7469f3-f700-4e02-a3a0-61e0b38a713e None None] Authenticating user token {{(pid=71939) process_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 24 16:32:01.825406 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e7469f3-f700-4e02-a3a0-61e0b38a713e None None] Validating token access rules against request {{(pid=71939) validate_allowed_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 24 16:32:01.830070 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a329628-b23a-4f25-bec7-1f82bdf4b890 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f2ba2e8375b4e8c8792ee1e22b60427', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '00a5583c7b7443e98e7a1d31a0b638dc', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=71939) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 24 16:32:01.830956 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a329628-b23a-4f25-bec7-1f82bdf4b890 admin admin] REQUEST_METHOD: `GET` {{(pid=71939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 24 16:32:01.831293 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a329628-b23a-4f25-bec7-1f82bdf4b890 admin admin] SCRIPT_NAME: `/identity` {{(pid=71939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 24 16:32:01.831623 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a329628-b23a-4f25-bec7-1f82bdf4b890 admin admin] PATH_INFO: `/v3/roles/service` {{(pid=71939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 24 16:32:01.843800 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a329628-b23a-4f25-bec7-1f82bdf4b890 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=71939) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:401}} Nov 24 16:32:01.852066 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: WARNING keystone.server.flask.application [None req-8a329628-b23a-4f25-bec7-1f82bdf4b890 admin admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Nov 24 16:32:01.853344 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: [pid: 71939|app: 0|req: 316/632] 10.222.0.53 () {56 vars in 1114 bytes} [Wed Nov 24 16:32:01 2021] GET /identity/v3/roles/service => generated 85 bytes in 38 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 24 16:32:01.861450 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ef6badf-6931-40c4-94bf-03edf3ae38e7 None None] Authenticating user token {{(pid=71938) process_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 24 16:32:01.871598 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ef6badf-6931-40c4-94bf-03edf3ae38e7 None None] Validating token access rules against request {{(pid=71938) validate_allowed_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 24 16:32:01.876243 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-726ffda9-28b8-4351-9837-887b7ddcd0c1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f2ba2e8375b4e8c8792ee1e22b60427', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '00a5583c7b7443e98e7a1d31a0b638dc', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=71938) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 24 16:32:01.876931 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-726ffda9-28b8-4351-9837-887b7ddcd0c1 admin admin] REQUEST_METHOD: `GET` {{(pid=71938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 24 16:32:01.877276 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-726ffda9-28b8-4351-9837-887b7ddcd0c1 admin admin] SCRIPT_NAME: `/identity` {{(pid=71938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 24 16:32:01.877613 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-726ffda9-28b8-4351-9837-887b7ddcd0c1 admin admin] PATH_INFO: `/v3/roles` {{(pid=71938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 24 16:32:01.878462 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-726ffda9-28b8-4351-9837-887b7ddcd0c1 admin admin] RBAC: Adding query filter params (name=service) {{(pid=71938) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:161}} Nov 24 16:32:01.878819 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-726ffda9-28b8-4351-9837-887b7ddcd0c1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=71938) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:442}} Nov 24 16:32:01.907964 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-726ffda9-28b8-4351-9837-887b7ddcd0c1 admin admin] RBAC: Authorization granted {{(pid=71938) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 24 16:32:01.917984 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: [pid: 71938|app: 0|req: 317/633] 10.222.0.53 () {56 vars in 1115 bytes} [Wed Nov 24 16:32:01 2021] GET /identity/v3/roles?name=service => generated 326 bytes in 58 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 24 16:32:01.924880 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a329628-b23a-4f25-bec7-1f82bdf4b890 admin admin] Authenticating user token {{(pid=71939) process_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 24 16:32:01.937542 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a329628-b23a-4f25-bec7-1f82bdf4b890 admin admin] Validating token access rules against request {{(pid=71939) validate_allowed_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 24 16:32:01.942954 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8ec3728-92c9-449b-a861-9ca76e6fab49 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f2ba2e8375b4e8c8792ee1e22b60427', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '00a5583c7b7443e98e7a1d31a0b638dc', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=71939) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 24 16:32:01.943900 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8ec3728-92c9-449b-a861-9ca76e6fab49 admin admin] REQUEST_METHOD: `GET` {{(pid=71939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 24 16:32:01.944244 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8ec3728-92c9-449b-a861-9ca76e6fab49 admin admin] SCRIPT_NAME: `/identity` {{(pid=71939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 24 16:32:01.944581 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8ec3728-92c9-449b-a861-9ca76e6fab49 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=71939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 24 16:32:01.957418 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8ec3728-92c9-449b-a861-9ca76e6fab49 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=71939) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:442}} Nov 24 16:32:01.987088 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8ec3728-92c9-449b-a861-9ca76e6fab49 admin admin] RBAC: Authorization granted {{(pid=71939) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 24 16:32:02.007595 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: WARNING keystone.server.flask.application [None req-f8ec3728-92c9-449b-a861-9ca76e6fab49 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Nov 24 16:32:02.008836 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: [pid: 71939|app: 0|req: 317/634] 10.222.0.53 () {56 vars in 1120 bytes} [Wed Nov 24 16:32:01 2021] GET /identity/v3/domains/Default => generated 87 bytes in 84 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 24 16:32:02.015306 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-726ffda9-28b8-4351-9837-887b7ddcd0c1 admin admin] Authenticating user token {{(pid=71938) process_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 24 16:32:02.025327 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-726ffda9-28b8-4351-9837-887b7ddcd0c1 admin admin] Validating token access rules against request {{(pid=71938) validate_allowed_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 24 16:32:02.030228 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a905bc0-f280-4cb9-b497-6f46e816ebdd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f2ba2e8375b4e8c8792ee1e22b60427', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '00a5583c7b7443e98e7a1d31a0b638dc', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=71938) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 24 16:32:02.030907 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a905bc0-f280-4cb9-b497-6f46e816ebdd admin admin] REQUEST_METHOD: `GET` {{(pid=71938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 24 16:32:02.031324 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a905bc0-f280-4cb9-b497-6f46e816ebdd admin admin] SCRIPT_NAME: `/identity` {{(pid=71938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 24 16:32:02.032127 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a905bc0-f280-4cb9-b497-6f46e816ebdd admin admin] PATH_INFO: `/v3/domains` {{(pid=71938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 24 16:32:02.032977 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a905bc0-f280-4cb9-b497-6f46e816ebdd admin admin] RBAC: Adding query filter params (name=Default) {{(pid=71938) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:161}} Nov 24 16:32:02.033333 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a905bc0-f280-4cb9-b497-6f46e816ebdd admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=71938) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:442}} Nov 24 16:32:02.062986 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a905bc0-f280-4cb9-b497-6f46e816ebdd admin admin] RBAC: Authorization granted {{(pid=71938) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 24 16:32:02.078274 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: [pid: 71938|app: 0|req: 318/635] 10.222.0.53 () {56 vars in 1121 bytes} [Wed Nov 24 16:32:02 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 64 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 24 16:32:02.084800 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8ec3728-92c9-449b-a861-9ca76e6fab49 admin admin] Authenticating user token {{(pid=71939) process_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 24 16:32:02.096336 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8ec3728-92c9-449b-a861-9ca76e6fab49 admin admin] Validating token access rules against request {{(pid=71939) validate_allowed_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 24 16:32:02.101231 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-404449ef-5288-45a6-8d7f-4041ac529951 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f2ba2e8375b4e8c8792ee1e22b60427', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '00a5583c7b7443e98e7a1d31a0b638dc', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=71939) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 24 16:32:02.102218 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-404449ef-5288-45a6-8d7f-4041ac529951 admin admin] REQUEST_METHOD: `GET` {{(pid=71939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 24 16:32:02.102566 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-404449ef-5288-45a6-8d7f-4041ac529951 admin admin] SCRIPT_NAME: `/identity` {{(pid=71939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 24 16:32:02.102906 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-404449ef-5288-45a6-8d7f-4041ac529951 admin admin] PATH_INFO: `/v3/users/glance` {{(pid=71939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 24 16:32:02.118002 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-404449ef-5288-45a6-8d7f-4041ac529951 admin admin] RBAC: Authorizing `identity:get_user(user_id=glance)` {{(pid=71939) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:442}} Nov 24 16:32:02.150123 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-404449ef-5288-45a6-8d7f-4041ac529951 admin admin] RBAC: Authorization granted {{(pid=71939) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 24 16:32:02.172761 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: WARNING keystone.server.flask.application [None req-404449ef-5288-45a6-8d7f-4041ac529951 admin admin] Could not find user: glance.: keystone.exception.UserNotFound: Could not find user: glance. Nov 24 16:32:02.173972 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: [pid: 71939|app: 0|req: 318/636] 10.222.0.53 () {56 vars in 1111 bytes} [Wed Nov 24 16:32:02 2021] GET /identity/v3/users/glance => generated 84 bytes in 90 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 24 16:32:02.180296 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a905bc0-f280-4cb9-b497-6f46e816ebdd admin admin] Authenticating user token {{(pid=71938) process_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 24 16:32:02.194724 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a905bc0-f280-4cb9-b497-6f46e816ebdd admin admin] Validating token access rules against request {{(pid=71938) validate_allowed_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 24 16:32:02.199302 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c06b9d10-af2c-448b-9ae1-4175ca21bde1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f2ba2e8375b4e8c8792ee1e22b60427', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '00a5583c7b7443e98e7a1d31a0b638dc', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=71938) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 24 16:32:02.200038 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c06b9d10-af2c-448b-9ae1-4175ca21bde1 admin admin] REQUEST_METHOD: `GET` {{(pid=71938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 24 16:32:02.200446 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c06b9d10-af2c-448b-9ae1-4175ca21bde1 admin admin] SCRIPT_NAME: `/identity` {{(pid=71938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 24 16:32:02.200792 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c06b9d10-af2c-448b-9ae1-4175ca21bde1 admin admin] PATH_INFO: `/v3/users` {{(pid=71938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 24 16:32:02.201712 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c06b9d10-af2c-448b-9ae1-4175ca21bde1 admin admin] RBAC: Adding query filter params (domain_id=default, name=glance) {{(pid=71938) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:161}} Nov 24 16:32:02.202115 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c06b9d10-af2c-448b-9ae1-4175ca21bde1 admin admin] RBAC: Authorizing `identity:list_users()` {{(pid=71938) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:442}} Nov 24 16:32:02.232704 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c06b9d10-af2c-448b-9ae1-4175ca21bde1 admin admin] RBAC: Authorization granted {{(pid=71938) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 24 16:32:02.266640 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: [pid: 71938|app: 0|req: 319/637] 10.222.0.53 () {56 vars in 1149 bytes} [Wed Nov 24 16:32:02 2021] GET /identity/v3/users?domain_id=default&name=glance => generated 372 bytes in 86 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 24 16:32:02.273121 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-404449ef-5288-45a6-8d7f-4041ac529951 admin admin] Authenticating user token {{(pid=71939) process_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 24 16:32:02.284953 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-404449ef-5288-45a6-8d7f-4041ac529951 admin admin] Validating token access rules against request {{(pid=71939) validate_allowed_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 24 16:32:02.289791 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8a44978-ebc9-42e7-b70b-a10cfebee143 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f2ba2e8375b4e8c8792ee1e22b60427', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '00a5583c7b7443e98e7a1d31a0b638dc', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=71939) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 24 16:32:02.290511 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8a44978-ebc9-42e7-b70b-a10cfebee143 admin admin] REQUEST_METHOD: `GET` {{(pid=71939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 24 16:32:02.290984 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8a44978-ebc9-42e7-b70b-a10cfebee143 admin admin] SCRIPT_NAME: `/identity` {{(pid=71939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 24 16:32:02.291319 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8a44978-ebc9-42e7-b70b-a10cfebee143 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=71939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 24 16:32:02.311579 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8a44978-ebc9-42e7-b70b-a10cfebee143 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=71939) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:442}} Nov 24 16:32:02.342356 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8a44978-ebc9-42e7-b70b-a10cfebee143 admin admin] RBAC: Authorization granted {{(pid=71939) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 24 16:32:02.353373 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: [pid: 71939|app: 0|req: 319/638] 10.222.0.53 () {58 vars in 1315 bytes} [Wed Nov 24 16:32:02 2021] GET /identity/v3/auth/tokens => generated 1616 bytes in 81 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 24 16:32:02.359880 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c06b9d10-af2c-448b-9ae1-4175ca21bde1 admin admin] Authenticating user token {{(pid=71938) process_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 24 16:32:02.370556 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c06b9d10-af2c-448b-9ae1-4175ca21bde1 admin admin] Validating token access rules against request {{(pid=71938) validate_allowed_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 24 16:32:02.375343 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41ab7e8c-ad29-4df7-a72f-18b2c7d61410 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f2ba2e8375b4e8c8792ee1e22b60427', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '00a5583c7b7443e98e7a1d31a0b638dc', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=71938) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 24 16:32:02.376253 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41ab7e8c-ad29-4df7-a72f-18b2c7d61410 admin admin] REQUEST_METHOD: `GET` {{(pid=71938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 24 16:32:02.376600 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41ab7e8c-ad29-4df7-a72f-18b2c7d61410 admin admin] SCRIPT_NAME: `/identity` {{(pid=71938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 24 16:32:02.376939 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41ab7e8c-ad29-4df7-a72f-18b2c7d61410 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=71938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 24 16:32:02.390638 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41ab7e8c-ad29-4df7-a72f-18b2c7d61410 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=71938) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:442}} Nov 24 16:32:02.421299 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41ab7e8c-ad29-4df7-a72f-18b2c7d61410 admin admin] RBAC: Authorization granted {{(pid=71938) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 24 16:32:02.442857 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: WARNING keystone.server.flask.application [None req-41ab7e8c-ad29-4df7-a72f-18b2c7d61410 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Nov 24 16:32:02.444032 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: [pid: 71938|app: 0|req: 320/639] 10.222.0.53 () {56 vars in 1120 bytes} [Wed Nov 24 16:32:02 2021] GET /identity/v3/domains/Default => generated 87 bytes in 85 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 24 16:32:02.451261 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8a44978-ebc9-42e7-b70b-a10cfebee143 admin admin] Authenticating user token {{(pid=71939) process_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 24 16:32:02.461327 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8a44978-ebc9-42e7-b70b-a10cfebee143 admin admin] Validating token access rules against request {{(pid=71939) validate_allowed_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 24 16:32:02.465626 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8648cde0-1963-4360-9c99-06eaadc48f25 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f2ba2e8375b4e8c8792ee1e22b60427', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '00a5583c7b7443e98e7a1d31a0b638dc', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=71939) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 24 16:32:02.466344 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8648cde0-1963-4360-9c99-06eaadc48f25 admin admin] REQUEST_METHOD: `GET` {{(pid=71939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 24 16:32:02.466683 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8648cde0-1963-4360-9c99-06eaadc48f25 admin admin] SCRIPT_NAME: `/identity` {{(pid=71939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 24 16:32:02.467018 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8648cde0-1963-4360-9c99-06eaadc48f25 admin admin] PATH_INFO: `/v3/domains` {{(pid=71939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 24 16:32:02.467799 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8648cde0-1963-4360-9c99-06eaadc48f25 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=71939) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:161}} Nov 24 16:32:02.468146 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8648cde0-1963-4360-9c99-06eaadc48f25 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=71939) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:442}} Nov 24 16:32:02.495968 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8648cde0-1963-4360-9c99-06eaadc48f25 admin admin] RBAC: Authorization granted {{(pid=71939) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 24 16:32:02.509891 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: [pid: 71939|app: 0|req: 320/640] 10.222.0.53 () {56 vars in 1121 bytes} [Wed Nov 24 16:32:02 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 59 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Nov 24 16:32:02.516599 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41ab7e8c-ad29-4df7-a72f-18b2c7d61410 admin admin] Authenticating user token {{(pid=71938) process_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 24 16:32:02.528200 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41ab7e8c-ad29-4df7-a72f-18b2c7d61410 admin admin] Validating token access rules against request {{(pid=71938) validate_allowed_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 24 16:32:02.533234 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57e5ab33-7efd-4b89-b405-7ae8ea2930e7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f2ba2e8375b4e8c8792ee1e22b60427', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '00a5583c7b7443e98e7a1d31a0b638dc', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=71938) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 24 16:32:02.534180 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57e5ab33-7efd-4b89-b405-7ae8ea2930e7 admin admin] REQUEST_METHOD: `GET` {{(pid=71938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 24 16:32:02.534527 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57e5ab33-7efd-4b89-b405-7ae8ea2930e7 admin admin] SCRIPT_NAME: `/identity` {{(pid=71938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 24 16:32:02.534924 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57e5ab33-7efd-4b89-b405-7ae8ea2930e7 admin admin] PATH_INFO: `/v3/projects/service` {{(pid=71938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 24 16:32:02.545306 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57e5ab33-7efd-4b89-b405-7ae8ea2930e7 admin admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=71938) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:442}} Nov 24 16:32:02.575317 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57e5ab33-7efd-4b89-b405-7ae8ea2930e7 admin admin] RBAC: Authorization granted {{(pid=71938) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 24 16:32:02.591841 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: WARNING keystone.server.flask.application [None req-57e5ab33-7efd-4b89-b405-7ae8ea2930e7 admin admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Nov 24 16:32:02.593074 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: [pid: 71938|app: 0|req: 321/641] 10.222.0.53 () {56 vars in 1123 bytes} [Wed Nov 24 16:32:02 2021] GET /identity/v3/projects/service => generated 88 bytes in 78 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 24 16:32:02.600527 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8648cde0-1963-4360-9c99-06eaadc48f25 admin admin] Authenticating user token {{(pid=71939) process_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 24 16:32:02.612406 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8648cde0-1963-4360-9c99-06eaadc48f25 admin admin] Validating token access rules against request {{(pid=71939) validate_allowed_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 24 16:32:02.616958 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c752961-bc6a-41c5-aec2-20a5f9fd50f2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f2ba2e8375b4e8c8792ee1e22b60427', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '00a5583c7b7443e98e7a1d31a0b638dc', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=71939) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 24 16:32:02.617716 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c752961-bc6a-41c5-aec2-20a5f9fd50f2 admin admin] REQUEST_METHOD: `GET` {{(pid=71939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 24 16:32:02.618079 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c752961-bc6a-41c5-aec2-20a5f9fd50f2 admin admin] SCRIPT_NAME: `/identity` {{(pid=71939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 24 16:32:02.618421 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c752961-bc6a-41c5-aec2-20a5f9fd50f2 admin admin] PATH_INFO: `/v3/projects` {{(pid=71939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 24 16:32:02.619298 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c752961-bc6a-41c5-aec2-20a5f9fd50f2 admin admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=71939) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:161}} Nov 24 16:32:02.619653 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c752961-bc6a-41c5-aec2-20a5f9fd50f2 admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=71939) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:442}} Nov 24 16:32:02.650390 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c752961-bc6a-41c5-aec2-20a5f9fd50f2 admin admin] RBAC: Authorization granted {{(pid=71939) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 24 16:32:02.665368 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: [pid: 71939|app: 0|req: 321/642] 10.222.0.53 () {56 vars in 1160 bytes} [Wed Nov 24 16:32:02 2021] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 66 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 24 16:32:02.672013 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57e5ab33-7efd-4b89-b405-7ae8ea2930e7 admin admin] Authenticating user token {{(pid=71938) process_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 24 16:32:02.682625 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57e5ab33-7efd-4b89-b405-7ae8ea2930e7 admin admin] Validating token access rules against request {{(pid=71938) validate_allowed_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 24 16:32:02.687284 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8782e922-6227-48ce-95e8-dff274e09dab admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f2ba2e8375b4e8c8792ee1e22b60427', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '00a5583c7b7443e98e7a1d31a0b638dc', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=71938) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 24 16:32:02.688488 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8782e922-6227-48ce-95e8-dff274e09dab admin admin] REQUEST_METHOD: `GET` {{(pid=71938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 24 16:32:02.688850 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8782e922-6227-48ce-95e8-dff274e09dab admin admin] SCRIPT_NAME: `/identity` {{(pid=71938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 24 16:32:02.689185 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8782e922-6227-48ce-95e8-dff274e09dab admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=71938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 24 16:32:02.690121 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8782e922-6227-48ce-95e8-dff274e09dab admin admin] RBAC: Adding query filter params (role.id=2d4a51004ce34308a7a33e68bf2cfc74, scope.project.id=3b3940d4ae1c4177ae29c02377bb4b0b, user.id=af9e91f8d56c491d99fab4346754ce2e) {{(pid=71938) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:161}} Nov 24 16:32:02.690591 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8782e922-6227-48ce-95e8-dff274e09dab admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=71938) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:442}} Nov 24 16:32:02.723480 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8782e922-6227-48ce-95e8-dff274e09dab admin admin] RBAC: Authorization granted {{(pid=71938) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 24 16:32:02.730488 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: [pid: 71938|app: 0|req: 322/643] 10.222.0.53 () {56 vars in 1386 bytes} [Wed Nov 24 16:32:02 2021] GET /identity/v3/role_assignments?user.id=af9e91f8d56c491d99fab4346754ce2e&scope.project.id=3b3940d4ae1c4177ae29c02377bb4b0b&role.id=2d4a51004ce34308a7a33e68bf2cfc74 => generated 608 bytes in 59 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 24 16:32:04.772657 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07146c1b-75f9-4f69-8b30-0e15aa45e9f5 None None] REQUEST_METHOD: `GET` {{(pid=71939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 24 16:32:04.773180 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07146c1b-75f9-4f69-8b30-0e15aa45e9f5 None None] SCRIPT_NAME: `/identity` {{(pid=71939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 24 16:32:04.773394 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07146c1b-75f9-4f69-8b30-0e15aa45e9f5 None None] PATH_INFO: `/` {{(pid=71939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 24 16:32:04.775262 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: [pid: 71939|app: 0|req: 322/644] 10.222.0.53 () {54 vars in 915 bytes} [Wed Nov 24 16:32:04 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 24 16:32:04.780902 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfaab461-0b20-4869-8454-129a7bc4c5a0 None None] REQUEST_METHOD: `POST` {{(pid=71938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 24 16:32:04.781252 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfaab461-0b20-4869-8454-129a7bc4c5a0 None None] SCRIPT_NAME: `/identity` {{(pid=71938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 24 16:32:04.782141 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfaab461-0b20-4869-8454-129a7bc4c5a0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=71938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 24 16:32:04.806571 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.auth.core [None req-cfaab461-0b20-4869-8454-129a7bc4c5a0 None None] MFA Rules not processed for user `0f2ba2e8375b4e8c8792ee1e22b60427`. Rule list: `[]` (Enabled: `True`). {{(pid=71938) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:442}} Nov 24 16:32:04.807790 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.fernet_utils [None req-cfaab461-0b20-4869-8454-129a7bc4c5a0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=71938) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:289}} Nov 24 16:32:04.815196 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: [pid: 71938|app: 0|req: 323/645] 10.222.0.53 () {58 vars in 1013 bytes} [Wed Nov 24 16:32:04 2021] POST /identity/v3/auth/tokens => generated 1616 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 24 16:32:04.837778 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3de582df-2143-4b75-bcef-a6a06dddcd81 None None] REQUEST_METHOD: `POST` {{(pid=71939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 24 16:32:04.838158 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3de582df-2143-4b75-bcef-a6a06dddcd81 None None] SCRIPT_NAME: `/identity` {{(pid=71939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 24 16:32:04.838489 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3de582df-2143-4b75-bcef-a6a06dddcd81 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=71939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 24 16:32:04.862388 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.auth.core [None req-3de582df-2143-4b75-bcef-a6a06dddcd81 None None] MFA Rules not processed for user `0f2ba2e8375b4e8c8792ee1e22b60427`. Rule list: `[]` (Enabled: `True`). {{(pid=71939) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:442}} Nov 24 16:32:04.863604 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.fernet_utils [None req-3de582df-2143-4b75-bcef-a6a06dddcd81 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=71939) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:289}} Nov 24 16:32:04.870669 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: [pid: 71939|app: 0|req: 323/646] 10.222.0.53 () {58 vars in 1013 bytes} [Wed Nov 24 16:32:04 2021] POST /identity/v3/auth/tokens => generated 1616 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 24 16:32:04.876620 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfaab461-0b20-4869-8454-129a7bc4c5a0 None None] Authenticating user token {{(pid=71938) process_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 24 16:32:04.886336 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfaab461-0b20-4869-8454-129a7bc4c5a0 None None] Validating token access rules against request {{(pid=71938) validate_allowed_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 24 16:32:04.890655 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-943329f4-0660-464c-96d3-8f9b9a616e8e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f2ba2e8375b4e8c8792ee1e22b60427', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '00a5583c7b7443e98e7a1d31a0b638dc', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=71938) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 24 16:32:04.891484 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-943329f4-0660-464c-96d3-8f9b9a616e8e admin admin] REQUEST_METHOD: `GET` {{(pid=71938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 24 16:32:04.891826 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-943329f4-0660-464c-96d3-8f9b9a616e8e admin admin] SCRIPT_NAME: `/identity` {{(pid=71938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 24 16:32:04.892160 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-943329f4-0660-464c-96d3-8f9b9a616e8e admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=71938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 24 16:32:04.904493 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-943329f4-0660-464c-96d3-8f9b9a616e8e admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=71938) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:442}} Nov 24 16:32:04.933937 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-943329f4-0660-464c-96d3-8f9b9a616e8e admin admin] RBAC: Authorization granted {{(pid=71938) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 24 16:32:04.953049 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: WARNING keystone.server.flask.application [None req-943329f4-0660-464c-96d3-8f9b9a616e8e admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Nov 24 16:32:04.954273 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: [pid: 71938|app: 0|req: 324/647] 10.222.0.53 () {56 vars in 1120 bytes} [Wed Nov 24 16:32:04 2021] GET /identity/v3/domains/Default => generated 87 bytes in 78 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 24 16:32:04.961043 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3de582df-2143-4b75-bcef-a6a06dddcd81 None None] Authenticating user token {{(pid=71939) process_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 24 16:32:04.970833 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3de582df-2143-4b75-bcef-a6a06dddcd81 None None] Validating token access rules against request {{(pid=71939) validate_allowed_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 24 16:32:04.975202 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3db8375b-7680-4a46-bab8-d5e4ce987a4f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f2ba2e8375b4e8c8792ee1e22b60427', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '00a5583c7b7443e98e7a1d31a0b638dc', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=71939) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 24 16:32:04.975871 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3db8375b-7680-4a46-bab8-d5e4ce987a4f admin admin] REQUEST_METHOD: `GET` {{(pid=71939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 24 16:32:04.976216 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3db8375b-7680-4a46-bab8-d5e4ce987a4f admin admin] SCRIPT_NAME: `/identity` {{(pid=71939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 24 16:32:04.976555 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3db8375b-7680-4a46-bab8-d5e4ce987a4f admin admin] PATH_INFO: `/v3/domains` {{(pid=71939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 24 16:32:04.977339 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3db8375b-7680-4a46-bab8-d5e4ce987a4f admin admin] RBAC: Adding query filter params (name=Default) {{(pid=71939) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:161}} Nov 24 16:32:04.977694 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3db8375b-7680-4a46-bab8-d5e4ce987a4f admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=71939) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:442}} Nov 24 16:32:05.007111 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3db8375b-7680-4a46-bab8-d5e4ce987a4f admin admin] RBAC: Authorization granted {{(pid=71939) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 24 16:32:05.020649 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: [pid: 71939|app: 0|req: 324/648] 10.222.0.53 () {56 vars in 1121 bytes} [Wed Nov 24 16:32:04 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 60 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 24 16:32:05.026628 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-943329f4-0660-464c-96d3-8f9b9a616e8e admin admin] Authenticating user token {{(pid=71938) process_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 24 16:32:05.037074 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-943329f4-0660-464c-96d3-8f9b9a616e8e admin admin] Validating token access rules against request {{(pid=71938) validate_allowed_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 24 16:32:05.041304 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b810fa1-4d58-4a2f-811a-4dcdc67e1c90 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f2ba2e8375b4e8c8792ee1e22b60427', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '00a5583c7b7443e98e7a1d31a0b638dc', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=71938) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 24 16:32:05.041977 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b810fa1-4d58-4a2f-811a-4dcdc67e1c90 admin admin] REQUEST_METHOD: `POST` {{(pid=71938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 24 16:32:05.042431 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b810fa1-4d58-4a2f-811a-4dcdc67e1c90 admin admin] SCRIPT_NAME: `/identity` {{(pid=71938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 24 16:32:05.042767 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b810fa1-4d58-4a2f-811a-4dcdc67e1c90 admin admin] PATH_INFO: `/v3/users` {{(pid=71938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 24 16:32:05.043511 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b810fa1-4d58-4a2f-811a-4dcdc67e1c90 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=71938) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:442}} Nov 24 16:32:05.072610 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b810fa1-4d58-4a2f-811a-4dcdc67e1c90 admin admin] RBAC: Authorization granted {{(pid=71938) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 24 16:32:05.096029 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: [pid: 71938|app: 0|req: 325/649] 10.222.0.53 () {60 vars in 1143 bytes} [Wed Nov 24 16:32:05 2021] POST /identity/v3/users => generated 254 bytes in 70 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 24 16:32:07.112853 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1795346-0feb-426a-9174-c01ae1daef10 None None] REQUEST_METHOD: `GET` {{(pid=71939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 24 16:32:07.113376 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1795346-0feb-426a-9174-c01ae1daef10 None None] SCRIPT_NAME: `/identity` {{(pid=71939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 24 16:32:07.113499 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1795346-0feb-426a-9174-c01ae1daef10 None None] PATH_INFO: `/` {{(pid=71939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 24 16:32:07.115361 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: [pid: 71939|app: 0|req: 325/650] 10.222.0.53 () {54 vars in 915 bytes} [Wed Nov 24 16:32:07 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 24 16:32:07.121857 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d510e7fb-babd-4198-b93e-f4c76794a4d0 None None] REQUEST_METHOD: `POST` {{(pid=71938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 24 16:32:07.122237 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d510e7fb-babd-4198-b93e-f4c76794a4d0 None None] SCRIPT_NAME: `/identity` {{(pid=71938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 24 16:32:07.122576 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d510e7fb-babd-4198-b93e-f4c76794a4d0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=71938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 24 16:32:07.145616 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.auth.core [None req-d510e7fb-babd-4198-b93e-f4c76794a4d0 None None] MFA Rules not processed for user `0f2ba2e8375b4e8c8792ee1e22b60427`. Rule list: `[]` (Enabled: `True`). {{(pid=71938) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:442}} Nov 24 16:32:07.146857 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.fernet_utils [None req-d510e7fb-babd-4198-b93e-f4c76794a4d0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=71938) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:289}} Nov 24 16:32:07.153953 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: [pid: 71938|app: 0|req: 326/651] 10.222.0.53 () {58 vars in 1013 bytes} [Wed Nov 24 16:32:07 2021] POST /identity/v3/auth/tokens => generated 1616 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 24 16:32:07.177689 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56807840-c253-4702-a4b9-0766749d6459 None None] REQUEST_METHOD: `POST` {{(pid=71939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 24 16:32:07.178052 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56807840-c253-4702-a4b9-0766749d6459 None None] SCRIPT_NAME: `/identity` {{(pid=71939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 24 16:32:07.178416 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56807840-c253-4702-a4b9-0766749d6459 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=71939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 24 16:32:07.201832 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.auth.core [None req-56807840-c253-4702-a4b9-0766749d6459 None None] MFA Rules not processed for user `0f2ba2e8375b4e8c8792ee1e22b60427`. Rule list: `[]` (Enabled: `True`). {{(pid=71939) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:442}} Nov 24 16:32:07.206947 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.fernet_utils [None req-56807840-c253-4702-a4b9-0766749d6459 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=71939) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:289}} Nov 24 16:32:07.221345 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: [pid: 71939|app: 0|req: 326/652] 10.222.0.53 () {58 vars in 1013 bytes} [Wed Nov 24 16:32:07 2021] POST /identity/v3/auth/tokens => generated 1616 bytes in 45 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 24 16:32:07.225289 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d510e7fb-babd-4198-b93e-f4c76794a4d0 None None] Authenticating user token {{(pid=71938) process_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 24 16:32:07.235760 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d510e7fb-babd-4198-b93e-f4c76794a4d0 None None] Validating token access rules against request {{(pid=71938) validate_allowed_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 24 16:32:07.240071 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa1ef358-37a0-4d08-bb5f-b8890512eeca admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f2ba2e8375b4e8c8792ee1e22b60427', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '00a5583c7b7443e98e7a1d31a0b638dc', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=71938) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 24 16:32:07.240882 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa1ef358-37a0-4d08-bb5f-b8890512eeca admin admin] REQUEST_METHOD: `GET` {{(pid=71938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 24 16:32:07.241221 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa1ef358-37a0-4d08-bb5f-b8890512eeca admin admin] SCRIPT_NAME: `/identity` {{(pid=71938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 24 16:32:07.241555 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa1ef358-37a0-4d08-bb5f-b8890512eeca admin admin] PATH_INFO: `/v3/roles/service` {{(pid=71938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 24 16:32:07.253263 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa1ef358-37a0-4d08-bb5f-b8890512eeca admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=71938) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:401}} Nov 24 16:32:07.261088 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: WARNING keystone.server.flask.application [None req-aa1ef358-37a0-4d08-bb5f-b8890512eeca admin admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Nov 24 16:32:07.262325 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: [pid: 71938|app: 0|req: 327/653] 10.222.0.53 () {56 vars in 1114 bytes} [Wed Nov 24 16:32:07 2021] GET /identity/v3/roles/service => generated 85 bytes in 38 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 24 16:32:07.268942 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56807840-c253-4702-a4b9-0766749d6459 None None] Authenticating user token {{(pid=71939) process_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 24 16:32:07.278246 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56807840-c253-4702-a4b9-0766749d6459 None None] Validating token access rules against request {{(pid=71939) validate_allowed_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 24 16:32:07.283053 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-096a3757-b8da-47eb-b658-b46e41507216 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f2ba2e8375b4e8c8792ee1e22b60427', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '00a5583c7b7443e98e7a1d31a0b638dc', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=71939) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 24 16:32:07.283729 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-096a3757-b8da-47eb-b658-b46e41507216 admin admin] REQUEST_METHOD: `GET` {{(pid=71939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 24 16:32:07.284071 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-096a3757-b8da-47eb-b658-b46e41507216 admin admin] SCRIPT_NAME: `/identity` {{(pid=71939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 24 16:32:07.284406 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-096a3757-b8da-47eb-b658-b46e41507216 admin admin] PATH_INFO: `/v3/roles` {{(pid=71939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 24 16:32:07.285220 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-096a3757-b8da-47eb-b658-b46e41507216 admin admin] RBAC: Adding query filter params (name=service) {{(pid=71939) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:161}} Nov 24 16:32:07.285574 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-096a3757-b8da-47eb-b658-b46e41507216 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=71939) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:442}} Nov 24 16:32:07.314070 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-096a3757-b8da-47eb-b658-b46e41507216 admin admin] RBAC: Authorization granted {{(pid=71939) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 24 16:32:07.330066 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: [pid: 71939|app: 0|req: 327/654] 10.222.0.53 () {56 vars in 1115 bytes} [Wed Nov 24 16:32:07 2021] GET /identity/v3/roles?name=service => generated 326 bytes in 59 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 24 16:32:07.334100 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa1ef358-37a0-4d08-bb5f-b8890512eeca admin admin] Authenticating user token {{(pid=71938) process_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 24 16:32:07.347608 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa1ef358-37a0-4d08-bb5f-b8890512eeca admin admin] Validating token access rules against request {{(pid=71938) validate_allowed_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 24 16:32:07.352076 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3017315e-d10a-40ef-88d8-2637348ee823 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f2ba2e8375b4e8c8792ee1e22b60427', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '00a5583c7b7443e98e7a1d31a0b638dc', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=71938) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 24 16:32:07.352879 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3017315e-d10a-40ef-88d8-2637348ee823 admin admin] REQUEST_METHOD: `GET` {{(pid=71938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 24 16:32:07.353212 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3017315e-d10a-40ef-88d8-2637348ee823 admin admin] SCRIPT_NAME: `/identity` {{(pid=71938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 24 16:32:07.353539 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3017315e-d10a-40ef-88d8-2637348ee823 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=71938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 24 16:32:07.365895 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3017315e-d10a-40ef-88d8-2637348ee823 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=71938) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:442}} Nov 24 16:32:07.394532 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3017315e-d10a-40ef-88d8-2637348ee823 admin admin] RBAC: Authorization granted {{(pid=71938) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 24 16:32:07.418042 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: WARNING keystone.server.flask.application [None req-3017315e-d10a-40ef-88d8-2637348ee823 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Nov 24 16:32:07.419291 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: [pid: 71938|app: 0|req: 328/655] 10.222.0.53 () {56 vars in 1120 bytes} [Wed Nov 24 16:32:07 2021] GET /identity/v3/domains/Default => generated 87 bytes in 86 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Nov 24 16:32:07.425381 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-096a3757-b8da-47eb-b658-b46e41507216 admin admin] Authenticating user token {{(pid=71939) process_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 24 16:32:07.435349 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-096a3757-b8da-47eb-b658-b46e41507216 admin admin] Validating token access rules against request {{(pid=71939) validate_allowed_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 24 16:32:07.439652 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be68f814-3005-4ead-8a84-179559c9386f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f2ba2e8375b4e8c8792ee1e22b60427', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '00a5583c7b7443e98e7a1d31a0b638dc', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=71939) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 24 16:32:07.440319 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be68f814-3005-4ead-8a84-179559c9386f admin admin] REQUEST_METHOD: `GET` {{(pid=71939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 24 16:32:07.440664 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be68f814-3005-4ead-8a84-179559c9386f admin admin] SCRIPT_NAME: `/identity` {{(pid=71939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 24 16:32:07.441003 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be68f814-3005-4ead-8a84-179559c9386f admin admin] PATH_INFO: `/v3/domains` {{(pid=71939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 24 16:32:07.441795 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be68f814-3005-4ead-8a84-179559c9386f admin admin] RBAC: Adding query filter params (name=Default) {{(pid=71939) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:161}} Nov 24 16:32:07.442200 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be68f814-3005-4ead-8a84-179559c9386f admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=71939) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:442}} Nov 24 16:32:07.471574 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be68f814-3005-4ead-8a84-179559c9386f admin admin] RBAC: Authorization granted {{(pid=71939) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 24 16:32:07.485170 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: [pid: 71939|app: 0|req: 328/656] 10.222.0.53 () {56 vars in 1121 bytes} [Wed Nov 24 16:32:07 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 60 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 24 16:32:07.491100 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3017315e-d10a-40ef-88d8-2637348ee823 admin admin] Authenticating user token {{(pid=71938) process_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 24 16:32:07.500936 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3017315e-d10a-40ef-88d8-2637348ee823 admin admin] Validating token access rules against request {{(pid=71938) validate_allowed_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 24 16:32:07.505123 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a2c586c-5df7-4e25-bf0f-474f414559b3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f2ba2e8375b4e8c8792ee1e22b60427', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '00a5583c7b7443e98e7a1d31a0b638dc', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=71938) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 24 16:32:07.505937 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a2c586c-5df7-4e25-bf0f-474f414559b3 admin admin] REQUEST_METHOD: `GET` {{(pid=71938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 24 16:32:07.506297 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a2c586c-5df7-4e25-bf0f-474f414559b3 admin admin] SCRIPT_NAME: `/identity` {{(pid=71938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 24 16:32:07.506624 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a2c586c-5df7-4e25-bf0f-474f414559b3 admin admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=71938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 24 16:32:07.520354 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a2c586c-5df7-4e25-bf0f-474f414559b3 admin admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=71938) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:442}} Nov 24 16:32:07.549460 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a2c586c-5df7-4e25-bf0f-474f414559b3 admin admin] RBAC: Authorization granted {{(pid=71938) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 24 16:32:07.570872 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: WARNING keystone.server.flask.application [None req-4a2c586c-5df7-4e25-bf0f-474f414559b3 admin admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Nov 24 16:32:07.572143 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: [pid: 71938|app: 0|req: 329/657] 10.222.0.53 () {56 vars in 1129 bytes} [Wed Nov 24 16:32:07 2021] GET /identity/v3/users/glance-swift => generated 90 bytes in 82 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 24 16:32:07.580111 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be68f814-3005-4ead-8a84-179559c9386f admin admin] Authenticating user token {{(pid=71939) process_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 24 16:32:07.590544 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be68f814-3005-4ead-8a84-179559c9386f admin admin] Validating token access rules against request {{(pid=71939) validate_allowed_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 24 16:32:07.595624 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4d612ce-a070-4848-85ae-4fc10ba331e6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f2ba2e8375b4e8c8792ee1e22b60427', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '00a5583c7b7443e98e7a1d31a0b638dc', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=71939) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 24 16:32:07.596306 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4d612ce-a070-4848-85ae-4fc10ba331e6 admin admin] REQUEST_METHOD: `GET` {{(pid=71939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 24 16:32:07.596649 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4d612ce-a070-4848-85ae-4fc10ba331e6 admin admin] SCRIPT_NAME: `/identity` {{(pid=71939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 24 16:32:07.596987 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4d612ce-a070-4848-85ae-4fc10ba331e6 admin admin] PATH_INFO: `/v3/users` {{(pid=71939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 24 16:32:07.597898 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4d612ce-a070-4848-85ae-4fc10ba331e6 admin admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=71939) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:161}} Nov 24 16:32:07.598283 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4d612ce-a070-4848-85ae-4fc10ba331e6 admin admin] RBAC: Authorizing `identity:list_users()` {{(pid=71939) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:442}} Nov 24 16:32:07.626800 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4d612ce-a070-4848-85ae-4fc10ba331e6 admin admin] RBAC: Authorization granted {{(pid=71939) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 24 16:32:07.660205 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: [pid: 71939|app: 0|req: 329/658] 10.222.0.53 () {56 vars in 1161 bytes} [Wed Nov 24 16:32:07 2021] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 82 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 24 16:32:07.666448 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a2c586c-5df7-4e25-bf0f-474f414559b3 admin admin] Authenticating user token {{(pid=71938) process_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 24 16:32:07.676394 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a2c586c-5df7-4e25-bf0f-474f414559b3 admin admin] Validating token access rules against request {{(pid=71938) validate_allowed_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 24 16:32:07.680682 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b138ff8-facd-4c8f-8d39-6ad80ecd63b9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f2ba2e8375b4e8c8792ee1e22b60427', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '00a5583c7b7443e98e7a1d31a0b638dc', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=71938) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 24 16:32:07.681329 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b138ff8-facd-4c8f-8d39-6ad80ecd63b9 admin admin] REQUEST_METHOD: `GET` {{(pid=71938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 24 16:32:07.681667 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b138ff8-facd-4c8f-8d39-6ad80ecd63b9 admin admin] SCRIPT_NAME: `/identity` {{(pid=71938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 24 16:32:07.682002 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b138ff8-facd-4c8f-8d39-6ad80ecd63b9 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=71938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 24 16:32:07.690701 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b138ff8-facd-4c8f-8d39-6ad80ecd63b9 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=71938) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:442}} Nov 24 16:32:07.719901 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b138ff8-facd-4c8f-8d39-6ad80ecd63b9 admin admin] RBAC: Authorization granted {{(pid=71938) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 24 16:32:07.729639 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: [pid: 71938|app: 0|req: 330/659] 10.222.0.53 () {58 vars in 1315 bytes} [Wed Nov 24 16:32:07 2021] GET /identity/v3/auth/tokens => generated 1616 bytes in 64 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 24 16:32:07.735743 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4d612ce-a070-4848-85ae-4fc10ba331e6 admin admin] Authenticating user token {{(pid=71939) process_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 24 16:32:07.745738 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4d612ce-a070-4848-85ae-4fc10ba331e6 admin admin] Validating token access rules against request {{(pid=71939) validate_allowed_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 24 16:32:07.750050 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e051f09-d0cb-4979-a602-ee9180694b16 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f2ba2e8375b4e8c8792ee1e22b60427', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '00a5583c7b7443e98e7a1d31a0b638dc', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=71939) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 24 16:32:07.751384 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e051f09-d0cb-4979-a602-ee9180694b16 admin admin] REQUEST_METHOD: `GET` {{(pid=71939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 24 16:32:07.751725 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e051f09-d0cb-4979-a602-ee9180694b16 admin admin] SCRIPT_NAME: `/identity` {{(pid=71939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 24 16:32:07.752058 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e051f09-d0cb-4979-a602-ee9180694b16 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=71939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 24 16:32:07.764094 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e051f09-d0cb-4979-a602-ee9180694b16 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=71939) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:442}} Nov 24 16:32:07.792880 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e051f09-d0cb-4979-a602-ee9180694b16 admin admin] RBAC: Authorization granted {{(pid=71939) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 24 16:32:07.811890 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: WARNING keystone.server.flask.application [None req-4e051f09-d0cb-4979-a602-ee9180694b16 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Nov 24 16:32:07.813641 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: [pid: 71939|app: 0|req: 330/660] 10.222.0.53 () {56 vars in 1120 bytes} [Wed Nov 24 16:32:07 2021] GET /identity/v3/domains/Default => generated 87 bytes in 78 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 24 16:32:07.819786 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b138ff8-facd-4c8f-8d39-6ad80ecd63b9 admin admin] Authenticating user token {{(pid=71938) process_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 24 16:32:07.829750 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b138ff8-facd-4c8f-8d39-6ad80ecd63b9 admin admin] Validating token access rules against request {{(pid=71938) validate_allowed_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 24 16:32:07.834039 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87605491-9089-4c85-8189-42cec35531fc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f2ba2e8375b4e8c8792ee1e22b60427', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '00a5583c7b7443e98e7a1d31a0b638dc', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=71938) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 24 16:32:07.834740 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87605491-9089-4c85-8189-42cec35531fc admin admin] REQUEST_METHOD: `GET` {{(pid=71938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 24 16:32:07.835081 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87605491-9089-4c85-8189-42cec35531fc admin admin] SCRIPT_NAME: `/identity` {{(pid=71938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 24 16:32:07.835410 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87605491-9089-4c85-8189-42cec35531fc admin admin] PATH_INFO: `/v3/domains` {{(pid=71938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 24 16:32:07.836189 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87605491-9089-4c85-8189-42cec35531fc admin admin] RBAC: Adding query filter params (name=Default) {{(pid=71938) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:161}} Nov 24 16:32:07.836540 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87605491-9089-4c85-8189-42cec35531fc admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=71938) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:442}} Nov 24 16:32:07.868173 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87605491-9089-4c85-8189-42cec35531fc admin admin] RBAC: Authorization granted {{(pid=71938) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 24 16:32:07.883077 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: [pid: 71938|app: 0|req: 331/661] 10.222.0.53 () {56 vars in 1121 bytes} [Wed Nov 24 16:32:07 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 64 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 24 16:32:07.889020 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e051f09-d0cb-4979-a602-ee9180694b16 admin admin] Authenticating user token {{(pid=71939) process_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 24 16:32:07.902756 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e051f09-d0cb-4979-a602-ee9180694b16 admin admin] Validating token access rules against request {{(pid=71939) validate_allowed_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 24 16:32:07.907141 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3efce744-4ffa-4363-a784-c67545459d6b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f2ba2e8375b4e8c8792ee1e22b60427', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '00a5583c7b7443e98e7a1d31a0b638dc', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=71939) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 24 16:32:07.907957 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3efce744-4ffa-4363-a784-c67545459d6b admin admin] REQUEST_METHOD: `GET` {{(pid=71939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 24 16:32:07.908295 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3efce744-4ffa-4363-a784-c67545459d6b admin admin] SCRIPT_NAME: `/identity` {{(pid=71939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 24 16:32:07.908626 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3efce744-4ffa-4363-a784-c67545459d6b admin admin] PATH_INFO: `/v3/projects/service` {{(pid=71939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 24 16:32:07.918225 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3efce744-4ffa-4363-a784-c67545459d6b admin admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=71939) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:442}} Nov 24 16:32:07.954067 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3efce744-4ffa-4363-a784-c67545459d6b admin admin] RBAC: Authorization granted {{(pid=71939) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 24 16:32:07.970055 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: WARNING keystone.server.flask.application [None req-3efce744-4ffa-4363-a784-c67545459d6b admin admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Nov 24 16:32:07.971214 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: [pid: 71939|app: 0|req: 331/662] 10.222.0.53 () {56 vars in 1123 bytes} [Wed Nov 24 16:32:07 2021] GET /identity/v3/projects/service => generated 88 bytes in 83 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 24 16:32:07.977431 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87605491-9089-4c85-8189-42cec35531fc admin admin] Authenticating user token {{(pid=71938) process_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 24 16:32:07.987859 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87605491-9089-4c85-8189-42cec35531fc admin admin] Validating token access rules against request {{(pid=71938) validate_allowed_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 24 16:32:07.992358 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d091d5b9-00d8-4bce-8852-1668381a5e14 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f2ba2e8375b4e8c8792ee1e22b60427', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '00a5583c7b7443e98e7a1d31a0b638dc', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=71938) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 24 16:32:07.993020 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d091d5b9-00d8-4bce-8852-1668381a5e14 admin admin] REQUEST_METHOD: `GET` {{(pid=71938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 24 16:32:07.993360 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d091d5b9-00d8-4bce-8852-1668381a5e14 admin admin] SCRIPT_NAME: `/identity` {{(pid=71938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 24 16:32:07.993719 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d091d5b9-00d8-4bce-8852-1668381a5e14 admin admin] PATH_INFO: `/v3/projects` {{(pid=71938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 24 16:32:07.994566 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d091d5b9-00d8-4bce-8852-1668381a5e14 admin admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=71938) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:161}} Nov 24 16:32:07.994924 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d091d5b9-00d8-4bce-8852-1668381a5e14 admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=71938) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:442}} Nov 24 16:32:08.024571 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d091d5b9-00d8-4bce-8852-1668381a5e14 admin admin] RBAC: Authorization granted {{(pid=71938) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 24 16:32:08.038664 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: [pid: 71938|app: 0|req: 332/663] 10.222.0.53 () {56 vars in 1160 bytes} [Wed Nov 24 16:32:07 2021] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 62 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 24 16:32:08.044951 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3efce744-4ffa-4363-a784-c67545459d6b admin admin] Authenticating user token {{(pid=71939) process_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 24 16:32:08.057433 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3efce744-4ffa-4363-a784-c67545459d6b admin admin] Validating token access rules against request {{(pid=71939) validate_allowed_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 24 16:32:08.061589 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33924554-3b20-405b-9fae-424839d0ca07 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f2ba2e8375b4e8c8792ee1e22b60427', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '00a5583c7b7443e98e7a1d31a0b638dc', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=71939) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 24 16:32:08.062284 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33924554-3b20-405b-9fae-424839d0ca07 admin admin] REQUEST_METHOD: `GET` {{(pid=71939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 24 16:32:08.062617 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33924554-3b20-405b-9fae-424839d0ca07 admin admin] SCRIPT_NAME: `/identity` {{(pid=71939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 24 16:32:08.063471 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33924554-3b20-405b-9fae-424839d0ca07 admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=71939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 24 16:32:08.064352 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33924554-3b20-405b-9fae-424839d0ca07 admin admin] RBAC: Adding query filter params (role.id=2d4a51004ce34308a7a33e68bf2cfc74, scope.project.id=3b3940d4ae1c4177ae29c02377bb4b0b, user.id=f8a135ac0e4744a98258dc7f6c12e741) {{(pid=71939) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:161}} Nov 24 16:32:08.064707 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33924554-3b20-405b-9fae-424839d0ca07 admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=71939) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:442}} Nov 24 16:32:08.093663 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33924554-3b20-405b-9fae-424839d0ca07 admin admin] RBAC: Authorization granted {{(pid=71939) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 24 16:32:08.099334 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: [pid: 71939|app: 0|req: 332/664] 10.222.0.53 () {56 vars in 1386 bytes} [Wed Nov 24 16:32:08 2021] GET /identity/v3/role_assignments?user.id=f8a135ac0e4744a98258dc7f6c12e741&scope.project.id=3b3940d4ae1c4177ae29c02377bb4b0b&role.id=2d4a51004ce34308a7a33e68bf2cfc74 => generated 259 bytes in 55 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 24 16:32:10.076114 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cc71c57-7e4a-44cc-8ef8-6ad81952413c None None] REQUEST_METHOD: `GET` {{(pid=71938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 24 16:32:10.076671 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cc71c57-7e4a-44cc-8ef8-6ad81952413c None None] SCRIPT_NAME: `/identity` {{(pid=71938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 24 16:32:10.076780 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cc71c57-7e4a-44cc-8ef8-6ad81952413c None None] PATH_INFO: `/` {{(pid=71938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 24 16:32:10.078962 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: [pid: 71938|app: 0|req: 333/665] 10.222.0.53 () {54 vars in 915 bytes} [Wed Nov 24 16:32:10 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 24 16:32:10.084445 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9091148-d91a-47b5-a29c-4512be7ed461 None None] REQUEST_METHOD: `POST` {{(pid=71939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 24 16:32:10.084791 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9091148-d91a-47b5-a29c-4512be7ed461 None None] SCRIPT_NAME: `/identity` {{(pid=71939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 24 16:32:10.085130 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9091148-d91a-47b5-a29c-4512be7ed461 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=71939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 24 16:32:10.109168 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.auth.core [None req-c9091148-d91a-47b5-a29c-4512be7ed461 None None] MFA Rules not processed for user `0f2ba2e8375b4e8c8792ee1e22b60427`. Rule list: `[]` (Enabled: `True`). {{(pid=71939) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:442}} Nov 24 16:32:10.111037 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.fernet_utils [None req-c9091148-d91a-47b5-a29c-4512be7ed461 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=71939) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:289}} Nov 24 16:32:10.118154 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: [pid: 71939|app: 0|req: 333/666] 10.222.0.53 () {58 vars in 1013 bytes} [Wed Nov 24 16:32:10 2021] POST /identity/v3/auth/tokens => generated 1616 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 24 16:32:10.140665 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60ea67ba-6ba3-4727-b1d0-343de9e3e046 None None] REQUEST_METHOD: `POST` {{(pid=71938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 24 16:32:10.141626 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60ea67ba-6ba3-4727-b1d0-343de9e3e046 None None] SCRIPT_NAME: `/identity` {{(pid=71938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 24 16:32:10.141966 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60ea67ba-6ba3-4727-b1d0-343de9e3e046 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=71938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 24 16:32:10.166635 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.auth.core [None req-60ea67ba-6ba3-4727-b1d0-343de9e3e046 None None] MFA Rules not processed for user `0f2ba2e8375b4e8c8792ee1e22b60427`. Rule list: `[]` (Enabled: `True`). {{(pid=71938) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:442}} Nov 24 16:32:10.167909 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.fernet_utils [None req-60ea67ba-6ba3-4727-b1d0-343de9e3e046 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=71938) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:289}} Nov 24 16:32:10.175107 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: [pid: 71938|app: 0|req: 334/667] 10.222.0.53 () {58 vars in 1013 bytes} [Wed Nov 24 16:32:10 2021] POST /identity/v3/auth/tokens => generated 1616 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 24 16:32:10.181189 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9091148-d91a-47b5-a29c-4512be7ed461 None None] Authenticating user token {{(pid=71939) process_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 24 16:32:10.191537 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9091148-d91a-47b5-a29c-4512be7ed461 None None] Validating token access rules against request {{(pid=71939) validate_allowed_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 24 16:32:10.197938 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da9ee23b-7ec2-4c6c-b74a-ce62d7578d6a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f2ba2e8375b4e8c8792ee1e22b60427', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '00a5583c7b7443e98e7a1d31a0b638dc', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=71939) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 24 16:32:10.199084 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da9ee23b-7ec2-4c6c-b74a-ce62d7578d6a admin admin] REQUEST_METHOD: `GET` {{(pid=71939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 24 16:32:10.199429 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da9ee23b-7ec2-4c6c-b74a-ce62d7578d6a admin admin] SCRIPT_NAME: `/identity` {{(pid=71939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 24 16:32:10.199769 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da9ee23b-7ec2-4c6c-b74a-ce62d7578d6a admin admin] PATH_INFO: `/v3/roles/service` {{(pid=71939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 24 16:32:10.216027 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da9ee23b-7ec2-4c6c-b74a-ce62d7578d6a admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=71939) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:401}} Nov 24 16:32:10.223624 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: WARNING keystone.server.flask.application [None req-da9ee23b-7ec2-4c6c-b74a-ce62d7578d6a admin admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Nov 24 16:32:10.224871 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: [pid: 71939|app: 0|req: 334/668] 10.222.0.53 () {56 vars in 1114 bytes} [Wed Nov 24 16:32:10 2021] GET /identity/v3/roles/service => generated 85 bytes in 44 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 24 16:32:10.231752 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60ea67ba-6ba3-4727-b1d0-343de9e3e046 None None] Authenticating user token {{(pid=71938) process_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 24 16:32:10.240981 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60ea67ba-6ba3-4727-b1d0-343de9e3e046 None None] Validating token access rules against request {{(pid=71938) validate_allowed_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 24 16:32:10.245273 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6152377-5518-412a-83bf-bcb1b96b71f5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f2ba2e8375b4e8c8792ee1e22b60427', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '00a5583c7b7443e98e7a1d31a0b638dc', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=71938) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 24 16:32:10.245936 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6152377-5518-412a-83bf-bcb1b96b71f5 admin admin] REQUEST_METHOD: `GET` {{(pid=71938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 24 16:32:10.246299 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6152377-5518-412a-83bf-bcb1b96b71f5 admin admin] SCRIPT_NAME: `/identity` {{(pid=71938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 24 16:32:10.246629 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6152377-5518-412a-83bf-bcb1b96b71f5 admin admin] PATH_INFO: `/v3/roles` {{(pid=71938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 24 16:32:10.247431 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6152377-5518-412a-83bf-bcb1b96b71f5 admin admin] RBAC: Adding query filter params (name=service) {{(pid=71938) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:161}} Nov 24 16:32:10.247777 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6152377-5518-412a-83bf-bcb1b96b71f5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=71938) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:442}} Nov 24 16:32:10.276947 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6152377-5518-412a-83bf-bcb1b96b71f5 admin admin] RBAC: Authorization granted {{(pid=71938) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 24 16:32:10.286574 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: [pid: 71938|app: 0|req: 335/669] 10.222.0.53 () {56 vars in 1115 bytes} [Wed Nov 24 16:32:10 2021] GET /identity/v3/roles?name=service => generated 326 bytes in 55 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 24 16:32:10.292586 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da9ee23b-7ec2-4c6c-b74a-ce62d7578d6a admin admin] Authenticating user token {{(pid=71939) process_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 24 16:32:10.303246 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da9ee23b-7ec2-4c6c-b74a-ce62d7578d6a admin admin] Validating token access rules against request {{(pid=71939) validate_allowed_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 24 16:32:10.307473 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-576dbd5a-60e4-4755-9090-ded861e9e5c7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f2ba2e8375b4e8c8792ee1e22b60427', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '00a5583c7b7443e98e7a1d31a0b638dc', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=71939) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 24 16:32:10.308278 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-576dbd5a-60e4-4755-9090-ded861e9e5c7 admin admin] REQUEST_METHOD: `GET` {{(pid=71939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 24 16:32:10.308618 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-576dbd5a-60e4-4755-9090-ded861e9e5c7 admin admin] SCRIPT_NAME: `/identity` {{(pid=71939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 24 16:32:10.308993 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-576dbd5a-60e4-4755-9090-ded861e9e5c7 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=71939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 24 16:32:10.321336 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-576dbd5a-60e4-4755-9090-ded861e9e5c7 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=71939) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:442}} Nov 24 16:32:10.350873 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-576dbd5a-60e4-4755-9090-ded861e9e5c7 admin admin] RBAC: Authorization granted {{(pid=71939) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 24 16:32:10.373818 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: WARNING keystone.server.flask.application [None req-576dbd5a-60e4-4755-9090-ded861e9e5c7 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Nov 24 16:32:10.375254 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: [pid: 71939|app: 0|req: 335/670] 10.222.0.53 () {56 vars in 1120 bytes} [Wed Nov 24 16:32:10 2021] GET /identity/v3/domains/Default => generated 87 bytes in 83 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 24 16:32:10.381815 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6152377-5518-412a-83bf-bcb1b96b71f5 admin admin] Authenticating user token {{(pid=71938) process_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 24 16:32:10.391928 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6152377-5518-412a-83bf-bcb1b96b71f5 admin admin] Validating token access rules against request {{(pid=71938) validate_allowed_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 24 16:32:10.396244 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f763cf37-4fa8-445e-920b-a94fe738fa99 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f2ba2e8375b4e8c8792ee1e22b60427', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '00a5583c7b7443e98e7a1d31a0b638dc', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=71938) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 24 16:32:10.396908 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f763cf37-4fa8-445e-920b-a94fe738fa99 admin admin] REQUEST_METHOD: `GET` {{(pid=71938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 24 16:32:10.397247 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f763cf37-4fa8-445e-920b-a94fe738fa99 admin admin] SCRIPT_NAME: `/identity` {{(pid=71938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 24 16:32:10.397579 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f763cf37-4fa8-445e-920b-a94fe738fa99 admin admin] PATH_INFO: `/v3/domains` {{(pid=71938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 24 16:32:10.398454 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f763cf37-4fa8-445e-920b-a94fe738fa99 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=71938) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:161}} Nov 24 16:32:10.398746 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f763cf37-4fa8-445e-920b-a94fe738fa99 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=71938) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:442}} Nov 24 16:32:10.427787 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f763cf37-4fa8-445e-920b-a94fe738fa99 admin admin] RBAC: Authorization granted {{(pid=71938) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 24 16:32:10.442172 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: [pid: 71938|app: 0|req: 336/671] 10.222.0.53 () {56 vars in 1121 bytes} [Wed Nov 24 16:32:10 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 61 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 24 16:32:10.448392 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-576dbd5a-60e4-4755-9090-ded861e9e5c7 admin admin] Authenticating user token {{(pid=71939) process_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 24 16:32:10.459515 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-576dbd5a-60e4-4755-9090-ded861e9e5c7 admin admin] Validating token access rules against request {{(pid=71939) validate_allowed_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 24 16:32:10.464758 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afd91d01-183a-41fc-b22f-424b4123b0e4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f2ba2e8375b4e8c8792ee1e22b60427', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '00a5583c7b7443e98e7a1d31a0b638dc', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=71939) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 24 16:32:10.465579 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afd91d01-183a-41fc-b22f-424b4123b0e4 admin admin] REQUEST_METHOD: `GET` {{(pid=71939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 24 16:32:10.465920 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afd91d01-183a-41fc-b22f-424b4123b0e4 admin admin] SCRIPT_NAME: `/identity` {{(pid=71939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 24 16:32:10.466303 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afd91d01-183a-41fc-b22f-424b4123b0e4 admin admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=71939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 24 16:32:10.480108 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afd91d01-183a-41fc-b22f-424b4123b0e4 admin admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=71939) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:442}} Nov 24 16:32:10.510178 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afd91d01-183a-41fc-b22f-424b4123b0e4 admin admin] RBAC: Authorization granted {{(pid=71939) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 24 16:32:10.530725 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: WARNING keystone.server.flask.application [None req-afd91d01-183a-41fc-b22f-424b4123b0e4 admin admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Nov 24 16:32:10.532093 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: [pid: 71939|app: 0|req: 336/672] 10.222.0.53 () {56 vars in 1129 bytes} [Wed Nov 24 16:32:10 2021] GET /identity/v3/users/glance-swift => generated 90 bytes in 84 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 24 16:32:10.538679 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f763cf37-4fa8-445e-920b-a94fe738fa99 admin admin] Authenticating user token {{(pid=71938) process_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 24 16:32:10.553606 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f763cf37-4fa8-445e-920b-a94fe738fa99 admin admin] Validating token access rules against request {{(pid=71938) validate_allowed_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 24 16:32:10.559773 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae708ea9-227a-4c89-9ca0-4331d86b4481 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f2ba2e8375b4e8c8792ee1e22b60427', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '00a5583c7b7443e98e7a1d31a0b638dc', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=71938) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 24 16:32:10.560478 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae708ea9-227a-4c89-9ca0-4331d86b4481 admin admin] REQUEST_METHOD: `GET` {{(pid=71938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 24 16:32:10.560843 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae708ea9-227a-4c89-9ca0-4331d86b4481 admin admin] SCRIPT_NAME: `/identity` {{(pid=71938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 24 16:32:10.561235 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae708ea9-227a-4c89-9ca0-4331d86b4481 admin admin] PATH_INFO: `/v3/users` {{(pid=71938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 24 16:32:10.563601 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae708ea9-227a-4c89-9ca0-4331d86b4481 admin admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=71938) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:161}} Nov 24 16:32:10.564268 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae708ea9-227a-4c89-9ca0-4331d86b4481 admin admin] RBAC: Authorizing `identity:list_users()` {{(pid=71938) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:442}} Nov 24 16:32:10.596094 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae708ea9-227a-4c89-9ca0-4331d86b4481 admin admin] RBAC: Authorization granted {{(pid=71938) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 24 16:32:10.630639 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: [pid: 71938|app: 0|req: 337/673] 10.222.0.53 () {56 vars in 1161 bytes} [Wed Nov 24 16:32:10 2021] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 93 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 24 16:32:10.637119 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afd91d01-183a-41fc-b22f-424b4123b0e4 admin admin] Authenticating user token {{(pid=71939) process_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 24 16:32:10.647550 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afd91d01-183a-41fc-b22f-424b4123b0e4 admin admin] Validating token access rules against request {{(pid=71939) validate_allowed_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 24 16:32:10.651874 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f71ef23-c626-437e-9528-119859a16a51 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f2ba2e8375b4e8c8792ee1e22b60427', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '00a5583c7b7443e98e7a1d31a0b638dc', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=71939) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 24 16:32:10.652672 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f71ef23-c626-437e-9528-119859a16a51 admin admin] REQUEST_METHOD: `GET` {{(pid=71939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 24 16:32:10.653068 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f71ef23-c626-437e-9528-119859a16a51 admin admin] SCRIPT_NAME: `/identity` {{(pid=71939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 24 16:32:10.653396 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f71ef23-c626-437e-9528-119859a16a51 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=71939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 24 16:32:10.666298 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f71ef23-c626-437e-9528-119859a16a51 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=71939) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:442}} Nov 24 16:32:10.696172 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f71ef23-c626-437e-9528-119859a16a51 admin admin] RBAC: Authorization granted {{(pid=71939) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 24 16:32:10.715676 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: WARNING keystone.server.flask.application [None req-5f71ef23-c626-437e-9528-119859a16a51 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Nov 24 16:32:10.716870 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: [pid: 71939|app: 0|req: 337/674] 10.222.0.53 () {56 vars in 1120 bytes} [Wed Nov 24 16:32:10 2021] GET /identity/v3/domains/Default => generated 87 bytes in 80 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 24 16:32:10.723373 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae708ea9-227a-4c89-9ca0-4331d86b4481 admin admin] Authenticating user token {{(pid=71938) process_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 24 16:32:10.733413 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae708ea9-227a-4c89-9ca0-4331d86b4481 admin admin] Validating token access rules against request {{(pid=71938) validate_allowed_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 24 16:32:10.738417 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9290b115-30e1-4dc1-b60c-1edce210cb90 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f2ba2e8375b4e8c8792ee1e22b60427', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '00a5583c7b7443e98e7a1d31a0b638dc', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=71938) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 24 16:32:10.739080 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9290b115-30e1-4dc1-b60c-1edce210cb90 admin admin] REQUEST_METHOD: `GET` {{(pid=71938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 24 16:32:10.739417 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9290b115-30e1-4dc1-b60c-1edce210cb90 admin admin] SCRIPT_NAME: `/identity` {{(pid=71938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 24 16:32:10.739753 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9290b115-30e1-4dc1-b60c-1edce210cb90 admin admin] PATH_INFO: `/v3/domains` {{(pid=71938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 24 16:32:10.740533 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9290b115-30e1-4dc1-b60c-1edce210cb90 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=71938) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:161}} Nov 24 16:32:10.740885 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9290b115-30e1-4dc1-b60c-1edce210cb90 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=71938) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:442}} Nov 24 16:32:10.769056 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9290b115-30e1-4dc1-b60c-1edce210cb90 admin admin] RBAC: Authorization granted {{(pid=71938) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 24 16:32:10.782478 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: [pid: 71938|app: 0|req: 338/675] 10.222.0.53 () {56 vars in 1121 bytes} [Wed Nov 24 16:32:10 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 60 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 24 16:32:10.788550 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f71ef23-c626-437e-9528-119859a16a51 admin admin] Authenticating user token {{(pid=71939) process_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 24 16:32:10.799795 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f71ef23-c626-437e-9528-119859a16a51 admin admin] Validating token access rules against request {{(pid=71939) validate_allowed_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 24 16:32:10.804441 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f4a0943-b9d0-4e2f-8621-0a78030f5b1d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f2ba2e8375b4e8c8792ee1e22b60427', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '00a5583c7b7443e98e7a1d31a0b638dc', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=71939) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 24 16:32:10.805237 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f4a0943-b9d0-4e2f-8621-0a78030f5b1d admin admin] REQUEST_METHOD: `GET` {{(pid=71939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 24 16:32:10.805578 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f4a0943-b9d0-4e2f-8621-0a78030f5b1d admin admin] SCRIPT_NAME: `/identity` {{(pid=71939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 24 16:32:10.805909 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f4a0943-b9d0-4e2f-8621-0a78030f5b1d admin admin] PATH_INFO: `/v3/projects/service` {{(pid=71939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 24 16:32:10.815881 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f4a0943-b9d0-4e2f-8621-0a78030f5b1d admin admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=71939) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:442}} Nov 24 16:32:10.846458 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f4a0943-b9d0-4e2f-8621-0a78030f5b1d admin admin] RBAC: Authorization granted {{(pid=71939) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 24 16:32:10.863454 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: WARNING keystone.server.flask.application [None req-3f4a0943-b9d0-4e2f-8621-0a78030f5b1d admin admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Nov 24 16:32:10.864794 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: [pid: 71939|app: 0|req: 338/676] 10.222.0.53 () {56 vars in 1123 bytes} [Wed Nov 24 16:32:10 2021] GET /identity/v3/projects/service => generated 88 bytes in 77 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 24 16:32:10.871073 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9290b115-30e1-4dc1-b60c-1edce210cb90 admin admin] Authenticating user token {{(pid=71938) process_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 24 16:32:10.883268 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9290b115-30e1-4dc1-b60c-1edce210cb90 admin admin] Validating token access rules against request {{(pid=71938) validate_allowed_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 24 16:32:10.889599 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90d76962-cac3-491d-a3da-2c91d9b58d2d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f2ba2e8375b4e8c8792ee1e22b60427', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '00a5583c7b7443e98e7a1d31a0b638dc', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=71938) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 24 16:32:10.890621 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90d76962-cac3-491d-a3da-2c91d9b58d2d admin admin] REQUEST_METHOD: `GET` {{(pid=71938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 24 16:32:10.891162 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90d76962-cac3-491d-a3da-2c91d9b58d2d admin admin] SCRIPT_NAME: `/identity` {{(pid=71938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 24 16:32:10.891742 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90d76962-cac3-491d-a3da-2c91d9b58d2d admin admin] PATH_INFO: `/v3/projects` {{(pid=71938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 24 16:32:10.892985 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90d76962-cac3-491d-a3da-2c91d9b58d2d admin admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=71938) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:161}} Nov 24 16:32:10.893529 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90d76962-cac3-491d-a3da-2c91d9b58d2d admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=71938) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:442}} Nov 24 16:32:10.932778 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90d76962-cac3-491d-a3da-2c91d9b58d2d admin admin] RBAC: Authorization granted {{(pid=71938) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 24 16:32:10.950767 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: [pid: 71938|app: 0|req: 339/677] 10.222.0.53 () {56 vars in 1160 bytes} [Wed Nov 24 16:32:10 2021] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 80 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 24 16:32:10.957478 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f4a0943-b9d0-4e2f-8621-0a78030f5b1d admin admin] Authenticating user token {{(pid=71939) process_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 24 16:32:10.967832 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f4a0943-b9d0-4e2f-8621-0a78030f5b1d admin admin] Validating token access rules against request {{(pid=71939) validate_allowed_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 24 16:32:10.972877 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d6da838-257a-403a-a5c3-e21466524036 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f2ba2e8375b4e8c8792ee1e22b60427', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '00a5583c7b7443e98e7a1d31a0b638dc', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=71939) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 24 16:32:10.973784 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d6da838-257a-403a-a5c3-e21466524036 admin admin] REQUEST_METHOD: `PUT` {{(pid=71939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 24 16:32:10.974180 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d6da838-257a-403a-a5c3-e21466524036 admin admin] SCRIPT_NAME: `/identity` {{(pid=71939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 24 16:32:10.974514 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d6da838-257a-403a-a5c3-e21466524036 admin admin] PATH_INFO: `/v3/projects/3b3940d4ae1c4177ae29c02377bb4b0b/users/f8a135ac0e4744a98258dc7f6c12e741/roles/2d4a51004ce34308a7a33e68bf2cfc74` {{(pid=71939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 24 16:32:10.997056 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d6da838-257a-403a-a5c3-e21466524036 admin admin] RBAC: Authorizing `identity:create_grant(project_id=3b3940d4ae1c4177ae29c02377bb4b0b, user_id=f8a135ac0e4744a98258dc7f6c12e741, role_id=2d4a51004ce34308a7a33e68bf2cfc74)` {{(pid=71939) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:442}} Nov 24 16:32:11.027310 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d6da838-257a-403a-a5c3-e21466524036 admin admin] RBAC: Authorization granted {{(pid=71939) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 24 16:32:11.039169 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: [pid: 71939|app: 0|req: 339/678] 10.222.0.53 () {58 vars in 1451 bytes} [Wed Nov 24 16:32:10 2021] PUT /identity/v3/projects/3b3940d4ae1c4177ae29c02377bb4b0b/users/f8a135ac0e4744a98258dc7f6c12e741/roles/2d4a51004ce34308a7a33e68bf2cfc74 => generated 0 bytes in 82 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 24 16:32:13.049142 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b1984c7-165f-4c1c-b564-74f35eb378b0 None None] REQUEST_METHOD: `GET` {{(pid=71938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 24 16:32:13.049667 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b1984c7-165f-4c1c-b564-74f35eb378b0 None None] SCRIPT_NAME: `/identity` {{(pid=71938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 24 16:32:13.049773 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b1984c7-165f-4c1c-b564-74f35eb378b0 None None] PATH_INFO: `/` {{(pid=71938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 24 16:32:13.051671 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: [pid: 71938|app: 0|req: 340/679] 10.222.0.53 () {54 vars in 915 bytes} [Wed Nov 24 16:32:13 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 24 16:32:13.057608 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3af1c4a-04f8-46b1-8ec2-6a359d03a4db None None] REQUEST_METHOD: `POST` {{(pid=71939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 24 16:32:13.057955 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3af1c4a-04f8-46b1-8ec2-6a359d03a4db None None] SCRIPT_NAME: `/identity` {{(pid=71939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 24 16:32:13.058406 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3af1c4a-04f8-46b1-8ec2-6a359d03a4db None None] PATH_INFO: `/v3/auth/tokens` {{(pid=71939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 24 16:32:13.084769 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.auth.core [None req-d3af1c4a-04f8-46b1-8ec2-6a359d03a4db None None] MFA Rules not processed for user `0f2ba2e8375b4e8c8792ee1e22b60427`. Rule list: `[]` (Enabled: `True`). {{(pid=71939) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:442}} Nov 24 16:32:13.086007 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.fernet_utils [None req-d3af1c4a-04f8-46b1-8ec2-6a359d03a4db None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=71939) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:289}} Nov 24 16:32:13.153306 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: [pid: 71939|app: 0|req: 340/680] 10.222.0.53 () {58 vars in 1013 bytes} [Wed Nov 24 16:32:13 2021] POST /identity/v3/auth/tokens => generated 1616 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 24 16:32:13.175923 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fefbcba5-80ba-4e5e-baf4-ed01de1ac79d None None] REQUEST_METHOD: `POST` {{(pid=71938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 24 16:32:13.176271 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fefbcba5-80ba-4e5e-baf4-ed01de1ac79d None None] SCRIPT_NAME: `/identity` {{(pid=71938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 24 16:32:13.176608 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fefbcba5-80ba-4e5e-baf4-ed01de1ac79d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=71938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 24 16:32:13.200556 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.auth.core [None req-fefbcba5-80ba-4e5e-baf4-ed01de1ac79d None None] MFA Rules not processed for user `0f2ba2e8375b4e8c8792ee1e22b60427`. Rule list: `[]` (Enabled: `True`). {{(pid=71938) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:442}} Nov 24 16:32:13.201780 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.fernet_utils [None req-fefbcba5-80ba-4e5e-baf4-ed01de1ac79d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=71938) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:289}} Nov 24 16:32:13.209807 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: [pid: 71938|app: 0|req: 341/681] 10.222.0.53 () {58 vars in 1013 bytes} [Wed Nov 24 16:32:13 2021] POST /identity/v3/auth/tokens => generated 1616 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 24 16:32:13.215998 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3af1c4a-04f8-46b1-8ec2-6a359d03a4db None None] Authenticating user token {{(pid=71939) process_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 24 16:32:13.225788 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3af1c4a-04f8-46b1-8ec2-6a359d03a4db None None] Validating token access rules against request {{(pid=71939) validate_allowed_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 24 16:32:13.230310 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9eeed166-9c53-4313-ae82-5599ab43025e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f2ba2e8375b4e8c8792ee1e22b60427', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '00a5583c7b7443e98e7a1d31a0b638dc', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=71939) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 24 16:32:13.231152 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9eeed166-9c53-4313-ae82-5599ab43025e admin admin] REQUEST_METHOD: `GET` {{(pid=71939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 24 16:32:13.231489 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9eeed166-9c53-4313-ae82-5599ab43025e admin admin] SCRIPT_NAME: `/identity` {{(pid=71939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 24 16:32:13.231819 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9eeed166-9c53-4313-ae82-5599ab43025e admin admin] PATH_INFO: `/v3/roles/service` {{(pid=71939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 24 16:32:13.245472 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9eeed166-9c53-4313-ae82-5599ab43025e admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=71939) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:401}} Nov 24 16:32:13.254128 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: WARNING keystone.server.flask.application [None req-9eeed166-9c53-4313-ae82-5599ab43025e admin admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Nov 24 16:32:13.255382 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: [pid: 71939|app: 0|req: 341/682] 10.222.0.53 () {56 vars in 1114 bytes} [Wed Nov 24 16:32:13 2021] GET /identity/v3/roles/service => generated 85 bytes in 40 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Nov 24 16:32:13.262309 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fefbcba5-80ba-4e5e-baf4-ed01de1ac79d None None] Authenticating user token {{(pid=71938) process_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 24 16:32:13.272264 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fefbcba5-80ba-4e5e-baf4-ed01de1ac79d None None] Validating token access rules against request {{(pid=71938) validate_allowed_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 24 16:32:13.276607 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5299838c-7718-46cf-a05e-abb4592ac584 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f2ba2e8375b4e8c8792ee1e22b60427', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '00a5583c7b7443e98e7a1d31a0b638dc', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=71938) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 24 16:32:13.277286 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5299838c-7718-46cf-a05e-abb4592ac584 admin admin] REQUEST_METHOD: `GET` {{(pid=71938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 24 16:32:13.277627 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5299838c-7718-46cf-a05e-abb4592ac584 admin admin] SCRIPT_NAME: `/identity` {{(pid=71938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 24 16:32:13.277961 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5299838c-7718-46cf-a05e-abb4592ac584 admin admin] PATH_INFO: `/v3/roles` {{(pid=71938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 24 16:32:13.278835 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5299838c-7718-46cf-a05e-abb4592ac584 admin admin] RBAC: Adding query filter params (name=service) {{(pid=71938) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:161}} Nov 24 16:32:13.279188 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5299838c-7718-46cf-a05e-abb4592ac584 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=71938) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:442}} Nov 24 16:32:13.307622 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5299838c-7718-46cf-a05e-abb4592ac584 admin admin] RBAC: Authorization granted {{(pid=71938) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 24 16:32:13.317580 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: [pid: 71938|app: 0|req: 342/683] 10.222.0.53 () {56 vars in 1115 bytes} [Wed Nov 24 16:32:13 2021] GET /identity/v3/roles?name=service => generated 326 bytes in 56 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 24 16:32:13.323718 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9eeed166-9c53-4313-ae82-5599ab43025e admin admin] Authenticating user token {{(pid=71939) process_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 24 16:32:13.335549 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9eeed166-9c53-4313-ae82-5599ab43025e admin admin] Validating token access rules against request {{(pid=71939) validate_allowed_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 24 16:32:13.340022 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-feebaf1b-1e82-4c12-93db-36ee6a824ed6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f2ba2e8375b4e8c8792ee1e22b60427', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '00a5583c7b7443e98e7a1d31a0b638dc', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=71939) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 24 16:32:13.340829 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-feebaf1b-1e82-4c12-93db-36ee6a824ed6 admin admin] REQUEST_METHOD: `GET` {{(pid=71939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 24 16:32:13.341172 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-feebaf1b-1e82-4c12-93db-36ee6a824ed6 admin admin] SCRIPT_NAME: `/identity` {{(pid=71939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 24 16:32:13.341508 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-feebaf1b-1e82-4c12-93db-36ee6a824ed6 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=71939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 24 16:32:13.353390 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-feebaf1b-1e82-4c12-93db-36ee6a824ed6 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=71939) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:442}} Nov 24 16:32:13.382838 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-feebaf1b-1e82-4c12-93db-36ee6a824ed6 admin admin] RBAC: Authorization granted {{(pid=71939) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 24 16:32:13.402214 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: WARNING keystone.server.flask.application [None req-feebaf1b-1e82-4c12-93db-36ee6a824ed6 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Nov 24 16:32:13.403434 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: [pid: 71939|app: 0|req: 342/684] 10.222.0.53 () {56 vars in 1120 bytes} [Wed Nov 24 16:32:13 2021] GET /identity/v3/domains/Default => generated 87 bytes in 80 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 24 16:32:13.409668 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5299838c-7718-46cf-a05e-abb4592ac584 admin admin] Authenticating user token {{(pid=71938) process_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 24 16:32:13.419651 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5299838c-7718-46cf-a05e-abb4592ac584 admin admin] Validating token access rules against request {{(pid=71938) validate_allowed_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 24 16:32:13.424390 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0390ea70-b849-4690-9560-cd93e7efb567 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f2ba2e8375b4e8c8792ee1e22b60427', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '00a5583c7b7443e98e7a1d31a0b638dc', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=71938) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 24 16:32:13.425060 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0390ea70-b849-4690-9560-cd93e7efb567 admin admin] REQUEST_METHOD: `GET` {{(pid=71938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 24 16:32:13.425397 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0390ea70-b849-4690-9560-cd93e7efb567 admin admin] SCRIPT_NAME: `/identity` {{(pid=71938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 24 16:32:13.425735 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0390ea70-b849-4690-9560-cd93e7efb567 admin admin] PATH_INFO: `/v3/domains` {{(pid=71938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 24 16:32:13.426554 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0390ea70-b849-4690-9560-cd93e7efb567 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=71938) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:161}} Nov 24 16:32:13.426904 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0390ea70-b849-4690-9560-cd93e7efb567 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=71938) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:442}} Nov 24 16:32:13.456354 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0390ea70-b849-4690-9560-cd93e7efb567 admin admin] RBAC: Authorization granted {{(pid=71938) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 24 16:32:13.471158 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: [pid: 71938|app: 0|req: 343/685] 10.222.0.53 () {56 vars in 1121 bytes} [Wed Nov 24 16:32:13 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 62 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 24 16:32:13.477162 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-feebaf1b-1e82-4c12-93db-36ee6a824ed6 admin admin] Authenticating user token {{(pid=71939) process_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 24 16:32:13.487194 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-feebaf1b-1e82-4c12-93db-36ee6a824ed6 admin admin] Validating token access rules against request {{(pid=71939) validate_allowed_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 24 16:32:13.491425 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cec4a66-38b0-4d77-a9a3-29a7e64198a8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f2ba2e8375b4e8c8792ee1e22b60427', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '00a5583c7b7443e98e7a1d31a0b638dc', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=71939) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 24 16:32:13.492251 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cec4a66-38b0-4d77-a9a3-29a7e64198a8 admin admin] REQUEST_METHOD: `GET` {{(pid=71939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 24 16:32:13.492592 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cec4a66-38b0-4d77-a9a3-29a7e64198a8 admin admin] SCRIPT_NAME: `/identity` {{(pid=71939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 24 16:32:13.492923 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cec4a66-38b0-4d77-a9a3-29a7e64198a8 admin admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=71939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 24 16:32:13.507172 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cec4a66-38b0-4d77-a9a3-29a7e64198a8 admin admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=71939) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:442}} Nov 24 16:32:13.545421 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cec4a66-38b0-4d77-a9a3-29a7e64198a8 admin admin] RBAC: Authorization granted {{(pid=71939) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 24 16:32:13.568994 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: WARNING keystone.server.flask.application [None req-4cec4a66-38b0-4d77-a9a3-29a7e64198a8 admin admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Nov 24 16:32:13.570182 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: [pid: 71939|app: 0|req: 343/686] 10.222.0.53 () {56 vars in 1129 bytes} [Wed Nov 24 16:32:13 2021] GET /identity/v3/users/glance-swift => generated 90 bytes in 94 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 24 16:32:13.576418 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0390ea70-b849-4690-9560-cd93e7efb567 admin admin] Authenticating user token {{(pid=71938) process_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 24 16:32:13.587325 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0390ea70-b849-4690-9560-cd93e7efb567 admin admin] Validating token access rules against request {{(pid=71938) validate_allowed_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 24 16:32:13.591772 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57770192-724d-4afc-8291-54694c5f002d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f2ba2e8375b4e8c8792ee1e22b60427', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '00a5583c7b7443e98e7a1d31a0b638dc', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=71938) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 24 16:32:13.592464 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57770192-724d-4afc-8291-54694c5f002d admin admin] REQUEST_METHOD: `GET` {{(pid=71938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 24 16:32:13.592804 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57770192-724d-4afc-8291-54694c5f002d admin admin] SCRIPT_NAME: `/identity` {{(pid=71938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 24 16:32:13.593137 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57770192-724d-4afc-8291-54694c5f002d admin admin] PATH_INFO: `/v3/users` {{(pid=71938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 24 16:32:13.594737 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57770192-724d-4afc-8291-54694c5f002d admin admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=71938) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:161}} Nov 24 16:32:13.595098 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57770192-724d-4afc-8291-54694c5f002d admin admin] RBAC: Authorizing `identity:list_users()` {{(pid=71938) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:442}} Nov 24 16:32:13.623926 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57770192-724d-4afc-8291-54694c5f002d admin admin] RBAC: Authorization granted {{(pid=71938) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 24 16:32:13.658214 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: [pid: 71938|app: 0|req: 344/687] 10.222.0.53 () {56 vars in 1161 bytes} [Wed Nov 24 16:32:13 2021] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 82 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 24 16:32:13.664443 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cec4a66-38b0-4d77-a9a3-29a7e64198a8 admin admin] Authenticating user token {{(pid=71939) process_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 24 16:32:13.674414 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cec4a66-38b0-4d77-a9a3-29a7e64198a8 admin admin] Validating token access rules against request {{(pid=71939) validate_allowed_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 24 16:32:13.678615 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-925db98b-2d8d-4d25-bbee-80c6728aa84b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f2ba2e8375b4e8c8792ee1e22b60427', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '00a5583c7b7443e98e7a1d31a0b638dc', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=71939) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 24 16:32:13.679262 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-925db98b-2d8d-4d25-bbee-80c6728aa84b admin admin] REQUEST_METHOD: `GET` {{(pid=71939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 24 16:32:13.679601 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-925db98b-2d8d-4d25-bbee-80c6728aa84b admin admin] SCRIPT_NAME: `/identity` {{(pid=71939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 24 16:32:13.679933 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-925db98b-2d8d-4d25-bbee-80c6728aa84b admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=71939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 24 16:32:13.689767 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-925db98b-2d8d-4d25-bbee-80c6728aa84b admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=71939) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:442}} Nov 24 16:32:13.718792 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-925db98b-2d8d-4d25-bbee-80c6728aa84b admin admin] RBAC: Authorization granted {{(pid=71939) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 24 16:32:13.728361 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: [pid: 71939|app: 0|req: 344/688] 10.222.0.53 () {58 vars in 1315 bytes} [Wed Nov 24 16:32:13 2021] GET /identity/v3/auth/tokens => generated 1616 bytes in 64 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 24 16:32:13.734585 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57770192-724d-4afc-8291-54694c5f002d admin admin] Authenticating user token {{(pid=71938) process_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 24 16:32:13.744527 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57770192-724d-4afc-8291-54694c5f002d admin admin] Validating token access rules against request {{(pid=71938) validate_allowed_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 24 16:32:13.748731 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ebdddc5-a7e1-41ed-a8e5-0472f967f042 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f2ba2e8375b4e8c8792ee1e22b60427', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '00a5583c7b7443e98e7a1d31a0b638dc', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=71938) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 24 16:32:13.749539 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ebdddc5-a7e1-41ed-a8e5-0472f967f042 admin admin] REQUEST_METHOD: `GET` {{(pid=71938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 24 16:32:13.749877 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ebdddc5-a7e1-41ed-a8e5-0472f967f042 admin admin] SCRIPT_NAME: `/identity` {{(pid=71938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 24 16:32:13.750752 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ebdddc5-a7e1-41ed-a8e5-0472f967f042 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=71938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 24 16:32:13.763132 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ebdddc5-a7e1-41ed-a8e5-0472f967f042 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=71938) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:442}} Nov 24 16:32:13.792027 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ebdddc5-a7e1-41ed-a8e5-0472f967f042 admin admin] RBAC: Authorization granted {{(pid=71938) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 24 16:32:13.811335 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: WARNING keystone.server.flask.application [None req-6ebdddc5-a7e1-41ed-a8e5-0472f967f042 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Nov 24 16:32:13.813064 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: [pid: 71938|app: 0|req: 345/689] 10.222.0.53 () {56 vars in 1120 bytes} [Wed Nov 24 16:32:13 2021] GET /identity/v3/domains/Default => generated 87 bytes in 79 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 24 16:32:13.819241 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-925db98b-2d8d-4d25-bbee-80c6728aa84b admin admin] Authenticating user token {{(pid=71939) process_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 24 16:32:13.829189 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-925db98b-2d8d-4d25-bbee-80c6728aa84b admin admin] Validating token access rules against request {{(pid=71939) validate_allowed_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 24 16:32:13.833451 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-918e185c-1800-48a8-b59a-b0506162452b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f2ba2e8375b4e8c8792ee1e22b60427', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '00a5583c7b7443e98e7a1d31a0b638dc', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=71939) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 24 16:32:13.834151 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-918e185c-1800-48a8-b59a-b0506162452b admin admin] REQUEST_METHOD: `GET` {{(pid=71939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 24 16:32:13.834487 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-918e185c-1800-48a8-b59a-b0506162452b admin admin] SCRIPT_NAME: `/identity` {{(pid=71939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 24 16:32:13.834812 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-918e185c-1800-48a8-b59a-b0506162452b admin admin] PATH_INFO: `/v3/domains` {{(pid=71939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 24 16:32:13.835588 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-918e185c-1800-48a8-b59a-b0506162452b admin admin] RBAC: Adding query filter params (name=Default) {{(pid=71939) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:161}} Nov 24 16:32:13.835935 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-918e185c-1800-48a8-b59a-b0506162452b admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=71939) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:442}} Nov 24 16:32:13.863787 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-918e185c-1800-48a8-b59a-b0506162452b admin admin] RBAC: Authorization granted {{(pid=71939) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 24 16:32:13.878929 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: [pid: 71939|app: 0|req: 345/690] 10.222.0.53 () {56 vars in 1121 bytes} [Wed Nov 24 16:32:13 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 60 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 24 16:32:13.885374 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ebdddc5-a7e1-41ed-a8e5-0472f967f042 admin admin] Authenticating user token {{(pid=71938) process_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 24 16:32:13.896412 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ebdddc5-a7e1-41ed-a8e5-0472f967f042 admin admin] Validating token access rules against request {{(pid=71938) validate_allowed_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 24 16:32:13.900756 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75251ca5-fba2-4381-a3de-4ada3c295fc1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f2ba2e8375b4e8c8792ee1e22b60427', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '00a5583c7b7443e98e7a1d31a0b638dc', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=71938) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 24 16:32:13.901570 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75251ca5-fba2-4381-a3de-4ada3c295fc1 admin admin] REQUEST_METHOD: `GET` {{(pid=71938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 24 16:32:13.901909 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75251ca5-fba2-4381-a3de-4ada3c295fc1 admin admin] SCRIPT_NAME: `/identity` {{(pid=71938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 24 16:32:13.902293 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75251ca5-fba2-4381-a3de-4ada3c295fc1 admin admin] PATH_INFO: `/v3/projects/service` {{(pid=71938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 24 16:32:13.911960 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75251ca5-fba2-4381-a3de-4ada3c295fc1 admin admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=71938) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:442}} Nov 24 16:32:13.941043 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75251ca5-fba2-4381-a3de-4ada3c295fc1 admin admin] RBAC: Authorization granted {{(pid=71938) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 24 16:32:13.958227 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: WARNING keystone.server.flask.application [None req-75251ca5-fba2-4381-a3de-4ada3c295fc1 admin admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Nov 24 16:32:13.959493 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: [pid: 71938|app: 0|req: 346/691] 10.222.0.53 () {56 vars in 1123 bytes} [Wed Nov 24 16:32:13 2021] GET /identity/v3/projects/service => generated 88 bytes in 75 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 24 16:32:13.965857 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-918e185c-1800-48a8-b59a-b0506162452b admin admin] Authenticating user token {{(pid=71939) process_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 24 16:32:13.976015 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-918e185c-1800-48a8-b59a-b0506162452b admin admin] Validating token access rules against request {{(pid=71939) validate_allowed_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 24 16:32:13.980286 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22097f33-20c3-4a16-b6cb-8987908b57fe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f2ba2e8375b4e8c8792ee1e22b60427', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '00a5583c7b7443e98e7a1d31a0b638dc', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=71939) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 24 16:32:13.980952 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22097f33-20c3-4a16-b6cb-8987908b57fe admin admin] REQUEST_METHOD: `GET` {{(pid=71939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 24 16:32:13.981293 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22097f33-20c3-4a16-b6cb-8987908b57fe admin admin] SCRIPT_NAME: `/identity` {{(pid=71939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 24 16:32:13.981629 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22097f33-20c3-4a16-b6cb-8987908b57fe admin admin] PATH_INFO: `/v3/projects` {{(pid=71939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 24 16:32:13.982529 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22097f33-20c3-4a16-b6cb-8987908b57fe admin admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=71939) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:161}} Nov 24 16:32:13.982888 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22097f33-20c3-4a16-b6cb-8987908b57fe admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=71939) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:442}} Nov 24 16:32:14.011649 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22097f33-20c3-4a16-b6cb-8987908b57fe admin admin] RBAC: Authorization granted {{(pid=71939) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 24 16:32:14.028727 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: [pid: 71939|app: 0|req: 346/692] 10.222.0.53 () {56 vars in 1160 bytes} [Wed Nov 24 16:32:13 2021] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 63 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 24 16:32:14.035313 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75251ca5-fba2-4381-a3de-4ada3c295fc1 admin admin] Authenticating user token {{(pid=71938) process_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 24 16:32:14.045330 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75251ca5-fba2-4381-a3de-4ada3c295fc1 admin admin] Validating token access rules against request {{(pid=71938) validate_allowed_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 24 16:32:14.049665 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a43b3e38-2789-48f6-8691-dba5239e7f65 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f2ba2e8375b4e8c8792ee1e22b60427', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '00a5583c7b7443e98e7a1d31a0b638dc', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=71938) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 24 16:32:14.050375 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a43b3e38-2789-48f6-8691-dba5239e7f65 admin admin] REQUEST_METHOD: `GET` {{(pid=71938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 24 16:32:14.050712 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a43b3e38-2789-48f6-8691-dba5239e7f65 admin admin] SCRIPT_NAME: `/identity` {{(pid=71938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 24 16:32:14.051043 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a43b3e38-2789-48f6-8691-dba5239e7f65 admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=71938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 24 16:32:14.051930 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a43b3e38-2789-48f6-8691-dba5239e7f65 admin admin] RBAC: Adding query filter params (role.id=2d4a51004ce34308a7a33e68bf2cfc74, scope.project.id=3b3940d4ae1c4177ae29c02377bb4b0b, user.id=f8a135ac0e4744a98258dc7f6c12e741) {{(pid=71938) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:161}} Nov 24 16:32:14.052323 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a43b3e38-2789-48f6-8691-dba5239e7f65 admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=71938) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:442}} Nov 24 16:32:14.082508 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a43b3e38-2789-48f6-8691-dba5239e7f65 admin admin] RBAC: Authorization granted {{(pid=71938) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 24 16:32:14.089175 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: [pid: 71938|app: 0|req: 347/693] 10.222.0.53 () {56 vars in 1386 bytes} [Wed Nov 24 16:32:14 2021] GET /identity/v3/role_assignments?user.id=f8a135ac0e4744a98258dc7f6c12e741&scope.project.id=3b3940d4ae1c4177ae29c02377bb4b0b&role.id=2d4a51004ce34308a7a33e68bf2cfc74 => generated 608 bytes in 54 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 24 16:32:16.118661 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-125f2a7d-e468-49c8-a41a-7027b153b536 None None] REQUEST_METHOD: `GET` {{(pid=71939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 24 16:32:16.119179 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-125f2a7d-e468-49c8-a41a-7027b153b536 None None] SCRIPT_NAME: `/identity` {{(pid=71939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 24 16:32:16.119333 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-125f2a7d-e468-49c8-a41a-7027b153b536 None None] PATH_INFO: `/` {{(pid=71939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 24 16:32:16.121175 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: [pid: 71939|app: 0|req: 347/694] 10.222.0.53 () {54 vars in 915 bytes} [Wed Nov 24 16:32:16 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 24 16:32:16.127438 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0c9fc9f-15a4-4a3c-9545-39261c564b41 None None] REQUEST_METHOD: `POST` {{(pid=71938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 24 16:32:16.127788 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0c9fc9f-15a4-4a3c-9545-39261c564b41 None None] SCRIPT_NAME: `/identity` {{(pid=71938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 24 16:32:16.128127 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0c9fc9f-15a4-4a3c-9545-39261c564b41 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=71938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 24 16:32:16.152188 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.auth.core [None req-b0c9fc9f-15a4-4a3c-9545-39261c564b41 None None] MFA Rules not processed for user `0f2ba2e8375b4e8c8792ee1e22b60427`. Rule list: `[]` (Enabled: `True`). {{(pid=71938) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:442}} Nov 24 16:32:16.153400 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.fernet_utils [None req-b0c9fc9f-15a4-4a3c-9545-39261c564b41 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=71938) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:289}} Nov 24 16:32:16.160503 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: [pid: 71938|app: 0|req: 348/695] 10.222.0.53 () {58 vars in 1013 bytes} [Wed Nov 24 16:32:16 2021] POST /identity/v3/auth/tokens => generated 1616 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 24 16:32:16.182787 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43c215e4-0cb9-4535-a6b2-f63e58b08dac None None] REQUEST_METHOD: `POST` {{(pid=71939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 24 16:32:16.183137 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43c215e4-0cb9-4535-a6b2-f63e58b08dac None None] SCRIPT_NAME: `/identity` {{(pid=71939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 24 16:32:16.183477 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43c215e4-0cb9-4535-a6b2-f63e58b08dac None None] PATH_INFO: `/v3/auth/tokens` {{(pid=71939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 24 16:32:16.284584 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.auth.core [None req-43c215e4-0cb9-4535-a6b2-f63e58b08dac None None] MFA Rules not processed for user `0f2ba2e8375b4e8c8792ee1e22b60427`. Rule list: `[]` (Enabled: `True`). {{(pid=71939) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:442}} Nov 24 16:32:16.285825 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.fernet_utils [None req-43c215e4-0cb9-4535-a6b2-f63e58b08dac None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=71939) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:289}} Nov 24 16:32:16.293022 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: [pid: 71939|app: 0|req: 348/696] 10.222.0.53 () {58 vars in 1013 bytes} [Wed Nov 24 16:32:16 2021] POST /identity/v3/auth/tokens => generated 1616 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 24 16:32:16.298974 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0c9fc9f-15a4-4a3c-9545-39261c564b41 None None] Authenticating user token {{(pid=71938) process_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 24 16:32:16.308537 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0c9fc9f-15a4-4a3c-9545-39261c564b41 None None] Validating token access rules against request {{(pid=71938) validate_allowed_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 24 16:32:16.313343 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b73df59-97e9-4a27-9316-f4abfb860a7f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f2ba2e8375b4e8c8792ee1e22b60427', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '00a5583c7b7443e98e7a1d31a0b638dc', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=71938) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 24 16:32:16.314189 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b73df59-97e9-4a27-9316-f4abfb860a7f admin admin] REQUEST_METHOD: `GET` {{(pid=71938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 24 16:32:16.314533 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b73df59-97e9-4a27-9316-f4abfb860a7f admin admin] SCRIPT_NAME: `/identity` {{(pid=71938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 24 16:32:16.314863 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b73df59-97e9-4a27-9316-f4abfb860a7f admin admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=71938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 24 16:32:16.326526 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b73df59-97e9-4a27-9316-f4abfb860a7f admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=71938) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:401}} Nov 24 16:32:16.335543 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: WARNING keystone.server.flask.application [None req-4b73df59-97e9-4a27-9316-f4abfb860a7f admin admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Nov 24 16:32:16.336711 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: [pid: 71938|app: 0|req: 349/697] 10.222.0.53 () {56 vars in 1132 bytes} [Wed Nov 24 16:32:16 2021] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 38 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 24 16:32:16.343252 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43c215e4-0cb9-4535-a6b2-f63e58b08dac None None] Authenticating user token {{(pid=71939) process_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 24 16:32:16.352321 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43c215e4-0cb9-4535-a6b2-f63e58b08dac None None] Validating token access rules against request {{(pid=71939) validate_allowed_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 24 16:32:16.357975 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-424138c9-ed08-40c4-8320-5eb57fb5de6c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f2ba2e8375b4e8c8792ee1e22b60427', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '00a5583c7b7443e98e7a1d31a0b638dc', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=71939) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 24 16:32:16.359167 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-424138c9-ed08-40c4-8320-5eb57fb5de6c admin admin] REQUEST_METHOD: `GET` {{(pid=71939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 24 16:32:16.360180 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-424138c9-ed08-40c4-8320-5eb57fb5de6c admin admin] SCRIPT_NAME: `/identity` {{(pid=71939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 24 16:32:16.360521 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-424138c9-ed08-40c4-8320-5eb57fb5de6c admin admin] PATH_INFO: `/v3/roles` {{(pid=71939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 24 16:32:16.361639 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-424138c9-ed08-40c4-8320-5eb57fb5de6c admin admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=71939) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:161}} Nov 24 16:32:16.362313 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-424138c9-ed08-40c4-8320-5eb57fb5de6c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=71939) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:442}} Nov 24 16:32:16.395695 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-424138c9-ed08-40c4-8320-5eb57fb5de6c admin admin] RBAC: Authorization granted {{(pid=71939) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 24 16:32:16.407027 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: [pid: 71939|app: 0|req: 349/698] 10.222.0.53 () {56 vars in 1127 bytes} [Wed Nov 24 16:32:16 2021] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 64 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 24 16:32:16.413100 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b73df59-97e9-4a27-9316-f4abfb860a7f admin admin] Authenticating user token {{(pid=71938) process_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 24 16:32:16.424237 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b73df59-97e9-4a27-9316-f4abfb860a7f admin admin] Validating token access rules against request {{(pid=71938) validate_allowed_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 24 16:32:16.428483 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5769ea56-1c36-484c-b230-734e129ce87c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f2ba2e8375b4e8c8792ee1e22b60427', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '00a5583c7b7443e98e7a1d31a0b638dc', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=71938) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 24 16:32:16.429284 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5769ea56-1c36-484c-b230-734e129ce87c admin admin] REQUEST_METHOD: `GET` {{(pid=71938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 24 16:32:16.429624 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5769ea56-1c36-484c-b230-734e129ce87c admin admin] SCRIPT_NAME: `/identity` {{(pid=71938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 24 16:32:16.429955 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5769ea56-1c36-484c-b230-734e129ce87c admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=71938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 24 16:32:16.442478 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5769ea56-1c36-484c-b230-734e129ce87c admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=71938) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:442}} Nov 24 16:32:16.471078 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5769ea56-1c36-484c-b230-734e129ce87c admin admin] RBAC: Authorization granted {{(pid=71938) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 24 16:32:16.490978 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: WARNING keystone.server.flask.application [None req-5769ea56-1c36-484c-b230-734e129ce87c admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Nov 24 16:32:16.492200 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: [pid: 71938|app: 0|req: 350/699] 10.222.0.53 () {56 vars in 1120 bytes} [Wed Nov 24 16:32:16 2021] GET /identity/v3/domains/Default => generated 87 bytes in 80 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 24 16:32:16.498406 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-424138c9-ed08-40c4-8320-5eb57fb5de6c admin admin] Authenticating user token {{(pid=71939) process_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 24 16:32:16.510492 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-424138c9-ed08-40c4-8320-5eb57fb5de6c admin admin] Validating token access rules against request {{(pid=71939) validate_allowed_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 24 16:32:16.514902 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a22b002e-511e-4b10-ae77-7922c43400b2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f2ba2e8375b4e8c8792ee1e22b60427', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '00a5583c7b7443e98e7a1d31a0b638dc', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=71939) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 24 16:32:16.515573 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a22b002e-511e-4b10-ae77-7922c43400b2 admin admin] REQUEST_METHOD: `GET` {{(pid=71939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 24 16:32:16.515917 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a22b002e-511e-4b10-ae77-7922c43400b2 admin admin] SCRIPT_NAME: `/identity` {{(pid=71939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 24 16:32:16.516252 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a22b002e-511e-4b10-ae77-7922c43400b2 admin admin] PATH_INFO: `/v3/domains` {{(pid=71939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 24 16:32:16.517041 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a22b002e-511e-4b10-ae77-7922c43400b2 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=71939) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:161}} Nov 24 16:32:16.517396 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a22b002e-511e-4b10-ae77-7922c43400b2 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=71939) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:442}} Nov 24 16:32:16.545247 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a22b002e-511e-4b10-ae77-7922c43400b2 admin admin] RBAC: Authorization granted {{(pid=71939) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 24 16:32:16.559507 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: [pid: 71939|app: 0|req: 350/700] 10.222.0.53 () {56 vars in 1121 bytes} [Wed Nov 24 16:32:16 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 62 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 24 16:32:16.566087 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5769ea56-1c36-484c-b230-734e129ce87c admin admin] Authenticating user token {{(pid=71938) process_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 24 16:32:16.575974 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5769ea56-1c36-484c-b230-734e129ce87c admin admin] Validating token access rules against request {{(pid=71938) validate_allowed_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 24 16:32:16.580580 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a9b6369-09bf-4b59-8053-69ab8743b0b8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f2ba2e8375b4e8c8792ee1e22b60427', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '00a5583c7b7443e98e7a1d31a0b638dc', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=71938) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 24 16:32:16.581402 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a9b6369-09bf-4b59-8053-69ab8743b0b8 admin admin] REQUEST_METHOD: `GET` {{(pid=71938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 24 16:32:16.581738 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a9b6369-09bf-4b59-8053-69ab8743b0b8 admin admin] SCRIPT_NAME: `/identity` {{(pid=71938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 24 16:32:16.582091 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a9b6369-09bf-4b59-8053-69ab8743b0b8 admin admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=71938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 24 16:32:16.595527 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a9b6369-09bf-4b59-8053-69ab8743b0b8 admin admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=71938) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:442}} Nov 24 16:32:16.624774 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a9b6369-09bf-4b59-8053-69ab8743b0b8 admin admin] RBAC: Authorization granted {{(pid=71938) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 24 16:32:16.645916 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: WARNING keystone.server.flask.application [None req-6a9b6369-09bf-4b59-8053-69ab8743b0b8 admin admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Nov 24 16:32:16.647085 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: [pid: 71938|app: 0|req: 351/701] 10.222.0.53 () {56 vars in 1129 bytes} [Wed Nov 24 16:32:16 2021] GET /identity/v3/users/glance-swift => generated 90 bytes in 82 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 24 16:32:16.653818 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a22b002e-511e-4b10-ae77-7922c43400b2 admin admin] Authenticating user token {{(pid=71939) process_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 24 16:32:16.663882 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a22b002e-511e-4b10-ae77-7922c43400b2 admin admin] Validating token access rules against request {{(pid=71939) validate_allowed_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 24 16:32:16.668134 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71ee4f3e-c1eb-468b-9de5-2ab297977da6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f2ba2e8375b4e8c8792ee1e22b60427', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '00a5583c7b7443e98e7a1d31a0b638dc', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=71939) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 24 16:32:16.668804 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71ee4f3e-c1eb-468b-9de5-2ab297977da6 admin admin] REQUEST_METHOD: `GET` {{(pid=71939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 24 16:32:16.669155 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71ee4f3e-c1eb-468b-9de5-2ab297977da6 admin admin] SCRIPT_NAME: `/identity` {{(pid=71939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 24 16:32:16.669484 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71ee4f3e-c1eb-468b-9de5-2ab297977da6 admin admin] PATH_INFO: `/v3/users` {{(pid=71939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 24 16:32:16.670418 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71ee4f3e-c1eb-468b-9de5-2ab297977da6 admin admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=71939) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:161}} Nov 24 16:32:16.670843 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71ee4f3e-c1eb-468b-9de5-2ab297977da6 admin admin] RBAC: Authorizing `identity:list_users()` {{(pid=71939) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:442}} Nov 24 16:32:16.704548 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71ee4f3e-c1eb-468b-9de5-2ab297977da6 admin admin] RBAC: Authorization granted {{(pid=71939) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 24 16:32:16.737682 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: [pid: 71939|app: 0|req: 351/702] 10.222.0.53 () {56 vars in 1161 bytes} [Wed Nov 24 16:32:16 2021] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 84 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 24 16:32:16.743805 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a9b6369-09bf-4b59-8053-69ab8743b0b8 admin admin] Authenticating user token {{(pid=71938) process_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 24 16:32:16.753845 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a9b6369-09bf-4b59-8053-69ab8743b0b8 admin admin] Validating token access rules against request {{(pid=71938) validate_allowed_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 24 16:32:16.758195 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d87a624-f88a-4121-8ce8-4c0b9930d9b7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f2ba2e8375b4e8c8792ee1e22b60427', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '00a5583c7b7443e98e7a1d31a0b638dc', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=71938) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 24 16:32:16.758847 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d87a624-f88a-4121-8ce8-4c0b9930d9b7 admin admin] REQUEST_METHOD: `GET` {{(pid=71938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 24 16:32:16.759187 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d87a624-f88a-4121-8ce8-4c0b9930d9b7 admin admin] SCRIPT_NAME: `/identity` {{(pid=71938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 24 16:32:16.759522 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d87a624-f88a-4121-8ce8-4c0b9930d9b7 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=71938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 24 16:32:16.768747 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d87a624-f88a-4121-8ce8-4c0b9930d9b7 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=71938) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:442}} Nov 24 16:32:16.797973 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d87a624-f88a-4121-8ce8-4c0b9930d9b7 admin admin] RBAC: Authorization granted {{(pid=71938) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 24 16:32:16.807996 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: [pid: 71938|app: 0|req: 352/703] 10.222.0.53 () {58 vars in 1315 bytes} [Wed Nov 24 16:32:16 2021] GET /identity/v3/auth/tokens => generated 1616 bytes in 65 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 24 16:32:16.814321 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71ee4f3e-c1eb-468b-9de5-2ab297977da6 admin admin] Authenticating user token {{(pid=71939) process_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 24 16:32:16.825101 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71ee4f3e-c1eb-468b-9de5-2ab297977da6 admin admin] Validating token access rules against request {{(pid=71939) validate_allowed_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 24 16:32:16.829696 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5fe69ea-1c62-455c-abf4-c60b2c8ae6dc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f2ba2e8375b4e8c8792ee1e22b60427', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '00a5583c7b7443e98e7a1d31a0b638dc', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=71939) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 24 16:32:16.830532 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5fe69ea-1c62-455c-abf4-c60b2c8ae6dc admin admin] REQUEST_METHOD: `GET` {{(pid=71939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 24 16:32:16.830870 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5fe69ea-1c62-455c-abf4-c60b2c8ae6dc admin admin] SCRIPT_NAME: `/identity` {{(pid=71939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 24 16:32:16.831200 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5fe69ea-1c62-455c-abf4-c60b2c8ae6dc admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=71939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 24 16:32:16.844515 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5fe69ea-1c62-455c-abf4-c60b2c8ae6dc admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=71939) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:442}} Nov 24 16:32:16.874293 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5fe69ea-1c62-455c-abf4-c60b2c8ae6dc admin admin] RBAC: Authorization granted {{(pid=71939) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 24 16:32:16.894689 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: WARNING keystone.server.flask.application [None req-e5fe69ea-1c62-455c-abf4-c60b2c8ae6dc admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Nov 24 16:32:16.895893 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: [pid: 71939|app: 0|req: 352/704] 10.222.0.53 () {56 vars in 1120 bytes} [Wed Nov 24 16:32:16 2021] GET /identity/v3/domains/Default => generated 87 bytes in 82 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 24 16:32:16.902166 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d87a624-f88a-4121-8ce8-4c0b9930d9b7 admin admin] Authenticating user token {{(pid=71938) process_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 24 16:32:16.911618 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d87a624-f88a-4121-8ce8-4c0b9930d9b7 admin admin] Validating token access rules against request {{(pid=71938) validate_allowed_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 24 16:32:16.915999 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6db40eca-387a-408c-b9c3-c607afed1e7a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f2ba2e8375b4e8c8792ee1e22b60427', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '00a5583c7b7443e98e7a1d31a0b638dc', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=71938) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 24 16:32:16.916658 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6db40eca-387a-408c-b9c3-c607afed1e7a admin admin] REQUEST_METHOD: `GET` {{(pid=71938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 24 16:32:16.916987 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6db40eca-387a-408c-b9c3-c607afed1e7a admin admin] SCRIPT_NAME: `/identity` {{(pid=71938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 24 16:32:16.917312 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6db40eca-387a-408c-b9c3-c607afed1e7a admin admin] PATH_INFO: `/v3/domains` {{(pid=71938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 24 16:32:16.918118 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6db40eca-387a-408c-b9c3-c607afed1e7a admin admin] RBAC: Adding query filter params (name=Default) {{(pid=71938) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:161}} Nov 24 16:32:16.918465 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6db40eca-387a-408c-b9c3-c607afed1e7a admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=71938) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:442}} Nov 24 16:32:16.949308 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6db40eca-387a-408c-b9c3-c607afed1e7a admin admin] RBAC: Authorization granted {{(pid=71938) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 24 16:32:16.963425 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: [pid: 71938|app: 0|req: 353/705] 10.222.0.53 () {56 vars in 1121 bytes} [Wed Nov 24 16:32:16 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 62 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 24 16:32:16.969541 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5fe69ea-1c62-455c-abf4-c60b2c8ae6dc admin admin] Authenticating user token {{(pid=71939) process_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 24 16:32:16.979503 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5fe69ea-1c62-455c-abf4-c60b2c8ae6dc admin admin] Validating token access rules against request {{(pid=71939) validate_allowed_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 24 16:32:16.983752 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49b66a65-c12a-48e9-88e6-da89440146b3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f2ba2e8375b4e8c8792ee1e22b60427', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '00a5583c7b7443e98e7a1d31a0b638dc', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=71939) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 24 16:32:16.984556 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49b66a65-c12a-48e9-88e6-da89440146b3 admin admin] REQUEST_METHOD: `GET` {{(pid=71939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 24 16:32:16.984897 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49b66a65-c12a-48e9-88e6-da89440146b3 admin admin] SCRIPT_NAME: `/identity` {{(pid=71939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 24 16:32:16.985230 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49b66a65-c12a-48e9-88e6-da89440146b3 admin admin] PATH_INFO: `/v3/projects/service` {{(pid=71939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 24 16:32:16.994431 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49b66a65-c12a-48e9-88e6-da89440146b3 admin admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=71939) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:442}} Nov 24 16:32:17.024252 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49b66a65-c12a-48e9-88e6-da89440146b3 admin admin] RBAC: Authorization granted {{(pid=71939) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 24 16:32:17.039159 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: WARNING keystone.server.flask.application [None req-49b66a65-c12a-48e9-88e6-da89440146b3 admin admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Nov 24 16:32:17.040318 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: [pid: 71939|app: 0|req: 353/706] 10.222.0.53 () {56 vars in 1123 bytes} [Wed Nov 24 16:32:16 2021] GET /identity/v3/projects/service => generated 88 bytes in 71 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 24 16:32:17.046478 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6db40eca-387a-408c-b9c3-c607afed1e7a admin admin] Authenticating user token {{(pid=71938) process_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 24 16:32:17.056416 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6db40eca-387a-408c-b9c3-c607afed1e7a admin admin] Validating token access rules against request {{(pid=71938) validate_allowed_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 24 16:32:17.060778 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-607b2df2-c5c4-47e2-8c50-8de47ec4b4ae admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f2ba2e8375b4e8c8792ee1e22b60427', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '00a5583c7b7443e98e7a1d31a0b638dc', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=71938) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 24 16:32:17.061418 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-607b2df2-c5c4-47e2-8c50-8de47ec4b4ae admin admin] REQUEST_METHOD: `GET` {{(pid=71938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 24 16:32:17.061765 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-607b2df2-c5c4-47e2-8c50-8de47ec4b4ae admin admin] SCRIPT_NAME: `/identity` {{(pid=71938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 24 16:32:17.062130 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-607b2df2-c5c4-47e2-8c50-8de47ec4b4ae admin admin] PATH_INFO: `/v3/projects` {{(pid=71938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 24 16:32:17.063485 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-607b2df2-c5c4-47e2-8c50-8de47ec4b4ae admin admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=71938) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:161}} Nov 24 16:32:17.063841 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-607b2df2-c5c4-47e2-8c50-8de47ec4b4ae admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=71938) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:442}} Nov 24 16:32:17.093195 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-607b2df2-c5c4-47e2-8c50-8de47ec4b4ae admin admin] RBAC: Authorization granted {{(pid=71938) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 24 16:32:17.106872 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: [pid: 71938|app: 0|req: 354/707] 10.222.0.53 () {56 vars in 1160 bytes} [Wed Nov 24 16:32:17 2021] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 61 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 24 16:32:17.113425 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49b66a65-c12a-48e9-88e6-da89440146b3 admin admin] Authenticating user token {{(pid=71939) process_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 24 16:32:17.123194 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49b66a65-c12a-48e9-88e6-da89440146b3 admin admin] Validating token access rules against request {{(pid=71939) validate_allowed_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 24 16:32:17.128226 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cc7a291-3f5b-44e4-bd1e-255a131cb9bb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f2ba2e8375b4e8c8792ee1e22b60427', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '00a5583c7b7443e98e7a1d31a0b638dc', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=71939) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 24 16:32:17.128870 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cc7a291-3f5b-44e4-bd1e-255a131cb9bb admin admin] REQUEST_METHOD: `GET` {{(pid=71939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 24 16:32:17.129208 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cc7a291-3f5b-44e4-bd1e-255a131cb9bb admin admin] SCRIPT_NAME: `/identity` {{(pid=71939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 24 16:32:17.129541 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cc7a291-3f5b-44e4-bd1e-255a131cb9bb admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=71939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 24 16:32:17.130476 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cc7a291-3f5b-44e4-bd1e-255a131cb9bb admin admin] RBAC: Adding query filter params (role.id=27a0b92630d549249a3beada0d8379f5, scope.project.id=3b3940d4ae1c4177ae29c02377bb4b0b, user.id=f8a135ac0e4744a98258dc7f6c12e741) {{(pid=71939) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:161}} Nov 24 16:32:17.130838 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cc7a291-3f5b-44e4-bd1e-255a131cb9bb admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=71939) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:442}} Nov 24 16:32:17.159340 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cc7a291-3f5b-44e4-bd1e-255a131cb9bb admin admin] RBAC: Authorization granted {{(pid=71939) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 24 16:32:17.164842 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: [pid: 71939|app: 0|req: 354/708] 10.222.0.53 () {56 vars in 1386 bytes} [Wed Nov 24 16:32:17 2021] GET /identity/v3/role_assignments?user.id=f8a135ac0e4744a98258dc7f6c12e741&scope.project.id=3b3940d4ae1c4177ae29c02377bb4b0b&role.id=27a0b92630d549249a3beada0d8379f5 => generated 259 bytes in 52 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 24 16:32:19.117123 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e7a8549-9521-41af-a519-58ed383ea1ee None None] REQUEST_METHOD: `GET` {{(pid=71938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 24 16:32:19.117672 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e7a8549-9521-41af-a519-58ed383ea1ee None None] SCRIPT_NAME: `/identity` {{(pid=71938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 24 16:32:19.117835 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e7a8549-9521-41af-a519-58ed383ea1ee None None] PATH_INFO: `/` {{(pid=71938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 24 16:32:19.119719 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: [pid: 71938|app: 0|req: 355/709] 10.222.0.53 () {54 vars in 915 bytes} [Wed Nov 24 16:32:19 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 24 16:32:19.125361 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c87c8d1-65d2-4612-aef9-d9ba21ddc240 None None] REQUEST_METHOD: `POST` {{(pid=71939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 24 16:32:19.125716 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c87c8d1-65d2-4612-aef9-d9ba21ddc240 None None] SCRIPT_NAME: `/identity` {{(pid=71939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 24 16:32:19.126092 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c87c8d1-65d2-4612-aef9-d9ba21ddc240 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=71939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 24 16:32:19.149437 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.auth.core [None req-8c87c8d1-65d2-4612-aef9-d9ba21ddc240 None None] MFA Rules not processed for user `0f2ba2e8375b4e8c8792ee1e22b60427`. Rule list: `[]` (Enabled: `True`). {{(pid=71939) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:442}} Nov 24 16:32:19.150695 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.fernet_utils [None req-8c87c8d1-65d2-4612-aef9-d9ba21ddc240 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=71939) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:289}} Nov 24 16:32:19.158327 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: [pid: 71939|app: 0|req: 355/710] 10.222.0.53 () {58 vars in 1013 bytes} [Wed Nov 24 16:32:19 2021] POST /identity/v3/auth/tokens => generated 1616 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 24 16:32:19.181538 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f072b156-9bbb-4644-8e28-44be69b6822c None None] REQUEST_METHOD: `POST` {{(pid=71938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 24 16:32:19.181893 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f072b156-9bbb-4644-8e28-44be69b6822c None None] SCRIPT_NAME: `/identity` {{(pid=71938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 24 16:32:19.182260 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f072b156-9bbb-4644-8e28-44be69b6822c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=71938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 24 16:32:19.205460 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.auth.core [None req-f072b156-9bbb-4644-8e28-44be69b6822c None None] MFA Rules not processed for user `0f2ba2e8375b4e8c8792ee1e22b60427`. Rule list: `[]` (Enabled: `True`). {{(pid=71938) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:442}} Nov 24 16:32:19.206721 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.fernet_utils [None req-f072b156-9bbb-4644-8e28-44be69b6822c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=71938) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:289}} Nov 24 16:32:19.213922 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: [pid: 71938|app: 0|req: 356/711] 10.222.0.53 () {58 vars in 1013 bytes} [Wed Nov 24 16:32:19 2021] POST /identity/v3/auth/tokens => generated 1616 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 24 16:32:19.220335 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c87c8d1-65d2-4612-aef9-d9ba21ddc240 None None] Authenticating user token {{(pid=71939) process_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 24 16:32:19.229989 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c87c8d1-65d2-4612-aef9-d9ba21ddc240 None None] Validating token access rules against request {{(pid=71939) validate_allowed_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 24 16:32:19.234984 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43d85bec-176c-40ee-8bd9-e2924809b680 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f2ba2e8375b4e8c8792ee1e22b60427', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '00a5583c7b7443e98e7a1d31a0b638dc', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=71939) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 24 16:32:19.235813 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43d85bec-176c-40ee-8bd9-e2924809b680 admin admin] REQUEST_METHOD: `GET` {{(pid=71939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 24 16:32:19.236153 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43d85bec-176c-40ee-8bd9-e2924809b680 admin admin] SCRIPT_NAME: `/identity` {{(pid=71939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 24 16:32:19.236487 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43d85bec-176c-40ee-8bd9-e2924809b680 admin admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=71939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 24 16:32:19.248227 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43d85bec-176c-40ee-8bd9-e2924809b680 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=71939) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:401}} Nov 24 16:32:19.257660 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: WARNING keystone.server.flask.application [None req-43d85bec-176c-40ee-8bd9-e2924809b680 admin admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Nov 24 16:32:19.258897 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: [pid: 71939|app: 0|req: 356/712] 10.222.0.53 () {56 vars in 1132 bytes} [Wed Nov 24 16:32:19 2021] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 39 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 24 16:32:19.266270 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f072b156-9bbb-4644-8e28-44be69b6822c None None] Authenticating user token {{(pid=71938) process_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 24 16:32:19.275691 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f072b156-9bbb-4644-8e28-44be69b6822c None None] Validating token access rules against request {{(pid=71938) validate_allowed_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 24 16:32:19.280013 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4244a74e-1951-4f91-ab4e-ba0bba2427dd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f2ba2e8375b4e8c8792ee1e22b60427', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '00a5583c7b7443e98e7a1d31a0b638dc', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=71938) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 24 16:32:19.280681 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4244a74e-1951-4f91-ab4e-ba0bba2427dd admin admin] REQUEST_METHOD: `GET` {{(pid=71938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 24 16:32:19.281022 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4244a74e-1951-4f91-ab4e-ba0bba2427dd admin admin] SCRIPT_NAME: `/identity` {{(pid=71938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 24 16:32:19.281872 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4244a74e-1951-4f91-ab4e-ba0bba2427dd admin admin] PATH_INFO: `/v3/roles` {{(pid=71938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 24 16:32:19.282712 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4244a74e-1951-4f91-ab4e-ba0bba2427dd admin admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=71938) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:161}} Nov 24 16:32:19.283066 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4244a74e-1951-4f91-ab4e-ba0bba2427dd admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=71938) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:442}} Nov 24 16:32:19.311638 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4244a74e-1951-4f91-ab4e-ba0bba2427dd admin admin] RBAC: Authorization granted {{(pid=71938) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 24 16:32:19.320515 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: [pid: 71938|app: 0|req: 357/713] 10.222.0.53 () {56 vars in 1127 bytes} [Wed Nov 24 16:32:19 2021] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 55 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 24 16:32:19.326240 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43d85bec-176c-40ee-8bd9-e2924809b680 admin admin] Authenticating user token {{(pid=71939) process_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 24 16:32:19.337876 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43d85bec-176c-40ee-8bd9-e2924809b680 admin admin] Validating token access rules against request {{(pid=71939) validate_allowed_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 24 16:32:19.342200 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5103dd94-e028-40a1-9b84-d8cb752a203e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f2ba2e8375b4e8c8792ee1e22b60427', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '00a5583c7b7443e98e7a1d31a0b638dc', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=71939) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 24 16:32:19.342995 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5103dd94-e028-40a1-9b84-d8cb752a203e admin admin] REQUEST_METHOD: `GET` {{(pid=71939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 24 16:32:19.343335 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5103dd94-e028-40a1-9b84-d8cb752a203e admin admin] SCRIPT_NAME: `/identity` {{(pid=71939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 24 16:32:19.344280 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5103dd94-e028-40a1-9b84-d8cb752a203e admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=71939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 24 16:32:19.355886 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5103dd94-e028-40a1-9b84-d8cb752a203e admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=71939) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:442}} Nov 24 16:32:19.383932 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5103dd94-e028-40a1-9b84-d8cb752a203e admin admin] RBAC: Authorization granted {{(pid=71939) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 24 16:32:19.403339 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: WARNING keystone.server.flask.application [None req-5103dd94-e028-40a1-9b84-d8cb752a203e admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Nov 24 16:32:19.404762 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: [pid: 71939|app: 0|req: 357/714] 10.222.0.53 () {56 vars in 1120 bytes} [Wed Nov 24 16:32:19 2021] GET /identity/v3/domains/Default => generated 87 bytes in 79 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 24 16:32:19.411186 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4244a74e-1951-4f91-ab4e-ba0bba2427dd admin admin] Authenticating user token {{(pid=71938) process_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 24 16:32:19.420967 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4244a74e-1951-4f91-ab4e-ba0bba2427dd admin admin] Validating token access rules against request {{(pid=71938) validate_allowed_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 24 16:32:19.425210 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c1530a4-4fda-4531-9e93-e3ea080d1447 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f2ba2e8375b4e8c8792ee1e22b60427', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '00a5583c7b7443e98e7a1d31a0b638dc', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=71938) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 24 16:32:19.425867 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c1530a4-4fda-4531-9e93-e3ea080d1447 admin admin] REQUEST_METHOD: `GET` {{(pid=71938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 24 16:32:19.426259 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c1530a4-4fda-4531-9e93-e3ea080d1447 admin admin] SCRIPT_NAME: `/identity` {{(pid=71938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 24 16:32:19.426592 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c1530a4-4fda-4531-9e93-e3ea080d1447 admin admin] PATH_INFO: `/v3/domains` {{(pid=71938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 24 16:32:19.427363 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c1530a4-4fda-4531-9e93-e3ea080d1447 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=71938) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:161}} Nov 24 16:32:19.427712 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c1530a4-4fda-4531-9e93-e3ea080d1447 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=71938) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:442}} Nov 24 16:32:19.456501 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c1530a4-4fda-4531-9e93-e3ea080d1447 admin admin] RBAC: Authorization granted {{(pid=71938) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 24 16:32:19.474258 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: [pid: 71938|app: 0|req: 358/715] 10.222.0.53 () {56 vars in 1121 bytes} [Wed Nov 24 16:32:19 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 64 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 24 16:32:19.479975 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5103dd94-e028-40a1-9b84-d8cb752a203e admin admin] Authenticating user token {{(pid=71939) process_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 24 16:32:19.489635 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5103dd94-e028-40a1-9b84-d8cb752a203e admin admin] Validating token access rules against request {{(pid=71939) validate_allowed_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 24 16:32:19.493911 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c325e438-559e-4afe-85a3-e95894d3e957 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f2ba2e8375b4e8c8792ee1e22b60427', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '00a5583c7b7443e98e7a1d31a0b638dc', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=71939) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 24 16:32:19.494755 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c325e438-559e-4afe-85a3-e95894d3e957 admin admin] REQUEST_METHOD: `GET` {{(pid=71939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 24 16:32:19.495090 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c325e438-559e-4afe-85a3-e95894d3e957 admin admin] SCRIPT_NAME: `/identity` {{(pid=71939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 24 16:32:19.495422 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c325e438-559e-4afe-85a3-e95894d3e957 admin admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=71939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 24 16:32:19.508532 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c325e438-559e-4afe-85a3-e95894d3e957 admin admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=71939) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:442}} Nov 24 16:32:19.537866 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c325e438-559e-4afe-85a3-e95894d3e957 admin admin] RBAC: Authorization granted {{(pid=71939) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 24 16:32:19.557931 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: WARNING keystone.server.flask.application [None req-c325e438-559e-4afe-85a3-e95894d3e957 admin admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Nov 24 16:32:19.559215 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: [pid: 71939|app: 0|req: 358/716] 10.222.0.53 () {56 vars in 1129 bytes} [Wed Nov 24 16:32:19 2021] GET /identity/v3/users/glance-swift => generated 90 bytes in 80 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 24 16:32:19.565316 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c1530a4-4fda-4531-9e93-e3ea080d1447 admin admin] Authenticating user token {{(pid=71938) process_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 24 16:32:19.575197 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c1530a4-4fda-4531-9e93-e3ea080d1447 admin admin] Validating token access rules against request {{(pid=71938) validate_allowed_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 24 16:32:19.580208 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5564ae86-7de4-48ca-a731-7e8956dd8978 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f2ba2e8375b4e8c8792ee1e22b60427', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '00a5583c7b7443e98e7a1d31a0b638dc', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=71938) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 24 16:32:19.580877 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5564ae86-7de4-48ca-a731-7e8956dd8978 admin admin] REQUEST_METHOD: `GET` {{(pid=71938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 24 16:32:19.581216 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5564ae86-7de4-48ca-a731-7e8956dd8978 admin admin] SCRIPT_NAME: `/identity` {{(pid=71938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 24 16:32:19.581549 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5564ae86-7de4-48ca-a731-7e8956dd8978 admin admin] PATH_INFO: `/v3/users` {{(pid=71938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 24 16:32:19.582482 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5564ae86-7de4-48ca-a731-7e8956dd8978 admin admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=71938) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:161}} Nov 24 16:32:19.582840 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5564ae86-7de4-48ca-a731-7e8956dd8978 admin admin] RBAC: Authorizing `identity:list_users()` {{(pid=71938) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:442}} Nov 24 16:32:19.611852 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5564ae86-7de4-48ca-a731-7e8956dd8978 admin admin] RBAC: Authorization granted {{(pid=71938) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 24 16:32:19.644717 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: [pid: 71938|app: 0|req: 359/717] 10.222.0.53 () {56 vars in 1161 bytes} [Wed Nov 24 16:32:19 2021] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 80 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 24 16:32:19.650463 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c325e438-559e-4afe-85a3-e95894d3e957 admin admin] Authenticating user token {{(pid=71939) process_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 24 16:32:19.660884 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c325e438-559e-4afe-85a3-e95894d3e957 admin admin] Validating token access rules against request {{(pid=71939) validate_allowed_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 24 16:32:19.665073 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-427b78f3-ddcd-4599-a8a0-a00d6c593dff admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f2ba2e8375b4e8c8792ee1e22b60427', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '00a5583c7b7443e98e7a1d31a0b638dc', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=71939) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 24 16:32:19.665866 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-427b78f3-ddcd-4599-a8a0-a00d6c593dff admin admin] REQUEST_METHOD: `GET` {{(pid=71939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 24 16:32:19.666254 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-427b78f3-ddcd-4599-a8a0-a00d6c593dff admin admin] SCRIPT_NAME: `/identity` {{(pid=71939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 24 16:32:19.666584 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-427b78f3-ddcd-4599-a8a0-a00d6c593dff admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=71939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 24 16:32:19.678948 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-427b78f3-ddcd-4599-a8a0-a00d6c593dff admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=71939) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:442}} Nov 24 16:32:19.708114 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-427b78f3-ddcd-4599-a8a0-a00d6c593dff admin admin] RBAC: Authorization granted {{(pid=71939) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 24 16:32:19.725916 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: WARNING keystone.server.flask.application [None req-427b78f3-ddcd-4599-a8a0-a00d6c593dff admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Nov 24 16:32:19.727068 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: [pid: 71939|app: 0|req: 359/718] 10.222.0.53 () {56 vars in 1120 bytes} [Wed Nov 24 16:32:19 2021] GET /identity/v3/domains/Default => generated 87 bytes in 77 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 24 16:32:19.732770 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5564ae86-7de4-48ca-a731-7e8956dd8978 admin admin] Authenticating user token {{(pid=71938) process_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 24 16:32:19.742519 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5564ae86-7de4-48ca-a731-7e8956dd8978 admin admin] Validating token access rules against request {{(pid=71938) validate_allowed_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 24 16:32:19.746896 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3baacae-6d22-44c3-8317-2787a4b01753 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f2ba2e8375b4e8c8792ee1e22b60427', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '00a5583c7b7443e98e7a1d31a0b638dc', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=71938) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 24 16:32:19.747555 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3baacae-6d22-44c3-8317-2787a4b01753 admin admin] REQUEST_METHOD: `GET` {{(pid=71938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 24 16:32:19.747893 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3baacae-6d22-44c3-8317-2787a4b01753 admin admin] SCRIPT_NAME: `/identity` {{(pid=71938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 24 16:32:19.748221 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3baacae-6d22-44c3-8317-2787a4b01753 admin admin] PATH_INFO: `/v3/domains` {{(pid=71938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 24 16:32:19.748990 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3baacae-6d22-44c3-8317-2787a4b01753 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=71938) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:161}} Nov 24 16:32:19.749338 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3baacae-6d22-44c3-8317-2787a4b01753 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=71938) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:442}} Nov 24 16:32:19.778944 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3baacae-6d22-44c3-8317-2787a4b01753 admin admin] RBAC: Authorization granted {{(pid=71938) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 24 16:32:19.791479 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: [pid: 71938|app: 0|req: 360/719] 10.222.0.53 () {56 vars in 1121 bytes} [Wed Nov 24 16:32:19 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 59 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 24 16:32:19.796983 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-427b78f3-ddcd-4599-a8a0-a00d6c593dff admin admin] Authenticating user token {{(pid=71939) process_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 24 16:32:19.806566 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-427b78f3-ddcd-4599-a8a0-a00d6c593dff admin admin] Validating token access rules against request {{(pid=71939) validate_allowed_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 24 16:32:19.810747 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce5b45e3-eb62-417c-940b-b4ff1a4c40b9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f2ba2e8375b4e8c8792ee1e22b60427', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '00a5583c7b7443e98e7a1d31a0b638dc', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=71939) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 24 16:32:19.811530 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce5b45e3-eb62-417c-940b-b4ff1a4c40b9 admin admin] REQUEST_METHOD: `GET` {{(pid=71939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 24 16:32:19.811863 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce5b45e3-eb62-417c-940b-b4ff1a4c40b9 admin admin] SCRIPT_NAME: `/identity` {{(pid=71939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 24 16:32:19.812191 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce5b45e3-eb62-417c-940b-b4ff1a4c40b9 admin admin] PATH_INFO: `/v3/projects/service` {{(pid=71939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 24 16:32:19.821721 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce5b45e3-eb62-417c-940b-b4ff1a4c40b9 admin admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=71939) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:442}} Nov 24 16:32:19.850640 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce5b45e3-eb62-417c-940b-b4ff1a4c40b9 admin admin] RBAC: Authorization granted {{(pid=71939) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 24 16:32:19.865253 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: WARNING keystone.server.flask.application [None req-ce5b45e3-eb62-417c-940b-b4ff1a4c40b9 admin admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Nov 24 16:32:19.866417 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: [pid: 71939|app: 0|req: 360/720] 10.222.0.53 () {56 vars in 1123 bytes} [Wed Nov 24 16:32:19 2021] GET /identity/v3/projects/service => generated 88 bytes in 70 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 24 16:32:19.872199 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3baacae-6d22-44c3-8317-2787a4b01753 admin admin] Authenticating user token {{(pid=71938) process_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 24 16:32:19.882356 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3baacae-6d22-44c3-8317-2787a4b01753 admin admin] Validating token access rules against request {{(pid=71938) validate_allowed_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 24 16:32:19.886520 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20d79e82-3d67-43c6-aa40-c0d88f0344d3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f2ba2e8375b4e8c8792ee1e22b60427', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '00a5583c7b7443e98e7a1d31a0b638dc', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=71938) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 24 16:32:19.887167 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20d79e82-3d67-43c6-aa40-c0d88f0344d3 admin admin] REQUEST_METHOD: `GET` {{(pid=71938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 24 16:32:19.887506 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20d79e82-3d67-43c6-aa40-c0d88f0344d3 admin admin] SCRIPT_NAME: `/identity` {{(pid=71938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 24 16:32:19.887831 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20d79e82-3d67-43c6-aa40-c0d88f0344d3 admin admin] PATH_INFO: `/v3/projects` {{(pid=71938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 24 16:32:19.888664 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20d79e82-3d67-43c6-aa40-c0d88f0344d3 admin admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=71938) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:161}} Nov 24 16:32:19.889014 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20d79e82-3d67-43c6-aa40-c0d88f0344d3 admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=71938) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:442}} Nov 24 16:32:19.917892 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20d79e82-3d67-43c6-aa40-c0d88f0344d3 admin admin] RBAC: Authorization granted {{(pid=71938) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 24 16:32:19.931190 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: [pid: 71938|app: 0|req: 361/721] 10.222.0.53 () {56 vars in 1160 bytes} [Wed Nov 24 16:32:19 2021] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 59 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 24 16:32:19.936974 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce5b45e3-eb62-417c-940b-b4ff1a4c40b9 admin admin] Authenticating user token {{(pid=71939) process_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 24 16:32:19.946953 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce5b45e3-eb62-417c-940b-b4ff1a4c40b9 admin admin] Validating token access rules against request {{(pid=71939) validate_allowed_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 24 16:32:19.951092 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a65fd81-03e6-4de7-b718-9e21bbedd5f2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f2ba2e8375b4e8c8792ee1e22b60427', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '00a5583c7b7443e98e7a1d31a0b638dc', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=71939) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 24 16:32:19.951963 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a65fd81-03e6-4de7-b718-9e21bbedd5f2 admin admin] REQUEST_METHOD: `PUT` {{(pid=71939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 24 16:32:19.952552 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a65fd81-03e6-4de7-b718-9e21bbedd5f2 admin admin] SCRIPT_NAME: `/identity` {{(pid=71939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 24 16:32:19.952876 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a65fd81-03e6-4de7-b718-9e21bbedd5f2 admin admin] PATH_INFO: `/v3/projects/3b3940d4ae1c4177ae29c02377bb4b0b/users/f8a135ac0e4744a98258dc7f6c12e741/roles/27a0b92630d549249a3beada0d8379f5` {{(pid=71939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 24 16:32:19.955599 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a65fd81-03e6-4de7-b718-9e21bbedd5f2 admin admin] RBAC: Authorizing `identity:create_grant(project_id=3b3940d4ae1c4177ae29c02377bb4b0b, user_id=f8a135ac0e4744a98258dc7f6c12e741, role_id=27a0b92630d549249a3beada0d8379f5)` {{(pid=71939) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:442}} Nov 24 16:32:19.984817 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a65fd81-03e6-4de7-b718-9e21bbedd5f2 admin admin] RBAC: Authorization granted {{(pid=71939) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 24 16:32:19.995990 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: [pid: 71939|app: 0|req: 361/722] 10.222.0.53 () {58 vars in 1451 bytes} [Wed Nov 24 16:32:19 2021] PUT /identity/v3/projects/3b3940d4ae1c4177ae29c02377bb4b0b/users/f8a135ac0e4744a98258dc7f6c12e741/roles/27a0b92630d549249a3beada0d8379f5 => generated 0 bytes in 59 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 24 16:32:21.941482 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39673d7d-bcf7-48c4-a51f-7f980971345d None None] REQUEST_METHOD: `GET` {{(pid=71938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 24 16:32:21.942105 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39673d7d-bcf7-48c4-a51f-7f980971345d None None] SCRIPT_NAME: `/identity` {{(pid=71938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 24 16:32:21.942216 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39673d7d-bcf7-48c4-a51f-7f980971345d None None] PATH_INFO: `/` {{(pid=71938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 24 16:32:21.944045 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: [pid: 71938|app: 0|req: 362/723] 10.222.0.53 () {54 vars in 915 bytes} [Wed Nov 24 16:32:21 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 24 16:32:21.949534 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d253f3f0-92ee-45b4-a96a-58891ffd6607 None None] REQUEST_METHOD: `POST` {{(pid=71939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 24 16:32:21.949888 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d253f3f0-92ee-45b4-a96a-58891ffd6607 None None] SCRIPT_NAME: `/identity` {{(pid=71939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 24 16:32:21.950258 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d253f3f0-92ee-45b4-a96a-58891ffd6607 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=71939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 24 16:32:21.976752 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.auth.core [None req-d253f3f0-92ee-45b4-a96a-58891ffd6607 None None] MFA Rules not processed for user `0f2ba2e8375b4e8c8792ee1e22b60427`. Rule list: `[]` (Enabled: `True`). {{(pid=71939) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:442}} Nov 24 16:32:21.978060 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.fernet_utils [None req-d253f3f0-92ee-45b4-a96a-58891ffd6607 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=71939) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:289}} Nov 24 16:32:22.045249 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: [pid: 71939|app: 0|req: 362/724] 10.222.0.53 () {58 vars in 1013 bytes} [Wed Nov 24 16:32:21 2021] POST /identity/v3/auth/tokens => generated 1616 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 24 16:32:22.067966 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-686a5276-665f-4361-8e3a-2b4a321e1e94 None None] REQUEST_METHOD: `POST` {{(pid=71938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 24 16:32:22.068313 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-686a5276-665f-4361-8e3a-2b4a321e1e94 None None] SCRIPT_NAME: `/identity` {{(pid=71938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 24 16:32:22.068646 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-686a5276-665f-4361-8e3a-2b4a321e1e94 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=71938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 24 16:32:22.091439 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.auth.core [None req-686a5276-665f-4361-8e3a-2b4a321e1e94 None None] MFA Rules not processed for user `0f2ba2e8375b4e8c8792ee1e22b60427`. Rule list: `[]` (Enabled: `True`). {{(pid=71938) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:442}} Nov 24 16:32:22.092646 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.fernet_utils [None req-686a5276-665f-4361-8e3a-2b4a321e1e94 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=71938) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:289}} Nov 24 16:32:22.100108 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: [pid: 71938|app: 0|req: 363/725] 10.222.0.53 () {58 vars in 1013 bytes} [Wed Nov 24 16:32:22 2021] POST /identity/v3/auth/tokens => generated 1616 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 24 16:32:22.105698 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d253f3f0-92ee-45b4-a96a-58891ffd6607 None None] Authenticating user token {{(pid=71939) process_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 24 16:32:22.115764 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d253f3f0-92ee-45b4-a96a-58891ffd6607 None None] Validating token access rules against request {{(pid=71939) validate_allowed_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 24 16:32:22.120126 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d825a135-660e-4eac-983e-857a4bc47a22 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f2ba2e8375b4e8c8792ee1e22b60427', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '00a5583c7b7443e98e7a1d31a0b638dc', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=71939) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 24 16:32:22.120943 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d825a135-660e-4eac-983e-857a4bc47a22 admin admin] REQUEST_METHOD: `GET` {{(pid=71939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 24 16:32:22.121283 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d825a135-660e-4eac-983e-857a4bc47a22 admin admin] SCRIPT_NAME: `/identity` {{(pid=71939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 24 16:32:22.121615 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d825a135-660e-4eac-983e-857a4bc47a22 admin admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=71939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 24 16:32:22.133216 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d825a135-660e-4eac-983e-857a4bc47a22 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=71939) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:401}} Nov 24 16:32:22.141005 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: WARNING keystone.server.flask.application [None req-d825a135-660e-4eac-983e-857a4bc47a22 admin admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Nov 24 16:32:22.142181 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: [pid: 71939|app: 0|req: 363/726] 10.222.0.53 () {56 vars in 1132 bytes} [Wed Nov 24 16:32:22 2021] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 37 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 24 16:32:22.148520 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-686a5276-665f-4361-8e3a-2b4a321e1e94 None None] Authenticating user token {{(pid=71938) process_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 24 16:32:22.158014 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-686a5276-665f-4361-8e3a-2b4a321e1e94 None None] Validating token access rules against request {{(pid=71938) validate_allowed_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 24 16:32:22.162256 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3eddb42-f400-4de2-b1dc-0a2d3bc9c960 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f2ba2e8375b4e8c8792ee1e22b60427', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '00a5583c7b7443e98e7a1d31a0b638dc', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=71938) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 24 16:32:22.162916 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3eddb42-f400-4de2-b1dc-0a2d3bc9c960 admin admin] REQUEST_METHOD: `GET` {{(pid=71938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 24 16:32:22.163252 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3eddb42-f400-4de2-b1dc-0a2d3bc9c960 admin admin] SCRIPT_NAME: `/identity` {{(pid=71938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 24 16:32:22.163580 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3eddb42-f400-4de2-b1dc-0a2d3bc9c960 admin admin] PATH_INFO: `/v3/roles` {{(pid=71938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 24 16:32:22.164376 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3eddb42-f400-4de2-b1dc-0a2d3bc9c960 admin admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=71938) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:161}} Nov 24 16:32:22.164722 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3eddb42-f400-4de2-b1dc-0a2d3bc9c960 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=71938) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:442}} Nov 24 16:32:22.195016 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3eddb42-f400-4de2-b1dc-0a2d3bc9c960 admin admin] RBAC: Authorization granted {{(pid=71938) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 24 16:32:22.204528 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: [pid: 71938|app: 0|req: 364/727] 10.222.0.53 () {56 vars in 1127 bytes} [Wed Nov 24 16:32:22 2021] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 56 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 24 16:32:22.210694 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d825a135-660e-4eac-983e-857a4bc47a22 admin admin] Authenticating user token {{(pid=71939) process_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 24 16:32:22.221727 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d825a135-660e-4eac-983e-857a4bc47a22 admin admin] Validating token access rules against request {{(pid=71939) validate_allowed_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 24 16:32:22.225958 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9e92fc0-e576-4de6-8df8-a310957e3681 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f2ba2e8375b4e8c8792ee1e22b60427', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '00a5583c7b7443e98e7a1d31a0b638dc', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=71939) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 24 16:32:22.226776 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9e92fc0-e576-4de6-8df8-a310957e3681 admin admin] REQUEST_METHOD: `GET` {{(pid=71939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 24 16:32:22.227112 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9e92fc0-e576-4de6-8df8-a310957e3681 admin admin] SCRIPT_NAME: `/identity` {{(pid=71939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 24 16:32:22.227437 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9e92fc0-e576-4de6-8df8-a310957e3681 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=71939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 24 16:32:22.239662 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9e92fc0-e576-4de6-8df8-a310957e3681 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=71939) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:442}} Nov 24 16:32:22.267566 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9e92fc0-e576-4de6-8df8-a310957e3681 admin admin] RBAC: Authorization granted {{(pid=71939) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 24 16:32:22.287086 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: WARNING keystone.server.flask.application [None req-b9e92fc0-e576-4de6-8df8-a310957e3681 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Nov 24 16:32:22.288300 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: [pid: 71939|app: 0|req: 364/728] 10.222.0.53 () {56 vars in 1120 bytes} [Wed Nov 24 16:32:22 2021] GET /identity/v3/domains/Default => generated 87 bytes in 78 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Nov 24 16:32:22.294359 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3eddb42-f400-4de2-b1dc-0a2d3bc9c960 admin admin] Authenticating user token {{(pid=71938) process_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 24 16:32:22.304854 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3eddb42-f400-4de2-b1dc-0a2d3bc9c960 admin admin] Validating token access rules against request {{(pid=71938) validate_allowed_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 24 16:32:22.309147 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1242af02-cf90-4e82-b763-2af4b2e27924 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f2ba2e8375b4e8c8792ee1e22b60427', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '00a5583c7b7443e98e7a1d31a0b638dc', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=71938) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 24 16:32:22.309811 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1242af02-cf90-4e82-b763-2af4b2e27924 admin admin] REQUEST_METHOD: `GET` {{(pid=71938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 24 16:32:22.310179 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1242af02-cf90-4e82-b763-2af4b2e27924 admin admin] SCRIPT_NAME: `/identity` {{(pid=71938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 24 16:32:22.310516 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1242af02-cf90-4e82-b763-2af4b2e27924 admin admin] PATH_INFO: `/v3/domains` {{(pid=71938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 24 16:32:22.311298 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1242af02-cf90-4e82-b763-2af4b2e27924 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=71938) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:161}} Nov 24 16:32:22.311653 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1242af02-cf90-4e82-b763-2af4b2e27924 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=71938) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:442}} Nov 24 16:32:22.341190 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1242af02-cf90-4e82-b763-2af4b2e27924 admin admin] RBAC: Authorization granted {{(pid=71938) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 24 16:32:22.355452 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: [pid: 71938|app: 0|req: 365/729] 10.222.0.53 () {56 vars in 1121 bytes} [Wed Nov 24 16:32:22 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 62 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 24 16:32:22.361243 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9e92fc0-e576-4de6-8df8-a310957e3681 admin admin] Authenticating user token {{(pid=71939) process_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 24 16:32:22.370910 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9e92fc0-e576-4de6-8df8-a310957e3681 admin admin] Validating token access rules against request {{(pid=71939) validate_allowed_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 24 16:32:22.375108 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0725b97-7924-4536-83db-dd876febfeb1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f2ba2e8375b4e8c8792ee1e22b60427', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '00a5583c7b7443e98e7a1d31a0b638dc', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=71939) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 24 16:32:22.375918 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0725b97-7924-4536-83db-dd876febfeb1 admin admin] REQUEST_METHOD: `GET` {{(pid=71939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 24 16:32:22.376253 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0725b97-7924-4536-83db-dd876febfeb1 admin admin] SCRIPT_NAME: `/identity` {{(pid=71939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 24 16:32:22.376582 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0725b97-7924-4536-83db-dd876febfeb1 admin admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=71939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 24 16:32:22.389799 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0725b97-7924-4536-83db-dd876febfeb1 admin admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=71939) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:442}} Nov 24 16:32:22.419118 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0725b97-7924-4536-83db-dd876febfeb1 admin admin] RBAC: Authorization granted {{(pid=71939) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 24 16:32:22.438655 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: WARNING keystone.server.flask.application [None req-f0725b97-7924-4536-83db-dd876febfeb1 admin admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Nov 24 16:32:22.439807 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: [pid: 71939|app: 0|req: 365/730] 10.222.0.53 () {56 vars in 1129 bytes} [Wed Nov 24 16:32:22 2021] GET /identity/v3/users/glance-swift => generated 90 bytes in 79 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 24 16:32:22.445746 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1242af02-cf90-4e82-b763-2af4b2e27924 admin admin] Authenticating user token {{(pid=71938) process_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 24 16:32:22.456410 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1242af02-cf90-4e82-b763-2af4b2e27924 admin admin] Validating token access rules against request {{(pid=71938) validate_allowed_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 24 16:32:22.460850 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef0a0c12-5dcf-4315-8dfe-3e85470718dd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f2ba2e8375b4e8c8792ee1e22b60427', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '00a5583c7b7443e98e7a1d31a0b638dc', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=71938) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 24 16:32:22.461532 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef0a0c12-5dcf-4315-8dfe-3e85470718dd admin admin] REQUEST_METHOD: `GET` {{(pid=71938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 24 16:32:22.461872 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef0a0c12-5dcf-4315-8dfe-3e85470718dd admin admin] SCRIPT_NAME: `/identity` {{(pid=71938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 24 16:32:22.462252 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef0a0c12-5dcf-4315-8dfe-3e85470718dd admin admin] PATH_INFO: `/v3/users` {{(pid=71938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 24 16:32:22.463155 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef0a0c12-5dcf-4315-8dfe-3e85470718dd admin admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=71938) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:161}} Nov 24 16:32:22.463512 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef0a0c12-5dcf-4315-8dfe-3e85470718dd admin admin] RBAC: Authorizing `identity:list_users()` {{(pid=71938) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:442}} Nov 24 16:32:22.492512 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef0a0c12-5dcf-4315-8dfe-3e85470718dd admin admin] RBAC: Authorization granted {{(pid=71938) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 24 16:32:22.523440 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: [pid: 71938|app: 0|req: 366/731] 10.222.0.53 () {56 vars in 1161 bytes} [Wed Nov 24 16:32:22 2021] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 78 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 24 16:32:22.529222 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0725b97-7924-4536-83db-dd876febfeb1 admin admin] Authenticating user token {{(pid=71939) process_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 24 16:32:22.539519 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0725b97-7924-4536-83db-dd876febfeb1 admin admin] Validating token access rules against request {{(pid=71939) validate_allowed_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 24 16:32:22.544004 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d19be646-e648-41d1-91d1-c7be357c9c88 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f2ba2e8375b4e8c8792ee1e22b60427', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '00a5583c7b7443e98e7a1d31a0b638dc', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=71939) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 24 16:32:22.544643 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d19be646-e648-41d1-91d1-c7be357c9c88 admin admin] REQUEST_METHOD: `GET` {{(pid=71939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 24 16:32:22.544977 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d19be646-e648-41d1-91d1-c7be357c9c88 admin admin] SCRIPT_NAME: `/identity` {{(pid=71939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 24 16:32:22.545305 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d19be646-e648-41d1-91d1-c7be357c9c88 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=71939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 24 16:32:22.553357 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d19be646-e648-41d1-91d1-c7be357c9c88 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=71939) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:442}} Nov 24 16:32:22.582103 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d19be646-e648-41d1-91d1-c7be357c9c88 admin admin] RBAC: Authorization granted {{(pid=71939) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 24 16:32:22.591114 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: [pid: 71939|app: 0|req: 366/732] 10.222.0.53 () {58 vars in 1315 bytes} [Wed Nov 24 16:32:22 2021] GET /identity/v3/auth/tokens => generated 1616 bytes in 62 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 24 16:32:22.597574 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef0a0c12-5dcf-4315-8dfe-3e85470718dd admin admin] Authenticating user token {{(pid=71938) process_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 24 16:32:22.607258 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef0a0c12-5dcf-4315-8dfe-3e85470718dd admin admin] Validating token access rules against request {{(pid=71938) validate_allowed_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 24 16:32:22.611482 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70ab30e5-ceae-4cba-8a5c-0b860f442dcf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f2ba2e8375b4e8c8792ee1e22b60427', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '00a5583c7b7443e98e7a1d31a0b638dc', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=71938) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 24 16:32:22.612285 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70ab30e5-ceae-4cba-8a5c-0b860f442dcf admin admin] REQUEST_METHOD: `GET` {{(pid=71938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 24 16:32:22.612617 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70ab30e5-ceae-4cba-8a5c-0b860f442dcf admin admin] SCRIPT_NAME: `/identity` {{(pid=71938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 24 16:32:22.612941 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70ab30e5-ceae-4cba-8a5c-0b860f442dcf admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=71938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 24 16:32:22.625040 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70ab30e5-ceae-4cba-8a5c-0b860f442dcf admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=71938) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:442}} Nov 24 16:32:22.653695 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70ab30e5-ceae-4cba-8a5c-0b860f442dcf admin admin] RBAC: Authorization granted {{(pid=71938) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 24 16:32:22.672723 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: WARNING keystone.server.flask.application [None req-70ab30e5-ceae-4cba-8a5c-0b860f442dcf admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Nov 24 16:32:22.673890 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: [pid: 71938|app: 0|req: 367/733] 10.222.0.53 () {56 vars in 1120 bytes} [Wed Nov 24 16:32:22 2021] GET /identity/v3/domains/Default => generated 87 bytes in 77 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 24 16:32:22.679612 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d19be646-e648-41d1-91d1-c7be357c9c88 admin admin] Authenticating user token {{(pid=71939) process_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 24 16:32:22.689148 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d19be646-e648-41d1-91d1-c7be357c9c88 admin admin] Validating token access rules against request {{(pid=71939) validate_allowed_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 24 16:32:22.693425 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-276acb2f-9839-4b84-85df-112f04837a52 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f2ba2e8375b4e8c8792ee1e22b60427', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '00a5583c7b7443e98e7a1d31a0b638dc', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=71939) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 24 16:32:22.694119 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-276acb2f-9839-4b84-85df-112f04837a52 admin admin] REQUEST_METHOD: `GET` {{(pid=71939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 24 16:32:22.694461 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-276acb2f-9839-4b84-85df-112f04837a52 admin admin] SCRIPT_NAME: `/identity` {{(pid=71939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 24 16:32:22.694801 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-276acb2f-9839-4b84-85df-112f04837a52 admin admin] PATH_INFO: `/v3/domains` {{(pid=71939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 24 16:32:22.695581 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-276acb2f-9839-4b84-85df-112f04837a52 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=71939) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:161}} Nov 24 16:32:22.695975 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-276acb2f-9839-4b84-85df-112f04837a52 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=71939) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:442}} Nov 24 16:32:22.724587 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-276acb2f-9839-4b84-85df-112f04837a52 admin admin] RBAC: Authorization granted {{(pid=71939) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 24 16:32:22.738113 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: [pid: 71939|app: 0|req: 367/734] 10.222.0.53 () {56 vars in 1121 bytes} [Wed Nov 24 16:32:22 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 59 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 24 16:32:22.743860 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70ab30e5-ceae-4cba-8a5c-0b860f442dcf admin admin] Authenticating user token {{(pid=71938) process_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 24 16:32:22.754151 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70ab30e5-ceae-4cba-8a5c-0b860f442dcf admin admin] Validating token access rules against request {{(pid=71938) validate_allowed_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 24 16:32:22.758295 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-319f25ff-466f-4883-b5b1-c966035c1e2c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f2ba2e8375b4e8c8792ee1e22b60427', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '00a5583c7b7443e98e7a1d31a0b638dc', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=71938) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 24 16:32:22.759090 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-319f25ff-466f-4883-b5b1-c966035c1e2c admin admin] REQUEST_METHOD: `GET` {{(pid=71938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 24 16:32:22.759424 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-319f25ff-466f-4883-b5b1-c966035c1e2c admin admin] SCRIPT_NAME: `/identity` {{(pid=71938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 24 16:32:22.759753 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-319f25ff-466f-4883-b5b1-c966035c1e2c admin admin] PATH_INFO: `/v3/projects/service` {{(pid=71938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 24 16:32:22.769371 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-319f25ff-466f-4883-b5b1-c966035c1e2c admin admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=71938) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:442}} Nov 24 16:32:22.797497 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-319f25ff-466f-4883-b5b1-c966035c1e2c admin admin] RBAC: Authorization granted {{(pid=71938) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 24 16:32:22.812152 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: WARNING keystone.server.flask.application [None req-319f25ff-466f-4883-b5b1-c966035c1e2c admin admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Nov 24 16:32:22.813804 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: [pid: 71938|app: 0|req: 368/735] 10.222.0.53 () {56 vars in 1123 bytes} [Wed Nov 24 16:32:22 2021] GET /identity/v3/projects/service => generated 88 bytes in 70 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 24 16:32:22.819641 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-276acb2f-9839-4b84-85df-112f04837a52 admin admin] Authenticating user token {{(pid=71939) process_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 24 16:32:22.830247 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-276acb2f-9839-4b84-85df-112f04837a52 admin admin] Validating token access rules against request {{(pid=71939) validate_allowed_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 24 16:32:22.834516 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4303a05c-d98b-4077-b0d3-3159e1b82f0f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f2ba2e8375b4e8c8792ee1e22b60427', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '00a5583c7b7443e98e7a1d31a0b638dc', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=71939) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 24 16:32:22.835173 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4303a05c-d98b-4077-b0d3-3159e1b82f0f admin admin] REQUEST_METHOD: `GET` {{(pid=71939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 24 16:32:22.835516 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4303a05c-d98b-4077-b0d3-3159e1b82f0f admin admin] SCRIPT_NAME: `/identity` {{(pid=71939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 24 16:32:22.835850 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4303a05c-d98b-4077-b0d3-3159e1b82f0f admin admin] PATH_INFO: `/v3/projects` {{(pid=71939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 24 16:32:22.836693 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4303a05c-d98b-4077-b0d3-3159e1b82f0f admin admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=71939) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:161}} Nov 24 16:32:22.837048 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4303a05c-d98b-4077-b0d3-3159e1b82f0f admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=71939) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:442}} Nov 24 16:32:22.875938 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4303a05c-d98b-4077-b0d3-3159e1b82f0f admin admin] RBAC: Authorization granted {{(pid=71939) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 24 16:32:22.890274 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: [pid: 71939|app: 0|req: 368/736] 10.222.0.53 () {56 vars in 1160 bytes} [Wed Nov 24 16:32:22 2021] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 71 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 24 16:32:22.897058 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-319f25ff-466f-4883-b5b1-c966035c1e2c admin admin] Authenticating user token {{(pid=71938) process_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 24 16:32:22.907068 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-319f25ff-466f-4883-b5b1-c966035c1e2c admin admin] Validating token access rules against request {{(pid=71938) validate_allowed_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 24 16:32:22.911360 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4291fc24-b1eb-456d-afd2-594ce6a8f142 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f2ba2e8375b4e8c8792ee1e22b60427', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '00a5583c7b7443e98e7a1d31a0b638dc', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=71938) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 24 16:32:22.912012 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4291fc24-b1eb-456d-afd2-594ce6a8f142 admin admin] REQUEST_METHOD: `GET` {{(pid=71938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 24 16:32:22.912349 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4291fc24-b1eb-456d-afd2-594ce6a8f142 admin admin] SCRIPT_NAME: `/identity` {{(pid=71938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 24 16:32:22.912684 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4291fc24-b1eb-456d-afd2-594ce6a8f142 admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=71938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 24 16:32:22.913563 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4291fc24-b1eb-456d-afd2-594ce6a8f142 admin admin] RBAC: Adding query filter params (role.id=27a0b92630d549249a3beada0d8379f5, scope.project.id=3b3940d4ae1c4177ae29c02377bb4b0b, user.id=f8a135ac0e4744a98258dc7f6c12e741) {{(pid=71938) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:161}} Nov 24 16:32:22.913923 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4291fc24-b1eb-456d-afd2-594ce6a8f142 admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=71938) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:442}} Nov 24 16:32:22.942944 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4291fc24-b1eb-456d-afd2-594ce6a8f142 admin admin] RBAC: Authorization granted {{(pid=71938) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 24 16:32:22.949206 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: [pid: 71938|app: 0|req: 369/737] 10.222.0.53 () {56 vars in 1386 bytes} [Wed Nov 24 16:32:22 2021] GET /identity/v3/role_assignments?user.id=f8a135ac0e4744a98258dc7f6c12e741&scope.project.id=3b3940d4ae1c4177ae29c02377bb4b0b&role.id=27a0b92630d549249a3beada0d8379f5 => generated 608 bytes in 53 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 24 16:32:24.942627 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac9372a9-a1a6-4123-9783-be49d570f435 None None] REQUEST_METHOD: `GET` {{(pid=71939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 24 16:32:24.943150 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac9372a9-a1a6-4123-9783-be49d570f435 None None] SCRIPT_NAME: `/identity` {{(pid=71939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 24 16:32:24.943296 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac9372a9-a1a6-4123-9783-be49d570f435 None None] PATH_INFO: `/` {{(pid=71939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 24 16:32:24.945142 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: [pid: 71939|app: 0|req: 369/738] 10.222.0.53 () {54 vars in 915 bytes} [Wed Nov 24 16:32:24 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 24 16:32:24.950671 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f8d3d52-a713-4a04-856d-2ff2f63e109c None None] REQUEST_METHOD: `POST` {{(pid=71938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 24 16:32:24.951016 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f8d3d52-a713-4a04-856d-2ff2f63e109c None None] SCRIPT_NAME: `/identity` {{(pid=71938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 24 16:32:24.951350 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f8d3d52-a713-4a04-856d-2ff2f63e109c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=71938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 24 16:32:24.975523 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.auth.core [None req-3f8d3d52-a713-4a04-856d-2ff2f63e109c None None] MFA Rules not processed for user `0f2ba2e8375b4e8c8792ee1e22b60427`. Rule list: `[]` (Enabled: `True`). {{(pid=71938) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:442}} Nov 24 16:32:24.976722 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.fernet_utils [None req-3f8d3d52-a713-4a04-856d-2ff2f63e109c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=71938) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:289}} Nov 24 16:32:24.983696 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: [pid: 71938|app: 0|req: 370/739] 10.222.0.53 () {58 vars in 1013 bytes} [Wed Nov 24 16:32:24 2021] POST /identity/v3/auth/tokens => generated 1616 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 24 16:32:25.005361 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-100cee10-80b9-4e13-9964-4c00e2b46835 None None] REQUEST_METHOD: `POST` {{(pid=71939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 24 16:32:25.005710 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-100cee10-80b9-4e13-9964-4c00e2b46835 None None] SCRIPT_NAME: `/identity` {{(pid=71939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 24 16:32:25.006056 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-100cee10-80b9-4e13-9964-4c00e2b46835 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=71939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 24 16:32:25.028702 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.auth.core [None req-100cee10-80b9-4e13-9964-4c00e2b46835 None None] MFA Rules not processed for user `0f2ba2e8375b4e8c8792ee1e22b60427`. Rule list: `[]` (Enabled: `True`). {{(pid=71939) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:442}} Nov 24 16:32:25.029905 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.fernet_utils [None req-100cee10-80b9-4e13-9964-4c00e2b46835 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=71939) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:289}} Nov 24 16:32:25.037473 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: [pid: 71939|app: 0|req: 370/740] 10.222.0.53 () {58 vars in 1013 bytes} [Wed Nov 24 16:32:25 2021] POST /identity/v3/auth/tokens => generated 1616 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 24 16:32:25.042885 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f8d3d52-a713-4a04-856d-2ff2f63e109c None None] Authenticating user token {{(pid=71938) process_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 24 16:32:25.053914 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f8d3d52-a713-4a04-856d-2ff2f63e109c None None] Validating token access rules against request {{(pid=71938) validate_allowed_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 24 16:32:25.058178 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-150f5fcb-e6a5-4b33-ab8d-b9517ecbae90 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f2ba2e8375b4e8c8792ee1e22b60427', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '00a5583c7b7443e98e7a1d31a0b638dc', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=71938) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 24 16:32:25.058982 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-150f5fcb-e6a5-4b33-ab8d-b9517ecbae90 admin admin] REQUEST_METHOD: `GET` {{(pid=71938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 24 16:32:25.059358 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-150f5fcb-e6a5-4b33-ab8d-b9517ecbae90 admin admin] SCRIPT_NAME: `/identity` {{(pid=71938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 24 16:32:25.059688 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-150f5fcb-e6a5-4b33-ab8d-b9517ecbae90 admin admin] PATH_INFO: `/v3/services/image` {{(pid=71938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 24 16:32:25.060435 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-150f5fcb-e6a5-4b33-ab8d-b9517ecbae90 admin admin] RBAC: Authorizing `identity:get_service(service_id=image)` {{(pid=71938) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:442}} Nov 24 16:32:25.088633 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-150f5fcb-e6a5-4b33-ab8d-b9517ecbae90 admin admin] RBAC: Authorization granted {{(pid=71938) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 24 16:32:25.100398 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: WARNING keystone.server.flask.application [None req-150f5fcb-e6a5-4b33-ab8d-b9517ecbae90 admin admin] Could not find service: image.: keystone.exception.ServiceNotFound: Could not find service: image. Nov 24 16:32:25.101546 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: [pid: 71938|app: 0|req: 371/741] 10.222.0.53 () {56 vars in 1117 bytes} [Wed Nov 24 16:32:25 2021] GET /identity/v3/services/image => generated 86 bytes in 59 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 24 16:32:25.108124 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-100cee10-80b9-4e13-9964-4c00e2b46835 None None] Authenticating user token {{(pid=71939) process_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 24 16:32:25.117991 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-100cee10-80b9-4e13-9964-4c00e2b46835 None None] Validating token access rules against request {{(pid=71939) validate_allowed_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 24 16:32:25.122317 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f30f1142-58f0-46a5-b63c-443bc512cbf0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f2ba2e8375b4e8c8792ee1e22b60427', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '00a5583c7b7443e98e7a1d31a0b638dc', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=71939) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 24 16:32:25.122983 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f30f1142-58f0-46a5-b63c-443bc512cbf0 admin admin] REQUEST_METHOD: `GET` {{(pid=71939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 24 16:32:25.123324 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f30f1142-58f0-46a5-b63c-443bc512cbf0 admin admin] SCRIPT_NAME: `/identity` {{(pid=71939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 24 16:32:25.123658 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f30f1142-58f0-46a5-b63c-443bc512cbf0 admin admin] PATH_INFO: `/v3/services` {{(pid=71939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 24 16:32:25.124471 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f30f1142-58f0-46a5-b63c-443bc512cbf0 admin admin] RBAC: Adding query filter params (name=image) {{(pid=71939) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:161}} Nov 24 16:32:25.124826 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f30f1142-58f0-46a5-b63c-443bc512cbf0 admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=71939) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:442}} Nov 24 16:32:25.152698 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f30f1142-58f0-46a5-b63c-443bc512cbf0 admin admin] RBAC: Authorization granted {{(pid=71939) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 24 16:32:25.158400 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: [pid: 71939|app: 0|req: 371/742] 10.222.0.53 () {56 vars in 1120 bytes} [Wed Nov 24 16:32:25 2021] GET /identity/v3/services?name=image => generated 122 bytes in 51 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 24 16:32:25.164115 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-150f5fcb-e6a5-4b33-ab8d-b9517ecbae90 admin admin] Authenticating user token {{(pid=71938) process_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 24 16:32:25.174660 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-150f5fcb-e6a5-4b33-ab8d-b9517ecbae90 admin admin] Validating token access rules against request {{(pid=71938) validate_allowed_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 24 16:32:25.178946 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7647b64b-8884-4952-b605-ec6c1ac5d652 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f2ba2e8375b4e8c8792ee1e22b60427', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '00a5583c7b7443e98e7a1d31a0b638dc', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=71938) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 24 16:32:25.179608 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7647b64b-8884-4952-b605-ec6c1ac5d652 admin admin] REQUEST_METHOD: `GET` {{(pid=71938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 24 16:32:25.179948 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7647b64b-8884-4952-b605-ec6c1ac5d652 admin admin] SCRIPT_NAME: `/identity` {{(pid=71938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 24 16:32:25.180283 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7647b64b-8884-4952-b605-ec6c1ac5d652 admin admin] PATH_INFO: `/v3/services` {{(pid=71938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 24 16:32:25.181050 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7647b64b-8884-4952-b605-ec6c1ac5d652 admin admin] RBAC: Adding query filter params (type=image) {{(pid=71938) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:161}} Nov 24 16:32:25.181404 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7647b64b-8884-4952-b605-ec6c1ac5d652 admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=71938) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:442}} Nov 24 16:32:25.210460 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7647b64b-8884-4952-b605-ec6c1ac5d652 admin admin] RBAC: Authorization granted {{(pid=71938) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 24 16:32:25.215356 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: [pid: 71938|app: 0|req: 372/743] 10.222.0.53 () {56 vars in 1120 bytes} [Wed Nov 24 16:32:25 2021] GET /identity/v3/services?type=image => generated 122 bytes in 52 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 24 16:32:27.168200 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfef111a-d182-4508-8661-e2e98769f930 None None] REQUEST_METHOD: `GET` {{(pid=71939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 24 16:32:27.168750 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfef111a-d182-4508-8661-e2e98769f930 None None] SCRIPT_NAME: `/identity` {{(pid=71939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 24 16:32:27.168840 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfef111a-d182-4508-8661-e2e98769f930 None None] PATH_INFO: `/` {{(pid=71939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 24 16:32:27.170745 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: [pid: 71939|app: 0|req: 372/744] 10.222.0.53 () {54 vars in 915 bytes} [Wed Nov 24 16:32:27 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 24 16:32:27.176664 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21a0bdf0-8c76-405e-83f3-91b250ee0c84 None None] REQUEST_METHOD: `POST` {{(pid=71938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 24 16:32:27.177014 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21a0bdf0-8c76-405e-83f3-91b250ee0c84 None None] SCRIPT_NAME: `/identity` {{(pid=71938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 24 16:32:27.177353 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21a0bdf0-8c76-405e-83f3-91b250ee0c84 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=71938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 24 16:32:27.201641 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.auth.core [None req-21a0bdf0-8c76-405e-83f3-91b250ee0c84 None None] MFA Rules not processed for user `0f2ba2e8375b4e8c8792ee1e22b60427`. Rule list: `[]` (Enabled: `True`). {{(pid=71938) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:442}} Nov 24 16:32:27.203734 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.fernet_utils [None req-21a0bdf0-8c76-405e-83f3-91b250ee0c84 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=71938) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:289}} Nov 24 16:32:27.211128 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: [pid: 71938|app: 0|req: 373/745] 10.222.0.53 () {58 vars in 1013 bytes} [Wed Nov 24 16:32:27 2021] POST /identity/v3/auth/tokens => generated 1616 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 24 16:32:27.233122 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1216f928-811e-4264-aab9-cc82ee46eafb None None] REQUEST_METHOD: `POST` {{(pid=71939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 24 16:32:27.233470 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1216f928-811e-4264-aab9-cc82ee46eafb None None] SCRIPT_NAME: `/identity` {{(pid=71939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 24 16:32:27.233808 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1216f928-811e-4264-aab9-cc82ee46eafb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=71939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 24 16:32:27.257283 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.auth.core [None req-1216f928-811e-4264-aab9-cc82ee46eafb None None] MFA Rules not processed for user `0f2ba2e8375b4e8c8792ee1e22b60427`. Rule list: `[]` (Enabled: `True`). {{(pid=71939) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:442}} Nov 24 16:32:27.258516 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.fernet_utils [None req-1216f928-811e-4264-aab9-cc82ee46eafb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=71939) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:289}} Nov 24 16:32:27.266165 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: [pid: 71939|app: 0|req: 373/746] 10.222.0.53 () {58 vars in 1013 bytes} [Wed Nov 24 16:32:27 2021] POST /identity/v3/auth/tokens => generated 1616 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 24 16:32:27.271755 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21a0bdf0-8c76-405e-83f3-91b250ee0c84 None None] Authenticating user token {{(pid=71938) process_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 24 16:32:27.281372 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21a0bdf0-8c76-405e-83f3-91b250ee0c84 None None] Validating token access rules against request {{(pid=71938) validate_allowed_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 24 16:32:27.285550 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4475ad59-3ba3-4188-b3a9-cfe86dba1e13 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f2ba2e8375b4e8c8792ee1e22b60427', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '00a5583c7b7443e98e7a1d31a0b638dc', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=71938) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 24 16:32:27.286245 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4475ad59-3ba3-4188-b3a9-cfe86dba1e13 admin admin] REQUEST_METHOD: `POST` {{(pid=71938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 24 16:32:27.286583 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4475ad59-3ba3-4188-b3a9-cfe86dba1e13 admin admin] SCRIPT_NAME: `/identity` {{(pid=71938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 24 16:32:27.286908 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4475ad59-3ba3-4188-b3a9-cfe86dba1e13 admin admin] PATH_INFO: `/v3/services` {{(pid=71938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 24 16:32:27.287667 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4475ad59-3ba3-4188-b3a9-cfe86dba1e13 admin admin] RBAC: Authorizing `identity:create_service()` {{(pid=71938) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:442}} Nov 24 16:32:27.316115 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4475ad59-3ba3-4188-b3a9-cfe86dba1e13 admin admin] RBAC: Authorization granted {{(pid=71938) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 24 16:32:27.329582 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: [pid: 71938|app: 0|req: 374/747] 10.222.0.53 () {60 vars in 1153 bytes} [Wed Nov 24 16:32:27 2021] POST /identity/v3/services => generated 242 bytes in 58 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 24 16:32:29.350525 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b0dc279-f4b2-43dd-b090-51df08527705 None None] REQUEST_METHOD: `GET` {{(pid=71939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 24 16:32:29.351037 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b0dc279-f4b2-43dd-b090-51df08527705 None None] SCRIPT_NAME: `/identity` {{(pid=71939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 24 16:32:29.351160 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b0dc279-f4b2-43dd-b090-51df08527705 None None] PATH_INFO: `/` {{(pid=71939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 24 16:32:29.352980 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: [pid: 71939|app: 0|req: 374/748] 10.222.0.53 () {54 vars in 915 bytes} [Wed Nov 24 16:32:29 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 24 16:32:29.358497 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d9c165e-106f-4d70-9fc1-b2ae5608854b None None] REQUEST_METHOD: `POST` {{(pid=71938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 24 16:32:29.358851 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d9c165e-106f-4d70-9fc1-b2ae5608854b None None] SCRIPT_NAME: `/identity` {{(pid=71938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 24 16:32:29.359191 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d9c165e-106f-4d70-9fc1-b2ae5608854b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=71938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 24 16:32:29.382512 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.auth.core [None req-5d9c165e-106f-4d70-9fc1-b2ae5608854b None None] MFA Rules not processed for user `0f2ba2e8375b4e8c8792ee1e22b60427`. Rule list: `[]` (Enabled: `True`). {{(pid=71938) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:442}} Nov 24 16:32:29.383729 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.fernet_utils [None req-5d9c165e-106f-4d70-9fc1-b2ae5608854b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=71938) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:289}} Nov 24 16:32:29.401662 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: [pid: 71938|app: 0|req: 375/749] 10.222.0.53 () {58 vars in 1013 bytes} [Wed Nov 24 16:32:29 2021] POST /identity/v3/auth/tokens => generated 1712 bytes in 44 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 24 16:32:29.423769 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94d65fcf-dbeb-423a-862f-d78a18b6a388 None None] REQUEST_METHOD: `POST` {{(pid=71939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 24 16:32:29.424113 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94d65fcf-dbeb-423a-862f-d78a18b6a388 None None] SCRIPT_NAME: `/identity` {{(pid=71939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 24 16:32:29.424446 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94d65fcf-dbeb-423a-862f-d78a18b6a388 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=71939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 24 16:32:29.447438 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.auth.core [None req-94d65fcf-dbeb-423a-862f-d78a18b6a388 None None] MFA Rules not processed for user `0f2ba2e8375b4e8c8792ee1e22b60427`. Rule list: `[]` (Enabled: `True`). {{(pid=71939) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:442}} Nov 24 16:32:29.448635 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.fernet_utils [None req-94d65fcf-dbeb-423a-862f-d78a18b6a388 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=71939) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:289}} Nov 24 16:32:29.456457 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: [pid: 71939|app: 0|req: 375/750] 10.222.0.53 () {58 vars in 1013 bytes} [Wed Nov 24 16:32:29 2021] POST /identity/v3/auth/tokens => generated 1712 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 24 16:32:29.461956 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d9c165e-106f-4d70-9fc1-b2ae5608854b None None] Authenticating user token {{(pid=71938) process_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 24 16:32:29.471544 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d9c165e-106f-4d70-9fc1-b2ae5608854b None None] Validating token access rules against request {{(pid=71938) validate_allowed_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 24 16:32:29.475713 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31e908bf-21a0-4aef-a1ca-d1a0380d6db4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f2ba2e8375b4e8c8792ee1e22b60427', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '00a5583c7b7443e98e7a1d31a0b638dc', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=71938) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 24 16:32:29.476519 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31e908bf-21a0-4aef-a1ca-d1a0380d6db4 admin admin] REQUEST_METHOD: `GET` {{(pid=71938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 24 16:32:29.476861 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31e908bf-21a0-4aef-a1ca-d1a0380d6db4 admin admin] SCRIPT_NAME: `/identity` {{(pid=71938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 24 16:32:29.477191 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31e908bf-21a0-4aef-a1ca-d1a0380d6db4 admin admin] PATH_INFO: `/v3/services/image` {{(pid=71938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 24 16:32:29.477898 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31e908bf-21a0-4aef-a1ca-d1a0380d6db4 admin admin] RBAC: Authorizing `identity:get_service(service_id=image)` {{(pid=71938) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:442}} Nov 24 16:32:29.506523 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31e908bf-21a0-4aef-a1ca-d1a0380d6db4 admin admin] RBAC: Authorization granted {{(pid=71938) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 24 16:32:29.518420 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: WARNING keystone.server.flask.application [None req-31e908bf-21a0-4aef-a1ca-d1a0380d6db4 admin admin] Could not find service: image.: keystone.exception.ServiceNotFound: Could not find service: image. Nov 24 16:32:29.519570 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: [pid: 71938|app: 0|req: 376/751] 10.222.0.53 () {56 vars in 1117 bytes} [Wed Nov 24 16:32:29 2021] GET /identity/v3/services/image => generated 86 bytes in 58 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 24 16:32:29.525883 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94d65fcf-dbeb-423a-862f-d78a18b6a388 None None] Authenticating user token {{(pid=71939) process_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 24 16:32:29.534902 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94d65fcf-dbeb-423a-862f-d78a18b6a388 None None] Validating token access rules against request {{(pid=71939) validate_allowed_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 24 16:32:29.539126 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9113bfc6-faf0-4d75-b6f6-ecdb48a0e12b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f2ba2e8375b4e8c8792ee1e22b60427', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '00a5583c7b7443e98e7a1d31a0b638dc', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=71939) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 24 16:32:29.539787 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9113bfc6-faf0-4d75-b6f6-ecdb48a0e12b admin admin] REQUEST_METHOD: `GET` {{(pid=71939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 24 16:32:29.540126 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9113bfc6-faf0-4d75-b6f6-ecdb48a0e12b admin admin] SCRIPT_NAME: `/identity` {{(pid=71939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 24 16:32:29.540462 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9113bfc6-faf0-4d75-b6f6-ecdb48a0e12b admin admin] PATH_INFO: `/v3/services` {{(pid=71939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 24 16:32:29.541227 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9113bfc6-faf0-4d75-b6f6-ecdb48a0e12b admin admin] RBAC: Adding query filter params (name=image) {{(pid=71939) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:161}} Nov 24 16:32:29.541574 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9113bfc6-faf0-4d75-b6f6-ecdb48a0e12b admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=71939) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:442}} Nov 24 16:32:29.570132 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9113bfc6-faf0-4d75-b6f6-ecdb48a0e12b admin admin] RBAC: Authorization granted {{(pid=71939) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 24 16:32:29.574910 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: [pid: 71939|app: 0|req: 376/752] 10.222.0.53 () {56 vars in 1120 bytes} [Wed Nov 24 16:32:29 2021] GET /identity/v3/services?name=image => generated 122 bytes in 49 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 24 16:32:29.581362 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31e908bf-21a0-4aef-a1ca-d1a0380d6db4 admin admin] Authenticating user token {{(pid=71938) process_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 24 16:32:29.591058 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31e908bf-21a0-4aef-a1ca-d1a0380d6db4 admin admin] Validating token access rules against request {{(pid=71938) validate_allowed_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 24 16:32:29.596107 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a38e00d-d015-42e4-ac43-ff1728f232db admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f2ba2e8375b4e8c8792ee1e22b60427', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '00a5583c7b7443e98e7a1d31a0b638dc', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=71938) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 24 16:32:29.597166 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a38e00d-d015-42e4-ac43-ff1728f232db admin admin] REQUEST_METHOD: `GET` {{(pid=71938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 24 16:32:29.597720 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a38e00d-d015-42e4-ac43-ff1728f232db admin admin] SCRIPT_NAME: `/identity` {{(pid=71938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 24 16:32:29.598245 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a38e00d-d015-42e4-ac43-ff1728f232db admin admin] PATH_INFO: `/v3/services` {{(pid=71938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 24 16:32:29.599454 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a38e00d-d015-42e4-ac43-ff1728f232db admin admin] RBAC: Adding query filter params (type=image) {{(pid=71938) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:161}} Nov 24 16:32:29.599999 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a38e00d-d015-42e4-ac43-ff1728f232db admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=71938) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:442}} Nov 24 16:32:29.643440 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a38e00d-d015-42e4-ac43-ff1728f232db admin admin] RBAC: Authorization granted {{(pid=71938) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 24 16:32:29.649168 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: [pid: 71938|app: 0|req: 377/753] 10.222.0.53 () {56 vars in 1120 bytes} [Wed Nov 24 16:32:29 2021] GET /identity/v3/services?type=image => generated 350 bytes in 68 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 24 16:32:29.655506 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9113bfc6-faf0-4d75-b6f6-ecdb48a0e12b admin admin] Authenticating user token {{(pid=71939) process_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 24 16:32:29.665464 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9113bfc6-faf0-4d75-b6f6-ecdb48a0e12b admin admin] Validating token access rules against request {{(pid=71939) validate_allowed_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 24 16:32:29.669712 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d93f308-c56c-41d1-a808-1b54d70c001f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f2ba2e8375b4e8c8792ee1e22b60427', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '00a5583c7b7443e98e7a1d31a0b638dc', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=71939) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 24 16:32:29.670422 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d93f308-c56c-41d1-a808-1b54d70c001f admin admin] REQUEST_METHOD: `GET` {{(pid=71939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 24 16:32:29.670763 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d93f308-c56c-41d1-a808-1b54d70c001f admin admin] SCRIPT_NAME: `/identity` {{(pid=71939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 24 16:32:29.671092 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d93f308-c56c-41d1-a808-1b54d70c001f admin admin] PATH_INFO: `/v3/endpoints` {{(pid=71939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 24 16:32:29.671944 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d93f308-c56c-41d1-a808-1b54d70c001f admin admin] RBAC: Adding query filter params (interface=public, service_id=f4959fb682074950ac46aeb55a918562, region_id=RegionOne) {{(pid=71939) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:161}} Nov 24 16:32:29.672303 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d93f308-c56c-41d1-a808-1b54d70c001f admin admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=71939) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:442}} Nov 24 16:32:29.700688 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d93f308-c56c-41d1-a808-1b54d70c001f admin admin] RBAC: Authorization granted {{(pid=71939) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 24 16:32:29.707114 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: [pid: 71939|app: 0|req: 377/754] 10.222.0.53 () {56 vars in 1263 bytes} [Wed Nov 24 16:32:29 2021] GET /identity/v3/endpoints?service_id=f4959fb682074950ac46aeb55a918562&interface=public®ion_id=RegionOne => generated 194 bytes in 52 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 24 16:32:29.712806 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a38e00d-d015-42e4-ac43-ff1728f232db admin admin] Authenticating user token {{(pid=71938) process_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 24 16:32:29.722641 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a38e00d-d015-42e4-ac43-ff1728f232db admin admin] Validating token access rules against request {{(pid=71938) validate_allowed_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 24 16:32:29.726843 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d72bec3-bf2c-4733-b4a5-7267980dd63f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f2ba2e8375b4e8c8792ee1e22b60427', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '00a5583c7b7443e98e7a1d31a0b638dc', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=71938) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 24 16:32:29.727505 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d72bec3-bf2c-4733-b4a5-7267980dd63f admin admin] REQUEST_METHOD: `GET` {{(pid=71938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 24 16:32:29.727845 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d72bec3-bf2c-4733-b4a5-7267980dd63f admin admin] SCRIPT_NAME: `/identity` {{(pid=71938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 24 16:32:29.728185 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d72bec3-bf2c-4733-b4a5-7267980dd63f admin admin] PATH_INFO: `/v3/services` {{(pid=71938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 24 16:32:29.728922 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d72bec3-bf2c-4733-b4a5-7267980dd63f admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=71938) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:442}} Nov 24 16:32:29.757399 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d72bec3-bf2c-4733-b4a5-7267980dd63f admin admin] RBAC: Authorization granted {{(pid=71938) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 24 16:32:29.763098 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: [pid: 71938|app: 0|req: 378/755] 10.222.0.53 () {56 vars in 1099 bytes} [Wed Nov 24 16:32:29 2021] GET /identity/v3/services => generated 1022 bytes in 51 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 24 16:32:31.726461 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25f7b301-b7f5-4263-aede-d8b94fb4e0e1 None None] REQUEST_METHOD: `GET` {{(pid=71939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 24 16:32:31.727045 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25f7b301-b7f5-4263-aede-d8b94fb4e0e1 None None] SCRIPT_NAME: `/identity` {{(pid=71939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 24 16:32:31.727162 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25f7b301-b7f5-4263-aede-d8b94fb4e0e1 None None] PATH_INFO: `/` {{(pid=71939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 24 16:32:31.728947 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: [pid: 71939|app: 0|req: 378/756] 10.222.0.53 () {54 vars in 915 bytes} [Wed Nov 24 16:32:31 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 24 16:32:31.734475 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-522d41c4-67e3-4227-a709-cf630a996ca8 None None] REQUEST_METHOD: `POST` {{(pid=71938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 24 16:32:31.734832 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-522d41c4-67e3-4227-a709-cf630a996ca8 None None] SCRIPT_NAME: `/identity` {{(pid=71938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 24 16:32:31.735174 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-522d41c4-67e3-4227-a709-cf630a996ca8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=71938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 24 16:32:31.761003 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.auth.core [None req-522d41c4-67e3-4227-a709-cf630a996ca8 None None] MFA Rules not processed for user `0f2ba2e8375b4e8c8792ee1e22b60427`. Rule list: `[]` (Enabled: `True`). {{(pid=71938) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:442}} Nov 24 16:32:31.762244 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.fernet_utils [None req-522d41c4-67e3-4227-a709-cf630a996ca8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=71938) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:289}} Nov 24 16:32:31.769909 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: [pid: 71938|app: 0|req: 379/757] 10.222.0.53 () {58 vars in 1013 bytes} [Wed Nov 24 16:32:31 2021] POST /identity/v3/auth/tokens => generated 1712 bytes in 37 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 24 16:32:31.791918 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-640654c9-aa87-46eb-abc5-3bf9b0f6c7b3 None None] REQUEST_METHOD: `POST` {{(pid=71939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 24 16:32:31.792268 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-640654c9-aa87-46eb-abc5-3bf9b0f6c7b3 None None] SCRIPT_NAME: `/identity` {{(pid=71939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 24 16:32:31.792605 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-640654c9-aa87-46eb-abc5-3bf9b0f6c7b3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=71939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 24 16:32:31.816260 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.auth.core [None req-640654c9-aa87-46eb-abc5-3bf9b0f6c7b3 None None] MFA Rules not processed for user `0f2ba2e8375b4e8c8792ee1e22b60427`. Rule list: `[]` (Enabled: `True`). {{(pid=71939) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:442}} Nov 24 16:32:31.817477 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.fernet_utils [None req-640654c9-aa87-46eb-abc5-3bf9b0f6c7b3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=71939) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:289}} Nov 24 16:32:31.824604 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: [pid: 71939|app: 0|req: 379/758] 10.222.0.53 () {58 vars in 1013 bytes} [Wed Nov 24 16:32:31 2021] POST /identity/v3/auth/tokens => generated 1712 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 24 16:32:31.831164 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-522d41c4-67e3-4227-a709-cf630a996ca8 None None] Authenticating user token {{(pid=71938) process_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 24 16:32:31.840654 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-522d41c4-67e3-4227-a709-cf630a996ca8 None None] Validating token access rules against request {{(pid=71938) validate_allowed_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 24 16:32:31.844921 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2de6a830-3197-49bf-af85-1fc4d650f675 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f2ba2e8375b4e8c8792ee1e22b60427', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '00a5583c7b7443e98e7a1d31a0b638dc', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=71938) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 24 16:32:31.845719 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2de6a830-3197-49bf-af85-1fc4d650f675 admin admin] REQUEST_METHOD: `GET` {{(pid=71938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 24 16:32:31.846085 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2de6a830-3197-49bf-af85-1fc4d650f675 admin admin] SCRIPT_NAME: `/identity` {{(pid=71938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 24 16:32:31.846419 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2de6a830-3197-49bf-af85-1fc4d650f675 admin admin] PATH_INFO: `/v3/services/image` {{(pid=71938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 24 16:32:31.847124 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2de6a830-3197-49bf-af85-1fc4d650f675 admin admin] RBAC: Authorizing `identity:get_service(service_id=image)` {{(pid=71938) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:442}} Nov 24 16:32:31.875502 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2de6a830-3197-49bf-af85-1fc4d650f675 admin admin] RBAC: Authorization granted {{(pid=71938) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 24 16:32:31.886708 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: WARNING keystone.server.flask.application [None req-2de6a830-3197-49bf-af85-1fc4d650f675 admin admin] Could not find service: image.: keystone.exception.ServiceNotFound: Could not find service: image. Nov 24 16:32:31.887868 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: [pid: 71938|app: 0|req: 380/759] 10.222.0.53 () {56 vars in 1117 bytes} [Wed Nov 24 16:32:31 2021] GET /identity/v3/services/image => generated 86 bytes in 57 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 24 16:32:31.894856 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-640654c9-aa87-46eb-abc5-3bf9b0f6c7b3 None None] Authenticating user token {{(pid=71939) process_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 24 16:32:31.904016 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-640654c9-aa87-46eb-abc5-3bf9b0f6c7b3 None None] Validating token access rules against request {{(pid=71939) validate_allowed_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 24 16:32:31.908358 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e04dbccc-b9c8-41aa-af82-781402b6b625 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f2ba2e8375b4e8c8792ee1e22b60427', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '00a5583c7b7443e98e7a1d31a0b638dc', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=71939) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 24 16:32:31.909022 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e04dbccc-b9c8-41aa-af82-781402b6b625 admin admin] REQUEST_METHOD: `GET` {{(pid=71939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 24 16:32:31.909367 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e04dbccc-b9c8-41aa-af82-781402b6b625 admin admin] SCRIPT_NAME: `/identity` {{(pid=71939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 24 16:32:31.909707 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e04dbccc-b9c8-41aa-af82-781402b6b625 admin admin] PATH_INFO: `/v3/services` {{(pid=71939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 24 16:32:31.910530 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e04dbccc-b9c8-41aa-af82-781402b6b625 admin admin] RBAC: Adding query filter params (name=image) {{(pid=71939) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:161}} Nov 24 16:32:31.910887 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e04dbccc-b9c8-41aa-af82-781402b6b625 admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=71939) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:442}} Nov 24 16:32:31.939245 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e04dbccc-b9c8-41aa-af82-781402b6b625 admin admin] RBAC: Authorization granted {{(pid=71939) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 24 16:32:31.944003 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: [pid: 71939|app: 0|req: 380/760] 10.222.0.53 () {56 vars in 1120 bytes} [Wed Nov 24 16:32:31 2021] GET /identity/v3/services?name=image => generated 122 bytes in 50 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 24 16:32:31.949571 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2de6a830-3197-49bf-af85-1fc4d650f675 admin admin] Authenticating user token {{(pid=71938) process_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 24 16:32:31.960245 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2de6a830-3197-49bf-af85-1fc4d650f675 admin admin] Validating token access rules against request {{(pid=71938) validate_allowed_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 24 16:32:31.964553 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c62decf0-d47b-4c7f-9c82-44e7223e41c2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f2ba2e8375b4e8c8792ee1e22b60427', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '00a5583c7b7443e98e7a1d31a0b638dc', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=71938) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 24 16:32:31.965206 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c62decf0-d47b-4c7f-9c82-44e7223e41c2 admin admin] REQUEST_METHOD: `GET` {{(pid=71938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 24 16:32:31.965547 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c62decf0-d47b-4c7f-9c82-44e7223e41c2 admin admin] SCRIPT_NAME: `/identity` {{(pid=71938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 24 16:32:31.965880 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c62decf0-d47b-4c7f-9c82-44e7223e41c2 admin admin] PATH_INFO: `/v3/services` {{(pid=71938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 24 16:32:31.966677 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c62decf0-d47b-4c7f-9c82-44e7223e41c2 admin admin] RBAC: Adding query filter params (type=image) {{(pid=71938) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:161}} Nov 24 16:32:31.967032 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c62decf0-d47b-4c7f-9c82-44e7223e41c2 admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=71938) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:442}} Nov 24 16:32:31.994895 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c62decf0-d47b-4c7f-9c82-44e7223e41c2 admin admin] RBAC: Authorization granted {{(pid=71938) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 24 16:32:32.000310 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: [pid: 71938|app: 0|req: 381/761] 10.222.0.53 () {56 vars in 1120 bytes} [Wed Nov 24 16:32:31 2021] GET /identity/v3/services?type=image => generated 350 bytes in 51 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 24 16:32:32.005816 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e04dbccc-b9c8-41aa-af82-781402b6b625 admin admin] Authenticating user token {{(pid=71939) process_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 24 16:32:32.016047 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e04dbccc-b9c8-41aa-af82-781402b6b625 admin admin] Validating token access rules against request {{(pid=71939) validate_allowed_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 24 16:32:32.020262 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05b8567e-a251-45d3-b2cc-369b0a305921 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f2ba2e8375b4e8c8792ee1e22b60427', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '00a5583c7b7443e98e7a1d31a0b638dc', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=71939) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 24 16:32:32.020911 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05b8567e-a251-45d3-b2cc-369b0a305921 admin admin] REQUEST_METHOD: `POST` {{(pid=71939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 24 16:32:32.021245 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05b8567e-a251-45d3-b2cc-369b0a305921 admin admin] SCRIPT_NAME: `/identity` {{(pid=71939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 24 16:32:32.021573 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05b8567e-a251-45d3-b2cc-369b0a305921 admin admin] PATH_INFO: `/v3/endpoints` {{(pid=71939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 24 16:32:32.022375 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05b8567e-a251-45d3-b2cc-369b0a305921 admin admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=71939) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:442}} Nov 24 16:32:32.050503 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05b8567e-a251-45d3-b2cc-369b0a305921 admin admin] RBAC: Authorization granted {{(pid=71939) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 24 16:32:32.068490 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: [pid: 71939|app: 0|req: 381/762] 10.222.0.53 () {60 vars in 1156 bytes} [Wed Nov 24 16:32:32 2021] POST /identity/v3/endpoints => generated 327 bytes in 63 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 24 16:32:34.041266 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfd1b5ba-daf8-46eb-ad92-867c1d28e328 None None] REQUEST_METHOD: `GET` {{(pid=71938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 24 16:32:34.041808 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfd1b5ba-daf8-46eb-ad92-867c1d28e328 None None] SCRIPT_NAME: `/identity` {{(pid=71938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 24 16:32:34.042401 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfd1b5ba-daf8-46eb-ad92-867c1d28e328 None None] PATH_INFO: `/` {{(pid=71938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 24 16:32:34.045476 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: [pid: 71938|app: 0|req: 382/763] 10.222.0.53 () {54 vars in 915 bytes} [Wed Nov 24 16:32:34 2021] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 24 16:32:34.051442 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3cee16e-02e7-44d3-8b90-c39f7b9c6a5a None None] REQUEST_METHOD: `POST` {{(pid=71939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 24 16:32:34.051797 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3cee16e-02e7-44d3-8b90-c39f7b9c6a5a None None] SCRIPT_NAME: `/identity` {{(pid=71939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 24 16:32:34.052133 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3cee16e-02e7-44d3-8b90-c39f7b9c6a5a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=71939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 24 16:32:34.077723 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.auth.core [None req-f3cee16e-02e7-44d3-8b90-c39f7b9c6a5a None None] MFA Rules not processed for user `0f2ba2e8375b4e8c8792ee1e22b60427`. Rule list: `[]` (Enabled: `True`). {{(pid=71939) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:442}} Nov 24 16:32:34.079746 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.fernet_utils [None req-f3cee16e-02e7-44d3-8b90-c39f7b9c6a5a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=71939) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:289}} Nov 24 16:32:34.096872 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: [pid: 71939|app: 0|req: 382/764] 10.222.0.53 () {58 vars in 1013 bytes} [Wed Nov 24 16:32:34 2021] POST /identity/v3/auth/tokens => generated 1861 bytes in 46 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 24 16:32:34.118580 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a210575-76ab-46b5-93be-1047b037dec0 None None] REQUEST_METHOD: `POST` {{(pid=71938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 24 16:32:34.118925 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a210575-76ab-46b5-93be-1047b037dec0 None None] SCRIPT_NAME: `/identity` {{(pid=71938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 24 16:32:34.119249 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a210575-76ab-46b5-93be-1047b037dec0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=71938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 24 16:32:34.143460 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.auth.core [None req-2a210575-76ab-46b5-93be-1047b037dec0 None None] MFA Rules not processed for user `0f2ba2e8375b4e8c8792ee1e22b60427`. Rule list: `[]` (Enabled: `True`). {{(pid=71938) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:442}} Nov 24 16:32:34.144650 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.fernet_utils [None req-2a210575-76ab-46b5-93be-1047b037dec0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=71938) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:289}} Nov 24 16:32:34.151620 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: [pid: 71938|app: 0|req: 383/765] 10.222.0.53 () {58 vars in 1013 bytes} [Wed Nov 24 16:32:34 2021] POST /identity/v3/auth/tokens => generated 1861 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 24 16:32:34.157394 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3cee16e-02e7-44d3-8b90-c39f7b9c6a5a None None] Authenticating user token {{(pid=71939) process_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 24 16:32:34.166916 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3cee16e-02e7-44d3-8b90-c39f7b9c6a5a None None] Validating token access rules against request {{(pid=71939) validate_allowed_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 24 16:32:34.171132 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d4986ba-3ba8-4fef-a353-7b28bd4fc721 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f2ba2e8375b4e8c8792ee1e22b60427', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '00a5583c7b7443e98e7a1d31a0b638dc', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=71939) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 24 16:32:34.171781 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d4986ba-3ba8-4fef-a353-7b28bd4fc721 admin admin] REQUEST_METHOD: `GET` {{(pid=71939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 24 16:32:34.172121 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d4986ba-3ba8-4fef-a353-7b28bd4fc721 admin admin] SCRIPT_NAME: `/identity` {{(pid=71939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 24 16:32:34.172454 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d4986ba-3ba8-4fef-a353-7b28bd4fc721 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=71939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 24 16:32:34.180550 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d4986ba-3ba8-4fef-a353-7b28bd4fc721 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=71939) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:442}} Nov 24 16:32:34.210053 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d4986ba-3ba8-4fef-a353-7b28bd4fc721 admin admin] RBAC: Authorization granted {{(pid=71939) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 24 16:32:34.219738 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: [pid: 71939|app: 0|req: 383/766] 10.222.0.53 () {58 vars in 1315 bytes} [Wed Nov 24 16:32:34 2021] GET /identity/v3/auth/tokens => generated 1861 bytes in 63 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 24 16:32:34.225919 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a210575-76ab-46b5-93be-1047b037dec0 None None] Authenticating user token {{(pid=71938) process_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 24 16:32:34.235266 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a210575-76ab-46b5-93be-1047b037dec0 None None] Validating token access rules against request {{(pid=71938) validate_allowed_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 24 16:32:34.239614 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e5e0fac-accf-4828-9413-4f5bd064772c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f2ba2e8375b4e8c8792ee1e22b60427', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '00a5583c7b7443e98e7a1d31a0b638dc', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=71938) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 24 16:32:34.240424 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e5e0fac-accf-4828-9413-4f5bd064772c admin admin] REQUEST_METHOD: `GET` {{(pid=71938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 24 16:32:34.240761 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e5e0fac-accf-4828-9413-4f5bd064772c admin admin] SCRIPT_NAME: `/identity` {{(pid=71938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 24 16:32:34.241090 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e5e0fac-accf-4828-9413-4f5bd064772c admin admin] PATH_INFO: `/v3/domains/default` {{(pid=71938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 24 16:32:34.242300 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e5e0fac-accf-4828-9413-4f5bd064772c admin admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=71938) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:442}} Nov 24 16:32:34.272401 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e5e0fac-accf-4828-9413-4f5bd064772c admin admin] RBAC: Authorization granted {{(pid=71938) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 24 16:32:34.274185 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: [pid: 71938|app: 0|req: 384/767] 10.222.0.53 () {56 vars in 1120 bytes} [Wed Nov 24 16:32:34 2021] GET /identity/v3/domains/default => generated 199 bytes in 49 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 24 16:32:36.323021 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-043d1cd3-a542-4d08-b981-6a3b00acf684 None None] REQUEST_METHOD: `GET` {{(pid=71939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 24 16:32:36.323526 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-043d1cd3-a542-4d08-b981-6a3b00acf684 None None] SCRIPT_NAME: `/identity` {{(pid=71939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 24 16:32:36.323660 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-043d1cd3-a542-4d08-b981-6a3b00acf684 None None] PATH_INFO: `/` {{(pid=71939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 24 16:32:36.325493 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: [pid: 71939|app: 0|req: 384/768] 10.222.0.53 () {54 vars in 915 bytes} [Wed Nov 24 16:32:36 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 24 16:32:36.331820 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-110f63b3-1162-48da-a304-367d40ed2c48 None None] REQUEST_METHOD: `POST` {{(pid=71938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 24 16:32:36.332167 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-110f63b3-1162-48da-a304-367d40ed2c48 None None] SCRIPT_NAME: `/identity` {{(pid=71938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 24 16:32:36.332505 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-110f63b3-1162-48da-a304-367d40ed2c48 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=71938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 24 16:32:36.356468 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.auth.core [None req-110f63b3-1162-48da-a304-367d40ed2c48 None None] MFA Rules not processed for user `0f2ba2e8375b4e8c8792ee1e22b60427`. Rule list: `[]` (Enabled: `True`). {{(pid=71938) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:442}} Nov 24 16:32:36.357689 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.fernet_utils [None req-110f63b3-1162-48da-a304-367d40ed2c48 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=71938) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:289}} Nov 24 16:32:36.365592 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: [pid: 71938|app: 0|req: 385/769] 10.222.0.53 () {58 vars in 1013 bytes} [Wed Nov 24 16:32:36 2021] POST /identity/v3/auth/tokens => generated 1861 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 24 16:32:36.388002 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-950a554f-dfb8-4c08-8ab6-d19afa427957 None None] REQUEST_METHOD: `POST` {{(pid=71939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 24 16:32:36.388340 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-950a554f-dfb8-4c08-8ab6-d19afa427957 None None] SCRIPT_NAME: `/identity` {{(pid=71939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 24 16:32:36.388675 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-950a554f-dfb8-4c08-8ab6-d19afa427957 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=71939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 24 16:32:36.412820 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.auth.core [None req-950a554f-dfb8-4c08-8ab6-d19afa427957 None None] MFA Rules not processed for user `0f2ba2e8375b4e8c8792ee1e22b60427`. Rule list: `[]` (Enabled: `True`). {{(pid=71939) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:442}} Nov 24 16:32:36.414058 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.fernet_utils [None req-950a554f-dfb8-4c08-8ab6-d19afa427957 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=71939) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:289}} Nov 24 16:32:36.421008 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: [pid: 71939|app: 0|req: 385/770] 10.222.0.53 () {58 vars in 1013 bytes} [Wed Nov 24 16:32:36 2021] POST /identity/v3/auth/tokens => generated 1861 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 24 16:32:36.427405 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-110f63b3-1162-48da-a304-367d40ed2c48 None None] Authenticating user token {{(pid=71938) process_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 24 16:32:36.436990 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-110f63b3-1162-48da-a304-367d40ed2c48 None None] Validating token access rules against request {{(pid=71938) validate_allowed_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 24 16:32:36.441223 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03ce036d-7a09-4b7c-94d3-bffa9608fe1d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f2ba2e8375b4e8c8792ee1e22b60427', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '00a5583c7b7443e98e7a1d31a0b638dc', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=71938) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 24 16:32:36.442098 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03ce036d-7a09-4b7c-94d3-bffa9608fe1d admin admin] REQUEST_METHOD: `GET` {{(pid=71938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 24 16:32:36.442441 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03ce036d-7a09-4b7c-94d3-bffa9608fe1d admin admin] SCRIPT_NAME: `/identity` {{(pid=71938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 24 16:32:36.442774 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03ce036d-7a09-4b7c-94d3-bffa9608fe1d admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=71938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 24 16:32:36.455291 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03ce036d-7a09-4b7c-94d3-bffa9608fe1d admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=71938) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:442}} Nov 24 16:32:36.484560 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03ce036d-7a09-4b7c-94d3-bffa9608fe1d admin admin] RBAC: Authorization granted {{(pid=71938) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 24 16:32:36.502795 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: WARNING keystone.server.flask.application [None req-03ce036d-7a09-4b7c-94d3-bffa9608fe1d admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Nov 24 16:32:36.503970 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: [pid: 71938|app: 0|req: 386/771] 10.222.0.53 () {56 vars in 1120 bytes} [Wed Nov 24 16:32:36 2021] GET /identity/v3/domains/Default => generated 87 bytes in 77 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 24 16:32:36.510720 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-950a554f-dfb8-4c08-8ab6-d19afa427957 None None] Authenticating user token {{(pid=71939) process_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 24 16:32:36.519845 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-950a554f-dfb8-4c08-8ab6-d19afa427957 None None] Validating token access rules against request {{(pid=71939) validate_allowed_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 24 16:32:36.524128 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-722d034b-d771-4d79-99cb-e1e7ebb4237b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f2ba2e8375b4e8c8792ee1e22b60427', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '00a5583c7b7443e98e7a1d31a0b638dc', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=71939) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 24 16:32:36.524794 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-722d034b-d771-4d79-99cb-e1e7ebb4237b admin admin] REQUEST_METHOD: `GET` {{(pid=71939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 24 16:32:36.525135 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-722d034b-d771-4d79-99cb-e1e7ebb4237b admin admin] SCRIPT_NAME: `/identity` {{(pid=71939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 24 16:32:36.525472 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-722d034b-d771-4d79-99cb-e1e7ebb4237b admin admin] PATH_INFO: `/v3/domains` {{(pid=71939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 24 16:32:36.526303 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-722d034b-d771-4d79-99cb-e1e7ebb4237b admin admin] RBAC: Adding query filter params (name=Default) {{(pid=71939) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:161}} Nov 24 16:32:36.526658 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-722d034b-d771-4d79-99cb-e1e7ebb4237b admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=71939) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:442}} Nov 24 16:32:36.555570 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-722d034b-d771-4d79-99cb-e1e7ebb4237b admin admin] RBAC: Authorization granted {{(pid=71939) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 24 16:32:36.569888 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: [pid: 71939|app: 0|req: 386/772] 10.222.0.53 () {56 vars in 1121 bytes} [Wed Nov 24 16:32:36 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 60 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 24 16:32:36.575618 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03ce036d-7a09-4b7c-94d3-bffa9608fe1d admin admin] Authenticating user token {{(pid=71938) process_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 24 16:32:36.586233 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03ce036d-7a09-4b7c-94d3-bffa9608fe1d admin admin] Validating token access rules against request {{(pid=71938) validate_allowed_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 24 16:32:36.590448 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3277bc83-262c-4009-987d-db5f278f397a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f2ba2e8375b4e8c8792ee1e22b60427', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '00a5583c7b7443e98e7a1d31a0b638dc', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=71938) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 24 16:32:36.591125 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3277bc83-262c-4009-987d-db5f278f397a admin admin] REQUEST_METHOD: `POST` {{(pid=71938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 24 16:32:36.591468 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3277bc83-262c-4009-987d-db5f278f397a admin admin] SCRIPT_NAME: `/identity` {{(pid=71938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 24 16:32:36.591804 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3277bc83-262c-4009-987d-db5f278f397a admin admin] PATH_INFO: `/v3/users` {{(pid=71938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 24 16:32:36.592541 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3277bc83-262c-4009-987d-db5f278f397a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=71938) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:442}} Nov 24 16:32:36.621619 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3277bc83-262c-4009-987d-db5f278f397a admin admin] RBAC: Authorization granted {{(pid=71938) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 24 16:32:36.640791 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: [pid: 71938|app: 0|req: 387/773] 10.222.0.53 () {60 vars in 1143 bytes} [Wed Nov 24 16:32:36 2021] POST /identity/v3/users => generated 248 bytes in 66 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 24 16:32:38.651916 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b04e91cd-23be-481d-9e46-fa9137936323 None None] REQUEST_METHOD: `GET` {{(pid=71939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 24 16:32:38.652444 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b04e91cd-23be-481d-9e46-fa9137936323 None None] SCRIPT_NAME: `/identity` {{(pid=71939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 24 16:32:38.652587 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b04e91cd-23be-481d-9e46-fa9137936323 None None] PATH_INFO: `/` {{(pid=71939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 24 16:32:38.654446 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: [pid: 71939|app: 0|req: 387/774] 10.222.0.53 () {54 vars in 915 bytes} [Wed Nov 24 16:32:38 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 24 16:32:38.660662 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a245733-13aa-42be-ad4b-209fb1823d86 None None] REQUEST_METHOD: `POST` {{(pid=71938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 24 16:32:38.661020 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a245733-13aa-42be-ad4b-209fb1823d86 None None] SCRIPT_NAME: `/identity` {{(pid=71938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 24 16:32:38.661359 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a245733-13aa-42be-ad4b-209fb1823d86 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=71938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 24 16:32:38.690748 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.auth.core [None req-1a245733-13aa-42be-ad4b-209fb1823d86 None None] MFA Rules not processed for user `0f2ba2e8375b4e8c8792ee1e22b60427`. Rule list: `[]` (Enabled: `True`). {{(pid=71938) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:442}} Nov 24 16:32:38.691979 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.fernet_utils [None req-1a245733-13aa-42be-ad4b-209fb1823d86 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=71938) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:289}} Nov 24 16:32:38.699159 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: [pid: 71938|app: 0|req: 388/775] 10.222.0.53 () {58 vars in 1013 bytes} [Wed Nov 24 16:32:38 2021] POST /identity/v3/auth/tokens => generated 1861 bytes in 40 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 24 16:32:38.722586 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d03e33e-b187-4136-b01c-7f8c17706c76 None None] REQUEST_METHOD: `POST` {{(pid=71939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 24 16:32:38.722932 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d03e33e-b187-4136-b01c-7f8c17706c76 None None] SCRIPT_NAME: `/identity` {{(pid=71939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 24 16:32:38.723266 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d03e33e-b187-4136-b01c-7f8c17706c76 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=71939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 24 16:32:38.746545 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.auth.core [None req-0d03e33e-b187-4136-b01c-7f8c17706c76 None None] MFA Rules not processed for user `0f2ba2e8375b4e8c8792ee1e22b60427`. Rule list: `[]` (Enabled: `True`). {{(pid=71939) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:442}} Nov 24 16:32:38.747758 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.fernet_utils [None req-0d03e33e-b187-4136-b01c-7f8c17706c76 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=71939) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:289}} Nov 24 16:32:38.754844 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: [pid: 71939|app: 0|req: 388/776] 10.222.0.53 () {58 vars in 1013 bytes} [Wed Nov 24 16:32:38 2021] POST /identity/v3/auth/tokens => generated 1861 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 24 16:32:38.760494 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a245733-13aa-42be-ad4b-209fb1823d86 None None] Authenticating user token {{(pid=71938) process_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 24 16:32:38.770120 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a245733-13aa-42be-ad4b-209fb1823d86 None None] Validating token access rules against request {{(pid=71938) validate_allowed_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 24 16:32:38.774363 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6a91a52-45c6-4a40-afe8-e6ad2a3f5db1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f2ba2e8375b4e8c8792ee1e22b60427', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '00a5583c7b7443e98e7a1d31a0b638dc', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=71938) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 24 16:32:38.775174 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6a91a52-45c6-4a40-afe8-e6ad2a3f5db1 admin admin] REQUEST_METHOD: `GET` {{(pid=71938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 24 16:32:38.775516 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6a91a52-45c6-4a40-afe8-e6ad2a3f5db1 admin admin] SCRIPT_NAME: `/identity` {{(pid=71938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 24 16:32:38.775851 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6a91a52-45c6-4a40-afe8-e6ad2a3f5db1 admin admin] PATH_INFO: `/v3/roles/service` {{(pid=71938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 24 16:32:38.790001 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6a91a52-45c6-4a40-afe8-e6ad2a3f5db1 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=71938) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:401}} Nov 24 16:32:38.798108 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: WARNING keystone.server.flask.application [None req-a6a91a52-45c6-4a40-afe8-e6ad2a3f5db1 admin admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Nov 24 16:32:38.799286 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: [pid: 71938|app: 0|req: 389/777] 10.222.0.53 () {56 vars in 1114 bytes} [Wed Nov 24 16:32:38 2021] GET /identity/v3/roles/service => generated 85 bytes in 39 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 24 16:32:38.805581 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d03e33e-b187-4136-b01c-7f8c17706c76 None None] Authenticating user token {{(pid=71939) process_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 24 16:32:38.814633 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d03e33e-b187-4136-b01c-7f8c17706c76 None None] Validating token access rules against request {{(pid=71939) validate_allowed_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 24 16:32:38.818847 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-910ccce2-cc45-469d-80cc-bf9e9c17efe7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f2ba2e8375b4e8c8792ee1e22b60427', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '00a5583c7b7443e98e7a1d31a0b638dc', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=71939) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 24 16:32:38.819504 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-910ccce2-cc45-469d-80cc-bf9e9c17efe7 admin admin] REQUEST_METHOD: `GET` {{(pid=71939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 24 16:32:38.819845 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-910ccce2-cc45-469d-80cc-bf9e9c17efe7 admin admin] SCRIPT_NAME: `/identity` {{(pid=71939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 24 16:32:38.820178 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-910ccce2-cc45-469d-80cc-bf9e9c17efe7 admin admin] PATH_INFO: `/v3/roles` {{(pid=71939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 24 16:32:38.820976 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-910ccce2-cc45-469d-80cc-bf9e9c17efe7 admin admin] RBAC: Adding query filter params (name=service) {{(pid=71939) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:161}} Nov 24 16:32:38.821410 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-910ccce2-cc45-469d-80cc-bf9e9c17efe7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=71939) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:442}} Nov 24 16:32:38.850595 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-910ccce2-cc45-469d-80cc-bf9e9c17efe7 admin admin] RBAC: Authorization granted {{(pid=71939) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 24 16:32:38.859283 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: [pid: 71939|app: 0|req: 389/778] 10.222.0.53 () {56 vars in 1115 bytes} [Wed Nov 24 16:32:38 2021] GET /identity/v3/roles?name=service => generated 326 bytes in 54 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 24 16:32:38.864834 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6a91a52-45c6-4a40-afe8-e6ad2a3f5db1 admin admin] Authenticating user token {{(pid=71938) process_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 24 16:32:38.875043 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6a91a52-45c6-4a40-afe8-e6ad2a3f5db1 admin admin] Validating token access rules against request {{(pid=71938) validate_allowed_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 24 16:32:38.879290 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89467896-9f08-4c45-ace2-a4c05c8b2818 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f2ba2e8375b4e8c8792ee1e22b60427', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '00a5583c7b7443e98e7a1d31a0b638dc', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=71938) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 24 16:32:38.880075 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89467896-9f08-4c45-ace2-a4c05c8b2818 admin admin] REQUEST_METHOD: `GET` {{(pid=71938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 24 16:32:38.880416 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89467896-9f08-4c45-ace2-a4c05c8b2818 admin admin] SCRIPT_NAME: `/identity` {{(pid=71938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 24 16:32:38.880750 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89467896-9f08-4c45-ace2-a4c05c8b2818 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=71938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 24 16:32:38.892907 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89467896-9f08-4c45-ace2-a4c05c8b2818 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=71938) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:442}} Nov 24 16:32:38.921989 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89467896-9f08-4c45-ace2-a4c05c8b2818 admin admin] RBAC: Authorization granted {{(pid=71938) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 24 16:32:38.940711 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: WARNING keystone.server.flask.application [None req-89467896-9f08-4c45-ace2-a4c05c8b2818 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Nov 24 16:32:38.941857 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: [pid: 71938|app: 0|req: 390/779] 10.222.0.53 () {56 vars in 1120 bytes} [Wed Nov 24 16:32:38 2021] GET /identity/v3/domains/Default => generated 87 bytes in 77 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 24 16:32:38.947608 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-910ccce2-cc45-469d-80cc-bf9e9c17efe7 admin admin] Authenticating user token {{(pid=71939) process_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 24 16:32:38.958169 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-910ccce2-cc45-469d-80cc-bf9e9c17efe7 admin admin] Validating token access rules against request {{(pid=71939) validate_allowed_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 24 16:32:38.962724 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96adb80a-101a-431f-9572-df05b0a651a2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f2ba2e8375b4e8c8792ee1e22b60427', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '00a5583c7b7443e98e7a1d31a0b638dc', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=71939) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 24 16:32:38.963395 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96adb80a-101a-431f-9572-df05b0a651a2 admin admin] REQUEST_METHOD: `GET` {{(pid=71939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 24 16:32:38.963737 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96adb80a-101a-431f-9572-df05b0a651a2 admin admin] SCRIPT_NAME: `/identity` {{(pid=71939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 24 16:32:38.964069 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96adb80a-101a-431f-9572-df05b0a651a2 admin admin] PATH_INFO: `/v3/domains` {{(pid=71939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 24 16:32:38.964846 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96adb80a-101a-431f-9572-df05b0a651a2 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=71939) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:161}} Nov 24 16:32:38.965198 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96adb80a-101a-431f-9572-df05b0a651a2 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=71939) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:442}} Nov 24 16:32:38.993553 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96adb80a-101a-431f-9572-df05b0a651a2 admin admin] RBAC: Authorization granted {{(pid=71939) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 24 16:32:39.007278 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: [pid: 71939|app: 0|req: 390/780] 10.222.0.53 () {56 vars in 1121 bytes} [Wed Nov 24 16:32:38 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 60 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 24 16:32:39.013280 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89467896-9f08-4c45-ace2-a4c05c8b2818 admin admin] Authenticating user token {{(pid=71938) process_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 24 16:32:39.023662 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89467896-9f08-4c45-ace2-a4c05c8b2818 admin admin] Validating token access rules against request {{(pid=71938) validate_allowed_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 24 16:32:39.028214 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44dfebd5-24a5-469d-bd19-cf7e1671f02d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f2ba2e8375b4e8c8792ee1e22b60427', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '00a5583c7b7443e98e7a1d31a0b638dc', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=71938) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 24 16:32:39.029025 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44dfebd5-24a5-469d-bd19-cf7e1671f02d admin admin] REQUEST_METHOD: `GET` {{(pid=71938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 24 16:32:39.029368 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44dfebd5-24a5-469d-bd19-cf7e1671f02d admin admin] SCRIPT_NAME: `/identity` {{(pid=71938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 24 16:32:39.029704 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44dfebd5-24a5-469d-bd19-cf7e1671f02d admin admin] PATH_INFO: `/v3/users/cinder` {{(pid=71938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 24 16:32:39.043688 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44dfebd5-24a5-469d-bd19-cf7e1671f02d admin admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=71938) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:442}} Nov 24 16:32:39.072375 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44dfebd5-24a5-469d-bd19-cf7e1671f02d admin admin] RBAC: Authorization granted {{(pid=71938) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 24 16:32:39.092347 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: WARNING keystone.server.flask.application [None req-44dfebd5-24a5-469d-bd19-cf7e1671f02d admin admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. Nov 24 16:32:39.094074 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: [pid: 71938|app: 0|req: 391/781] 10.222.0.53 () {56 vars in 1111 bytes} [Wed Nov 24 16:32:39 2021] GET /identity/v3/users/cinder => generated 84 bytes in 81 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 24 16:32:39.099996 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96adb80a-101a-431f-9572-df05b0a651a2 admin admin] Authenticating user token {{(pid=71939) process_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 24 16:32:39.109843 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96adb80a-101a-431f-9572-df05b0a651a2 admin admin] Validating token access rules against request {{(pid=71939) validate_allowed_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 24 16:32:39.114113 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8fbd733-4b32-416d-80de-7ed887354efd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f2ba2e8375b4e8c8792ee1e22b60427', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '00a5583c7b7443e98e7a1d31a0b638dc', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=71939) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 24 16:32:39.114783 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8fbd733-4b32-416d-80de-7ed887354efd admin admin] REQUEST_METHOD: `GET` {{(pid=71939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 24 16:32:39.115124 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8fbd733-4b32-416d-80de-7ed887354efd admin admin] SCRIPT_NAME: `/identity` {{(pid=71939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 24 16:32:39.115458 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8fbd733-4b32-416d-80de-7ed887354efd admin admin] PATH_INFO: `/v3/users` {{(pid=71939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 24 16:32:39.116358 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8fbd733-4b32-416d-80de-7ed887354efd admin admin] RBAC: Adding query filter params (domain_id=default, name=cinder) {{(pid=71939) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:161}} Nov 24 16:32:39.116716 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8fbd733-4b32-416d-80de-7ed887354efd admin admin] RBAC: Authorizing `identity:list_users()` {{(pid=71939) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:442}} Nov 24 16:32:39.145471 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8fbd733-4b32-416d-80de-7ed887354efd admin admin] RBAC: Authorization granted {{(pid=71939) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 24 16:32:39.176580 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: [pid: 71939|app: 0|req: 391/782] 10.222.0.53 () {56 vars in 1149 bytes} [Wed Nov 24 16:32:39 2021] GET /identity/v3/users?domain_id=default&name=cinder => generated 372 bytes in 77 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 24 16:32:39.182534 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44dfebd5-24a5-469d-bd19-cf7e1671f02d admin admin] Authenticating user token {{(pid=71938) process_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 24 16:32:39.192878 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44dfebd5-24a5-469d-bd19-cf7e1671f02d admin admin] Validating token access rules against request {{(pid=71938) validate_allowed_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 24 16:32:39.197070 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d02629f-2eba-4766-b1e6-a04812910936 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f2ba2e8375b4e8c8792ee1e22b60427', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '00a5583c7b7443e98e7a1d31a0b638dc', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=71938) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 24 16:32:39.197712 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d02629f-2eba-4766-b1e6-a04812910936 admin admin] REQUEST_METHOD: `GET` {{(pid=71938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 24 16:32:39.198072 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d02629f-2eba-4766-b1e6-a04812910936 admin admin] SCRIPT_NAME: `/identity` {{(pid=71938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 24 16:32:39.198401 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d02629f-2eba-4766-b1e6-a04812910936 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=71938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 24 16:32:39.207327 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d02629f-2eba-4766-b1e6-a04812910936 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=71938) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:442}} Nov 24 16:32:39.235501 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d02629f-2eba-4766-b1e6-a04812910936 admin admin] RBAC: Authorization granted {{(pid=71938) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 24 16:32:39.244556 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: [pid: 71938|app: 0|req: 392/783] 10.222.0.53 () {58 vars in 1315 bytes} [Wed Nov 24 16:32:39 2021] GET /identity/v3/auth/tokens => generated 1861 bytes in 63 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 24 16:32:39.251105 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8fbd733-4b32-416d-80de-7ed887354efd admin admin] Authenticating user token {{(pid=71939) process_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 24 16:32:39.261026 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8fbd733-4b32-416d-80de-7ed887354efd admin admin] Validating token access rules against request {{(pid=71939) validate_allowed_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 24 16:32:39.266002 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d02a80f-5311-4f0b-b362-3a6dfa52f870 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f2ba2e8375b4e8c8792ee1e22b60427', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '00a5583c7b7443e98e7a1d31a0b638dc', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=71939) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 24 16:32:39.266875 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d02a80f-5311-4f0b-b362-3a6dfa52f870 admin admin] REQUEST_METHOD: `GET` {{(pid=71939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 24 16:32:39.267214 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d02a80f-5311-4f0b-b362-3a6dfa52f870 admin admin] SCRIPT_NAME: `/identity` {{(pid=71939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 24 16:32:39.267546 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d02a80f-5311-4f0b-b362-3a6dfa52f870 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=71939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 24 16:32:39.279898 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d02a80f-5311-4f0b-b362-3a6dfa52f870 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=71939) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:442}} Nov 24 16:32:39.307906 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d02a80f-5311-4f0b-b362-3a6dfa52f870 admin admin] RBAC: Authorization granted {{(pid=71939) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 24 16:32:39.326482 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: WARNING keystone.server.flask.application [None req-3d02a80f-5311-4f0b-b362-3a6dfa52f870 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Nov 24 16:32:39.328860 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: [pid: 71939|app: 0|req: 392/784] 10.222.0.53 () {56 vars in 1120 bytes} [Wed Nov 24 16:32:39 2021] GET /identity/v3/domains/Default => generated 87 bytes in 78 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 24 16:32:39.334948 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d02629f-2eba-4766-b1e6-a04812910936 admin admin] Authenticating user token {{(pid=71938) process_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 24 16:32:39.343983 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d02629f-2eba-4766-b1e6-a04812910936 admin admin] Validating token access rules against request {{(pid=71938) validate_allowed_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 24 16:32:39.348262 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ea74ab0-09b5-4f5a-b1b4-a88853b9e074 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f2ba2e8375b4e8c8792ee1e22b60427', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '00a5583c7b7443e98e7a1d31a0b638dc', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=71938) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 24 16:32:39.348916 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ea74ab0-09b5-4f5a-b1b4-a88853b9e074 admin admin] REQUEST_METHOD: `GET` {{(pid=71938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 24 16:32:39.349248 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ea74ab0-09b5-4f5a-b1b4-a88853b9e074 admin admin] SCRIPT_NAME: `/identity` {{(pid=71938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 24 16:32:39.349574 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ea74ab0-09b5-4f5a-b1b4-a88853b9e074 admin admin] PATH_INFO: `/v3/domains` {{(pid=71938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 24 16:32:39.350378 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ea74ab0-09b5-4f5a-b1b4-a88853b9e074 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=71938) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:161}} Nov 24 16:32:39.350763 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ea74ab0-09b5-4f5a-b1b4-a88853b9e074 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=71938) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:442}} Nov 24 16:32:39.381347 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ea74ab0-09b5-4f5a-b1b4-a88853b9e074 admin admin] RBAC: Authorization granted {{(pid=71938) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 24 16:32:39.395152 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: [pid: 71938|app: 0|req: 393/785] 10.222.0.53 () {56 vars in 1121 bytes} [Wed Nov 24 16:32:39 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 61 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 24 16:32:39.400933 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d02a80f-5311-4f0b-b362-3a6dfa52f870 admin admin] Authenticating user token {{(pid=71939) process_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 24 16:32:39.410784 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d02a80f-5311-4f0b-b362-3a6dfa52f870 admin admin] Validating token access rules against request {{(pid=71939) validate_allowed_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 24 16:32:39.415076 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6cc70b0-84fa-49f9-8976-0f6fde643304 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f2ba2e8375b4e8c8792ee1e22b60427', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '00a5583c7b7443e98e7a1d31a0b638dc', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=71939) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 24 16:32:39.415871 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6cc70b0-84fa-49f9-8976-0f6fde643304 admin admin] REQUEST_METHOD: `GET` {{(pid=71939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 24 16:32:39.416207 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6cc70b0-84fa-49f9-8976-0f6fde643304 admin admin] SCRIPT_NAME: `/identity` {{(pid=71939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 24 16:32:39.416536 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6cc70b0-84fa-49f9-8976-0f6fde643304 admin admin] PATH_INFO: `/v3/projects/service` {{(pid=71939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 24 16:32:39.425717 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6cc70b0-84fa-49f9-8976-0f6fde643304 admin admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=71939) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:442}} Nov 24 16:32:39.455618 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6cc70b0-84fa-49f9-8976-0f6fde643304 admin admin] RBAC: Authorization granted {{(pid=71939) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 24 16:32:39.470539 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: WARNING keystone.server.flask.application [None req-f6cc70b0-84fa-49f9-8976-0f6fde643304 admin admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Nov 24 16:32:39.471694 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: [pid: 71939|app: 0|req: 393/786] 10.222.0.53 () {56 vars in 1123 bytes} [Wed Nov 24 16:32:39 2021] GET /identity/v3/projects/service => generated 88 bytes in 71 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 24 16:32:39.477739 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ea74ab0-09b5-4f5a-b1b4-a88853b9e074 admin admin] Authenticating user token {{(pid=71938) process_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 24 16:32:39.487621 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ea74ab0-09b5-4f5a-b1b4-a88853b9e074 admin admin] Validating token access rules against request {{(pid=71938) validate_allowed_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 24 16:32:39.491927 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0413bf62-291f-4e40-91bf-1a8b291d043a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f2ba2e8375b4e8c8792ee1e22b60427', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '00a5583c7b7443e98e7a1d31a0b638dc', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=71938) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 24 16:32:39.492583 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0413bf62-291f-4e40-91bf-1a8b291d043a admin admin] REQUEST_METHOD: `GET` {{(pid=71938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 24 16:32:39.492922 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0413bf62-291f-4e40-91bf-1a8b291d043a admin admin] SCRIPT_NAME: `/identity` {{(pid=71938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 24 16:32:39.493256 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0413bf62-291f-4e40-91bf-1a8b291d043a admin admin] PATH_INFO: `/v3/projects` {{(pid=71938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 24 16:32:39.494131 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0413bf62-291f-4e40-91bf-1a8b291d043a admin admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=71938) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:161}} Nov 24 16:32:39.494490 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0413bf62-291f-4e40-91bf-1a8b291d043a admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=71938) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:442}} Nov 24 16:32:39.524053 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0413bf62-291f-4e40-91bf-1a8b291d043a admin admin] RBAC: Authorization granted {{(pid=71938) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 24 16:32:39.537577 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: [pid: 71938|app: 0|req: 394/787] 10.222.0.53 () {56 vars in 1160 bytes} [Wed Nov 24 16:32:39 2021] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 60 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 24 16:32:39.543616 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6cc70b0-84fa-49f9-8976-0f6fde643304 admin admin] Authenticating user token {{(pid=71939) process_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 24 16:32:39.553327 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6cc70b0-84fa-49f9-8976-0f6fde643304 admin admin] Validating token access rules against request {{(pid=71939) validate_allowed_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 24 16:32:39.557705 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9009e284-4047-4a74-a34d-f9a857b45bcd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f2ba2e8375b4e8c8792ee1e22b60427', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '00a5583c7b7443e98e7a1d31a0b638dc', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=71939) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 24 16:32:39.558381 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9009e284-4047-4a74-a34d-f9a857b45bcd admin admin] REQUEST_METHOD: `GET` {{(pid=71939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 24 16:32:39.558722 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9009e284-4047-4a74-a34d-f9a857b45bcd admin admin] SCRIPT_NAME: `/identity` {{(pid=71939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 24 16:32:39.559056 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9009e284-4047-4a74-a34d-f9a857b45bcd admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=71939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 24 16:32:39.559939 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9009e284-4047-4a74-a34d-f9a857b45bcd admin admin] RBAC: Adding query filter params (role.id=2d4a51004ce34308a7a33e68bf2cfc74, scope.project.id=3b3940d4ae1c4177ae29c02377bb4b0b, user.id=a12374a3093a401a97c343ff0854184d) {{(pid=71939) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:161}} Nov 24 16:32:39.560302 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9009e284-4047-4a74-a34d-f9a857b45bcd admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=71939) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:442}} Nov 24 16:32:39.589699 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9009e284-4047-4a74-a34d-f9a857b45bcd admin admin] RBAC: Authorization granted {{(pid=71939) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 24 16:32:39.595301 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: [pid: 71939|app: 0|req: 394/788] 10.222.0.53 () {56 vars in 1386 bytes} [Wed Nov 24 16:32:39 2021] GET /identity/v3/role_assignments?user.id=a12374a3093a401a97c343ff0854184d&scope.project.id=3b3940d4ae1c4177ae29c02377bb4b0b&role.id=2d4a51004ce34308a7a33e68bf2cfc74 => generated 259 bytes in 52 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 24 16:32:41.572435 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9bf1a35-baf9-4551-9a52-849312ad962e None None] REQUEST_METHOD: `GET` {{(pid=71938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 24 16:32:41.572981 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9bf1a35-baf9-4551-9a52-849312ad962e None None] SCRIPT_NAME: `/identity` {{(pid=71938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 24 16:32:41.572981 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9bf1a35-baf9-4551-9a52-849312ad962e None None] PATH_INFO: `/` {{(pid=71938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 24 16:32:41.574896 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: [pid: 71938|app: 0|req: 395/789] 10.222.0.53 () {54 vars in 915 bytes} [Wed Nov 24 16:32:41 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 24 16:32:41.580814 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81c80211-35dd-451c-af85-83df19184fad None None] REQUEST_METHOD: `POST` {{(pid=71939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 24 16:32:41.581167 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81c80211-35dd-451c-af85-83df19184fad None None] SCRIPT_NAME: `/identity` {{(pid=71939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 24 16:32:41.581511 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81c80211-35dd-451c-af85-83df19184fad None None] PATH_INFO: `/v3/auth/tokens` {{(pid=71939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 24 16:32:41.605418 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.auth.core [None req-81c80211-35dd-451c-af85-83df19184fad None None] MFA Rules not processed for user `0f2ba2e8375b4e8c8792ee1e22b60427`. Rule list: `[]` (Enabled: `True`). {{(pid=71939) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:442}} Nov 24 16:32:41.606671 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.fernet_utils [None req-81c80211-35dd-451c-af85-83df19184fad None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=71939) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:289}} Nov 24 16:32:41.614395 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: [pid: 71939|app: 0|req: 395/790] 10.222.0.53 () {58 vars in 1013 bytes} [Wed Nov 24 16:32:41 2021] POST /identity/v3/auth/tokens => generated 1861 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 24 16:32:41.636625 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b8baf51-9556-421f-b3e9-48311518ce2b None None] REQUEST_METHOD: `POST` {{(pid=71938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 24 16:32:41.636971 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b8baf51-9556-421f-b3e9-48311518ce2b None None] SCRIPT_NAME: `/identity` {{(pid=71938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 24 16:32:41.637310 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b8baf51-9556-421f-b3e9-48311518ce2b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=71938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 24 16:32:41.663166 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.auth.core [None req-3b8baf51-9556-421f-b3e9-48311518ce2b None None] MFA Rules not processed for user `0f2ba2e8375b4e8c8792ee1e22b60427`. Rule list: `[]` (Enabled: `True`). {{(pid=71938) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:442}} Nov 24 16:32:41.664988 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.fernet_utils [None req-3b8baf51-9556-421f-b3e9-48311518ce2b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=71938) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:289}} Nov 24 16:32:41.675000 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: [pid: 71938|app: 0|req: 396/791] 10.222.0.53 () {58 vars in 1013 bytes} [Wed Nov 24 16:32:41 2021] POST /identity/v3/auth/tokens => generated 1861 bytes in 39 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 24 16:32:41.682906 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81c80211-35dd-451c-af85-83df19184fad None None] Authenticating user token {{(pid=71939) process_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 24 16:32:41.698279 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81c80211-35dd-451c-af85-83df19184fad None None] Validating token access rules against request {{(pid=71939) validate_allowed_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 24 16:32:41.705323 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-151205f8-311f-4a22-beb2-ca6a207754b1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f2ba2e8375b4e8c8792ee1e22b60427', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '00a5583c7b7443e98e7a1d31a0b638dc', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=71939) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 24 16:32:41.706611 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-151205f8-311f-4a22-beb2-ca6a207754b1 admin admin] REQUEST_METHOD: `GET` {{(pid=71939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 24 16:32:41.707139 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-151205f8-311f-4a22-beb2-ca6a207754b1 admin admin] SCRIPT_NAME: `/identity` {{(pid=71939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 24 16:32:41.707661 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-151205f8-311f-4a22-beb2-ca6a207754b1 admin admin] PATH_INFO: `/v3/roles/service` {{(pid=71939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 24 16:32:41.723688 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-151205f8-311f-4a22-beb2-ca6a207754b1 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=71939) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:401}} Nov 24 16:32:41.734432 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: WARNING keystone.server.flask.application [None req-151205f8-311f-4a22-beb2-ca6a207754b1 admin admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Nov 24 16:32:41.735936 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: [pid: 71939|app: 0|req: 396/792] 10.222.0.53 () {56 vars in 1114 bytes} [Wed Nov 24 16:32:41 2021] GET /identity/v3/roles/service => generated 85 bytes in 54 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 24 16:32:41.742511 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b8baf51-9556-421f-b3e9-48311518ce2b None None] Authenticating user token {{(pid=71938) process_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 24 16:32:41.752267 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b8baf51-9556-421f-b3e9-48311518ce2b None None] Validating token access rules against request {{(pid=71938) validate_allowed_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 24 16:32:41.756585 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e954a3b6-4a10-4683-af60-f2d885241472 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f2ba2e8375b4e8c8792ee1e22b60427', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '00a5583c7b7443e98e7a1d31a0b638dc', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=71938) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 24 16:32:41.757257 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e954a3b6-4a10-4683-af60-f2d885241472 admin admin] REQUEST_METHOD: `GET` {{(pid=71938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 24 16:32:41.757596 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e954a3b6-4a10-4683-af60-f2d885241472 admin admin] SCRIPT_NAME: `/identity` {{(pid=71938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 24 16:32:41.757931 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e954a3b6-4a10-4683-af60-f2d885241472 admin admin] PATH_INFO: `/v3/roles` {{(pid=71938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 24 16:32:41.758887 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e954a3b6-4a10-4683-af60-f2d885241472 admin admin] RBAC: Adding query filter params (name=service) {{(pid=71938) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:161}} Nov 24 16:32:41.759133 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e954a3b6-4a10-4683-af60-f2d885241472 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=71938) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:442}} Nov 24 16:32:41.787886 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e954a3b6-4a10-4683-af60-f2d885241472 admin admin] RBAC: Authorization granted {{(pid=71938) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 24 16:32:41.796738 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: [pid: 71938|app: 0|req: 397/793] 10.222.0.53 () {56 vars in 1115 bytes} [Wed Nov 24 16:32:41 2021] GET /identity/v3/roles?name=service => generated 326 bytes in 55 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 24 16:32:41.802458 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-151205f8-311f-4a22-beb2-ca6a207754b1 admin admin] Authenticating user token {{(pid=71939) process_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 24 16:32:41.813191 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-151205f8-311f-4a22-beb2-ca6a207754b1 admin admin] Validating token access rules against request {{(pid=71939) validate_allowed_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 24 16:32:41.817438 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b3a60a5-bd10-410e-94b7-1351584bd41b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f2ba2e8375b4e8c8792ee1e22b60427', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '00a5583c7b7443e98e7a1d31a0b638dc', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=71939) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 24 16:32:41.818255 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b3a60a5-bd10-410e-94b7-1351584bd41b admin admin] REQUEST_METHOD: `GET` {{(pid=71939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 24 16:32:41.818594 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b3a60a5-bd10-410e-94b7-1351584bd41b admin admin] SCRIPT_NAME: `/identity` {{(pid=71939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 24 16:32:41.818927 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b3a60a5-bd10-410e-94b7-1351584bd41b admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=71939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 24 16:32:41.831397 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b3a60a5-bd10-410e-94b7-1351584bd41b admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=71939) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:442}} Nov 24 16:32:41.859894 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b3a60a5-bd10-410e-94b7-1351584bd41b admin admin] RBAC: Authorization granted {{(pid=71939) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 24 16:32:41.879149 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: WARNING keystone.server.flask.application [None req-2b3a60a5-bd10-410e-94b7-1351584bd41b admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Nov 24 16:32:41.880295 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: [pid: 71939|app: 0|req: 397/794] 10.222.0.53 () {56 vars in 1120 bytes} [Wed Nov 24 16:32:41 2021] GET /identity/v3/domains/Default => generated 87 bytes in 78 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 24 16:32:41.886099 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e954a3b6-4a10-4683-af60-f2d885241472 admin admin] Authenticating user token {{(pid=71938) process_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 24 16:32:41.895856 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e954a3b6-4a10-4683-af60-f2d885241472 admin admin] Validating token access rules against request {{(pid=71938) validate_allowed_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 24 16:32:41.900123 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82206aaf-8712-4f87-8f41-613a900d9462 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f2ba2e8375b4e8c8792ee1e22b60427', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '00a5583c7b7443e98e7a1d31a0b638dc', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=71938) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 24 16:32:41.900779 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82206aaf-8712-4f87-8f41-613a900d9462 admin admin] REQUEST_METHOD: `GET` {{(pid=71938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 24 16:32:41.901118 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82206aaf-8712-4f87-8f41-613a900d9462 admin admin] SCRIPT_NAME: `/identity` {{(pid=71938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 24 16:32:41.901449 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82206aaf-8712-4f87-8f41-613a900d9462 admin admin] PATH_INFO: `/v3/domains` {{(pid=71938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 24 16:32:41.902252 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82206aaf-8712-4f87-8f41-613a900d9462 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=71938) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:161}} Nov 24 16:32:41.902605 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82206aaf-8712-4f87-8f41-613a900d9462 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=71938) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:442}} Nov 24 16:32:41.931220 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82206aaf-8712-4f87-8f41-613a900d9462 admin admin] RBAC: Authorization granted {{(pid=71938) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 24 16:32:41.946968 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: [pid: 71938|app: 0|req: 398/795] 10.222.0.53 () {56 vars in 1121 bytes} [Wed Nov 24 16:32:41 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 61 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 24 16:32:41.953420 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b3a60a5-bd10-410e-94b7-1351584bd41b admin admin] Authenticating user token {{(pid=71939) process_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 24 16:32:41.963261 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b3a60a5-bd10-410e-94b7-1351584bd41b admin admin] Validating token access rules against request {{(pid=71939) validate_allowed_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 24 16:32:41.967524 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71145002-7197-4413-bc80-68b3cdc24eef admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f2ba2e8375b4e8c8792ee1e22b60427', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '00a5583c7b7443e98e7a1d31a0b638dc', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=71939) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 24 16:32:41.968976 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71145002-7197-4413-bc80-68b3cdc24eef admin admin] REQUEST_METHOD: `GET` {{(pid=71939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 24 16:32:41.969320 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71145002-7197-4413-bc80-68b3cdc24eef admin admin] SCRIPT_NAME: `/identity` {{(pid=71939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 24 16:32:41.969656 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71145002-7197-4413-bc80-68b3cdc24eef admin admin] PATH_INFO: `/v3/users/cinder` {{(pid=71939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 24 16:32:41.985065 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71145002-7197-4413-bc80-68b3cdc24eef admin admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=71939) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:442}} Nov 24 16:32:42.013464 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71145002-7197-4413-bc80-68b3cdc24eef admin admin] RBAC: Authorization granted {{(pid=71939) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 24 16:32:42.033970 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: WARNING keystone.server.flask.application [None req-71145002-7197-4413-bc80-68b3cdc24eef admin admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. Nov 24 16:32:42.035174 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: [pid: 71939|app: 0|req: 398/796] 10.222.0.53 () {56 vars in 1111 bytes} [Wed Nov 24 16:32:41 2021] GET /identity/v3/users/cinder => generated 84 bytes in 83 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 24 16:32:42.043176 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82206aaf-8712-4f87-8f41-613a900d9462 admin admin] Authenticating user token {{(pid=71938) process_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 24 16:32:42.056577 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82206aaf-8712-4f87-8f41-613a900d9462 admin admin] Validating token access rules against request {{(pid=71938) validate_allowed_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 24 16:32:42.063092 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b21b16b-277e-4982-b9bf-88015e226726 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f2ba2e8375b4e8c8792ee1e22b60427', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '00a5583c7b7443e98e7a1d31a0b638dc', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=71938) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 24 16:32:42.063772 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b21b16b-277e-4982-b9bf-88015e226726 admin admin] REQUEST_METHOD: `GET` {{(pid=71938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 24 16:32:42.064108 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b21b16b-277e-4982-b9bf-88015e226726 admin admin] SCRIPT_NAME: `/identity` {{(pid=71938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 24 16:32:42.064495 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b21b16b-277e-4982-b9bf-88015e226726 admin admin] PATH_INFO: `/v3/users` {{(pid=71938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 24 16:32:42.065900 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b21b16b-277e-4982-b9bf-88015e226726 admin admin] RBAC: Adding query filter params (domain_id=default, name=cinder) {{(pid=71938) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:161}} Nov 24 16:32:42.066285 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b21b16b-277e-4982-b9bf-88015e226726 admin admin] RBAC: Authorizing `identity:list_users()` {{(pid=71938) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:442}} Nov 24 16:32:42.095847 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b21b16b-277e-4982-b9bf-88015e226726 admin admin] RBAC: Authorization granted {{(pid=71938) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 24 16:32:42.126453 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: [pid: 71938|app: 0|req: 399/797] 10.222.0.53 () {56 vars in 1149 bytes} [Wed Nov 24 16:32:42 2021] GET /identity/v3/users?domain_id=default&name=cinder => generated 372 bytes in 85 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 24 16:32:42.132499 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71145002-7197-4413-bc80-68b3cdc24eef admin admin] Authenticating user token {{(pid=71939) process_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 24 16:32:42.142908 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71145002-7197-4413-bc80-68b3cdc24eef admin admin] Validating token access rules against request {{(pid=71939) validate_allowed_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 24 16:32:42.147089 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f28596e-b187-4490-ac37-7d424f5cdfd7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f2ba2e8375b4e8c8792ee1e22b60427', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '00a5583c7b7443e98e7a1d31a0b638dc', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=71939) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 24 16:32:42.147887 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f28596e-b187-4490-ac37-7d424f5cdfd7 admin admin] REQUEST_METHOD: `GET` {{(pid=71939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 24 16:32:42.148225 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f28596e-b187-4490-ac37-7d424f5cdfd7 admin admin] SCRIPT_NAME: `/identity` {{(pid=71939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 24 16:32:42.148555 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f28596e-b187-4490-ac37-7d424f5cdfd7 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=71939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 24 16:32:42.162060 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f28596e-b187-4490-ac37-7d424f5cdfd7 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=71939) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:442}} Nov 24 16:32:42.190803 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f28596e-b187-4490-ac37-7d424f5cdfd7 admin admin] RBAC: Authorization granted {{(pid=71939) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 24 16:32:42.210445 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: WARNING keystone.server.flask.application [None req-9f28596e-b187-4490-ac37-7d424f5cdfd7 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Nov 24 16:32:42.213348 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: [pid: 71939|app: 0|req: 399/798] 10.222.0.53 () {56 vars in 1120 bytes} [Wed Nov 24 16:32:42 2021] GET /identity/v3/domains/Default => generated 87 bytes in 80 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 24 16:32:42.217706 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b21b16b-277e-4982-b9bf-88015e226726 admin admin] Authenticating user token {{(pid=71938) process_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 24 16:32:42.227570 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b21b16b-277e-4982-b9bf-88015e226726 admin admin] Validating token access rules against request {{(pid=71938) validate_allowed_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 24 16:32:42.231839 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30c2a266-8ca9-4458-8d00-f25beeb82177 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f2ba2e8375b4e8c8792ee1e22b60427', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '00a5583c7b7443e98e7a1d31a0b638dc', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=71938) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 24 16:32:42.232501 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30c2a266-8ca9-4458-8d00-f25beeb82177 admin admin] REQUEST_METHOD: `GET` {{(pid=71938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 24 16:32:42.232837 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30c2a266-8ca9-4458-8d00-f25beeb82177 admin admin] SCRIPT_NAME: `/identity` {{(pid=71938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 24 16:32:42.233163 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30c2a266-8ca9-4458-8d00-f25beeb82177 admin admin] PATH_INFO: `/v3/domains` {{(pid=71938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 24 16:32:42.233936 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30c2a266-8ca9-4458-8d00-f25beeb82177 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=71938) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:161}} Nov 24 16:32:42.234320 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30c2a266-8ca9-4458-8d00-f25beeb82177 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=71938) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:442}} Nov 24 16:32:42.262565 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30c2a266-8ca9-4458-8d00-f25beeb82177 admin admin] RBAC: Authorization granted {{(pid=71938) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 24 16:32:42.275687 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: [pid: 71938|app: 0|req: 400/799] 10.222.0.53 () {56 vars in 1121 bytes} [Wed Nov 24 16:32:42 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 59 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 24 16:32:42.281380 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f28596e-b187-4490-ac37-7d424f5cdfd7 admin admin] Authenticating user token {{(pid=71939) process_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 24 16:32:42.291243 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f28596e-b187-4490-ac37-7d424f5cdfd7 admin admin] Validating token access rules against request {{(pid=71939) validate_allowed_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 24 16:32:42.295446 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f019c36-2203-4f30-b6d3-9665343b6128 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f2ba2e8375b4e8c8792ee1e22b60427', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '00a5583c7b7443e98e7a1d31a0b638dc', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=71939) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 24 16:32:42.296232 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f019c36-2203-4f30-b6d3-9665343b6128 admin admin] REQUEST_METHOD: `GET` {{(pid=71939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 24 16:32:42.296645 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f019c36-2203-4f30-b6d3-9665343b6128 admin admin] SCRIPT_NAME: `/identity` {{(pid=71939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 24 16:32:42.296981 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f019c36-2203-4f30-b6d3-9665343b6128 admin admin] PATH_INFO: `/v3/projects/service` {{(pid=71939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 24 16:32:42.307494 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f019c36-2203-4f30-b6d3-9665343b6128 admin admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=71939) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:442}} Nov 24 16:32:42.337956 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f019c36-2203-4f30-b6d3-9665343b6128 admin admin] RBAC: Authorization granted {{(pid=71939) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 24 16:32:42.353631 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: WARNING keystone.server.flask.application [None req-1f019c36-2203-4f30-b6d3-9665343b6128 admin admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Nov 24 16:32:42.354805 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: [pid: 71939|app: 0|req: 400/800] 10.222.0.53 () {56 vars in 1123 bytes} [Wed Nov 24 16:32:42 2021] GET /identity/v3/projects/service => generated 88 bytes in 74 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 24 16:32:42.361123 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30c2a266-8ca9-4458-8d00-f25beeb82177 admin admin] Authenticating user token {{(pid=71938) process_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 24 16:32:42.371160 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30c2a266-8ca9-4458-8d00-f25beeb82177 admin admin] Validating token access rules against request {{(pid=71938) validate_allowed_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 24 16:32:42.375962 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96d7ac95-479c-4450-9a45-54dbafe9a9ce admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f2ba2e8375b4e8c8792ee1e22b60427', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '00a5583c7b7443e98e7a1d31a0b638dc', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=71938) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 24 16:32:42.376631 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96d7ac95-479c-4450-9a45-54dbafe9a9ce admin admin] REQUEST_METHOD: `GET` {{(pid=71938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 24 16:32:42.376976 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96d7ac95-479c-4450-9a45-54dbafe9a9ce admin admin] SCRIPT_NAME: `/identity` {{(pid=71938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 24 16:32:42.379460 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96d7ac95-479c-4450-9a45-54dbafe9a9ce admin admin] PATH_INFO: `/v3/projects` {{(pid=71938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 24 16:32:42.379460 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96d7ac95-479c-4450-9a45-54dbafe9a9ce admin admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=71938) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:161}} Nov 24 16:32:42.379460 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96d7ac95-479c-4450-9a45-54dbafe9a9ce admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=71938) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:442}} Nov 24 16:32:42.407840 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96d7ac95-479c-4450-9a45-54dbafe9a9ce admin admin] RBAC: Authorization granted {{(pid=71938) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 24 16:32:42.421897 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: [pid: 71938|app: 0|req: 401/801] 10.222.0.53 () {56 vars in 1160 bytes} [Wed Nov 24 16:32:42 2021] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 61 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 24 16:32:42.428159 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f019c36-2203-4f30-b6d3-9665343b6128 admin admin] Authenticating user token {{(pid=71939) process_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 24 16:32:42.438438 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f019c36-2203-4f30-b6d3-9665343b6128 admin admin] Validating token access rules against request {{(pid=71939) validate_allowed_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 24 16:32:42.442928 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a678f43-52f2-44d0-9ab6-a57c9f756a18 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f2ba2e8375b4e8c8792ee1e22b60427', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '00a5583c7b7443e98e7a1d31a0b638dc', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=71939) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 24 16:32:42.443837 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a678f43-52f2-44d0-9ab6-a57c9f756a18 admin admin] REQUEST_METHOD: `PUT` {{(pid=71939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 24 16:32:42.444188 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a678f43-52f2-44d0-9ab6-a57c9f756a18 admin admin] SCRIPT_NAME: `/identity` {{(pid=71939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 24 16:32:42.444523 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a678f43-52f2-44d0-9ab6-a57c9f756a18 admin admin] PATH_INFO: `/v3/projects/3b3940d4ae1c4177ae29c02377bb4b0b/users/a12374a3093a401a97c343ff0854184d/roles/2d4a51004ce34308a7a33e68bf2cfc74` {{(pid=71939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 24 16:32:42.466139 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a678f43-52f2-44d0-9ab6-a57c9f756a18 admin admin] RBAC: Authorizing `identity:create_grant(project_id=3b3940d4ae1c4177ae29c02377bb4b0b, user_id=a12374a3093a401a97c343ff0854184d, role_id=2d4a51004ce34308a7a33e68bf2cfc74)` {{(pid=71939) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:442}} Nov 24 16:32:42.495007 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a678f43-52f2-44d0-9ab6-a57c9f756a18 admin admin] RBAC: Authorization granted {{(pid=71939) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 24 16:32:42.506712 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: [pid: 71939|app: 0|req: 401/802] 10.222.0.53 () {58 vars in 1451 bytes} [Wed Nov 24 16:32:42 2021] PUT /identity/v3/projects/3b3940d4ae1c4177ae29c02377bb4b0b/users/a12374a3093a401a97c343ff0854184d/roles/2d4a51004ce34308a7a33e68bf2cfc74 => generated 0 bytes in 79 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 24 16:32:44.477402 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cff10154-1d87-4a18-98b2-f51728c46554 None None] REQUEST_METHOD: `GET` {{(pid=71938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 24 16:32:44.477896 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cff10154-1d87-4a18-98b2-f51728c46554 None None] SCRIPT_NAME: `/identity` {{(pid=71938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 24 16:32:44.478106 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cff10154-1d87-4a18-98b2-f51728c46554 None None] PATH_INFO: `/` {{(pid=71938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 24 16:32:44.479947 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: [pid: 71938|app: 0|req: 402/803] 10.222.0.53 () {54 vars in 915 bytes} [Wed Nov 24 16:32:44 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 24 16:32:44.485682 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4244dc3-5d8c-4902-9d44-64458579354b None None] REQUEST_METHOD: `POST` {{(pid=71939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 24 16:32:44.486059 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4244dc3-5d8c-4902-9d44-64458579354b None None] SCRIPT_NAME: `/identity` {{(pid=71939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 24 16:32:44.486389 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4244dc3-5d8c-4902-9d44-64458579354b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=71939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 24 16:32:44.509974 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.auth.core [None req-c4244dc3-5d8c-4902-9d44-64458579354b None None] MFA Rules not processed for user `0f2ba2e8375b4e8c8792ee1e22b60427`. Rule list: `[]` (Enabled: `True`). {{(pid=71939) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:442}} Nov 24 16:32:44.511222 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.fernet_utils [None req-c4244dc3-5d8c-4902-9d44-64458579354b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=71939) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:289}} Nov 24 16:32:44.578183 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: [pid: 71939|app: 0|req: 402/804] 10.222.0.53 () {58 vars in 1013 bytes} [Wed Nov 24 16:32:44 2021] POST /identity/v3/auth/tokens => generated 1861 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 24 16:32:44.600581 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16ecd867-3a16-4803-b87d-0ce66b58e42f None None] REQUEST_METHOD: `POST` {{(pid=71938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 24 16:32:44.600932 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16ecd867-3a16-4803-b87d-0ce66b58e42f None None] SCRIPT_NAME: `/identity` {{(pid=71938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 24 16:32:44.601272 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16ecd867-3a16-4803-b87d-0ce66b58e42f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=71938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 24 16:32:44.624716 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.auth.core [None req-16ecd867-3a16-4803-b87d-0ce66b58e42f None None] MFA Rules not processed for user `0f2ba2e8375b4e8c8792ee1e22b60427`. Rule list: `[]` (Enabled: `True`). {{(pid=71938) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:442}} Nov 24 16:32:44.625939 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.fernet_utils [None req-16ecd867-3a16-4803-b87d-0ce66b58e42f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=71938) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:289}} Nov 24 16:32:44.633105 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: [pid: 71938|app: 0|req: 403/805] 10.222.0.53 () {58 vars in 1013 bytes} [Wed Nov 24 16:32:44 2021] POST /identity/v3/auth/tokens => generated 1861 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 24 16:32:44.638780 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4244dc3-5d8c-4902-9d44-64458579354b None None] Authenticating user token {{(pid=71939) process_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 24 16:32:44.648966 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4244dc3-5d8c-4902-9d44-64458579354b None None] Validating token access rules against request {{(pid=71939) validate_allowed_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 24 16:32:44.653212 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-884dfcf2-28cb-4c9c-bbda-5c00ea133ffd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f2ba2e8375b4e8c8792ee1e22b60427', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '00a5583c7b7443e98e7a1d31a0b638dc', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=71939) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 24 16:32:44.654058 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-884dfcf2-28cb-4c9c-bbda-5c00ea133ffd admin admin] REQUEST_METHOD: `GET` {{(pid=71939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 24 16:32:44.654410 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-884dfcf2-28cb-4c9c-bbda-5c00ea133ffd admin admin] SCRIPT_NAME: `/identity` {{(pid=71939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 24 16:32:44.654745 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-884dfcf2-28cb-4c9c-bbda-5c00ea133ffd admin admin] PATH_INFO: `/v3/roles/service` {{(pid=71939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 24 16:32:44.666715 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-884dfcf2-28cb-4c9c-bbda-5c00ea133ffd admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=71939) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:401}} Nov 24 16:32:44.682189 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: WARNING keystone.server.flask.application [None req-884dfcf2-28cb-4c9c-bbda-5c00ea133ffd admin admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Nov 24 16:32:44.683665 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: [pid: 71939|app: 0|req: 403/806] 10.222.0.53 () {56 vars in 1114 bytes} [Wed Nov 24 16:32:44 2021] GET /identity/v3/roles/service => generated 85 bytes in 45 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 24 16:32:44.691373 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16ecd867-3a16-4803-b87d-0ce66b58e42f None None] Authenticating user token {{(pid=71938) process_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 24 16:32:44.704722 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16ecd867-3a16-4803-b87d-0ce66b58e42f None None] Validating token access rules against request {{(pid=71938) validate_allowed_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 24 16:32:44.709785 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2881ca1-eb58-4bb0-911d-360a1c2863a9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f2ba2e8375b4e8c8792ee1e22b60427', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '00a5583c7b7443e98e7a1d31a0b638dc', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=71938) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 24 16:32:44.710494 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2881ca1-eb58-4bb0-911d-360a1c2863a9 admin admin] REQUEST_METHOD: `GET` {{(pid=71938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 24 16:32:44.710833 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2881ca1-eb58-4bb0-911d-360a1c2863a9 admin admin] SCRIPT_NAME: `/identity` {{(pid=71938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 24 16:32:44.711165 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2881ca1-eb58-4bb0-911d-360a1c2863a9 admin admin] PATH_INFO: `/v3/roles` {{(pid=71938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 24 16:32:44.711973 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2881ca1-eb58-4bb0-911d-360a1c2863a9 admin admin] RBAC: Adding query filter params (name=service) {{(pid=71938) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:161}} Nov 24 16:32:44.712323 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2881ca1-eb58-4bb0-911d-360a1c2863a9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=71938) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:442}} Nov 24 16:32:44.745206 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2881ca1-eb58-4bb0-911d-360a1c2863a9 admin admin] RBAC: Authorization granted {{(pid=71938) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 24 16:32:44.754961 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: [pid: 71938|app: 0|req: 404/807] 10.222.0.53 () {56 vars in 1115 bytes} [Wed Nov 24 16:32:44 2021] GET /identity/v3/roles?name=service => generated 326 bytes in 64 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 24 16:32:44.760961 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-884dfcf2-28cb-4c9c-bbda-5c00ea133ffd admin admin] Authenticating user token {{(pid=71939) process_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 24 16:32:44.771914 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-884dfcf2-28cb-4c9c-bbda-5c00ea133ffd admin admin] Validating token access rules against request {{(pid=71939) validate_allowed_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 24 16:32:44.776160 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a2964a6-8c78-41d4-852a-3cb1b69f1bfe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f2ba2e8375b4e8c8792ee1e22b60427', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '00a5583c7b7443e98e7a1d31a0b638dc', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=71939) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 24 16:32:44.776962 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a2964a6-8c78-41d4-852a-3cb1b69f1bfe admin admin] REQUEST_METHOD: `GET` {{(pid=71939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 24 16:32:44.777307 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a2964a6-8c78-41d4-852a-3cb1b69f1bfe admin admin] SCRIPT_NAME: `/identity` {{(pid=71939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 24 16:32:44.777645 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a2964a6-8c78-41d4-852a-3cb1b69f1bfe admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=71939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 24 16:32:44.789289 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a2964a6-8c78-41d4-852a-3cb1b69f1bfe admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=71939) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:442}} Nov 24 16:32:44.817836 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a2964a6-8c78-41d4-852a-3cb1b69f1bfe admin admin] RBAC: Authorization granted {{(pid=71939) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 24 16:32:44.837401 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: WARNING keystone.server.flask.application [None req-8a2964a6-8c78-41d4-852a-3cb1b69f1bfe admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Nov 24 16:32:44.838612 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: [pid: 71939|app: 0|req: 404/808] 10.222.0.53 () {56 vars in 1120 bytes} [Wed Nov 24 16:32:44 2021] GET /identity/v3/domains/Default => generated 87 bytes in 78 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 24 16:32:44.844533 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2881ca1-eb58-4bb0-911d-360a1c2863a9 admin admin] Authenticating user token {{(pid=71938) process_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 24 16:32:44.854442 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2881ca1-eb58-4bb0-911d-360a1c2863a9 admin admin] Validating token access rules against request {{(pid=71938) validate_allowed_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 24 16:32:44.859215 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57403ea5-23c9-48e7-b1df-123c42273994 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f2ba2e8375b4e8c8792ee1e22b60427', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '00a5583c7b7443e98e7a1d31a0b638dc', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=71938) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 24 16:32:44.859875 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57403ea5-23c9-48e7-b1df-123c42273994 admin admin] REQUEST_METHOD: `GET` {{(pid=71938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 24 16:32:44.860214 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57403ea5-23c9-48e7-b1df-123c42273994 admin admin] SCRIPT_NAME: `/identity` {{(pid=71938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 24 16:32:44.860547 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57403ea5-23c9-48e7-b1df-123c42273994 admin admin] PATH_INFO: `/v3/domains` {{(pid=71938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 24 16:32:44.861331 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57403ea5-23c9-48e7-b1df-123c42273994 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=71938) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:161}} Nov 24 16:32:44.861680 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57403ea5-23c9-48e7-b1df-123c42273994 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=71938) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:442}} Nov 24 16:32:44.890258 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57403ea5-23c9-48e7-b1df-123c42273994 admin admin] RBAC: Authorization granted {{(pid=71938) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 24 16:32:44.903526 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: [pid: 71938|app: 0|req: 405/809] 10.222.0.53 () {56 vars in 1121 bytes} [Wed Nov 24 16:32:44 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 59 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 24 16:32:44.909168 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a2964a6-8c78-41d4-852a-3cb1b69f1bfe admin admin] Authenticating user token {{(pid=71939) process_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 24 16:32:44.918947 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a2964a6-8c78-41d4-852a-3cb1b69f1bfe admin admin] Validating token access rules against request {{(pid=71939) validate_allowed_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 24 16:32:44.923722 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7842ffc6-3c29-4913-a536-209438cf59ba admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f2ba2e8375b4e8c8792ee1e22b60427', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '00a5583c7b7443e98e7a1d31a0b638dc', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=71939) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 24 16:32:44.924520 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7842ffc6-3c29-4913-a536-209438cf59ba admin admin] REQUEST_METHOD: `GET` {{(pid=71939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 24 16:32:44.924861 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7842ffc6-3c29-4913-a536-209438cf59ba admin admin] SCRIPT_NAME: `/identity` {{(pid=71939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 24 16:32:44.925195 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7842ffc6-3c29-4913-a536-209438cf59ba admin admin] PATH_INFO: `/v3/users/cinder` {{(pid=71939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 24 16:32:44.939005 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7842ffc6-3c29-4913-a536-209438cf59ba admin admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=71939) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:442}} Nov 24 16:32:44.967459 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7842ffc6-3c29-4913-a536-209438cf59ba admin admin] RBAC: Authorization granted {{(pid=71939) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 24 16:32:44.987288 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: WARNING keystone.server.flask.application [None req-7842ffc6-3c29-4913-a536-209438cf59ba admin admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. Nov 24 16:32:44.988445 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: [pid: 71939|app: 0|req: 405/810] 10.222.0.53 () {56 vars in 1111 bytes} [Wed Nov 24 16:32:44 2021] GET /identity/v3/users/cinder => generated 84 bytes in 80 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 24 16:32:44.994379 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57403ea5-23c9-48e7-b1df-123c42273994 admin admin] Authenticating user token {{(pid=71938) process_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 24 16:32:45.005708 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57403ea5-23c9-48e7-b1df-123c42273994 admin admin] Validating token access rules against request {{(pid=71938) validate_allowed_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 24 16:32:45.009956 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dd1280c-3d42-4f88-be29-bd44bfc89e1c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f2ba2e8375b4e8c8792ee1e22b60427', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '00a5583c7b7443e98e7a1d31a0b638dc', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=71938) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 24 16:32:45.010669 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dd1280c-3d42-4f88-be29-bd44bfc89e1c admin admin] REQUEST_METHOD: `GET` {{(pid=71938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 24 16:32:45.015282 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dd1280c-3d42-4f88-be29-bd44bfc89e1c admin admin] SCRIPT_NAME: `/identity` {{(pid=71938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 24 16:32:45.015651 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dd1280c-3d42-4f88-be29-bd44bfc89e1c admin admin] PATH_INFO: `/v3/users` {{(pid=71938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 24 16:32:45.016806 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9dd1280c-3d42-4f88-be29-bd44bfc89e1c admin admin] RBAC: Adding query filter params (domain_id=default, name=cinder) {{(pid=71938) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:161}} Nov 24 16:32:45.017228 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9dd1280c-3d42-4f88-be29-bd44bfc89e1c admin admin] RBAC: Authorizing `identity:list_users()` {{(pid=71938) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:442}} Nov 24 16:32:45.051547 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9dd1280c-3d42-4f88-be29-bd44bfc89e1c admin admin] RBAC: Authorization granted {{(pid=71938) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 24 16:32:45.083800 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: [pid: 71938|app: 0|req: 406/811] 10.222.0.53 () {56 vars in 1149 bytes} [Wed Nov 24 16:32:44 2021] GET /identity/v3/users?domain_id=default&name=cinder => generated 372 bytes in 90 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 24 16:32:45.089855 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7842ffc6-3c29-4913-a536-209438cf59ba admin admin] Authenticating user token {{(pid=71939) process_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 24 16:32:45.099735 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7842ffc6-3c29-4913-a536-209438cf59ba admin admin] Validating token access rules against request {{(pid=71939) validate_allowed_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 24 16:32:45.104042 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fd02bd0-4a6c-44a2-9366-4785170e0786 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f2ba2e8375b4e8c8792ee1e22b60427', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '00a5583c7b7443e98e7a1d31a0b638dc', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=71939) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 24 16:32:45.104678 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fd02bd0-4a6c-44a2-9366-4785170e0786 admin admin] REQUEST_METHOD: `GET` {{(pid=71939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 24 16:32:45.105010 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fd02bd0-4a6c-44a2-9366-4785170e0786 admin admin] SCRIPT_NAME: `/identity` {{(pid=71939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 24 16:32:45.105340 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fd02bd0-4a6c-44a2-9366-4785170e0786 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=71939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 24 16:32:45.114644 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fd02bd0-4a6c-44a2-9366-4785170e0786 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=71939) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:442}} Nov 24 16:32:45.143075 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fd02bd0-4a6c-44a2-9366-4785170e0786 admin admin] RBAC: Authorization granted {{(pid=71939) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 24 16:32:45.151877 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: [pid: 71939|app: 0|req: 406/812] 10.222.0.53 () {58 vars in 1315 bytes} [Wed Nov 24 16:32:45 2021] GET /identity/v3/auth/tokens => generated 1861 bytes in 63 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 24 16:32:45.158051 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dd1280c-3d42-4f88-be29-bd44bfc89e1c admin admin] Authenticating user token {{(pid=71938) process_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 24 16:32:45.167806 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dd1280c-3d42-4f88-be29-bd44bfc89e1c admin admin] Validating token access rules against request {{(pid=71938) validate_allowed_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 24 16:32:45.172561 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42d571c5-68ed-4b59-ada1-311e4b10b381 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f2ba2e8375b4e8c8792ee1e22b60427', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '00a5583c7b7443e98e7a1d31a0b638dc', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=71938) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 24 16:32:45.173362 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42d571c5-68ed-4b59-ada1-311e4b10b381 admin admin] REQUEST_METHOD: `GET` {{(pid=71938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 24 16:32:45.173699 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42d571c5-68ed-4b59-ada1-311e4b10b381 admin admin] SCRIPT_NAME: `/identity` {{(pid=71938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 24 16:32:45.174076 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42d571c5-68ed-4b59-ada1-311e4b10b381 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=71938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 24 16:32:45.186669 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42d571c5-68ed-4b59-ada1-311e4b10b381 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=71938) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:442}} Nov 24 16:32:45.215673 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42d571c5-68ed-4b59-ada1-311e4b10b381 admin admin] RBAC: Authorization granted {{(pid=71938) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 24 16:32:45.235291 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: WARNING keystone.server.flask.application [None req-42d571c5-68ed-4b59-ada1-311e4b10b381 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Nov 24 16:32:45.236482 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: [pid: 71938|app: 0|req: 407/813] 10.222.0.53 () {56 vars in 1120 bytes} [Wed Nov 24 16:32:45 2021] GET /identity/v3/domains/Default => generated 87 bytes in 79 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 24 16:32:45.242578 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fd02bd0-4a6c-44a2-9366-4785170e0786 admin admin] Authenticating user token {{(pid=71939) process_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 24 16:32:45.251704 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fd02bd0-4a6c-44a2-9366-4785170e0786 admin admin] Validating token access rules against request {{(pid=71939) validate_allowed_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 24 16:32:45.256106 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c7e5753-59c1-4f0f-9433-708d4e2cc0c2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f2ba2e8375b4e8c8792ee1e22b60427', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '00a5583c7b7443e98e7a1d31a0b638dc', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=71939) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 24 16:32:45.256701 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c7e5753-59c1-4f0f-9433-708d4e2cc0c2 admin admin] REQUEST_METHOD: `GET` {{(pid=71939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 24 16:32:45.257040 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c7e5753-59c1-4f0f-9433-708d4e2cc0c2 admin admin] SCRIPT_NAME: `/identity` {{(pid=71939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 24 16:32:45.257374 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c7e5753-59c1-4f0f-9433-708d4e2cc0c2 admin admin] PATH_INFO: `/v3/domains` {{(pid=71939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 24 16:32:45.258199 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c7e5753-59c1-4f0f-9433-708d4e2cc0c2 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=71939) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:161}} Nov 24 16:32:45.258554 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c7e5753-59c1-4f0f-9433-708d4e2cc0c2 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=71939) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:442}} Nov 24 16:32:45.286903 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c7e5753-59c1-4f0f-9433-708d4e2cc0c2 admin admin] RBAC: Authorization granted {{(pid=71939) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 24 16:32:45.299974 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: [pid: 71939|app: 0|req: 407/814] 10.222.0.53 () {56 vars in 1121 bytes} [Wed Nov 24 16:32:45 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 58 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 24 16:32:45.305520 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42d571c5-68ed-4b59-ada1-311e4b10b381 admin admin] Authenticating user token {{(pid=71938) process_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 24 16:32:45.315230 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42d571c5-68ed-4b59-ada1-311e4b10b381 admin admin] Validating token access rules against request {{(pid=71938) validate_allowed_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 24 16:32:45.319391 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-754ac921-b5b4-4207-9168-736c8fe2fa8a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f2ba2e8375b4e8c8792ee1e22b60427', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '00a5583c7b7443e98e7a1d31a0b638dc', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=71938) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 24 16:32:45.320177 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-754ac921-b5b4-4207-9168-736c8fe2fa8a admin admin] REQUEST_METHOD: `GET` {{(pid=71938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 24 16:32:45.320514 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-754ac921-b5b4-4207-9168-736c8fe2fa8a admin admin] SCRIPT_NAME: `/identity` {{(pid=71938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 24 16:32:45.320837 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-754ac921-b5b4-4207-9168-736c8fe2fa8a admin admin] PATH_INFO: `/v3/projects/service` {{(pid=71938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 24 16:32:45.330752 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-754ac921-b5b4-4207-9168-736c8fe2fa8a admin admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=71938) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:442}} Nov 24 16:32:45.360693 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-754ac921-b5b4-4207-9168-736c8fe2fa8a admin admin] RBAC: Authorization granted {{(pid=71938) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 24 16:32:45.375900 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: WARNING keystone.server.flask.application [None req-754ac921-b5b4-4207-9168-736c8fe2fa8a admin admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Nov 24 16:32:45.377063 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: [pid: 71938|app: 0|req: 408/815] 10.222.0.53 () {56 vars in 1123 bytes} [Wed Nov 24 16:32:45 2021] GET /identity/v3/projects/service => generated 88 bytes in 72 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 24 16:32:45.383255 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c7e5753-59c1-4f0f-9433-708d4e2cc0c2 admin admin] Authenticating user token {{(pid=71939) process_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 24 16:32:45.393236 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c7e5753-59c1-4f0f-9433-708d4e2cc0c2 admin admin] Validating token access rules against request {{(pid=71939) validate_allowed_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 24 16:32:45.397534 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-028158e8-2af2-4f25-be10-b90baeadfd2c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f2ba2e8375b4e8c8792ee1e22b60427', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '00a5583c7b7443e98e7a1d31a0b638dc', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=71939) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 24 16:32:45.398220 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-028158e8-2af2-4f25-be10-b90baeadfd2c admin admin] REQUEST_METHOD: `GET` {{(pid=71939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 24 16:32:45.398568 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-028158e8-2af2-4f25-be10-b90baeadfd2c admin admin] SCRIPT_NAME: `/identity` {{(pid=71939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 24 16:32:45.398901 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-028158e8-2af2-4f25-be10-b90baeadfd2c admin admin] PATH_INFO: `/v3/projects` {{(pid=71939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 24 16:32:45.399744 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-028158e8-2af2-4f25-be10-b90baeadfd2c admin admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=71939) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:161}} Nov 24 16:32:45.400105 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-028158e8-2af2-4f25-be10-b90baeadfd2c admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=71939) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:442}} Nov 24 16:32:45.429410 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-028158e8-2af2-4f25-be10-b90baeadfd2c admin admin] RBAC: Authorization granted {{(pid=71939) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 24 16:32:45.442871 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: [pid: 71939|app: 0|req: 408/816] 10.222.0.53 () {56 vars in 1160 bytes} [Wed Nov 24 16:32:45 2021] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 60 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 24 16:32:45.448827 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-754ac921-b5b4-4207-9168-736c8fe2fa8a admin admin] Authenticating user token {{(pid=71938) process_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 24 16:32:45.458896 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-754ac921-b5b4-4207-9168-736c8fe2fa8a admin admin] Validating token access rules against request {{(pid=71938) validate_allowed_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 24 16:32:45.463125 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d3e399f-1453-4c83-860b-0179d33cfc28 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f2ba2e8375b4e8c8792ee1e22b60427', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '00a5583c7b7443e98e7a1d31a0b638dc', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=71938) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 24 16:32:45.463770 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d3e399f-1453-4c83-860b-0179d33cfc28 admin admin] REQUEST_METHOD: `GET` {{(pid=71938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 24 16:32:45.464107 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d3e399f-1453-4c83-860b-0179d33cfc28 admin admin] SCRIPT_NAME: `/identity` {{(pid=71938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 24 16:32:45.464434 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d3e399f-1453-4c83-860b-0179d33cfc28 admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=71938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 24 16:32:45.465315 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d3e399f-1453-4c83-860b-0179d33cfc28 admin admin] RBAC: Adding query filter params (role.id=2d4a51004ce34308a7a33e68bf2cfc74, scope.project.id=3b3940d4ae1c4177ae29c02377bb4b0b, user.id=a12374a3093a401a97c343ff0854184d) {{(pid=71938) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:161}} Nov 24 16:32:45.465673 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d3e399f-1453-4c83-860b-0179d33cfc28 admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=71938) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:442}} Nov 24 16:32:45.496083 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d3e399f-1453-4c83-860b-0179d33cfc28 admin admin] RBAC: Authorization granted {{(pid=71938) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 24 16:32:45.502233 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: [pid: 71938|app: 0|req: 409/817] 10.222.0.53 () {56 vars in 1386 bytes} [Wed Nov 24 16:32:45 2021] GET /identity/v3/role_assignments?user.id=a12374a3093a401a97c343ff0854184d&scope.project.id=3b3940d4ae1c4177ae29c02377bb4b0b&role.id=2d4a51004ce34308a7a33e68bf2cfc74 => generated 608 bytes in 54 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 24 16:32:47.481051 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb38d9aa-89f6-45e1-b8b1-7dc7ed8e0713 None None] REQUEST_METHOD: `GET` {{(pid=71939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 24 16:32:47.481541 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb38d9aa-89f6-45e1-b8b1-7dc7ed8e0713 None None] SCRIPT_NAME: `/identity` {{(pid=71939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 24 16:32:47.481664 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb38d9aa-89f6-45e1-b8b1-7dc7ed8e0713 None None] PATH_INFO: `/` {{(pid=71939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 24 16:32:47.483589 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: [pid: 71939|app: 0|req: 409/818] 10.222.0.53 () {54 vars in 915 bytes} [Wed Nov 24 16:32:47 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 24 16:32:47.488939 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f28090d0-a8f9-4694-9735-70eeca68370b None None] REQUEST_METHOD: `POST` {{(pid=71938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 24 16:32:47.489290 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f28090d0-a8f9-4694-9735-70eeca68370b None None] SCRIPT_NAME: `/identity` {{(pid=71938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 24 16:32:47.489623 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f28090d0-a8f9-4694-9735-70eeca68370b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=71938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 24 16:32:47.513661 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.auth.core [None req-f28090d0-a8f9-4694-9735-70eeca68370b None None] MFA Rules not processed for user `0f2ba2e8375b4e8c8792ee1e22b60427`. Rule list: `[]` (Enabled: `True`). {{(pid=71938) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:442}} Nov 24 16:32:47.515487 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.fernet_utils [None req-f28090d0-a8f9-4694-9735-70eeca68370b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=71938) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:289}} Nov 24 16:32:47.522651 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: [pid: 71938|app: 0|req: 410/819] 10.222.0.53 () {58 vars in 1013 bytes} [Wed Nov 24 16:32:47 2021] POST /identity/v3/auth/tokens => generated 1861 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 24 16:32:47.543803 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef97d885-8b67-491d-8786-7b93695a2e6a None None] REQUEST_METHOD: `POST` {{(pid=71939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 24 16:32:47.544153 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef97d885-8b67-491d-8786-7b93695a2e6a None None] SCRIPT_NAME: `/identity` {{(pid=71939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 24 16:32:47.544496 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef97d885-8b67-491d-8786-7b93695a2e6a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=71939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 24 16:32:47.570660 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.auth.core [None req-ef97d885-8b67-491d-8786-7b93695a2e6a None None] MFA Rules not processed for user `0f2ba2e8375b4e8c8792ee1e22b60427`. Rule list: `[]` (Enabled: `True`). {{(pid=71939) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:442}} Nov 24 16:32:47.571896 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.fernet_utils [None req-ef97d885-8b67-491d-8786-7b93695a2e6a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=71939) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:289}} Nov 24 16:32:47.579872 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: [pid: 71939|app: 0|req: 410/820] 10.222.0.53 () {58 vars in 1013 bytes} [Wed Nov 24 16:32:47 2021] POST /identity/v3/auth/tokens => generated 1861 bytes in 37 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 24 16:32:47.585615 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f28090d0-a8f9-4694-9735-70eeca68370b None None] Authenticating user token {{(pid=71938) process_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 24 16:32:47.595167 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f28090d0-a8f9-4694-9735-70eeca68370b None None] Validating token access rules against request {{(pid=71938) validate_allowed_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 24 16:32:47.599378 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2df26fce-f6ea-45d5-a9c2-492894c7adbf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f2ba2e8375b4e8c8792ee1e22b60427', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '00a5583c7b7443e98e7a1d31a0b638dc', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=71938) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 24 16:32:47.600193 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2df26fce-f6ea-45d5-a9c2-492894c7adbf admin admin] REQUEST_METHOD: `GET` {{(pid=71938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 24 16:32:47.600527 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2df26fce-f6ea-45d5-a9c2-492894c7adbf admin admin] SCRIPT_NAME: `/identity` {{(pid=71938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 24 16:32:47.600856 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2df26fce-f6ea-45d5-a9c2-492894c7adbf admin admin] PATH_INFO: `/v3/services/block-storage` {{(pid=71938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 24 16:32:47.601557 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2df26fce-f6ea-45d5-a9c2-492894c7adbf admin admin] RBAC: Authorizing `identity:get_service(service_id=block-storage)` {{(pid=71938) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:442}} Nov 24 16:32:47.629932 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2df26fce-f6ea-45d5-a9c2-492894c7adbf admin admin] RBAC: Authorization granted {{(pid=71938) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 24 16:32:47.642207 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: WARNING keystone.server.flask.application [None req-2df26fce-f6ea-45d5-a9c2-492894c7adbf admin admin] Could not find service: block-storage.: keystone.exception.ServiceNotFound: Could not find service: block-storage. Nov 24 16:32:47.643345 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: [pid: 71938|app: 0|req: 411/821] 10.222.0.53 () {56 vars in 1141 bytes} [Wed Nov 24 16:32:47 2021] GET /identity/v3/services/block-storage => generated 94 bytes in 58 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 24 16:32:47.649739 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef97d885-8b67-491d-8786-7b93695a2e6a None None] Authenticating user token {{(pid=71939) process_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 24 16:32:47.659467 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef97d885-8b67-491d-8786-7b93695a2e6a None None] Validating token access rules against request {{(pid=71939) validate_allowed_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 24 16:32:47.663736 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d34d6b2f-79e8-4616-b06a-70b6fac86517 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f2ba2e8375b4e8c8792ee1e22b60427', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '00a5583c7b7443e98e7a1d31a0b638dc', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=71939) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 24 16:32:47.664393 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d34d6b2f-79e8-4616-b06a-70b6fac86517 admin admin] REQUEST_METHOD: `GET` {{(pid=71939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 24 16:32:47.664733 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d34d6b2f-79e8-4616-b06a-70b6fac86517 admin admin] SCRIPT_NAME: `/identity` {{(pid=71939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 24 16:32:47.665073 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d34d6b2f-79e8-4616-b06a-70b6fac86517 admin admin] PATH_INFO: `/v3/services` {{(pid=71939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 24 16:32:47.665826 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d34d6b2f-79e8-4616-b06a-70b6fac86517 admin admin] RBAC: Adding query filter params (name=block-storage) {{(pid=71939) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:161}} Nov 24 16:32:47.666327 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d34d6b2f-79e8-4616-b06a-70b6fac86517 admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=71939) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:442}} Nov 24 16:32:47.694664 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d34d6b2f-79e8-4616-b06a-70b6fac86517 admin admin] RBAC: Authorization granted {{(pid=71939) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 24 16:32:47.699470 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: [pid: 71939|app: 0|req: 411/822] 10.222.0.53 () {56 vars in 1136 bytes} [Wed Nov 24 16:32:47 2021] GET /identity/v3/services?name=block-storage => generated 130 bytes in 50 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 24 16:32:47.706067 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2df26fce-f6ea-45d5-a9c2-492894c7adbf admin admin] Authenticating user token {{(pid=71938) process_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 24 16:32:47.715754 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2df26fce-f6ea-45d5-a9c2-492894c7adbf admin admin] Validating token access rules against request {{(pid=71938) validate_allowed_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 24 16:32:47.719998 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-752f1678-7a8f-4d37-bba5-df55e8155e0b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f2ba2e8375b4e8c8792ee1e22b60427', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '00a5583c7b7443e98e7a1d31a0b638dc', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=71938) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 24 16:32:47.720651 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-752f1678-7a8f-4d37-bba5-df55e8155e0b admin admin] REQUEST_METHOD: `GET` {{(pid=71938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 24 16:32:47.720988 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-752f1678-7a8f-4d37-bba5-df55e8155e0b admin admin] SCRIPT_NAME: `/identity` {{(pid=71938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 24 16:32:47.721320 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-752f1678-7a8f-4d37-bba5-df55e8155e0b admin admin] PATH_INFO: `/v3/services` {{(pid=71938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 24 16:32:47.722101 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-752f1678-7a8f-4d37-bba5-df55e8155e0b admin admin] RBAC: Adding query filter params (type=block-storage) {{(pid=71938) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:161}} Nov 24 16:32:47.722451 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-752f1678-7a8f-4d37-bba5-df55e8155e0b admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=71938) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:442}} Nov 24 16:32:47.751023 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-752f1678-7a8f-4d37-bba5-df55e8155e0b admin admin] RBAC: Authorization granted {{(pid=71938) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 24 16:32:47.755432 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: [pid: 71938|app: 0|req: 412/823] 10.222.0.53 () {56 vars in 1136 bytes} [Wed Nov 24 16:32:47 2021] GET /identity/v3/services?type=block-storage => generated 130 bytes in 50 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 24 16:32:49.733059 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f0dec38-0927-4c48-99fb-964e637b68ab None None] REQUEST_METHOD: `GET` {{(pid=71939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 24 16:32:49.733575 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f0dec38-0927-4c48-99fb-964e637b68ab None None] SCRIPT_NAME: `/identity` {{(pid=71939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 24 16:32:49.733701 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f0dec38-0927-4c48-99fb-964e637b68ab None None] PATH_INFO: `/` {{(pid=71939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 24 16:32:49.735565 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: [pid: 71939|app: 0|req: 412/824] 10.222.0.53 () {54 vars in 915 bytes} [Wed Nov 24 16:32:49 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 24 16:32:49.741090 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab1a66c8-bccf-4a8b-a16a-12caa139895e None None] REQUEST_METHOD: `POST` {{(pid=71938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 24 16:32:49.741439 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab1a66c8-bccf-4a8b-a16a-12caa139895e None None] SCRIPT_NAME: `/identity` {{(pid=71938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 24 16:32:49.741778 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab1a66c8-bccf-4a8b-a16a-12caa139895e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=71938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 24 16:32:49.766716 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.auth.core [None req-ab1a66c8-bccf-4a8b-a16a-12caa139895e None None] MFA Rules not processed for user `0f2ba2e8375b4e8c8792ee1e22b60427`. Rule list: `[]` (Enabled: `True`). {{(pid=71938) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:442}} Nov 24 16:32:49.767923 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.fernet_utils [None req-ab1a66c8-bccf-4a8b-a16a-12caa139895e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=71938) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:289}} Nov 24 16:32:49.775082 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: [pid: 71938|app: 0|req: 413/825] 10.222.0.53 () {58 vars in 1013 bytes} [Wed Nov 24 16:32:49 2021] POST /identity/v3/auth/tokens => generated 1861 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 24 16:32:49.796566 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa597725-3aab-4e20-ab84-4563b31519d2 None None] REQUEST_METHOD: `POST` {{(pid=71939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 24 16:32:49.796918 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa597725-3aab-4e20-ab84-4563b31519d2 None None] SCRIPT_NAME: `/identity` {{(pid=71939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 24 16:32:49.797261 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa597725-3aab-4e20-ab84-4563b31519d2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=71939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 24 16:32:49.820863 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.auth.core [None req-fa597725-3aab-4e20-ab84-4563b31519d2 None None] MFA Rules not processed for user `0f2ba2e8375b4e8c8792ee1e22b60427`. Rule list: `[]` (Enabled: `True`). {{(pid=71939) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:442}} Nov 24 16:32:49.822086 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.fernet_utils [None req-fa597725-3aab-4e20-ab84-4563b31519d2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=71939) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:289}} Nov 24 16:32:49.830073 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: [pid: 71939|app: 0|req: 413/826] 10.222.0.53 () {58 vars in 1013 bytes} [Wed Nov 24 16:32:49 2021] POST /identity/v3/auth/tokens => generated 1861 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 24 16:32:49.835655 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab1a66c8-bccf-4a8b-a16a-12caa139895e None None] Authenticating user token {{(pid=71938) process_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 24 16:32:49.845197 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab1a66c8-bccf-4a8b-a16a-12caa139895e None None] Validating token access rules against request {{(pid=71938) validate_allowed_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 24 16:32:49.849444 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a2a3e5c-c44e-4a41-83ec-5f2ed8a5abc8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f2ba2e8375b4e8c8792ee1e22b60427', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '00a5583c7b7443e98e7a1d31a0b638dc', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=71938) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 24 16:32:49.850150 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a2a3e5c-c44e-4a41-83ec-5f2ed8a5abc8 admin admin] REQUEST_METHOD: `POST` {{(pid=71938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 24 16:32:49.850492 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a2a3e5c-c44e-4a41-83ec-5f2ed8a5abc8 admin admin] SCRIPT_NAME: `/identity` {{(pid=71938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 24 16:32:49.850822 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a2a3e5c-c44e-4a41-83ec-5f2ed8a5abc8 admin admin] PATH_INFO: `/v3/services` {{(pid=71938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 24 16:32:49.851580 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a2a3e5c-c44e-4a41-83ec-5f2ed8a5abc8 admin admin] RBAC: Authorizing `identity:create_service()` {{(pid=71938) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:442}} Nov 24 16:32:49.880382 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a2a3e5c-c44e-4a41-83ec-5f2ed8a5abc8 admin admin] RBAC: Authorization granted {{(pid=71938) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 24 16:32:49.892553 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: [pid: 71938|app: 0|req: 414/827] 10.222.0.53 () {60 vars in 1153 bytes} [Wed Nov 24 16:32:49 2021] POST /identity/v3/services => generated 251 bytes in 57 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 24 16:32:51.860949 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b7d3751-271b-4aa7-8bed-58a8f933570d None None] REQUEST_METHOD: `GET` {{(pid=71939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 24 16:32:51.861473 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b7d3751-271b-4aa7-8bed-58a8f933570d None None] SCRIPT_NAME: `/identity` {{(pid=71939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 24 16:32:51.861593 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b7d3751-271b-4aa7-8bed-58a8f933570d None None] PATH_INFO: `/` {{(pid=71939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 24 16:32:51.863421 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: [pid: 71939|app: 0|req: 414/828] 10.222.0.53 () {54 vars in 915 bytes} [Wed Nov 24 16:32:51 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 24 16:32:51.868907 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e929d6e6-2ef1-4f51-80ab-26d59ffd03da None None] REQUEST_METHOD: `POST` {{(pid=71938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 24 16:32:51.869261 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e929d6e6-2ef1-4f51-80ab-26d59ffd03da None None] SCRIPT_NAME: `/identity` {{(pid=71938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 24 16:32:51.869601 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e929d6e6-2ef1-4f51-80ab-26d59ffd03da None None] PATH_INFO: `/v3/auth/tokens` {{(pid=71938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 24 16:32:51.895396 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.auth.core [None req-e929d6e6-2ef1-4f51-80ab-26d59ffd03da None None] MFA Rules not processed for user `0f2ba2e8375b4e8c8792ee1e22b60427`. Rule list: `[]` (Enabled: `True`). {{(pid=71938) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:442}} Nov 24 16:32:51.896617 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.fernet_utils [None req-e929d6e6-2ef1-4f51-80ab-26d59ffd03da None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=71938) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:289}} Nov 24 16:32:51.913603 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: [pid: 71938|app: 0|req: 415/829] 10.222.0.53 () {58 vars in 1013 bytes} [Wed Nov 24 16:32:51 2021] POST /identity/v3/auth/tokens => generated 1965 bytes in 46 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 24 16:32:51.935407 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dad82f2-73b0-442e-94f3-b550d4a1f355 None None] REQUEST_METHOD: `POST` {{(pid=71939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 24 16:32:51.935749 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dad82f2-73b0-442e-94f3-b550d4a1f355 None None] SCRIPT_NAME: `/identity` {{(pid=71939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 24 16:32:51.936080 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dad82f2-73b0-442e-94f3-b550d4a1f355 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=71939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 24 16:32:51.959423 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.auth.core [None req-0dad82f2-73b0-442e-94f3-b550d4a1f355 None None] MFA Rules not processed for user `0f2ba2e8375b4e8c8792ee1e22b60427`. Rule list: `[]` (Enabled: `True`). {{(pid=71939) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:442}} Nov 24 16:32:51.960615 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.fernet_utils [None req-0dad82f2-73b0-442e-94f3-b550d4a1f355 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=71939) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:289}} Nov 24 16:32:51.967565 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: [pid: 71939|app: 0|req: 415/830] 10.222.0.53 () {58 vars in 1013 bytes} [Wed Nov 24 16:32:51 2021] POST /identity/v3/auth/tokens => generated 1965 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 24 16:32:51.973704 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e929d6e6-2ef1-4f51-80ab-26d59ffd03da None None] Authenticating user token {{(pid=71938) process_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 24 16:32:51.983185 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e929d6e6-2ef1-4f51-80ab-26d59ffd03da None None] Validating token access rules against request {{(pid=71938) validate_allowed_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 24 16:32:51.988074 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd2516b2-c723-4af9-b9a5-8db9ece5f126 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f2ba2e8375b4e8c8792ee1e22b60427', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '00a5583c7b7443e98e7a1d31a0b638dc', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=71938) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 24 16:32:51.988889 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd2516b2-c723-4af9-b9a5-8db9ece5f126 admin admin] REQUEST_METHOD: `GET` {{(pid=71938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 24 16:32:51.989233 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd2516b2-c723-4af9-b9a5-8db9ece5f126 admin admin] SCRIPT_NAME: `/identity` {{(pid=71938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 24 16:32:51.989563 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd2516b2-c723-4af9-b9a5-8db9ece5f126 admin admin] PATH_INFO: `/v3/services/block-storage` {{(pid=71938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 24 16:32:51.990300 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd2516b2-c723-4af9-b9a5-8db9ece5f126 admin admin] RBAC: Authorizing `identity:get_service(service_id=block-storage)` {{(pid=71938) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:442}} Nov 24 16:32:52.018141 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd2516b2-c723-4af9-b9a5-8db9ece5f126 admin admin] RBAC: Authorization granted {{(pid=71938) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 24 16:32:52.029768 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: WARNING keystone.server.flask.application [None req-dd2516b2-c723-4af9-b9a5-8db9ece5f126 admin admin] Could not find service: block-storage.: keystone.exception.ServiceNotFound: Could not find service: block-storage. Nov 24 16:32:52.031445 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: [pid: 71938|app: 0|req: 416/831] 10.222.0.53 () {56 vars in 1141 bytes} [Wed Nov 24 16:32:51 2021] GET /identity/v3/services/block-storage => generated 94 bytes in 58 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 24 16:32:52.037666 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dad82f2-73b0-442e-94f3-b550d4a1f355 None None] Authenticating user token {{(pid=71939) process_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 24 16:32:52.047213 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dad82f2-73b0-442e-94f3-b550d4a1f355 None None] Validating token access rules against request {{(pid=71939) validate_allowed_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 24 16:32:52.051400 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff135460-2986-413f-8d98-91012cfc6fc0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f2ba2e8375b4e8c8792ee1e22b60427', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '00a5583c7b7443e98e7a1d31a0b638dc', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=71939) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 24 16:32:52.052051 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff135460-2986-413f-8d98-91012cfc6fc0 admin admin] REQUEST_METHOD: `GET` {{(pid=71939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 24 16:32:52.052387 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff135460-2986-413f-8d98-91012cfc6fc0 admin admin] SCRIPT_NAME: `/identity` {{(pid=71939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 24 16:32:52.052718 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff135460-2986-413f-8d98-91012cfc6fc0 admin admin] PATH_INFO: `/v3/services` {{(pid=71939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 24 16:32:52.053477 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff135460-2986-413f-8d98-91012cfc6fc0 admin admin] RBAC: Adding query filter params (name=block-storage) {{(pid=71939) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:161}} Nov 24 16:32:52.053821 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff135460-2986-413f-8d98-91012cfc6fc0 admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=71939) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:442}} Nov 24 16:32:52.081888 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff135460-2986-413f-8d98-91012cfc6fc0 admin admin] RBAC: Authorization granted {{(pid=71939) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 24 16:32:52.086684 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: [pid: 71939|app: 0|req: 416/832] 10.222.0.53 () {56 vars in 1136 bytes} [Wed Nov 24 16:32:52 2021] GET /identity/v3/services?name=block-storage => generated 130 bytes in 49 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 24 16:32:52.093486 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd2516b2-c723-4af9-b9a5-8db9ece5f126 admin admin] Authenticating user token {{(pid=71938) process_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 24 16:32:52.103156 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd2516b2-c723-4af9-b9a5-8db9ece5f126 admin admin] Validating token access rules against request {{(pid=71938) validate_allowed_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 24 16:32:52.107414 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8973fa97-3b03-4994-9661-b4b87888120f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f2ba2e8375b4e8c8792ee1e22b60427', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '00a5583c7b7443e98e7a1d31a0b638dc', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=71938) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 24 16:32:52.108069 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8973fa97-3b03-4994-9661-b4b87888120f admin admin] REQUEST_METHOD: `GET` {{(pid=71938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 24 16:32:52.109015 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8973fa97-3b03-4994-9661-b4b87888120f admin admin] SCRIPT_NAME: `/identity` {{(pid=71938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 24 16:32:52.109356 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8973fa97-3b03-4994-9661-b4b87888120f admin admin] PATH_INFO: `/v3/services` {{(pid=71938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 24 16:32:52.110146 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8973fa97-3b03-4994-9661-b4b87888120f admin admin] RBAC: Adding query filter params (type=block-storage) {{(pid=71938) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:161}} Nov 24 16:32:52.110500 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8973fa97-3b03-4994-9661-b4b87888120f admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=71938) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:442}} Nov 24 16:32:52.138369 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8973fa97-3b03-4994-9661-b4b87888120f admin admin] RBAC: Authorization granted {{(pid=71938) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 24 16:32:52.143348 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: [pid: 71938|app: 0|req: 417/833] 10.222.0.53 () {56 vars in 1136 bytes} [Wed Nov 24 16:32:52 2021] GET /identity/v3/services?type=block-storage => generated 367 bytes in 51 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 24 16:32:52.149060 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff135460-2986-413f-8d98-91012cfc6fc0 admin admin] Authenticating user token {{(pid=71939) process_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 24 16:32:52.159180 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff135460-2986-413f-8d98-91012cfc6fc0 admin admin] Validating token access rules against request {{(pid=71939) validate_allowed_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 24 16:32:52.163388 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fd39d1b-a4cc-42e6-b1de-71f95ac0b5ac admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f2ba2e8375b4e8c8792ee1e22b60427', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '00a5583c7b7443e98e7a1d31a0b638dc', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=71939) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 24 16:32:52.164030 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fd39d1b-a4cc-42e6-b1de-71f95ac0b5ac admin admin] REQUEST_METHOD: `GET` {{(pid=71939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 24 16:32:52.164367 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fd39d1b-a4cc-42e6-b1de-71f95ac0b5ac admin admin] SCRIPT_NAME: `/identity` {{(pid=71939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 24 16:32:52.164697 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fd39d1b-a4cc-42e6-b1de-71f95ac0b5ac admin admin] PATH_INFO: `/v3/endpoints` {{(pid=71939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 24 16:32:52.165533 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fd39d1b-a4cc-42e6-b1de-71f95ac0b5ac admin admin] RBAC: Adding query filter params (interface=public, service_id=c42364448c7140eca5552c384f528e33, region_id=RegionOne) {{(pid=71939) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:161}} Nov 24 16:32:52.165891 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fd39d1b-a4cc-42e6-b1de-71f95ac0b5ac admin admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=71939) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:442}} Nov 24 16:32:52.194210 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fd39d1b-a4cc-42e6-b1de-71f95ac0b5ac admin admin] RBAC: Authorization granted {{(pid=71939) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 24 16:32:52.206597 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: [pid: 71939|app: 0|req: 417/834] 10.222.0.53 () {56 vars in 1263 bytes} [Wed Nov 24 16:32:52 2021] GET /identity/v3/endpoints?service_id=c42364448c7140eca5552c384f528e33&interface=public®ion_id=RegionOne => generated 194 bytes in 58 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 24 16:32:52.212642 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8973fa97-3b03-4994-9661-b4b87888120f admin admin] Authenticating user token {{(pid=71938) process_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 24 16:32:52.223184 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8973fa97-3b03-4994-9661-b4b87888120f admin admin] Validating token access rules against request {{(pid=71938) validate_allowed_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 24 16:32:52.227453 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71cb2f61-e3cf-4c5b-aefc-a6e93b1b5ddd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f2ba2e8375b4e8c8792ee1e22b60427', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '00a5583c7b7443e98e7a1d31a0b638dc', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=71938) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 24 16:32:52.228115 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71cb2f61-e3cf-4c5b-aefc-a6e93b1b5ddd admin admin] REQUEST_METHOD: `GET` {{(pid=71938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 24 16:32:52.228456 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71cb2f61-e3cf-4c5b-aefc-a6e93b1b5ddd admin admin] SCRIPT_NAME: `/identity` {{(pid=71938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 24 16:32:52.228791 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71cb2f61-e3cf-4c5b-aefc-a6e93b1b5ddd admin admin] PATH_INFO: `/v3/services` {{(pid=71938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 24 16:32:52.229528 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71cb2f61-e3cf-4c5b-aefc-a6e93b1b5ddd admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=71938) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:442}} Nov 24 16:32:52.258040 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71cb2f61-e3cf-4c5b-aefc-a6e93b1b5ddd admin admin] RBAC: Authorization granted {{(pid=71938) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 24 16:32:52.264082 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: [pid: 71938|app: 0|req: 418/835] 10.222.0.53 () {56 vars in 1099 bytes} [Wed Nov 24 16:32:52 2021] GET /identity/v3/services => generated 1261 bytes in 52 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 24 16:32:54.248069 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ea019f2-8c56-43bb-b50e-799733157a52 None None] REQUEST_METHOD: `GET` {{(pid=71939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 24 16:32:54.248577 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ea019f2-8c56-43bb-b50e-799733157a52 None None] SCRIPT_NAME: `/identity` {{(pid=71939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 24 16:32:54.248725 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ea019f2-8c56-43bb-b50e-799733157a52 None None] PATH_INFO: `/` {{(pid=71939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 24 16:32:54.250598 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: [pid: 71939|app: 0|req: 418/836] 10.222.0.53 () {54 vars in 915 bytes} [Wed Nov 24 16:32:54 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 24 16:32:54.256193 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14b0930a-bd08-4e8f-8fec-530d88cf3d4d None None] REQUEST_METHOD: `POST` {{(pid=71938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 24 16:32:54.256541 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14b0930a-bd08-4e8f-8fec-530d88cf3d4d None None] SCRIPT_NAME: `/identity` {{(pid=71938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 24 16:32:54.256884 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14b0930a-bd08-4e8f-8fec-530d88cf3d4d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=71938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 24 16:32:54.353419 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.auth.core [None req-14b0930a-bd08-4e8f-8fec-530d88cf3d4d None None] MFA Rules not processed for user `0f2ba2e8375b4e8c8792ee1e22b60427`. Rule list: `[]` (Enabled: `True`). {{(pid=71938) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:442}} Nov 24 16:32:54.354683 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.fernet_utils [None req-14b0930a-bd08-4e8f-8fec-530d88cf3d4d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=71938) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:289}} Nov 24 16:32:54.363333 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: [pid: 71938|app: 0|req: 419/837] 10.222.0.53 () {58 vars in 1013 bytes} [Wed Nov 24 16:32:54 2021] POST /identity/v3/auth/tokens => generated 1965 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 24 16:32:54.385657 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee243931-0473-469b-9e08-12b924ad618b None None] REQUEST_METHOD: `POST` {{(pid=71939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 24 16:32:54.385995 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee243931-0473-469b-9e08-12b924ad618b None None] SCRIPT_NAME: `/identity` {{(pid=71939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 24 16:32:54.386418 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee243931-0473-469b-9e08-12b924ad618b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=71939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 24 16:32:54.410483 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.auth.core [None req-ee243931-0473-469b-9e08-12b924ad618b None None] MFA Rules not processed for user `0f2ba2e8375b4e8c8792ee1e22b60427`. Rule list: `[]` (Enabled: `True`). {{(pid=71939) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:442}} Nov 24 16:32:54.411731 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.fernet_utils [None req-ee243931-0473-469b-9e08-12b924ad618b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=71939) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:289}} Nov 24 16:32:54.418842 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: [pid: 71939|app: 0|req: 419/838] 10.222.0.53 () {58 vars in 1013 bytes} [Wed Nov 24 16:32:54 2021] POST /identity/v3/auth/tokens => generated 1965 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 24 16:32:54.425454 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14b0930a-bd08-4e8f-8fec-530d88cf3d4d None None] Authenticating user token {{(pid=71938) process_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 24 16:32:54.435148 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14b0930a-bd08-4e8f-8fec-530d88cf3d4d None None] Validating token access rules against request {{(pid=71938) validate_allowed_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 24 16:32:54.439408 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-887b721d-be62-4e6a-acf1-1d5bad14ce4f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f2ba2e8375b4e8c8792ee1e22b60427', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '00a5583c7b7443e98e7a1d31a0b638dc', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=71938) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 24 16:32:54.440229 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-887b721d-be62-4e6a-acf1-1d5bad14ce4f admin admin] REQUEST_METHOD: `GET` {{(pid=71938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 24 16:32:54.440569 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-887b721d-be62-4e6a-acf1-1d5bad14ce4f admin admin] SCRIPT_NAME: `/identity` {{(pid=71938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 24 16:32:54.440904 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-887b721d-be62-4e6a-acf1-1d5bad14ce4f admin admin] PATH_INFO: `/v3/services/block-storage` {{(pid=71938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 24 16:32:54.441613 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-887b721d-be62-4e6a-acf1-1d5bad14ce4f admin admin] RBAC: Authorizing `identity:get_service(service_id=block-storage)` {{(pid=71938) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:442}} Nov 24 16:32:54.470516 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-887b721d-be62-4e6a-acf1-1d5bad14ce4f admin admin] RBAC: Authorization granted {{(pid=71938) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 24 16:32:54.482187 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: WARNING keystone.server.flask.application [None req-887b721d-be62-4e6a-acf1-1d5bad14ce4f admin admin] Could not find service: block-storage.: keystone.exception.ServiceNotFound: Could not find service: block-storage. Nov 24 16:32:54.483387 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: [pid: 71938|app: 0|req: 420/839] 10.222.0.53 () {56 vars in 1141 bytes} [Wed Nov 24 16:32:54 2021] GET /identity/v3/services/block-storage => generated 94 bytes in 58 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 24 16:32:54.490381 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee243931-0473-469b-9e08-12b924ad618b None None] Authenticating user token {{(pid=71939) process_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 24 16:32:54.499509 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee243931-0473-469b-9e08-12b924ad618b None None] Validating token access rules against request {{(pid=71939) validate_allowed_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 24 16:32:54.504004 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bd826e2-5cfb-40f2-94cf-a9b5fdb7aa98 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f2ba2e8375b4e8c8792ee1e22b60427', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '00a5583c7b7443e98e7a1d31a0b638dc', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=71939) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 24 16:32:54.504683 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bd826e2-5cfb-40f2-94cf-a9b5fdb7aa98 admin admin] REQUEST_METHOD: `GET` {{(pid=71939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 24 16:32:54.505023 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bd826e2-5cfb-40f2-94cf-a9b5fdb7aa98 admin admin] SCRIPT_NAME: `/identity` {{(pid=71939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 24 16:32:54.505354 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bd826e2-5cfb-40f2-94cf-a9b5fdb7aa98 admin admin] PATH_INFO: `/v3/services` {{(pid=71939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 24 16:32:54.506156 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bd826e2-5cfb-40f2-94cf-a9b5fdb7aa98 admin admin] RBAC: Adding query filter params (name=block-storage) {{(pid=71939) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:161}} Nov 24 16:32:54.506511 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bd826e2-5cfb-40f2-94cf-a9b5fdb7aa98 admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=71939) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:442}} Nov 24 16:32:54.535416 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bd826e2-5cfb-40f2-94cf-a9b5fdb7aa98 admin admin] RBAC: Authorization granted {{(pid=71939) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 24 16:32:54.540546 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: [pid: 71939|app: 0|req: 420/840] 10.222.0.53 () {56 vars in 1136 bytes} [Wed Nov 24 16:32:54 2021] GET /identity/v3/services?name=block-storage => generated 130 bytes in 51 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 24 16:32:54.547270 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-887b721d-be62-4e6a-acf1-1d5bad14ce4f admin admin] Authenticating user token {{(pid=71938) process_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 24 16:32:54.557074 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-887b721d-be62-4e6a-acf1-1d5bad14ce4f admin admin] Validating token access rules against request {{(pid=71938) validate_allowed_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 24 16:32:54.561415 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e8747f0-f211-40c9-b531-6d6f3170f25d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f2ba2e8375b4e8c8792ee1e22b60427', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '00a5583c7b7443e98e7a1d31a0b638dc', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=71938) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 24 16:32:54.562092 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e8747f0-f211-40c9-b531-6d6f3170f25d admin admin] REQUEST_METHOD: `GET` {{(pid=71938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 24 16:32:54.562431 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e8747f0-f211-40c9-b531-6d6f3170f25d admin admin] SCRIPT_NAME: `/identity` {{(pid=71938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 24 16:32:54.562759 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e8747f0-f211-40c9-b531-6d6f3170f25d admin admin] PATH_INFO: `/v3/services` {{(pid=71938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 24 16:32:54.563516 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e8747f0-f211-40c9-b531-6d6f3170f25d admin admin] RBAC: Adding query filter params (type=block-storage) {{(pid=71938) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:161}} Nov 24 16:32:54.563861 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e8747f0-f211-40c9-b531-6d6f3170f25d admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=71938) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:442}} Nov 24 16:32:54.592402 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e8747f0-f211-40c9-b531-6d6f3170f25d admin admin] RBAC: Authorization granted {{(pid=71938) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 24 16:32:54.598115 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: [pid: 71938|app: 0|req: 421/841] 10.222.0.53 () {56 vars in 1136 bytes} [Wed Nov 24 16:32:54 2021] GET /identity/v3/services?type=block-storage => generated 367 bytes in 52 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 24 16:32:54.604056 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bd826e2-5cfb-40f2-94cf-a9b5fdb7aa98 admin admin] Authenticating user token {{(pid=71939) process_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 24 16:32:54.613825 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bd826e2-5cfb-40f2-94cf-a9b5fdb7aa98 admin admin] Validating token access rules against request {{(pid=71939) validate_allowed_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 24 16:32:54.618126 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5508d8b2-39e8-4cd3-8002-c6fe0cdbdc48 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f2ba2e8375b4e8c8792ee1e22b60427', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '00a5583c7b7443e98e7a1d31a0b638dc', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=71939) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 24 16:32:54.618776 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5508d8b2-39e8-4cd3-8002-c6fe0cdbdc48 admin admin] REQUEST_METHOD: `POST` {{(pid=71939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 24 16:32:54.619117 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5508d8b2-39e8-4cd3-8002-c6fe0cdbdc48 admin admin] SCRIPT_NAME: `/identity` {{(pid=71939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 24 16:32:54.619450 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5508d8b2-39e8-4cd3-8002-c6fe0cdbdc48 admin admin] PATH_INFO: `/v3/endpoints` {{(pid=71939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 24 16:32:54.620240 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5508d8b2-39e8-4cd3-8002-c6fe0cdbdc48 admin admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=71939) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:442}} Nov 24 16:32:54.648636 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5508d8b2-39e8-4cd3-8002-c6fe0cdbdc48 admin admin] RBAC: Authorization granted {{(pid=71939) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 24 16:32:54.667517 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: [pid: 71939|app: 0|req: 421/842] 10.222.0.53 () {60 vars in 1156 bytes} [Wed Nov 24 16:32:54 2021] POST /identity/v3/endpoints => generated 346 bytes in 64 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 24 16:32:56.641121 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63a55e2f-4918-4e43-9339-dba5b61e7d92 None None] REQUEST_METHOD: `GET` {{(pid=71938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 24 16:32:56.641621 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63a55e2f-4918-4e43-9339-dba5b61e7d92 None None] SCRIPT_NAME: `/identity` {{(pid=71938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 24 16:32:56.641777 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63a55e2f-4918-4e43-9339-dba5b61e7d92 None None] PATH_INFO: `/` {{(pid=71938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 24 16:32:56.643639 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: [pid: 71938|app: 0|req: 422/843] 10.222.0.53 () {54 vars in 915 bytes} [Wed Nov 24 16:32:56 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 24 16:32:56.648996 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2c47bb4-1364-4ae9-84ec-8287e7f89faa None None] REQUEST_METHOD: `POST` {{(pid=71939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 24 16:32:56.649356 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2c47bb4-1364-4ae9-84ec-8287e7f89faa None None] SCRIPT_NAME: `/identity` {{(pid=71939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 24 16:32:56.649697 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2c47bb4-1364-4ae9-84ec-8287e7f89faa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=71939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 24 16:32:56.672964 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.auth.core [None req-f2c47bb4-1364-4ae9-84ec-8287e7f89faa None None] MFA Rules not processed for user `0f2ba2e8375b4e8c8792ee1e22b60427`. Rule list: `[]` (Enabled: `True`). {{(pid=71939) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:442}} Nov 24 16:32:56.674217 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.fernet_utils [None req-f2c47bb4-1364-4ae9-84ec-8287e7f89faa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=71939) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:289}} Nov 24 16:32:56.692531 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: [pid: 71939|app: 0|req: 422/844] 10.222.0.53 () {58 vars in 1013 bytes} [Wed Nov 24 16:32:56 2021] POST /identity/v3/auth/tokens => generated 2151 bytes in 45 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 24 16:32:56.718896 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ca8363b-fd0a-488c-9bc6-51813933d7d6 None None] REQUEST_METHOD: `POST` {{(pid=71938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 24 16:32:56.719416 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ca8363b-fd0a-488c-9bc6-51813933d7d6 None None] SCRIPT_NAME: `/identity` {{(pid=71938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 24 16:32:56.719752 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ca8363b-fd0a-488c-9bc6-51813933d7d6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=71938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 24 16:32:56.743924 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.auth.core [None req-0ca8363b-fd0a-488c-9bc6-51813933d7d6 None None] MFA Rules not processed for user `0f2ba2e8375b4e8c8792ee1e22b60427`. Rule list: `[]` (Enabled: `True`). {{(pid=71938) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:442}} Nov 24 16:32:56.745131 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.fernet_utils [None req-0ca8363b-fd0a-488c-9bc6-51813933d7d6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=71938) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:289}} Nov 24 16:32:56.752698 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: [pid: 71938|app: 0|req: 423/845] 10.222.0.53 () {58 vars in 1013 bytes} [Wed Nov 24 16:32:56 2021] POST /identity/v3/auth/tokens => generated 2151 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 24 16:32:56.758850 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2c47bb4-1364-4ae9-84ec-8287e7f89faa None None] Authenticating user token {{(pid=71939) process_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 24 16:32:56.769028 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2c47bb4-1364-4ae9-84ec-8287e7f89faa None None] Validating token access rules against request {{(pid=71939) validate_allowed_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 24 16:32:56.773201 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf454ddb-507f-43da-9256-1bc4cf807802 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f2ba2e8375b4e8c8792ee1e22b60427', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '00a5583c7b7443e98e7a1d31a0b638dc', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=71939) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 24 16:32:56.774229 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf454ddb-507f-43da-9256-1bc4cf807802 admin admin] REQUEST_METHOD: `GET` {{(pid=71939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 24 16:32:56.774568 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf454ddb-507f-43da-9256-1bc4cf807802 admin admin] SCRIPT_NAME: `/identity` {{(pid=71939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 24 16:32:56.774897 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf454ddb-507f-43da-9256-1bc4cf807802 admin admin] PATH_INFO: `/v3/services/volumev2` {{(pid=71939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 24 16:32:56.775602 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf454ddb-507f-43da-9256-1bc4cf807802 admin admin] RBAC: Authorizing `identity:get_service(service_id=volumev2)` {{(pid=71939) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:442}} Nov 24 16:32:56.803539 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf454ddb-507f-43da-9256-1bc4cf807802 admin admin] RBAC: Authorization granted {{(pid=71939) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 24 16:32:56.815619 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: WARNING keystone.server.flask.application [None req-cf454ddb-507f-43da-9256-1bc4cf807802 admin admin] Could not find service: volumev2.: keystone.exception.ServiceNotFound: Could not find service: volumev2. Nov 24 16:32:56.816765 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: [pid: 71939|app: 0|req: 423/846] 10.222.0.53 () {56 vars in 1126 bytes} [Wed Nov 24 16:32:56 2021] GET /identity/v3/services/volumev2 => generated 89 bytes in 59 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 24 16:32:56.823358 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ca8363b-fd0a-488c-9bc6-51813933d7d6 None None] Authenticating user token {{(pid=71938) process_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 24 16:32:56.833380 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ca8363b-fd0a-488c-9bc6-51813933d7d6 None None] Validating token access rules against request {{(pid=71938) validate_allowed_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 24 16:32:56.837709 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d90b1a34-4b07-4260-89ae-9fa3d28ea7fd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f2ba2e8375b4e8c8792ee1e22b60427', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '00a5583c7b7443e98e7a1d31a0b638dc', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=71938) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 24 16:32:56.838407 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d90b1a34-4b07-4260-89ae-9fa3d28ea7fd admin admin] REQUEST_METHOD: `GET` {{(pid=71938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 24 16:32:56.838750 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d90b1a34-4b07-4260-89ae-9fa3d28ea7fd admin admin] SCRIPT_NAME: `/identity` {{(pid=71938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 24 16:32:56.839086 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d90b1a34-4b07-4260-89ae-9fa3d28ea7fd admin admin] PATH_INFO: `/v3/services` {{(pid=71938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 24 16:32:56.839856 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d90b1a34-4b07-4260-89ae-9fa3d28ea7fd admin admin] RBAC: Adding query filter params (name=volumev2) {{(pid=71938) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:161}} Nov 24 16:32:56.840213 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d90b1a34-4b07-4260-89ae-9fa3d28ea7fd admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=71938) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:442}} Nov 24 16:32:56.869032 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d90b1a34-4b07-4260-89ae-9fa3d28ea7fd admin admin] RBAC: Authorization granted {{(pid=71938) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 24 16:32:56.874561 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: [pid: 71938|app: 0|req: 424/847] 10.222.0.53 () {56 vars in 1126 bytes} [Wed Nov 24 16:32:56 2021] GET /identity/v3/services?name=volumev2 => generated 125 bytes in 51 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 24 16:32:56.880233 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf454ddb-507f-43da-9256-1bc4cf807802 admin admin] Authenticating user token {{(pid=71939) process_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 24 16:32:56.890003 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf454ddb-507f-43da-9256-1bc4cf807802 admin admin] Validating token access rules against request {{(pid=71939) validate_allowed_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 24 16:32:56.894308 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b155f57f-dfda-4bc4-a75f-e8bc3424a544 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f2ba2e8375b4e8c8792ee1e22b60427', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '00a5583c7b7443e98e7a1d31a0b638dc', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=71939) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 24 16:32:56.894919 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b155f57f-dfda-4bc4-a75f-e8bc3424a544 admin admin] REQUEST_METHOD: `GET` {{(pid=71939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 24 16:32:56.895261 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b155f57f-dfda-4bc4-a75f-e8bc3424a544 admin admin] SCRIPT_NAME: `/identity` {{(pid=71939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 24 16:32:56.895596 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b155f57f-dfda-4bc4-a75f-e8bc3424a544 admin admin] PATH_INFO: `/v3/services` {{(pid=71939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 24 16:32:56.896403 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b155f57f-dfda-4bc4-a75f-e8bc3424a544 admin admin] RBAC: Adding query filter params (type=volumev2) {{(pid=71939) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:161}} Nov 24 16:32:56.896755 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b155f57f-dfda-4bc4-a75f-e8bc3424a544 admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=71939) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:442}} Nov 24 16:32:56.925064 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b155f57f-dfda-4bc4-a75f-e8bc3424a544 admin admin] RBAC: Authorization granted {{(pid=71939) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 24 16:32:56.929674 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: [pid: 71939|app: 0|req: 424/848] 10.222.0.53 () {56 vars in 1126 bytes} [Wed Nov 24 16:32:56 2021] GET /identity/v3/services?type=volumev2 => generated 125 bytes in 50 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 24 16:32:58.918183 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c3a3568-8548-4526-8031-6bbbf165d100 None None] REQUEST_METHOD: `GET` {{(pid=71938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 24 16:32:58.918736 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c3a3568-8548-4526-8031-6bbbf165d100 None None] SCRIPT_NAME: `/identity` {{(pid=71938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 24 16:32:58.918826 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c3a3568-8548-4526-8031-6bbbf165d100 None None] PATH_INFO: `/` {{(pid=71938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 24 16:32:58.920670 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: [pid: 71938|app: 0|req: 425/849] 10.222.0.53 () {54 vars in 915 bytes} [Wed Nov 24 16:32:58 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 24 16:32:58.926715 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dec1133-e21f-4deb-a24c-619d067bc8b1 None None] REQUEST_METHOD: `POST` {{(pid=71939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 24 16:32:58.927060 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dec1133-e21f-4deb-a24c-619d067bc8b1 None None] SCRIPT_NAME: `/identity` {{(pid=71939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 24 16:32:58.927394 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dec1133-e21f-4deb-a24c-619d067bc8b1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=71939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 24 16:32:58.950541 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.auth.core [None req-4dec1133-e21f-4deb-a24c-619d067bc8b1 None None] MFA Rules not processed for user `0f2ba2e8375b4e8c8792ee1e22b60427`. Rule list: `[]` (Enabled: `True`). {{(pid=71939) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:442}} Nov 24 16:32:58.951997 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.fernet_utils [None req-4dec1133-e21f-4deb-a24c-619d067bc8b1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=71939) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:289}} Nov 24 16:32:58.958993 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: [pid: 71939|app: 0|req: 425/850] 10.222.0.53 () {58 vars in 1013 bytes} [Wed Nov 24 16:32:58 2021] POST /identity/v3/auth/tokens => generated 2151 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 24 16:32:58.981037 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4df81a9-8fce-4ba6-8940-84d9459e85e3 None None] REQUEST_METHOD: `POST` {{(pid=71938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 24 16:32:58.981386 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4df81a9-8fce-4ba6-8940-84d9459e85e3 None None] SCRIPT_NAME: `/identity` {{(pid=71938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 24 16:32:58.981726 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4df81a9-8fce-4ba6-8940-84d9459e85e3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=71938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 24 16:32:59.005453 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.auth.core [None req-d4df81a9-8fce-4ba6-8940-84d9459e85e3 None None] MFA Rules not processed for user `0f2ba2e8375b4e8c8792ee1e22b60427`. Rule list: `[]` (Enabled: `True`). {{(pid=71938) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:442}} Nov 24 16:32:59.006685 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.fernet_utils [None req-d4df81a9-8fce-4ba6-8940-84d9459e85e3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=71938) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:289}} Nov 24 16:32:59.014122 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: [pid: 71938|app: 0|req: 426/851] 10.222.0.53 () {58 vars in 1013 bytes} [Wed Nov 24 16:32:58 2021] POST /identity/v3/auth/tokens => generated 2151 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 24 16:32:59.022713 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dec1133-e21f-4deb-a24c-619d067bc8b1 None None] Authenticating user token {{(pid=71939) process_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 24 16:32:59.029253 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dec1133-e21f-4deb-a24c-619d067bc8b1 None None] Validating token access rules against request {{(pid=71939) validate_allowed_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 24 16:32:59.034110 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93da76fe-7900-4e88-95ca-c7b65282749a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f2ba2e8375b4e8c8792ee1e22b60427', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '00a5583c7b7443e98e7a1d31a0b638dc', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=71939) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 24 16:32:59.034772 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93da76fe-7900-4e88-95ca-c7b65282749a admin admin] REQUEST_METHOD: `POST` {{(pid=71939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 24 16:32:59.035107 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93da76fe-7900-4e88-95ca-c7b65282749a admin admin] SCRIPT_NAME: `/identity` {{(pid=71939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 24 16:32:59.035436 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93da76fe-7900-4e88-95ca-c7b65282749a admin admin] PATH_INFO: `/v3/services` {{(pid=71939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 24 16:32:59.036197 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93da76fe-7900-4e88-95ca-c7b65282749a admin admin] RBAC: Authorizing `identity:create_service()` {{(pid=71939) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:442}} Nov 24 16:32:59.064584 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93da76fe-7900-4e88-95ca-c7b65282749a admin admin] RBAC: Authorization granted {{(pid=71939) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 24 16:32:59.081131 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: [pid: 71939|app: 0|req: 426/852] 10.222.0.53 () {60 vars in 1153 bytes} [Wed Nov 24 16:32:59 2021] POST /identity/v3/services => generated 251 bytes in 59 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 24 16:33:01.066594 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a61af2fb-5533-4132-b981-cefbfad1ed16 None None] REQUEST_METHOD: `GET` {{(pid=71938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 24 16:33:01.067117 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a61af2fb-5533-4132-b981-cefbfad1ed16 None None] SCRIPT_NAME: `/identity` {{(pid=71938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 24 16:33:01.067263 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a61af2fb-5533-4132-b981-cefbfad1ed16 None None] PATH_INFO: `/` {{(pid=71938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 24 16:33:01.069115 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: [pid: 71938|app: 0|req: 427/853] 10.222.0.53 () {54 vars in 915 bytes} [Wed Nov 24 16:33:01 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 24 16:33:01.074771 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a587b20a-fdf7-4084-8de0-1340098410ef None None] REQUEST_METHOD: `POST` {{(pid=71939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 24 16:33:01.075129 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a587b20a-fdf7-4084-8de0-1340098410ef None None] SCRIPT_NAME: `/identity` {{(pid=71939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 24 16:33:01.075472 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a587b20a-fdf7-4084-8de0-1340098410ef None None] PATH_INFO: `/v3/auth/tokens` {{(pid=71939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 24 16:33:01.099518 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.auth.core [None req-a587b20a-fdf7-4084-8de0-1340098410ef None None] MFA Rules not processed for user `0f2ba2e8375b4e8c8792ee1e22b60427`. Rule list: `[]` (Enabled: `True`). {{(pid=71939) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:442}} Nov 24 16:33:01.100741 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.fernet_utils [None req-a587b20a-fdf7-4084-8de0-1340098410ef None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=71939) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:289}} Nov 24 16:33:01.118068 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: [pid: 71939|app: 0|req: 427/854] 10.222.0.53 () {58 vars in 1013 bytes} [Wed Nov 24 16:33:01 2021] POST /identity/v3/auth/tokens => generated 2252 bytes in 44 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 24 16:33:01.140136 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ee95930-4968-4ba7-96fb-9577f9471e81 None None] REQUEST_METHOD: `POST` {{(pid=71938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 24 16:33:01.140491 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ee95930-4968-4ba7-96fb-9577f9471e81 None None] SCRIPT_NAME: `/identity` {{(pid=71938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 24 16:33:01.141375 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ee95930-4968-4ba7-96fb-9577f9471e81 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=71938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 24 16:33:01.164039 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.auth.core [None req-2ee95930-4968-4ba7-96fb-9577f9471e81 None None] MFA Rules not processed for user `0f2ba2e8375b4e8c8792ee1e22b60427`. Rule list: `[]` (Enabled: `True`). {{(pid=71938) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:442}} Nov 24 16:33:01.165235 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.fernet_utils [None req-2ee95930-4968-4ba7-96fb-9577f9471e81 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=71938) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:289}} Nov 24 16:33:01.172444 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: [pid: 71938|app: 0|req: 428/855] 10.222.0.53 () {58 vars in 1013 bytes} [Wed Nov 24 16:33:01 2021] POST /identity/v3/auth/tokens => generated 2252 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 24 16:33:01.178285 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a587b20a-fdf7-4084-8de0-1340098410ef None None] Authenticating user token {{(pid=71939) process_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 24 16:33:01.188395 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a587b20a-fdf7-4084-8de0-1340098410ef None None] Validating token access rules against request {{(pid=71939) validate_allowed_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 24 16:33:01.192600 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b41c3035-fbf7-4fbd-b3c2-2161c888393b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f2ba2e8375b4e8c8792ee1e22b60427', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '00a5583c7b7443e98e7a1d31a0b638dc', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=71939) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 24 16:33:01.193412 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b41c3035-fbf7-4fbd-b3c2-2161c888393b admin admin] REQUEST_METHOD: `GET` {{(pid=71939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 24 16:33:01.193748 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b41c3035-fbf7-4fbd-b3c2-2161c888393b admin admin] SCRIPT_NAME: `/identity` {{(pid=71939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 24 16:33:01.194103 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b41c3035-fbf7-4fbd-b3c2-2161c888393b admin admin] PATH_INFO: `/v3/services/volumev2` {{(pid=71939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 24 16:33:01.194810 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b41c3035-fbf7-4fbd-b3c2-2161c888393b admin admin] RBAC: Authorizing `identity:get_service(service_id=volumev2)` {{(pid=71939) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:442}} Nov 24 16:33:01.223503 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b41c3035-fbf7-4fbd-b3c2-2161c888393b admin admin] RBAC: Authorization granted {{(pid=71939) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 24 16:33:01.235160 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: WARNING keystone.server.flask.application [None req-b41c3035-fbf7-4fbd-b3c2-2161c888393b admin admin] Could not find service: volumev2.: keystone.exception.ServiceNotFound: Could not find service: volumev2. Nov 24 16:33:01.236326 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: [pid: 71939|app: 0|req: 428/856] 10.222.0.53 () {56 vars in 1126 bytes} [Wed Nov 24 16:33:01 2021] GET /identity/v3/services/volumev2 => generated 89 bytes in 59 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 24 16:33:01.243121 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ee95930-4968-4ba7-96fb-9577f9471e81 None None] Authenticating user token {{(pid=71938) process_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 24 16:33:01.252784 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ee95930-4968-4ba7-96fb-9577f9471e81 None None] Validating token access rules against request {{(pid=71938) validate_allowed_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 24 16:33:01.257065 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abd45eac-e645-47c6-901c-77c63de9bb16 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f2ba2e8375b4e8c8792ee1e22b60427', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '00a5583c7b7443e98e7a1d31a0b638dc', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=71938) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 24 16:33:01.257729 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abd45eac-e645-47c6-901c-77c63de9bb16 admin admin] REQUEST_METHOD: `GET` {{(pid=71938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 24 16:33:01.258091 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abd45eac-e645-47c6-901c-77c63de9bb16 admin admin] SCRIPT_NAME: `/identity` {{(pid=71938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 24 16:33:01.258433 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abd45eac-e645-47c6-901c-77c63de9bb16 admin admin] PATH_INFO: `/v3/services` {{(pid=71938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 24 16:33:01.259197 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abd45eac-e645-47c6-901c-77c63de9bb16 admin admin] RBAC: Adding query filter params (name=volumev2) {{(pid=71938) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:161}} Nov 24 16:33:01.259553 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abd45eac-e645-47c6-901c-77c63de9bb16 admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=71938) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:442}} Nov 24 16:33:01.287893 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abd45eac-e645-47c6-901c-77c63de9bb16 admin admin] RBAC: Authorization granted {{(pid=71938) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 24 16:33:01.292812 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: [pid: 71938|app: 0|req: 429/857] 10.222.0.53 () {56 vars in 1126 bytes} [Wed Nov 24 16:33:01 2021] GET /identity/v3/services?name=volumev2 => generated 125 bytes in 50 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 24 16:33:01.298644 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b41c3035-fbf7-4fbd-b3c2-2161c888393b admin admin] Authenticating user token {{(pid=71939) process_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 24 16:33:01.308347 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b41c3035-fbf7-4fbd-b3c2-2161c888393b admin admin] Validating token access rules against request {{(pid=71939) validate_allowed_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 24 16:33:01.313107 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2598207-bd91-495f-be86-30a61db8d913 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f2ba2e8375b4e8c8792ee1e22b60427', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '00a5583c7b7443e98e7a1d31a0b638dc', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=71939) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 24 16:33:01.313759 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2598207-bd91-495f-be86-30a61db8d913 admin admin] REQUEST_METHOD: `GET` {{(pid=71939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 24 16:33:01.314132 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2598207-bd91-495f-be86-30a61db8d913 admin admin] SCRIPT_NAME: `/identity` {{(pid=71939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 24 16:33:01.314465 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2598207-bd91-495f-be86-30a61db8d913 admin admin] PATH_INFO: `/v3/services` {{(pid=71939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 24 16:33:01.315224 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2598207-bd91-495f-be86-30a61db8d913 admin admin] RBAC: Adding query filter params (type=volumev2) {{(pid=71939) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:161}} Nov 24 16:33:01.315574 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2598207-bd91-495f-be86-30a61db8d913 admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=71939) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:442}} Nov 24 16:33:01.344784 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2598207-bd91-495f-be86-30a61db8d913 admin admin] RBAC: Authorization granted {{(pid=71939) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 24 16:33:01.349656 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: [pid: 71939|app: 0|req: 429/858] 10.222.0.53 () {56 vars in 1126 bytes} [Wed Nov 24 16:33:01 2021] GET /identity/v3/services?type=volumev2 => generated 362 bytes in 52 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 24 16:33:01.355768 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abd45eac-e645-47c6-901c-77c63de9bb16 admin admin] Authenticating user token {{(pid=71938) process_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 24 16:33:01.365904 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abd45eac-e645-47c6-901c-77c63de9bb16 admin admin] Validating token access rules against request {{(pid=71938) validate_allowed_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 24 16:33:01.370159 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f66a5b0b-c2df-4a29-b5f4-82fa5ddbbca5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f2ba2e8375b4e8c8792ee1e22b60427', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '00a5583c7b7443e98e7a1d31a0b638dc', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=71938) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 24 16:33:01.370807 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f66a5b0b-c2df-4a29-b5f4-82fa5ddbbca5 admin admin] REQUEST_METHOD: `GET` {{(pid=71938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 24 16:33:01.371141 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f66a5b0b-c2df-4a29-b5f4-82fa5ddbbca5 admin admin] SCRIPT_NAME: `/identity` {{(pid=71938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 24 16:33:01.371470 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f66a5b0b-c2df-4a29-b5f4-82fa5ddbbca5 admin admin] PATH_INFO: `/v3/endpoints` {{(pid=71938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 24 16:33:01.372305 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f66a5b0b-c2df-4a29-b5f4-82fa5ddbbca5 admin admin] RBAC: Adding query filter params (interface=public, service_id=cb8724f804374178b925a4972ca6972a, region_id=RegionOne) {{(pid=71938) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:161}} Nov 24 16:33:01.372659 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f66a5b0b-c2df-4a29-b5f4-82fa5ddbbca5 admin admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=71938) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:442}} Nov 24 16:33:01.400884 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f66a5b0b-c2df-4a29-b5f4-82fa5ddbbca5 admin admin] RBAC: Authorization granted {{(pid=71938) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 24 16:33:01.406465 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: [pid: 71938|app: 0|req: 430/859] 10.222.0.53 () {56 vars in 1263 bytes} [Wed Nov 24 16:33:01 2021] GET /identity/v3/endpoints?service_id=cb8724f804374178b925a4972ca6972a&interface=public®ion_id=RegionOne => generated 194 bytes in 51 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 24 16:33:01.412418 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2598207-bd91-495f-be86-30a61db8d913 admin admin] Authenticating user token {{(pid=71939) process_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 24 16:33:01.423065 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2598207-bd91-495f-be86-30a61db8d913 admin admin] Validating token access rules against request {{(pid=71939) validate_allowed_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 24 16:33:01.427337 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06b3b6eb-ca53-4ee5-9322-1d98d2dbea0d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f2ba2e8375b4e8c8792ee1e22b60427', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '00a5583c7b7443e98e7a1d31a0b638dc', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=71939) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 24 16:33:01.427997 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06b3b6eb-ca53-4ee5-9322-1d98d2dbea0d admin admin] REQUEST_METHOD: `GET` {{(pid=71939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 24 16:33:01.428335 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06b3b6eb-ca53-4ee5-9322-1d98d2dbea0d admin admin] SCRIPT_NAME: `/identity` {{(pid=71939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 24 16:33:01.428668 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06b3b6eb-ca53-4ee5-9322-1d98d2dbea0d admin admin] PATH_INFO: `/v3/services` {{(pid=71939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 24 16:33:01.429405 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06b3b6eb-ca53-4ee5-9322-1d98d2dbea0d admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=71939) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:442}} Nov 24 16:33:01.458151 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06b3b6eb-ca53-4ee5-9322-1d98d2dbea0d admin admin] RBAC: Authorization granted {{(pid=71939) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 24 16:33:01.464492 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: [pid: 71939|app: 0|req: 430/860] 10.222.0.53 () {56 vars in 1099 bytes} [Wed Nov 24 16:33:01 2021] GET /identity/v3/services => generated 1500 bytes in 53 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 24 16:33:03.430681 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc13df70-b7f6-456a-83d7-87640e86c5c0 None None] REQUEST_METHOD: `GET` {{(pid=71938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 24 16:33:03.431240 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc13df70-b7f6-456a-83d7-87640e86c5c0 None None] SCRIPT_NAME: `/identity` {{(pid=71938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 24 16:33:03.431355 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc13df70-b7f6-456a-83d7-87640e86c5c0 None None] PATH_INFO: `/` {{(pid=71938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 24 16:33:03.433173 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: [pid: 71938|app: 0|req: 431/861] 10.222.0.53 () {54 vars in 915 bytes} [Wed Nov 24 16:33:03 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 24 16:33:03.439390 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9fc797e-ecf8-4946-b29a-dffe5092d0c4 None None] REQUEST_METHOD: `POST` {{(pid=71939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 24 16:33:03.439740 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9fc797e-ecf8-4946-b29a-dffe5092d0c4 None None] SCRIPT_NAME: `/identity` {{(pid=71939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 24 16:33:03.440079 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9fc797e-ecf8-4946-b29a-dffe5092d0c4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=71939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 24 16:33:03.469670 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.auth.core [None req-d9fc797e-ecf8-4946-b29a-dffe5092d0c4 None None] MFA Rules not processed for user `0f2ba2e8375b4e8c8792ee1e22b60427`. Rule list: `[]` (Enabled: `True`). {{(pid=71939) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:442}} Nov 24 16:33:03.471020 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.fernet_utils [None req-d9fc797e-ecf8-4946-b29a-dffe5092d0c4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=71939) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:289}} Nov 24 16:33:03.479460 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: [pid: 71939|app: 0|req: 431/862] 10.222.0.53 () {58 vars in 1013 bytes} [Wed Nov 24 16:33:03 2021] POST /identity/v3/auth/tokens => generated 2252 bytes in 41 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 24 16:33:03.501885 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e916b0c3-a70a-450f-ad75-f4999660754d None None] REQUEST_METHOD: `POST` {{(pid=71938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 24 16:33:03.502280 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e916b0c3-a70a-450f-ad75-f4999660754d None None] SCRIPT_NAME: `/identity` {{(pid=71938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 24 16:33:03.502623 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e916b0c3-a70a-450f-ad75-f4999660754d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=71938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 24 16:33:03.526608 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.auth.core [None req-e916b0c3-a70a-450f-ad75-f4999660754d None None] MFA Rules not processed for user `0f2ba2e8375b4e8c8792ee1e22b60427`. Rule list: `[]` (Enabled: `True`). {{(pid=71938) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:442}} Nov 24 16:33:03.527826 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.fernet_utils [None req-e916b0c3-a70a-450f-ad75-f4999660754d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=71938) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:289}} Nov 24 16:33:03.534972 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: [pid: 71938|app: 0|req: 432/863] 10.222.0.53 () {58 vars in 1013 bytes} [Wed Nov 24 16:33:03 2021] POST /identity/v3/auth/tokens => generated 2252 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 24 16:33:03.540701 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9fc797e-ecf8-4946-b29a-dffe5092d0c4 None None] Authenticating user token {{(pid=71939) process_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 24 16:33:03.550319 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9fc797e-ecf8-4946-b29a-dffe5092d0c4 None None] Validating token access rules against request {{(pid=71939) validate_allowed_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 24 16:33:03.554595 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0018511-1bc5-416c-ac06-5b9ca8f55ba7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f2ba2e8375b4e8c8792ee1e22b60427', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '00a5583c7b7443e98e7a1d31a0b638dc', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=71939) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 24 16:33:03.555414 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0018511-1bc5-416c-ac06-5b9ca8f55ba7 admin admin] REQUEST_METHOD: `GET` {{(pid=71939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 24 16:33:03.555758 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0018511-1bc5-416c-ac06-5b9ca8f55ba7 admin admin] SCRIPT_NAME: `/identity` {{(pid=71939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 24 16:33:03.556091 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0018511-1bc5-416c-ac06-5b9ca8f55ba7 admin admin] PATH_INFO: `/v3/services/volumev2` {{(pid=71939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 24 16:33:03.556801 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0018511-1bc5-416c-ac06-5b9ca8f55ba7 admin admin] RBAC: Authorizing `identity:get_service(service_id=volumev2)` {{(pid=71939) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:442}} Nov 24 16:33:03.586176 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0018511-1bc5-416c-ac06-5b9ca8f55ba7 admin admin] RBAC: Authorization granted {{(pid=71939) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 24 16:33:03.597894 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: WARNING keystone.server.flask.application [None req-c0018511-1bc5-416c-ac06-5b9ca8f55ba7 admin admin] Could not find service: volumev2.: keystone.exception.ServiceNotFound: Could not find service: volumev2. Nov 24 16:33:03.599099 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: [pid: 71939|app: 0|req: 432/864] 10.222.0.53 () {56 vars in 1126 bytes} [Wed Nov 24 16:33:03 2021] GET /identity/v3/services/volumev2 => generated 89 bytes in 59 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 24 16:33:03.605843 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e916b0c3-a70a-450f-ad75-f4999660754d None None] Authenticating user token {{(pid=71938) process_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 24 16:33:03.615675 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e916b0c3-a70a-450f-ad75-f4999660754d None None] Validating token access rules against request {{(pid=71938) validate_allowed_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 24 16:33:03.620163 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bc3596d-94da-4d9e-8492-c3a258b4691a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f2ba2e8375b4e8c8792ee1e22b60427', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '00a5583c7b7443e98e7a1d31a0b638dc', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=71938) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 24 16:33:03.620836 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bc3596d-94da-4d9e-8492-c3a258b4691a admin admin] REQUEST_METHOD: `GET` {{(pid=71938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 24 16:33:03.621178 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bc3596d-94da-4d9e-8492-c3a258b4691a admin admin] SCRIPT_NAME: `/identity` {{(pid=71938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 24 16:33:03.621512 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bc3596d-94da-4d9e-8492-c3a258b4691a admin admin] PATH_INFO: `/v3/services` {{(pid=71938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 24 16:33:03.622318 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bc3596d-94da-4d9e-8492-c3a258b4691a admin admin] RBAC: Adding query filter params (name=volumev2) {{(pid=71938) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:161}} Nov 24 16:33:03.622672 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bc3596d-94da-4d9e-8492-c3a258b4691a admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=71938) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:442}} Nov 24 16:33:03.651388 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bc3596d-94da-4d9e-8492-c3a258b4691a admin admin] RBAC: Authorization granted {{(pid=71938) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 24 16:33:03.656757 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: [pid: 71938|app: 0|req: 433/865] 10.222.0.53 () {56 vars in 1126 bytes} [Wed Nov 24 16:33:03 2021] GET /identity/v3/services?name=volumev2 => generated 125 bytes in 51 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 24 16:33:03.662927 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0018511-1bc5-416c-ac06-5b9ca8f55ba7 admin admin] Authenticating user token {{(pid=71939) process_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 24 16:33:03.673254 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0018511-1bc5-416c-ac06-5b9ca8f55ba7 admin admin] Validating token access rules against request {{(pid=71939) validate_allowed_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 24 16:33:03.677567 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d168bfb6-763a-40b1-8de9-d601b24b3fa1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f2ba2e8375b4e8c8792ee1e22b60427', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '00a5583c7b7443e98e7a1d31a0b638dc', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=71939) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 24 16:33:03.678267 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d168bfb6-763a-40b1-8de9-d601b24b3fa1 admin admin] REQUEST_METHOD: `GET` {{(pid=71939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 24 16:33:03.678610 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d168bfb6-763a-40b1-8de9-d601b24b3fa1 admin admin] SCRIPT_NAME: `/identity` {{(pid=71939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 24 16:33:03.678948 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d168bfb6-763a-40b1-8de9-d601b24b3fa1 admin admin] PATH_INFO: `/v3/services` {{(pid=71939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 24 16:33:03.679713 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d168bfb6-763a-40b1-8de9-d601b24b3fa1 admin admin] RBAC: Adding query filter params (type=volumev2) {{(pid=71939) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:161}} Nov 24 16:33:03.680069 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d168bfb6-763a-40b1-8de9-d601b24b3fa1 admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=71939) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:442}} Nov 24 16:33:03.708817 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d168bfb6-763a-40b1-8de9-d601b24b3fa1 admin admin] RBAC: Authorization granted {{(pid=71939) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 24 16:33:03.713916 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: [pid: 71939|app: 0|req: 433/866] 10.222.0.53 () {56 vars in 1126 bytes} [Wed Nov 24 16:33:03 2021] GET /identity/v3/services?type=volumev2 => generated 362 bytes in 52 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 24 16:33:03.719868 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bc3596d-94da-4d9e-8492-c3a258b4691a admin admin] Authenticating user token {{(pid=71938) process_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 24 16:33:03.729637 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bc3596d-94da-4d9e-8492-c3a258b4691a admin admin] Validating token access rules against request {{(pid=71938) validate_allowed_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 24 16:33:03.734607 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab64c1b8-0682-478c-81db-5e222110ccbc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f2ba2e8375b4e8c8792ee1e22b60427', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '00a5583c7b7443e98e7a1d31a0b638dc', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=71938) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 24 16:33:03.735264 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab64c1b8-0682-478c-81db-5e222110ccbc admin admin] REQUEST_METHOD: `POST` {{(pid=71938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 24 16:33:03.735606 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab64c1b8-0682-478c-81db-5e222110ccbc admin admin] SCRIPT_NAME: `/identity` {{(pid=71938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 24 16:33:03.735943 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab64c1b8-0682-478c-81db-5e222110ccbc admin admin] PATH_INFO: `/v3/endpoints` {{(pid=71938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 24 16:33:03.736733 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab64c1b8-0682-478c-81db-5e222110ccbc admin admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=71938) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:442}} Nov 24 16:33:03.769200 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab64c1b8-0682-478c-81db-5e222110ccbc admin admin] RBAC: Authorization granted {{(pid=71938) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 24 16:33:03.786015 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: [pid: 71938|app: 0|req: 434/867] 10.222.0.53 () {60 vars in 1156 bytes} [Wed Nov 24 16:33:03 2021] POST /identity/v3/endpoints => generated 346 bytes in 67 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 24 16:33:05.775794 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17437096-9144-4aa3-9821-ef8264cd127a None None] REQUEST_METHOD: `GET` {{(pid=71939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 24 16:33:05.776337 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17437096-9144-4aa3-9821-ef8264cd127a None None] SCRIPT_NAME: `/identity` {{(pid=71939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 24 16:33:05.776441 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17437096-9144-4aa3-9821-ef8264cd127a None None] PATH_INFO: `/` {{(pid=71939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 24 16:33:05.778332 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: [pid: 71939|app: 0|req: 434/868] 10.222.0.53 () {54 vars in 915 bytes} [Wed Nov 24 16:33:05 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 24 16:33:05.784452 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8284a84-644a-452b-a6b1-06b68f20306e None None] REQUEST_METHOD: `POST` {{(pid=71938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 24 16:33:05.784804 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8284a84-644a-452b-a6b1-06b68f20306e None None] SCRIPT_NAME: `/identity` {{(pid=71938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 24 16:33:05.785142 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8284a84-644a-452b-a6b1-06b68f20306e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=71938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 24 16:33:05.808370 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.auth.core [None req-f8284a84-644a-452b-a6b1-06b68f20306e None None] MFA Rules not processed for user `0f2ba2e8375b4e8c8792ee1e22b60427`. Rule list: `[]` (Enabled: `True`). {{(pid=71938) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:442}} Nov 24 16:33:05.809627 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.fernet_utils [None req-f8284a84-644a-452b-a6b1-06b68f20306e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=71938) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:289}} Nov 24 16:33:05.828195 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: [pid: 71938|app: 0|req: 435/869] 10.222.0.53 () {58 vars in 1013 bytes} [Wed Nov 24 16:33:05 2021] POST /identity/v3/auth/tokens => generated 2438 bytes in 45 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 24 16:33:05.849743 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a1d1a9e-03bb-4194-8f73-f107ff26e00d None None] REQUEST_METHOD: `POST` {{(pid=71939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 24 16:33:05.850118 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a1d1a9e-03bb-4194-8f73-f107ff26e00d None None] SCRIPT_NAME: `/identity` {{(pid=71939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 24 16:33:05.850457 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a1d1a9e-03bb-4194-8f73-f107ff26e00d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=71939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 24 16:33:05.874953 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.auth.core [None req-9a1d1a9e-03bb-4194-8f73-f107ff26e00d None None] MFA Rules not processed for user `0f2ba2e8375b4e8c8792ee1e22b60427`. Rule list: `[]` (Enabled: `True`). {{(pid=71939) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:442}} Nov 24 16:33:05.876155 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.fernet_utils [None req-9a1d1a9e-03bb-4194-8f73-f107ff26e00d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=71939) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:289}} Nov 24 16:33:05.883251 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: [pid: 71939|app: 0|req: 435/870] 10.222.0.53 () {58 vars in 1013 bytes} [Wed Nov 24 16:33:05 2021] POST /identity/v3/auth/tokens => generated 2438 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 24 16:33:05.889010 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8284a84-644a-452b-a6b1-06b68f20306e None None] Authenticating user token {{(pid=71938) process_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 24 16:33:05.898637 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8284a84-644a-452b-a6b1-06b68f20306e None None] Validating token access rules against request {{(pid=71938) validate_allowed_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 24 16:33:05.902978 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99fdc91a-218e-4e18-a503-90ea72c07b77 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f2ba2e8375b4e8c8792ee1e22b60427', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '00a5583c7b7443e98e7a1d31a0b638dc', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=71938) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 24 16:33:05.903795 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99fdc91a-218e-4e18-a503-90ea72c07b77 admin admin] REQUEST_METHOD: `GET` {{(pid=71938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 24 16:33:05.904133 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99fdc91a-218e-4e18-a503-90ea72c07b77 admin admin] SCRIPT_NAME: `/identity` {{(pid=71938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 24 16:33:05.904465 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99fdc91a-218e-4e18-a503-90ea72c07b77 admin admin] PATH_INFO: `/v3/services/volumev3` {{(pid=71938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 24 16:33:05.905177 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99fdc91a-218e-4e18-a503-90ea72c07b77 admin admin] RBAC: Authorizing `identity:get_service(service_id=volumev3)` {{(pid=71938) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:442}} Nov 24 16:33:05.933757 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99fdc91a-218e-4e18-a503-90ea72c07b77 admin admin] RBAC: Authorization granted {{(pid=71938) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 24 16:33:05.945846 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: WARNING keystone.server.flask.application [None req-99fdc91a-218e-4e18-a503-90ea72c07b77 admin admin] Could not find service: volumev3.: keystone.exception.ServiceNotFound: Could not find service: volumev3. Nov 24 16:33:05.947110 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: [pid: 71938|app: 0|req: 436/871] 10.222.0.53 () {56 vars in 1126 bytes} [Wed Nov 24 16:33:05 2021] GET /identity/v3/services/volumev3 => generated 89 bytes in 59 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 24 16:33:05.953561 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a1d1a9e-03bb-4194-8f73-f107ff26e00d None None] Authenticating user token {{(pid=71939) process_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 24 16:33:05.962548 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a1d1a9e-03bb-4194-8f73-f107ff26e00d None None] Validating token access rules against request {{(pid=71939) validate_allowed_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 24 16:33:05.966846 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b39182af-7f11-4eaf-8a9b-17ce4d846d25 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f2ba2e8375b4e8c8792ee1e22b60427', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '00a5583c7b7443e98e7a1d31a0b638dc', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=71939) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 24 16:33:05.967522 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b39182af-7f11-4eaf-8a9b-17ce4d846d25 admin admin] REQUEST_METHOD: `GET` {{(pid=71939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 24 16:33:05.967863 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b39182af-7f11-4eaf-8a9b-17ce4d846d25 admin admin] SCRIPT_NAME: `/identity` {{(pid=71939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 24 16:33:05.968195 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b39182af-7f11-4eaf-8a9b-17ce4d846d25 admin admin] PATH_INFO: `/v3/services` {{(pid=71939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 24 16:33:05.968953 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b39182af-7f11-4eaf-8a9b-17ce4d846d25 admin admin] RBAC: Adding query filter params (name=volumev3) {{(pid=71939) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:161}} Nov 24 16:33:05.969307 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b39182af-7f11-4eaf-8a9b-17ce4d846d25 admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=71939) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:442}} Nov 24 16:33:05.997505 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b39182af-7f11-4eaf-8a9b-17ce4d846d25 admin admin] RBAC: Authorization granted {{(pid=71939) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 24 16:33:06.003212 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: [pid: 71939|app: 0|req: 436/872] 10.222.0.53 () {56 vars in 1126 bytes} [Wed Nov 24 16:33:05 2021] GET /identity/v3/services?name=volumev3 => generated 125 bytes in 50 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 24 16:33:06.008992 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99fdc91a-218e-4e18-a503-90ea72c07b77 admin admin] Authenticating user token {{(pid=71938) process_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 24 16:33:06.018702 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99fdc91a-218e-4e18-a503-90ea72c07b77 admin admin] Validating token access rules against request {{(pid=71938) validate_allowed_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 24 16:33:06.022924 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16ac213f-7290-455c-866a-8b59ff2b4d3b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f2ba2e8375b4e8c8792ee1e22b60427', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '00a5583c7b7443e98e7a1d31a0b638dc', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=71938) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 24 16:33:06.023575 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16ac213f-7290-455c-866a-8b59ff2b4d3b admin admin] REQUEST_METHOD: `GET` {{(pid=71938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 24 16:33:06.023912 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16ac213f-7290-455c-866a-8b59ff2b4d3b admin admin] SCRIPT_NAME: `/identity` {{(pid=71938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 24 16:33:06.024288 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16ac213f-7290-455c-866a-8b59ff2b4d3b admin admin] PATH_INFO: `/v3/services` {{(pid=71938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 24 16:33:06.024986 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16ac213f-7290-455c-866a-8b59ff2b4d3b admin admin] RBAC: Adding query filter params (type=volumev3) {{(pid=71938) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:161}} Nov 24 16:33:06.025327 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16ac213f-7290-455c-866a-8b59ff2b4d3b admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=71938) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:442}} Nov 24 16:33:06.053910 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16ac213f-7290-455c-866a-8b59ff2b4d3b admin admin] RBAC: Authorization granted {{(pid=71938) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 24 16:33:06.058755 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: [pid: 71938|app: 0|req: 437/873] 10.222.0.53 () {56 vars in 1126 bytes} [Wed Nov 24 16:33:06 2021] GET /identity/v3/services?type=volumev3 => generated 125 bytes in 50 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 24 16:33:08.009420 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2353402c-4756-48f8-a679-6082a23a28e9 None None] REQUEST_METHOD: `GET` {{(pid=71939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 24 16:33:08.009969 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2353402c-4756-48f8-a679-6082a23a28e9 None None] SCRIPT_NAME: `/identity` {{(pid=71939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 24 16:33:08.010113 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2353402c-4756-48f8-a679-6082a23a28e9 None None] PATH_INFO: `/` {{(pid=71939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 24 16:33:08.011951 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: [pid: 71939|app: 0|req: 437/874] 10.222.0.53 () {54 vars in 915 bytes} [Wed Nov 24 16:33:08 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 24 16:33:08.017952 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a808f37a-5699-4630-bccc-21b55321223d None None] REQUEST_METHOD: `POST` {{(pid=71938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 24 16:33:08.018352 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a808f37a-5699-4630-bccc-21b55321223d None None] SCRIPT_NAME: `/identity` {{(pid=71938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 24 16:33:08.018684 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a808f37a-5699-4630-bccc-21b55321223d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=71938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 24 16:33:08.042460 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.auth.core [None req-a808f37a-5699-4630-bccc-21b55321223d None None] MFA Rules not processed for user `0f2ba2e8375b4e8c8792ee1e22b60427`. Rule list: `[]` (Enabled: `True`). {{(pid=71938) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:442}} Nov 24 16:33:08.043658 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.fernet_utils [None req-a808f37a-5699-4630-bccc-21b55321223d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=71938) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:289}} Nov 24 16:33:08.051249 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: [pid: 71938|app: 0|req: 438/875] 10.222.0.53 () {58 vars in 1013 bytes} [Wed Nov 24 16:33:08 2021] POST /identity/v3/auth/tokens => generated 2438 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 24 16:33:08.072691 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d78ad9eb-d866-4fd0-bc01-58d5f1aeebe0 None None] REQUEST_METHOD: `POST` {{(pid=71939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 24 16:33:08.073073 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d78ad9eb-d866-4fd0-bc01-58d5f1aeebe0 None None] SCRIPT_NAME: `/identity` {{(pid=71939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 24 16:33:08.073409 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d78ad9eb-d866-4fd0-bc01-58d5f1aeebe0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=71939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 24 16:33:08.097893 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.auth.core [None req-d78ad9eb-d866-4fd0-bc01-58d5f1aeebe0 None None] MFA Rules not processed for user `0f2ba2e8375b4e8c8792ee1e22b60427`. Rule list: `[]` (Enabled: `True`). {{(pid=71939) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:442}} Nov 24 16:33:08.099134 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.fernet_utils [None req-d78ad9eb-d866-4fd0-bc01-58d5f1aeebe0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=71939) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:289}} Nov 24 16:33:08.106239 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: [pid: 71939|app: 0|req: 438/876] 10.222.0.53 () {58 vars in 1013 bytes} [Wed Nov 24 16:33:08 2021] POST /identity/v3/auth/tokens => generated 2438 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 24 16:33:08.112249 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a808f37a-5699-4630-bccc-21b55321223d None None] Authenticating user token {{(pid=71938) process_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 24 16:33:08.121844 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a808f37a-5699-4630-bccc-21b55321223d None None] Validating token access rules against request {{(pid=71938) validate_allowed_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 24 16:33:08.126187 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ee1b756-70e4-4ae2-9e1c-3dd54d19b448 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f2ba2e8375b4e8c8792ee1e22b60427', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '00a5583c7b7443e98e7a1d31a0b638dc', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=71938) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 24 16:33:08.126854 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ee1b756-70e4-4ae2-9e1c-3dd54d19b448 admin admin] REQUEST_METHOD: `POST` {{(pid=71938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 24 16:33:08.127198 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ee1b756-70e4-4ae2-9e1c-3dd54d19b448 admin admin] SCRIPT_NAME: `/identity` {{(pid=71938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 24 16:33:08.127534 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ee1b756-70e4-4ae2-9e1c-3dd54d19b448 admin admin] PATH_INFO: `/v3/services` {{(pid=71938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 24 16:33:08.128302 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ee1b756-70e4-4ae2-9e1c-3dd54d19b448 admin admin] RBAC: Authorizing `identity:create_service()` {{(pid=71938) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:442}} Nov 24 16:33:08.157593 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ee1b756-70e4-4ae2-9e1c-3dd54d19b448 admin admin] RBAC: Authorization granted {{(pid=71938) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 24 16:33:08.169730 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: [pid: 71938|app: 0|req: 439/877] 10.222.0.53 () {60 vars in 1153 bytes} [Wed Nov 24 16:33:08 2021] POST /identity/v3/services => generated 251 bytes in 58 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 24 16:33:10.150831 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bddd870-eb19-435b-b028-ba33e43bf3bf None None] REQUEST_METHOD: `GET` {{(pid=71939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 24 16:33:10.151379 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bddd870-eb19-435b-b028-ba33e43bf3bf None None] SCRIPT_NAME: `/identity` {{(pid=71939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 24 16:33:10.151476 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bddd870-eb19-435b-b028-ba33e43bf3bf None None] PATH_INFO: `/` {{(pid=71939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 24 16:33:10.153311 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: [pid: 71939|app: 0|req: 439/878] 10.222.0.53 () {54 vars in 915 bytes} [Wed Nov 24 16:33:10 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 24 16:33:10.159225 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e515a218-8fb9-4b84-9991-e1a4ebf5e912 None None] REQUEST_METHOD: `POST` {{(pid=71938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 24 16:33:10.159577 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e515a218-8fb9-4b84-9991-e1a4ebf5e912 None None] SCRIPT_NAME: `/identity` {{(pid=71938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 24 16:33:10.159909 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e515a218-8fb9-4b84-9991-e1a4ebf5e912 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=71938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 24 16:33:10.183095 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.auth.core [None req-e515a218-8fb9-4b84-9991-e1a4ebf5e912 None None] MFA Rules not processed for user `0f2ba2e8375b4e8c8792ee1e22b60427`. Rule list: `[]` (Enabled: `True`). {{(pid=71938) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:442}} Nov 24 16:33:10.184311 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.fernet_utils [None req-e515a218-8fb9-4b84-9991-e1a4ebf5e912 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=71938) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:289}} Nov 24 16:33:10.203317 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: [pid: 71938|app: 0|req: 440/879] 10.222.0.53 () {58 vars in 1013 bytes} [Wed Nov 24 16:33:10 2021] POST /identity/v3/auth/tokens => generated 2539 bytes in 45 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 24 16:33:10.225231 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1e79b21-e72c-45b5-9085-85802c29ddbb None None] REQUEST_METHOD: `POST` {{(pid=71939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 24 16:33:10.225583 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1e79b21-e72c-45b5-9085-85802c29ddbb None None] SCRIPT_NAME: `/identity` {{(pid=71939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 24 16:33:10.225919 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1e79b21-e72c-45b5-9085-85802c29ddbb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=71939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 24 16:33:10.248998 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.auth.core [None req-e1e79b21-e72c-45b5-9085-85802c29ddbb None None] MFA Rules not processed for user `0f2ba2e8375b4e8c8792ee1e22b60427`. Rule list: `[]` (Enabled: `True`). {{(pid=71939) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:442}} Nov 24 16:33:10.250229 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.fernet_utils [None req-e1e79b21-e72c-45b5-9085-85802c29ddbb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=71939) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:289}} Nov 24 16:33:10.257177 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: [pid: 71939|app: 0|req: 440/880] 10.222.0.53 () {58 vars in 1013 bytes} [Wed Nov 24 16:33:10 2021] POST /identity/v3/auth/tokens => generated 2539 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 24 16:33:10.262979 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e515a218-8fb9-4b84-9991-e1a4ebf5e912 None None] Authenticating user token {{(pid=71938) process_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 24 16:33:10.273054 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e515a218-8fb9-4b84-9991-e1a4ebf5e912 None None] Validating token access rules against request {{(pid=71938) validate_allowed_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 24 16:33:10.277370 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fce7cdaa-d36d-4615-8d69-996ea12217b4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f2ba2e8375b4e8c8792ee1e22b60427', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '00a5583c7b7443e98e7a1d31a0b638dc', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=71938) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 24 16:33:10.278207 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fce7cdaa-d36d-4615-8d69-996ea12217b4 admin admin] REQUEST_METHOD: `GET` {{(pid=71938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 24 16:33:10.278545 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fce7cdaa-d36d-4615-8d69-996ea12217b4 admin admin] SCRIPT_NAME: `/identity` {{(pid=71938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 24 16:33:10.278875 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fce7cdaa-d36d-4615-8d69-996ea12217b4 admin admin] PATH_INFO: `/v3/services/volumev3` {{(pid=71938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 24 16:33:10.279582 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fce7cdaa-d36d-4615-8d69-996ea12217b4 admin admin] RBAC: Authorizing `identity:get_service(service_id=volumev3)` {{(pid=71938) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:442}} Nov 24 16:33:10.307570 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fce7cdaa-d36d-4615-8d69-996ea12217b4 admin admin] RBAC: Authorization granted {{(pid=71938) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 24 16:33:10.319573 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: WARNING keystone.server.flask.application [None req-fce7cdaa-d36d-4615-8d69-996ea12217b4 admin admin] Could not find service: volumev3.: keystone.exception.ServiceNotFound: Could not find service: volumev3. Nov 24 16:33:10.320733 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: [pid: 71938|app: 0|req: 441/881] 10.222.0.53 () {56 vars in 1126 bytes} [Wed Nov 24 16:33:10 2021] GET /identity/v3/services/volumev3 => generated 89 bytes in 58 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 24 16:33:10.328802 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1e79b21-e72c-45b5-9085-85802c29ddbb None None] Authenticating user token {{(pid=71939) process_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 24 16:33:10.338060 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1e79b21-e72c-45b5-9085-85802c29ddbb None None] Validating token access rules against request {{(pid=71939) validate_allowed_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 24 16:33:10.342478 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10764c95-04ab-4197-b319-c8ae152b6c89 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f2ba2e8375b4e8c8792ee1e22b60427', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '00a5583c7b7443e98e7a1d31a0b638dc', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=71939) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 24 16:33:10.343141 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10764c95-04ab-4197-b319-c8ae152b6c89 admin admin] REQUEST_METHOD: `GET` {{(pid=71939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 24 16:33:10.343478 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10764c95-04ab-4197-b319-c8ae152b6c89 admin admin] SCRIPT_NAME: `/identity` {{(pid=71939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 24 16:33:10.343817 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10764c95-04ab-4197-b319-c8ae152b6c89 admin admin] PATH_INFO: `/v3/services` {{(pid=71939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 24 16:33:10.344583 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10764c95-04ab-4197-b319-c8ae152b6c89 admin admin] RBAC: Adding query filter params (name=volumev3) {{(pid=71939) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:161}} Nov 24 16:33:10.344929 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10764c95-04ab-4197-b319-c8ae152b6c89 admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=71939) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:442}} Nov 24 16:33:10.373391 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10764c95-04ab-4197-b319-c8ae152b6c89 admin admin] RBAC: Authorization granted {{(pid=71939) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 24 16:33:10.379004 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: [pid: 71939|app: 0|req: 441/882] 10.222.0.53 () {56 vars in 1126 bytes} [Wed Nov 24 16:33:10 2021] GET /identity/v3/services?name=volumev3 => generated 125 bytes in 52 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 24 16:33:10.384973 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fce7cdaa-d36d-4615-8d69-996ea12217b4 admin admin] Authenticating user token {{(pid=71938) process_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 24 16:33:10.394761 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fce7cdaa-d36d-4615-8d69-996ea12217b4 admin admin] Validating token access rules against request {{(pid=71938) validate_allowed_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 24 16:33:10.399048 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc2a58af-2562-484b-a56c-d4bf68924f19 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f2ba2e8375b4e8c8792ee1e22b60427', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '00a5583c7b7443e98e7a1d31a0b638dc', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=71938) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 24 16:33:10.399699 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc2a58af-2562-484b-a56c-d4bf68924f19 admin admin] REQUEST_METHOD: `GET` {{(pid=71938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 24 16:33:10.400035 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc2a58af-2562-484b-a56c-d4bf68924f19 admin admin] SCRIPT_NAME: `/identity` {{(pid=71938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 24 16:33:10.400363 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc2a58af-2562-484b-a56c-d4bf68924f19 admin admin] PATH_INFO: `/v3/services` {{(pid=71938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 24 16:33:10.401167 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc2a58af-2562-484b-a56c-d4bf68924f19 admin admin] RBAC: Adding query filter params (type=volumev3) {{(pid=71938) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:161}} Nov 24 16:33:10.401460 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc2a58af-2562-484b-a56c-d4bf68924f19 admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=71938) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:442}} Nov 24 16:33:10.430008 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc2a58af-2562-484b-a56c-d4bf68924f19 admin admin] RBAC: Authorization granted {{(pid=71938) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 24 16:33:10.435245 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: [pid: 71938|app: 0|req: 442/883] 10.222.0.53 () {56 vars in 1126 bytes} [Wed Nov 24 16:33:10 2021] GET /identity/v3/services?type=volumev3 => generated 362 bytes in 51 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 24 16:33:10.441825 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10764c95-04ab-4197-b319-c8ae152b6c89 admin admin] Authenticating user token {{(pid=71939) process_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 24 16:33:10.451950 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10764c95-04ab-4197-b319-c8ae152b6c89 admin admin] Validating token access rules against request {{(pid=71939) validate_allowed_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 24 16:33:10.456346 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a86fc0f-cbf5-44a7-a91f-af99b0921190 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f2ba2e8375b4e8c8792ee1e22b60427', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '00a5583c7b7443e98e7a1d31a0b638dc', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=71939) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 24 16:33:10.457000 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a86fc0f-cbf5-44a7-a91f-af99b0921190 admin admin] REQUEST_METHOD: `GET` {{(pid=71939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 24 16:33:10.457339 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a86fc0f-cbf5-44a7-a91f-af99b0921190 admin admin] SCRIPT_NAME: `/identity` {{(pid=71939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 24 16:33:10.457673 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a86fc0f-cbf5-44a7-a91f-af99b0921190 admin admin] PATH_INFO: `/v3/endpoints` {{(pid=71939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 24 16:33:10.458571 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a86fc0f-cbf5-44a7-a91f-af99b0921190 admin admin] RBAC: Adding query filter params (interface=public, service_id=95d32e7ab3684b6d8865f9b7f3a37285, region_id=RegionOne) {{(pid=71939) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:161}} Nov 24 16:33:10.458935 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a86fc0f-cbf5-44a7-a91f-af99b0921190 admin admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=71939) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:442}} Nov 24 16:33:10.499719 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a86fc0f-cbf5-44a7-a91f-af99b0921190 admin admin] RBAC: Authorization granted {{(pid=71939) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 24 16:33:10.506163 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: [pid: 71939|app: 0|req: 442/884] 10.222.0.53 () {56 vars in 1263 bytes} [Wed Nov 24 16:33:10 2021] GET /identity/v3/endpoints?service_id=95d32e7ab3684b6d8865f9b7f3a37285&interface=public®ion_id=RegionOne => generated 194 bytes in 65 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 24 16:33:10.512352 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc2a58af-2562-484b-a56c-d4bf68924f19 admin admin] Authenticating user token {{(pid=71938) process_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 24 16:33:10.522239 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc2a58af-2562-484b-a56c-d4bf68924f19 admin admin] Validating token access rules against request {{(pid=71938) validate_allowed_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 24 16:33:10.526561 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59ff4fae-06e5-473b-8371-05ca158eba9a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f2ba2e8375b4e8c8792ee1e22b60427', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '00a5583c7b7443e98e7a1d31a0b638dc', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=71938) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 24 16:33:10.527224 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59ff4fae-06e5-473b-8371-05ca158eba9a admin admin] REQUEST_METHOD: `GET` {{(pid=71938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 24 16:33:10.527562 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59ff4fae-06e5-473b-8371-05ca158eba9a admin admin] SCRIPT_NAME: `/identity` {{(pid=71938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 24 16:33:10.527896 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59ff4fae-06e5-473b-8371-05ca158eba9a admin admin] PATH_INFO: `/v3/services` {{(pid=71938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 24 16:33:10.528634 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59ff4fae-06e5-473b-8371-05ca158eba9a admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=71938) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:442}} Nov 24 16:33:10.557070 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59ff4fae-06e5-473b-8371-05ca158eba9a admin admin] RBAC: Authorization granted {{(pid=71938) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 24 16:33:10.564388 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: [pid: 71938|app: 0|req: 443/885] 10.222.0.53 () {56 vars in 1099 bytes} [Wed Nov 24 16:33:10 2021] GET /identity/v3/services => generated 1739 bytes in 53 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 24 16:33:12.558730 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5e67be6-4fda-49e8-977a-4eecff6665c9 None None] REQUEST_METHOD: `GET` {{(pid=71939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 24 16:33:12.559224 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5e67be6-4fda-49e8-977a-4eecff6665c9 None None] SCRIPT_NAME: `/identity` {{(pid=71939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 24 16:33:12.559448 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5e67be6-4fda-49e8-977a-4eecff6665c9 None None] PATH_INFO: `/` {{(pid=71939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 24 16:33:12.561783 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: [pid: 71939|app: 0|req: 443/886] 10.222.0.53 () {54 vars in 915 bytes} [Wed Nov 24 16:33:12 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 24 16:33:12.567703 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7f69636-9b33-463c-8e47-6176ec540499 None None] REQUEST_METHOD: `POST` {{(pid=71938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 24 16:33:12.568056 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7f69636-9b33-463c-8e47-6176ec540499 None None] SCRIPT_NAME: `/identity` {{(pid=71938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 24 16:33:12.568393 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7f69636-9b33-463c-8e47-6176ec540499 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=71938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 24 16:33:12.593188 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.auth.core [None req-b7f69636-9b33-463c-8e47-6176ec540499 None None] MFA Rules not processed for user `0f2ba2e8375b4e8c8792ee1e22b60427`. Rule list: `[]` (Enabled: `True`). {{(pid=71938) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:442}} Nov 24 16:33:12.594436 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.fernet_utils [None req-b7f69636-9b33-463c-8e47-6176ec540499 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=71938) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:289}} Nov 24 16:33:12.601800 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: [pid: 71938|app: 0|req: 444/887] 10.222.0.53 () {58 vars in 1013 bytes} [Wed Nov 24 16:33:12 2021] POST /identity/v3/auth/tokens => generated 2539 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 24 16:33:12.625265 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a3ef0e2-2302-4d99-a26c-8dba3d3c6fdc None None] REQUEST_METHOD: `POST` {{(pid=71939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 24 16:33:12.625604 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a3ef0e2-2302-4d99-a26c-8dba3d3c6fdc None None] SCRIPT_NAME: `/identity` {{(pid=71939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 24 16:33:12.625934 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a3ef0e2-2302-4d99-a26c-8dba3d3c6fdc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=71939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 24 16:33:12.649467 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.auth.core [None req-0a3ef0e2-2302-4d99-a26c-8dba3d3c6fdc None None] MFA Rules not processed for user `0f2ba2e8375b4e8c8792ee1e22b60427`. Rule list: `[]` (Enabled: `True`). {{(pid=71939) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:442}} Nov 24 16:33:12.650752 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.fernet_utils [None req-0a3ef0e2-2302-4d99-a26c-8dba3d3c6fdc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=71939) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:289}} Nov 24 16:33:12.658862 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: [pid: 71939|app: 0|req: 444/888] 10.222.0.53 () {58 vars in 1013 bytes} [Wed Nov 24 16:33:12 2021] POST /identity/v3/auth/tokens => generated 2539 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 24 16:33:12.665036 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7f69636-9b33-463c-8e47-6176ec540499 None None] Authenticating user token {{(pid=71938) process_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 24 16:33:12.676309 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7f69636-9b33-463c-8e47-6176ec540499 None None] Validating token access rules against request {{(pid=71938) validate_allowed_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 24 16:33:12.680682 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b662a3a-f5cf-4c1f-9064-8976c562d490 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f2ba2e8375b4e8c8792ee1e22b60427', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '00a5583c7b7443e98e7a1d31a0b638dc', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=71938) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 24 16:33:12.681501 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b662a3a-f5cf-4c1f-9064-8976c562d490 admin admin] REQUEST_METHOD: `GET` {{(pid=71938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 24 16:33:12.681835 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b662a3a-f5cf-4c1f-9064-8976c562d490 admin admin] SCRIPT_NAME: `/identity` {{(pid=71938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 24 16:33:12.682199 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b662a3a-f5cf-4c1f-9064-8976c562d490 admin admin] PATH_INFO: `/v3/services/volumev3` {{(pid=71938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 24 16:33:12.682907 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b662a3a-f5cf-4c1f-9064-8976c562d490 admin admin] RBAC: Authorizing `identity:get_service(service_id=volumev3)` {{(pid=71938) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:442}} Nov 24 16:33:12.711767 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b662a3a-f5cf-4c1f-9064-8976c562d490 admin admin] RBAC: Authorization granted {{(pid=71938) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 24 16:33:12.723579 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: WARNING keystone.server.flask.application [None req-5b662a3a-f5cf-4c1f-9064-8976c562d490 admin admin] Could not find service: volumev3.: keystone.exception.ServiceNotFound: Could not find service: volumev3. Nov 24 16:33:12.724767 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: [pid: 71938|app: 0|req: 445/889] 10.222.0.53 () {56 vars in 1126 bytes} [Wed Nov 24 16:33:12 2021] GET /identity/v3/services/volumev3 => generated 89 bytes in 60 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 24 16:33:12.731966 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a3ef0e2-2302-4d99-a26c-8dba3d3c6fdc None None] Authenticating user token {{(pid=71939) process_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 24 16:33:12.743885 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a3ef0e2-2302-4d99-a26c-8dba3d3c6fdc None None] Validating token access rules against request {{(pid=71939) validate_allowed_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 24 16:33:12.748586 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f8cdaca-3861-4e25-9984-232eaad01e18 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f2ba2e8375b4e8c8792ee1e22b60427', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '00a5583c7b7443e98e7a1d31a0b638dc', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=71939) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 24 16:33:12.749766 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f8cdaca-3861-4e25-9984-232eaad01e18 admin admin] REQUEST_METHOD: `GET` {{(pid=71939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 24 16:33:12.750138 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f8cdaca-3861-4e25-9984-232eaad01e18 admin admin] SCRIPT_NAME: `/identity` {{(pid=71939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 24 16:33:12.750477 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f8cdaca-3861-4e25-9984-232eaad01e18 admin admin] PATH_INFO: `/v3/services` {{(pid=71939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 24 16:33:12.751254 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f8cdaca-3861-4e25-9984-232eaad01e18 admin admin] RBAC: Adding query filter params (name=volumev3) {{(pid=71939) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:161}} Nov 24 16:33:12.751599 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f8cdaca-3861-4e25-9984-232eaad01e18 admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=71939) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:442}} Nov 24 16:33:12.779401 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f8cdaca-3861-4e25-9984-232eaad01e18 admin admin] RBAC: Authorization granted {{(pid=71939) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 24 16:33:12.785284 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: [pid: 71939|app: 0|req: 445/890] 10.222.0.53 () {56 vars in 1126 bytes} [Wed Nov 24 16:33:12 2021] GET /identity/v3/services?name=volumev3 => generated 125 bytes in 54 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 24 16:33:12.792081 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b662a3a-f5cf-4c1f-9064-8976c562d490 admin admin] Authenticating user token {{(pid=71938) process_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 24 16:33:12.803606 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b662a3a-f5cf-4c1f-9064-8976c562d490 admin admin] Validating token access rules against request {{(pid=71938) validate_allowed_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 24 16:33:12.810187 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef47c7bd-b464-4581-9f00-7a3048a5b478 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f2ba2e8375b4e8c8792ee1e22b60427', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '00a5583c7b7443e98e7a1d31a0b638dc', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=71938) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 24 16:33:12.810796 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef47c7bd-b464-4581-9f00-7a3048a5b478 admin admin] REQUEST_METHOD: `GET` {{(pid=71938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 24 16:33:12.811723 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef47c7bd-b464-4581-9f00-7a3048a5b478 admin admin] SCRIPT_NAME: `/identity` {{(pid=71938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 24 16:33:12.812053 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef47c7bd-b464-4581-9f00-7a3048a5b478 admin admin] PATH_INFO: `/v3/services` {{(pid=71938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 24 16:33:12.812830 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef47c7bd-b464-4581-9f00-7a3048a5b478 admin admin] RBAC: Adding query filter params (type=volumev3) {{(pid=71938) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:161}} Nov 24 16:33:12.813184 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef47c7bd-b464-4581-9f00-7a3048a5b478 admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=71938) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:442}} Nov 24 16:33:12.841599 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef47c7bd-b464-4581-9f00-7a3048a5b478 admin admin] RBAC: Authorization granted {{(pid=71938) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 24 16:33:12.847194 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: [pid: 71938|app: 0|req: 446/891] 10.222.0.53 () {56 vars in 1126 bytes} [Wed Nov 24 16:33:12 2021] GET /identity/v3/services?type=volumev3 => generated 362 bytes in 56 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 24 16:33:12.863081 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f8cdaca-3861-4e25-9984-232eaad01e18 admin admin] Authenticating user token {{(pid=71939) process_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 24 16:33:12.872952 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f8cdaca-3861-4e25-9984-232eaad01e18 admin admin] Validating token access rules against request {{(pid=71939) validate_allowed_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 24 16:33:12.878171 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a77e3e76-42fb-4e9e-b0c5-ae47adbab25d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f2ba2e8375b4e8c8792ee1e22b60427', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '00a5583c7b7443e98e7a1d31a0b638dc', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=71939) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 24 16:33:12.878828 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a77e3e76-42fb-4e9e-b0c5-ae47adbab25d admin admin] REQUEST_METHOD: `POST` {{(pid=71939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 24 16:33:12.879168 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a77e3e76-42fb-4e9e-b0c5-ae47adbab25d admin admin] SCRIPT_NAME: `/identity` {{(pid=71939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 24 16:33:12.879510 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a77e3e76-42fb-4e9e-b0c5-ae47adbab25d admin admin] PATH_INFO: `/v3/endpoints` {{(pid=71939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 24 16:33:12.880293 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a77e3e76-42fb-4e9e-b0c5-ae47adbab25d admin admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=71939) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:442}} Nov 24 16:33:12.908030 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a77e3e76-42fb-4e9e-b0c5-ae47adbab25d admin admin] RBAC: Authorization granted {{(pid=71939) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 24 16:33:12.925494 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: [pid: 71939|app: 0|req: 446/892] 10.222.0.53 () {60 vars in 1156 bytes} [Wed Nov 24 16:33:12 2021] POST /identity/v3/endpoints => generated 346 bytes in 63 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 24 16:33:14.934199 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53c92f93-8f40-4316-ab7e-8976dc4c303a None None] REQUEST_METHOD: `GET` {{(pid=71938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 24 16:33:14.934722 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53c92f93-8f40-4316-ab7e-8976dc4c303a None None] SCRIPT_NAME: `/identity` {{(pid=71938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 24 16:33:14.934875 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53c92f93-8f40-4316-ab7e-8976dc4c303a None None] PATH_INFO: `/` {{(pid=71938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 24 16:33:14.936722 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: [pid: 71938|app: 0|req: 447/893] 10.222.0.53 () {54 vars in 915 bytes} [Wed Nov 24 16:33:14 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 24 16:33:14.942240 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54e37b53-e824-44fa-aeb1-d1de9a87d3d9 None None] REQUEST_METHOD: `POST` {{(pid=71939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 24 16:33:14.942597 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54e37b53-e824-44fa-aeb1-d1de9a87d3d9 None None] SCRIPT_NAME: `/identity` {{(pid=71939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 24 16:33:14.942935 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54e37b53-e824-44fa-aeb1-d1de9a87d3d9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=71939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 24 16:33:14.968482 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.auth.core [None req-54e37b53-e824-44fa-aeb1-d1de9a87d3d9 None None] MFA Rules not processed for user `0f2ba2e8375b4e8c8792ee1e22b60427`. Rule list: `[]` (Enabled: `True`). {{(pid=71939) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:442}} Nov 24 16:33:14.969679 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.fernet_utils [None req-54e37b53-e824-44fa-aeb1-d1de9a87d3d9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=71939) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:289}} Nov 24 16:33:14.986989 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: [pid: 71939|app: 0|req: 447/894] 10.222.0.53 () {58 vars in 1013 bytes} [Wed Nov 24 16:33:14 2021] POST /identity/v3/auth/tokens => generated 2725 bytes in 46 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 24 16:33:15.008804 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6eb9cc52-8482-41aa-9366-34a878a2a544 None None] REQUEST_METHOD: `POST` {{(pid=71938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 24 16:33:15.009246 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6eb9cc52-8482-41aa-9366-34a878a2a544 None None] SCRIPT_NAME: `/identity` {{(pid=71938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 24 16:33:15.009587 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6eb9cc52-8482-41aa-9366-34a878a2a544 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=71938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 24 16:33:15.033966 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.auth.core [None req-6eb9cc52-8482-41aa-9366-34a878a2a544 None None] MFA Rules not processed for user `0f2ba2e8375b4e8c8792ee1e22b60427`. Rule list: `[]` (Enabled: `True`). {{(pid=71938) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:442}} Nov 24 16:33:15.035223 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.fernet_utils [None req-6eb9cc52-8482-41aa-9366-34a878a2a544 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=71938) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:289}} Nov 24 16:33:15.042442 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: [pid: 71938|app: 0|req: 448/895] 10.222.0.53 () {58 vars in 1013 bytes} [Wed Nov 24 16:33:15 2021] POST /identity/v3/auth/tokens => generated 2725 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 24 16:33:15.048444 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54e37b53-e824-44fa-aeb1-d1de9a87d3d9 None None] Authenticating user token {{(pid=71939) process_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 24 16:33:15.057915 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54e37b53-e824-44fa-aeb1-d1de9a87d3d9 None None] Validating token access rules against request {{(pid=71939) validate_allowed_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 24 16:33:15.062198 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf95ecb5-1f59-41e8-a649-9a021a71dff4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f2ba2e8375b4e8c8792ee1e22b60427', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '00a5583c7b7443e98e7a1d31a0b638dc', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=71939) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 24 16:33:15.062861 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf95ecb5-1f59-41e8-a649-9a021a71dff4 admin admin] REQUEST_METHOD: `POST` {{(pid=71939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 24 16:33:15.063200 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf95ecb5-1f59-41e8-a649-9a021a71dff4 admin admin] SCRIPT_NAME: `/identity` {{(pid=71939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 24 16:33:15.063533 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf95ecb5-1f59-41e8-a649-9a021a71dff4 admin admin] PATH_INFO: `/v3/projects` {{(pid=71939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 24 16:33:15.064259 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf95ecb5-1f59-41e8-a649-9a021a71dff4 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=71939) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:442}} Nov 24 16:33:15.093415 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf95ecb5-1f59-41e8-a649-9a021a71dff4 admin admin] RBAC: Authorization granted {{(pid=71939) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 24 16:33:15.094867 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: WARNING keystone.server.flask.common [None req-bf95ecb5-1f59-41e8-a649-9a021a71dff4 admin admin] Deprecated: Not specifying a domain during a create user, group or project call, and relying on falling back to the default domain, is deprecated as of Liberty. There is no plan to remove this compatibility, however, future API versions may remove this, so please specify the domain explicitly or use a domain-scoped token. Nov 24 16:33:15.115264 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.sql.core [None req-bf95ecb5-1f59-41e8-a649-9a021a71dff4 admin admin] Conflict project: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'default-service' for key 'ixu_project_name_domain_id'") Nov 24 16:33:15.115264 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: [SQL: INSERT INTO project (id, name, domain_id, description, enabled, extra, parent_id, is_domain) VALUES (%(id)s, %(name)s, %(domain_id)s, %(description)s, %(enabled)s, %(extra)s, %(parent_id)s, %(is_domain)s)] Nov 24 16:33:15.115264 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: [parameters: {'id': 'a4ef61af318446cd8a3cc731c6405def', 'name': 'service', 'domain_id': 'default', 'description': '', 'enabled': 1, 'extra': '{}', 'parent_id': 'default', 'is_domain': 0}] Nov 24 16:33:15.115264 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: (Background on this error at: http://sqlalche.me/e/gkpj) {{(pid=71939) wrapper /opt/stack/keystone/keystone/common/sql/core.py:523}} Nov 24 16:33:15.131342 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: WARNING keystone.server.flask.application [None req-bf95ecb5-1f59-41e8-a649-9a021a71dff4 admin admin] Conflict occurred attempting to store project - it is not permitted to have two projects with either the same name or same id in the same domain: name is service, project id a4ef61af318446cd8a3cc731c6405def.: keystone.exception.Conflict: Conflict occurred attempting to store project - it is not permitted to have two projects with either the same name or same id in the same domain: name is service, project id a4ef61af318446cd8a3cc731c6405def. Nov 24 16:33:15.133506 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: [pid: 71939|app: 0|req: 448/896] 10.222.0.53 () {60 vars in 1152 bytes} [Wed Nov 24 16:33:15 2021] POST /identity/v3/projects => generated 262 bytes in 86 msecs (HTTP/1.1 409) 5 headers in 183 bytes (1 switches on core 0) Nov 24 16:33:15.142605 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6eb9cc52-8482-41aa-9366-34a878a2a544 None None] Authenticating user token {{(pid=71938) process_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 24 16:33:15.151997 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6eb9cc52-8482-41aa-9366-34a878a2a544 None None] Validating token access rules against request {{(pid=71938) validate_allowed_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 24 16:33:15.157423 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-338ce6b9-2b21-4471-a3fa-200c71e861b7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f2ba2e8375b4e8c8792ee1e22b60427', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '00a5583c7b7443e98e7a1d31a0b638dc', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=71938) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 24 16:33:15.158263 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-338ce6b9-2b21-4471-a3fa-200c71e861b7 admin admin] REQUEST_METHOD: `GET` {{(pid=71938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 24 16:33:15.158603 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-338ce6b9-2b21-4471-a3fa-200c71e861b7 admin admin] SCRIPT_NAME: `/identity` {{(pid=71938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 24 16:33:15.158935 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-338ce6b9-2b21-4471-a3fa-200c71e861b7 admin admin] PATH_INFO: `/v3/projects/service` {{(pid=71938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 24 16:33:15.169356 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-338ce6b9-2b21-4471-a3fa-200c71e861b7 admin admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=71938) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:442}} Nov 24 16:33:15.198804 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-338ce6b9-2b21-4471-a3fa-200c71e861b7 admin admin] RBAC: Authorization granted {{(pid=71938) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 24 16:33:15.215746 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: WARNING keystone.server.flask.application [None req-338ce6b9-2b21-4471-a3fa-200c71e861b7 admin admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Nov 24 16:33:15.217005 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: [pid: 71938|app: 0|req: 449/897] 10.222.0.53 () {56 vars in 1123 bytes} [Wed Nov 24 16:33:15 2021] GET /identity/v3/projects/service => generated 88 bytes in 75 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 24 16:33:15.223624 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf95ecb5-1f59-41e8-a649-9a021a71dff4 admin admin] Authenticating user token {{(pid=71939) process_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 24 16:33:15.233898 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf95ecb5-1f59-41e8-a649-9a021a71dff4 admin admin] Validating token access rules against request {{(pid=71939) validate_allowed_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 24 16:33:15.238258 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be368f1d-da31-42ba-9f92-99cdb51e320b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f2ba2e8375b4e8c8792ee1e22b60427', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '00a5583c7b7443e98e7a1d31a0b638dc', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=71939) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 24 16:33:15.238919 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be368f1d-da31-42ba-9f92-99cdb51e320b admin admin] REQUEST_METHOD: `GET` {{(pid=71939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 24 16:33:15.239260 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be368f1d-da31-42ba-9f92-99cdb51e320b admin admin] SCRIPT_NAME: `/identity` {{(pid=71939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 24 16:33:15.239594 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be368f1d-da31-42ba-9f92-99cdb51e320b admin admin] PATH_INFO: `/v3/projects` {{(pid=71939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 24 16:33:15.240417 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be368f1d-da31-42ba-9f92-99cdb51e320b admin admin] RBAC: Adding query filter params (name=service) {{(pid=71939) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:161}} Nov 24 16:33:15.240767 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be368f1d-da31-42ba-9f92-99cdb51e320b admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=71939) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:442}} Nov 24 16:33:15.270407 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be368f1d-da31-42ba-9f92-99cdb51e320b admin admin] RBAC: Authorization granted {{(pid=71939) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 24 16:33:15.287436 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: [pid: 71939|app: 0|req: 449/898] 10.222.0.53 () {56 vars in 1124 bytes} [Wed Nov 24 16:33:15 2021] GET /identity/v3/projects?name=service => generated 411 bytes in 65 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 24 16:33:17.280317 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09a35ed6-e2fe-4899-a54c-a2142b355df4 None None] REQUEST_METHOD: `GET` {{(pid=71938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 24 16:33:17.280807 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09a35ed6-e2fe-4899-a54c-a2142b355df4 None None] SCRIPT_NAME: `/identity` {{(pid=71938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 24 16:33:17.280967 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09a35ed6-e2fe-4899-a54c-a2142b355df4 None None] PATH_INFO: `/` {{(pid=71938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 24 16:33:17.282851 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: [pid: 71938|app: 0|req: 450/899] 10.222.0.53 () {54 vars in 915 bytes} [Wed Nov 24 16:33:17 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 24 16:33:17.288266 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54fd84a9-2c8d-4a3f-bcfb-5634de4da947 None None] REQUEST_METHOD: `POST` {{(pid=71939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 24 16:33:17.288625 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54fd84a9-2c8d-4a3f-bcfb-5634de4da947 None None] SCRIPT_NAME: `/identity` {{(pid=71939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 24 16:33:17.288966 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54fd84a9-2c8d-4a3f-bcfb-5634de4da947 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=71939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 24 16:33:17.313533 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.auth.core [None req-54fd84a9-2c8d-4a3f-bcfb-5634de4da947 None None] MFA Rules not processed for user `0f2ba2e8375b4e8c8792ee1e22b60427`. Rule list: `[]` (Enabled: `True`). {{(pid=71939) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:442}} Nov 24 16:33:17.315175 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.fernet_utils [None req-54fd84a9-2c8d-4a3f-bcfb-5634de4da947 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=71939) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:289}} Nov 24 16:33:17.322602 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: [pid: 71939|app: 0|req: 450/900] 10.222.0.53 () {58 vars in 1013 bytes} [Wed Nov 24 16:33:17 2021] POST /identity/v3/auth/tokens => generated 2725 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 24 16:33:17.345564 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a30e237-270d-4b8d-98f5-7d2195576095 None None] REQUEST_METHOD: `POST` {{(pid=71938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 24 16:33:17.345911 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a30e237-270d-4b8d-98f5-7d2195576095 None None] SCRIPT_NAME: `/identity` {{(pid=71938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 24 16:33:17.346287 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a30e237-270d-4b8d-98f5-7d2195576095 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=71938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 24 16:33:17.371284 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.auth.core [None req-2a30e237-270d-4b8d-98f5-7d2195576095 None None] MFA Rules not processed for user `0f2ba2e8375b4e8c8792ee1e22b60427`. Rule list: `[]` (Enabled: `True`). {{(pid=71938) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:442}} Nov 24 16:33:17.372488 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.fernet_utils [None req-2a30e237-270d-4b8d-98f5-7d2195576095 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=71938) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:289}} Nov 24 16:33:17.380157 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: [pid: 71938|app: 0|req: 451/901] 10.222.0.53 () {58 vars in 1013 bytes} [Wed Nov 24 16:33:17 2021] POST /identity/v3/auth/tokens => generated 2725 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 24 16:33:17.386042 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54fd84a9-2c8d-4a3f-bcfb-5634de4da947 None None] Authenticating user token {{(pid=71939) process_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 24 16:33:17.396074 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54fd84a9-2c8d-4a3f-bcfb-5634de4da947 None None] Validating token access rules against request {{(pid=71939) validate_allowed_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 24 16:33:17.400447 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eed029e0-05a5-48fc-83de-2879493be5cc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f2ba2e8375b4e8c8792ee1e22b60427', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '00a5583c7b7443e98e7a1d31a0b638dc', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=71939) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 24 16:33:17.401126 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eed029e0-05a5-48fc-83de-2879493be5cc admin admin] REQUEST_METHOD: `POST` {{(pid=71939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 24 16:33:17.401470 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eed029e0-05a5-48fc-83de-2879493be5cc admin admin] SCRIPT_NAME: `/identity` {{(pid=71939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 24 16:33:17.401807 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eed029e0-05a5-48fc-83de-2879493be5cc admin admin] PATH_INFO: `/v3/users` {{(pid=71939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 24 16:33:17.402588 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eed029e0-05a5-48fc-83de-2879493be5cc admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=71939) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:442}} Nov 24 16:33:17.430463 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: WARNING py.warnings [None req-eed029e0-05a5-48fc-83de-2879493be5cc admin admin] /usr/local/lib/python3.6/dist-packages/oslo_policy/policy.py:1018: UserWarning: Policy identity:create_user failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Nov 24 16:33:17.430463 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: warnings.warn(msg) Nov 24 16:33:17.430463 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: Nov 24 16:33:17.431763 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eed029e0-05a5-48fc-83de-2879493be5cc admin admin] RBAC: Authorization granted {{(pid=71939) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 24 16:33:17.448511 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.sql.core [None req-eed029e0-05a5-48fc-83de-2879493be5cc admin admin] Conflict user: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'default-cinder' for key 'domain_id'") Nov 24 16:33:17.448511 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: [SQL: INSERT INTO local_user (user_id, domain_id, name, failed_auth_count, failed_auth_at) VALUES (%(user_id)s, %(domain_id)s, %(name)s, %(failed_auth_count)s, %(failed_auth_at)s)] Nov 24 16:33:17.448511 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: [parameters: {'user_id': '8e76a9e4134b4ffbb58cffb994e2169f', 'domain_id': 'default', 'name': 'cinder', 'failed_auth_count': 0, 'failed_auth_at': None}] Nov 24 16:33:17.448511 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: (Background on this error at: http://sqlalche.me/e/gkpj) {{(pid=71939) wrapper /opt/stack/keystone/keystone/common/sql/core.py:523}} Nov 24 16:33:17.456005 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: WARNING keystone.server.flask.application [None req-eed029e0-05a5-48fc-83de-2879493be5cc admin admin] Conflict occurred attempting to store user - Duplicate entry found with name cinder at domain ID default.: keystone.exception.Conflict: Conflict occurred attempting to store user - Duplicate entry found with name cinder at domain ID default. Nov 24 16:33:17.457269 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: [pid: 71939|app: 0|req: 451/902] 10.222.0.53 () {60 vars in 1143 bytes} [Wed Nov 24 16:33:17 2021] POST /identity/v3/users => generated 160 bytes in 72 msecs (HTTP/1.1 409) 5 headers in 183 bytes (1 switches on core 0) Nov 24 16:33:17.463958 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a30e237-270d-4b8d-98f5-7d2195576095 None None] Authenticating user token {{(pid=71938) process_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 24 16:33:17.473043 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a30e237-270d-4b8d-98f5-7d2195576095 None None] Validating token access rules against request {{(pid=71938) validate_allowed_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 24 16:33:17.477391 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-328fdfc8-bebd-4dc9-9ab7-b9ce05d34efd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f2ba2e8375b4e8c8792ee1e22b60427', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '00a5583c7b7443e98e7a1d31a0b638dc', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=71938) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 24 16:33:17.478238 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-328fdfc8-bebd-4dc9-9ab7-b9ce05d34efd admin admin] REQUEST_METHOD: `GET` {{(pid=71938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 24 16:33:17.478688 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-328fdfc8-bebd-4dc9-9ab7-b9ce05d34efd admin admin] SCRIPT_NAME: `/identity` {{(pid=71938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 24 16:33:17.479093 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-328fdfc8-bebd-4dc9-9ab7-b9ce05d34efd admin admin] PATH_INFO: `/v3/users/cinder` {{(pid=71938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 24 16:33:17.492760 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-328fdfc8-bebd-4dc9-9ab7-b9ce05d34efd admin admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=71938) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:442}} Nov 24 16:33:17.522260 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-328fdfc8-bebd-4dc9-9ab7-b9ce05d34efd admin admin] RBAC: Authorization granted {{(pid=71938) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 24 16:33:17.541348 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: WARNING keystone.server.flask.application [None req-328fdfc8-bebd-4dc9-9ab7-b9ce05d34efd admin admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. Nov 24 16:33:17.542555 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: [pid: 71938|app: 0|req: 452/903] 10.222.0.53 () {56 vars in 1111 bytes} [Wed Nov 24 16:33:17 2021] GET /identity/v3/users/cinder => generated 84 bytes in 79 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 24 16:33:17.549012 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eed029e0-05a5-48fc-83de-2879493be5cc admin admin] Authenticating user token {{(pid=71939) process_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 24 16:33:17.559204 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eed029e0-05a5-48fc-83de-2879493be5cc admin admin] Validating token access rules against request {{(pid=71939) validate_allowed_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 24 16:33:17.563989 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5519efd6-d2af-4c04-a335-da20cb778f3e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f2ba2e8375b4e8c8792ee1e22b60427', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '00a5583c7b7443e98e7a1d31a0b638dc', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=71939) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 24 16:33:17.564655 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5519efd6-d2af-4c04-a335-da20cb778f3e admin admin] REQUEST_METHOD: `GET` {{(pid=71939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 24 16:33:17.564991 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5519efd6-d2af-4c04-a335-da20cb778f3e admin admin] SCRIPT_NAME: `/identity` {{(pid=71939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 24 16:33:17.565322 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5519efd6-d2af-4c04-a335-da20cb778f3e admin admin] PATH_INFO: `/v3/users` {{(pid=71939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 24 16:33:17.566229 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5519efd6-d2af-4c04-a335-da20cb778f3e admin admin] RBAC: Adding query filter params (name=cinder) {{(pid=71939) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:161}} Nov 24 16:33:17.566578 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5519efd6-d2af-4c04-a335-da20cb778f3e admin admin] RBAC: Authorizing `identity:list_users()` {{(pid=71939) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:442}} Nov 24 16:33:17.595955 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5519efd6-d2af-4c04-a335-da20cb778f3e admin admin] RBAC: Authorization granted {{(pid=71939) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 24 16:33:17.629341 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: [pid: 71939|app: 0|req: 452/904] 10.222.0.53 () {56 vars in 1113 bytes} [Wed Nov 24 16:33:17 2021] GET /identity/v3/users?name=cinder => generated 354 bytes in 81 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 24 16:33:19.752187 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-504479df-542a-4db8-acae-2f75ddfe59cd None None] REQUEST_METHOD: `GET` {{(pid=71938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 24 16:33:19.752733 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-504479df-542a-4db8-acae-2f75ddfe59cd None None] SCRIPT_NAME: `/identity` {{(pid=71938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 24 16:33:19.752843 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-504479df-542a-4db8-acae-2f75ddfe59cd None None] PATH_INFO: `/` {{(pid=71938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 24 16:33:19.754683 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: [pid: 71938|app: 0|req: 453/905] 10.222.0.53 () {54 vars in 915 bytes} [Wed Nov 24 16:33:19 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 24 16:33:19.760302 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcb59862-283f-4e47-a7b5-d4c600f8356f None None] REQUEST_METHOD: `POST` {{(pid=71939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 24 16:33:19.760655 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcb59862-283f-4e47-a7b5-d4c600f8356f None None] SCRIPT_NAME: `/identity` {{(pid=71939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 24 16:33:19.760991 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcb59862-283f-4e47-a7b5-d4c600f8356f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=71939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 24 16:33:19.784453 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.auth.core [None req-bcb59862-283f-4e47-a7b5-d4c600f8356f None None] MFA Rules not processed for user `0f2ba2e8375b4e8c8792ee1e22b60427`. Rule list: `[]` (Enabled: `True`). {{(pid=71939) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:442}} Nov 24 16:33:19.785994 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.fernet_utils [None req-bcb59862-283f-4e47-a7b5-d4c600f8356f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=71939) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:289}} Nov 24 16:33:19.793165 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: [pid: 71939|app: 0|req: 453/906] 10.222.0.53 () {58 vars in 1013 bytes} [Wed Nov 24 16:33:19 2021] POST /identity/v3/auth/tokens => generated 2725 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 24 16:33:19.817355 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b64df53b-1001-44b6-867c-68b5fe4d3b5b None None] REQUEST_METHOD: `POST` {{(pid=71938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 24 16:33:19.817705 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b64df53b-1001-44b6-867c-68b5fe4d3b5b None None] SCRIPT_NAME: `/identity` {{(pid=71938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 24 16:33:19.818058 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b64df53b-1001-44b6-867c-68b5fe4d3b5b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=71938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 24 16:33:19.841520 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.auth.core [None req-b64df53b-1001-44b6-867c-68b5fe4d3b5b None None] MFA Rules not processed for user `0f2ba2e8375b4e8c8792ee1e22b60427`. Rule list: `[]` (Enabled: `True`). {{(pid=71938) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:442}} Nov 24 16:33:19.843260 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.fernet_utils [None req-b64df53b-1001-44b6-867c-68b5fe4d3b5b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=71938) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:289}} Nov 24 16:33:19.850497 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: [pid: 71938|app: 0|req: 454/907] 10.222.0.53 () {58 vars in 1013 bytes} [Wed Nov 24 16:33:19 2021] POST /identity/v3/auth/tokens => generated 2725 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 24 16:33:19.856333 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcb59862-283f-4e47-a7b5-d4c600f8356f None None] Authenticating user token {{(pid=71939) process_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 24 16:33:19.866414 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcb59862-283f-4e47-a7b5-d4c600f8356f None None] Validating token access rules against request {{(pid=71939) validate_allowed_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 24 16:33:19.870665 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-732a716f-d078-4963-a913-758f521d671f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f2ba2e8375b4e8c8792ee1e22b60427', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '00a5583c7b7443e98e7a1d31a0b638dc', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=71939) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 24 16:33:19.871459 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-732a716f-d078-4963-a913-758f521d671f admin admin] REQUEST_METHOD: `GET` {{(pid=71939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 24 16:33:19.871793 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-732a716f-d078-4963-a913-758f521d671f admin admin] SCRIPT_NAME: `/identity` {{(pid=71939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 24 16:33:19.872119 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-732a716f-d078-4963-a913-758f521d671f admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=71939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 24 16:33:19.884568 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-732a716f-d078-4963-a913-758f521d671f admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=71939) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:442}} Nov 24 16:33:19.914226 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-732a716f-d078-4963-a913-758f521d671f admin admin] RBAC: Authorization granted {{(pid=71939) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 24 16:33:19.932593 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: WARNING keystone.server.flask.application [None req-732a716f-d078-4963-a913-758f521d671f admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Nov 24 16:33:19.933773 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: [pid: 71939|app: 0|req: 454/908] 10.222.0.53 () {56 vars in 1120 bytes} [Wed Nov 24 16:33:19 2021] GET /identity/v3/domains/Default => generated 87 bytes in 78 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 24 16:33:19.941154 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b64df53b-1001-44b6-867c-68b5fe4d3b5b None None] Authenticating user token {{(pid=71938) process_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 24 16:33:19.950344 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b64df53b-1001-44b6-867c-68b5fe4d3b5b None None] Validating token access rules against request {{(pid=71938) validate_allowed_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 24 16:33:19.955537 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b936cef-912b-4a45-b947-596062132f9e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f2ba2e8375b4e8c8792ee1e22b60427', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '00a5583c7b7443e98e7a1d31a0b638dc', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=71938) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 24 16:33:19.956198 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b936cef-912b-4a45-b947-596062132f9e admin admin] REQUEST_METHOD: `GET` {{(pid=71938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 24 16:33:19.956540 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b936cef-912b-4a45-b947-596062132f9e admin admin] SCRIPT_NAME: `/identity` {{(pid=71938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 24 16:33:19.956874 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b936cef-912b-4a45-b947-596062132f9e admin admin] PATH_INFO: `/v3/domains` {{(pid=71938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 24 16:33:19.957661 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b936cef-912b-4a45-b947-596062132f9e admin admin] RBAC: Adding query filter params (name=Default) {{(pid=71938) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:161}} Nov 24 16:33:19.958014 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b936cef-912b-4a45-b947-596062132f9e admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=71938) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:442}} Nov 24 16:33:19.985769 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b936cef-912b-4a45-b947-596062132f9e admin admin] RBAC: Authorization granted {{(pid=71938) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 24 16:33:19.999487 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: [pid: 71938|app: 0|req: 455/909] 10.222.0.53 () {56 vars in 1121 bytes} [Wed Nov 24 16:33:19 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 59 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 24 16:33:20.005840 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-732a716f-d078-4963-a913-758f521d671f admin admin] Authenticating user token {{(pid=71939) process_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 24 16:33:20.016237 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-732a716f-d078-4963-a913-758f521d671f admin admin] Validating token access rules against request {{(pid=71939) validate_allowed_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 24 16:33:20.020485 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83f62b6a-badf-4aaa-aac0-a672b7a767ba admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f2ba2e8375b4e8c8792ee1e22b60427', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '00a5583c7b7443e98e7a1d31a0b638dc', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=71939) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 24 16:33:20.021153 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83f62b6a-badf-4aaa-aac0-a672b7a767ba admin admin] REQUEST_METHOD: `POST` {{(pid=71939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 24 16:33:20.021495 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83f62b6a-badf-4aaa-aac0-a672b7a767ba admin admin] SCRIPT_NAME: `/identity` {{(pid=71939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 24 16:33:20.021836 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83f62b6a-badf-4aaa-aac0-a672b7a767ba admin admin] PATH_INFO: `/v3/users` {{(pid=71939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 24 16:33:20.022605 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83f62b6a-badf-4aaa-aac0-a672b7a767ba admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=71939) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:442}} Nov 24 16:33:20.050817 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83f62b6a-badf-4aaa-aac0-a672b7a767ba admin admin] RBAC: Authorization granted {{(pid=71939) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 24 16:33:20.072029 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: [pid: 71939|app: 0|req: 455/910] 10.222.0.53 () {60 vars in 1143 bytes} [Wed Nov 24 16:33:20 2021] POST /identity/v3/users => generated 249 bytes in 67 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 24 16:33:22.094817 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99d74422-bcc0-450f-8ef9-23cbf4ea3855 None None] REQUEST_METHOD: `GET` {{(pid=71938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 24 16:33:22.095362 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99d74422-bcc0-450f-8ef9-23cbf4ea3855 None None] SCRIPT_NAME: `/identity` {{(pid=71938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 24 16:33:22.095469 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99d74422-bcc0-450f-8ef9-23cbf4ea3855 None None] PATH_INFO: `/` {{(pid=71938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 24 16:33:22.097268 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: [pid: 71938|app: 0|req: 456/911] 10.222.0.53 () {54 vars in 915 bytes} [Wed Nov 24 16:33:22 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 24 16:33:22.102754 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e02e56ea-345c-4bc8-a9c9-c8549b1189cd None None] REQUEST_METHOD: `POST` {{(pid=71939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 24 16:33:22.103110 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e02e56ea-345c-4bc8-a9c9-c8549b1189cd None None] SCRIPT_NAME: `/identity` {{(pid=71939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 24 16:33:22.103447 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e02e56ea-345c-4bc8-a9c9-c8549b1189cd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=71939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 24 16:33:22.126952 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.auth.core [None req-e02e56ea-345c-4bc8-a9c9-c8549b1189cd None None] MFA Rules not processed for user `0f2ba2e8375b4e8c8792ee1e22b60427`. Rule list: `[]` (Enabled: `True`). {{(pid=71939) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:442}} Nov 24 16:33:22.128168 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.fernet_utils [None req-e02e56ea-345c-4bc8-a9c9-c8549b1189cd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=71939) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:289}} Nov 24 16:33:22.135350 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: [pid: 71939|app: 0|req: 456/912] 10.222.0.53 () {58 vars in 1013 bytes} [Wed Nov 24 16:33:22 2021] POST /identity/v3/auth/tokens => generated 2725 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 24 16:33:22.158192 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7f06079-1e22-494a-aeb3-d42bfa6bc16e None None] REQUEST_METHOD: `POST` {{(pid=71938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 24 16:33:22.158538 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7f06079-1e22-494a-aeb3-d42bfa6bc16e None None] SCRIPT_NAME: `/identity` {{(pid=71938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 24 16:33:22.158871 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7f06079-1e22-494a-aeb3-d42bfa6bc16e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=71938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 24 16:33:22.182103 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.auth.core [None req-c7f06079-1e22-494a-aeb3-d42bfa6bc16e None None] MFA Rules not processed for user `0f2ba2e8375b4e8c8792ee1e22b60427`. Rule list: `[]` (Enabled: `True`). {{(pid=71938) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:442}} Nov 24 16:33:22.183302 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.fernet_utils [None req-c7f06079-1e22-494a-aeb3-d42bfa6bc16e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=71938) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:289}} Nov 24 16:33:22.190390 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: [pid: 71938|app: 0|req: 457/913] 10.222.0.53 () {58 vars in 1013 bytes} [Wed Nov 24 16:33:22 2021] POST /identity/v3/auth/tokens => generated 2725 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 24 16:33:22.196760 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e02e56ea-345c-4bc8-a9c9-c8549b1189cd None None] Authenticating user token {{(pid=71939) process_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 24 16:33:22.206715 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e02e56ea-345c-4bc8-a9c9-c8549b1189cd None None] Validating token access rules against request {{(pid=71939) validate_allowed_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 24 16:33:22.211095 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-685664b1-161e-43a7-a503-30904923fbe7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f2ba2e8375b4e8c8792ee1e22b60427', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '00a5583c7b7443e98e7a1d31a0b638dc', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=71939) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 24 16:33:22.211899 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-685664b1-161e-43a7-a503-30904923fbe7 admin admin] REQUEST_METHOD: `GET` {{(pid=71939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 24 16:33:22.212235 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-685664b1-161e-43a7-a503-30904923fbe7 admin admin] SCRIPT_NAME: `/identity` {{(pid=71939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 24 16:33:22.212559 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-685664b1-161e-43a7-a503-30904923fbe7 admin admin] PATH_INFO: `/v3/roles/service` {{(pid=71939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 24 16:33:22.224804 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-685664b1-161e-43a7-a503-30904923fbe7 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=71939) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:401}} Nov 24 16:33:22.232288 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: WARNING keystone.server.flask.application [None req-685664b1-161e-43a7-a503-30904923fbe7 admin admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Nov 24 16:33:22.234127 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: [pid: 71939|app: 0|req: 457/914] 10.222.0.53 () {56 vars in 1114 bytes} [Wed Nov 24 16:33:22 2021] GET /identity/v3/roles/service => generated 85 bytes in 38 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 24 16:33:22.240788 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7f06079-1e22-494a-aeb3-d42bfa6bc16e None None] Authenticating user token {{(pid=71938) process_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 24 16:33:22.249946 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7f06079-1e22-494a-aeb3-d42bfa6bc16e None None] Validating token access rules against request {{(pid=71938) validate_allowed_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 24 16:33:22.254360 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fb32cff-62ac-4e03-bb06-f9a7eb0ea464 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f2ba2e8375b4e8c8792ee1e22b60427', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '00a5583c7b7443e98e7a1d31a0b638dc', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=71938) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 24 16:33:22.255031 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fb32cff-62ac-4e03-bb06-f9a7eb0ea464 admin admin] REQUEST_METHOD: `GET` {{(pid=71938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 24 16:33:22.255374 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fb32cff-62ac-4e03-bb06-f9a7eb0ea464 admin admin] SCRIPT_NAME: `/identity` {{(pid=71938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 24 16:33:22.255710 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fb32cff-62ac-4e03-bb06-f9a7eb0ea464 admin admin] PATH_INFO: `/v3/roles` {{(pid=71938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 24 16:33:22.256521 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fb32cff-62ac-4e03-bb06-f9a7eb0ea464 admin admin] RBAC: Adding query filter params (name=service) {{(pid=71938) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:161}} Nov 24 16:33:22.256875 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fb32cff-62ac-4e03-bb06-f9a7eb0ea464 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=71938) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:442}} Nov 24 16:33:22.285346 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fb32cff-62ac-4e03-bb06-f9a7eb0ea464 admin admin] RBAC: Authorization granted {{(pid=71938) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 24 16:33:22.294478 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: [pid: 71938|app: 0|req: 458/915] 10.222.0.53 () {56 vars in 1115 bytes} [Wed Nov 24 16:33:22 2021] GET /identity/v3/roles?name=service => generated 326 bytes in 54 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 24 16:33:22.300843 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-685664b1-161e-43a7-a503-30904923fbe7 admin admin] Authenticating user token {{(pid=71939) process_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 24 16:33:22.311105 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-685664b1-161e-43a7-a503-30904923fbe7 admin admin] Validating token access rules against request {{(pid=71939) validate_allowed_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 24 16:33:22.315380 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2093b1b-812e-4cd9-9dc0-18a6fee7a170 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f2ba2e8375b4e8c8792ee1e22b60427', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '00a5583c7b7443e98e7a1d31a0b638dc', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=71939) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 24 16:33:22.316173 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2093b1b-812e-4cd9-9dc0-18a6fee7a170 admin admin] REQUEST_METHOD: `GET` {{(pid=71939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 24 16:33:22.316507 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2093b1b-812e-4cd9-9dc0-18a6fee7a170 admin admin] SCRIPT_NAME: `/identity` {{(pid=71939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 24 16:33:22.316835 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2093b1b-812e-4cd9-9dc0-18a6fee7a170 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=71939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 24 16:33:22.329339 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2093b1b-812e-4cd9-9dc0-18a6fee7a170 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=71939) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:442}} Nov 24 16:33:22.358185 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2093b1b-812e-4cd9-9dc0-18a6fee7a170 admin admin] RBAC: Authorization granted {{(pid=71939) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 24 16:33:22.379886 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: WARNING keystone.server.flask.application [None req-b2093b1b-812e-4cd9-9dc0-18a6fee7a170 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Nov 24 16:33:22.381071 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: [pid: 71939|app: 0|req: 458/916] 10.222.0.53 () {56 vars in 1120 bytes} [Wed Nov 24 16:33:22 2021] GET /identity/v3/domains/Default => generated 87 bytes in 81 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 24 16:33:22.387277 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fb32cff-62ac-4e03-bb06-f9a7eb0ea464 admin admin] Authenticating user token {{(pid=71938) process_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 24 16:33:22.397945 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fb32cff-62ac-4e03-bb06-f9a7eb0ea464 admin admin] Validating token access rules against request {{(pid=71938) validate_allowed_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 24 16:33:22.402301 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e5e3889-7fef-4687-9adc-10d64ff36646 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f2ba2e8375b4e8c8792ee1e22b60427', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '00a5583c7b7443e98e7a1d31a0b638dc', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=71938) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 24 16:33:22.402970 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e5e3889-7fef-4687-9adc-10d64ff36646 admin admin] REQUEST_METHOD: `GET` {{(pid=71938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 24 16:33:22.403308 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e5e3889-7fef-4687-9adc-10d64ff36646 admin admin] SCRIPT_NAME: `/identity` {{(pid=71938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 24 16:33:22.403642 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e5e3889-7fef-4687-9adc-10d64ff36646 admin admin] PATH_INFO: `/v3/domains` {{(pid=71938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 24 16:33:22.404442 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e5e3889-7fef-4687-9adc-10d64ff36646 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=71938) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:161}} Nov 24 16:33:22.405407 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e5e3889-7fef-4687-9adc-10d64ff36646 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=71938) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:442}} Nov 24 16:33:22.433505 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e5e3889-7fef-4687-9adc-10d64ff36646 admin admin] RBAC: Authorization granted {{(pid=71938) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 24 16:33:22.446938 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: [pid: 71938|app: 0|req: 459/917] 10.222.0.53 () {56 vars in 1121 bytes} [Wed Nov 24 16:33:22 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 60 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 24 16:33:22.453460 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2093b1b-812e-4cd9-9dc0-18a6fee7a170 admin admin] Authenticating user token {{(pid=71939) process_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 24 16:33:22.463307 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2093b1b-812e-4cd9-9dc0-18a6fee7a170 admin admin] Validating token access rules against request {{(pid=71939) validate_allowed_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 24 16:33:22.468379 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-240949e7-9b51-40a4-bf22-0310af54f7b9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f2ba2e8375b4e8c8792ee1e22b60427', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '00a5583c7b7443e98e7a1d31a0b638dc', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=71939) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 24 16:33:22.469190 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-240949e7-9b51-40a4-bf22-0310af54f7b9 admin admin] REQUEST_METHOD: `GET` {{(pid=71939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 24 16:33:22.469532 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-240949e7-9b51-40a4-bf22-0310af54f7b9 admin admin] SCRIPT_NAME: `/identity` {{(pid=71939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 24 16:33:22.469865 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-240949e7-9b51-40a4-bf22-0310af54f7b9 admin admin] PATH_INFO: `/v3/users/neutron` {{(pid=71939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 24 16:33:22.484738 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-240949e7-9b51-40a4-bf22-0310af54f7b9 admin admin] RBAC: Authorizing `identity:get_user(user_id=neutron)` {{(pid=71939) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:442}} Nov 24 16:33:22.515457 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-240949e7-9b51-40a4-bf22-0310af54f7b9 admin admin] RBAC: Authorization granted {{(pid=71939) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 24 16:33:22.535821 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: WARNING keystone.server.flask.application [None req-240949e7-9b51-40a4-bf22-0310af54f7b9 admin admin] Could not find user: neutron.: keystone.exception.UserNotFound: Could not find user: neutron. Nov 24 16:33:22.537015 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: [pid: 71939|app: 0|req: 459/918] 10.222.0.53 () {56 vars in 1114 bytes} [Wed Nov 24 16:33:22 2021] GET /identity/v3/users/neutron => generated 85 bytes in 84 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 24 16:33:22.543203 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e5e3889-7fef-4687-9adc-10d64ff36646 admin admin] Authenticating user token {{(pid=71938) process_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 24 16:33:22.553082 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e5e3889-7fef-4687-9adc-10d64ff36646 admin admin] Validating token access rules against request {{(pid=71938) validate_allowed_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 24 16:33:22.557612 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ea42c6c-7730-4e1d-a150-35fd96688d35 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f2ba2e8375b4e8c8792ee1e22b60427', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '00a5583c7b7443e98e7a1d31a0b638dc', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=71938) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 24 16:33:22.558331 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ea42c6c-7730-4e1d-a150-35fd96688d35 admin admin] REQUEST_METHOD: `GET` {{(pid=71938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 24 16:33:22.558677 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ea42c6c-7730-4e1d-a150-35fd96688d35 admin admin] SCRIPT_NAME: `/identity` {{(pid=71938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 24 16:33:22.559014 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ea42c6c-7730-4e1d-a150-35fd96688d35 admin admin] PATH_INFO: `/v3/users` {{(pid=71938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 24 16:33:22.559923 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ea42c6c-7730-4e1d-a150-35fd96688d35 admin admin] RBAC: Adding query filter params (domain_id=default, name=neutron) {{(pid=71938) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:161}} Nov 24 16:33:22.560287 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ea42c6c-7730-4e1d-a150-35fd96688d35 admin admin] RBAC: Authorizing `identity:list_users()` {{(pid=71938) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:442}} Nov 24 16:33:22.589418 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ea42c6c-7730-4e1d-a150-35fd96688d35 admin admin] RBAC: Authorization granted {{(pid=71938) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 24 16:33:22.620882 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: [pid: 71938|app: 0|req: 460/919] 10.222.0.53 () {56 vars in 1151 bytes} [Wed Nov 24 16:33:22 2021] GET /identity/v3/users?domain_id=default&name=neutron => generated 374 bytes in 78 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 24 16:33:22.626999 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-240949e7-9b51-40a4-bf22-0310af54f7b9 admin admin] Authenticating user token {{(pid=71939) process_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 24 16:33:22.636939 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-240949e7-9b51-40a4-bf22-0310af54f7b9 admin admin] Validating token access rules against request {{(pid=71939) validate_allowed_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 24 16:33:22.641745 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b4765cc-4a83-4e99-8f0a-5e437e9ef2ad admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f2ba2e8375b4e8c8792ee1e22b60427', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '00a5583c7b7443e98e7a1d31a0b638dc', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=71939) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 24 16:33:22.642424 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b4765cc-4a83-4e99-8f0a-5e437e9ef2ad admin admin] REQUEST_METHOD: `GET` {{(pid=71939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 24 16:33:22.642766 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b4765cc-4a83-4e99-8f0a-5e437e9ef2ad admin admin] SCRIPT_NAME: `/identity` {{(pid=71939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 24 16:33:22.643100 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b4765cc-4a83-4e99-8f0a-5e437e9ef2ad admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=71939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 24 16:33:22.651203 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b4765cc-4a83-4e99-8f0a-5e437e9ef2ad admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=71939) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:442}} Nov 24 16:33:22.680193 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b4765cc-4a83-4e99-8f0a-5e437e9ef2ad admin admin] RBAC: Authorization granted {{(pid=71939) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 24 16:33:22.689653 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: [pid: 71939|app: 0|req: 460/920] 10.222.0.53 () {58 vars in 1315 bytes} [Wed Nov 24 16:33:22 2021] GET /identity/v3/auth/tokens => generated 2725 bytes in 63 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 24 16:33:22.695604 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ea42c6c-7730-4e1d-a150-35fd96688d35 admin admin] Authenticating user token {{(pid=71938) process_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 24 16:33:22.706010 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ea42c6c-7730-4e1d-a150-35fd96688d35 admin admin] Validating token access rules against request {{(pid=71938) validate_allowed_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 24 16:33:22.710364 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc191b51-5a7e-4ec9-993f-3ceec5a7cfb6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f2ba2e8375b4e8c8792ee1e22b60427', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '00a5583c7b7443e98e7a1d31a0b638dc', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=71938) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 24 16:33:22.711174 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc191b51-5a7e-4ec9-993f-3ceec5a7cfb6 admin admin] REQUEST_METHOD: `GET` {{(pid=71938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 24 16:33:22.711524 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc191b51-5a7e-4ec9-993f-3ceec5a7cfb6 admin admin] SCRIPT_NAME: `/identity` {{(pid=71938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 24 16:33:22.711857 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc191b51-5a7e-4ec9-993f-3ceec5a7cfb6 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=71938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 24 16:33:22.723824 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc191b51-5a7e-4ec9-993f-3ceec5a7cfb6 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=71938) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:442}} Nov 24 16:33:22.752525 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc191b51-5a7e-4ec9-993f-3ceec5a7cfb6 admin admin] RBAC: Authorization granted {{(pid=71938) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 24 16:33:22.771343 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: WARNING keystone.server.flask.application [None req-cc191b51-5a7e-4ec9-993f-3ceec5a7cfb6 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Nov 24 16:33:22.772517 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: [pid: 71938|app: 0|req: 461/921] 10.222.0.53 () {56 vars in 1120 bytes} [Wed Nov 24 16:33:22 2021] GET /identity/v3/domains/Default => generated 87 bytes in 77 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 24 16:33:22.778649 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b4765cc-4a83-4e99-8f0a-5e437e9ef2ad admin admin] Authenticating user token {{(pid=71939) process_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 24 16:33:22.787816 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b4765cc-4a83-4e99-8f0a-5e437e9ef2ad admin admin] Validating token access rules against request {{(pid=71939) validate_allowed_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 24 16:33:22.792210 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c03608b-cbef-4999-a3ea-71559e8b4b96 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f2ba2e8375b4e8c8792ee1e22b60427', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '00a5583c7b7443e98e7a1d31a0b638dc', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=71939) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 24 16:33:22.792873 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c03608b-cbef-4999-a3ea-71559e8b4b96 admin admin] REQUEST_METHOD: `GET` {{(pid=71939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 24 16:33:22.793213 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c03608b-cbef-4999-a3ea-71559e8b4b96 admin admin] SCRIPT_NAME: `/identity` {{(pid=71939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 24 16:33:22.793553 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c03608b-cbef-4999-a3ea-71559e8b4b96 admin admin] PATH_INFO: `/v3/domains` {{(pid=71939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 24 16:33:22.794366 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c03608b-cbef-4999-a3ea-71559e8b4b96 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=71939) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:161}} Nov 24 16:33:22.794716 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c03608b-cbef-4999-a3ea-71559e8b4b96 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=71939) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:442}} Nov 24 16:33:22.823618 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c03608b-cbef-4999-a3ea-71559e8b4b96 admin admin] RBAC: Authorization granted {{(pid=71939) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 24 16:33:22.837668 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: [pid: 71939|app: 0|req: 461/922] 10.222.0.53 () {56 vars in 1121 bytes} [Wed Nov 24 16:33:22 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 60 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 24 16:33:22.843549 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc191b51-5a7e-4ec9-993f-3ceec5a7cfb6 admin admin] Authenticating user token {{(pid=71938) process_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 24 16:33:22.853377 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc191b51-5a7e-4ec9-993f-3ceec5a7cfb6 admin admin] Validating token access rules against request {{(pid=71938) validate_allowed_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 24 16:33:22.857651 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c95edbb-20d0-4c70-b8f4-831411da44f3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f2ba2e8375b4e8c8792ee1e22b60427', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '00a5583c7b7443e98e7a1d31a0b638dc', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=71938) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 24 16:33:22.858503 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c95edbb-20d0-4c70-b8f4-831411da44f3 admin admin] REQUEST_METHOD: `GET` {{(pid=71938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 24 16:33:22.858846 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c95edbb-20d0-4c70-b8f4-831411da44f3 admin admin] SCRIPT_NAME: `/identity` {{(pid=71938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 24 16:33:22.859179 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c95edbb-20d0-4c70-b8f4-831411da44f3 admin admin] PATH_INFO: `/v3/projects/service` {{(pid=71938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 24 16:33:22.868355 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c95edbb-20d0-4c70-b8f4-831411da44f3 admin admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=71938) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:442}} Nov 24 16:33:22.897850 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c95edbb-20d0-4c70-b8f4-831411da44f3 admin admin] RBAC: Authorization granted {{(pid=71938) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 24 16:33:22.912886 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: WARNING keystone.server.flask.application [None req-8c95edbb-20d0-4c70-b8f4-831411da44f3 admin admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Nov 24 16:33:22.914070 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: [pid: 71938|app: 0|req: 462/923] 10.222.0.53 () {56 vars in 1123 bytes} [Wed Nov 24 16:33:22 2021] GET /identity/v3/projects/service => generated 88 bytes in 71 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 24 16:33:22.920037 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c03608b-cbef-4999-a3ea-71559e8b4b96 admin admin] Authenticating user token {{(pid=71939) process_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 24 16:33:22.929678 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c03608b-cbef-4999-a3ea-71559e8b4b96 admin admin] Validating token access rules against request {{(pid=71939) validate_allowed_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 24 16:33:22.933917 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e5a3dc8-8daf-4337-87bf-7e19536896b7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f2ba2e8375b4e8c8792ee1e22b60427', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '00a5583c7b7443e98e7a1d31a0b638dc', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=71939) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 24 16:33:22.934599 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e5a3dc8-8daf-4337-87bf-7e19536896b7 admin admin] REQUEST_METHOD: `GET` {{(pid=71939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 24 16:33:22.934930 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e5a3dc8-8daf-4337-87bf-7e19536896b7 admin admin] SCRIPT_NAME: `/identity` {{(pid=71939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 24 16:33:22.935255 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e5a3dc8-8daf-4337-87bf-7e19536896b7 admin admin] PATH_INFO: `/v3/projects` {{(pid=71939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 24 16:33:22.936972 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e5a3dc8-8daf-4337-87bf-7e19536896b7 admin admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=71939) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:161}} Nov 24 16:33:22.937506 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e5a3dc8-8daf-4337-87bf-7e19536896b7 admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=71939) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:442}} Nov 24 16:33:22.966929 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e5a3dc8-8daf-4337-87bf-7e19536896b7 admin admin] RBAC: Authorization granted {{(pid=71939) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 24 16:33:22.980775 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: [pid: 71939|app: 0|req: 462/924] 10.222.0.53 () {56 vars in 1160 bytes} [Wed Nov 24 16:33:22 2021] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 61 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 24 16:33:22.987104 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c95edbb-20d0-4c70-b8f4-831411da44f3 admin admin] Authenticating user token {{(pid=71938) process_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 24 16:33:22.996960 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c95edbb-20d0-4c70-b8f4-831411da44f3 admin admin] Validating token access rules against request {{(pid=71938) validate_allowed_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 24 16:33:23.001799 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9ee7d19-e5fa-477d-855b-3f3d3b448f3a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f2ba2e8375b4e8c8792ee1e22b60427', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '00a5583c7b7443e98e7a1d31a0b638dc', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=71938) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 24 16:33:23.002500 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9ee7d19-e5fa-477d-855b-3f3d3b448f3a admin admin] REQUEST_METHOD: `GET` {{(pid=71938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 24 16:33:23.002842 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9ee7d19-e5fa-477d-855b-3f3d3b448f3a admin admin] SCRIPT_NAME: `/identity` {{(pid=71938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 24 16:33:23.003176 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9ee7d19-e5fa-477d-855b-3f3d3b448f3a admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=71938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 24 16:33:23.004066 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9ee7d19-e5fa-477d-855b-3f3d3b448f3a admin admin] RBAC: Adding query filter params (role.id=2d4a51004ce34308a7a33e68bf2cfc74, scope.project.id=3b3940d4ae1c4177ae29c02377bb4b0b, user.id=c90f21b9cdcb413282461fa83cb6b7a5) {{(pid=71938) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:161}} Nov 24 16:33:23.004431 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9ee7d19-e5fa-477d-855b-3f3d3b448f3a admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=71938) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:442}} Nov 24 16:33:23.033515 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9ee7d19-e5fa-477d-855b-3f3d3b448f3a admin admin] RBAC: Authorization granted {{(pid=71938) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 24 16:33:23.041760 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: [pid: 71938|app: 0|req: 463/925] 10.222.0.53 () {56 vars in 1386 bytes} [Wed Nov 24 16:33:22 2021] GET /identity/v3/role_assignments?user.id=c90f21b9cdcb413282461fa83cb6b7a5&scope.project.id=3b3940d4ae1c4177ae29c02377bb4b0b&role.id=2d4a51004ce34308a7a33e68bf2cfc74 => generated 259 bytes in 55 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 24 16:33:25.005754 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f7ad253-35a8-4d8c-87b2-9254ed8bd953 None None] REQUEST_METHOD: `GET` {{(pid=71939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 24 16:33:25.006303 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f7ad253-35a8-4d8c-87b2-9254ed8bd953 None None] SCRIPT_NAME: `/identity` {{(pid=71939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 24 16:33:25.006460 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f7ad253-35a8-4d8c-87b2-9254ed8bd953 None None] PATH_INFO: `/` {{(pid=71939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 24 16:33:25.008302 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: [pid: 71939|app: 0|req: 463/926] 10.222.0.53 () {54 vars in 915 bytes} [Wed Nov 24 16:33:25 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 24 16:33:25.013752 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77a17258-015c-45e9-a513-d7d0587ff256 None None] REQUEST_METHOD: `POST` {{(pid=71938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 24 16:33:25.014162 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77a17258-015c-45e9-a513-d7d0587ff256 None None] SCRIPT_NAME: `/identity` {{(pid=71938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 24 16:33:25.014505 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77a17258-015c-45e9-a513-d7d0587ff256 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=71938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 24 16:33:25.038567 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.auth.core [None req-77a17258-015c-45e9-a513-d7d0587ff256 None None] MFA Rules not processed for user `0f2ba2e8375b4e8c8792ee1e22b60427`. Rule list: `[]` (Enabled: `True`). {{(pid=71938) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:442}} Nov 24 16:33:25.039790 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.fernet_utils [None req-77a17258-015c-45e9-a513-d7d0587ff256 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=71938) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:289}} Nov 24 16:33:25.047541 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: [pid: 71938|app: 0|req: 464/927] 10.222.0.53 () {58 vars in 1013 bytes} [Wed Nov 24 16:33:25 2021] POST /identity/v3/auth/tokens => generated 2725 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 24 16:33:25.069158 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3274298d-811e-4d1a-99dd-668fa558d4b4 None None] REQUEST_METHOD: `POST` {{(pid=71939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 24 16:33:25.069502 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3274298d-811e-4d1a-99dd-668fa558d4b4 None None] SCRIPT_NAME: `/identity` {{(pid=71939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 24 16:33:25.069843 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3274298d-811e-4d1a-99dd-668fa558d4b4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=71939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 24 16:33:25.093223 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.auth.core [None req-3274298d-811e-4d1a-99dd-668fa558d4b4 None None] MFA Rules not processed for user `0f2ba2e8375b4e8c8792ee1e22b60427`. Rule list: `[]` (Enabled: `True`). {{(pid=71939) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:442}} Nov 24 16:33:25.094461 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.fernet_utils [None req-3274298d-811e-4d1a-99dd-668fa558d4b4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=71939) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:289}} Nov 24 16:33:25.103715 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: [pid: 71939|app: 0|req: 464/928] 10.222.0.53 () {58 vars in 1013 bytes} [Wed Nov 24 16:33:25 2021] POST /identity/v3/auth/tokens => generated 2725 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 24 16:33:25.110292 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77a17258-015c-45e9-a513-d7d0587ff256 None None] Authenticating user token {{(pid=71938) process_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 24 16:33:25.119828 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77a17258-015c-45e9-a513-d7d0587ff256 None None] Validating token access rules against request {{(pid=71938) validate_allowed_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 24 16:33:25.124101 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1496a4ca-d04f-4911-80a8-d258bb7b3642 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f2ba2e8375b4e8c8792ee1e22b60427', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '00a5583c7b7443e98e7a1d31a0b638dc', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=71938) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 24 16:33:25.124909 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1496a4ca-d04f-4911-80a8-d258bb7b3642 admin admin] REQUEST_METHOD: `GET` {{(pid=71938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 24 16:33:25.125249 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1496a4ca-d04f-4911-80a8-d258bb7b3642 admin admin] SCRIPT_NAME: `/identity` {{(pid=71938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 24 16:33:25.125582 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1496a4ca-d04f-4911-80a8-d258bb7b3642 admin admin] PATH_INFO: `/v3/roles/service` {{(pid=71938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 24 16:33:25.139891 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1496a4ca-d04f-4911-80a8-d258bb7b3642 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=71938) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:401}} Nov 24 16:33:25.150237 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: WARNING keystone.server.flask.application [None req-1496a4ca-d04f-4911-80a8-d258bb7b3642 admin admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Nov 24 16:33:25.151474 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: [pid: 71938|app: 0|req: 465/929] 10.222.0.53 () {56 vars in 1114 bytes} [Wed Nov 24 16:33:25 2021] GET /identity/v3/roles/service => generated 85 bytes in 42 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 24 16:33:25.158874 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3274298d-811e-4d1a-99dd-668fa558d4b4 None None] Authenticating user token {{(pid=71939) process_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 24 16:33:25.168095 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3274298d-811e-4d1a-99dd-668fa558d4b4 None None] Validating token access rules against request {{(pid=71939) validate_allowed_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 24 16:33:25.173302 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d03c423-d883-49a7-b1c5-257851f4021c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f2ba2e8375b4e8c8792ee1e22b60427', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '00a5583c7b7443e98e7a1d31a0b638dc', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=71939) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 24 16:33:25.173981 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d03c423-d883-49a7-b1c5-257851f4021c admin admin] REQUEST_METHOD: `GET` {{(pid=71939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 24 16:33:25.174359 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d03c423-d883-49a7-b1c5-257851f4021c admin admin] SCRIPT_NAME: `/identity` {{(pid=71939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 24 16:33:25.174697 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d03c423-d883-49a7-b1c5-257851f4021c admin admin] PATH_INFO: `/v3/roles` {{(pid=71939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 24 16:33:25.175510 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d03c423-d883-49a7-b1c5-257851f4021c admin admin] RBAC: Adding query filter params (name=service) {{(pid=71939) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:161}} Nov 24 16:33:25.175864 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d03c423-d883-49a7-b1c5-257851f4021c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=71939) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:442}} Nov 24 16:33:25.204115 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d03c423-d883-49a7-b1c5-257851f4021c admin admin] RBAC: Authorization granted {{(pid=71939) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 24 16:33:25.213577 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: [pid: 71939|app: 0|req: 465/930] 10.222.0.53 () {56 vars in 1115 bytes} [Wed Nov 24 16:33:25 2021] GET /identity/v3/roles?name=service => generated 326 bytes in 55 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 24 16:33:25.220181 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1496a4ca-d04f-4911-80a8-d258bb7b3642 admin admin] Authenticating user token {{(pid=71938) process_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 24 16:33:25.230542 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1496a4ca-d04f-4911-80a8-d258bb7b3642 admin admin] Validating token access rules against request {{(pid=71938) validate_allowed_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 24 16:33:25.235428 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-373eab0f-9607-4988-810d-5e7e2a0b7e07 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f2ba2e8375b4e8c8792ee1e22b60427', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '00a5583c7b7443e98e7a1d31a0b638dc', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=71938) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 24 16:33:25.236220 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-373eab0f-9607-4988-810d-5e7e2a0b7e07 admin admin] REQUEST_METHOD: `GET` {{(pid=71938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 24 16:33:25.236551 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-373eab0f-9607-4988-810d-5e7e2a0b7e07 admin admin] SCRIPT_NAME: `/identity` {{(pid=71938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 24 16:33:25.236877 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-373eab0f-9607-4988-810d-5e7e2a0b7e07 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=71938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 24 16:33:25.248435 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-373eab0f-9607-4988-810d-5e7e2a0b7e07 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=71938) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:442}} Nov 24 16:33:25.276654 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-373eab0f-9607-4988-810d-5e7e2a0b7e07 admin admin] RBAC: Authorization granted {{(pid=71938) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 24 16:33:25.298014 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: WARNING keystone.server.flask.application [None req-373eab0f-9607-4988-810d-5e7e2a0b7e07 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Nov 24 16:33:25.299181 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: [pid: 71938|app: 0|req: 466/931] 10.222.0.53 () {56 vars in 1120 bytes} [Wed Nov 24 16:33:25 2021] GET /identity/v3/domains/Default => generated 87 bytes in 80 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 24 16:33:25.305177 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d03c423-d883-49a7-b1c5-257851f4021c admin admin] Authenticating user token {{(pid=71939) process_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 24 16:33:25.314988 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d03c423-d883-49a7-b1c5-257851f4021c admin admin] Validating token access rules against request {{(pid=71939) validate_allowed_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 24 16:33:25.319278 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce51818a-610a-41a8-b911-cf230a870c4c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f2ba2e8375b4e8c8792ee1e22b60427', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '00a5583c7b7443e98e7a1d31a0b638dc', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=71939) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 24 16:33:25.319984 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce51818a-610a-41a8-b911-cf230a870c4c admin admin] REQUEST_METHOD: `GET` {{(pid=71939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 24 16:33:25.320350 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce51818a-610a-41a8-b911-cf230a870c4c admin admin] SCRIPT_NAME: `/identity` {{(pid=71939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 24 16:33:25.320688 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce51818a-610a-41a8-b911-cf230a870c4c admin admin] PATH_INFO: `/v3/domains` {{(pid=71939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 24 16:33:25.321469 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce51818a-610a-41a8-b911-cf230a870c4c admin admin] RBAC: Adding query filter params (name=Default) {{(pid=71939) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:161}} Nov 24 16:33:25.321821 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce51818a-610a-41a8-b911-cf230a870c4c admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=71939) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:442}} Nov 24 16:33:25.351302 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce51818a-610a-41a8-b911-cf230a870c4c admin admin] RBAC: Authorization granted {{(pid=71939) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 24 16:33:25.365012 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: [pid: 71939|app: 0|req: 466/932] 10.222.0.53 () {56 vars in 1121 bytes} [Wed Nov 24 16:33:25 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 60 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 24 16:33:25.370866 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-373eab0f-9607-4988-810d-5e7e2a0b7e07 admin admin] Authenticating user token {{(pid=71938) process_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 24 16:33:25.381302 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-373eab0f-9607-4988-810d-5e7e2a0b7e07 admin admin] Validating token access rules against request {{(pid=71938) validate_allowed_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 24 16:33:25.385596 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4aa8c7e-efcd-405e-8e93-2e1c1b600f5f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f2ba2e8375b4e8c8792ee1e22b60427', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '00a5583c7b7443e98e7a1d31a0b638dc', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=71938) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 24 16:33:25.386450 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4aa8c7e-efcd-405e-8e93-2e1c1b600f5f admin admin] REQUEST_METHOD: `GET` {{(pid=71938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 24 16:33:25.386802 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4aa8c7e-efcd-405e-8e93-2e1c1b600f5f admin admin] SCRIPT_NAME: `/identity` {{(pid=71938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 24 16:33:25.387135 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4aa8c7e-efcd-405e-8e93-2e1c1b600f5f admin admin] PATH_INFO: `/v3/users/neutron` {{(pid=71938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 24 16:33:25.400484 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4aa8c7e-efcd-405e-8e93-2e1c1b600f5f admin admin] RBAC: Authorizing `identity:get_user(user_id=neutron)` {{(pid=71938) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:442}} Nov 24 16:33:25.430091 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4aa8c7e-efcd-405e-8e93-2e1c1b600f5f admin admin] RBAC: Authorization granted {{(pid=71938) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 24 16:33:25.450410 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: WARNING keystone.server.flask.application [None req-b4aa8c7e-efcd-405e-8e93-2e1c1b600f5f admin admin] Could not find user: neutron.: keystone.exception.UserNotFound: Could not find user: neutron. Nov 24 16:33:25.451901 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: [pid: 71938|app: 0|req: 467/933] 10.222.0.53 () {56 vars in 1114 bytes} [Wed Nov 24 16:33:25 2021] GET /identity/v3/users/neutron => generated 85 bytes in 82 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 24 16:33:25.457988 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce51818a-610a-41a8-b911-cf230a870c4c admin admin] Authenticating user token {{(pid=71939) process_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 24 16:33:25.467935 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce51818a-610a-41a8-b911-cf230a870c4c admin admin] Validating token access rules against request {{(pid=71939) validate_allowed_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 24 16:33:25.472254 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fed468f-bfa8-4988-8405-c8e6451a257e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f2ba2e8375b4e8c8792ee1e22b60427', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '00a5583c7b7443e98e7a1d31a0b638dc', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=71939) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 24 16:33:25.472967 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fed468f-bfa8-4988-8405-c8e6451a257e admin admin] REQUEST_METHOD: `GET` {{(pid=71939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 24 16:33:25.473318 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fed468f-bfa8-4988-8405-c8e6451a257e admin admin] SCRIPT_NAME: `/identity` {{(pid=71939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 24 16:33:25.473654 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fed468f-bfa8-4988-8405-c8e6451a257e admin admin] PATH_INFO: `/v3/users` {{(pid=71939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 24 16:33:25.474591 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fed468f-bfa8-4988-8405-c8e6451a257e admin admin] RBAC: Adding query filter params (domain_id=default, name=neutron) {{(pid=71939) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:161}} Nov 24 16:33:25.474948 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fed468f-bfa8-4988-8405-c8e6451a257e admin admin] RBAC: Authorizing `identity:list_users()` {{(pid=71939) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:442}} Nov 24 16:33:25.504430 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fed468f-bfa8-4988-8405-c8e6451a257e admin admin] RBAC: Authorization granted {{(pid=71939) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 24 16:33:25.534925 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: [pid: 71939|app: 0|req: 467/934] 10.222.0.53 () {56 vars in 1151 bytes} [Wed Nov 24 16:33:25 2021] GET /identity/v3/users?domain_id=default&name=neutron => generated 374 bytes in 77 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 24 16:33:25.540788 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4aa8c7e-efcd-405e-8e93-2e1c1b600f5f admin admin] Authenticating user token {{(pid=71938) process_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 24 16:33:25.550995 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4aa8c7e-efcd-405e-8e93-2e1c1b600f5f admin admin] Validating token access rules against request {{(pid=71938) validate_allowed_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 24 16:33:25.555229 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ad61765-c90e-49e0-84e0-c061562091b1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f2ba2e8375b4e8c8792ee1e22b60427', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '00a5583c7b7443e98e7a1d31a0b638dc', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=71938) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 24 16:33:25.556026 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ad61765-c90e-49e0-84e0-c061562091b1 admin admin] REQUEST_METHOD: `GET` {{(pid=71938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 24 16:33:25.556359 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ad61765-c90e-49e0-84e0-c061562091b1 admin admin] SCRIPT_NAME: `/identity` {{(pid=71938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 24 16:33:25.556687 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ad61765-c90e-49e0-84e0-c061562091b1 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=71938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 24 16:33:25.569730 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ad61765-c90e-49e0-84e0-c061562091b1 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=71938) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:442}} Nov 24 16:33:25.597845 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ad61765-c90e-49e0-84e0-c061562091b1 admin admin] RBAC: Authorization granted {{(pid=71938) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 24 16:33:25.616267 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: WARNING keystone.server.flask.application [None req-7ad61765-c90e-49e0-84e0-c061562091b1 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Nov 24 16:33:25.617413 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: [pid: 71938|app: 0|req: 468/935] 10.222.0.53 () {56 vars in 1120 bytes} [Wed Nov 24 16:33:25 2021] GET /identity/v3/domains/Default => generated 87 bytes in 77 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 24 16:33:25.623887 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fed468f-bfa8-4988-8405-c8e6451a257e admin admin] Authenticating user token {{(pid=71939) process_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 24 16:33:25.633677 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fed468f-bfa8-4988-8405-c8e6451a257e admin admin] Validating token access rules against request {{(pid=71939) validate_allowed_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 24 16:33:25.638004 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43ea253a-b9f7-4e01-a856-b955d4f1fb67 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f2ba2e8375b4e8c8792ee1e22b60427', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '00a5583c7b7443e98e7a1d31a0b638dc', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=71939) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 24 16:33:25.638706 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43ea253a-b9f7-4e01-a856-b955d4f1fb67 admin admin] REQUEST_METHOD: `GET` {{(pid=71939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 24 16:33:25.639049 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43ea253a-b9f7-4e01-a856-b955d4f1fb67 admin admin] SCRIPT_NAME: `/identity` {{(pid=71939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 24 16:33:25.639383 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43ea253a-b9f7-4e01-a856-b955d4f1fb67 admin admin] PATH_INFO: `/v3/domains` {{(pid=71939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 24 16:33:25.640162 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43ea253a-b9f7-4e01-a856-b955d4f1fb67 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=71939) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:161}} Nov 24 16:33:25.640512 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43ea253a-b9f7-4e01-a856-b955d4f1fb67 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=71939) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:442}} Nov 24 16:33:25.668291 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43ea253a-b9f7-4e01-a856-b955d4f1fb67 admin admin] RBAC: Authorization granted {{(pid=71939) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 24 16:33:25.681291 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: [pid: 71939|app: 0|req: 468/936] 10.222.0.53 () {56 vars in 1121 bytes} [Wed Nov 24 16:33:25 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 58 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 24 16:33:25.687688 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ad61765-c90e-49e0-84e0-c061562091b1 admin admin] Authenticating user token {{(pid=71938) process_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 24 16:33:25.697516 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ad61765-c90e-49e0-84e0-c061562091b1 admin admin] Validating token access rules against request {{(pid=71938) validate_allowed_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 24 16:33:25.701998 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56dedfd4-4e4c-401c-a740-e77c8180b293 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f2ba2e8375b4e8c8792ee1e22b60427', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '00a5583c7b7443e98e7a1d31a0b638dc', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=71938) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 24 16:33:25.702833 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56dedfd4-4e4c-401c-a740-e77c8180b293 admin admin] REQUEST_METHOD: `GET` {{(pid=71938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 24 16:33:25.703171 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56dedfd4-4e4c-401c-a740-e77c8180b293 admin admin] SCRIPT_NAME: `/identity` {{(pid=71938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 24 16:33:25.703499 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56dedfd4-4e4c-401c-a740-e77c8180b293 admin admin] PATH_INFO: `/v3/projects/service` {{(pid=71938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 24 16:33:25.712673 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56dedfd4-4e4c-401c-a740-e77c8180b293 admin admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=71938) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:442}} Nov 24 16:33:25.741764 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56dedfd4-4e4c-401c-a740-e77c8180b293 admin admin] RBAC: Authorization granted {{(pid=71938) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 24 16:33:25.756663 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: WARNING keystone.server.flask.application [None req-56dedfd4-4e4c-401c-a740-e77c8180b293 admin admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Nov 24 16:33:25.757810 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: [pid: 71938|app: 0|req: 469/937] 10.222.0.53 () {56 vars in 1123 bytes} [Wed Nov 24 16:33:25 2021] GET /identity/v3/projects/service => generated 88 bytes in 71 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 24 16:33:25.763811 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43ea253a-b9f7-4e01-a856-b955d4f1fb67 admin admin] Authenticating user token {{(pid=71939) process_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 24 16:33:25.773513 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43ea253a-b9f7-4e01-a856-b955d4f1fb67 admin admin] Validating token access rules against request {{(pid=71939) validate_allowed_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 24 16:33:25.777833 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96d9b90b-9981-4a6d-816f-4f2a51b9f2bd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f2ba2e8375b4e8c8792ee1e22b60427', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '00a5583c7b7443e98e7a1d31a0b638dc', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=71939) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 24 16:33:25.778518 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96d9b90b-9981-4a6d-816f-4f2a51b9f2bd admin admin] REQUEST_METHOD: `GET` {{(pid=71939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 24 16:33:25.778862 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96d9b90b-9981-4a6d-816f-4f2a51b9f2bd admin admin] SCRIPT_NAME: `/identity` {{(pid=71939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 24 16:33:25.779196 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96d9b90b-9981-4a6d-816f-4f2a51b9f2bd admin admin] PATH_INFO: `/v3/projects` {{(pid=71939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 24 16:33:25.780551 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96d9b90b-9981-4a6d-816f-4f2a51b9f2bd admin admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=71939) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:161}} Nov 24 16:33:25.780911 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96d9b90b-9981-4a6d-816f-4f2a51b9f2bd admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=71939) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:442}} Nov 24 16:33:25.809848 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96d9b90b-9981-4a6d-816f-4f2a51b9f2bd admin admin] RBAC: Authorization granted {{(pid=71939) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 24 16:33:25.823461 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: [pid: 71939|app: 0|req: 469/938] 10.222.0.53 () {56 vars in 1160 bytes} [Wed Nov 24 16:33:25 2021] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 60 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 24 16:33:25.829561 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56dedfd4-4e4c-401c-a740-e77c8180b293 admin admin] Authenticating user token {{(pid=71938) process_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 24 16:33:25.839219 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56dedfd4-4e4c-401c-a740-e77c8180b293 admin admin] Validating token access rules against request {{(pid=71938) validate_allowed_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 24 16:33:25.844067 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4519080c-aac6-488f-bc41-cd3ed0b43b60 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f2ba2e8375b4e8c8792ee1e22b60427', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '00a5583c7b7443e98e7a1d31a0b638dc', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=71938) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 24 16:33:25.844957 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4519080c-aac6-488f-bc41-cd3ed0b43b60 admin admin] REQUEST_METHOD: `PUT` {{(pid=71938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 24 16:33:25.845289 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4519080c-aac6-488f-bc41-cd3ed0b43b60 admin admin] SCRIPT_NAME: `/identity` {{(pid=71938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 24 16:33:25.845615 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4519080c-aac6-488f-bc41-cd3ed0b43b60 admin admin] PATH_INFO: `/v3/projects/3b3940d4ae1c4177ae29c02377bb4b0b/users/c90f21b9cdcb413282461fa83cb6b7a5/roles/2d4a51004ce34308a7a33e68bf2cfc74` {{(pid=71938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 24 16:33:25.867156 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4519080c-aac6-488f-bc41-cd3ed0b43b60 admin admin] RBAC: Authorizing `identity:create_grant(project_id=3b3940d4ae1c4177ae29c02377bb4b0b, user_id=c90f21b9cdcb413282461fa83cb6b7a5, role_id=2d4a51004ce34308a7a33e68bf2cfc74)` {{(pid=71938) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:442}} Nov 24 16:33:25.896167 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4519080c-aac6-488f-bc41-cd3ed0b43b60 admin admin] RBAC: Authorization granted {{(pid=71938) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 24 16:33:25.908443 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: [pid: 71938|app: 0|req: 470/939] 10.222.0.53 () {58 vars in 1451 bytes} [Wed Nov 24 16:33:25 2021] PUT /identity/v3/projects/3b3940d4ae1c4177ae29c02377bb4b0b/users/c90f21b9cdcb413282461fa83cb6b7a5/roles/2d4a51004ce34308a7a33e68bf2cfc74 => generated 0 bytes in 79 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 24 16:33:27.864564 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71a22649-cd80-4191-89a9-fd11553438ee None None] REQUEST_METHOD: `GET` {{(pid=71939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 24 16:33:27.865107 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71a22649-cd80-4191-89a9-fd11553438ee None None] SCRIPT_NAME: `/identity` {{(pid=71939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 24 16:33:27.865210 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71a22649-cd80-4191-89a9-fd11553438ee None None] PATH_INFO: `/` {{(pid=71939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 24 16:33:27.867629 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: [pid: 71939|app: 0|req: 470/940] 10.222.0.53 () {54 vars in 915 bytes} [Wed Nov 24 16:33:27 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 24 16:33:27.874829 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-783b7658-34aa-40b0-a717-1a5eb24ac548 None None] REQUEST_METHOD: `POST` {{(pid=71938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 24 16:33:27.875183 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-783b7658-34aa-40b0-a717-1a5eb24ac548 None None] SCRIPT_NAME: `/identity` {{(pid=71938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 24 16:33:27.875520 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-783b7658-34aa-40b0-a717-1a5eb24ac548 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=71938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 24 16:33:27.899339 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.auth.core [None req-783b7658-34aa-40b0-a717-1a5eb24ac548 None None] MFA Rules not processed for user `0f2ba2e8375b4e8c8792ee1e22b60427`. Rule list: `[]` (Enabled: `True`). {{(pid=71938) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:442}} Nov 24 16:33:27.900555 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.fernet_utils [None req-783b7658-34aa-40b0-a717-1a5eb24ac548 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=71938) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:289}} Nov 24 16:33:27.966829 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: [pid: 71938|app: 0|req: 471/941] 10.222.0.53 () {58 vars in 1013 bytes} [Wed Nov 24 16:33:27 2021] POST /identity/v3/auth/tokens => generated 2725 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 24 16:33:27.988945 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc567127-1f88-4630-89d9-29941362b294 None None] REQUEST_METHOD: `POST` {{(pid=71939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 24 16:33:27.989293 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc567127-1f88-4630-89d9-29941362b294 None None] SCRIPT_NAME: `/identity` {{(pid=71939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 24 16:33:27.989633 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc567127-1f88-4630-89d9-29941362b294 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=71939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 24 16:33:28.013015 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.auth.core [None req-fc567127-1f88-4630-89d9-29941362b294 None None] MFA Rules not processed for user `0f2ba2e8375b4e8c8792ee1e22b60427`. Rule list: `[]` (Enabled: `True`). {{(pid=71939) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:442}} Nov 24 16:33:28.014974 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.fernet_utils [None req-fc567127-1f88-4630-89d9-29941362b294 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=71939) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:289}} Nov 24 16:33:28.022151 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: [pid: 71939|app: 0|req: 471/942] 10.222.0.53 () {58 vars in 1013 bytes} [Wed Nov 24 16:33:27 2021] POST /identity/v3/auth/tokens => generated 2725 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 24 16:33:28.027985 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-783b7658-34aa-40b0-a717-1a5eb24ac548 None None] Authenticating user token {{(pid=71938) process_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 24 16:33:28.037543 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-783b7658-34aa-40b0-a717-1a5eb24ac548 None None] Validating token access rules against request {{(pid=71938) validate_allowed_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 24 16:33:28.042014 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd8e09ca-93d6-4dbd-8f2e-f3f9395a875c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f2ba2e8375b4e8c8792ee1e22b60427', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '00a5583c7b7443e98e7a1d31a0b638dc', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=71938) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 24 16:33:28.042861 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd8e09ca-93d6-4dbd-8f2e-f3f9395a875c admin admin] REQUEST_METHOD: `GET` {{(pid=71938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 24 16:33:28.043200 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd8e09ca-93d6-4dbd-8f2e-f3f9395a875c admin admin] SCRIPT_NAME: `/identity` {{(pid=71938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 24 16:33:28.043528 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd8e09ca-93d6-4dbd-8f2e-f3f9395a875c admin admin] PATH_INFO: `/v3/roles/service` {{(pid=71938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 24 16:33:28.055235 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd8e09ca-93d6-4dbd-8f2e-f3f9395a875c admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=71938) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:401}} Nov 24 16:33:28.063186 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: WARNING keystone.server.flask.application [None req-bd8e09ca-93d6-4dbd-8f2e-f3f9395a875c admin admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Nov 24 16:33:28.064342 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: [pid: 71938|app: 0|req: 472/943] 10.222.0.53 () {56 vars in 1114 bytes} [Wed Nov 24 16:33:28 2021] GET /identity/v3/roles/service => generated 85 bytes in 37 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 24 16:33:28.070664 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc567127-1f88-4630-89d9-29941362b294 None None] Authenticating user token {{(pid=71939) process_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 24 16:33:28.080347 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc567127-1f88-4630-89d9-29941362b294 None None] Validating token access rules against request {{(pid=71939) validate_allowed_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 24 16:33:28.084688 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5423fbcd-b43b-4040-871e-1207f0b99d29 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f2ba2e8375b4e8c8792ee1e22b60427', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '00a5583c7b7443e98e7a1d31a0b638dc', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=71939) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 24 16:33:28.085353 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5423fbcd-b43b-4040-871e-1207f0b99d29 admin admin] REQUEST_METHOD: `GET` {{(pid=71939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 24 16:33:28.085804 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5423fbcd-b43b-4040-871e-1207f0b99d29 admin admin] SCRIPT_NAME: `/identity` {{(pid=71939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 24 16:33:28.086065 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5423fbcd-b43b-4040-871e-1207f0b99d29 admin admin] PATH_INFO: `/v3/roles` {{(pid=71939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 24 16:33:28.086882 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5423fbcd-b43b-4040-871e-1207f0b99d29 admin admin] RBAC: Adding query filter params (name=service) {{(pid=71939) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:161}} Nov 24 16:33:28.087238 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5423fbcd-b43b-4040-871e-1207f0b99d29 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=71939) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:442}} Nov 24 16:33:28.115205 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5423fbcd-b43b-4040-871e-1207f0b99d29 admin admin] RBAC: Authorization granted {{(pid=71939) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 24 16:33:28.124556 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: [pid: 71939|app: 0|req: 472/944] 10.222.0.53 () {56 vars in 1115 bytes} [Wed Nov 24 16:33:28 2021] GET /identity/v3/roles?name=service => generated 326 bytes in 54 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 24 16:33:28.130392 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd8e09ca-93d6-4dbd-8f2e-f3f9395a875c admin admin] Authenticating user token {{(pid=71938) process_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 24 16:33:28.141477 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd8e09ca-93d6-4dbd-8f2e-f3f9395a875c admin admin] Validating token access rules against request {{(pid=71938) validate_allowed_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 24 16:33:28.157861 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be002fad-cc82-4f43-a408-032e8b27ba2c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f2ba2e8375b4e8c8792ee1e22b60427', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '00a5583c7b7443e98e7a1d31a0b638dc', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=71938) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 24 16:33:28.158728 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be002fad-cc82-4f43-a408-032e8b27ba2c admin admin] REQUEST_METHOD: `GET` {{(pid=71938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 24 16:33:28.159071 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be002fad-cc82-4f43-a408-032e8b27ba2c admin admin] SCRIPT_NAME: `/identity` {{(pid=71938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 24 16:33:28.159405 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be002fad-cc82-4f43-a408-032e8b27ba2c admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=71938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 24 16:33:28.176130 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be002fad-cc82-4f43-a408-032e8b27ba2c admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=71938) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:442}} Nov 24 16:33:28.210344 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be002fad-cc82-4f43-a408-032e8b27ba2c admin admin] RBAC: Authorization granted {{(pid=71938) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 24 16:33:28.230303 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: WARNING keystone.server.flask.application [None req-be002fad-cc82-4f43-a408-032e8b27ba2c admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Nov 24 16:33:28.231517 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: [pid: 71938|app: 0|req: 473/945] 10.222.0.53 () {56 vars in 1120 bytes} [Wed Nov 24 16:33:28 2021] GET /identity/v3/domains/Default => generated 87 bytes in 102 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 24 16:33:28.237715 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5423fbcd-b43b-4040-871e-1207f0b99d29 admin admin] Authenticating user token {{(pid=71939) process_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 24 16:33:28.248597 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5423fbcd-b43b-4040-871e-1207f0b99d29 admin admin] Validating token access rules against request {{(pid=71939) validate_allowed_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 24 16:33:28.252861 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16e49b2a-9423-4065-9799-33928f87f5d2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f2ba2e8375b4e8c8792ee1e22b60427', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '00a5583c7b7443e98e7a1d31a0b638dc', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=71939) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 24 16:33:28.253525 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16e49b2a-9423-4065-9799-33928f87f5d2 admin admin] REQUEST_METHOD: `GET` {{(pid=71939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 24 16:33:28.253859 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16e49b2a-9423-4065-9799-33928f87f5d2 admin admin] SCRIPT_NAME: `/identity` {{(pid=71939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 24 16:33:28.254224 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16e49b2a-9423-4065-9799-33928f87f5d2 admin admin] PATH_INFO: `/v3/domains` {{(pid=71939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 24 16:33:28.255009 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16e49b2a-9423-4065-9799-33928f87f5d2 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=71939) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:161}} Nov 24 16:33:28.255358 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16e49b2a-9423-4065-9799-33928f87f5d2 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=71939) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:442}} Nov 24 16:33:28.283830 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16e49b2a-9423-4065-9799-33928f87f5d2 admin admin] RBAC: Authorization granted {{(pid=71939) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 24 16:33:28.297096 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: [pid: 71939|app: 0|req: 473/946] 10.222.0.53 () {56 vars in 1121 bytes} [Wed Nov 24 16:33:28 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 60 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 24 16:33:28.303076 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be002fad-cc82-4f43-a408-032e8b27ba2c admin admin] Authenticating user token {{(pid=71938) process_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 24 16:33:28.313442 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be002fad-cc82-4f43-a408-032e8b27ba2c admin admin] Validating token access rules against request {{(pid=71938) validate_allowed_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 24 16:33:28.317778 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3acc081-303d-4b17-994c-fb39d1fe9c72 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f2ba2e8375b4e8c8792ee1e22b60427', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '00a5583c7b7443e98e7a1d31a0b638dc', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=71938) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 24 16:33:28.318614 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3acc081-303d-4b17-994c-fb39d1fe9c72 admin admin] REQUEST_METHOD: `GET` {{(pid=71938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 24 16:33:28.318957 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3acc081-303d-4b17-994c-fb39d1fe9c72 admin admin] SCRIPT_NAME: `/identity` {{(pid=71938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 24 16:33:28.319292 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3acc081-303d-4b17-994c-fb39d1fe9c72 admin admin] PATH_INFO: `/v3/users/neutron` {{(pid=71938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 24 16:33:28.333754 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3acc081-303d-4b17-994c-fb39d1fe9c72 admin admin] RBAC: Authorizing `identity:get_user(user_id=neutron)` {{(pid=71938) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:442}} Nov 24 16:33:28.362951 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3acc081-303d-4b17-994c-fb39d1fe9c72 admin admin] RBAC: Authorization granted {{(pid=71938) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 24 16:33:28.383003 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: WARNING keystone.server.flask.application [None req-e3acc081-303d-4b17-994c-fb39d1fe9c72 admin admin] Could not find user: neutron.: keystone.exception.UserNotFound: Could not find user: neutron. Nov 24 16:33:28.384157 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: [pid: 71938|app: 0|req: 474/947] 10.222.0.53 () {56 vars in 1114 bytes} [Wed Nov 24 16:33:28 2021] GET /identity/v3/users/neutron => generated 85 bytes in 82 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 24 16:33:28.390216 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16e49b2a-9423-4065-9799-33928f87f5d2 admin admin] Authenticating user token {{(pid=71939) process_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 24 16:33:28.400071 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16e49b2a-9423-4065-9799-33928f87f5d2 admin admin] Validating token access rules against request {{(pid=71939) validate_allowed_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 24 16:33:28.404387 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0650ccd8-39f4-4184-b7a9-48d738b68335 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f2ba2e8375b4e8c8792ee1e22b60427', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '00a5583c7b7443e98e7a1d31a0b638dc', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=71939) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 24 16:33:28.405055 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0650ccd8-39f4-4184-b7a9-48d738b68335 admin admin] REQUEST_METHOD: `GET` {{(pid=71939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 24 16:33:28.405397 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0650ccd8-39f4-4184-b7a9-48d738b68335 admin admin] SCRIPT_NAME: `/identity` {{(pid=71939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 24 16:33:28.405735 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0650ccd8-39f4-4184-b7a9-48d738b68335 admin admin] PATH_INFO: `/v3/users` {{(pid=71939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 24 16:33:28.406710 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0650ccd8-39f4-4184-b7a9-48d738b68335 admin admin] RBAC: Adding query filter params (domain_id=default, name=neutron) {{(pid=71939) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:161}} Nov 24 16:33:28.407069 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0650ccd8-39f4-4184-b7a9-48d738b68335 admin admin] RBAC: Authorizing `identity:list_users()` {{(pid=71939) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:442}} Nov 24 16:33:28.436382 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0650ccd8-39f4-4184-b7a9-48d738b68335 admin admin] RBAC: Authorization granted {{(pid=71939) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 24 16:33:28.470463 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: [pid: 71939|app: 0|req: 474/948] 10.222.0.53 () {56 vars in 1151 bytes} [Wed Nov 24 16:33:28 2021] GET /identity/v3/users?domain_id=default&name=neutron => generated 374 bytes in 81 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 24 16:33:28.476653 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3acc081-303d-4b17-994c-fb39d1fe9c72 admin admin] Authenticating user token {{(pid=71938) process_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 24 16:33:28.486999 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3acc081-303d-4b17-994c-fb39d1fe9c72 admin admin] Validating token access rules against request {{(pid=71938) validate_allowed_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 24 16:33:28.491213 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-006edafd-33fc-49b4-98e1-e230b08e4008 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f2ba2e8375b4e8c8792ee1e22b60427', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '00a5583c7b7443e98e7a1d31a0b638dc', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=71938) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 24 16:33:28.491860 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-006edafd-33fc-49b4-98e1-e230b08e4008 admin admin] REQUEST_METHOD: `GET` {{(pid=71938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 24 16:33:28.492196 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-006edafd-33fc-49b4-98e1-e230b08e4008 admin admin] SCRIPT_NAME: `/identity` {{(pid=71938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 24 16:33:28.492517 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-006edafd-33fc-49b4-98e1-e230b08e4008 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=71938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 24 16:33:28.503390 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-006edafd-33fc-49b4-98e1-e230b08e4008 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=71938) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:442}} Nov 24 16:33:28.531284 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-006edafd-33fc-49b4-98e1-e230b08e4008 admin admin] RBAC: Authorization granted {{(pid=71938) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 24 16:33:28.540349 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: [pid: 71938|app: 0|req: 475/949] 10.222.0.53 () {58 vars in 1315 bytes} [Wed Nov 24 16:33:28 2021] GET /identity/v3/auth/tokens => generated 2725 bytes in 64 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 24 16:33:28.547035 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0650ccd8-39f4-4184-b7a9-48d738b68335 admin admin] Authenticating user token {{(pid=71939) process_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 24 16:33:28.556845 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0650ccd8-39f4-4184-b7a9-48d738b68335 admin admin] Validating token access rules against request {{(pid=71939) validate_allowed_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 24 16:33:28.561770 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be2b443a-a69e-4aaf-ad5e-0a1d70980e01 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f2ba2e8375b4e8c8792ee1e22b60427', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '00a5583c7b7443e98e7a1d31a0b638dc', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=71939) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 24 16:33:28.562608 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be2b443a-a69e-4aaf-ad5e-0a1d70980e01 admin admin] REQUEST_METHOD: `GET` {{(pid=71939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 24 16:33:28.562949 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be2b443a-a69e-4aaf-ad5e-0a1d70980e01 admin admin] SCRIPT_NAME: `/identity` {{(pid=71939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 24 16:33:28.563285 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be2b443a-a69e-4aaf-ad5e-0a1d70980e01 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=71939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 24 16:33:28.575393 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be2b443a-a69e-4aaf-ad5e-0a1d70980e01 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=71939) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:442}} Nov 24 16:33:28.603789 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be2b443a-a69e-4aaf-ad5e-0a1d70980e01 admin admin] RBAC: Authorization granted {{(pid=71939) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 24 16:33:28.622476 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: WARNING keystone.server.flask.application [None req-be2b443a-a69e-4aaf-ad5e-0a1d70980e01 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Nov 24 16:33:28.624273 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: [pid: 71939|app: 0|req: 475/950] 10.222.0.53 () {56 vars in 1120 bytes} [Wed Nov 24 16:33:28 2021] GET /identity/v3/domains/Default => generated 87 bytes in 78 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 24 16:33:28.630318 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-006edafd-33fc-49b4-98e1-e230b08e4008 admin admin] Authenticating user token {{(pid=71938) process_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 24 16:33:28.639668 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-006edafd-33fc-49b4-98e1-e230b08e4008 admin admin] Validating token access rules against request {{(pid=71938) validate_allowed_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 24 16:33:28.643961 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a75e257-f7b0-443f-b007-1a94aaa0a885 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f2ba2e8375b4e8c8792ee1e22b60427', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '00a5583c7b7443e98e7a1d31a0b638dc', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=71938) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 24 16:33:28.644626 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a75e257-f7b0-443f-b007-1a94aaa0a885 admin admin] REQUEST_METHOD: `GET` {{(pid=71938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 24 16:33:28.644963 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a75e257-f7b0-443f-b007-1a94aaa0a885 admin admin] SCRIPT_NAME: `/identity` {{(pid=71938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 24 16:33:28.645297 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a75e257-f7b0-443f-b007-1a94aaa0a885 admin admin] PATH_INFO: `/v3/domains` {{(pid=71938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 24 16:33:28.646111 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a75e257-f7b0-443f-b007-1a94aaa0a885 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=71938) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:161}} Nov 24 16:33:28.646465 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a75e257-f7b0-443f-b007-1a94aaa0a885 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=71938) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:442}} Nov 24 16:33:28.674970 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a75e257-f7b0-443f-b007-1a94aaa0a885 admin admin] RBAC: Authorization granted {{(pid=71938) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 24 16:33:28.688380 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: [pid: 71938|app: 0|req: 476/951] 10.222.0.53 () {56 vars in 1121 bytes} [Wed Nov 24 16:33:28 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 59 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 24 16:33:28.694358 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be2b443a-a69e-4aaf-ad5e-0a1d70980e01 admin admin] Authenticating user token {{(pid=71939) process_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 24 16:33:28.704575 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be2b443a-a69e-4aaf-ad5e-0a1d70980e01 admin admin] Validating token access rules against request {{(pid=71939) validate_allowed_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 24 16:33:28.708879 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83eb1cb8-b263-4e6c-a6f6-a40fabc63a31 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f2ba2e8375b4e8c8792ee1e22b60427', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '00a5583c7b7443e98e7a1d31a0b638dc', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=71939) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 24 16:33:28.709678 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83eb1cb8-b263-4e6c-a6f6-a40fabc63a31 admin admin] REQUEST_METHOD: `GET` {{(pid=71939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 24 16:33:28.710020 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83eb1cb8-b263-4e6c-a6f6-a40fabc63a31 admin admin] SCRIPT_NAME: `/identity` {{(pid=71939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 24 16:33:28.710401 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83eb1cb8-b263-4e6c-a6f6-a40fabc63a31 admin admin] PATH_INFO: `/v3/projects/service` {{(pid=71939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 24 16:33:28.720197 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83eb1cb8-b263-4e6c-a6f6-a40fabc63a31 admin admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=71939) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:442}} Nov 24 16:33:28.749130 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83eb1cb8-b263-4e6c-a6f6-a40fabc63a31 admin admin] RBAC: Authorization granted {{(pid=71939) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 24 16:33:28.764039 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: WARNING keystone.server.flask.application [None req-83eb1cb8-b263-4e6c-a6f6-a40fabc63a31 admin admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Nov 24 16:33:28.765266 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: [pid: 71939|app: 0|req: 476/952] 10.222.0.53 () {56 vars in 1123 bytes} [Wed Nov 24 16:33:28 2021] GET /identity/v3/projects/service => generated 88 bytes in 71 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 24 16:33:28.771147 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a75e257-f7b0-443f-b007-1a94aaa0a885 admin admin] Authenticating user token {{(pid=71938) process_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 24 16:33:28.781265 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a75e257-f7b0-443f-b007-1a94aaa0a885 admin admin] Validating token access rules against request {{(pid=71938) validate_allowed_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 24 16:33:28.785554 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d52be05-230d-4da7-84e7-ff53d5a27133 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f2ba2e8375b4e8c8792ee1e22b60427', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '00a5583c7b7443e98e7a1d31a0b638dc', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=71938) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 24 16:33:28.786231 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d52be05-230d-4da7-84e7-ff53d5a27133 admin admin] REQUEST_METHOD: `GET` {{(pid=71938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 24 16:33:28.786566 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d52be05-230d-4da7-84e7-ff53d5a27133 admin admin] SCRIPT_NAME: `/identity` {{(pid=71938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 24 16:33:28.786894 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d52be05-230d-4da7-84e7-ff53d5a27133 admin admin] PATH_INFO: `/v3/projects` {{(pid=71938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 24 16:33:28.787725 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d52be05-230d-4da7-84e7-ff53d5a27133 admin admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=71938) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:161}} Nov 24 16:33:28.788077 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d52be05-230d-4da7-84e7-ff53d5a27133 admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=71938) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:442}} Nov 24 16:33:28.816997 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d52be05-230d-4da7-84e7-ff53d5a27133 admin admin] RBAC: Authorization granted {{(pid=71938) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 24 16:33:28.832845 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: [pid: 71938|app: 0|req: 477/953] 10.222.0.53 () {56 vars in 1160 bytes} [Wed Nov 24 16:33:28 2021] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 62 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 24 16:33:28.838958 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83eb1cb8-b263-4e6c-a6f6-a40fabc63a31 admin admin] Authenticating user token {{(pid=71939) process_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 24 16:33:28.849170 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83eb1cb8-b263-4e6c-a6f6-a40fabc63a31 admin admin] Validating token access rules against request {{(pid=71939) validate_allowed_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 24 16:33:28.853456 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86eb7263-ccd7-4c48-ad54-0874907911f8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f2ba2e8375b4e8c8792ee1e22b60427', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '00a5583c7b7443e98e7a1d31a0b638dc', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=71939) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 24 16:33:28.854127 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86eb7263-ccd7-4c48-ad54-0874907911f8 admin admin] REQUEST_METHOD: `GET` {{(pid=71939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 24 16:33:28.854471 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86eb7263-ccd7-4c48-ad54-0874907911f8 admin admin] SCRIPT_NAME: `/identity` {{(pid=71939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 24 16:33:28.854805 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86eb7263-ccd7-4c48-ad54-0874907911f8 admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=71939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 24 16:33:28.855692 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86eb7263-ccd7-4c48-ad54-0874907911f8 admin admin] RBAC: Adding query filter params (role.id=2d4a51004ce34308a7a33e68bf2cfc74, scope.project.id=3b3940d4ae1c4177ae29c02377bb4b0b, user.id=c90f21b9cdcb413282461fa83cb6b7a5) {{(pid=71939) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:161}} Nov 24 16:33:28.856055 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86eb7263-ccd7-4c48-ad54-0874907911f8 admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=71939) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:442}} Nov 24 16:33:28.884869 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86eb7263-ccd7-4c48-ad54-0874907911f8 admin admin] RBAC: Authorization granted {{(pid=71939) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 24 16:33:28.897238 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: [pid: 71939|app: 0|req: 477/954] 10.222.0.53 () {56 vars in 1386 bytes} [Wed Nov 24 16:33:28 2021] GET /identity/v3/role_assignments?user.id=c90f21b9cdcb413282461fa83cb6b7a5&scope.project.id=3b3940d4ae1c4177ae29c02377bb4b0b&role.id=2d4a51004ce34308a7a33e68bf2cfc74 => generated 608 bytes in 53 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 24 16:33:30.903027 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fb03716-8a54-4421-b105-216d5d2d33b3 None None] REQUEST_METHOD: `GET` {{(pid=71938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 24 16:33:30.903548 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fb03716-8a54-4421-b105-216d5d2d33b3 None None] SCRIPT_NAME: `/identity` {{(pid=71938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 24 16:33:30.903652 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fb03716-8a54-4421-b105-216d5d2d33b3 None None] PATH_INFO: `/` {{(pid=71938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 24 16:33:30.906118 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: [pid: 71938|app: 0|req: 478/955] 10.222.0.53 () {54 vars in 915 bytes} [Wed Nov 24 16:33:30 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 24 16:33:30.911583 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92384194-6a64-405e-82e0-d8fdb5e4574f None None] REQUEST_METHOD: `POST` {{(pid=71939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 24 16:33:30.911936 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92384194-6a64-405e-82e0-d8fdb5e4574f None None] SCRIPT_NAME: `/identity` {{(pid=71939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 24 16:33:30.912283 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92384194-6a64-405e-82e0-d8fdb5e4574f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=71939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 24 16:33:30.936170 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.auth.core [None req-92384194-6a64-405e-82e0-d8fdb5e4574f None None] MFA Rules not processed for user `0f2ba2e8375b4e8c8792ee1e22b60427`. Rule list: `[]` (Enabled: `True`). {{(pid=71939) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:442}} Nov 24 16:33:30.937380 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.fernet_utils [None req-92384194-6a64-405e-82e0-d8fdb5e4574f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=71939) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:289}} Nov 24 16:33:30.944557 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: [pid: 71939|app: 0|req: 478/956] 10.222.0.53 () {58 vars in 1013 bytes} [Wed Nov 24 16:33:30 2021] POST /identity/v3/auth/tokens => generated 2725 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 24 16:33:30.967094 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc78ace7-58c8-40f0-9e0c-f0634f4c74af None None] REQUEST_METHOD: `POST` {{(pid=71938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 24 16:33:30.967441 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc78ace7-58c8-40f0-9e0c-f0634f4c74af None None] SCRIPT_NAME: `/identity` {{(pid=71938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 24 16:33:30.967780 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc78ace7-58c8-40f0-9e0c-f0634f4c74af None None] PATH_INFO: `/v3/auth/tokens` {{(pid=71938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 24 16:33:30.990483 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.auth.core [None req-dc78ace7-58c8-40f0-9e0c-f0634f4c74af None None] MFA Rules not processed for user `0f2ba2e8375b4e8c8792ee1e22b60427`. Rule list: `[]` (Enabled: `True`). {{(pid=71938) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:442}} Nov 24 16:33:30.991697 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.fernet_utils [None req-dc78ace7-58c8-40f0-9e0c-f0634f4c74af None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=71938) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:289}} Nov 24 16:33:30.999649 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: [pid: 71938|app: 0|req: 479/957] 10.222.0.53 () {58 vars in 1013 bytes} [Wed Nov 24 16:33:30 2021] POST /identity/v3/auth/tokens => generated 2725 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 24 16:33:31.005233 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92384194-6a64-405e-82e0-d8fdb5e4574f None None] Authenticating user token {{(pid=71939) process_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 24 16:33:31.015508 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92384194-6a64-405e-82e0-d8fdb5e4574f None None] Validating token access rules against request {{(pid=71939) validate_allowed_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 24 16:33:31.019856 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12fe5cb5-7ff5-46f9-9f6a-d60ef6509336 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f2ba2e8375b4e8c8792ee1e22b60427', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '00a5583c7b7443e98e7a1d31a0b638dc', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=71939) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 24 16:33:31.020666 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12fe5cb5-7ff5-46f9-9f6a-d60ef6509336 admin admin] REQUEST_METHOD: `GET` {{(pid=71939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 24 16:33:31.021007 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12fe5cb5-7ff5-46f9-9f6a-d60ef6509336 admin admin] SCRIPT_NAME: `/identity` {{(pid=71939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 24 16:33:31.021339 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12fe5cb5-7ff5-46f9-9f6a-d60ef6509336 admin admin] PATH_INFO: `/v3/services/network` {{(pid=71939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 24 16:33:31.022062 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12fe5cb5-7ff5-46f9-9f6a-d60ef6509336 admin admin] RBAC: Authorizing `identity:get_service(service_id=network)` {{(pid=71939) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:442}} Nov 24 16:33:31.049911 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12fe5cb5-7ff5-46f9-9f6a-d60ef6509336 admin admin] RBAC: Authorization granted {{(pid=71939) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 24 16:33:31.062015 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: WARNING keystone.server.flask.application [None req-12fe5cb5-7ff5-46f9-9f6a-d60ef6509336 admin admin] Could not find service: network.: keystone.exception.ServiceNotFound: Could not find service: network. Nov 24 16:33:31.063240 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: [pid: 71939|app: 0|req: 479/958] 10.222.0.53 () {56 vars in 1123 bytes} [Wed Nov 24 16:33:31 2021] GET /identity/v3/services/network => generated 88 bytes in 59 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 24 16:33:31.069891 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc78ace7-58c8-40f0-9e0c-f0634f4c74af None None] Authenticating user token {{(pid=71938) process_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 24 16:33:31.079712 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc78ace7-58c8-40f0-9e0c-f0634f4c74af None None] Validating token access rules against request {{(pid=71938) validate_allowed_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 24 16:33:31.084101 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3b6fa48-21c1-4074-a080-3352e04d8891 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f2ba2e8375b4e8c8792ee1e22b60427', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '00a5583c7b7443e98e7a1d31a0b638dc', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=71938) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 24 16:33:31.084764 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3b6fa48-21c1-4074-a080-3352e04d8891 admin admin] REQUEST_METHOD: `GET` {{(pid=71938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 24 16:33:31.085104 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3b6fa48-21c1-4074-a080-3352e04d8891 admin admin] SCRIPT_NAME: `/identity` {{(pid=71938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 24 16:33:31.085443 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3b6fa48-21c1-4074-a080-3352e04d8891 admin admin] PATH_INFO: `/v3/services` {{(pid=71938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 24 16:33:31.086233 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3b6fa48-21c1-4074-a080-3352e04d8891 admin admin] RBAC: Adding query filter params (name=network) {{(pid=71938) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:161}} Nov 24 16:33:31.086585 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3b6fa48-21c1-4074-a080-3352e04d8891 admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=71938) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:442}} Nov 24 16:33:31.121337 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3b6fa48-21c1-4074-a080-3352e04d8891 admin admin] RBAC: Authorization granted {{(pid=71938) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 24 16:33:31.128644 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: [pid: 71938|app: 0|req: 480/959] 10.222.0.53 () {56 vars in 1124 bytes} [Wed Nov 24 16:33:31 2021] GET /identity/v3/services?name=network => generated 124 bytes in 59 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 24 16:33:31.134852 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12fe5cb5-7ff5-46f9-9f6a-d60ef6509336 admin admin] Authenticating user token {{(pid=71939) process_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 24 16:33:31.145386 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12fe5cb5-7ff5-46f9-9f6a-d60ef6509336 admin admin] Validating token access rules against request {{(pid=71939) validate_allowed_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 24 16:33:31.149635 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e65e34bd-65e5-4ea4-b385-65776626fb5d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f2ba2e8375b4e8c8792ee1e22b60427', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '00a5583c7b7443e98e7a1d31a0b638dc', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=71939) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 24 16:33:31.150327 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e65e34bd-65e5-4ea4-b385-65776626fb5d admin admin] REQUEST_METHOD: `GET` {{(pid=71939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 24 16:33:31.150669 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e65e34bd-65e5-4ea4-b385-65776626fb5d admin admin] SCRIPT_NAME: `/identity` {{(pid=71939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 24 16:33:31.151004 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e65e34bd-65e5-4ea4-b385-65776626fb5d admin admin] PATH_INFO: `/v3/services` {{(pid=71939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 24 16:33:31.151765 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e65e34bd-65e5-4ea4-b385-65776626fb5d admin admin] RBAC: Adding query filter params (type=network) {{(pid=71939) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:161}} Nov 24 16:33:31.152118 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e65e34bd-65e5-4ea4-b385-65776626fb5d admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=71939) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:442}} Nov 24 16:33:31.180046 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e65e34bd-65e5-4ea4-b385-65776626fb5d admin admin] RBAC: Authorization granted {{(pid=71939) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 24 16:33:31.184764 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: [pid: 71939|app: 0|req: 480/960] 10.222.0.53 () {56 vars in 1124 bytes} [Wed Nov 24 16:33:31 2021] GET /identity/v3/services?type=network => generated 124 bytes in 50 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 24 16:33:33.135837 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0f6ffc6-aeea-4492-b678-593a2868cb14 None None] REQUEST_METHOD: `GET` {{(pid=71938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 24 16:33:33.136454 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0f6ffc6-aeea-4492-b678-593a2868cb14 None None] SCRIPT_NAME: `/identity` {{(pid=71938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 24 16:33:33.136454 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0f6ffc6-aeea-4492-b678-593a2868cb14 None None] PATH_INFO: `/` {{(pid=71938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 24 16:33:33.138348 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: [pid: 71938|app: 0|req: 481/961] 10.222.0.53 () {54 vars in 915 bytes} [Wed Nov 24 16:33:33 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 24 16:33:33.144417 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f079c7db-bfcf-4183-8af6-f9323dfe743e None None] REQUEST_METHOD: `POST` {{(pid=71939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 24 16:33:33.144767 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f079c7db-bfcf-4183-8af6-f9323dfe743e None None] SCRIPT_NAME: `/identity` {{(pid=71939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 24 16:33:33.145102 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f079c7db-bfcf-4183-8af6-f9323dfe743e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=71939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 24 16:33:33.169454 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.auth.core [None req-f079c7db-bfcf-4183-8af6-f9323dfe743e None None] MFA Rules not processed for user `0f2ba2e8375b4e8c8792ee1e22b60427`. Rule list: `[]` (Enabled: `True`). {{(pid=71939) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:442}} Nov 24 16:33:33.170756 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.fernet_utils [None req-f079c7db-bfcf-4183-8af6-f9323dfe743e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=71939) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:289}} Nov 24 16:33:33.177900 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: [pid: 71939|app: 0|req: 481/962] 10.222.0.53 () {58 vars in 1013 bytes} [Wed Nov 24 16:33:33 2021] POST /identity/v3/auth/tokens => generated 2725 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 24 16:33:33.200167 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6d6db14-f795-4f73-8786-bd5a62f48619 None None] REQUEST_METHOD: `POST` {{(pid=71938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 24 16:33:33.200520 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6d6db14-f795-4f73-8786-bd5a62f48619 None None] SCRIPT_NAME: `/identity` {{(pid=71938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 24 16:33:33.200868 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6d6db14-f795-4f73-8786-bd5a62f48619 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=71938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 24 16:33:33.224789 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.auth.core [None req-f6d6db14-f795-4f73-8786-bd5a62f48619 None None] MFA Rules not processed for user `0f2ba2e8375b4e8c8792ee1e22b60427`. Rule list: `[]` (Enabled: `True`). {{(pid=71938) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:442}} Nov 24 16:33:33.226000 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.fernet_utils [None req-f6d6db14-f795-4f73-8786-bd5a62f48619 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=71938) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:289}} Nov 24 16:33:33.233216 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: [pid: 71938|app: 0|req: 482/963] 10.222.0.53 () {58 vars in 1013 bytes} [Wed Nov 24 16:33:33 2021] POST /identity/v3/auth/tokens => generated 2725 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 24 16:33:33.239257 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f079c7db-bfcf-4183-8af6-f9323dfe743e None None] Authenticating user token {{(pid=71939) process_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 24 16:33:33.249408 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f079c7db-bfcf-4183-8af6-f9323dfe743e None None] Validating token access rules against request {{(pid=71939) validate_allowed_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 24 16:33:33.253724 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba78dc27-f99d-4918-8ed6-f8c12ebc7abb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f2ba2e8375b4e8c8792ee1e22b60427', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '00a5583c7b7443e98e7a1d31a0b638dc', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=71939) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 24 16:33:33.254425 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba78dc27-f99d-4918-8ed6-f8c12ebc7abb admin admin] REQUEST_METHOD: `POST` {{(pid=71939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 24 16:33:33.254771 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba78dc27-f99d-4918-8ed6-f8c12ebc7abb admin admin] SCRIPT_NAME: `/identity` {{(pid=71939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 24 16:33:33.255109 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba78dc27-f99d-4918-8ed6-f8c12ebc7abb admin admin] PATH_INFO: `/v3/services` {{(pid=71939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 24 16:33:33.255879 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba78dc27-f99d-4918-8ed6-f8c12ebc7abb admin admin] RBAC: Authorizing `identity:create_service()` {{(pid=71939) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:442}} Nov 24 16:33:33.284402 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba78dc27-f99d-4918-8ed6-f8c12ebc7abb admin admin] RBAC: Authorization granted {{(pid=71939) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 24 16:33:33.296740 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: [pid: 71939|app: 0|req: 482/964] 10.222.0.53 () {60 vars in 1153 bytes} [Wed Nov 24 16:33:33 2021] POST /identity/v3/services => generated 240 bytes in 58 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 24 16:33:35.303273 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffe50fe2-782c-4835-b46c-bf96a7a588d0 None None] REQUEST_METHOD: `GET` {{(pid=71938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 24 16:33:35.303806 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffe50fe2-782c-4835-b46c-bf96a7a588d0 None None] SCRIPT_NAME: `/identity` {{(pid=71938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 24 16:33:35.303906 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffe50fe2-782c-4835-b46c-bf96a7a588d0 None None] PATH_INFO: `/` {{(pid=71938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 24 16:33:35.305753 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: [pid: 71938|app: 0|req: 483/965] 10.222.0.53 () {54 vars in 915 bytes} [Wed Nov 24 16:33:35 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 24 16:33:35.311859 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e13a27d9-170d-4a5f-85b8-c58537eb6fef None None] REQUEST_METHOD: `POST` {{(pid=71939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 24 16:33:35.312218 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e13a27d9-170d-4a5f-85b8-c58537eb6fef None None] SCRIPT_NAME: `/identity` {{(pid=71939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 24 16:33:35.312559 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e13a27d9-170d-4a5f-85b8-c58537eb6fef None None] PATH_INFO: `/v3/auth/tokens` {{(pid=71939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 24 16:33:35.336820 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.auth.core [None req-e13a27d9-170d-4a5f-85b8-c58537eb6fef None None] MFA Rules not processed for user `0f2ba2e8375b4e8c8792ee1e22b60427`. Rule list: `[]` (Enabled: `True`). {{(pid=71939) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:442}} Nov 24 16:33:35.338086 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.fernet_utils [None req-e13a27d9-170d-4a5f-85b8-c58537eb6fef None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=71939) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:289}} Nov 24 16:33:35.356106 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: [pid: 71939|app: 0|req: 483/966] 10.222.0.53 () {58 vars in 1013 bytes} [Wed Nov 24 16:33:35 2021] POST /identity/v3/auth/tokens => generated 2824 bytes in 46 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 24 16:33:35.379510 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d71fb0f-64f6-40a6-b140-bc91cd064718 None None] REQUEST_METHOD: `POST` {{(pid=71938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 24 16:33:35.379866 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d71fb0f-64f6-40a6-b140-bc91cd064718 None None] SCRIPT_NAME: `/identity` {{(pid=71938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 24 16:33:35.380209 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d71fb0f-64f6-40a6-b140-bc91cd064718 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=71938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 24 16:33:35.403149 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.auth.core [None req-9d71fb0f-64f6-40a6-b140-bc91cd064718 None None] MFA Rules not processed for user `0f2ba2e8375b4e8c8792ee1e22b60427`. Rule list: `[]` (Enabled: `True`). {{(pid=71938) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:442}} Nov 24 16:33:35.404352 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.fernet_utils [None req-9d71fb0f-64f6-40a6-b140-bc91cd064718 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=71938) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:289}} Nov 24 16:33:35.411567 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: [pid: 71938|app: 0|req: 484/967] 10.222.0.53 () {58 vars in 1013 bytes} [Wed Nov 24 16:33:35 2021] POST /identity/v3/auth/tokens => generated 2824 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 24 16:33:35.417451 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e13a27d9-170d-4a5f-85b8-c58537eb6fef None None] Authenticating user token {{(pid=71939) process_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 24 16:33:35.427577 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e13a27d9-170d-4a5f-85b8-c58537eb6fef None None] Validating token access rules against request {{(pid=71939) validate_allowed_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 24 16:33:35.432004 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5dd1499-1ea3-48e7-bbca-ce00140ef175 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f2ba2e8375b4e8c8792ee1e22b60427', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '00a5583c7b7443e98e7a1d31a0b638dc', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=71939) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 24 16:33:35.432802 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5dd1499-1ea3-48e7-bbca-ce00140ef175 admin admin] REQUEST_METHOD: `GET` {{(pid=71939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 24 16:33:35.433136 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5dd1499-1ea3-48e7-bbca-ce00140ef175 admin admin] SCRIPT_NAME: `/identity` {{(pid=71939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 24 16:33:35.433463 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5dd1499-1ea3-48e7-bbca-ce00140ef175 admin admin] PATH_INFO: `/v3/services/network` {{(pid=71939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 24 16:33:35.434199 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5dd1499-1ea3-48e7-bbca-ce00140ef175 admin admin] RBAC: Authorizing `identity:get_service(service_id=network)` {{(pid=71939) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:442}} Nov 24 16:33:35.463057 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5dd1499-1ea3-48e7-bbca-ce00140ef175 admin admin] RBAC: Authorization granted {{(pid=71939) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 24 16:33:35.474978 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: WARNING keystone.server.flask.application [None req-f5dd1499-1ea3-48e7-bbca-ce00140ef175 admin admin] Could not find service: network.: keystone.exception.ServiceNotFound: Could not find service: network. Nov 24 16:33:35.476143 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: [pid: 71939|app: 0|req: 484/968] 10.222.0.53 () {56 vars in 1123 bytes} [Wed Nov 24 16:33:35 2021] GET /identity/v3/services/network => generated 88 bytes in 59 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 24 16:33:35.483606 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d71fb0f-64f6-40a6-b140-bc91cd064718 None None] Authenticating user token {{(pid=71938) process_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 24 16:33:35.492829 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d71fb0f-64f6-40a6-b140-bc91cd064718 None None] Validating token access rules against request {{(pid=71938) validate_allowed_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 24 16:33:35.497173 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd6a91c9-0124-417a-8ebb-fccb994bffe1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f2ba2e8375b4e8c8792ee1e22b60427', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '00a5583c7b7443e98e7a1d31a0b638dc', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=71938) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 24 16:33:35.497843 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd6a91c9-0124-417a-8ebb-fccb994bffe1 admin admin] REQUEST_METHOD: `GET` {{(pid=71938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 24 16:33:35.498219 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd6a91c9-0124-417a-8ebb-fccb994bffe1 admin admin] SCRIPT_NAME: `/identity` {{(pid=71938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 24 16:33:35.498559 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd6a91c9-0124-417a-8ebb-fccb994bffe1 admin admin] PATH_INFO: `/v3/services` {{(pid=71938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 24 16:33:35.499327 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd6a91c9-0124-417a-8ebb-fccb994bffe1 admin admin] RBAC: Adding query filter params (name=network) {{(pid=71938) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:161}} Nov 24 16:33:35.499682 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd6a91c9-0124-417a-8ebb-fccb994bffe1 admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=71938) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:442}} Nov 24 16:33:35.536495 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd6a91c9-0124-417a-8ebb-fccb994bffe1 admin admin] RBAC: Authorization granted {{(pid=71938) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 24 16:33:35.541961 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: [pid: 71938|app: 0|req: 485/969] 10.222.0.53 () {56 vars in 1124 bytes} [Wed Nov 24 16:33:35 2021] GET /identity/v3/services?name=network => generated 124 bytes in 60 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 24 16:33:35.548645 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5dd1499-1ea3-48e7-bbca-ce00140ef175 admin admin] Authenticating user token {{(pid=71939) process_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 24 16:33:35.558578 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5dd1499-1ea3-48e7-bbca-ce00140ef175 admin admin] Validating token access rules against request {{(pid=71939) validate_allowed_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 24 16:33:35.562902 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5224f0da-525b-47bf-acea-06a600efe757 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f2ba2e8375b4e8c8792ee1e22b60427', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '00a5583c7b7443e98e7a1d31a0b638dc', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=71939) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 24 16:33:35.563565 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5224f0da-525b-47bf-acea-06a600efe757 admin admin] REQUEST_METHOD: `GET` {{(pid=71939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 24 16:33:35.563905 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5224f0da-525b-47bf-acea-06a600efe757 admin admin] SCRIPT_NAME: `/identity` {{(pid=71939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 24 16:33:35.564236 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5224f0da-525b-47bf-acea-06a600efe757 admin admin] PATH_INFO: `/v3/services` {{(pid=71939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 24 16:33:35.565004 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5224f0da-525b-47bf-acea-06a600efe757 admin admin] RBAC: Adding query filter params (type=network) {{(pid=71939) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:161}} Nov 24 16:33:35.565358 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5224f0da-525b-47bf-acea-06a600efe757 admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=71939) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:442}} Nov 24 16:33:35.593980 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5224f0da-525b-47bf-acea-06a600efe757 admin admin] RBAC: Authorization granted {{(pid=71939) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 24 16:33:35.599432 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: [pid: 71939|app: 0|req: 485/970] 10.222.0.53 () {56 vars in 1124 bytes} [Wed Nov 24 16:33:35 2021] GET /identity/v3/services?type=network => generated 350 bytes in 51 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 24 16:33:35.605882 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd6a91c9-0124-417a-8ebb-fccb994bffe1 admin admin] Authenticating user token {{(pid=71938) process_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 24 16:33:35.616426 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd6a91c9-0124-417a-8ebb-fccb994bffe1 admin admin] Validating token access rules against request {{(pid=71938) validate_allowed_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 24 16:33:35.620849 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b033162-c5ad-4901-b8f3-7b610847cf49 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f2ba2e8375b4e8c8792ee1e22b60427', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '00a5583c7b7443e98e7a1d31a0b638dc', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=71938) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 24 16:33:35.621501 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b033162-c5ad-4901-b8f3-7b610847cf49 admin admin] REQUEST_METHOD: `GET` {{(pid=71938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 24 16:33:35.621838 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b033162-c5ad-4901-b8f3-7b610847cf49 admin admin] SCRIPT_NAME: `/identity` {{(pid=71938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 24 16:33:35.622201 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b033162-c5ad-4901-b8f3-7b610847cf49 admin admin] PATH_INFO: `/v3/endpoints` {{(pid=71938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 24 16:33:35.623051 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b033162-c5ad-4901-b8f3-7b610847cf49 admin admin] RBAC: Adding query filter params (interface=public, service_id=59590f195a5d43f39198a3b988501aa0, region_id=RegionOne) {{(pid=71938) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:161}} Nov 24 16:33:35.623413 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b033162-c5ad-4901-b8f3-7b610847cf49 admin admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=71938) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:442}} Nov 24 16:33:35.651292 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b033162-c5ad-4901-b8f3-7b610847cf49 admin admin] RBAC: Authorization granted {{(pid=71938) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 24 16:33:35.657638 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: [pid: 71938|app: 0|req: 486/971] 10.222.0.53 () {56 vars in 1263 bytes} [Wed Nov 24 16:33:35 2021] GET /identity/v3/endpoints?service_id=59590f195a5d43f39198a3b988501aa0&interface=public®ion_id=RegionOne => generated 194 bytes in 52 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 24 16:33:35.663686 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5224f0da-525b-47bf-acea-06a600efe757 admin admin] Authenticating user token {{(pid=71939) process_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 24 16:33:35.674235 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5224f0da-525b-47bf-acea-06a600efe757 admin admin] Validating token access rules against request {{(pid=71939) validate_allowed_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 24 16:33:35.678583 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c021c3c-0fcc-4b49-a9ce-34ca751eb0fd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f2ba2e8375b4e8c8792ee1e22b60427', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '00a5583c7b7443e98e7a1d31a0b638dc', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=71939) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 24 16:33:35.679250 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c021c3c-0fcc-4b49-a9ce-34ca751eb0fd admin admin] REQUEST_METHOD: `GET` {{(pid=71939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 24 16:33:35.679591 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c021c3c-0fcc-4b49-a9ce-34ca751eb0fd admin admin] SCRIPT_NAME: `/identity` {{(pid=71939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 24 16:33:35.679936 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c021c3c-0fcc-4b49-a9ce-34ca751eb0fd admin admin] PATH_INFO: `/v3/services` {{(pid=71939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 24 16:33:35.680678 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c021c3c-0fcc-4b49-a9ce-34ca751eb0fd admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=71939) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:442}} Nov 24 16:33:35.708822 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c021c3c-0fcc-4b49-a9ce-34ca751eb0fd admin admin] RBAC: Authorization granted {{(pid=71939) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 24 16:33:35.716080 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: [pid: 71939|app: 0|req: 486/972] 10.222.0.53 () {56 vars in 1099 bytes} [Wed Nov 24 16:33:35 2021] GET /identity/v3/services => generated 1967 bytes in 53 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 24 16:33:37.735708 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d427dca-2fe4-48ad-b91b-b06ae64d4e70 None None] REQUEST_METHOD: `GET` {{(pid=71938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 24 16:33:37.736230 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d427dca-2fe4-48ad-b91b-b06ae64d4e70 None None] SCRIPT_NAME: `/identity` {{(pid=71938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 24 16:33:37.736354 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d427dca-2fe4-48ad-b91b-b06ae64d4e70 None None] PATH_INFO: `/` {{(pid=71938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 24 16:33:37.738198 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: [pid: 71938|app: 0|req: 487/973] 10.222.0.53 () {54 vars in 915 bytes} [Wed Nov 24 16:33:37 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 24 16:33:37.743717 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1667452-3501-4e35-9e3b-1b8116a24983 None None] REQUEST_METHOD: `POST` {{(pid=71939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 24 16:33:37.744074 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1667452-3501-4e35-9e3b-1b8116a24983 None None] SCRIPT_NAME: `/identity` {{(pid=71939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 24 16:33:37.744414 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1667452-3501-4e35-9e3b-1b8116a24983 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=71939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 24 16:33:37.768877 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.auth.core [None req-d1667452-3501-4e35-9e3b-1b8116a24983 None None] MFA Rules not processed for user `0f2ba2e8375b4e8c8792ee1e22b60427`. Rule list: `[]` (Enabled: `True`). {{(pid=71939) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:442}} Nov 24 16:33:37.770124 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.fernet_utils [None req-d1667452-3501-4e35-9e3b-1b8116a24983 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=71939) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:289}} Nov 24 16:33:37.777258 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: [pid: 71939|app: 0|req: 487/974] 10.222.0.53 () {58 vars in 1013 bytes} [Wed Nov 24 16:33:37 2021] POST /identity/v3/auth/tokens => generated 2824 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 24 16:33:37.799295 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdedb354-61b9-4518-a789-004b49ab7f64 None None] REQUEST_METHOD: `POST` {{(pid=71938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 24 16:33:37.799638 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdedb354-61b9-4518-a789-004b49ab7f64 None None] SCRIPT_NAME: `/identity` {{(pid=71938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 24 16:33:37.799973 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdedb354-61b9-4518-a789-004b49ab7f64 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=71938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 24 16:33:37.823753 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.auth.core [None req-fdedb354-61b9-4518-a789-004b49ab7f64 None None] MFA Rules not processed for user `0f2ba2e8375b4e8c8792ee1e22b60427`. Rule list: `[]` (Enabled: `True`). {{(pid=71938) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:442}} Nov 24 16:33:37.824957 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.fernet_utils [None req-fdedb354-61b9-4518-a789-004b49ab7f64 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=71938) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:289}} Nov 24 16:33:37.832999 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: [pid: 71938|app: 0|req: 488/975] 10.222.0.53 () {58 vars in 1013 bytes} [Wed Nov 24 16:33:37 2021] POST /identity/v3/auth/tokens => generated 2824 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 24 16:33:37.838885 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1667452-3501-4e35-9e3b-1b8116a24983 None None] Authenticating user token {{(pid=71939) process_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 24 16:33:37.848480 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1667452-3501-4e35-9e3b-1b8116a24983 None None] Validating token access rules against request {{(pid=71939) validate_allowed_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 24 16:33:37.852990 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c32a05ff-5d7a-4dcf-bfb2-6d2a418e4971 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f2ba2e8375b4e8c8792ee1e22b60427', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '00a5583c7b7443e98e7a1d31a0b638dc', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=71939) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 24 16:33:37.853796 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c32a05ff-5d7a-4dcf-bfb2-6d2a418e4971 admin admin] REQUEST_METHOD: `GET` {{(pid=71939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 24 16:33:37.854169 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c32a05ff-5d7a-4dcf-bfb2-6d2a418e4971 admin admin] SCRIPT_NAME: `/identity` {{(pid=71939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 24 16:33:37.854506 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c32a05ff-5d7a-4dcf-bfb2-6d2a418e4971 admin admin] PATH_INFO: `/v3/services/network` {{(pid=71939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 24 16:33:37.855215 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c32a05ff-5d7a-4dcf-bfb2-6d2a418e4971 admin admin] RBAC: Authorizing `identity:get_service(service_id=network)` {{(pid=71939) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:442}} Nov 24 16:33:37.883596 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c32a05ff-5d7a-4dcf-bfb2-6d2a418e4971 admin admin] RBAC: Authorization granted {{(pid=71939) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 24 16:33:37.895581 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: WARNING keystone.server.flask.application [None req-c32a05ff-5d7a-4dcf-bfb2-6d2a418e4971 admin admin] Could not find service: network.: keystone.exception.ServiceNotFound: Could not find service: network. Nov 24 16:33:37.896742 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: [pid: 71939|app: 0|req: 488/976] 10.222.0.53 () {56 vars in 1123 bytes} [Wed Nov 24 16:33:37 2021] GET /identity/v3/services/network => generated 88 bytes in 58 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 24 16:33:37.903349 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdedb354-61b9-4518-a789-004b49ab7f64 None None] Authenticating user token {{(pid=71938) process_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 24 16:33:37.912439 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdedb354-61b9-4518-a789-004b49ab7f64 None None] Validating token access rules against request {{(pid=71938) validate_allowed_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 24 16:33:37.916719 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63ee8145-751c-44f1-9b9a-17d6e354661a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f2ba2e8375b4e8c8792ee1e22b60427', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '00a5583c7b7443e98e7a1d31a0b638dc', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=71938) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 24 16:33:37.917368 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63ee8145-751c-44f1-9b9a-17d6e354661a admin admin] REQUEST_METHOD: `GET` {{(pid=71938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 24 16:33:37.917709 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63ee8145-751c-44f1-9b9a-17d6e354661a admin admin] SCRIPT_NAME: `/identity` {{(pid=71938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 24 16:33:37.918060 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63ee8145-751c-44f1-9b9a-17d6e354661a admin admin] PATH_INFO: `/v3/services` {{(pid=71938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 24 16:33:37.918816 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63ee8145-751c-44f1-9b9a-17d6e354661a admin admin] RBAC: Adding query filter params (name=network) {{(pid=71938) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:161}} Nov 24 16:33:37.919165 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63ee8145-751c-44f1-9b9a-17d6e354661a admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=71938) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:442}} Nov 24 16:33:37.947608 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63ee8145-751c-44f1-9b9a-17d6e354661a admin admin] RBAC: Authorization granted {{(pid=71938) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 24 16:33:37.953496 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: [pid: 71938|app: 0|req: 489/977] 10.222.0.53 () {56 vars in 1124 bytes} [Wed Nov 24 16:33:37 2021] GET /identity/v3/services?name=network => generated 124 bytes in 51 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 24 16:33:37.959313 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c32a05ff-5d7a-4dcf-bfb2-6d2a418e4971 admin admin] Authenticating user token {{(pid=71939) process_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 24 16:33:37.968895 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c32a05ff-5d7a-4dcf-bfb2-6d2a418e4971 admin admin] Validating token access rules against request {{(pid=71939) validate_allowed_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 24 16:33:37.973202 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-337efb9d-cc48-48e8-ac83-8c0b66df4b24 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f2ba2e8375b4e8c8792ee1e22b60427', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '00a5583c7b7443e98e7a1d31a0b638dc', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=71939) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 24 16:33:37.973849 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-337efb9d-cc48-48e8-ac83-8c0b66df4b24 admin admin] REQUEST_METHOD: `GET` {{(pid=71939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 24 16:33:37.974222 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-337efb9d-cc48-48e8-ac83-8c0b66df4b24 admin admin] SCRIPT_NAME: `/identity` {{(pid=71939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 24 16:33:37.974561 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-337efb9d-cc48-48e8-ac83-8c0b66df4b24 admin admin] PATH_INFO: `/v3/services` {{(pid=71939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 24 16:33:37.975316 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-337efb9d-cc48-48e8-ac83-8c0b66df4b24 admin admin] RBAC: Adding query filter params (type=network) {{(pid=71939) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:161}} Nov 24 16:33:37.975668 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-337efb9d-cc48-48e8-ac83-8c0b66df4b24 admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=71939) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:442}} Nov 24 16:33:38.003958 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-337efb9d-cc48-48e8-ac83-8c0b66df4b24 admin admin] RBAC: Authorization granted {{(pid=71939) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 24 16:33:38.009356 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: [pid: 71939|app: 0|req: 489/978] 10.222.0.53 () {56 vars in 1124 bytes} [Wed Nov 24 16:33:37 2021] GET /identity/v3/services?type=network => generated 350 bytes in 50 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 24 16:33:38.016050 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63ee8145-751c-44f1-9b9a-17d6e354661a admin admin] Authenticating user token {{(pid=71938) process_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 24 16:33:38.025727 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63ee8145-751c-44f1-9b9a-17d6e354661a admin admin] Validating token access rules against request {{(pid=71938) validate_allowed_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 24 16:33:38.030036 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10e65f1e-4967-4561-8cee-e337b9cac3b2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f2ba2e8375b4e8c8792ee1e22b60427', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '00a5583c7b7443e98e7a1d31a0b638dc', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=71938) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 24 16:33:38.030720 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10e65f1e-4967-4561-8cee-e337b9cac3b2 admin admin] REQUEST_METHOD: `POST` {{(pid=71938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 24 16:33:38.031061 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10e65f1e-4967-4561-8cee-e337b9cac3b2 admin admin] SCRIPT_NAME: `/identity` {{(pid=71938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 24 16:33:38.031398 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10e65f1e-4967-4561-8cee-e337b9cac3b2 admin admin] PATH_INFO: `/v3/endpoints` {{(pid=71938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 24 16:33:38.032173 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10e65f1e-4967-4561-8cee-e337b9cac3b2 admin admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=71938) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:442}} Nov 24 16:33:38.060035 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10e65f1e-4967-4561-8cee-e337b9cac3b2 admin admin] RBAC: Authorization granted {{(pid=71938) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 24 16:33:38.078007 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: [pid: 71938|app: 0|req: 490/979] 10.222.0.53 () {60 vars in 1156 bytes} [Wed Nov 24 16:33:38 2021] POST /identity/v3/endpoints => generated 327 bytes in 62 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 24 16:33:40.101113 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-203109a2-aaf3-4c57-ba31-3fb1d61ef5c6 None None] REQUEST_METHOD: `GET` {{(pid=71939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 24 16:33:40.101657 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-203109a2-aaf3-4c57-ba31-3fb1d61ef5c6 None None] SCRIPT_NAME: `/identity` {{(pid=71939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 24 16:33:40.101755 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-203109a2-aaf3-4c57-ba31-3fb1d61ef5c6 None None] PATH_INFO: `/` {{(pid=71939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 24 16:33:40.103655 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: [pid: 71939|app: 0|req: 490/980] 10.222.0.53 () {54 vars in 915 bytes} [Wed Nov 24 16:33:40 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 24 16:33:40.109818 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53c26d88-3116-4d1d-89c9-bb9adfb8c93c None None] REQUEST_METHOD: `POST` {{(pid=71938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 24 16:33:40.110219 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53c26d88-3116-4d1d-89c9-bb9adfb8c93c None None] SCRIPT_NAME: `/identity` {{(pid=71938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 24 16:33:40.110553 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53c26d88-3116-4d1d-89c9-bb9adfb8c93c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=71938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 24 16:33:40.133592 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.auth.core [None req-53c26d88-3116-4d1d-89c9-bb9adfb8c93c None None] MFA Rules not processed for user `0f2ba2e8375b4e8c8792ee1e22b60427`. Rule list: `[]` (Enabled: `True`). {{(pid=71938) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:442}} Nov 24 16:33:40.134811 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.fernet_utils [None req-53c26d88-3116-4d1d-89c9-bb9adfb8c93c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=71938) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:289}} Nov 24 16:33:40.153042 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: [pid: 71938|app: 0|req: 491/981] 10.222.0.53 () {58 vars in 1013 bytes} [Wed Nov 24 16:33:40 2021] POST /identity/v3/auth/tokens => generated 2973 bytes in 44 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 24 16:33:40.176060 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86700fd1-44a1-45a3-baf0-f4a174de7c53 None None] REQUEST_METHOD: `POST` {{(pid=71939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 24 16:33:40.176411 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86700fd1-44a1-45a3-baf0-f4a174de7c53 None None] SCRIPT_NAME: `/identity` {{(pid=71939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 24 16:33:40.176751 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86700fd1-44a1-45a3-baf0-f4a174de7c53 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=71939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 24 16:33:40.205390 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.auth.core [None req-86700fd1-44a1-45a3-baf0-f4a174de7c53 None None] MFA Rules not processed for user `0f2ba2e8375b4e8c8792ee1e22b60427`. Rule list: `[]` (Enabled: `True`). {{(pid=71939) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:442}} Nov 24 16:33:40.206653 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.fernet_utils [None req-86700fd1-44a1-45a3-baf0-f4a174de7c53 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=71939) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:289}} Nov 24 16:33:40.214309 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: [pid: 71939|app: 0|req: 491/982] 10.222.0.53 () {58 vars in 1013 bytes} [Wed Nov 24 16:33:40 2021] POST /identity/v3/auth/tokens => generated 2973 bytes in 39 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 24 16:33:40.221043 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53c26d88-3116-4d1d-89c9-bb9adfb8c93c None None] Authenticating user token {{(pid=71938) process_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 24 16:33:40.230694 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53c26d88-3116-4d1d-89c9-bb9adfb8c93c None None] Validating token access rules against request {{(pid=71938) validate_allowed_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 24 16:33:40.235606 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef3cf48a-0fb7-482d-8cf4-6ef813d4e5a4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f2ba2e8375b4e8c8792ee1e22b60427', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '00a5583c7b7443e98e7a1d31a0b638dc', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=71938) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 24 16:33:40.236271 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef3cf48a-0fb7-482d-8cf4-6ef813d4e5a4 admin admin] REQUEST_METHOD: `POST` {{(pid=71938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 24 16:33:40.236606 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef3cf48a-0fb7-482d-8cf4-6ef813d4e5a4 admin admin] SCRIPT_NAME: `/identity` {{(pid=71938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 24 16:33:40.236935 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef3cf48a-0fb7-482d-8cf4-6ef813d4e5a4 admin admin] PATH_INFO: `/v3/roles` {{(pid=71938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 24 16:33:40.237706 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef3cf48a-0fb7-482d-8cf4-6ef813d4e5a4 admin admin] RBAC: Authorizing `identity:create_role()` {{(pid=71938) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:442}} Nov 24 16:33:40.265093 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: WARNING py.warnings [None req-ef3cf48a-0fb7-482d-8cf4-6ef813d4e5a4 admin admin] /usr/local/lib/python3.6/dist-packages/oslo_policy/policy.py:1018: UserWarning: Policy identity:create_role failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 24 16:33:40.265093 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: warnings.warn(msg) Nov 24 16:33:40.265093 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: Nov 24 16:33:40.266110 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef3cf48a-0fb7-482d-8cf4-6ef813d4e5a4 admin admin] RBAC: Authorization granted {{(pid=71938) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 24 16:33:40.272548 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.sql.core [None req-ef3cf48a-0fb7-482d-8cf4-6ef813d4e5a4 admin admin] Conflict role: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'anotherrole-<>' for key 'ixu_role_name_domain_id'") Nov 24 16:33:40.272548 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: [SQL: INSERT INTO `role` (id, name, description, extra) VALUES (%(id)s, %(name)s, %(description)s, %(extra)s)] Nov 24 16:33:40.272548 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: [parameters: {'id': 'b21df69755a04caa9162564917da9e7c', 'name': 'anotherrole', 'description': None, 'extra': '{}'}] Nov 24 16:33:40.272548 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: (Background on this error at: http://sqlalche.me/e/gkpj) {{(pid=71938) wrapper /opt/stack/keystone/keystone/common/sql/core.py:523}} Nov 24 16:33:40.286498 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: WARNING keystone.server.flask.application [None req-ef3cf48a-0fb7-482d-8cf4-6ef813d4e5a4 admin admin] Conflict occurred attempting to store role - Duplicate entry found with name anotherrole.: keystone.exception.Conflict: Conflict occurred attempting to store role - Duplicate entry found with name anotherrole. Nov 24 16:33:40.287767 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: [pid: 71938|app: 0|req: 492/983] 10.222.0.53 () {60 vars in 1143 bytes} [Wed Nov 24 16:33:40 2021] POST /identity/v3/roles => generated 144 bytes in 67 msecs (HTTP/1.1 409) 5 headers in 183 bytes (1 switches on core 0) Nov 24 16:33:40.295417 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86700fd1-44a1-45a3-baf0-f4a174de7c53 None None] Authenticating user token {{(pid=71939) process_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 24 16:33:40.304648 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86700fd1-44a1-45a3-baf0-f4a174de7c53 None None] Validating token access rules against request {{(pid=71939) validate_allowed_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 24 16:33:40.309079 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29a60192-e508-4d57-b537-86695cfba19d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f2ba2e8375b4e8c8792ee1e22b60427', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '00a5583c7b7443e98e7a1d31a0b638dc', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=71939) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 24 16:33:40.309904 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29a60192-e508-4d57-b537-86695cfba19d admin admin] REQUEST_METHOD: `GET` {{(pid=71939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 24 16:33:40.310294 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29a60192-e508-4d57-b537-86695cfba19d admin admin] SCRIPT_NAME: `/identity` {{(pid=71939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 24 16:33:40.310634 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29a60192-e508-4d57-b537-86695cfba19d admin admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=71939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 24 16:33:40.322302 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29a60192-e508-4d57-b537-86695cfba19d admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=71939) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:401}} Nov 24 16:33:40.331285 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: WARNING keystone.server.flask.application [None req-29a60192-e508-4d57-b537-86695cfba19d admin admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Nov 24 16:33:40.332558 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: [pid: 71939|app: 0|req: 492/984] 10.222.0.53 () {56 vars in 1126 bytes} [Wed Nov 24 16:33:40 2021] GET /identity/v3/roles/anotherrole => generated 89 bytes in 38 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 24 16:33:40.338675 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef3cf48a-0fb7-482d-8cf4-6ef813d4e5a4 admin admin] Authenticating user token {{(pid=71938) process_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 24 16:33:40.350424 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef3cf48a-0fb7-482d-8cf4-6ef813d4e5a4 admin admin] Validating token access rules against request {{(pid=71938) validate_allowed_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 24 16:33:40.354805 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35fb2eb5-1f1c-4076-9207-8ff8006284cd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f2ba2e8375b4e8c8792ee1e22b60427', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '00a5583c7b7443e98e7a1d31a0b638dc', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=71938) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 24 16:33:40.355417 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35fb2eb5-1f1c-4076-9207-8ff8006284cd admin admin] REQUEST_METHOD: `GET` {{(pid=71938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 24 16:33:40.355750 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35fb2eb5-1f1c-4076-9207-8ff8006284cd admin admin] SCRIPT_NAME: `/identity` {{(pid=71938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 24 16:33:40.356079 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35fb2eb5-1f1c-4076-9207-8ff8006284cd admin admin] PATH_INFO: `/v3/roles` {{(pid=71938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 24 16:33:40.356878 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35fb2eb5-1f1c-4076-9207-8ff8006284cd admin admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=71938) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:161}} Nov 24 16:33:40.357287 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35fb2eb5-1f1c-4076-9207-8ff8006284cd admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=71938) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:442}} Nov 24 16:33:40.385062 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35fb2eb5-1f1c-4076-9207-8ff8006284cd admin admin] RBAC: Authorization granted {{(pid=71938) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 24 16:33:40.394424 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: [pid: 71938|app: 0|req: 493/985] 10.222.0.53 () {56 vars in 1123 bytes} [Wed Nov 24 16:33:40 2021] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 56 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 24 16:33:42.385299 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22ebc0ae-b205-47f3-889a-9b2752a4845e None None] REQUEST_METHOD: `GET` {{(pid=71939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 24 16:33:42.385874 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22ebc0ae-b205-47f3-889a-9b2752a4845e None None] SCRIPT_NAME: `/identity` {{(pid=71939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 24 16:33:42.385982 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22ebc0ae-b205-47f3-889a-9b2752a4845e None None] PATH_INFO: `/` {{(pid=71939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 24 16:33:42.387809 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: [pid: 71939|app: 0|req: 493/986] 10.222.0.53 () {54 vars in 915 bytes} [Wed Nov 24 16:33:42 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 24 16:33:42.393847 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9022937a-765c-4cf5-b995-6eb0b781e55d None None] REQUEST_METHOD: `POST` {{(pid=71938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 24 16:33:42.394230 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9022937a-765c-4cf5-b995-6eb0b781e55d None None] SCRIPT_NAME: `/identity` {{(pid=71938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 24 16:33:42.394563 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9022937a-765c-4cf5-b995-6eb0b781e55d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=71938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 24 16:33:42.417770 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.auth.core [None req-9022937a-765c-4cf5-b995-6eb0b781e55d None None] MFA Rules not processed for user `0f2ba2e8375b4e8c8792ee1e22b60427`. Rule list: `[]` (Enabled: `True`). {{(pid=71938) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:442}} Nov 24 16:33:42.419024 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.fernet_utils [None req-9022937a-765c-4cf5-b995-6eb0b781e55d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=71938) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:289}} Nov 24 16:33:42.426242 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: [pid: 71938|app: 0|req: 494/987] 10.222.0.53 () {58 vars in 1013 bytes} [Wed Nov 24 16:33:42 2021] POST /identity/v3/auth/tokens => generated 2973 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 24 16:33:42.449184 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b66e991a-4f80-4169-bfea-2538411b67f7 None None] REQUEST_METHOD: `POST` {{(pid=71939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 24 16:33:42.449526 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b66e991a-4f80-4169-bfea-2538411b67f7 None None] SCRIPT_NAME: `/identity` {{(pid=71939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 24 16:33:42.449867 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b66e991a-4f80-4169-bfea-2538411b67f7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=71939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 24 16:33:42.473763 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.auth.core [None req-b66e991a-4f80-4169-bfea-2538411b67f7 None None] MFA Rules not processed for user `0f2ba2e8375b4e8c8792ee1e22b60427`. Rule list: `[]` (Enabled: `True`). {{(pid=71939) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:442}} Nov 24 16:33:42.474932 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.fernet_utils [None req-b66e991a-4f80-4169-bfea-2538411b67f7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=71939) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:289}} Nov 24 16:33:42.482185 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: [pid: 71939|app: 0|req: 494/988] 10.222.0.53 () {58 vars in 1013 bytes} [Wed Nov 24 16:33:42 2021] POST /identity/v3/auth/tokens => generated 2973 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 24 16:33:42.487962 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9022937a-765c-4cf5-b995-6eb0b781e55d None None] Authenticating user token {{(pid=71938) process_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 24 16:33:42.497503 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9022937a-765c-4cf5-b995-6eb0b781e55d None None] Validating token access rules against request {{(pid=71938) validate_allowed_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 24 16:33:42.502291 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5120accc-031c-447c-92bb-63a49c3657e5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f2ba2e8375b4e8c8792ee1e22b60427', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '00a5583c7b7443e98e7a1d31a0b638dc', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=71938) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 24 16:33:42.503093 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5120accc-031c-447c-92bb-63a49c3657e5 admin admin] REQUEST_METHOD: `GET` {{(pid=71938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 24 16:33:42.503427 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5120accc-031c-447c-92bb-63a49c3657e5 admin admin] SCRIPT_NAME: `/identity` {{(pid=71938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 24 16:33:42.503755 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5120accc-031c-447c-92bb-63a49c3657e5 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=71938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 24 16:33:42.516543 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5120accc-031c-447c-92bb-63a49c3657e5 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=71938) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:442}} Nov 24 16:33:42.544733 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5120accc-031c-447c-92bb-63a49c3657e5 admin admin] RBAC: Authorization granted {{(pid=71938) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 24 16:33:42.564152 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: WARNING keystone.server.flask.application [None req-5120accc-031c-447c-92bb-63a49c3657e5 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Nov 24 16:33:42.565375 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: [pid: 71938|app: 0|req: 495/989] 10.222.0.53 () {56 vars in 1120 bytes} [Wed Nov 24 16:33:42 2021] GET /identity/v3/domains/Default => generated 87 bytes in 78 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 24 16:33:42.572306 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b66e991a-4f80-4169-bfea-2538411b67f7 None None] Authenticating user token {{(pid=71939) process_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 24 16:33:42.582426 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b66e991a-4f80-4169-bfea-2538411b67f7 None None] Validating token access rules against request {{(pid=71939) validate_allowed_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 24 16:33:42.586719 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdc38fd3-45ec-4d1e-99ce-1694debe4d5f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f2ba2e8375b4e8c8792ee1e22b60427', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '00a5583c7b7443e98e7a1d31a0b638dc', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=71939) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 24 16:33:42.587374 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdc38fd3-45ec-4d1e-99ce-1694debe4d5f admin admin] REQUEST_METHOD: `GET` {{(pid=71939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 24 16:33:42.587714 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdc38fd3-45ec-4d1e-99ce-1694debe4d5f admin admin] SCRIPT_NAME: `/identity` {{(pid=71939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 24 16:33:42.588041 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdc38fd3-45ec-4d1e-99ce-1694debe4d5f admin admin] PATH_INFO: `/v3/domains` {{(pid=71939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 24 16:33:42.588815 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdc38fd3-45ec-4d1e-99ce-1694debe4d5f admin admin] RBAC: Adding query filter params (name=Default) {{(pid=71939) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:161}} Nov 24 16:33:42.589161 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdc38fd3-45ec-4d1e-99ce-1694debe4d5f admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=71939) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:442}} Nov 24 16:33:42.617432 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdc38fd3-45ec-4d1e-99ce-1694debe4d5f admin admin] RBAC: Authorization granted {{(pid=71939) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 24 16:33:42.631213 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: [pid: 71939|app: 0|req: 495/990] 10.222.0.53 () {56 vars in 1121 bytes} [Wed Nov 24 16:33:42 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 59 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 24 16:33:42.637200 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5120accc-031c-447c-92bb-63a49c3657e5 admin admin] Authenticating user token {{(pid=71938) process_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 24 16:33:42.647084 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5120accc-031c-447c-92bb-63a49c3657e5 admin admin] Validating token access rules against request {{(pid=71938) validate_allowed_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 24 16:33:42.651417 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbf78700-3cee-495e-9066-e4b44578cead admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f2ba2e8375b4e8c8792ee1e22b60427', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '00a5583c7b7443e98e7a1d31a0b638dc', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=71938) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 24 16:33:42.652082 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbf78700-3cee-495e-9066-e4b44578cead admin admin] REQUEST_METHOD: `POST` {{(pid=71938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 24 16:33:42.652421 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbf78700-3cee-495e-9066-e4b44578cead admin admin] SCRIPT_NAME: `/identity` {{(pid=71938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 24 16:33:42.652754 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbf78700-3cee-495e-9066-e4b44578cead admin admin] PATH_INFO: `/v3/users` {{(pid=71938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 24 16:33:42.653491 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbf78700-3cee-495e-9066-e4b44578cead admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=71938) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:442}} Nov 24 16:33:42.683065 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbf78700-3cee-495e-9066-e4b44578cead admin admin] RBAC: Authorization granted {{(pid=71938) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 24 16:33:42.702914 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: [pid: 71938|app: 0|req: 496/991] 10.222.0.53 () {60 vars in 1143 bytes} [Wed Nov 24 16:33:42 2021] POST /identity/v3/users => generated 247 bytes in 66 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 24 16:33:44.724319 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea78dbed-8b35-4cb2-8eef-e3b27c4f4e38 None None] REQUEST_METHOD: `GET` {{(pid=71939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 24 16:33:44.724897 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea78dbed-8b35-4cb2-8eef-e3b27c4f4e38 None None] SCRIPT_NAME: `/identity` {{(pid=71939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 24 16:33:44.724997 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea78dbed-8b35-4cb2-8eef-e3b27c4f4e38 None None] PATH_INFO: `/` {{(pid=71939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 24 16:33:44.726857 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: [pid: 71939|app: 0|req: 496/992] 10.222.0.53 () {54 vars in 915 bytes} [Wed Nov 24 16:33:44 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 24 16:33:44.732739 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98865099-34df-4615-8caa-9673ce52c7aa None None] REQUEST_METHOD: `POST` {{(pid=71938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 24 16:33:44.733087 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98865099-34df-4615-8caa-9673ce52c7aa None None] SCRIPT_NAME: `/identity` {{(pid=71938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 24 16:33:44.733431 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98865099-34df-4615-8caa-9673ce52c7aa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=71938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 24 16:33:44.758800 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.auth.core [None req-98865099-34df-4615-8caa-9673ce52c7aa None None] MFA Rules not processed for user `0f2ba2e8375b4e8c8792ee1e22b60427`. Rule list: `[]` (Enabled: `True`). {{(pid=71938) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:442}} Nov 24 16:33:44.760075 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.fernet_utils [None req-98865099-34df-4615-8caa-9673ce52c7aa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=71938) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:289}} Nov 24 16:33:44.768330 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: [pid: 71938|app: 0|req: 497/993] 10.222.0.53 () {58 vars in 1013 bytes} [Wed Nov 24 16:33:44 2021] POST /identity/v3/auth/tokens => generated 2973 bytes in 37 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 24 16:33:44.791884 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-989c8bcb-6232-424f-9a69-f5bf168eb946 None None] REQUEST_METHOD: `POST` {{(pid=71939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 24 16:33:44.792245 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-989c8bcb-6232-424f-9a69-f5bf168eb946 None None] SCRIPT_NAME: `/identity` {{(pid=71939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 24 16:33:44.792596 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-989c8bcb-6232-424f-9a69-f5bf168eb946 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=71939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 24 16:33:44.817794 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.auth.core [None req-989c8bcb-6232-424f-9a69-f5bf168eb946 None None] MFA Rules not processed for user `0f2ba2e8375b4e8c8792ee1e22b60427`. Rule list: `[]` (Enabled: `True`). {{(pid=71939) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:442}} Nov 24 16:33:44.819074 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.fernet_utils [None req-989c8bcb-6232-424f-9a69-f5bf168eb946 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=71939) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:289}} Nov 24 16:33:44.827423 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: [pid: 71939|app: 0|req: 497/994] 10.222.0.53 () {58 vars in 1013 bytes} [Wed Nov 24 16:33:44 2021] POST /identity/v3/auth/tokens => generated 2973 bytes in 37 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 24 16:33:44.833831 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98865099-34df-4615-8caa-9673ce52c7aa None None] Authenticating user token {{(pid=71938) process_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 24 16:33:44.849007 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98865099-34df-4615-8caa-9673ce52c7aa None None] Validating token access rules against request {{(pid=71938) validate_allowed_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 24 16:33:44.854577 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0aa3e2d3-1ddc-4240-92ee-d677a173656a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f2ba2e8375b4e8c8792ee1e22b60427', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '00a5583c7b7443e98e7a1d31a0b638dc', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=71938) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 24 16:33:44.856083 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0aa3e2d3-1ddc-4240-92ee-d677a173656a admin admin] REQUEST_METHOD: `GET` {{(pid=71938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 24 16:33:44.856683 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0aa3e2d3-1ddc-4240-92ee-d677a173656a admin admin] SCRIPT_NAME: `/identity` {{(pid=71938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 24 16:33:44.857786 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0aa3e2d3-1ddc-4240-92ee-d677a173656a admin admin] PATH_INFO: `/v3/roles/service` {{(pid=71938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 24 16:33:44.871695 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0aa3e2d3-1ddc-4240-92ee-d677a173656a admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=71938) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:401}} Nov 24 16:33:44.879880 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: WARNING keystone.server.flask.application [None req-0aa3e2d3-1ddc-4240-92ee-d677a173656a admin admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Nov 24 16:33:44.881136 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: [pid: 71938|app: 0|req: 498/995] 10.222.0.53 () {56 vars in 1114 bytes} [Wed Nov 24 16:33:44 2021] GET /identity/v3/roles/service => generated 85 bytes in 48 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 24 16:33:44.888298 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-989c8bcb-6232-424f-9a69-f5bf168eb946 None None] Authenticating user token {{(pid=71939) process_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 24 16:33:44.898157 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-989c8bcb-6232-424f-9a69-f5bf168eb946 None None] Validating token access rules against request {{(pid=71939) validate_allowed_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 24 16:33:44.902684 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b392dc46-0999-426e-bf63-86d325502a18 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f2ba2e8375b4e8c8792ee1e22b60427', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '00a5583c7b7443e98e7a1d31a0b638dc', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=71939) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 24 16:33:44.903370 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b392dc46-0999-426e-bf63-86d325502a18 admin admin] REQUEST_METHOD: `GET` {{(pid=71939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 24 16:33:44.903711 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b392dc46-0999-426e-bf63-86d325502a18 admin admin] SCRIPT_NAME: `/identity` {{(pid=71939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 24 16:33:44.904044 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b392dc46-0999-426e-bf63-86d325502a18 admin admin] PATH_INFO: `/v3/roles` {{(pid=71939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 24 16:33:44.904872 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b392dc46-0999-426e-bf63-86d325502a18 admin admin] RBAC: Adding query filter params (name=service) {{(pid=71939) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:161}} Nov 24 16:33:44.905224 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b392dc46-0999-426e-bf63-86d325502a18 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=71939) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:442}} Nov 24 16:33:44.933830 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b392dc46-0999-426e-bf63-86d325502a18 admin admin] RBAC: Authorization granted {{(pid=71939) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 24 16:33:44.944818 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: [pid: 71939|app: 0|req: 498/996] 10.222.0.53 () {56 vars in 1115 bytes} [Wed Nov 24 16:33:44 2021] GET /identity/v3/roles?name=service => generated 326 bytes in 57 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 24 16:33:44.951525 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0aa3e2d3-1ddc-4240-92ee-d677a173656a admin admin] Authenticating user token {{(pid=71938) process_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 24 16:33:44.962297 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0aa3e2d3-1ddc-4240-92ee-d677a173656a admin admin] Validating token access rules against request {{(pid=71938) validate_allowed_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 24 16:33:44.966759 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09fd5b23-22a8-4398-bf6f-9e918a3d670d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f2ba2e8375b4e8c8792ee1e22b60427', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '00a5583c7b7443e98e7a1d31a0b638dc', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=71938) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 24 16:33:44.967588 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09fd5b23-22a8-4398-bf6f-9e918a3d670d admin admin] REQUEST_METHOD: `GET` {{(pid=71938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 24 16:33:44.967925 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09fd5b23-22a8-4398-bf6f-9e918a3d670d admin admin] SCRIPT_NAME: `/identity` {{(pid=71938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 24 16:33:44.968261 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09fd5b23-22a8-4398-bf6f-9e918a3d670d admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=71938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 24 16:33:44.981573 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09fd5b23-22a8-4398-bf6f-9e918a3d670d admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=71938) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:442}} Nov 24 16:33:45.011189 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09fd5b23-22a8-4398-bf6f-9e918a3d670d admin admin] RBAC: Authorization granted {{(pid=71938) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 24 16:33:45.033888 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: WARNING keystone.server.flask.application [None req-09fd5b23-22a8-4398-bf6f-9e918a3d670d admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Nov 24 16:33:45.035264 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: [pid: 71938|app: 0|req: 499/997] 10.222.0.53 () {56 vars in 1120 bytes} [Wed Nov 24 16:33:44 2021] GET /identity/v3/domains/Default => generated 87 bytes in 85 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Nov 24 16:33:45.041825 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b392dc46-0999-426e-bf63-86d325502a18 admin admin] Authenticating user token {{(pid=71939) process_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 24 16:33:45.052324 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b392dc46-0999-426e-bf63-86d325502a18 admin admin] Validating token access rules against request {{(pid=71939) validate_allowed_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 24 16:33:45.056864 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dffb57b-7cba-4f71-9f30-fdb8d3ce344a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f2ba2e8375b4e8c8792ee1e22b60427', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '00a5583c7b7443e98e7a1d31a0b638dc', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=71939) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 24 16:33:45.057564 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dffb57b-7cba-4f71-9f30-fdb8d3ce344a admin admin] REQUEST_METHOD: `GET` {{(pid=71939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 24 16:33:45.057902 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dffb57b-7cba-4f71-9f30-fdb8d3ce344a admin admin] SCRIPT_NAME: `/identity` {{(pid=71939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 24 16:33:45.058270 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dffb57b-7cba-4f71-9f30-fdb8d3ce344a admin admin] PATH_INFO: `/v3/domains` {{(pid=71939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 24 16:33:45.059209 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9dffb57b-7cba-4f71-9f30-fdb8d3ce344a admin admin] RBAC: Adding query filter params (name=Default) {{(pid=71939) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:161}} Nov 24 16:33:45.059562 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9dffb57b-7cba-4f71-9f30-fdb8d3ce344a admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=71939) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:442}} Nov 24 16:33:45.089317 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9dffb57b-7cba-4f71-9f30-fdb8d3ce344a admin admin] RBAC: Authorization granted {{(pid=71939) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 24 16:33:45.104585 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: [pid: 71939|app: 0|req: 499/998] 10.222.0.53 () {56 vars in 1121 bytes} [Wed Nov 24 16:33:45 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 63 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 24 16:33:45.111331 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09fd5b23-22a8-4398-bf6f-9e918a3d670d admin admin] Authenticating user token {{(pid=71938) process_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 24 16:33:45.121388 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09fd5b23-22a8-4398-bf6f-9e918a3d670d admin admin] Validating token access rules against request {{(pid=71938) validate_allowed_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 24 16:33:45.126570 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0552e5de-85f0-4fe0-ace9-bc92ecc05bb1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f2ba2e8375b4e8c8792ee1e22b60427', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '00a5583c7b7443e98e7a1d31a0b638dc', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=71938) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 24 16:33:45.127395 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0552e5de-85f0-4fe0-ace9-bc92ecc05bb1 admin admin] REQUEST_METHOD: `GET` {{(pid=71938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 24 16:33:45.127728 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0552e5de-85f0-4fe0-ace9-bc92ecc05bb1 admin admin] SCRIPT_NAME: `/identity` {{(pid=71938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 24 16:33:45.128055 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0552e5de-85f0-4fe0-ace9-bc92ecc05bb1 admin admin] PATH_INFO: `/v3/users/swift` {{(pid=71938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 24 16:33:45.142135 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0552e5de-85f0-4fe0-ace9-bc92ecc05bb1 admin admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=71938) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:442}} Nov 24 16:33:45.172507 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0552e5de-85f0-4fe0-ace9-bc92ecc05bb1 admin admin] RBAC: Authorization granted {{(pid=71938) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 24 16:33:45.197945 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: WARNING keystone.server.flask.application [None req-0552e5de-85f0-4fe0-ace9-bc92ecc05bb1 admin admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Nov 24 16:33:45.199264 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: [pid: 71938|app: 0|req: 500/999] 10.222.0.53 () {56 vars in 1108 bytes} [Wed Nov 24 16:33:45 2021] GET /identity/v3/users/swift => generated 83 bytes in 88 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 24 16:33:45.205963 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dffb57b-7cba-4f71-9f30-fdb8d3ce344a admin admin] Authenticating user token {{(pid=71939) process_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 24 16:33:45.217099 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dffb57b-7cba-4f71-9f30-fdb8d3ce344a admin admin] Validating token access rules against request {{(pid=71939) validate_allowed_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 24 16:33:45.222809 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21d78ec9-0a09-4a6e-a2c4-cf95f19ff1ec admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f2ba2e8375b4e8c8792ee1e22b60427', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '00a5583c7b7443e98e7a1d31a0b638dc', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=71939) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 24 16:33:45.223533 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21d78ec9-0a09-4a6e-a2c4-cf95f19ff1ec admin admin] REQUEST_METHOD: `GET` {{(pid=71939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 24 16:33:45.223875 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21d78ec9-0a09-4a6e-a2c4-cf95f19ff1ec admin admin] SCRIPT_NAME: `/identity` {{(pid=71939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 24 16:33:45.224212 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21d78ec9-0a09-4a6e-a2c4-cf95f19ff1ec admin admin] PATH_INFO: `/v3/users` {{(pid=71939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 24 16:33:45.225469 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21d78ec9-0a09-4a6e-a2c4-cf95f19ff1ec admin admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=71939) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:161}} Nov 24 16:33:45.225469 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21d78ec9-0a09-4a6e-a2c4-cf95f19ff1ec admin admin] RBAC: Authorizing `identity:list_users()` {{(pid=71939) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:442}} Nov 24 16:33:45.254929 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21d78ec9-0a09-4a6e-a2c4-cf95f19ff1ec admin admin] RBAC: Authorization granted {{(pid=71939) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 24 16:33:45.291928 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: [pid: 71939|app: 0|req: 500/1000] 10.222.0.53 () {56 vars in 1147 bytes} [Wed Nov 24 16:33:45 2021] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 86 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 24 16:33:45.299020 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0552e5de-85f0-4fe0-ace9-bc92ecc05bb1 admin admin] Authenticating user token {{(pid=71938) process_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 24 16:33:45.309749 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0552e5de-85f0-4fe0-ace9-bc92ecc05bb1 admin admin] Validating token access rules against request {{(pid=71938) validate_allowed_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 24 16:33:45.314461 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ac98aaa-5427-4f47-a084-b0dd51890cc5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f2ba2e8375b4e8c8792ee1e22b60427', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '00a5583c7b7443e98e7a1d31a0b638dc', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=71938) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 24 16:33:45.315143 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ac98aaa-5427-4f47-a084-b0dd51890cc5 admin admin] REQUEST_METHOD: `GET` {{(pid=71938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 24 16:33:45.315477 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ac98aaa-5427-4f47-a084-b0dd51890cc5 admin admin] SCRIPT_NAME: `/identity` {{(pid=71938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 24 16:33:45.315809 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ac98aaa-5427-4f47-a084-b0dd51890cc5 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=71938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 24 16:33:45.325627 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ac98aaa-5427-4f47-a084-b0dd51890cc5 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=71938) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:442}} Nov 24 16:33:45.356331 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ac98aaa-5427-4f47-a084-b0dd51890cc5 admin admin] RBAC: Authorization granted {{(pid=71938) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 24 16:33:45.368064 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: [pid: 71938|app: 0|req: 501/1001] 10.222.0.53 () {58 vars in 1315 bytes} [Wed Nov 24 16:33:45 2021] GET /identity/v3/auth/tokens => generated 2973 bytes in 70 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 24 16:33:45.375326 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21d78ec9-0a09-4a6e-a2c4-cf95f19ff1ec admin admin] Authenticating user token {{(pid=71939) process_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 24 16:33:45.385897 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21d78ec9-0a09-4a6e-a2c4-cf95f19ff1ec admin admin] Validating token access rules against request {{(pid=71939) validate_allowed_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 24 16:33:45.390563 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a21b9bd8-23e2-4e4f-b7cd-5f219dc3e082 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f2ba2e8375b4e8c8792ee1e22b60427', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '00a5583c7b7443e98e7a1d31a0b638dc', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=71939) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 24 16:33:45.391388 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a21b9bd8-23e2-4e4f-b7cd-5f219dc3e082 admin admin] REQUEST_METHOD: `GET` {{(pid=71939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 24 16:33:45.391729 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a21b9bd8-23e2-4e4f-b7cd-5f219dc3e082 admin admin] SCRIPT_NAME: `/identity` {{(pid=71939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 24 16:33:45.392067 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a21b9bd8-23e2-4e4f-b7cd-5f219dc3e082 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=71939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 24 16:33:45.406135 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a21b9bd8-23e2-4e4f-b7cd-5f219dc3e082 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=71939) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:442}} Nov 24 16:33:45.435365 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a21b9bd8-23e2-4e4f-b7cd-5f219dc3e082 admin admin] RBAC: Authorization granted {{(pid=71939) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 24 16:33:45.455422 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: WARNING keystone.server.flask.application [None req-a21b9bd8-23e2-4e4f-b7cd-5f219dc3e082 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Nov 24 16:33:45.456758 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: [pid: 71939|app: 0|req: 501/1002] 10.222.0.53 () {56 vars in 1120 bytes} [Wed Nov 24 16:33:45 2021] GET /identity/v3/domains/Default => generated 87 bytes in 82 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 24 16:33:45.463631 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ac98aaa-5427-4f47-a084-b0dd51890cc5 admin admin] Authenticating user token {{(pid=71938) process_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 24 16:33:45.474162 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ac98aaa-5427-4f47-a084-b0dd51890cc5 admin admin] Validating token access rules against request {{(pid=71938) validate_allowed_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 24 16:33:45.478926 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cf85a86-de36-4028-b02e-7f71e3eb939b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f2ba2e8375b4e8c8792ee1e22b60427', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '00a5583c7b7443e98e7a1d31a0b638dc', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=71938) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 24 16:33:45.479652 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cf85a86-de36-4028-b02e-7f71e3eb939b admin admin] REQUEST_METHOD: `GET` {{(pid=71938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 24 16:33:45.479986 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cf85a86-de36-4028-b02e-7f71e3eb939b admin admin] SCRIPT_NAME: `/identity` {{(pid=71938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 24 16:33:45.480314 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cf85a86-de36-4028-b02e-7f71e3eb939b admin admin] PATH_INFO: `/v3/domains` {{(pid=71938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 24 16:33:45.481100 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cf85a86-de36-4028-b02e-7f71e3eb939b admin admin] RBAC: Adding query filter params (name=Default) {{(pid=71938) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:161}} Nov 24 16:33:45.481448 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cf85a86-de36-4028-b02e-7f71e3eb939b admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=71938) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:442}} Nov 24 16:33:45.511017 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cf85a86-de36-4028-b02e-7f71e3eb939b admin admin] RBAC: Authorization granted {{(pid=71938) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 24 16:33:45.526581 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: [pid: 71938|app: 0|req: 502/1003] 10.222.0.53 () {56 vars in 1121 bytes} [Wed Nov 24 16:33:45 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 64 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 24 16:33:45.533901 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a21b9bd8-23e2-4e4f-b7cd-5f219dc3e082 admin admin] Authenticating user token {{(pid=71939) process_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 24 16:33:45.547609 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a21b9bd8-23e2-4e4f-b7cd-5f219dc3e082 admin admin] Validating token access rules against request {{(pid=71939) validate_allowed_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 24 16:33:45.552345 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c485b60e-f802-4ca4-894c-67cfbc86ffa9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f2ba2e8375b4e8c8792ee1e22b60427', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '00a5583c7b7443e98e7a1d31a0b638dc', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=71939) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 24 16:33:45.553156 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c485b60e-f802-4ca4-894c-67cfbc86ffa9 admin admin] REQUEST_METHOD: `GET` {{(pid=71939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 24 16:33:45.553503 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c485b60e-f802-4ca4-894c-67cfbc86ffa9 admin admin] SCRIPT_NAME: `/identity` {{(pid=71939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 24 16:33:45.553837 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c485b60e-f802-4ca4-894c-67cfbc86ffa9 admin admin] PATH_INFO: `/v3/projects/service` {{(pid=71939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 24 16:33:45.564387 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c485b60e-f802-4ca4-894c-67cfbc86ffa9 admin admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=71939) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:442}} Nov 24 16:33:45.594644 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c485b60e-f802-4ca4-894c-67cfbc86ffa9 admin admin] RBAC: Authorization granted {{(pid=71939) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 24 16:33:45.611384 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: WARNING keystone.server.flask.application [None req-c485b60e-f802-4ca4-894c-67cfbc86ffa9 admin admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Nov 24 16:33:45.612732 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: [pid: 71939|app: 0|req: 502/1004] 10.222.0.53 () {56 vars in 1123 bytes} [Wed Nov 24 16:33:45 2021] GET /identity/v3/projects/service => generated 88 bytes in 79 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 24 16:33:45.619549 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cf85a86-de36-4028-b02e-7f71e3eb939b admin admin] Authenticating user token {{(pid=71938) process_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 24 16:33:45.630454 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cf85a86-de36-4028-b02e-7f71e3eb939b admin admin] Validating token access rules against request {{(pid=71938) validate_allowed_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 24 16:33:45.635719 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed96d962-761f-4190-8fb8-d3d0e69c7b2b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f2ba2e8375b4e8c8792ee1e22b60427', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '00a5583c7b7443e98e7a1d31a0b638dc', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=71938) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 24 16:33:45.636419 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed96d962-761f-4190-8fb8-d3d0e69c7b2b admin admin] REQUEST_METHOD: `GET` {{(pid=71938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 24 16:33:45.636767 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed96d962-761f-4190-8fb8-d3d0e69c7b2b admin admin] SCRIPT_NAME: `/identity` {{(pid=71938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 24 16:33:45.637176 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed96d962-761f-4190-8fb8-d3d0e69c7b2b admin admin] PATH_INFO: `/v3/projects` {{(pid=71938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 24 16:33:45.638001 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed96d962-761f-4190-8fb8-d3d0e69c7b2b admin admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=71938) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:161}} Nov 24 16:33:45.638974 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed96d962-761f-4190-8fb8-d3d0e69c7b2b admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=71938) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:442}} Nov 24 16:33:45.668671 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed96d962-761f-4190-8fb8-d3d0e69c7b2b admin admin] RBAC: Authorization granted {{(pid=71938) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 24 16:33:45.685068 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: [pid: 71938|app: 0|req: 503/1005] 10.222.0.53 () {56 vars in 1160 bytes} [Wed Nov 24 16:33:45 2021] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 66 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 24 16:33:45.691958 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c485b60e-f802-4ca4-894c-67cfbc86ffa9 admin admin] Authenticating user token {{(pid=71939) process_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 24 16:33:45.702980 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c485b60e-f802-4ca4-894c-67cfbc86ffa9 admin admin] Validating token access rules against request {{(pid=71939) validate_allowed_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 24 16:33:45.708070 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98b716bb-ff95-4753-8e39-2252339d0493 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f2ba2e8375b4e8c8792ee1e22b60427', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '00a5583c7b7443e98e7a1d31a0b638dc', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=71939) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 24 16:33:45.708743 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98b716bb-ff95-4753-8e39-2252339d0493 admin admin] REQUEST_METHOD: `GET` {{(pid=71939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 24 16:33:45.709130 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98b716bb-ff95-4753-8e39-2252339d0493 admin admin] SCRIPT_NAME: `/identity` {{(pid=71939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 24 16:33:45.709464 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98b716bb-ff95-4753-8e39-2252339d0493 admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=71939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 24 16:33:45.710418 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98b716bb-ff95-4753-8e39-2252339d0493 admin admin] RBAC: Adding query filter params (role.id=2d4a51004ce34308a7a33e68bf2cfc74, scope.project.id=3b3940d4ae1c4177ae29c02377bb4b0b, user.id=1a4cec9543ba4b7da4ecb1e6e8681302) {{(pid=71939) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:161}} Nov 24 16:33:45.710781 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98b716bb-ff95-4753-8e39-2252339d0493 admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=71939) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:442}} Nov 24 16:33:45.740437 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98b716bb-ff95-4753-8e39-2252339d0493 admin admin] RBAC: Authorization granted {{(pid=71939) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 24 16:33:45.747198 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: [pid: 71939|app: 0|req: 503/1006] 10.222.0.53 () {56 vars in 1386 bytes} [Wed Nov 24 16:33:45 2021] GET /identity/v3/role_assignments?user.id=1a4cec9543ba4b7da4ecb1e6e8681302&scope.project.id=3b3940d4ae1c4177ae29c02377bb4b0b&role.id=2d4a51004ce34308a7a33e68bf2cfc74 => generated 259 bytes in 56 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 24 16:33:47.741569 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24acac7a-7101-431f-a94b-ecf97c3b9607 None None] REQUEST_METHOD: `GET` {{(pid=71938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 24 16:33:47.742149 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24acac7a-7101-431f-a94b-ecf97c3b9607 None None] SCRIPT_NAME: `/identity` {{(pid=71938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 24 16:33:47.742260 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24acac7a-7101-431f-a94b-ecf97c3b9607 None None] PATH_INFO: `/` {{(pid=71938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 24 16:33:47.744127 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: [pid: 71938|app: 0|req: 504/1007] 10.222.0.53 () {54 vars in 915 bytes} [Wed Nov 24 16:33:47 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 24 16:33:47.750457 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5919e7d-722d-412c-9062-287d04b18155 None None] REQUEST_METHOD: `POST` {{(pid=71939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 24 16:33:47.750810 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5919e7d-722d-412c-9062-287d04b18155 None None] SCRIPT_NAME: `/identity` {{(pid=71939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 24 16:33:47.751148 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5919e7d-722d-412c-9062-287d04b18155 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=71939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 24 16:33:47.775402 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.auth.core [None req-a5919e7d-722d-412c-9062-287d04b18155 None None] MFA Rules not processed for user `0f2ba2e8375b4e8c8792ee1e22b60427`. Rule list: `[]` (Enabled: `True`). {{(pid=71939) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:442}} Nov 24 16:33:47.776653 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.fernet_utils [None req-a5919e7d-722d-412c-9062-287d04b18155 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=71939) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:289}} Nov 24 16:33:47.783885 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: [pid: 71939|app: 0|req: 504/1008] 10.222.0.53 () {58 vars in 1013 bytes} [Wed Nov 24 16:33:47 2021] POST /identity/v3/auth/tokens => generated 2973 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 24 16:33:47.805835 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3f968c3-9863-4a74-8667-3b72c896b534 None None] REQUEST_METHOD: `POST` {{(pid=71938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 24 16:33:47.806210 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3f968c3-9863-4a74-8667-3b72c896b534 None None] SCRIPT_NAME: `/identity` {{(pid=71938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 24 16:33:47.806547 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3f968c3-9863-4a74-8667-3b72c896b534 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=71938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 24 16:33:47.831179 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.auth.core [None req-b3f968c3-9863-4a74-8667-3b72c896b534 None None] MFA Rules not processed for user `0f2ba2e8375b4e8c8792ee1e22b60427`. Rule list: `[]` (Enabled: `True`). {{(pid=71938) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:442}} Nov 24 16:33:47.832406 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.fernet_utils [None req-b3f968c3-9863-4a74-8667-3b72c896b534 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=71938) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:289}} Nov 24 16:33:47.839602 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: [pid: 71938|app: 0|req: 505/1009] 10.222.0.53 () {58 vars in 1013 bytes} [Wed Nov 24 16:33:47 2021] POST /identity/v3/auth/tokens => generated 2973 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 24 16:33:47.845926 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5919e7d-722d-412c-9062-287d04b18155 None None] Authenticating user token {{(pid=71939) process_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 24 16:33:47.855886 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5919e7d-722d-412c-9062-287d04b18155 None None] Validating token access rules against request {{(pid=71939) validate_allowed_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 24 16:33:47.860743 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16c4a8ed-1f9f-4de5-b075-d37889d75469 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f2ba2e8375b4e8c8792ee1e22b60427', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '00a5583c7b7443e98e7a1d31a0b638dc', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=71939) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 24 16:33:47.861560 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16c4a8ed-1f9f-4de5-b075-d37889d75469 admin admin] REQUEST_METHOD: `GET` {{(pid=71939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 24 16:33:47.861899 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16c4a8ed-1f9f-4de5-b075-d37889d75469 admin admin] SCRIPT_NAME: `/identity` {{(pid=71939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 24 16:33:47.862277 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16c4a8ed-1f9f-4de5-b075-d37889d75469 admin admin] PATH_INFO: `/v3/roles/service` {{(pid=71939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 24 16:33:47.874866 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16c4a8ed-1f9f-4de5-b075-d37889d75469 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=71939) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:401}} Nov 24 16:33:47.882315 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: WARNING keystone.server.flask.application [None req-16c4a8ed-1f9f-4de5-b075-d37889d75469 admin admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Nov 24 16:33:47.883551 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: [pid: 71939|app: 0|req: 505/1010] 10.222.0.53 () {56 vars in 1114 bytes} [Wed Nov 24 16:33:47 2021] GET /identity/v3/roles/service => generated 85 bytes in 38 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 24 16:33:47.891116 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3f968c3-9863-4a74-8667-3b72c896b534 None None] Authenticating user token {{(pid=71938) process_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 24 16:33:47.901309 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3f968c3-9863-4a74-8667-3b72c896b534 None None] Validating token access rules against request {{(pid=71938) validate_allowed_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 24 16:33:47.906430 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3e8e450-5a0f-4bb7-a7a6-a453b2d6d99e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f2ba2e8375b4e8c8792ee1e22b60427', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '00a5583c7b7443e98e7a1d31a0b638dc', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=71938) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 24 16:33:47.907100 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3e8e450-5a0f-4bb7-a7a6-a453b2d6d99e admin admin] REQUEST_METHOD: `GET` {{(pid=71938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 24 16:33:47.907437 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3e8e450-5a0f-4bb7-a7a6-a453b2d6d99e admin admin] SCRIPT_NAME: `/identity` {{(pid=71938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 24 16:33:47.907767 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3e8e450-5a0f-4bb7-a7a6-a453b2d6d99e admin admin] PATH_INFO: `/v3/roles` {{(pid=71938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 24 16:33:47.908565 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3e8e450-5a0f-4bb7-a7a6-a453b2d6d99e admin admin] RBAC: Adding query filter params (name=service) {{(pid=71938) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:161}} Nov 24 16:33:47.908912 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3e8e450-5a0f-4bb7-a7a6-a453b2d6d99e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=71938) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:442}} Nov 24 16:33:47.942495 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3e8e450-5a0f-4bb7-a7a6-a453b2d6d99e admin admin] RBAC: Authorization granted {{(pid=71938) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 24 16:33:47.953348 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: [pid: 71938|app: 0|req: 506/1011] 10.222.0.53 () {56 vars in 1115 bytes} [Wed Nov 24 16:33:47 2021] GET /identity/v3/roles?name=service => generated 326 bytes in 63 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 24 16:33:47.959791 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16c4a8ed-1f9f-4de5-b075-d37889d75469 admin admin] Authenticating user token {{(pid=71939) process_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 24 16:33:47.970400 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16c4a8ed-1f9f-4de5-b075-d37889d75469 admin admin] Validating token access rules against request {{(pid=71939) validate_allowed_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 24 16:33:47.974732 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f817be3c-4a0c-4b3c-a76a-eb315e8c34b4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f2ba2e8375b4e8c8792ee1e22b60427', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '00a5583c7b7443e98e7a1d31a0b638dc', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=71939) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 24 16:33:47.975542 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f817be3c-4a0c-4b3c-a76a-eb315e8c34b4 admin admin] REQUEST_METHOD: `GET` {{(pid=71939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 24 16:33:47.975883 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f817be3c-4a0c-4b3c-a76a-eb315e8c34b4 admin admin] SCRIPT_NAME: `/identity` {{(pid=71939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 24 16:33:47.976218 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f817be3c-4a0c-4b3c-a76a-eb315e8c34b4 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=71939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 24 16:33:47.988632 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f817be3c-4a0c-4b3c-a76a-eb315e8c34b4 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=71939) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:442}} Nov 24 16:33:48.018173 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f817be3c-4a0c-4b3c-a76a-eb315e8c34b4 admin admin] RBAC: Authorization granted {{(pid=71939) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 24 16:33:48.038637 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: WARNING keystone.server.flask.application [None req-f817be3c-4a0c-4b3c-a76a-eb315e8c34b4 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Nov 24 16:33:48.039865 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: [pid: 71939|app: 0|req: 506/1012] 10.222.0.53 () {56 vars in 1120 bytes} [Wed Nov 24 16:33:47 2021] GET /identity/v3/domains/Default => generated 87 bytes in 81 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 24 16:33:48.046784 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3e8e450-5a0f-4bb7-a7a6-a453b2d6d99e admin admin] Authenticating user token {{(pid=71938) process_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 24 16:33:48.056795 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3e8e450-5a0f-4bb7-a7a6-a453b2d6d99e admin admin] Validating token access rules against request {{(pid=71938) validate_allowed_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 24 16:33:48.061664 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad66bb70-0753-4485-b29c-b0184d69428a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f2ba2e8375b4e8c8792ee1e22b60427', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '00a5583c7b7443e98e7a1d31a0b638dc', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=71938) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 24 16:33:48.062366 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad66bb70-0753-4485-b29c-b0184d69428a admin admin] REQUEST_METHOD: `GET` {{(pid=71938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 24 16:33:48.062699 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad66bb70-0753-4485-b29c-b0184d69428a admin admin] SCRIPT_NAME: `/identity` {{(pid=71938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 24 16:33:48.063024 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad66bb70-0753-4485-b29c-b0184d69428a admin admin] PATH_INFO: `/v3/domains` {{(pid=71938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 24 16:33:48.063801 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad66bb70-0753-4485-b29c-b0184d69428a admin admin] RBAC: Adding query filter params (name=Default) {{(pid=71938) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:161}} Nov 24 16:33:48.064149 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad66bb70-0753-4485-b29c-b0184d69428a admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=71938) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:442}} Nov 24 16:33:48.092407 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad66bb70-0753-4485-b29c-b0184d69428a admin admin] RBAC: Authorization granted {{(pid=71938) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 24 16:33:48.107833 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: [pid: 71938|app: 0|req: 507/1013] 10.222.0.53 () {56 vars in 1121 bytes} [Wed Nov 24 16:33:48 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 62 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 24 16:33:48.114329 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f817be3c-4a0c-4b3c-a76a-eb315e8c34b4 admin admin] Authenticating user token {{(pid=71939) process_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 24 16:33:48.124854 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f817be3c-4a0c-4b3c-a76a-eb315e8c34b4 admin admin] Validating token access rules against request {{(pid=71939) validate_allowed_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 24 16:33:48.129493 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84a3d2f1-fd3b-487a-a7f1-659f92726067 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f2ba2e8375b4e8c8792ee1e22b60427', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '00a5583c7b7443e98e7a1d31a0b638dc', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=71939) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 24 16:33:48.130360 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84a3d2f1-fd3b-487a-a7f1-659f92726067 admin admin] REQUEST_METHOD: `GET` {{(pid=71939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 24 16:33:48.130673 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84a3d2f1-fd3b-487a-a7f1-659f92726067 admin admin] SCRIPT_NAME: `/identity` {{(pid=71939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 24 16:33:48.130998 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84a3d2f1-fd3b-487a-a7f1-659f92726067 admin admin] PATH_INFO: `/v3/users/swift` {{(pid=71939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 24 16:33:48.144403 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84a3d2f1-fd3b-487a-a7f1-659f92726067 admin admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=71939) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:442}} Nov 24 16:33:48.173295 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84a3d2f1-fd3b-487a-a7f1-659f92726067 admin admin] RBAC: Authorization granted {{(pid=71939) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 24 16:33:48.194785 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: WARNING keystone.server.flask.application [None req-84a3d2f1-fd3b-487a-a7f1-659f92726067 admin admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Nov 24 16:33:48.196134 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: [pid: 71939|app: 0|req: 507/1014] 10.222.0.53 () {56 vars in 1108 bytes} [Wed Nov 24 16:33:48 2021] GET /identity/v3/users/swift => generated 83 bytes in 82 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 24 16:33:48.202953 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad66bb70-0753-4485-b29c-b0184d69428a admin admin] Authenticating user token {{(pid=71938) process_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 24 16:33:48.213112 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad66bb70-0753-4485-b29c-b0184d69428a admin admin] Validating token access rules against request {{(pid=71938) validate_allowed_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 24 16:33:48.218095 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f005b17-55ad-4b10-ab84-241f9a83acd4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f2ba2e8375b4e8c8792ee1e22b60427', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '00a5583c7b7443e98e7a1d31a0b638dc', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=71938) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 24 16:33:48.218770 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f005b17-55ad-4b10-ab84-241f9a83acd4 admin admin] REQUEST_METHOD: `GET` {{(pid=71938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 24 16:33:48.219112 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f005b17-55ad-4b10-ab84-241f9a83acd4 admin admin] SCRIPT_NAME: `/identity` {{(pid=71938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 24 16:33:48.219451 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f005b17-55ad-4b10-ab84-241f9a83acd4 admin admin] PATH_INFO: `/v3/users` {{(pid=71938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 24 16:33:48.220367 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f005b17-55ad-4b10-ab84-241f9a83acd4 admin admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=71938) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:161}} Nov 24 16:33:48.220722 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f005b17-55ad-4b10-ab84-241f9a83acd4 admin admin] RBAC: Authorizing `identity:list_users()` {{(pid=71938) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:442}} Nov 24 16:33:48.249814 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f005b17-55ad-4b10-ab84-241f9a83acd4 admin admin] RBAC: Authorization granted {{(pid=71938) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 24 16:33:48.281980 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: [pid: 71938|app: 0|req: 508/1015] 10.222.0.53 () {56 vars in 1147 bytes} [Wed Nov 24 16:33:48 2021] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 80 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 24 16:33:48.288176 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84a3d2f1-fd3b-487a-a7f1-659f92726067 admin admin] Authenticating user token {{(pid=71939) process_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 24 16:33:48.299144 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84a3d2f1-fd3b-487a-a7f1-659f92726067 admin admin] Validating token access rules against request {{(pid=71939) validate_allowed_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 24 16:33:48.303870 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5609078-c346-4868-baa6-fe0b17c9a16e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f2ba2e8375b4e8c8792ee1e22b60427', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '00a5583c7b7443e98e7a1d31a0b638dc', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=71939) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 24 16:33:48.304721 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5609078-c346-4868-baa6-fe0b17c9a16e admin admin] REQUEST_METHOD: `GET` {{(pid=71939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 24 16:33:48.305117 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5609078-c346-4868-baa6-fe0b17c9a16e admin admin] SCRIPT_NAME: `/identity` {{(pid=71939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 24 16:33:48.305509 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5609078-c346-4868-baa6-fe0b17c9a16e admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=71939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 24 16:33:48.318720 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5609078-c346-4868-baa6-fe0b17c9a16e admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=71939) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:442}} Nov 24 16:33:48.349027 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5609078-c346-4868-baa6-fe0b17c9a16e admin admin] RBAC: Authorization granted {{(pid=71939) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 24 16:33:48.368687 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: WARNING keystone.server.flask.application [None req-d5609078-c346-4868-baa6-fe0b17c9a16e admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Nov 24 16:33:48.369917 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: [pid: 71939|app: 0|req: 508/1016] 10.222.0.53 () {56 vars in 1120 bytes} [Wed Nov 24 16:33:48 2021] GET /identity/v3/domains/Default => generated 87 bytes in 82 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 24 16:33:48.376467 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f005b17-55ad-4b10-ab84-241f9a83acd4 admin admin] Authenticating user token {{(pid=71938) process_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 24 16:33:48.386507 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f005b17-55ad-4b10-ab84-241f9a83acd4 admin admin] Validating token access rules against request {{(pid=71938) validate_allowed_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 24 16:33:48.390903 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c62f88c-a2e4-4dc8-90b2-43d277788dba admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f2ba2e8375b4e8c8792ee1e22b60427', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '00a5583c7b7443e98e7a1d31a0b638dc', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=71938) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 24 16:33:48.391567 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c62f88c-a2e4-4dc8-90b2-43d277788dba admin admin] REQUEST_METHOD: `GET` {{(pid=71938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 24 16:33:48.391904 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c62f88c-a2e4-4dc8-90b2-43d277788dba admin admin] SCRIPT_NAME: `/identity` {{(pid=71938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 24 16:33:48.392235 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c62f88c-a2e4-4dc8-90b2-43d277788dba admin admin] PATH_INFO: `/v3/domains` {{(pid=71938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 24 16:33:48.393016 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c62f88c-a2e4-4dc8-90b2-43d277788dba admin admin] RBAC: Adding query filter params (name=Default) {{(pid=71938) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:161}} Nov 24 16:33:48.393369 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c62f88c-a2e4-4dc8-90b2-43d277788dba admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=71938) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:442}} Nov 24 16:33:48.422552 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c62f88c-a2e4-4dc8-90b2-43d277788dba admin admin] RBAC: Authorization granted {{(pid=71938) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 24 16:33:48.435506 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: [pid: 71938|app: 0|req: 509/1017] 10.222.0.53 () {56 vars in 1121 bytes} [Wed Nov 24 16:33:48 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 60 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 24 16:33:48.441759 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5609078-c346-4868-baa6-fe0b17c9a16e admin admin] Authenticating user token {{(pid=71939) process_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 24 16:33:48.452043 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5609078-c346-4868-baa6-fe0b17c9a16e admin admin] Validating token access rules against request {{(pid=71939) validate_allowed_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 24 16:33:48.457265 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d11d93c5-f309-4733-8c87-f0611494950b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f2ba2e8375b4e8c8792ee1e22b60427', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '00a5583c7b7443e98e7a1d31a0b638dc', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=71939) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 24 16:33:48.458099 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d11d93c5-f309-4733-8c87-f0611494950b admin admin] REQUEST_METHOD: `GET` {{(pid=71939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 24 16:33:48.458446 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d11d93c5-f309-4733-8c87-f0611494950b admin admin] SCRIPT_NAME: `/identity` {{(pid=71939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 24 16:33:48.458783 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d11d93c5-f309-4733-8c87-f0611494950b admin admin] PATH_INFO: `/v3/projects/service` {{(pid=71939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 24 16:33:48.468830 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d11d93c5-f309-4733-8c87-f0611494950b admin admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=71939) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:442}} Nov 24 16:33:48.497759 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d11d93c5-f309-4733-8c87-f0611494950b admin admin] RBAC: Authorization granted {{(pid=71939) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 24 16:33:48.513251 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: WARNING keystone.server.flask.application [None req-d11d93c5-f309-4733-8c87-f0611494950b admin admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Nov 24 16:33:48.514496 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: [pid: 71939|app: 0|req: 509/1018] 10.222.0.53 () {56 vars in 1123 bytes} [Wed Nov 24 16:33:48 2021] GET /identity/v3/projects/service => generated 88 bytes in 73 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 24 16:33:48.521047 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c62f88c-a2e4-4dc8-90b2-43d277788dba admin admin] Authenticating user token {{(pid=71938) process_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 24 16:33:48.532954 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c62f88c-a2e4-4dc8-90b2-43d277788dba admin admin] Validating token access rules against request {{(pid=71938) validate_allowed_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 24 16:33:48.537776 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fffc0595-95e1-458e-aa4e-1b08563c2a71 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f2ba2e8375b4e8c8792ee1e22b60427', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '00a5583c7b7443e98e7a1d31a0b638dc', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=71938) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 24 16:33:48.538463 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fffc0595-95e1-458e-aa4e-1b08563c2a71 admin admin] REQUEST_METHOD: `GET` {{(pid=71938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 24 16:33:48.538795 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fffc0595-95e1-458e-aa4e-1b08563c2a71 admin admin] SCRIPT_NAME: `/identity` {{(pid=71938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 24 16:33:48.539123 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fffc0595-95e1-458e-aa4e-1b08563c2a71 admin admin] PATH_INFO: `/v3/projects` {{(pid=71938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 24 16:33:48.539963 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fffc0595-95e1-458e-aa4e-1b08563c2a71 admin admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=71938) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:161}} Nov 24 16:33:48.540314 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fffc0595-95e1-458e-aa4e-1b08563c2a71 admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=71938) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:442}} Nov 24 16:33:48.582775 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fffc0595-95e1-458e-aa4e-1b08563c2a71 admin admin] RBAC: Authorization granted {{(pid=71938) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 24 16:33:48.599388 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: [pid: 71938|app: 0|req: 510/1019] 10.222.0.53 () {56 vars in 1160 bytes} [Wed Nov 24 16:33:48 2021] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 79 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 24 16:33:48.605900 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d11d93c5-f309-4733-8c87-f0611494950b admin admin] Authenticating user token {{(pid=71939) process_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 24 16:33:48.616686 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d11d93c5-f309-4733-8c87-f0611494950b admin admin] Validating token access rules against request {{(pid=71939) validate_allowed_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 24 16:33:48.621881 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27ee2163-44bc-4846-9c04-875b31361e19 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f2ba2e8375b4e8c8792ee1e22b60427', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '00a5583c7b7443e98e7a1d31a0b638dc', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=71939) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 24 16:33:48.622836 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27ee2163-44bc-4846-9c04-875b31361e19 admin admin] REQUEST_METHOD: `PUT` {{(pid=71939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 24 16:33:48.623171 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27ee2163-44bc-4846-9c04-875b31361e19 admin admin] SCRIPT_NAME: `/identity` {{(pid=71939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 24 16:33:48.623497 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27ee2163-44bc-4846-9c04-875b31361e19 admin admin] PATH_INFO: `/v3/projects/3b3940d4ae1c4177ae29c02377bb4b0b/users/1a4cec9543ba4b7da4ecb1e6e8681302/roles/2d4a51004ce34308a7a33e68bf2cfc74` {{(pid=71939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 24 16:33:48.647497 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27ee2163-44bc-4846-9c04-875b31361e19 admin admin] RBAC: Authorizing `identity:create_grant(project_id=3b3940d4ae1c4177ae29c02377bb4b0b, user_id=1a4cec9543ba4b7da4ecb1e6e8681302, role_id=2d4a51004ce34308a7a33e68bf2cfc74)` {{(pid=71939) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:442}} Nov 24 16:33:48.680524 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27ee2163-44bc-4846-9c04-875b31361e19 admin admin] RBAC: Authorization granted {{(pid=71939) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 24 16:33:48.693701 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: [pid: 71939|app: 0|req: 510/1020] 10.222.0.53 () {58 vars in 1451 bytes} [Wed Nov 24 16:33:48 2021] PUT /identity/v3/projects/3b3940d4ae1c4177ae29c02377bb4b0b/users/1a4cec9543ba4b7da4ecb1e6e8681302/roles/2d4a51004ce34308a7a33e68bf2cfc74 => generated 0 bytes in 88 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 24 16:33:50.670344 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f138fd07-bfb6-4bf7-a8ab-391b5a8e0911 None None] REQUEST_METHOD: `GET` {{(pid=71938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 24 16:33:50.670870 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f138fd07-bfb6-4bf7-a8ab-391b5a8e0911 None None] SCRIPT_NAME: `/identity` {{(pid=71938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 24 16:33:50.670976 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f138fd07-bfb6-4bf7-a8ab-391b5a8e0911 None None] PATH_INFO: `/` {{(pid=71938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 24 16:33:50.672834 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: [pid: 71938|app: 0|req: 511/1021] 10.222.0.53 () {54 vars in 915 bytes} [Wed Nov 24 16:33:50 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 24 16:33:50.678624 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-410feca2-9d3a-434d-b808-a01e793ae148 None None] REQUEST_METHOD: `POST` {{(pid=71939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 24 16:33:50.678981 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-410feca2-9d3a-434d-b808-a01e793ae148 None None] SCRIPT_NAME: `/identity` {{(pid=71939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 24 16:33:50.679320 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-410feca2-9d3a-434d-b808-a01e793ae148 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=71939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 24 16:33:50.703239 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.auth.core [None req-410feca2-9d3a-434d-b808-a01e793ae148 None None] MFA Rules not processed for user `0f2ba2e8375b4e8c8792ee1e22b60427`. Rule list: `[]` (Enabled: `True`). {{(pid=71939) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:442}} Nov 24 16:33:50.704475 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.fernet_utils [None req-410feca2-9d3a-434d-b808-a01e793ae148 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=71939) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:289}} Nov 24 16:33:50.774786 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: [pid: 71939|app: 0|req: 511/1022] 10.222.0.53 () {58 vars in 1013 bytes} [Wed Nov 24 16:33:50 2021] POST /identity/v3/auth/tokens => generated 2973 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 24 16:33:50.798337 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5aeaf5f-58ae-4249-a1f6-b0570cde27d3 None None] REQUEST_METHOD: `POST` {{(pid=71938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 24 16:33:50.798688 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5aeaf5f-58ae-4249-a1f6-b0570cde27d3 None None] SCRIPT_NAME: `/identity` {{(pid=71938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 24 16:33:50.799027 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5aeaf5f-58ae-4249-a1f6-b0570cde27d3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=71938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 24 16:33:50.822109 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.auth.core [None req-c5aeaf5f-58ae-4249-a1f6-b0570cde27d3 None None] MFA Rules not processed for user `0f2ba2e8375b4e8c8792ee1e22b60427`. Rule list: `[]` (Enabled: `True`). {{(pid=71938) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:442}} Nov 24 16:33:50.823331 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.fernet_utils [None req-c5aeaf5f-58ae-4249-a1f6-b0570cde27d3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=71938) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:289}} Nov 24 16:33:50.831322 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: [pid: 71938|app: 0|req: 512/1023] 10.222.0.53 () {58 vars in 1013 bytes} [Wed Nov 24 16:33:50 2021] POST /identity/v3/auth/tokens => generated 2973 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 24 16:33:50.837548 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-410feca2-9d3a-434d-b808-a01e793ae148 None None] Authenticating user token {{(pid=71939) process_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 24 16:33:50.847850 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-410feca2-9d3a-434d-b808-a01e793ae148 None None] Validating token access rules against request {{(pid=71939) validate_allowed_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 24 16:33:50.852178 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdecb881-b630-4455-9e21-c1af04fa6bcc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f2ba2e8375b4e8c8792ee1e22b60427', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '00a5583c7b7443e98e7a1d31a0b638dc', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=71939) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 24 16:33:50.852992 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdecb881-b630-4455-9e21-c1af04fa6bcc admin admin] REQUEST_METHOD: `GET` {{(pid=71939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 24 16:33:50.853325 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdecb881-b630-4455-9e21-c1af04fa6bcc admin admin] SCRIPT_NAME: `/identity` {{(pid=71939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 24 16:33:50.853652 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdecb881-b630-4455-9e21-c1af04fa6bcc admin admin] PATH_INFO: `/v3/roles/service` {{(pid=71939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 24 16:33:50.865379 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdecb881-b630-4455-9e21-c1af04fa6bcc admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=71939) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:401}} Nov 24 16:33:50.872777 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: WARNING keystone.server.flask.application [None req-cdecb881-b630-4455-9e21-c1af04fa6bcc admin admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Nov 24 16:33:50.873988 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: [pid: 71939|app: 0|req: 512/1024] 10.222.0.53 () {56 vars in 1114 bytes} [Wed Nov 24 16:33:50 2021] GET /identity/v3/roles/service => generated 85 bytes in 37 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 24 16:33:50.880975 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5aeaf5f-58ae-4249-a1f6-b0570cde27d3 None None] Authenticating user token {{(pid=71938) process_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 24 16:33:50.890870 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5aeaf5f-58ae-4249-a1f6-b0570cde27d3 None None] Validating token access rules against request {{(pid=71938) validate_allowed_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 24 16:33:50.895207 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e8eb541-76b3-4778-bd28-abdbfd2ee5e8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f2ba2e8375b4e8c8792ee1e22b60427', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '00a5583c7b7443e98e7a1d31a0b638dc', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=71938) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 24 16:33:50.895879 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e8eb541-76b3-4778-bd28-abdbfd2ee5e8 admin admin] REQUEST_METHOD: `GET` {{(pid=71938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 24 16:33:50.896220 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e8eb541-76b3-4778-bd28-abdbfd2ee5e8 admin admin] SCRIPT_NAME: `/identity` {{(pid=71938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 24 16:33:50.896554 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e8eb541-76b3-4778-bd28-abdbfd2ee5e8 admin admin] PATH_INFO: `/v3/roles` {{(pid=71938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 24 16:33:50.897368 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e8eb541-76b3-4778-bd28-abdbfd2ee5e8 admin admin] RBAC: Adding query filter params (name=service) {{(pid=71938) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:161}} Nov 24 16:33:50.897722 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e8eb541-76b3-4778-bd28-abdbfd2ee5e8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=71938) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:442}} Nov 24 16:33:50.926389 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e8eb541-76b3-4778-bd28-abdbfd2ee5e8 admin admin] RBAC: Authorization granted {{(pid=71938) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 24 16:33:50.935425 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: [pid: 71938|app: 0|req: 513/1025] 10.222.0.53 () {56 vars in 1115 bytes} [Wed Nov 24 16:33:50 2021] GET /identity/v3/roles?name=service => generated 326 bytes in 55 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 24 16:33:50.941514 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdecb881-b630-4455-9e21-c1af04fa6bcc admin admin] Authenticating user token {{(pid=71939) process_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 24 16:33:50.952989 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdecb881-b630-4455-9e21-c1af04fa6bcc admin admin] Validating token access rules against request {{(pid=71939) validate_allowed_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 24 16:33:50.957347 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-357ad58f-e49c-44ce-8626-49ef9a8b3e94 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f2ba2e8375b4e8c8792ee1e22b60427', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '00a5583c7b7443e98e7a1d31a0b638dc', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=71939) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 24 16:33:50.958179 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-357ad58f-e49c-44ce-8626-49ef9a8b3e94 admin admin] REQUEST_METHOD: `GET` {{(pid=71939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 24 16:33:50.958520 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-357ad58f-e49c-44ce-8626-49ef9a8b3e94 admin admin] SCRIPT_NAME: `/identity` {{(pid=71939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 24 16:33:50.958849 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-357ad58f-e49c-44ce-8626-49ef9a8b3e94 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=71939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 24 16:33:50.976143 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-357ad58f-e49c-44ce-8626-49ef9a8b3e94 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=71939) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:442}} Nov 24 16:33:51.004165 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-357ad58f-e49c-44ce-8626-49ef9a8b3e94 admin admin] RBAC: Authorization granted {{(pid=71939) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 24 16:33:51.024144 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: WARNING keystone.server.flask.application [None req-357ad58f-e49c-44ce-8626-49ef9a8b3e94 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Nov 24 16:33:51.025366 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: [pid: 71939|app: 0|req: 513/1026] 10.222.0.53 () {56 vars in 1120 bytes} [Wed Nov 24 16:33:50 2021] GET /identity/v3/domains/Default => generated 87 bytes in 84 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 24 16:33:51.032338 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e8eb541-76b3-4778-bd28-abdbfd2ee5e8 admin admin] Authenticating user token {{(pid=71938) process_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 24 16:33:51.042468 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e8eb541-76b3-4778-bd28-abdbfd2ee5e8 admin admin] Validating token access rules against request {{(pid=71938) validate_allowed_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 24 16:33:51.046809 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f14748dc-a1ed-4831-bc78-42233d07bf28 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f2ba2e8375b4e8c8792ee1e22b60427', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '00a5583c7b7443e98e7a1d31a0b638dc', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=71938) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 24 16:33:51.047473 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f14748dc-a1ed-4831-bc78-42233d07bf28 admin admin] REQUEST_METHOD: `GET` {{(pid=71938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 24 16:33:51.047812 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f14748dc-a1ed-4831-bc78-42233d07bf28 admin admin] SCRIPT_NAME: `/identity` {{(pid=71938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 24 16:33:51.048146 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f14748dc-a1ed-4831-bc78-42233d07bf28 admin admin] PATH_INFO: `/v3/domains` {{(pid=71938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 24 16:33:51.048923 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f14748dc-a1ed-4831-bc78-42233d07bf28 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=71938) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:161}} Nov 24 16:33:51.049276 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f14748dc-a1ed-4831-bc78-42233d07bf28 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=71938) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:442}} Nov 24 16:33:51.078354 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f14748dc-a1ed-4831-bc78-42233d07bf28 admin admin] RBAC: Authorization granted {{(pid=71938) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 24 16:33:51.092693 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: [pid: 71938|app: 0|req: 514/1027] 10.222.0.53 () {56 vars in 1121 bytes} [Wed Nov 24 16:33:51 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 61 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 24 16:33:51.098949 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-357ad58f-e49c-44ce-8626-49ef9a8b3e94 admin admin] Authenticating user token {{(pid=71939) process_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 24 16:33:51.108952 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-357ad58f-e49c-44ce-8626-49ef9a8b3e94 admin admin] Validating token access rules against request {{(pid=71939) validate_allowed_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 24 16:33:51.113482 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e61b89d-85cc-407d-a27a-a07184c09e42 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f2ba2e8375b4e8c8792ee1e22b60427', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '00a5583c7b7443e98e7a1d31a0b638dc', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=71939) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 24 16:33:51.114319 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e61b89d-85cc-407d-a27a-a07184c09e42 admin admin] REQUEST_METHOD: `GET` {{(pid=71939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 24 16:33:51.114661 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e61b89d-85cc-407d-a27a-a07184c09e42 admin admin] SCRIPT_NAME: `/identity` {{(pid=71939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 24 16:33:51.114994 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e61b89d-85cc-407d-a27a-a07184c09e42 admin admin] PATH_INFO: `/v3/users/swift` {{(pid=71939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 24 16:33:51.130758 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e61b89d-85cc-407d-a27a-a07184c09e42 admin admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=71939) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:442}} Nov 24 16:33:51.160758 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e61b89d-85cc-407d-a27a-a07184c09e42 admin admin] RBAC: Authorization granted {{(pid=71939) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 24 16:33:51.181403 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: WARNING keystone.server.flask.application [None req-2e61b89d-85cc-407d-a27a-a07184c09e42 admin admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Nov 24 16:33:51.182731 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: [pid: 71939|app: 0|req: 514/1028] 10.222.0.53 () {56 vars in 1108 bytes} [Wed Nov 24 16:33:51 2021] GET /identity/v3/users/swift => generated 83 bytes in 84 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 24 16:33:51.189501 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f14748dc-a1ed-4831-bc78-42233d07bf28 admin admin] Authenticating user token {{(pid=71938) process_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 24 16:33:51.199606 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f14748dc-a1ed-4831-bc78-42233d07bf28 admin admin] Validating token access rules against request {{(pid=71938) validate_allowed_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 24 16:33:51.204881 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b92c385-7815-47ba-8853-2193be9513ec admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f2ba2e8375b4e8c8792ee1e22b60427', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '00a5583c7b7443e98e7a1d31a0b638dc', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=71938) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 24 16:33:51.205555 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b92c385-7815-47ba-8853-2193be9513ec admin admin] REQUEST_METHOD: `GET` {{(pid=71938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 24 16:33:51.205893 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b92c385-7815-47ba-8853-2193be9513ec admin admin] SCRIPT_NAME: `/identity` {{(pid=71938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 24 16:33:51.206276 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b92c385-7815-47ba-8853-2193be9513ec admin admin] PATH_INFO: `/v3/users` {{(pid=71938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 24 16:33:51.207197 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b92c385-7815-47ba-8853-2193be9513ec admin admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=71938) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:161}} Nov 24 16:33:51.207553 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b92c385-7815-47ba-8853-2193be9513ec admin admin] RBAC: Authorizing `identity:list_users()` {{(pid=71938) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:442}} Nov 24 16:33:51.236356 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b92c385-7815-47ba-8853-2193be9513ec admin admin] RBAC: Authorization granted {{(pid=71938) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 24 16:33:51.270648 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: [pid: 71938|app: 0|req: 515/1029] 10.222.0.53 () {56 vars in 1147 bytes} [Wed Nov 24 16:33:51 2021] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 82 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 24 16:33:51.276936 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e61b89d-85cc-407d-a27a-a07184c09e42 admin admin] Authenticating user token {{(pid=71939) process_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 24 16:33:51.287048 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e61b89d-85cc-407d-a27a-a07184c09e42 admin admin] Validating token access rules against request {{(pid=71939) validate_allowed_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 24 16:33:51.291380 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb00a023-33ed-4aa1-879e-649cb0c4343f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f2ba2e8375b4e8c8792ee1e22b60427', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '00a5583c7b7443e98e7a1d31a0b638dc', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=71939) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 24 16:33:51.292024 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb00a023-33ed-4aa1-879e-649cb0c4343f admin admin] REQUEST_METHOD: `GET` {{(pid=71939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 24 16:33:51.292358 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb00a023-33ed-4aa1-879e-649cb0c4343f admin admin] SCRIPT_NAME: `/identity` {{(pid=71939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 24 16:33:51.292686 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb00a023-33ed-4aa1-879e-649cb0c4343f admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=71939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 24 16:33:51.300921 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb00a023-33ed-4aa1-879e-649cb0c4343f admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=71939) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:442}} Nov 24 16:33:51.330696 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb00a023-33ed-4aa1-879e-649cb0c4343f admin admin] RBAC: Authorization granted {{(pid=71939) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 24 16:33:51.340089 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: [pid: 71939|app: 0|req: 515/1030] 10.222.0.53 () {58 vars in 1315 bytes} [Wed Nov 24 16:33:51 2021] GET /identity/v3/auth/tokens => generated 2973 bytes in 64 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 24 16:33:51.346489 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b92c385-7815-47ba-8853-2193be9513ec admin admin] Authenticating user token {{(pid=71938) process_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 24 16:33:51.356437 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b92c385-7815-47ba-8853-2193be9513ec admin admin] Validating token access rules against request {{(pid=71938) validate_allowed_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 24 16:33:51.360909 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca266c5a-75a7-4e42-9ee0-cd8176a676bd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f2ba2e8375b4e8c8792ee1e22b60427', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '00a5583c7b7443e98e7a1d31a0b638dc', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=71938) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 24 16:33:51.361714 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca266c5a-75a7-4e42-9ee0-cd8176a676bd admin admin] REQUEST_METHOD: `GET` {{(pid=71938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 24 16:33:51.362322 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca266c5a-75a7-4e42-9ee0-cd8176a676bd admin admin] SCRIPT_NAME: `/identity` {{(pid=71938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 24 16:33:51.362565 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca266c5a-75a7-4e42-9ee0-cd8176a676bd admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=71938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 24 16:33:51.377643 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca266c5a-75a7-4e42-9ee0-cd8176a676bd admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=71938) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:442}} Nov 24 16:33:51.406866 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca266c5a-75a7-4e42-9ee0-cd8176a676bd admin admin] RBAC: Authorization granted {{(pid=71938) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 24 16:33:51.425707 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: WARNING keystone.server.flask.application [None req-ca266c5a-75a7-4e42-9ee0-cd8176a676bd admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Nov 24 16:33:51.426982 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: [pid: 71938|app: 0|req: 516/1031] 10.222.0.53 () {56 vars in 1120 bytes} [Wed Nov 24 16:33:51 2021] GET /identity/v3/domains/Default => generated 87 bytes in 81 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 24 16:33:51.433325 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb00a023-33ed-4aa1-879e-649cb0c4343f admin admin] Authenticating user token {{(pid=71939) process_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 24 16:33:51.443096 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb00a023-33ed-4aa1-879e-649cb0c4343f admin admin] Validating token access rules against request {{(pid=71939) validate_allowed_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 24 16:33:51.447542 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f72c8045-0f2a-48ce-9d53-2a9b6cc8cf07 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f2ba2e8375b4e8c8792ee1e22b60427', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '00a5583c7b7443e98e7a1d31a0b638dc', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=71939) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 24 16:33:51.448206 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f72c8045-0f2a-48ce-9d53-2a9b6cc8cf07 admin admin] REQUEST_METHOD: `GET` {{(pid=71939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 24 16:33:51.448548 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f72c8045-0f2a-48ce-9d53-2a9b6cc8cf07 admin admin] SCRIPT_NAME: `/identity` {{(pid=71939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 24 16:33:51.448879 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f72c8045-0f2a-48ce-9d53-2a9b6cc8cf07 admin admin] PATH_INFO: `/v3/domains` {{(pid=71939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 24 16:33:51.449663 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f72c8045-0f2a-48ce-9d53-2a9b6cc8cf07 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=71939) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:161}} Nov 24 16:33:51.450069 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f72c8045-0f2a-48ce-9d53-2a9b6cc8cf07 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=71939) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:442}} Nov 24 16:33:51.478849 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f72c8045-0f2a-48ce-9d53-2a9b6cc8cf07 admin admin] RBAC: Authorization granted {{(pid=71939) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 24 16:33:51.492667 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: [pid: 71939|app: 0|req: 516/1032] 10.222.0.53 () {56 vars in 1121 bytes} [Wed Nov 24 16:33:51 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 60 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 24 16:33:51.499542 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca266c5a-75a7-4e42-9ee0-cd8176a676bd admin admin] Authenticating user token {{(pid=71938) process_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 24 16:33:51.509442 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca266c5a-75a7-4e42-9ee0-cd8176a676bd admin admin] Validating token access rules against request {{(pid=71938) validate_allowed_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 24 16:33:51.515059 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0c840ea-14d7-4e14-92b0-c5a6265f4f05 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f2ba2e8375b4e8c8792ee1e22b60427', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '00a5583c7b7443e98e7a1d31a0b638dc', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=71938) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 24 16:33:51.515860 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0c840ea-14d7-4e14-92b0-c5a6265f4f05 admin admin] REQUEST_METHOD: `GET` {{(pid=71938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 24 16:33:51.516193 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0c840ea-14d7-4e14-92b0-c5a6265f4f05 admin admin] SCRIPT_NAME: `/identity` {{(pid=71938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 24 16:33:51.516520 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0c840ea-14d7-4e14-92b0-c5a6265f4f05 admin admin] PATH_INFO: `/v3/projects/service` {{(pid=71938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 24 16:33:51.525776 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0c840ea-14d7-4e14-92b0-c5a6265f4f05 admin admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=71938) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:442}} Nov 24 16:33:51.554089 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0c840ea-14d7-4e14-92b0-c5a6265f4f05 admin admin] RBAC: Authorization granted {{(pid=71938) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 24 16:33:51.569800 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: WARNING keystone.server.flask.application [None req-d0c840ea-14d7-4e14-92b0-c5a6265f4f05 admin admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Nov 24 16:33:51.571032 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: [pid: 71938|app: 0|req: 517/1033] 10.222.0.53 () {56 vars in 1123 bytes} [Wed Nov 24 16:33:51 2021] GET /identity/v3/projects/service => generated 88 bytes in 72 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 24 16:33:51.579437 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f72c8045-0f2a-48ce-9d53-2a9b6cc8cf07 admin admin] Authenticating user token {{(pid=71939) process_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 24 16:33:51.589445 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f72c8045-0f2a-48ce-9d53-2a9b6cc8cf07 admin admin] Validating token access rules against request {{(pid=71939) validate_allowed_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 24 16:33:51.595099 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5745207e-8124-4e3b-ba1d-703788412821 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f2ba2e8375b4e8c8792ee1e22b60427', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '00a5583c7b7443e98e7a1d31a0b638dc', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=71939) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 24 16:33:51.595759 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5745207e-8124-4e3b-ba1d-703788412821 admin admin] REQUEST_METHOD: `GET` {{(pid=71939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 24 16:33:51.596098 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5745207e-8124-4e3b-ba1d-703788412821 admin admin] SCRIPT_NAME: `/identity` {{(pid=71939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 24 16:33:51.596437 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5745207e-8124-4e3b-ba1d-703788412821 admin admin] PATH_INFO: `/v3/projects` {{(pid=71939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 24 16:33:51.597282 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5745207e-8124-4e3b-ba1d-703788412821 admin admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=71939) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:161}} Nov 24 16:33:51.597633 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5745207e-8124-4e3b-ba1d-703788412821 admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=71939) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:442}} Nov 24 16:33:51.630493 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5745207e-8124-4e3b-ba1d-703788412821 admin admin] RBAC: Authorization granted {{(pid=71939) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 24 16:33:51.644466 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: [pid: 71939|app: 0|req: 517/1034] 10.222.0.53 () {56 vars in 1160 bytes} [Wed Nov 24 16:33:51 2021] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 66 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 24 16:33:51.651388 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0c840ea-14d7-4e14-92b0-c5a6265f4f05 admin admin] Authenticating user token {{(pid=71938) process_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 24 16:33:51.661548 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0c840ea-14d7-4e14-92b0-c5a6265f4f05 admin admin] Validating token access rules against request {{(pid=71938) validate_allowed_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 24 16:33:51.667803 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4acceb22-60d4-4366-9bc9-bf367d88cdec admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f2ba2e8375b4e8c8792ee1e22b60427', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '00a5583c7b7443e98e7a1d31a0b638dc', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=71938) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 24 16:33:51.668596 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4acceb22-60d4-4366-9bc9-bf367d88cdec admin admin] REQUEST_METHOD: `GET` {{(pid=71938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 24 16:33:51.668936 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4acceb22-60d4-4366-9bc9-bf367d88cdec admin admin] SCRIPT_NAME: `/identity` {{(pid=71938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 24 16:33:51.669763 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4acceb22-60d4-4366-9bc9-bf367d88cdec admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=71938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 24 16:33:51.670680 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4acceb22-60d4-4366-9bc9-bf367d88cdec admin admin] RBAC: Adding query filter params (role.id=2d4a51004ce34308a7a33e68bf2cfc74, scope.project.id=3b3940d4ae1c4177ae29c02377bb4b0b, user.id=1a4cec9543ba4b7da4ecb1e6e8681302) {{(pid=71938) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:161}} Nov 24 16:33:51.671126 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4acceb22-60d4-4366-9bc9-bf367d88cdec admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=71938) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:442}} Nov 24 16:33:51.703648 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4acceb22-60d4-4366-9bc9-bf367d88cdec admin admin] RBAC: Authorization granted {{(pid=71938) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 24 16:33:51.710018 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: [pid: 71938|app: 0|req: 518/1035] 10.222.0.53 () {56 vars in 1386 bytes} [Wed Nov 24 16:33:51 2021] GET /identity/v3/role_assignments?user.id=1a4cec9543ba4b7da4ecb1e6e8681302&scope.project.id=3b3940d4ae1c4177ae29c02377bb4b0b&role.id=2d4a51004ce34308a7a33e68bf2cfc74 => generated 608 bytes in 59 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 24 16:33:53.740843 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9c7501d-869c-460e-897e-02d1bef45566 None None] REQUEST_METHOD: `GET` {{(pid=71939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 24 16:33:53.741364 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9c7501d-869c-460e-897e-02d1bef45566 None None] SCRIPT_NAME: `/identity` {{(pid=71939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 24 16:33:53.741527 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9c7501d-869c-460e-897e-02d1bef45566 None None] PATH_INFO: `/` {{(pid=71939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 24 16:33:53.743442 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: [pid: 71939|app: 0|req: 518/1036] 10.222.0.53 () {54 vars in 915 bytes} [Wed Nov 24 16:33:53 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 24 16:33:53.750242 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfa80926-a7db-45ef-b4bb-217e37268c12 None None] REQUEST_METHOD: `POST` {{(pid=71938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 24 16:33:53.750594 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfa80926-a7db-45ef-b4bb-217e37268c12 None None] SCRIPT_NAME: `/identity` {{(pid=71938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 24 16:33:53.750931 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfa80926-a7db-45ef-b4bb-217e37268c12 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=71938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 24 16:33:53.775051 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.auth.core [None req-bfa80926-a7db-45ef-b4bb-217e37268c12 None None] MFA Rules not processed for user `0f2ba2e8375b4e8c8792ee1e22b60427`. Rule list: `[]` (Enabled: `True`). {{(pid=71938) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:442}} Nov 24 16:33:53.776291 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.fernet_utils [None req-bfa80926-a7db-45ef-b4bb-217e37268c12 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=71938) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:289}} Nov 24 16:33:53.783786 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: [pid: 71938|app: 0|req: 519/1037] 10.222.0.53 () {58 vars in 1013 bytes} [Wed Nov 24 16:33:53 2021] POST /identity/v3/auth/tokens => generated 2973 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 24 16:33:53.806193 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48348b37-3584-49cb-94a9-8428ddc73991 None None] REQUEST_METHOD: `POST` {{(pid=71939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 24 16:33:53.806545 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48348b37-3584-49cb-94a9-8428ddc73991 None None] SCRIPT_NAME: `/identity` {{(pid=71939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 24 16:33:53.806885 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48348b37-3584-49cb-94a9-8428ddc73991 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=71939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 24 16:33:53.831562 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.auth.core [None req-48348b37-3584-49cb-94a9-8428ddc73991 None None] MFA Rules not processed for user `0f2ba2e8375b4e8c8792ee1e22b60427`. Rule list: `[]` (Enabled: `True`). {{(pid=71939) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:442}} Nov 24 16:33:53.832823 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.fernet_utils [None req-48348b37-3584-49cb-94a9-8428ddc73991 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=71939) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:289}} Nov 24 16:33:53.840154 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: [pid: 71939|app: 0|req: 519/1038] 10.222.0.53 () {58 vars in 1013 bytes} [Wed Nov 24 16:33:53 2021] POST /identity/v3/auth/tokens => generated 2973 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 24 16:33:53.846479 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfa80926-a7db-45ef-b4bb-217e37268c12 None None] Authenticating user token {{(pid=71938) process_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 24 16:33:53.856193 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfa80926-a7db-45ef-b4bb-217e37268c12 None None] Validating token access rules against request {{(pid=71938) validate_allowed_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 24 16:33:53.861112 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b303e81-eb07-49e2-9734-332408fe8f3d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f2ba2e8375b4e8c8792ee1e22b60427', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '00a5583c7b7443e98e7a1d31a0b638dc', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=71938) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 24 16:33:53.861924 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b303e81-eb07-49e2-9734-332408fe8f3d admin admin] REQUEST_METHOD: `GET` {{(pid=71938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 24 16:33:53.862287 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b303e81-eb07-49e2-9734-332408fe8f3d admin admin] SCRIPT_NAME: `/identity` {{(pid=71938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 24 16:33:53.862620 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b303e81-eb07-49e2-9734-332408fe8f3d admin admin] PATH_INFO: `/v3/roles/admin` {{(pid=71938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 24 16:33:53.875284 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b303e81-eb07-49e2-9734-332408fe8f3d admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=71938) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:401}} Nov 24 16:33:53.882669 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: WARNING keystone.server.flask.application [None req-7b303e81-eb07-49e2-9734-332408fe8f3d admin admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Nov 24 16:33:53.883891 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: [pid: 71938|app: 0|req: 520/1039] 10.222.0.53 () {56 vars in 1108 bytes} [Wed Nov 24 16:33:53 2021] GET /identity/v3/roles/admin => generated 83 bytes in 38 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 24 16:33:53.890836 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48348b37-3584-49cb-94a9-8428ddc73991 None None] Authenticating user token {{(pid=71939) process_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 24 16:33:53.900196 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48348b37-3584-49cb-94a9-8428ddc73991 None None] Validating token access rules against request {{(pid=71939) validate_allowed_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 24 16:33:53.904634 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0be7293-f8b9-4631-a3ce-6cb75f4f3769 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f2ba2e8375b4e8c8792ee1e22b60427', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '00a5583c7b7443e98e7a1d31a0b638dc', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=71939) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 24 16:33:53.905310 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0be7293-f8b9-4631-a3ce-6cb75f4f3769 admin admin] REQUEST_METHOD: `GET` {{(pid=71939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 24 16:33:53.905653 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0be7293-f8b9-4631-a3ce-6cb75f4f3769 admin admin] SCRIPT_NAME: `/identity` {{(pid=71939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 24 16:33:53.905993 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0be7293-f8b9-4631-a3ce-6cb75f4f3769 admin admin] PATH_INFO: `/v3/roles` {{(pid=71939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 24 16:33:53.906852 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0be7293-f8b9-4631-a3ce-6cb75f4f3769 admin admin] RBAC: Adding query filter params (name=admin) {{(pid=71939) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:161}} Nov 24 16:33:53.907208 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0be7293-f8b9-4631-a3ce-6cb75f4f3769 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=71939) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:442}} Nov 24 16:33:53.936299 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0be7293-f8b9-4631-a3ce-6cb75f4f3769 admin admin] RBAC: Authorization granted {{(pid=71939) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 24 16:33:53.945881 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: [pid: 71939|app: 0|req: 520/1040] 10.222.0.53 () {56 vars in 1111 bytes} [Wed Nov 24 16:33:53 2021] GET /identity/v3/roles?name=admin => generated 339 bytes in 56 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 24 16:33:53.952282 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b303e81-eb07-49e2-9734-332408fe8f3d admin admin] Authenticating user token {{(pid=71938) process_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 24 16:33:53.962673 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b303e81-eb07-49e2-9734-332408fe8f3d admin admin] Validating token access rules against request {{(pid=71938) validate_allowed_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 24 16:33:53.966918 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07a102e6-43d4-4459-a950-61fcb0fc3a78 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f2ba2e8375b4e8c8792ee1e22b60427', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '00a5583c7b7443e98e7a1d31a0b638dc', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=71938) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 24 16:33:53.967713 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07a102e6-43d4-4459-a950-61fcb0fc3a78 admin admin] REQUEST_METHOD: `GET` {{(pid=71938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 24 16:33:53.968046 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07a102e6-43d4-4459-a950-61fcb0fc3a78 admin admin] SCRIPT_NAME: `/identity` {{(pid=71938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 24 16:33:53.968375 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07a102e6-43d4-4459-a950-61fcb0fc3a78 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=71938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 24 16:33:53.980190 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07a102e6-43d4-4459-a950-61fcb0fc3a78 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=71938) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:442}} Nov 24 16:33:54.009571 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07a102e6-43d4-4459-a950-61fcb0fc3a78 admin admin] RBAC: Authorization granted {{(pid=71938) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 24 16:33:54.029045 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: WARNING keystone.server.flask.application [None req-07a102e6-43d4-4459-a950-61fcb0fc3a78 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Nov 24 16:33:54.030286 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: [pid: 71938|app: 0|req: 521/1041] 10.222.0.53 () {56 vars in 1120 bytes} [Wed Nov 24 16:33:53 2021] GET /identity/v3/domains/Default => generated 87 bytes in 79 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 24 16:33:54.036624 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0be7293-f8b9-4631-a3ce-6cb75f4f3769 admin admin] Authenticating user token {{(pid=71939) process_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 24 16:33:54.047373 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0be7293-f8b9-4631-a3ce-6cb75f4f3769 admin admin] Validating token access rules against request {{(pid=71939) validate_allowed_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 24 16:33:54.051729 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5671c209-aff2-4fcb-abe7-c03bb58060b2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f2ba2e8375b4e8c8792ee1e22b60427', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '00a5583c7b7443e98e7a1d31a0b638dc', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=71939) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 24 16:33:54.052399 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5671c209-aff2-4fcb-abe7-c03bb58060b2 admin admin] REQUEST_METHOD: `GET` {{(pid=71939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 24 16:33:54.052741 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5671c209-aff2-4fcb-abe7-c03bb58060b2 admin admin] SCRIPT_NAME: `/identity` {{(pid=71939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 24 16:33:54.053105 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5671c209-aff2-4fcb-abe7-c03bb58060b2 admin admin] PATH_INFO: `/v3/domains` {{(pid=71939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 24 16:33:54.053890 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5671c209-aff2-4fcb-abe7-c03bb58060b2 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=71939) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:161}} Nov 24 16:33:54.054271 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5671c209-aff2-4fcb-abe7-c03bb58060b2 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=71939) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:442}} Nov 24 16:33:54.083297 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5671c209-aff2-4fcb-abe7-c03bb58060b2 admin admin] RBAC: Authorization granted {{(pid=71939) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 24 16:33:54.097238 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: [pid: 71939|app: 0|req: 521/1042] 10.222.0.53 () {56 vars in 1121 bytes} [Wed Nov 24 16:33:54 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 61 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 24 16:33:54.103396 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07a102e6-43d4-4459-a950-61fcb0fc3a78 admin admin] Authenticating user token {{(pid=71938) process_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 24 16:33:54.114949 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07a102e6-43d4-4459-a950-61fcb0fc3a78 admin admin] Validating token access rules against request {{(pid=71938) validate_allowed_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 24 16:33:54.119237 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a9dd267-df01-4d86-bce7-de9e32f95efa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f2ba2e8375b4e8c8792ee1e22b60427', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '00a5583c7b7443e98e7a1d31a0b638dc', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=71938) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 24 16:33:54.120042 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a9dd267-df01-4d86-bce7-de9e32f95efa admin admin] REQUEST_METHOD: `GET` {{(pid=71938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 24 16:33:54.120378 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a9dd267-df01-4d86-bce7-de9e32f95efa admin admin] SCRIPT_NAME: `/identity` {{(pid=71938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 24 16:33:54.120706 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a9dd267-df01-4d86-bce7-de9e32f95efa admin admin] PATH_INFO: `/v3/users/swift` {{(pid=71938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 24 16:33:54.135702 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a9dd267-df01-4d86-bce7-de9e32f95efa admin admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=71938) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:442}} Nov 24 16:33:54.167912 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a9dd267-df01-4d86-bce7-de9e32f95efa admin admin] RBAC: Authorization granted {{(pid=71938) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 24 16:33:54.190683 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: WARNING keystone.server.flask.application [None req-9a9dd267-df01-4d86-bce7-de9e32f95efa admin admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Nov 24 16:33:54.192057 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: [pid: 71938|app: 0|req: 522/1043] 10.222.0.53 () {56 vars in 1108 bytes} [Wed Nov 24 16:33:54 2021] GET /identity/v3/users/swift => generated 83 bytes in 89 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 24 16:33:54.198449 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5671c209-aff2-4fcb-abe7-c03bb58060b2 admin admin] Authenticating user token {{(pid=71939) process_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 24 16:33:54.210332 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5671c209-aff2-4fcb-abe7-c03bb58060b2 admin admin] Validating token access rules against request {{(pid=71939) validate_allowed_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 24 16:33:54.215594 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71dc5d87-98fb-41ff-a94c-9b1b3c2c1ea9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f2ba2e8375b4e8c8792ee1e22b60427', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '00a5583c7b7443e98e7a1d31a0b638dc', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=71939) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 24 16:33:54.216946 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71dc5d87-98fb-41ff-a94c-9b1b3c2c1ea9 admin admin] REQUEST_METHOD: `GET` {{(pid=71939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 24 16:33:54.217295 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71dc5d87-98fb-41ff-a94c-9b1b3c2c1ea9 admin admin] SCRIPT_NAME: `/identity` {{(pid=71939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 24 16:33:54.217636 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71dc5d87-98fb-41ff-a94c-9b1b3c2c1ea9 admin admin] PATH_INFO: `/v3/users` {{(pid=71939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 24 16:33:54.218597 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71dc5d87-98fb-41ff-a94c-9b1b3c2c1ea9 admin admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=71939) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:161}} Nov 24 16:33:54.218958 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71dc5d87-98fb-41ff-a94c-9b1b3c2c1ea9 admin admin] RBAC: Authorizing `identity:list_users()` {{(pid=71939) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:442}} Nov 24 16:33:54.248057 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71dc5d87-98fb-41ff-a94c-9b1b3c2c1ea9 admin admin] RBAC: Authorization granted {{(pid=71939) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 24 16:33:54.280258 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: [pid: 71939|app: 0|req: 522/1044] 10.222.0.53 () {56 vars in 1147 bytes} [Wed Nov 24 16:33:54 2021] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 82 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 24 16:33:54.286530 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a9dd267-df01-4d86-bce7-de9e32f95efa admin admin] Authenticating user token {{(pid=71938) process_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 24 16:33:54.297396 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a9dd267-df01-4d86-bce7-de9e32f95efa admin admin] Validating token access rules against request {{(pid=71938) validate_allowed_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 24 16:33:54.301750 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edd7e873-dfe3-4f2f-8a66-1fb31cb51b94 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f2ba2e8375b4e8c8792ee1e22b60427', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '00a5583c7b7443e98e7a1d31a0b638dc', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=71938) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 24 16:33:54.302431 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edd7e873-dfe3-4f2f-8a66-1fb31cb51b94 admin admin] REQUEST_METHOD: `GET` {{(pid=71938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 24 16:33:54.302770 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edd7e873-dfe3-4f2f-8a66-1fb31cb51b94 admin admin] SCRIPT_NAME: `/identity` {{(pid=71938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 24 16:33:54.303101 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edd7e873-dfe3-4f2f-8a66-1fb31cb51b94 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=71938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 24 16:33:54.312430 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edd7e873-dfe3-4f2f-8a66-1fb31cb51b94 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=71938) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:442}} Nov 24 16:33:54.342423 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edd7e873-dfe3-4f2f-8a66-1fb31cb51b94 admin admin] RBAC: Authorization granted {{(pid=71938) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 24 16:33:54.352123 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: [pid: 71938|app: 0|req: 523/1045] 10.222.0.53 () {58 vars in 1315 bytes} [Wed Nov 24 16:33:54 2021] GET /identity/v3/auth/tokens => generated 2973 bytes in 66 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 24 16:33:54.359189 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71dc5d87-98fb-41ff-a94c-9b1b3c2c1ea9 admin admin] Authenticating user token {{(pid=71939) process_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 24 16:33:54.369074 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71dc5d87-98fb-41ff-a94c-9b1b3c2c1ea9 admin admin] Validating token access rules against request {{(pid=71939) validate_allowed_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 24 16:33:54.373423 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-996b3c3b-c134-4171-82ef-f2a70c4bf71a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f2ba2e8375b4e8c8792ee1e22b60427', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '00a5583c7b7443e98e7a1d31a0b638dc', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=71939) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 24 16:33:54.374257 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-996b3c3b-c134-4171-82ef-f2a70c4bf71a admin admin] REQUEST_METHOD: `GET` {{(pid=71939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 24 16:33:54.374597 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-996b3c3b-c134-4171-82ef-f2a70c4bf71a admin admin] SCRIPT_NAME: `/identity` {{(pid=71939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 24 16:33:54.374930 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-996b3c3b-c134-4171-82ef-f2a70c4bf71a admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=71939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 24 16:33:54.387067 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-996b3c3b-c134-4171-82ef-f2a70c4bf71a admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=71939) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:442}} Nov 24 16:33:54.415926 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-996b3c3b-c134-4171-82ef-f2a70c4bf71a admin admin] RBAC: Authorization granted {{(pid=71939) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 24 16:33:54.435839 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: WARNING keystone.server.flask.application [None req-996b3c3b-c134-4171-82ef-f2a70c4bf71a admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Nov 24 16:33:54.437094 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: [pid: 71939|app: 0|req: 523/1046] 10.222.0.53 () {56 vars in 1120 bytes} [Wed Nov 24 16:33:54 2021] GET /identity/v3/domains/Default => generated 87 bytes in 78 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 24 16:33:54.443391 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edd7e873-dfe3-4f2f-8a66-1fb31cb51b94 admin admin] Authenticating user token {{(pid=71938) process_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 24 16:33:54.453042 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edd7e873-dfe3-4f2f-8a66-1fb31cb51b94 admin admin] Validating token access rules against request {{(pid=71938) validate_allowed_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 24 16:33:54.457743 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fa2969d-5a2f-4cf7-b1d2-53123dd97eff admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f2ba2e8375b4e8c8792ee1e22b60427', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '00a5583c7b7443e98e7a1d31a0b638dc', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=71938) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 24 16:33:54.458475 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fa2969d-5a2f-4cf7-b1d2-53123dd97eff admin admin] REQUEST_METHOD: `GET` {{(pid=71938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 24 16:33:54.458816 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fa2969d-5a2f-4cf7-b1d2-53123dd97eff admin admin] SCRIPT_NAME: `/identity` {{(pid=71938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 24 16:33:54.459150 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fa2969d-5a2f-4cf7-b1d2-53123dd97eff admin admin] PATH_INFO: `/v3/domains` {{(pid=71938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 24 16:33:54.459939 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fa2969d-5a2f-4cf7-b1d2-53123dd97eff admin admin] RBAC: Adding query filter params (name=Default) {{(pid=71938) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:161}} Nov 24 16:33:54.460295 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fa2969d-5a2f-4cf7-b1d2-53123dd97eff admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=71938) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:442}} Nov 24 16:33:54.489439 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fa2969d-5a2f-4cf7-b1d2-53123dd97eff admin admin] RBAC: Authorization granted {{(pid=71938) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 24 16:33:54.502866 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: [pid: 71938|app: 0|req: 524/1047] 10.222.0.53 () {56 vars in 1121 bytes} [Wed Nov 24 16:33:54 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 60 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 24 16:33:54.508818 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-996b3c3b-c134-4171-82ef-f2a70c4bf71a admin admin] Authenticating user token {{(pid=71939) process_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 24 16:33:54.518805 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-996b3c3b-c134-4171-82ef-f2a70c4bf71a admin admin] Validating token access rules against request {{(pid=71939) validate_allowed_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 24 16:33:54.523298 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84fcc833-c2f8-4f24-b837-d72460e4b302 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f2ba2e8375b4e8c8792ee1e22b60427', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '00a5583c7b7443e98e7a1d31a0b638dc', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=71939) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 24 16:33:54.524111 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84fcc833-c2f8-4f24-b837-d72460e4b302 admin admin] REQUEST_METHOD: `GET` {{(pid=71939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 24 16:33:54.524454 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84fcc833-c2f8-4f24-b837-d72460e4b302 admin admin] SCRIPT_NAME: `/identity` {{(pid=71939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 24 16:33:54.524791 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84fcc833-c2f8-4f24-b837-d72460e4b302 admin admin] PATH_INFO: `/v3/projects/service` {{(pid=71939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 24 16:33:54.536896 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84fcc833-c2f8-4f24-b837-d72460e4b302 admin admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=71939) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:442}} Nov 24 16:33:54.565506 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84fcc833-c2f8-4f24-b837-d72460e4b302 admin admin] RBAC: Authorization granted {{(pid=71939) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 24 16:33:54.581722 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: WARNING keystone.server.flask.application [None req-84fcc833-c2f8-4f24-b837-d72460e4b302 admin admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Nov 24 16:33:54.582967 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: [pid: 71939|app: 0|req: 524/1048] 10.222.0.53 () {56 vars in 1123 bytes} [Wed Nov 24 16:33:54 2021] GET /identity/v3/projects/service => generated 88 bytes in 75 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 24 16:33:54.589420 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fa2969d-5a2f-4cf7-b1d2-53123dd97eff admin admin] Authenticating user token {{(pid=71938) process_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 24 16:33:54.600223 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fa2969d-5a2f-4cf7-b1d2-53123dd97eff admin admin] Validating token access rules against request {{(pid=71938) validate_allowed_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 24 16:33:54.604688 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef206918-32de-40ed-91a4-afc7d2dbbb14 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f2ba2e8375b4e8c8792ee1e22b60427', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '00a5583c7b7443e98e7a1d31a0b638dc', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=71938) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 24 16:33:54.605367 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef206918-32de-40ed-91a4-afc7d2dbbb14 admin admin] REQUEST_METHOD: `GET` {{(pid=71938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 24 16:33:54.605707 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef206918-32de-40ed-91a4-afc7d2dbbb14 admin admin] SCRIPT_NAME: `/identity` {{(pid=71938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 24 16:33:54.606070 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef206918-32de-40ed-91a4-afc7d2dbbb14 admin admin] PATH_INFO: `/v3/projects` {{(pid=71938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 24 16:33:54.606936 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef206918-32de-40ed-91a4-afc7d2dbbb14 admin admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=71938) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:161}} Nov 24 16:33:54.607294 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef206918-32de-40ed-91a4-afc7d2dbbb14 admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=71938) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:442}} Nov 24 16:33:54.636021 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef206918-32de-40ed-91a4-afc7d2dbbb14 admin admin] RBAC: Authorization granted {{(pid=71938) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 24 16:33:54.651024 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: [pid: 71938|app: 0|req: 525/1049] 10.222.0.53 () {56 vars in 1160 bytes} [Wed Nov 24 16:33:54 2021] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 62 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 24 16:33:54.658502 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84fcc833-c2f8-4f24-b837-d72460e4b302 admin admin] Authenticating user token {{(pid=71939) process_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 24 16:33:54.668434 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84fcc833-c2f8-4f24-b837-d72460e4b302 admin admin] Validating token access rules against request {{(pid=71939) validate_allowed_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 24 16:33:54.673395 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cabe7c33-9114-4107-a867-2eb4f68e734a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f2ba2e8375b4e8c8792ee1e22b60427', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '00a5583c7b7443e98e7a1d31a0b638dc', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=71939) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 24 16:33:54.674073 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cabe7c33-9114-4107-a867-2eb4f68e734a admin admin] REQUEST_METHOD: `GET` {{(pid=71939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 24 16:33:54.674435 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cabe7c33-9114-4107-a867-2eb4f68e734a admin admin] SCRIPT_NAME: `/identity` {{(pid=71939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 24 16:33:54.674769 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cabe7c33-9114-4107-a867-2eb4f68e734a admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=71939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 24 16:33:54.675669 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cabe7c33-9114-4107-a867-2eb4f68e734a admin admin] RBAC: Adding query filter params (role.id=5611724e350b41e19921b5961a342582, scope.project.id=3b3940d4ae1c4177ae29c02377bb4b0b, user.id=1a4cec9543ba4b7da4ecb1e6e8681302) {{(pid=71939) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:161}} Nov 24 16:33:54.676028 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cabe7c33-9114-4107-a867-2eb4f68e734a admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=71939) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:442}} Nov 24 16:33:54.704850 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cabe7c33-9114-4107-a867-2eb4f68e734a admin admin] RBAC: Authorization granted {{(pid=71939) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 24 16:33:54.711046 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: [pid: 71939|app: 0|req: 525/1050] 10.222.0.53 () {56 vars in 1386 bytes} [Wed Nov 24 16:33:54 2021] GET /identity/v3/role_assignments?user.id=1a4cec9543ba4b7da4ecb1e6e8681302&scope.project.id=3b3940d4ae1c4177ae29c02377bb4b0b&role.id=5611724e350b41e19921b5961a342582 => generated 259 bytes in 53 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 24 16:33:56.757351 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31bdcfaf-1077-4fae-94df-c2d39e07a792 None None] REQUEST_METHOD: `GET` {{(pid=71938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 24 16:33:56.757909 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31bdcfaf-1077-4fae-94df-c2d39e07a792 None None] SCRIPT_NAME: `/identity` {{(pid=71938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 24 16:33:56.758063 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31bdcfaf-1077-4fae-94df-c2d39e07a792 None None] PATH_INFO: `/` {{(pid=71938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 24 16:33:56.759893 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: [pid: 71938|app: 0|req: 526/1051] 10.222.0.53 () {54 vars in 915 bytes} [Wed Nov 24 16:33:56 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 24 16:33:56.766141 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-967e1273-4eae-4a63-b029-efd00aeba40a None None] REQUEST_METHOD: `POST` {{(pid=71939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 24 16:33:56.766486 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-967e1273-4eae-4a63-b029-efd00aeba40a None None] SCRIPT_NAME: `/identity` {{(pid=71939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 24 16:33:56.766821 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-967e1273-4eae-4a63-b029-efd00aeba40a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=71939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 24 16:33:56.790080 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.auth.core [None req-967e1273-4eae-4a63-b029-efd00aeba40a None None] MFA Rules not processed for user `0f2ba2e8375b4e8c8792ee1e22b60427`. Rule list: `[]` (Enabled: `True`). {{(pid=71939) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:442}} Nov 24 16:33:56.791291 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.fernet_utils [None req-967e1273-4eae-4a63-b029-efd00aeba40a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=71939) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:289}} Nov 24 16:33:56.798406 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: [pid: 71939|app: 0|req: 526/1052] 10.222.0.53 () {58 vars in 1013 bytes} [Wed Nov 24 16:33:56 2021] POST /identity/v3/auth/tokens => generated 2973 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 24 16:33:56.820495 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96cd4d96-05f1-4cb9-977c-595fc24ce61f None None] REQUEST_METHOD: `POST` {{(pid=71938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 24 16:33:56.820847 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96cd4d96-05f1-4cb9-977c-595fc24ce61f None None] SCRIPT_NAME: `/identity` {{(pid=71938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 24 16:33:56.821188 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96cd4d96-05f1-4cb9-977c-595fc24ce61f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=71938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 24 16:33:56.844908 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.auth.core [None req-96cd4d96-05f1-4cb9-977c-595fc24ce61f None None] MFA Rules not processed for user `0f2ba2e8375b4e8c8792ee1e22b60427`. Rule list: `[]` (Enabled: `True`). {{(pid=71938) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:442}} Nov 24 16:33:56.846149 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.fernet_utils [None req-96cd4d96-05f1-4cb9-977c-595fc24ce61f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=71938) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:289}} Nov 24 16:33:56.853267 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: [pid: 71938|app: 0|req: 527/1053] 10.222.0.53 () {58 vars in 1013 bytes} [Wed Nov 24 16:33:56 2021] POST /identity/v3/auth/tokens => generated 2973 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 24 16:33:56.859781 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-967e1273-4eae-4a63-b029-efd00aeba40a None None] Authenticating user token {{(pid=71939) process_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 24 16:33:56.869558 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-967e1273-4eae-4a63-b029-efd00aeba40a None None] Validating token access rules against request {{(pid=71939) validate_allowed_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 24 16:33:56.874430 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a357174-e3a2-4322-949f-64431ed5310c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f2ba2e8375b4e8c8792ee1e22b60427', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '00a5583c7b7443e98e7a1d31a0b638dc', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=71939) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 24 16:33:56.875232 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a357174-e3a2-4322-949f-64431ed5310c admin admin] REQUEST_METHOD: `GET` {{(pid=71939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 24 16:33:56.875566 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a357174-e3a2-4322-949f-64431ed5310c admin admin] SCRIPT_NAME: `/identity` {{(pid=71939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 24 16:33:56.875894 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a357174-e3a2-4322-949f-64431ed5310c admin admin] PATH_INFO: `/v3/roles/admin` {{(pid=71939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 24 16:33:56.887720 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a357174-e3a2-4322-949f-64431ed5310c admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=71939) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:401}} Nov 24 16:33:56.894959 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: WARNING keystone.server.flask.application [None req-4a357174-e3a2-4322-949f-64431ed5310c admin admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Nov 24 16:33:56.896170 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: [pid: 71939|app: 0|req: 527/1054] 10.222.0.53 () {56 vars in 1108 bytes} [Wed Nov 24 16:33:56 2021] GET /identity/v3/roles/admin => generated 83 bytes in 37 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 24 16:33:56.903102 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96cd4d96-05f1-4cb9-977c-595fc24ce61f None None] Authenticating user token {{(pid=71938) process_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 24 16:33:56.912296 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96cd4d96-05f1-4cb9-977c-595fc24ce61f None None] Validating token access rules against request {{(pid=71938) validate_allowed_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 24 16:33:56.916663 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8868e62c-02b7-4481-b997-16e0f489cf18 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f2ba2e8375b4e8c8792ee1e22b60427', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '00a5583c7b7443e98e7a1d31a0b638dc', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=71938) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 24 16:33:56.917330 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8868e62c-02b7-4481-b997-16e0f489cf18 admin admin] REQUEST_METHOD: `GET` {{(pid=71938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 24 16:33:56.917667 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8868e62c-02b7-4481-b997-16e0f489cf18 admin admin] SCRIPT_NAME: `/identity` {{(pid=71938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 24 16:33:56.917996 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8868e62c-02b7-4481-b997-16e0f489cf18 admin admin] PATH_INFO: `/v3/roles` {{(pid=71938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 24 16:33:56.918849 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8868e62c-02b7-4481-b997-16e0f489cf18 admin admin] RBAC: Adding query filter params (name=admin) {{(pid=71938) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:161}} Nov 24 16:33:56.919699 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8868e62c-02b7-4481-b997-16e0f489cf18 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=71938) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:442}} Nov 24 16:33:56.948323 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8868e62c-02b7-4481-b997-16e0f489cf18 admin admin] RBAC: Authorization granted {{(pid=71938) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 24 16:33:56.957453 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: [pid: 71938|app: 0|req: 528/1055] 10.222.0.53 () {56 vars in 1111 bytes} [Wed Nov 24 16:33:56 2021] GET /identity/v3/roles?name=admin => generated 339 bytes in 55 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 24 16:33:56.963304 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a357174-e3a2-4322-949f-64431ed5310c admin admin] Authenticating user token {{(pid=71939) process_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 24 16:33:56.973660 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a357174-e3a2-4322-949f-64431ed5310c admin admin] Validating token access rules against request {{(pid=71939) validate_allowed_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 24 16:33:56.978015 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2a1cb54-5816-4ce8-aeda-a15d5d772143 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f2ba2e8375b4e8c8792ee1e22b60427', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '00a5583c7b7443e98e7a1d31a0b638dc', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=71939) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 24 16:33:56.978845 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2a1cb54-5816-4ce8-aeda-a15d5d772143 admin admin] REQUEST_METHOD: `GET` {{(pid=71939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 24 16:33:56.979185 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2a1cb54-5816-4ce8-aeda-a15d5d772143 admin admin] SCRIPT_NAME: `/identity` {{(pid=71939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 24 16:33:56.979521 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2a1cb54-5816-4ce8-aeda-a15d5d772143 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=71939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 24 16:33:56.991758 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2a1cb54-5816-4ce8-aeda-a15d5d772143 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=71939) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:442}} Nov 24 16:33:57.020368 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2a1cb54-5816-4ce8-aeda-a15d5d772143 admin admin] RBAC: Authorization granted {{(pid=71939) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 24 16:33:57.039102 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: WARNING keystone.server.flask.application [None req-c2a1cb54-5816-4ce8-aeda-a15d5d772143 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Nov 24 16:33:57.040268 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: [pid: 71939|app: 0|req: 528/1056] 10.222.0.53 () {56 vars in 1120 bytes} [Wed Nov 24 16:33:56 2021] GET /identity/v3/domains/Default => generated 87 bytes in 77 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 24 16:33:57.047019 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8868e62c-02b7-4481-b997-16e0f489cf18 admin admin] Authenticating user token {{(pid=71938) process_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 24 16:33:57.056805 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8868e62c-02b7-4481-b997-16e0f489cf18 admin admin] Validating token access rules against request {{(pid=71938) validate_allowed_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 24 16:33:57.061798 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-563dcba3-899e-42d5-8d6d-6d5fa31cb43c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f2ba2e8375b4e8c8792ee1e22b60427', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '00a5583c7b7443e98e7a1d31a0b638dc', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=71938) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 24 16:33:57.062504 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-563dcba3-899e-42d5-8d6d-6d5fa31cb43c admin admin] REQUEST_METHOD: `GET` {{(pid=71938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 24 16:33:57.062841 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-563dcba3-899e-42d5-8d6d-6d5fa31cb43c admin admin] SCRIPT_NAME: `/identity` {{(pid=71938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 24 16:33:57.063170 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-563dcba3-899e-42d5-8d6d-6d5fa31cb43c admin admin] PATH_INFO: `/v3/domains` {{(pid=71938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 24 16:33:57.063949 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-563dcba3-899e-42d5-8d6d-6d5fa31cb43c admin admin] RBAC: Adding query filter params (name=Default) {{(pid=71938) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:161}} Nov 24 16:33:57.064298 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-563dcba3-899e-42d5-8d6d-6d5fa31cb43c admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=71938) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:442}} Nov 24 16:33:57.092822 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-563dcba3-899e-42d5-8d6d-6d5fa31cb43c admin admin] RBAC: Authorization granted {{(pid=71938) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 24 16:33:57.107924 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: [pid: 71938|app: 0|req: 529/1057] 10.222.0.53 () {56 vars in 1121 bytes} [Wed Nov 24 16:33:57 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 61 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 24 16:33:57.116443 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2a1cb54-5816-4ce8-aeda-a15d5d772143 admin admin] Authenticating user token {{(pid=71939) process_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 24 16:33:57.124880 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2a1cb54-5816-4ce8-aeda-a15d5d772143 admin admin] Validating token access rules against request {{(pid=71939) validate_allowed_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 24 16:33:57.129378 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-347f5dc1-b2e9-4aff-9865-8cfa361e604d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f2ba2e8375b4e8c8792ee1e22b60427', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '00a5583c7b7443e98e7a1d31a0b638dc', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=71939) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 24 16:33:57.130232 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-347f5dc1-b2e9-4aff-9865-8cfa361e604d admin admin] REQUEST_METHOD: `GET` {{(pid=71939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 24 16:33:57.130576 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-347f5dc1-b2e9-4aff-9865-8cfa361e604d admin admin] SCRIPT_NAME: `/identity` {{(pid=71939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 24 16:33:57.130912 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-347f5dc1-b2e9-4aff-9865-8cfa361e604d admin admin] PATH_INFO: `/v3/users/swift` {{(pid=71939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 24 16:33:57.145792 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-347f5dc1-b2e9-4aff-9865-8cfa361e604d admin admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=71939) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:442}} Nov 24 16:33:57.175077 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-347f5dc1-b2e9-4aff-9865-8cfa361e604d admin admin] RBAC: Authorization granted {{(pid=71939) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 24 16:33:57.197517 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: WARNING keystone.server.flask.application [None req-347f5dc1-b2e9-4aff-9865-8cfa361e604d admin admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Nov 24 16:33:57.198812 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: [pid: 71939|app: 0|req: 529/1058] 10.222.0.53 () {56 vars in 1108 bytes} [Wed Nov 24 16:33:57 2021] GET /identity/v3/users/swift => generated 83 bytes in 85 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 24 16:33:57.210504 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-563dcba3-899e-42d5-8d6d-6d5fa31cb43c admin admin] Authenticating user token {{(pid=71938) process_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 24 16:33:57.222502 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-563dcba3-899e-42d5-8d6d-6d5fa31cb43c admin admin] Validating token access rules against request {{(pid=71938) validate_allowed_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 24 16:33:57.227444 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8f8beee-aa32-45da-abbf-19c2e1fd422f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f2ba2e8375b4e8c8792ee1e22b60427', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '00a5583c7b7443e98e7a1d31a0b638dc', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=71938) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 24 16:33:57.228119 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8f8beee-aa32-45da-abbf-19c2e1fd422f admin admin] REQUEST_METHOD: `GET` {{(pid=71938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 24 16:33:57.228457 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8f8beee-aa32-45da-abbf-19c2e1fd422f admin admin] SCRIPT_NAME: `/identity` {{(pid=71938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 24 16:33:57.228789 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8f8beee-aa32-45da-abbf-19c2e1fd422f admin admin] PATH_INFO: `/v3/users` {{(pid=71938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 24 16:33:57.229696 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8f8beee-aa32-45da-abbf-19c2e1fd422f admin admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=71938) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:161}} Nov 24 16:33:57.230073 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8f8beee-aa32-45da-abbf-19c2e1fd422f admin admin] RBAC: Authorizing `identity:list_users()` {{(pid=71938) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:442}} Nov 24 16:33:57.259305 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8f8beee-aa32-45da-abbf-19c2e1fd422f admin admin] RBAC: Authorization granted {{(pid=71938) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 24 16:33:57.295230 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: [pid: 71938|app: 0|req: 530/1059] 10.222.0.53 () {56 vars in 1147 bytes} [Wed Nov 24 16:33:57 2021] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 86 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 24 16:33:57.301536 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-347f5dc1-b2e9-4aff-9865-8cfa361e604d admin admin] Authenticating user token {{(pid=71939) process_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 24 16:33:57.314553 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-347f5dc1-b2e9-4aff-9865-8cfa361e604d admin admin] Validating token access rules against request {{(pid=71939) validate_allowed_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 24 16:33:57.318892 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26b177de-f3b4-4c5c-ad98-2cbbeffd3cdb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f2ba2e8375b4e8c8792ee1e22b60427', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '00a5583c7b7443e98e7a1d31a0b638dc', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=71939) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 24 16:33:57.319715 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26b177de-f3b4-4c5c-ad98-2cbbeffd3cdb admin admin] REQUEST_METHOD: `GET` {{(pid=71939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 24 16:33:57.320053 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26b177de-f3b4-4c5c-ad98-2cbbeffd3cdb admin admin] SCRIPT_NAME: `/identity` {{(pid=71939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 24 16:33:57.320468 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26b177de-f3b4-4c5c-ad98-2cbbeffd3cdb admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=71939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 24 16:33:57.334827 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26b177de-f3b4-4c5c-ad98-2cbbeffd3cdb admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=71939) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:442}} Nov 24 16:33:57.363133 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26b177de-f3b4-4c5c-ad98-2cbbeffd3cdb admin admin] RBAC: Authorization granted {{(pid=71939) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 24 16:33:57.382954 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: WARNING keystone.server.flask.application [None req-26b177de-f3b4-4c5c-ad98-2cbbeffd3cdb admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Nov 24 16:33:57.384227 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: [pid: 71939|app: 0|req: 530/1060] 10.222.0.53 () {56 vars in 1120 bytes} [Wed Nov 24 16:33:57 2021] GET /identity/v3/domains/Default => generated 87 bytes in 83 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 24 16:33:57.391241 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8f8beee-aa32-45da-abbf-19c2e1fd422f admin admin] Authenticating user token {{(pid=71938) process_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 24 16:33:57.401415 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8f8beee-aa32-45da-abbf-19c2e1fd422f admin admin] Validating token access rules against request {{(pid=71938) validate_allowed_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 24 16:33:57.405875 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95743265-7bbd-4ac5-9574-87323b0546ac admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f2ba2e8375b4e8c8792ee1e22b60427', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '00a5583c7b7443e98e7a1d31a0b638dc', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=71938) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 24 16:33:57.406597 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95743265-7bbd-4ac5-9574-87323b0546ac admin admin] REQUEST_METHOD: `GET` {{(pid=71938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 24 16:33:57.406942 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95743265-7bbd-4ac5-9574-87323b0546ac admin admin] SCRIPT_NAME: `/identity` {{(pid=71938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 24 16:33:57.407279 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95743265-7bbd-4ac5-9574-87323b0546ac admin admin] PATH_INFO: `/v3/domains` {{(pid=71938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 24 16:33:57.408072 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95743265-7bbd-4ac5-9574-87323b0546ac admin admin] RBAC: Adding query filter params (name=Default) {{(pid=71938) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:161}} Nov 24 16:33:57.408422 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95743265-7bbd-4ac5-9574-87323b0546ac admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=71938) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:442}} Nov 24 16:33:57.437018 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95743265-7bbd-4ac5-9574-87323b0546ac admin admin] RBAC: Authorization granted {{(pid=71938) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 24 16:33:57.450421 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: [pid: 71938|app: 0|req: 531/1061] 10.222.0.53 () {56 vars in 1121 bytes} [Wed Nov 24 16:33:57 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 60 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 24 16:33:57.457427 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26b177de-f3b4-4c5c-ad98-2cbbeffd3cdb admin admin] Authenticating user token {{(pid=71939) process_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 24 16:33:57.467673 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26b177de-f3b4-4c5c-ad98-2cbbeffd3cdb admin admin] Validating token access rules against request {{(pid=71939) validate_allowed_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 24 16:33:57.472413 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0577d527-0e8e-47d6-92a4-e7b229c0e2a0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f2ba2e8375b4e8c8792ee1e22b60427', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '00a5583c7b7443e98e7a1d31a0b638dc', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=71939) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 24 16:33:57.473229 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0577d527-0e8e-47d6-92a4-e7b229c0e2a0 admin admin] REQUEST_METHOD: `GET` {{(pid=71939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 24 16:33:57.473566 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0577d527-0e8e-47d6-92a4-e7b229c0e2a0 admin admin] SCRIPT_NAME: `/identity` {{(pid=71939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 24 16:33:57.473896 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0577d527-0e8e-47d6-92a4-e7b229c0e2a0 admin admin] PATH_INFO: `/v3/projects/service` {{(pid=71939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 24 16:33:57.483957 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0577d527-0e8e-47d6-92a4-e7b229c0e2a0 admin admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=71939) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:442}} Nov 24 16:33:57.512927 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0577d527-0e8e-47d6-92a4-e7b229c0e2a0 admin admin] RBAC: Authorization granted {{(pid=71939) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 24 16:33:57.529084 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: WARNING keystone.server.flask.application [None req-0577d527-0e8e-47d6-92a4-e7b229c0e2a0 admin admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Nov 24 16:33:57.530343 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: [pid: 71939|app: 0|req: 531/1062] 10.222.0.53 () {56 vars in 1123 bytes} [Wed Nov 24 16:33:57 2021] GET /identity/v3/projects/service => generated 88 bytes in 73 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 24 16:33:57.536808 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95743265-7bbd-4ac5-9574-87323b0546ac admin admin] Authenticating user token {{(pid=71938) process_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 24 16:33:57.547491 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95743265-7bbd-4ac5-9574-87323b0546ac admin admin] Validating token access rules against request {{(pid=71938) validate_allowed_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 24 16:33:57.551861 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ce6ae2e-5f8a-43ce-9497-f217757a2054 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f2ba2e8375b4e8c8792ee1e22b60427', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '00a5583c7b7443e98e7a1d31a0b638dc', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=71938) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 24 16:33:57.552537 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ce6ae2e-5f8a-43ce-9497-f217757a2054 admin admin] REQUEST_METHOD: `GET` {{(pid=71938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 24 16:33:57.552878 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ce6ae2e-5f8a-43ce-9497-f217757a2054 admin admin] SCRIPT_NAME: `/identity` {{(pid=71938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 24 16:33:57.553216 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ce6ae2e-5f8a-43ce-9497-f217757a2054 admin admin] PATH_INFO: `/v3/projects` {{(pid=71938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 24 16:33:57.554091 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ce6ae2e-5f8a-43ce-9497-f217757a2054 admin admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=71938) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:161}} Nov 24 16:33:57.554458 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ce6ae2e-5f8a-43ce-9497-f217757a2054 admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=71938) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:442}} Nov 24 16:33:57.584158 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ce6ae2e-5f8a-43ce-9497-f217757a2054 admin admin] RBAC: Authorization granted {{(pid=71938) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 24 16:33:57.598636 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: [pid: 71938|app: 0|req: 532/1063] 10.222.0.53 () {56 vars in 1160 bytes} [Wed Nov 24 16:33:57 2021] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 62 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 24 16:33:57.605317 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0577d527-0e8e-47d6-92a4-e7b229c0e2a0 admin admin] Authenticating user token {{(pid=71939) process_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 24 16:33:57.615789 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0577d527-0e8e-47d6-92a4-e7b229c0e2a0 admin admin] Validating token access rules against request {{(pid=71939) validate_allowed_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 24 16:33:57.621557 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18a5e7a2-ca06-43d6-86e5-9e6d7714b90e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f2ba2e8375b4e8c8792ee1e22b60427', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '00a5583c7b7443e98e7a1d31a0b638dc', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=71939) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 24 16:33:57.623114 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18a5e7a2-ca06-43d6-86e5-9e6d7714b90e admin admin] REQUEST_METHOD: `PUT` {{(pid=71939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 24 16:33:57.623449 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18a5e7a2-ca06-43d6-86e5-9e6d7714b90e admin admin] SCRIPT_NAME: `/identity` {{(pid=71939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 24 16:33:57.623777 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18a5e7a2-ca06-43d6-86e5-9e6d7714b90e admin admin] PATH_INFO: `/v3/projects/3b3940d4ae1c4177ae29c02377bb4b0b/users/1a4cec9543ba4b7da4ecb1e6e8681302/roles/5611724e350b41e19921b5961a342582` {{(pid=71939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 24 16:33:57.625709 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18a5e7a2-ca06-43d6-86e5-9e6d7714b90e admin admin] RBAC: Authorizing `identity:create_grant(project_id=3b3940d4ae1c4177ae29c02377bb4b0b, user_id=1a4cec9543ba4b7da4ecb1e6e8681302, role_id=5611724e350b41e19921b5961a342582)` {{(pid=71939) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:442}} Nov 24 16:33:57.654733 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18a5e7a2-ca06-43d6-86e5-9e6d7714b90e admin admin] RBAC: Authorization granted {{(pid=71939) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 24 16:33:57.667388 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: [pid: 71939|app: 0|req: 532/1064] 10.222.0.53 () {58 vars in 1451 bytes} [Wed Nov 24 16:33:57 2021] PUT /identity/v3/projects/3b3940d4ae1c4177ae29c02377bb4b0b/users/1a4cec9543ba4b7da4ecb1e6e8681302/roles/5611724e350b41e19921b5961a342582 => generated 0 bytes in 63 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Nov 24 16:33:59.748905 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd14a206-7178-4295-90ba-5789004c66fa None None] REQUEST_METHOD: `GET` {{(pid=71938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 24 16:33:59.749450 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd14a206-7178-4295-90ba-5789004c66fa None None] SCRIPT_NAME: `/identity` {{(pid=71938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 24 16:33:59.749541 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd14a206-7178-4295-90ba-5789004c66fa None None] PATH_INFO: `/` {{(pid=71938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 24 16:33:59.751432 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: [pid: 71938|app: 0|req: 533/1065] 10.222.0.53 () {54 vars in 915 bytes} [Wed Nov 24 16:33:59 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 24 16:33:59.756928 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5e86da6-6350-473d-93f5-2a61aec8ec4c None None] REQUEST_METHOD: `POST` {{(pid=71939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 24 16:33:59.757277 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5e86da6-6350-473d-93f5-2a61aec8ec4c None None] SCRIPT_NAME: `/identity` {{(pid=71939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 24 16:33:59.757613 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5e86da6-6350-473d-93f5-2a61aec8ec4c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=71939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 24 16:33:59.781429 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.auth.core [None req-d5e86da6-6350-473d-93f5-2a61aec8ec4c None None] MFA Rules not processed for user `0f2ba2e8375b4e8c8792ee1e22b60427`. Rule list: `[]` (Enabled: `True`). {{(pid=71939) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:442}} Nov 24 16:33:59.782650 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.fernet_utils [None req-d5e86da6-6350-473d-93f5-2a61aec8ec4c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=71939) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:289}} Nov 24 16:33:59.848273 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: [pid: 71939|app: 0|req: 533/1066] 10.222.0.53 () {58 vars in 1013 bytes} [Wed Nov 24 16:33:59 2021] POST /identity/v3/auth/tokens => generated 2973 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 24 16:33:59.870983 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f807653-c1fe-4c77-81c9-06a53a2174b2 None None] REQUEST_METHOD: `POST` {{(pid=71938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 24 16:33:59.871334 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f807653-c1fe-4c77-81c9-06a53a2174b2 None None] SCRIPT_NAME: `/identity` {{(pid=71938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 24 16:33:59.871674 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f807653-c1fe-4c77-81c9-06a53a2174b2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=71938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 24 16:33:59.894925 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.auth.core [None req-4f807653-c1fe-4c77-81c9-06a53a2174b2 None None] MFA Rules not processed for user `0f2ba2e8375b4e8c8792ee1e22b60427`. Rule list: `[]` (Enabled: `True`). {{(pid=71938) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:442}} Nov 24 16:33:59.896144 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.fernet_utils [None req-4f807653-c1fe-4c77-81c9-06a53a2174b2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=71938) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:289}} Nov 24 16:33:59.903361 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: [pid: 71938|app: 0|req: 534/1067] 10.222.0.53 () {58 vars in 1013 bytes} [Wed Nov 24 16:33:59 2021] POST /identity/v3/auth/tokens => generated 2973 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 24 16:33:59.909216 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5e86da6-6350-473d-93f5-2a61aec8ec4c None None] Authenticating user token {{(pid=71939) process_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 24 16:33:59.918664 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5e86da6-6350-473d-93f5-2a61aec8ec4c None None] Validating token access rules against request {{(pid=71939) validate_allowed_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 24 16:33:59.923454 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cc96a94-e3ff-48c7-9001-99095fcf7d0b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f2ba2e8375b4e8c8792ee1e22b60427', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '00a5583c7b7443e98e7a1d31a0b638dc', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=71939) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 24 16:33:59.924248 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cc96a94-e3ff-48c7-9001-99095fcf7d0b admin admin] REQUEST_METHOD: `GET` {{(pid=71939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 24 16:33:59.924583 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cc96a94-e3ff-48c7-9001-99095fcf7d0b admin admin] SCRIPT_NAME: `/identity` {{(pid=71939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 24 16:33:59.924910 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cc96a94-e3ff-48c7-9001-99095fcf7d0b admin admin] PATH_INFO: `/v3/roles/admin` {{(pid=71939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 24 16:33:59.937072 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cc96a94-e3ff-48c7-9001-99095fcf7d0b admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=71939) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:401}} Nov 24 16:33:59.944359 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: WARNING keystone.server.flask.application [None req-3cc96a94-e3ff-48c7-9001-99095fcf7d0b admin admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Nov 24 16:33:59.945512 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: [pid: 71939|app: 0|req: 534/1068] 10.222.0.53 () {56 vars in 1108 bytes} [Wed Nov 24 16:33:59 2021] GET /identity/v3/roles/admin => generated 83 bytes in 37 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 24 16:33:59.952180 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f807653-c1fe-4c77-81c9-06a53a2174b2 None None] Authenticating user token {{(pid=71938) process_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 24 16:33:59.961189 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f807653-c1fe-4c77-81c9-06a53a2174b2 None None] Validating token access rules against request {{(pid=71938) validate_allowed_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 24 16:33:59.965565 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a9a091a-c412-4254-9fbf-6cd167bc046f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f2ba2e8375b4e8c8792ee1e22b60427', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '00a5583c7b7443e98e7a1d31a0b638dc', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=71938) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 24 16:33:59.966252 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a9a091a-c412-4254-9fbf-6cd167bc046f admin admin] REQUEST_METHOD: `GET` {{(pid=71938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 24 16:33:59.966595 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a9a091a-c412-4254-9fbf-6cd167bc046f admin admin] SCRIPT_NAME: `/identity` {{(pid=71938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 24 16:33:59.966932 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a9a091a-c412-4254-9fbf-6cd167bc046f admin admin] PATH_INFO: `/v3/roles` {{(pid=71938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 24 16:33:59.967736 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a9a091a-c412-4254-9fbf-6cd167bc046f admin admin] RBAC: Adding query filter params (name=admin) {{(pid=71938) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:161}} Nov 24 16:33:59.968088 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a9a091a-c412-4254-9fbf-6cd167bc046f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=71938) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:442}} Nov 24 16:33:59.996400 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a9a091a-c412-4254-9fbf-6cd167bc046f admin admin] RBAC: Authorization granted {{(pid=71938) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 24 16:34:00.005962 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: [pid: 71938|app: 0|req: 535/1069] 10.222.0.53 () {56 vars in 1111 bytes} [Wed Nov 24 16:33:59 2021] GET /identity/v3/roles?name=admin => generated 339 bytes in 54 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 24 16:34:00.011706 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cc96a94-e3ff-48c7-9001-99095fcf7d0b admin admin] Authenticating user token {{(pid=71939) process_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 24 16:34:00.021729 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cc96a94-e3ff-48c7-9001-99095fcf7d0b admin admin] Validating token access rules against request {{(pid=71939) validate_allowed_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 24 16:34:00.026376 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69bdca0a-2ee8-48aa-b659-16cc78e72f7f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f2ba2e8375b4e8c8792ee1e22b60427', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '00a5583c7b7443e98e7a1d31a0b638dc', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=71939) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 24 16:34:00.027153 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69bdca0a-2ee8-48aa-b659-16cc78e72f7f admin admin] REQUEST_METHOD: `GET` {{(pid=71939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 24 16:34:00.027486 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69bdca0a-2ee8-48aa-b659-16cc78e72f7f admin admin] SCRIPT_NAME: `/identity` {{(pid=71939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 24 16:34:00.027813 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69bdca0a-2ee8-48aa-b659-16cc78e72f7f admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=71939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 24 16:34:00.039487 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69bdca0a-2ee8-48aa-b659-16cc78e72f7f admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=71939) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:442}} Nov 24 16:34:00.068969 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69bdca0a-2ee8-48aa-b659-16cc78e72f7f admin admin] RBAC: Authorization granted {{(pid=71939) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 24 16:34:00.088228 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: WARNING keystone.server.flask.application [None req-69bdca0a-2ee8-48aa-b659-16cc78e72f7f admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Nov 24 16:34:00.089379 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: [pid: 71939|app: 0|req: 535/1070] 10.222.0.53 () {56 vars in 1120 bytes} [Wed Nov 24 16:34:00 2021] GET /identity/v3/domains/Default => generated 87 bytes in 78 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 24 16:34:00.095388 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a9a091a-c412-4254-9fbf-6cd167bc046f admin admin] Authenticating user token {{(pid=71938) process_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 24 16:34:00.105645 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a9a091a-c412-4254-9fbf-6cd167bc046f admin admin] Validating token access rules against request {{(pid=71938) validate_allowed_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 24 16:34:00.110552 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f15cbdb3-7963-4990-91cb-0bf77e5e85b2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f2ba2e8375b4e8c8792ee1e22b60427', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '00a5583c7b7443e98e7a1d31a0b638dc', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=71938) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 24 16:34:00.111216 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f15cbdb3-7963-4990-91cb-0bf77e5e85b2 admin admin] REQUEST_METHOD: `GET` {{(pid=71938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 24 16:34:00.111560 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f15cbdb3-7963-4990-91cb-0bf77e5e85b2 admin admin] SCRIPT_NAME: `/identity` {{(pid=71938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 24 16:34:00.111898 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f15cbdb3-7963-4990-91cb-0bf77e5e85b2 admin admin] PATH_INFO: `/v3/domains` {{(pid=71938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 24 16:34:00.112680 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f15cbdb3-7963-4990-91cb-0bf77e5e85b2 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=71938) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:161}} Nov 24 16:34:00.113035 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f15cbdb3-7963-4990-91cb-0bf77e5e85b2 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=71938) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:442}} Nov 24 16:34:00.141397 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f15cbdb3-7963-4990-91cb-0bf77e5e85b2 admin admin] RBAC: Authorization granted {{(pid=71938) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 24 16:34:00.159544 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: [pid: 71938|app: 0|req: 536/1071] 10.222.0.53 () {56 vars in 1121 bytes} [Wed Nov 24 16:34:00 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 60 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 24 16:34:00.160682 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69bdca0a-2ee8-48aa-b659-16cc78e72f7f admin admin] Authenticating user token {{(pid=71939) process_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 24 16:34:00.171074 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69bdca0a-2ee8-48aa-b659-16cc78e72f7f admin admin] Validating token access rules against request {{(pid=71939) validate_allowed_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 24 16:34:00.175378 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe1d0ae1-0db6-4e9f-b62a-417f98d7f70b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f2ba2e8375b4e8c8792ee1e22b60427', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '00a5583c7b7443e98e7a1d31a0b638dc', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=71939) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 24 16:34:00.176174 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe1d0ae1-0db6-4e9f-b62a-417f98d7f70b admin admin] REQUEST_METHOD: `GET` {{(pid=71939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 24 16:34:00.176508 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe1d0ae1-0db6-4e9f-b62a-417f98d7f70b admin admin] SCRIPT_NAME: `/identity` {{(pid=71939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 24 16:34:00.176836 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe1d0ae1-0db6-4e9f-b62a-417f98d7f70b admin admin] PATH_INFO: `/v3/users/swift` {{(pid=71939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 24 16:34:00.193677 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe1d0ae1-0db6-4e9f-b62a-417f98d7f70b admin admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=71939) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:442}} Nov 24 16:34:00.223262 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe1d0ae1-0db6-4e9f-b62a-417f98d7f70b admin admin] RBAC: Authorization granted {{(pid=71939) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 24 16:34:00.243501 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: WARNING keystone.server.flask.application [None req-fe1d0ae1-0db6-4e9f-b62a-417f98d7f70b admin admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Nov 24 16:34:00.244686 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: [pid: 71939|app: 0|req: 536/1072] 10.222.0.53 () {56 vars in 1108 bytes} [Wed Nov 24 16:34:00 2021] GET /identity/v3/users/swift => generated 83 bytes in 84 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 24 16:34:00.251071 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f15cbdb3-7963-4990-91cb-0bf77e5e85b2 admin admin] Authenticating user token {{(pid=71938) process_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 24 16:34:00.260870 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f15cbdb3-7963-4990-91cb-0bf77e5e85b2 admin admin] Validating token access rules against request {{(pid=71938) validate_allowed_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 24 16:34:00.265132 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7eab2c7a-e47a-468a-8849-a6c4498a70c9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f2ba2e8375b4e8c8792ee1e22b60427', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '00a5583c7b7443e98e7a1d31a0b638dc', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=71938) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 24 16:34:00.265801 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7eab2c7a-e47a-468a-8849-a6c4498a70c9 admin admin] REQUEST_METHOD: `GET` {{(pid=71938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 24 16:34:00.266169 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7eab2c7a-e47a-468a-8849-a6c4498a70c9 admin admin] SCRIPT_NAME: `/identity` {{(pid=71938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 24 16:34:00.266500 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7eab2c7a-e47a-468a-8849-a6c4498a70c9 admin admin] PATH_INFO: `/v3/users` {{(pid=71938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 24 16:34:00.267389 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7eab2c7a-e47a-468a-8849-a6c4498a70c9 admin admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=71938) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:161}} Nov 24 16:34:00.267741 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7eab2c7a-e47a-468a-8849-a6c4498a70c9 admin admin] RBAC: Authorizing `identity:list_users()` {{(pid=71938) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:442}} Nov 24 16:34:00.297063 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7eab2c7a-e47a-468a-8849-a6c4498a70c9 admin admin] RBAC: Authorization granted {{(pid=71938) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 24 16:34:00.327591 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: [pid: 71938|app: 0|req: 537/1073] 10.222.0.53 () {56 vars in 1147 bytes} [Wed Nov 24 16:34:00 2021] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 77 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 24 16:34:00.333771 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe1d0ae1-0db6-4e9f-b62a-417f98d7f70b admin admin] Authenticating user token {{(pid=71939) process_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 24 16:34:00.344190 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe1d0ae1-0db6-4e9f-b62a-417f98d7f70b admin admin] Validating token access rules against request {{(pid=71939) validate_allowed_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 24 16:34:00.348553 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8793a7ef-c1e8-42af-92fb-4340f605bd17 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f2ba2e8375b4e8c8792ee1e22b60427', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '00a5583c7b7443e98e7a1d31a0b638dc', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=71939) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 24 16:34:00.349197 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8793a7ef-c1e8-42af-92fb-4340f605bd17 admin admin] REQUEST_METHOD: `GET` {{(pid=71939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 24 16:34:00.349538 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8793a7ef-c1e8-42af-92fb-4340f605bd17 admin admin] SCRIPT_NAME: `/identity` {{(pid=71939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 24 16:34:00.349872 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8793a7ef-c1e8-42af-92fb-4340f605bd17 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=71939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 24 16:34:00.358909 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8793a7ef-c1e8-42af-92fb-4340f605bd17 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=71939) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:442}} Nov 24 16:34:00.400048 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8793a7ef-c1e8-42af-92fb-4340f605bd17 admin admin] RBAC: Authorization granted {{(pid=71939) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 24 16:34:00.413666 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: [pid: 71939|app: 0|req: 537/1074] 10.222.0.53 () {58 vars in 1315 bytes} [Wed Nov 24 16:34:00 2021] GET /identity/v3/auth/tokens => generated 2973 bytes in 80 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 24 16:34:00.420753 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7eab2c7a-e47a-468a-8849-a6c4498a70c9 admin admin] Authenticating user token {{(pid=71938) process_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 24 16:34:00.430580 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7eab2c7a-e47a-468a-8849-a6c4498a70c9 admin admin] Validating token access rules against request {{(pid=71938) validate_allowed_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 24 16:34:00.434906 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b85e486-911c-4ce3-af61-1f2288e25b8d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f2ba2e8375b4e8c8792ee1e22b60427', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '00a5583c7b7443e98e7a1d31a0b638dc', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=71938) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 24 16:34:00.435702 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b85e486-911c-4ce3-af61-1f2288e25b8d admin admin] REQUEST_METHOD: `GET` {{(pid=71938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 24 16:34:00.436034 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b85e486-911c-4ce3-af61-1f2288e25b8d admin admin] SCRIPT_NAME: `/identity` {{(pid=71938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 24 16:34:00.436360 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b85e486-911c-4ce3-af61-1f2288e25b8d admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=71938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 24 16:34:00.448311 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b85e486-911c-4ce3-af61-1f2288e25b8d admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=71938) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:442}} Nov 24 16:34:00.477307 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b85e486-911c-4ce3-af61-1f2288e25b8d admin admin] RBAC: Authorization granted {{(pid=71938) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 24 16:34:00.496405 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: WARNING keystone.server.flask.application [None req-7b85e486-911c-4ce3-af61-1f2288e25b8d admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Nov 24 16:34:00.497731 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: [pid: 71938|app: 0|req: 538/1075] 10.222.0.53 () {56 vars in 1120 bytes} [Wed Nov 24 16:34:00 2021] GET /identity/v3/domains/Default => generated 87 bytes in 78 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 24 16:34:00.503858 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8793a7ef-c1e8-42af-92fb-4340f605bd17 admin admin] Authenticating user token {{(pid=71939) process_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 24 16:34:00.513159 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8793a7ef-c1e8-42af-92fb-4340f605bd17 admin admin] Validating token access rules against request {{(pid=71939) validate_allowed_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 24 16:34:00.517574 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-509c1963-1c1c-424a-b1b8-39426d090164 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f2ba2e8375b4e8c8792ee1e22b60427', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '00a5583c7b7443e98e7a1d31a0b638dc', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=71939) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 24 16:34:00.518266 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-509c1963-1c1c-424a-b1b8-39426d090164 admin admin] REQUEST_METHOD: `GET` {{(pid=71939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 24 16:34:00.518606 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-509c1963-1c1c-424a-b1b8-39426d090164 admin admin] SCRIPT_NAME: `/identity` {{(pid=71939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 24 16:34:00.518938 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-509c1963-1c1c-424a-b1b8-39426d090164 admin admin] PATH_INFO: `/v3/domains` {{(pid=71939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 24 16:34:00.519726 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-509c1963-1c1c-424a-b1b8-39426d090164 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=71939) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:161}} Nov 24 16:34:00.520079 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-509c1963-1c1c-424a-b1b8-39426d090164 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=71939) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:442}} Nov 24 16:34:00.548933 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-509c1963-1c1c-424a-b1b8-39426d090164 admin admin] RBAC: Authorization granted {{(pid=71939) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 24 16:34:00.562531 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: [pid: 71939|app: 0|req: 538/1076] 10.222.0.53 () {56 vars in 1121 bytes} [Wed Nov 24 16:34:00 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 59 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 24 16:34:00.568593 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b85e486-911c-4ce3-af61-1f2288e25b8d admin admin] Authenticating user token {{(pid=71938) process_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 24 16:34:00.579367 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b85e486-911c-4ce3-af61-1f2288e25b8d admin admin] Validating token access rules against request {{(pid=71938) validate_allowed_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 24 16:34:00.583873 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c88b88dc-b71e-4a71-bc5f-1c617fa64612 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f2ba2e8375b4e8c8792ee1e22b60427', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '00a5583c7b7443e98e7a1d31a0b638dc', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=71938) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 24 16:34:00.584698 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c88b88dc-b71e-4a71-bc5f-1c617fa64612 admin admin] REQUEST_METHOD: `GET` {{(pid=71938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 24 16:34:00.585027 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c88b88dc-b71e-4a71-bc5f-1c617fa64612 admin admin] SCRIPT_NAME: `/identity` {{(pid=71938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 24 16:34:00.585355 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c88b88dc-b71e-4a71-bc5f-1c617fa64612 admin admin] PATH_INFO: `/v3/projects/service` {{(pid=71938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 24 16:34:00.595353 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c88b88dc-b71e-4a71-bc5f-1c617fa64612 admin admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=71938) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:442}} Nov 24 16:34:00.626938 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c88b88dc-b71e-4a71-bc5f-1c617fa64612 admin admin] RBAC: Authorization granted {{(pid=71938) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 24 16:34:00.642004 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: WARNING keystone.server.flask.application [None req-c88b88dc-b71e-4a71-bc5f-1c617fa64612 admin admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Nov 24 16:34:00.643213 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: [pid: 71938|app: 0|req: 539/1077] 10.222.0.53 () {56 vars in 1123 bytes} [Wed Nov 24 16:34:00 2021] GET /identity/v3/projects/service => generated 88 bytes in 75 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 24 16:34:00.649757 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-509c1963-1c1c-424a-b1b8-39426d090164 admin admin] Authenticating user token {{(pid=71939) process_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 24 16:34:00.661893 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-509c1963-1c1c-424a-b1b8-39426d090164 admin admin] Validating token access rules against request {{(pid=71939) validate_allowed_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 24 16:34:00.666385 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d09c26e-0cda-44ba-b1c7-c3a431eecda5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f2ba2e8375b4e8c8792ee1e22b60427', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '00a5583c7b7443e98e7a1d31a0b638dc', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=71939) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 24 16:34:00.667048 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d09c26e-0cda-44ba-b1c7-c3a431eecda5 admin admin] REQUEST_METHOD: `GET` {{(pid=71939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 24 16:34:00.667384 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d09c26e-0cda-44ba-b1c7-c3a431eecda5 admin admin] SCRIPT_NAME: `/identity` {{(pid=71939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 24 16:34:00.667718 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d09c26e-0cda-44ba-b1c7-c3a431eecda5 admin admin] PATH_INFO: `/v3/projects` {{(pid=71939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 24 16:34:00.668563 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d09c26e-0cda-44ba-b1c7-c3a431eecda5 admin admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=71939) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:161}} Nov 24 16:34:00.668917 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d09c26e-0cda-44ba-b1c7-c3a431eecda5 admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=71939) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:442}} Nov 24 16:34:00.698588 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d09c26e-0cda-44ba-b1c7-c3a431eecda5 admin admin] RBAC: Authorization granted {{(pid=71939) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 24 16:34:00.712579 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: [pid: 71939|app: 0|req: 539/1078] 10.222.0.53 () {56 vars in 1160 bytes} [Wed Nov 24 16:34:00 2021] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 64 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 24 16:34:00.719055 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c88b88dc-b71e-4a71-bc5f-1c617fa64612 admin admin] Authenticating user token {{(pid=71938) process_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 24 16:34:00.729162 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c88b88dc-b71e-4a71-bc5f-1c617fa64612 admin admin] Validating token access rules against request {{(pid=71938) validate_allowed_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 24 16:34:00.734136 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ae5b184-cfe3-463b-bc67-6b2c25001cbb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f2ba2e8375b4e8c8792ee1e22b60427', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '00a5583c7b7443e98e7a1d31a0b638dc', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=71938) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 24 16:34:00.734811 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ae5b184-cfe3-463b-bc67-6b2c25001cbb admin admin] REQUEST_METHOD: `GET` {{(pid=71938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 24 16:34:00.735885 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ae5b184-cfe3-463b-bc67-6b2c25001cbb admin admin] SCRIPT_NAME: `/identity` {{(pid=71938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 24 16:34:00.735885 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ae5b184-cfe3-463b-bc67-6b2c25001cbb admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=71938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 24 16:34:00.736950 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ae5b184-cfe3-463b-bc67-6b2c25001cbb admin admin] RBAC: Adding query filter params (role.id=5611724e350b41e19921b5961a342582, scope.project.id=3b3940d4ae1c4177ae29c02377bb4b0b, user.id=1a4cec9543ba4b7da4ecb1e6e8681302) {{(pid=71938) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:161}} Nov 24 16:34:00.736950 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ae5b184-cfe3-463b-bc67-6b2c25001cbb admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=71938) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:442}} Nov 24 16:34:00.772111 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ae5b184-cfe3-463b-bc67-6b2c25001cbb admin admin] RBAC: Authorization granted {{(pid=71938) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 24 16:34:00.780390 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: [pid: 71938|app: 0|req: 540/1079] 10.222.0.53 () {56 vars in 1386 bytes} [Wed Nov 24 16:34:00 2021] GET /identity/v3/role_assignments?user.id=1a4cec9543ba4b7da4ecb1e6e8681302&scope.project.id=3b3940d4ae1c4177ae29c02377bb4b0b&role.id=5611724e350b41e19921b5961a342582 => generated 608 bytes in 62 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 24 16:34:02.820021 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6788cd1-98bd-4fcb-97e9-7d1a6daaf2d2 None None] REQUEST_METHOD: `GET` {{(pid=71939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 24 16:34:02.820536 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6788cd1-98bd-4fcb-97e9-7d1a6daaf2d2 None None] SCRIPT_NAME: `/identity` {{(pid=71939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 24 16:34:02.820658 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6788cd1-98bd-4fcb-97e9-7d1a6daaf2d2 None None] PATH_INFO: `/` {{(pid=71939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 24 16:34:02.822536 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: [pid: 71939|app: 0|req: 540/1080] 10.222.0.53 () {54 vars in 915 bytes} [Wed Nov 24 16:34:02 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 24 16:34:02.829101 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6aff023b-5793-43de-ba5f-cf0cee20fe24 None None] REQUEST_METHOD: `POST` {{(pid=71938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 24 16:34:02.829458 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6aff023b-5793-43de-ba5f-cf0cee20fe24 None None] SCRIPT_NAME: `/identity` {{(pid=71938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 24 16:34:02.829799 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6aff023b-5793-43de-ba5f-cf0cee20fe24 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=71938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 24 16:34:02.853300 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.auth.core [None req-6aff023b-5793-43de-ba5f-cf0cee20fe24 None None] MFA Rules not processed for user `0f2ba2e8375b4e8c8792ee1e22b60427`. Rule list: `[]` (Enabled: `True`). {{(pid=71938) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:442}} Nov 24 16:34:02.854566 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.fernet_utils [None req-6aff023b-5793-43de-ba5f-cf0cee20fe24 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=71938) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:289}} Nov 24 16:34:02.862319 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: [pid: 71938|app: 0|req: 541/1081] 10.222.0.53 () {58 vars in 1013 bytes} [Wed Nov 24 16:34:02 2021] POST /identity/v3/auth/tokens => generated 2973 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 24 16:34:02.884354 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ca44194-a23e-4a10-9c6e-cd2d73628472 None None] REQUEST_METHOD: `POST` {{(pid=71939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 24 16:34:02.884700 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ca44194-a23e-4a10-9c6e-cd2d73628472 None None] SCRIPT_NAME: `/identity` {{(pid=71939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 24 16:34:02.885040 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ca44194-a23e-4a10-9c6e-cd2d73628472 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=71939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 24 16:34:02.907843 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.auth.core [None req-0ca44194-a23e-4a10-9c6e-cd2d73628472 None None] MFA Rules not processed for user `0f2ba2e8375b4e8c8792ee1e22b60427`. Rule list: `[]` (Enabled: `True`). {{(pid=71939) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:442}} Nov 24 16:34:02.909055 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.fernet_utils [None req-0ca44194-a23e-4a10-9c6e-cd2d73628472 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=71939) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:289}} Nov 24 16:34:02.916437 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: [pid: 71939|app: 0|req: 541/1082] 10.222.0.53 () {58 vars in 1013 bytes} [Wed Nov 24 16:34:02 2021] POST /identity/v3/auth/tokens => generated 2973 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 24 16:34:02.923031 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6aff023b-5793-43de-ba5f-cf0cee20fe24 None None] Authenticating user token {{(pid=71938) process_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 24 16:34:02.932639 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6aff023b-5793-43de-ba5f-cf0cee20fe24 None None] Validating token access rules against request {{(pid=71938) validate_allowed_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 24 16:34:02.937542 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12abba76-93fd-4e5d-bf92-b61f16cabcdb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f2ba2e8375b4e8c8792ee1e22b60427', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '00a5583c7b7443e98e7a1d31a0b638dc', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=71938) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 24 16:34:02.938411 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12abba76-93fd-4e5d-bf92-b61f16cabcdb admin admin] REQUEST_METHOD: `GET` {{(pid=71938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 24 16:34:02.938749 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12abba76-93fd-4e5d-bf92-b61f16cabcdb admin admin] SCRIPT_NAME: `/identity` {{(pid=71938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 24 16:34:02.939075 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12abba76-93fd-4e5d-bf92-b61f16cabcdb admin admin] PATH_INFO: `/v3/services/object-store` {{(pid=71938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 24 16:34:02.939779 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12abba76-93fd-4e5d-bf92-b61f16cabcdb admin admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=71938) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:442}} Nov 24 16:34:02.968228 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12abba76-93fd-4e5d-bf92-b61f16cabcdb admin admin] RBAC: Authorization granted {{(pid=71938) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 24 16:34:02.979988 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: WARNING keystone.server.flask.application [None req-12abba76-93fd-4e5d-bf92-b61f16cabcdb admin admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. Nov 24 16:34:02.981183 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: [pid: 71938|app: 0|req: 542/1083] 10.222.0.53 () {56 vars in 1138 bytes} [Wed Nov 24 16:34:02 2021] GET /identity/v3/services/object-store => generated 93 bytes in 59 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 24 16:34:02.988600 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ca44194-a23e-4a10-9c6e-cd2d73628472 None None] Authenticating user token {{(pid=71939) process_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 24 16:34:02.998569 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ca44194-a23e-4a10-9c6e-cd2d73628472 None None] Validating token access rules against request {{(pid=71939) validate_allowed_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 24 16:34:03.003040 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05d69ce2-737a-4fb0-b79f-1a7667e780cc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f2ba2e8375b4e8c8792ee1e22b60427', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '00a5583c7b7443e98e7a1d31a0b638dc', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=71939) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 24 16:34:03.003714 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05d69ce2-737a-4fb0-b79f-1a7667e780cc admin admin] REQUEST_METHOD: `GET` {{(pid=71939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 24 16:34:03.004055 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05d69ce2-737a-4fb0-b79f-1a7667e780cc admin admin] SCRIPT_NAME: `/identity` {{(pid=71939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 24 16:34:03.004391 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05d69ce2-737a-4fb0-b79f-1a7667e780cc admin admin] PATH_INFO: `/v3/services` {{(pid=71939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 24 16:34:03.005163 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05d69ce2-737a-4fb0-b79f-1a7667e780cc admin admin] RBAC: Adding query filter params (name=object-store) {{(pid=71939) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:161}} Nov 24 16:34:03.005518 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05d69ce2-737a-4fb0-b79f-1a7667e780cc admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=71939) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:442}} Nov 24 16:34:03.033257 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05d69ce2-737a-4fb0-b79f-1a7667e780cc admin admin] RBAC: Authorization granted {{(pid=71939) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 24 16:34:03.038621 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: [pid: 71939|app: 0|req: 542/1084] 10.222.0.53 () {56 vars in 1134 bytes} [Wed Nov 24 16:34:02 2021] GET /identity/v3/services?name=object-store => generated 129 bytes in 51 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 24 16:34:03.045175 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12abba76-93fd-4e5d-bf92-b61f16cabcdb admin admin] Authenticating user token {{(pid=71938) process_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 24 16:34:03.055051 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12abba76-93fd-4e5d-bf92-b61f16cabcdb admin admin] Validating token access rules against request {{(pid=71938) validate_allowed_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 24 16:34:03.060268 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea93287e-3ab9-4f9d-bdcc-fa5206f0b86d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f2ba2e8375b4e8c8792ee1e22b60427', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '00a5583c7b7443e98e7a1d31a0b638dc', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=71938) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 24 16:34:03.060944 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea93287e-3ab9-4f9d-bdcc-fa5206f0b86d admin admin] REQUEST_METHOD: `GET` {{(pid=71938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 24 16:34:03.061287 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea93287e-3ab9-4f9d-bdcc-fa5206f0b86d admin admin] SCRIPT_NAME: `/identity` {{(pid=71938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 24 16:34:03.061623 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea93287e-3ab9-4f9d-bdcc-fa5206f0b86d admin admin] PATH_INFO: `/v3/services` {{(pid=71938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 24 16:34:03.062433 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea93287e-3ab9-4f9d-bdcc-fa5206f0b86d admin admin] RBAC: Adding query filter params (type=object-store) {{(pid=71938) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:161}} Nov 24 16:34:03.062788 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea93287e-3ab9-4f9d-bdcc-fa5206f0b86d admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=71938) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:442}} Nov 24 16:34:03.091523 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea93287e-3ab9-4f9d-bdcc-fa5206f0b86d admin admin] RBAC: Authorization granted {{(pid=71938) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 24 16:34:03.096330 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: [pid: 71938|app: 0|req: 543/1085] 10.222.0.53 () {56 vars in 1134 bytes} [Wed Nov 24 16:34:03 2021] GET /identity/v3/services?type=object-store => generated 129 bytes in 52 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 24 16:34:05.087820 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27a3dcee-53c6-4f0f-8c78-1c9b17480047 None None] REQUEST_METHOD: `GET` {{(pid=71939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 24 16:34:05.088402 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27a3dcee-53c6-4f0f-8c78-1c9b17480047 None None] SCRIPT_NAME: `/identity` {{(pid=71939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 24 16:34:05.088528 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27a3dcee-53c6-4f0f-8c78-1c9b17480047 None None] PATH_INFO: `/` {{(pid=71939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 24 16:34:05.090335 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: [pid: 71939|app: 0|req: 543/1086] 10.222.0.53 () {54 vars in 915 bytes} [Wed Nov 24 16:34:05 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 24 16:34:05.095980 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57e05ec1-91ab-46a1-853e-ae95ebc4a6f2 None None] REQUEST_METHOD: `POST` {{(pid=71938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 24 16:34:05.096341 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57e05ec1-91ab-46a1-853e-ae95ebc4a6f2 None None] SCRIPT_NAME: `/identity` {{(pid=71938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 24 16:34:05.096737 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57e05ec1-91ab-46a1-853e-ae95ebc4a6f2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=71938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 24 16:34:05.122191 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.auth.core [None req-57e05ec1-91ab-46a1-853e-ae95ebc4a6f2 None None] MFA Rules not processed for user `0f2ba2e8375b4e8c8792ee1e22b60427`. Rule list: `[]` (Enabled: `True`). {{(pid=71938) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:442}} Nov 24 16:34:05.124009 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.fernet_utils [None req-57e05ec1-91ab-46a1-853e-ae95ebc4a6f2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=71938) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:289}} Nov 24 16:34:05.131508 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: [pid: 71938|app: 0|req: 544/1087] 10.222.0.53 () {58 vars in 1013 bytes} [Wed Nov 24 16:34:05 2021] POST /identity/v3/auth/tokens => generated 2973 bytes in 37 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 24 16:34:05.153852 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ef0c95d-ab5a-4564-ba66-2bb69d74fdaf None None] REQUEST_METHOD: `POST` {{(pid=71939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 24 16:34:05.154273 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ef0c95d-ab5a-4564-ba66-2bb69d74fdaf None None] SCRIPT_NAME: `/identity` {{(pid=71939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 24 16:34:05.154617 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ef0c95d-ab5a-4564-ba66-2bb69d74fdaf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=71939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 24 16:34:05.179216 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.auth.core [None req-7ef0c95d-ab5a-4564-ba66-2bb69d74fdaf None None] MFA Rules not processed for user `0f2ba2e8375b4e8c8792ee1e22b60427`. Rule list: `[]` (Enabled: `True`). {{(pid=71939) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:442}} Nov 24 16:34:05.180480 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.fernet_utils [None req-7ef0c95d-ab5a-4564-ba66-2bb69d74fdaf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=71939) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:289}} Nov 24 16:34:05.188498 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: [pid: 71939|app: 0|req: 544/1088] 10.222.0.53 () {58 vars in 1013 bytes} [Wed Nov 24 16:34:05 2021] POST /identity/v3/auth/tokens => generated 2973 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 24 16:34:05.194863 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57e05ec1-91ab-46a1-853e-ae95ebc4a6f2 None None] Authenticating user token {{(pid=71938) process_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 24 16:34:05.205631 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57e05ec1-91ab-46a1-853e-ae95ebc4a6f2 None None] Validating token access rules against request {{(pid=71938) validate_allowed_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 24 16:34:05.209960 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10275647-0407-499e-8743-2f0b82f7b1d3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f2ba2e8375b4e8c8792ee1e22b60427', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '00a5583c7b7443e98e7a1d31a0b638dc', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=71938) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 24 16:34:05.210663 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10275647-0407-499e-8743-2f0b82f7b1d3 admin admin] REQUEST_METHOD: `POST` {{(pid=71938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 24 16:34:05.211000 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10275647-0407-499e-8743-2f0b82f7b1d3 admin admin] SCRIPT_NAME: `/identity` {{(pid=71938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 24 16:34:05.211307 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10275647-0407-499e-8743-2f0b82f7b1d3 admin admin] PATH_INFO: `/v3/services` {{(pid=71938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 24 16:34:05.212078 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10275647-0407-499e-8743-2f0b82f7b1d3 admin admin] RBAC: Authorizing `identity:create_service()` {{(pid=71938) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:442}} Nov 24 16:34:05.240819 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10275647-0407-499e-8743-2f0b82f7b1d3 admin admin] RBAC: Authorization granted {{(pid=71938) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 24 16:34:05.253356 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: [pid: 71938|app: 0|req: 545/1089] 10.222.0.53 () {60 vars in 1153 bytes} [Wed Nov 24 16:34:05 2021] POST /identity/v3/services => generated 241 bytes in 59 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 24 16:34:07.271196 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e6f9514-a33e-40e6-99d3-74ab67500357 None None] REQUEST_METHOD: `GET` {{(pid=71939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 24 16:34:07.271742 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e6f9514-a33e-40e6-99d3-74ab67500357 None None] SCRIPT_NAME: `/identity` {{(pid=71939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 24 16:34:07.271855 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e6f9514-a33e-40e6-99d3-74ab67500357 None None] PATH_INFO: `/` {{(pid=71939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 24 16:34:07.274654 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: [pid: 71939|app: 0|req: 545/1090] 10.222.0.53 () {54 vars in 915 bytes} [Wed Nov 24 16:34:07 2021] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 24 16:34:07.280572 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6291eba6-2572-4c15-a0a2-3d79920a4c31 None None] REQUEST_METHOD: `POST` {{(pid=71938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 24 16:34:07.280953 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6291eba6-2572-4c15-a0a2-3d79920a4c31 None None] SCRIPT_NAME: `/identity` {{(pid=71938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 24 16:34:07.281299 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6291eba6-2572-4c15-a0a2-3d79920a4c31 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=71938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 24 16:34:07.305185 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.auth.core [None req-6291eba6-2572-4c15-a0a2-3d79920a4c31 None None] MFA Rules not processed for user `0f2ba2e8375b4e8c8792ee1e22b60427`. Rule list: `[]` (Enabled: `True`). {{(pid=71938) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:442}} Nov 24 16:34:07.306446 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.fernet_utils [None req-6291eba6-2572-4c15-a0a2-3d79920a4c31 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=71938) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:289}} Nov 24 16:34:07.325873 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: [pid: 71938|app: 0|req: 546/1091] 10.222.0.53 () {58 vars in 1013 bytes} [Wed Nov 24 16:34:07 2021] POST /identity/v3/auth/tokens => generated 3075 bytes in 46 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 24 16:34:07.352694 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e852573-73c4-4d2f-abf2-7f020ee224a5 None None] REQUEST_METHOD: `POST` {{(pid=71939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 24 16:34:07.353049 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e852573-73c4-4d2f-abf2-7f020ee224a5 None None] SCRIPT_NAME: `/identity` {{(pid=71939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 24 16:34:07.353390 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e852573-73c4-4d2f-abf2-7f020ee224a5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=71939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 24 16:34:07.377865 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.auth.core [None req-2e852573-73c4-4d2f-abf2-7f020ee224a5 None None] MFA Rules not processed for user `0f2ba2e8375b4e8c8792ee1e22b60427`. Rule list: `[]` (Enabled: `True`). {{(pid=71939) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:442}} Nov 24 16:34:07.379134 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.fernet_utils [None req-2e852573-73c4-4d2f-abf2-7f020ee224a5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=71939) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:289}} Nov 24 16:34:07.386503 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: [pid: 71939|app: 0|req: 546/1092] 10.222.0.53 () {58 vars in 1013 bytes} [Wed Nov 24 16:34:07 2021] POST /identity/v3/auth/tokens => generated 3075 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 24 16:34:07.392684 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6291eba6-2572-4c15-a0a2-3d79920a4c31 None None] Authenticating user token {{(pid=71938) process_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 24 16:34:07.402913 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6291eba6-2572-4c15-a0a2-3d79920a4c31 None None] Validating token access rules against request {{(pid=71938) validate_allowed_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 24 16:34:07.407711 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9693115e-e641-4124-b01c-a35499837c13 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f2ba2e8375b4e8c8792ee1e22b60427', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '00a5583c7b7443e98e7a1d31a0b638dc', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=71938) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 24 16:34:07.408562 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9693115e-e641-4124-b01c-a35499837c13 admin admin] REQUEST_METHOD: `GET` {{(pid=71938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 24 16:34:07.408897 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9693115e-e641-4124-b01c-a35499837c13 admin admin] SCRIPT_NAME: `/identity` {{(pid=71938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 24 16:34:07.409226 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9693115e-e641-4124-b01c-a35499837c13 admin admin] PATH_INFO: `/v3/services/object-store` {{(pid=71938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 24 16:34:07.409948 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9693115e-e641-4124-b01c-a35499837c13 admin admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=71938) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:442}} Nov 24 16:34:07.439226 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9693115e-e641-4124-b01c-a35499837c13 admin admin] RBAC: Authorization granted {{(pid=71938) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 24 16:34:07.452175 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: WARNING keystone.server.flask.application [None req-9693115e-e641-4124-b01c-a35499837c13 admin admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. Nov 24 16:34:07.453420 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: [pid: 71938|app: 0|req: 547/1093] 10.222.0.53 () {56 vars in 1138 bytes} [Wed Nov 24 16:34:07 2021] GET /identity/v3/services/object-store => generated 93 bytes in 61 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 24 16:34:07.461557 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e852573-73c4-4d2f-abf2-7f020ee224a5 None None] Authenticating user token {{(pid=71939) process_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 24 16:34:07.470939 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e852573-73c4-4d2f-abf2-7f020ee224a5 None None] Validating token access rules against request {{(pid=71939) validate_allowed_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 24 16:34:07.475994 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3696d9d3-090d-4e7a-af6a-7e7b184f955d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f2ba2e8375b4e8c8792ee1e22b60427', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '00a5583c7b7443e98e7a1d31a0b638dc', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=71939) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 24 16:34:07.476692 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3696d9d3-090d-4e7a-af6a-7e7b184f955d admin admin] REQUEST_METHOD: `GET` {{(pid=71939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 24 16:34:07.477037 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3696d9d3-090d-4e7a-af6a-7e7b184f955d admin admin] SCRIPT_NAME: `/identity` {{(pid=71939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 24 16:34:07.477374 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3696d9d3-090d-4e7a-af6a-7e7b184f955d admin admin] PATH_INFO: `/v3/services` {{(pid=71939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 24 16:34:07.478202 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3696d9d3-090d-4e7a-af6a-7e7b184f955d admin admin] RBAC: Adding query filter params (name=object-store) {{(pid=71939) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:161}} Nov 24 16:34:07.478555 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3696d9d3-090d-4e7a-af6a-7e7b184f955d admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=71939) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:442}} Nov 24 16:34:07.507713 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3696d9d3-090d-4e7a-af6a-7e7b184f955d admin admin] RBAC: Authorization granted {{(pid=71939) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 24 16:34:07.514009 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: [pid: 71939|app: 0|req: 547/1094] 10.222.0.53 () {56 vars in 1134 bytes} [Wed Nov 24 16:34:07 2021] GET /identity/v3/services?name=object-store => generated 129 bytes in 53 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 24 16:34:07.520340 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9693115e-e641-4124-b01c-a35499837c13 admin admin] Authenticating user token {{(pid=71938) process_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 24 16:34:07.530346 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9693115e-e641-4124-b01c-a35499837c13 admin admin] Validating token access rules against request {{(pid=71938) validate_allowed_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 24 16:34:07.534926 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86459360-3a7a-42e3-b998-b3f282f607da admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f2ba2e8375b4e8c8792ee1e22b60427', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '00a5583c7b7443e98e7a1d31a0b638dc', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=71938) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 24 16:34:07.535652 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86459360-3a7a-42e3-b998-b3f282f607da admin admin] REQUEST_METHOD: `GET` {{(pid=71938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 24 16:34:07.536033 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86459360-3a7a-42e3-b998-b3f282f607da admin admin] SCRIPT_NAME: `/identity` {{(pid=71938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 24 16:34:07.536400 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86459360-3a7a-42e3-b998-b3f282f607da admin admin] PATH_INFO: `/v3/services` {{(pid=71938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 24 16:34:07.537275 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86459360-3a7a-42e3-b998-b3f282f607da admin admin] RBAC: Adding query filter params (type=object-store) {{(pid=71938) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:161}} Nov 24 16:34:07.537671 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86459360-3a7a-42e3-b998-b3f282f607da admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=71938) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:442}} Nov 24 16:34:07.567410 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86459360-3a7a-42e3-b998-b3f282f607da admin admin] RBAC: Authorization granted {{(pid=71938) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 24 16:34:07.573120 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: [pid: 71938|app: 0|req: 548/1095] 10.222.0.53 () {56 vars in 1134 bytes} [Wed Nov 24 16:34:07 2021] GET /identity/v3/services?type=object-store => generated 356 bytes in 53 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 24 16:34:07.579974 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3696d9d3-090d-4e7a-af6a-7e7b184f955d admin admin] Authenticating user token {{(pid=71939) process_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 24 16:34:07.589963 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3696d9d3-090d-4e7a-af6a-7e7b184f955d admin admin] Validating token access rules against request {{(pid=71939) validate_allowed_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 24 16:34:07.594408 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcb4a8f8-32ab-41c2-ba0e-19d40d90a060 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f2ba2e8375b4e8c8792ee1e22b60427', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '00a5583c7b7443e98e7a1d31a0b638dc', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=71939) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 24 16:34:07.595070 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcb4a8f8-32ab-41c2-ba0e-19d40d90a060 admin admin] REQUEST_METHOD: `GET` {{(pid=71939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 24 16:34:07.595409 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcb4a8f8-32ab-41c2-ba0e-19d40d90a060 admin admin] SCRIPT_NAME: `/identity` {{(pid=71939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 24 16:34:07.595745 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcb4a8f8-32ab-41c2-ba0e-19d40d90a060 admin admin] PATH_INFO: `/v3/endpoints` {{(pid=71939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 24 16:34:07.596604 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcb4a8f8-32ab-41c2-ba0e-19d40d90a060 admin admin] RBAC: Adding query filter params (interface=public, service_id=24c6a015b00941e192c30087694231c2, region_id=RegionOne) {{(pid=71939) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:161}} Nov 24 16:34:07.596970 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcb4a8f8-32ab-41c2-ba0e-19d40d90a060 admin admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=71939) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:442}} Nov 24 16:34:07.626389 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcb4a8f8-32ab-41c2-ba0e-19d40d90a060 admin admin] RBAC: Authorization granted {{(pid=71939) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 24 16:34:07.632655 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: [pid: 71939|app: 0|req: 548/1096] 10.222.0.53 () {56 vars in 1263 bytes} [Wed Nov 24 16:34:07 2021] GET /identity/v3/endpoints?service_id=24c6a015b00941e192c30087694231c2&interface=public®ion_id=RegionOne => generated 194 bytes in 53 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 24 16:34:07.638899 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86459360-3a7a-42e3-b998-b3f282f607da admin admin] Authenticating user token {{(pid=71938) process_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 24 16:34:07.648841 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86459360-3a7a-42e3-b998-b3f282f607da admin admin] Validating token access rules against request {{(pid=71938) validate_allowed_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 24 16:34:07.653212 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15abdd6d-2cb0-42ef-8135-52c949ca3b7a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f2ba2e8375b4e8c8792ee1e22b60427', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '00a5583c7b7443e98e7a1d31a0b638dc', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=71938) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 24 16:34:07.653881 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15abdd6d-2cb0-42ef-8135-52c949ca3b7a admin admin] REQUEST_METHOD: `GET` {{(pid=71938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 24 16:34:07.654272 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15abdd6d-2cb0-42ef-8135-52c949ca3b7a admin admin] SCRIPT_NAME: `/identity` {{(pid=71938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 24 16:34:07.654973 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15abdd6d-2cb0-42ef-8135-52c949ca3b7a admin admin] PATH_INFO: `/v3/services` {{(pid=71938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 24 16:34:07.655800 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15abdd6d-2cb0-42ef-8135-52c949ca3b7a admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=71938) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:442}} Nov 24 16:34:07.684350 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15abdd6d-2cb0-42ef-8135-52c949ca3b7a admin admin] RBAC: Authorization granted {{(pid=71938) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 24 16:34:07.695673 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: [pid: 71938|app: 0|req: 549/1097] 10.222.0.53 () {56 vars in 1099 bytes} [Wed Nov 24 16:34:07 2021] GET /identity/v3/services => generated 2196 bytes in 57 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 24 16:34:09.722544 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d28ea74f-7e73-4413-bf37-9337fcece912 None None] REQUEST_METHOD: `GET` {{(pid=71939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 24 16:34:09.723134 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d28ea74f-7e73-4413-bf37-9337fcece912 None None] SCRIPT_NAME: `/identity` {{(pid=71939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 24 16:34:09.723260 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d28ea74f-7e73-4413-bf37-9337fcece912 None None] PATH_INFO: `/` {{(pid=71939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 24 16:34:09.725240 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: [pid: 71939|app: 0|req: 549/1098] 10.222.0.53 () {54 vars in 915 bytes} [Wed Nov 24 16:34:09 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 24 16:34:09.732055 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcdfbb6d-97cb-4444-888f-2b3536067dbf None None] REQUEST_METHOD: `POST` {{(pid=71938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 24 16:34:09.732398 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcdfbb6d-97cb-4444-888f-2b3536067dbf None None] SCRIPT_NAME: `/identity` {{(pid=71938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 24 16:34:09.732731 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcdfbb6d-97cb-4444-888f-2b3536067dbf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=71938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 24 16:34:09.758045 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.auth.core [None req-fcdfbb6d-97cb-4444-888f-2b3536067dbf None None] MFA Rules not processed for user `0f2ba2e8375b4e8c8792ee1e22b60427`. Rule list: `[]` (Enabled: `True`). {{(pid=71938) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:442}} Nov 24 16:34:09.759781 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.fernet_utils [None req-fcdfbb6d-97cb-4444-888f-2b3536067dbf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=71938) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:289}} Nov 24 16:34:09.767912 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: [pid: 71938|app: 0|req: 550/1099] 10.222.0.53 () {58 vars in 1013 bytes} [Wed Nov 24 16:34:09 2021] POST /identity/v3/auth/tokens => generated 3075 bytes in 38 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 24 16:34:09.790579 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38fb57c9-10d9-4c93-8fac-1b2e5776d6e9 None None] REQUEST_METHOD: `POST` {{(pid=71939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 24 16:34:09.790926 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38fb57c9-10d9-4c93-8fac-1b2e5776d6e9 None None] SCRIPT_NAME: `/identity` {{(pid=71939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 24 16:34:09.791272 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38fb57c9-10d9-4c93-8fac-1b2e5776d6e9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=71939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 24 16:34:09.816314 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.auth.core [None req-38fb57c9-10d9-4c93-8fac-1b2e5776d6e9 None None] MFA Rules not processed for user `0f2ba2e8375b4e8c8792ee1e22b60427`. Rule list: `[]` (Enabled: `True`). {{(pid=71939) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:442}} Nov 24 16:34:09.817550 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.fernet_utils [None req-38fb57c9-10d9-4c93-8fac-1b2e5776d6e9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=71939) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:289}} Nov 24 16:34:09.824909 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: [pid: 71939|app: 0|req: 550/1100] 10.222.0.53 () {58 vars in 1013 bytes} [Wed Nov 24 16:34:09 2021] POST /identity/v3/auth/tokens => generated 3075 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 24 16:34:09.831408 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcdfbb6d-97cb-4444-888f-2b3536067dbf None None] Authenticating user token {{(pid=71938) process_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 24 16:34:09.841027 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcdfbb6d-97cb-4444-888f-2b3536067dbf None None] Validating token access rules against request {{(pid=71938) validate_allowed_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 24 16:34:09.845308 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d676e673-2b92-494f-ad8d-279f82969e4f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f2ba2e8375b4e8c8792ee1e22b60427', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '00a5583c7b7443e98e7a1d31a0b638dc', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=71938) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 24 16:34:09.846174 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d676e673-2b92-494f-ad8d-279f82969e4f admin admin] REQUEST_METHOD: `GET` {{(pid=71938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 24 16:34:09.846514 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d676e673-2b92-494f-ad8d-279f82969e4f admin admin] SCRIPT_NAME: `/identity` {{(pid=71938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 24 16:34:09.846843 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d676e673-2b92-494f-ad8d-279f82969e4f admin admin] PATH_INFO: `/v3/services/object-store` {{(pid=71938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 24 16:34:09.847550 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d676e673-2b92-494f-ad8d-279f82969e4f admin admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=71938) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:442}} Nov 24 16:34:09.878127 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d676e673-2b92-494f-ad8d-279f82969e4f admin admin] RBAC: Authorization granted {{(pid=71938) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 24 16:34:09.890786 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: WARNING keystone.server.flask.application [None req-d676e673-2b92-494f-ad8d-279f82969e4f admin admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. Nov 24 16:34:09.892030 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: [pid: 71938|app: 0|req: 551/1101] 10.222.0.53 () {56 vars in 1138 bytes} [Wed Nov 24 16:34:09 2021] GET /identity/v3/services/object-store => generated 93 bytes in 61 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 24 16:34:09.899148 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38fb57c9-10d9-4c93-8fac-1b2e5776d6e9 None None] Authenticating user token {{(pid=71939) process_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 24 16:34:09.908455 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38fb57c9-10d9-4c93-8fac-1b2e5776d6e9 None None] Validating token access rules against request {{(pid=71939) validate_allowed_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 24 16:34:09.912849 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e20967b-5f86-4176-bc68-6ea80a807990 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f2ba2e8375b4e8c8792ee1e22b60427', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '00a5583c7b7443e98e7a1d31a0b638dc', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=71939) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 24 16:34:09.913520 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e20967b-5f86-4176-bc68-6ea80a807990 admin admin] REQUEST_METHOD: `GET` {{(pid=71939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 24 16:34:09.913865 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e20967b-5f86-4176-bc68-6ea80a807990 admin admin] SCRIPT_NAME: `/identity` {{(pid=71939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 24 16:34:09.914233 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e20967b-5f86-4176-bc68-6ea80a807990 admin admin] PATH_INFO: `/v3/services` {{(pid=71939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 24 16:34:09.915009 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e20967b-5f86-4176-bc68-6ea80a807990 admin admin] RBAC: Adding query filter params (name=object-store) {{(pid=71939) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:161}} Nov 24 16:34:09.915360 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e20967b-5f86-4176-bc68-6ea80a807990 admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=71939) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:442}} Nov 24 16:34:09.944366 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e20967b-5f86-4176-bc68-6ea80a807990 admin admin] RBAC: Authorization granted {{(pid=71939) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 24 16:34:09.950795 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: [pid: 71939|app: 0|req: 551/1102] 10.222.0.53 () {56 vars in 1134 bytes} [Wed Nov 24 16:34:09 2021] GET /identity/v3/services?name=object-store => generated 129 bytes in 52 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 24 16:34:09.961811 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d676e673-2b92-494f-ad8d-279f82969e4f admin admin] Authenticating user token {{(pid=71938) process_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 24 16:34:09.972496 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d676e673-2b92-494f-ad8d-279f82969e4f admin admin] Validating token access rules against request {{(pid=71938) validate_allowed_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 24 16:34:09.976827 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad9a72e4-995d-4b01-bb9a-e16d82b8cb65 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f2ba2e8375b4e8c8792ee1e22b60427', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '00a5583c7b7443e98e7a1d31a0b638dc', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=71938) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 24 16:34:09.977445 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad9a72e4-995d-4b01-bb9a-e16d82b8cb65 admin admin] REQUEST_METHOD: `GET` {{(pid=71938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 24 16:34:09.977779 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad9a72e4-995d-4b01-bb9a-e16d82b8cb65 admin admin] SCRIPT_NAME: `/identity` {{(pid=71938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 24 16:34:09.978134 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad9a72e4-995d-4b01-bb9a-e16d82b8cb65 admin admin] PATH_INFO: `/v3/services` {{(pid=71938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 24 16:34:09.978900 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad9a72e4-995d-4b01-bb9a-e16d82b8cb65 admin admin] RBAC: Adding query filter params (type=object-store) {{(pid=71938) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:161}} Nov 24 16:34:09.979242 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad9a72e4-995d-4b01-bb9a-e16d82b8cb65 admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=71938) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:442}} Nov 24 16:34:10.007746 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad9a72e4-995d-4b01-bb9a-e16d82b8cb65 admin admin] RBAC: Authorization granted {{(pid=71938) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 24 16:34:10.013108 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: [pid: 71938|app: 0|req: 552/1103] 10.222.0.53 () {56 vars in 1134 bytes} [Wed Nov 24 16:34:09 2021] GET /identity/v3/services?type=object-store => generated 356 bytes in 52 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 24 16:34:10.019740 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e20967b-5f86-4176-bc68-6ea80a807990 admin admin] Authenticating user token {{(pid=71939) process_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 24 16:34:10.030701 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e20967b-5f86-4176-bc68-6ea80a807990 admin admin] Validating token access rules against request {{(pid=71939) validate_allowed_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 24 16:34:10.035102 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-123dff66-7dc1-401c-8109-d0def3b9bd7d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f2ba2e8375b4e8c8792ee1e22b60427', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '00a5583c7b7443e98e7a1d31a0b638dc', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=71939) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 24 16:34:10.035770 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-123dff66-7dc1-401c-8109-d0def3b9bd7d admin admin] REQUEST_METHOD: `POST` {{(pid=71939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 24 16:34:10.036113 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-123dff66-7dc1-401c-8109-d0def3b9bd7d admin admin] SCRIPT_NAME: `/identity` {{(pid=71939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 24 16:34:10.036453 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-123dff66-7dc1-401c-8109-d0def3b9bd7d admin admin] PATH_INFO: `/v3/endpoints` {{(pid=71939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 24 16:34:10.037251 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-123dff66-7dc1-401c-8109-d0def3b9bd7d admin admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=71939) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:442}} Nov 24 16:34:10.065893 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-123dff66-7dc1-401c-8109-d0def3b9bd7d admin admin] RBAC: Authorization granted {{(pid=71939) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 24 16:34:10.083246 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: [pid: 71939|app: 0|req: 552/1104] 10.222.0.53 () {60 vars in 1156 bytes} [Wed Nov 24 16:34:10 2021] POST /identity/v3/endpoints => generated 349 bytes in 64 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 24 16:34:12.087292 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eeee25d2-fe55-4148-907b-6542490c47fc None None] REQUEST_METHOD: `GET` {{(pid=71938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 24 16:34:12.087828 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eeee25d2-fe55-4148-907b-6542490c47fc None None] SCRIPT_NAME: `/identity` {{(pid=71938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 24 16:34:12.087966 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eeee25d2-fe55-4148-907b-6542490c47fc None None] PATH_INFO: `/` {{(pid=71938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 24 16:34:12.089780 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: [pid: 71938|app: 0|req: 553/1105] 10.222.0.53 () {54 vars in 915 bytes} [Wed Nov 24 16:34:12 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 24 16:34:12.096151 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0475cdb9-e1cf-43fc-9146-8126ce116c0b None None] REQUEST_METHOD: `POST` {{(pid=71939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 24 16:34:12.096505 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0475cdb9-e1cf-43fc-9146-8126ce116c0b None None] SCRIPT_NAME: `/identity` {{(pid=71939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 24 16:34:12.096848 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0475cdb9-e1cf-43fc-9146-8126ce116c0b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=71939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 24 16:34:12.120389 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.auth.core [None req-0475cdb9-e1cf-43fc-9146-8126ce116c0b None None] MFA Rules not processed for user `0f2ba2e8375b4e8c8792ee1e22b60427`. Rule list: `[]` (Enabled: `True`). {{(pid=71939) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:442}} Nov 24 16:34:12.121619 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.fernet_utils [None req-0475cdb9-e1cf-43fc-9146-8126ce116c0b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=71939) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:289}} Nov 24 16:34:12.140363 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: [pid: 71939|app: 0|req: 553/1106] 10.222.0.53 () {58 vars in 1013 bytes} [Wed Nov 24 16:34:12 2021] POST /identity/v3/auth/tokens => generated 3264 bytes in 45 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 24 16:34:12.163459 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed508add-faf3-4a56-8d5f-49509dd2eb12 None None] REQUEST_METHOD: `POST` {{(pid=71938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 24 16:34:12.163803 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed508add-faf3-4a56-8d5f-49509dd2eb12 None None] SCRIPT_NAME: `/identity` {{(pid=71938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 24 16:34:12.164137 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed508add-faf3-4a56-8d5f-49509dd2eb12 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=71938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 24 16:34:12.190308 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.auth.core [None req-ed508add-faf3-4a56-8d5f-49509dd2eb12 None None] MFA Rules not processed for user `0f2ba2e8375b4e8c8792ee1e22b60427`. Rule list: `[]` (Enabled: `True`). {{(pid=71938) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:442}} Nov 24 16:34:12.191527 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.fernet_utils [None req-ed508add-faf3-4a56-8d5f-49509dd2eb12 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=71938) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:289}} Nov 24 16:34:12.198810 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: [pid: 71938|app: 0|req: 554/1107] 10.222.0.53 () {58 vars in 1013 bytes} [Wed Nov 24 16:34:12 2021] POST /identity/v3/auth/tokens => generated 3264 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 24 16:34:12.206047 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0475cdb9-e1cf-43fc-9146-8126ce116c0b None None] Authenticating user token {{(pid=71939) process_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 24 16:34:12.215920 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0475cdb9-e1cf-43fc-9146-8126ce116c0b None None] Validating token access rules against request {{(pid=71939) validate_allowed_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 24 16:34:12.220269 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed72057f-8f67-4c5b-8040-b71de3dc4cce admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f2ba2e8375b4e8c8792ee1e22b60427', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '00a5583c7b7443e98e7a1d31a0b638dc', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=71939) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 24 16:34:12.221101 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed72057f-8f67-4c5b-8040-b71de3dc4cce admin admin] REQUEST_METHOD: `GET` {{(pid=71939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 24 16:34:12.221444 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed72057f-8f67-4c5b-8040-b71de3dc4cce admin admin] SCRIPT_NAME: `/identity` {{(pid=71939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 24 16:34:12.221778 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed72057f-8f67-4c5b-8040-b71de3dc4cce admin admin] PATH_INFO: `/v3/services/object-store` {{(pid=71939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 24 16:34:12.222548 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed72057f-8f67-4c5b-8040-b71de3dc4cce admin admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=71939) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:442}} Nov 24 16:34:12.251458 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed72057f-8f67-4c5b-8040-b71de3dc4cce admin admin] RBAC: Authorization granted {{(pid=71939) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 24 16:34:12.264639 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: WARNING keystone.server.flask.application [None req-ed72057f-8f67-4c5b-8040-b71de3dc4cce admin admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. Nov 24 16:34:12.265880 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: [pid: 71939|app: 0|req: 554/1108] 10.222.0.53 () {56 vars in 1138 bytes} [Wed Nov 24 16:34:12 2021] GET /identity/v3/services/object-store => generated 93 bytes in 60 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 24 16:34:12.273141 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed508add-faf3-4a56-8d5f-49509dd2eb12 None None] Authenticating user token {{(pid=71938) process_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 24 16:34:12.282347 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed508add-faf3-4a56-8d5f-49509dd2eb12 None None] Validating token access rules against request {{(pid=71938) validate_allowed_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 24 16:34:12.286694 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd25f20b-00c1-494a-88d5-175cf4482c57 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f2ba2e8375b4e8c8792ee1e22b60427', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '00a5583c7b7443e98e7a1d31a0b638dc', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=71938) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 24 16:34:12.287356 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd25f20b-00c1-494a-88d5-175cf4482c57 admin admin] REQUEST_METHOD: `GET` {{(pid=71938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 24 16:34:12.287689 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd25f20b-00c1-494a-88d5-175cf4482c57 admin admin] SCRIPT_NAME: `/identity` {{(pid=71938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 24 16:34:12.288024 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd25f20b-00c1-494a-88d5-175cf4482c57 admin admin] PATH_INFO: `/v3/services` {{(pid=71938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 24 16:34:12.288779 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd25f20b-00c1-494a-88d5-175cf4482c57 admin admin] RBAC: Adding query filter params (name=object-store) {{(pid=71938) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:161}} Nov 24 16:34:12.289126 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd25f20b-00c1-494a-88d5-175cf4482c57 admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=71938) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:442}} Nov 24 16:34:12.317648 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd25f20b-00c1-494a-88d5-175cf4482c57 admin admin] RBAC: Authorization granted {{(pid=71938) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 24 16:34:12.323828 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: [pid: 71938|app: 0|req: 555/1109] 10.222.0.53 () {56 vars in 1134 bytes} [Wed Nov 24 16:34:12 2021] GET /identity/v3/services?name=object-store => generated 129 bytes in 51 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 24 16:34:12.331133 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed72057f-8f67-4c5b-8040-b71de3dc4cce admin admin] Authenticating user token {{(pid=71939) process_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 24 16:34:12.341159 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed72057f-8f67-4c5b-8040-b71de3dc4cce admin admin] Validating token access rules against request {{(pid=71939) validate_allowed_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 24 16:34:12.345466 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe9cbe4b-8681-48e7-aecd-e37b95c7bec0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f2ba2e8375b4e8c8792ee1e22b60427', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '00a5583c7b7443e98e7a1d31a0b638dc', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=71939) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 24 16:34:12.346171 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe9cbe4b-8681-48e7-aecd-e37b95c7bec0 admin admin] REQUEST_METHOD: `GET` {{(pid=71939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 24 16:34:12.346512 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe9cbe4b-8681-48e7-aecd-e37b95c7bec0 admin admin] SCRIPT_NAME: `/identity` {{(pid=71939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 24 16:34:12.346846 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe9cbe4b-8681-48e7-aecd-e37b95c7bec0 admin admin] PATH_INFO: `/v3/services` {{(pid=71939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 24 16:34:12.347611 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe9cbe4b-8681-48e7-aecd-e37b95c7bec0 admin admin] RBAC: Adding query filter params (type=object-store) {{(pid=71939) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:161}} Nov 24 16:34:12.347960 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe9cbe4b-8681-48e7-aecd-e37b95c7bec0 admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=71939) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:442}} Nov 24 16:34:12.377390 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe9cbe4b-8681-48e7-aecd-e37b95c7bec0 admin admin] RBAC: Authorization granted {{(pid=71939) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 24 16:34:12.382768 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: [pid: 71939|app: 0|req: 555/1110] 10.222.0.53 () {56 vars in 1134 bytes} [Wed Nov 24 16:34:12 2021] GET /identity/v3/services?type=object-store => generated 356 bytes in 52 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 24 16:34:12.389998 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd25f20b-00c1-494a-88d5-175cf4482c57 admin admin] Authenticating user token {{(pid=71938) process_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 24 16:34:12.400592 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd25f20b-00c1-494a-88d5-175cf4482c57 admin admin] Validating token access rules against request {{(pid=71938) validate_allowed_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 24 16:34:12.405285 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf1ad16a-608f-4d5b-830a-2caae604b5ca admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f2ba2e8375b4e8c8792ee1e22b60427', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '00a5583c7b7443e98e7a1d31a0b638dc', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=71938) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 24 16:34:12.405961 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf1ad16a-608f-4d5b-830a-2caae604b5ca admin admin] REQUEST_METHOD: `GET` {{(pid=71938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 24 16:34:12.406336 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf1ad16a-608f-4d5b-830a-2caae604b5ca admin admin] SCRIPT_NAME: `/identity` {{(pid=71938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 24 16:34:12.406673 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf1ad16a-608f-4d5b-830a-2caae604b5ca admin admin] PATH_INFO: `/v3/endpoints` {{(pid=71938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 24 16:34:12.407543 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf1ad16a-608f-4d5b-830a-2caae604b5ca admin admin] RBAC: Adding query filter params (interface=admin, service_id=24c6a015b00941e192c30087694231c2, region_id=RegionOne) {{(pid=71938) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:161}} Nov 24 16:34:12.407908 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf1ad16a-608f-4d5b-830a-2caae604b5ca admin admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=71938) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:442}} Nov 24 16:34:12.436246 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf1ad16a-608f-4d5b-830a-2caae604b5ca admin admin] RBAC: Authorization granted {{(pid=71938) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 24 16:34:12.442442 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: [pid: 71938|app: 0|req: 556/1111] 10.222.0.53 () {56 vars in 1261 bytes} [Wed Nov 24 16:34:12 2021] GET /identity/v3/endpoints?service_id=24c6a015b00941e192c30087694231c2&interface=admin®ion_id=RegionOne => generated 193 bytes in 53 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 24 16:34:12.448811 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe9cbe4b-8681-48e7-aecd-e37b95c7bec0 admin admin] Authenticating user token {{(pid=71939) process_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 24 16:34:12.459671 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe9cbe4b-8681-48e7-aecd-e37b95c7bec0 admin admin] Validating token access rules against request {{(pid=71939) validate_allowed_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 24 16:34:12.464027 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b88302c-2234-42c7-9fc4-3c0beb1aa336 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f2ba2e8375b4e8c8792ee1e22b60427', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '00a5583c7b7443e98e7a1d31a0b638dc', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=71939) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 24 16:34:12.464689 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b88302c-2234-42c7-9fc4-3c0beb1aa336 admin admin] REQUEST_METHOD: `GET` {{(pid=71939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 24 16:34:12.465030 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b88302c-2234-42c7-9fc4-3c0beb1aa336 admin admin] SCRIPT_NAME: `/identity` {{(pid=71939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 24 16:34:12.465361 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b88302c-2234-42c7-9fc4-3c0beb1aa336 admin admin] PATH_INFO: `/v3/services` {{(pid=71939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 24 16:34:12.466298 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b88302c-2234-42c7-9fc4-3c0beb1aa336 admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=71939) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:442}} Nov 24 16:34:12.494659 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b88302c-2234-42c7-9fc4-3c0beb1aa336 admin admin] RBAC: Authorization granted {{(pid=71939) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 24 16:34:12.503333 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: [pid: 71939|app: 0|req: 556/1112] 10.222.0.53 () {56 vars in 1099 bytes} [Wed Nov 24 16:34:12 2021] GET /identity/v3/services => generated 2196 bytes in 55 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 24 16:34:14.509831 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4c6b8ab-f2b5-4854-a5e6-5ba8af42fe01 None None] REQUEST_METHOD: `GET` {{(pid=71938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 24 16:34:14.510382 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4c6b8ab-f2b5-4854-a5e6-5ba8af42fe01 None None] SCRIPT_NAME: `/identity` {{(pid=71938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 24 16:34:14.510489 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4c6b8ab-f2b5-4854-a5e6-5ba8af42fe01 None None] PATH_INFO: `/` {{(pid=71938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 24 16:34:14.512302 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: [pid: 71938|app: 0|req: 557/1113] 10.222.0.53 () {54 vars in 915 bytes} [Wed Nov 24 16:34:14 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 24 16:34:14.519289 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b50f8baf-ee08-4b2f-be21-dfe5b5d9ccbe None None] REQUEST_METHOD: `POST` {{(pid=71939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 24 16:34:14.519689 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b50f8baf-ee08-4b2f-be21-dfe5b5d9ccbe None None] SCRIPT_NAME: `/identity` {{(pid=71939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 24 16:34:14.520055 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b50f8baf-ee08-4b2f-be21-dfe5b5d9ccbe None None] PATH_INFO: `/v3/auth/tokens` {{(pid=71939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 24 16:34:14.543944 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.auth.core [None req-b50f8baf-ee08-4b2f-be21-dfe5b5d9ccbe None None] MFA Rules not processed for user `0f2ba2e8375b4e8c8792ee1e22b60427`. Rule list: `[]` (Enabled: `True`). {{(pid=71939) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:442}} Nov 24 16:34:14.545176 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.fernet_utils [None req-b50f8baf-ee08-4b2f-be21-dfe5b5d9ccbe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=71939) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:289}} Nov 24 16:34:14.552371 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: [pid: 71939|app: 0|req: 557/1114] 10.222.0.53 () {58 vars in 1013 bytes} [Wed Nov 24 16:34:14 2021] POST /identity/v3/auth/tokens => generated 3264 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 24 16:34:14.574795 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5241f31-c604-4900-957c-e4c4eb705493 None None] REQUEST_METHOD: `POST` {{(pid=71938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 24 16:34:14.575155 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5241f31-c604-4900-957c-e4c4eb705493 None None] SCRIPT_NAME: `/identity` {{(pid=71938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 24 16:34:14.575493 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5241f31-c604-4900-957c-e4c4eb705493 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=71938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 24 16:34:14.600753 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.auth.core [None req-e5241f31-c604-4900-957c-e4c4eb705493 None None] MFA Rules not processed for user `0f2ba2e8375b4e8c8792ee1e22b60427`. Rule list: `[]` (Enabled: `True`). {{(pid=71938) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:442}} Nov 24 16:34:14.602071 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.fernet_utils [None req-e5241f31-c604-4900-957c-e4c4eb705493 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=71938) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:289}} Nov 24 16:34:14.609492 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: [pid: 71938|app: 0|req: 558/1115] 10.222.0.53 () {58 vars in 1013 bytes} [Wed Nov 24 16:34:14 2021] POST /identity/v3/auth/tokens => generated 3264 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 24 16:34:14.615783 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b50f8baf-ee08-4b2f-be21-dfe5b5d9ccbe None None] Authenticating user token {{(pid=71939) process_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 24 16:34:14.626110 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b50f8baf-ee08-4b2f-be21-dfe5b5d9ccbe None None] Validating token access rules against request {{(pid=71939) validate_allowed_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 24 16:34:14.630529 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-803945c9-910e-4488-b87c-373e717406b6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f2ba2e8375b4e8c8792ee1e22b60427', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '00a5583c7b7443e98e7a1d31a0b638dc', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=71939) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 24 16:34:14.631360 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-803945c9-910e-4488-b87c-373e717406b6 admin admin] REQUEST_METHOD: `GET` {{(pid=71939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 24 16:34:14.631705 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-803945c9-910e-4488-b87c-373e717406b6 admin admin] SCRIPT_NAME: `/identity` {{(pid=71939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 24 16:34:14.632042 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-803945c9-910e-4488-b87c-373e717406b6 admin admin] PATH_INFO: `/v3/services/object-store` {{(pid=71939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 24 16:34:14.632757 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-803945c9-910e-4488-b87c-373e717406b6 admin admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=71939) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:442}} Nov 24 16:34:14.661369 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-803945c9-910e-4488-b87c-373e717406b6 admin admin] RBAC: Authorization granted {{(pid=71939) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 24 16:34:14.673826 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: WARNING keystone.server.flask.application [None req-803945c9-910e-4488-b87c-373e717406b6 admin admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. Nov 24 16:34:14.675075 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: [pid: 71939|app: 0|req: 558/1116] 10.222.0.53 () {56 vars in 1138 bytes} [Wed Nov 24 16:34:14 2021] GET /identity/v3/services/object-store => generated 93 bytes in 60 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 24 16:34:14.682094 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5241f31-c604-4900-957c-e4c4eb705493 None None] Authenticating user token {{(pid=71938) process_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 24 16:34:14.694404 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5241f31-c604-4900-957c-e4c4eb705493 None None] Validating token access rules against request {{(pid=71938) validate_allowed_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 24 16:34:14.698859 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9b0aba0-63b7-4c10-b46f-1afcd353c91f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f2ba2e8375b4e8c8792ee1e22b60427', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '00a5583c7b7443e98e7a1d31a0b638dc', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=71938) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 24 16:34:14.699525 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9b0aba0-63b7-4c10-b46f-1afcd353c91f admin admin] REQUEST_METHOD: `GET` {{(pid=71938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 24 16:34:14.699931 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9b0aba0-63b7-4c10-b46f-1afcd353c91f admin admin] SCRIPT_NAME: `/identity` {{(pid=71938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 24 16:34:14.701622 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9b0aba0-63b7-4c10-b46f-1afcd353c91f admin admin] PATH_INFO: `/v3/services` {{(pid=71938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 24 16:34:14.702567 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9b0aba0-63b7-4c10-b46f-1afcd353c91f admin admin] RBAC: Adding query filter params (name=object-store) {{(pid=71938) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:161}} Nov 24 16:34:14.702899 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9b0aba0-63b7-4c10-b46f-1afcd353c91f admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=71938) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:442}} Nov 24 16:34:14.730859 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9b0aba0-63b7-4c10-b46f-1afcd353c91f admin admin] RBAC: Authorization granted {{(pid=71938) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 24 16:34:14.738452 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: [pid: 71938|app: 0|req: 559/1117] 10.222.0.53 () {56 vars in 1134 bytes} [Wed Nov 24 16:34:14 2021] GET /identity/v3/services?name=object-store => generated 129 bytes in 57 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 24 16:34:14.745772 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-803945c9-910e-4488-b87c-373e717406b6 admin admin] Authenticating user token {{(pid=71939) process_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 24 16:34:14.758296 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-803945c9-910e-4488-b87c-373e717406b6 admin admin] Validating token access rules against request {{(pid=71939) validate_allowed_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 24 16:34:14.764040 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-992464eb-afc6-4974-934e-427e94e6face admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f2ba2e8375b4e8c8792ee1e22b60427', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '00a5583c7b7443e98e7a1d31a0b638dc', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=71939) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 24 16:34:14.764749 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-992464eb-afc6-4974-934e-427e94e6face admin admin] REQUEST_METHOD: `GET` {{(pid=71939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 24 16:34:14.765085 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-992464eb-afc6-4974-934e-427e94e6face admin admin] SCRIPT_NAME: `/identity` {{(pid=71939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 24 16:34:14.765429 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-992464eb-afc6-4974-934e-427e94e6face admin admin] PATH_INFO: `/v3/services` {{(pid=71939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 24 16:34:14.766454 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-992464eb-afc6-4974-934e-427e94e6face admin admin] RBAC: Adding query filter params (type=object-store) {{(pid=71939) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:161}} Nov 24 16:34:14.766807 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-992464eb-afc6-4974-934e-427e94e6face admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=71939) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:442}} Nov 24 16:34:14.801339 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-992464eb-afc6-4974-934e-427e94e6face admin admin] RBAC: Authorization granted {{(pid=71939) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 24 16:34:14.807311 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: [pid: 71939|app: 0|req: 559/1118] 10.222.0.53 () {56 vars in 1134 bytes} [Wed Nov 24 16:34:14 2021] GET /identity/v3/services?type=object-store => generated 356 bytes in 62 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 24 16:34:14.814348 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9b0aba0-63b7-4c10-b46f-1afcd353c91f admin admin] Authenticating user token {{(pid=71938) process_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 24 16:34:14.824473 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9b0aba0-63b7-4c10-b46f-1afcd353c91f admin admin] Validating token access rules against request {{(pid=71938) validate_allowed_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 24 16:34:14.829708 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1c848a8-e352-4d6f-8229-96b12ca700e1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f2ba2e8375b4e8c8792ee1e22b60427', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '00a5583c7b7443e98e7a1d31a0b638dc', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=71938) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 24 16:34:14.830433 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1c848a8-e352-4d6f-8229-96b12ca700e1 admin admin] REQUEST_METHOD: `POST` {{(pid=71938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 24 16:34:14.830779 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1c848a8-e352-4d6f-8229-96b12ca700e1 admin admin] SCRIPT_NAME: `/identity` {{(pid=71938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 24 16:34:14.831116 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1c848a8-e352-4d6f-8229-96b12ca700e1 admin admin] PATH_INFO: `/v3/endpoints` {{(pid=71938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 24 16:34:14.831907 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1c848a8-e352-4d6f-8229-96b12ca700e1 admin admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=71938) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:442}} Nov 24 16:34:14.863891 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1c848a8-e352-4d6f-8229-96b12ca700e1 admin admin] RBAC: Authorization granted {{(pid=71938) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 24 16:34:14.882987 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: [pid: 71938|app: 0|req: 560/1119] 10.222.0.53 () {60 vars in 1156 bytes} [Wed Nov 24 16:34:14 2021] POST /identity/v3/endpoints => generated 325 bytes in 69 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 24 16:34:16.944092 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fb1545f-743f-4937-9b82-e350c9c6d2f5 None None] REQUEST_METHOD: `GET` {{(pid=71939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 24 16:34:16.944644 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fb1545f-743f-4937-9b82-e350c9c6d2f5 None None] SCRIPT_NAME: `/identity` {{(pid=71939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 24 16:34:16.944768 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fb1545f-743f-4937-9b82-e350c9c6d2f5 None None] PATH_INFO: `/` {{(pid=71939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 24 16:34:16.946619 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: [pid: 71939|app: 0|req: 560/1120] 10.222.0.53 () {54 vars in 915 bytes} [Wed Nov 24 16:34:16 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 24 16:34:16.952540 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f75e8a95-8979-4901-8c09-aff51f70efa6 None None] REQUEST_METHOD: `POST` {{(pid=71938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 24 16:34:16.952894 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f75e8a95-8979-4901-8c09-aff51f70efa6 None None] SCRIPT_NAME: `/identity` {{(pid=71938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 24 16:34:16.953232 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f75e8a95-8979-4901-8c09-aff51f70efa6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=71938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 24 16:34:16.977049 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.auth.core [None req-f75e8a95-8979-4901-8c09-aff51f70efa6 None None] MFA Rules not processed for user `0f2ba2e8375b4e8c8792ee1e22b60427`. Rule list: `[]` (Enabled: `True`). {{(pid=71938) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:442}} Nov 24 16:34:16.978288 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.fernet_utils [None req-f75e8a95-8979-4901-8c09-aff51f70efa6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=71938) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:289}} Nov 24 16:34:16.996889 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: [pid: 71938|app: 0|req: 561/1121] 10.222.0.53 () {58 vars in 1013 bytes} [Wed Nov 24 16:34:16 2021] POST /identity/v3/auth/tokens => generated 3413 bytes in 46 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 24 16:34:17.019369 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6355e219-cd57-42d7-a90a-ebc02328c5bf None None] REQUEST_METHOD: `POST` {{(pid=71939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 24 16:34:17.019720 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6355e219-cd57-42d7-a90a-ebc02328c5bf None None] SCRIPT_NAME: `/identity` {{(pid=71939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 24 16:34:17.020064 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6355e219-cd57-42d7-a90a-ebc02328c5bf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=71939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 24 16:34:17.044786 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.auth.core [None req-6355e219-cd57-42d7-a90a-ebc02328c5bf None None] MFA Rules not processed for user `0f2ba2e8375b4e8c8792ee1e22b60427`. Rule list: `[]` (Enabled: `True`). {{(pid=71939) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:442}} Nov 24 16:34:17.046000 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.fernet_utils [None req-6355e219-cd57-42d7-a90a-ebc02328c5bf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=71939) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:289}} Nov 24 16:34:17.053274 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: [pid: 71939|app: 0|req: 561/1122] 10.222.0.53 () {58 vars in 1013 bytes} [Wed Nov 24 16:34:17 2021] POST /identity/v3/auth/tokens => generated 3413 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 24 16:34:17.059463 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f75e8a95-8979-4901-8c09-aff51f70efa6 None None] Authenticating user token {{(pid=71938) process_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 24 16:34:17.069192 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f75e8a95-8979-4901-8c09-aff51f70efa6 None None] Validating token access rules against request {{(pid=71938) validate_allowed_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 24 16:34:17.073498 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf0aaa61-f239-4329-834f-7796de037909 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f2ba2e8375b4e8c8792ee1e22b60427', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '00a5583c7b7443e98e7a1d31a0b638dc', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=71938) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 24 16:34:17.074330 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf0aaa61-f239-4329-834f-7796de037909 admin admin] REQUEST_METHOD: `GET` {{(pid=71938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 24 16:34:17.074667 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf0aaa61-f239-4329-834f-7796de037909 admin admin] SCRIPT_NAME: `/identity` {{(pid=71938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 24 16:34:17.075496 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf0aaa61-f239-4329-834f-7796de037909 admin admin] PATH_INFO: `/v3/domains/default` {{(pid=71938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 24 16:34:17.076940 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf0aaa61-f239-4329-834f-7796de037909 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=71938) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:442}} Nov 24 16:34:17.106131 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf0aaa61-f239-4329-834f-7796de037909 admin admin] RBAC: Authorization granted {{(pid=71938) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 24 16:34:17.107907 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: [pid: 71938|app: 0|req: 562/1123] 10.222.0.53 () {56 vars in 1120 bytes} [Wed Nov 24 16:34:17 2021] GET /identity/v3/domains/default => generated 199 bytes in 49 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 24 16:34:17.114268 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6355e219-cd57-42d7-a90a-ebc02328c5bf None None] Authenticating user token {{(pid=71939) process_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 24 16:34:17.123757 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6355e219-cd57-42d7-a90a-ebc02328c5bf None None] Validating token access rules against request {{(pid=71939) validate_allowed_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 24 16:34:17.129231 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-767415aa-ed19-45bc-b0fa-6b8565cc1f42 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f2ba2e8375b4e8c8792ee1e22b60427', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '00a5583c7b7443e98e7a1d31a0b638dc', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=71939) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 24 16:34:17.129896 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-767415aa-ed19-45bc-b0fa-6b8565cc1f42 admin admin] REQUEST_METHOD: `POST` {{(pid=71939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 24 16:34:17.130279 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-767415aa-ed19-45bc-b0fa-6b8565cc1f42 admin admin] SCRIPT_NAME: `/identity` {{(pid=71939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 24 16:34:17.130654 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-767415aa-ed19-45bc-b0fa-6b8565cc1f42 admin admin] PATH_INFO: `/v3/projects` {{(pid=71939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 24 16:34:17.131785 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-767415aa-ed19-45bc-b0fa-6b8565cc1f42 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=71939) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:442}} Nov 24 16:34:17.161888 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-767415aa-ed19-45bc-b0fa-6b8565cc1f42 admin admin] RBAC: Authorization granted {{(pid=71939) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 24 16:34:17.188807 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: [pid: 71939|app: 0|req: 562/1124] 10.222.0.53 () {60 vars in 1152 bytes} [Wed Nov 24 16:34:17 2021] POST /identity/v3/projects => generated 311 bytes in 75 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 24 16:34:19.251192 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9f655db-3714-4ed6-b237-98b786f5494d None None] REQUEST_METHOD: `GET` {{(pid=71938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 24 16:34:19.251674 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9f655db-3714-4ed6-b237-98b786f5494d None None] SCRIPT_NAME: `/identity` {{(pid=71938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 24 16:34:19.251856 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9f655db-3714-4ed6-b237-98b786f5494d None None] PATH_INFO: `/` {{(pid=71938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 24 16:34:19.253707 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: [pid: 71938|app: 0|req: 563/1125] 10.222.0.53 () {54 vars in 915 bytes} [Wed Nov 24 16:34:19 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 24 16:34:19.259308 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77f127b3-b4b1-4239-ad82-2085c41a9010 None None] REQUEST_METHOD: `POST` {{(pid=71939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 24 16:34:19.259663 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77f127b3-b4b1-4239-ad82-2085c41a9010 None None] SCRIPT_NAME: `/identity` {{(pid=71939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 24 16:34:19.259998 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77f127b3-b4b1-4239-ad82-2085c41a9010 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=71939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 24 16:34:19.283676 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.auth.core [None req-77f127b3-b4b1-4239-ad82-2085c41a9010 None None] MFA Rules not processed for user `0f2ba2e8375b4e8c8792ee1e22b60427`. Rule list: `[]` (Enabled: `True`). {{(pid=71939) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:442}} Nov 24 16:34:19.284893 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.fernet_utils [None req-77f127b3-b4b1-4239-ad82-2085c41a9010 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=71939) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:289}} Nov 24 16:34:19.354516 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: [pid: 71939|app: 0|req: 563/1126] 10.222.0.53 () {58 vars in 1013 bytes} [Wed Nov 24 16:34:19 2021] POST /identity/v3/auth/tokens => generated 3413 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 24 16:34:19.377014 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8eee0c31-e493-41ac-a00a-275827e339e1 None None] REQUEST_METHOD: `POST` {{(pid=71938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 24 16:34:19.377365 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8eee0c31-e493-41ac-a00a-275827e339e1 None None] SCRIPT_NAME: `/identity` {{(pid=71938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 24 16:34:19.377704 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8eee0c31-e493-41ac-a00a-275827e339e1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=71938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 24 16:34:19.401580 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.auth.core [None req-8eee0c31-e493-41ac-a00a-275827e339e1 None None] MFA Rules not processed for user `0f2ba2e8375b4e8c8792ee1e22b60427`. Rule list: `[]` (Enabled: `True`). {{(pid=71938) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:442}} Nov 24 16:34:19.402836 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.fernet_utils [None req-8eee0c31-e493-41ac-a00a-275827e339e1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=71938) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:289}} Nov 24 16:34:19.410585 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: [pid: 71938|app: 0|req: 564/1127] 10.222.0.53 () {58 vars in 1013 bytes} [Wed Nov 24 16:34:19 2021] POST /identity/v3/auth/tokens => generated 3413 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 24 16:34:19.416600 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77f127b3-b4b1-4239-ad82-2085c41a9010 None None] Authenticating user token {{(pid=71939) process_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 24 16:34:19.426182 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77f127b3-b4b1-4239-ad82-2085c41a9010 None None] Validating token access rules against request {{(pid=71939) validate_allowed_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 24 16:34:19.430528 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08defb11-74f5-4196-832b-5b7dae4ce59e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f2ba2e8375b4e8c8792ee1e22b60427', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '00a5583c7b7443e98e7a1d31a0b638dc', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=71939) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 24 16:34:19.431337 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08defb11-74f5-4196-832b-5b7dae4ce59e admin admin] REQUEST_METHOD: `GET` {{(pid=71939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 24 16:34:19.431675 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08defb11-74f5-4196-832b-5b7dae4ce59e admin admin] SCRIPT_NAME: `/identity` {{(pid=71939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 24 16:34:19.432007 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08defb11-74f5-4196-832b-5b7dae4ce59e admin admin] PATH_INFO: `/v3/domains/default` {{(pid=71939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 24 16:34:19.433187 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08defb11-74f5-4196-832b-5b7dae4ce59e admin admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=71939) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:442}} Nov 24 16:34:19.462058 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08defb11-74f5-4196-832b-5b7dae4ce59e admin admin] RBAC: Authorization granted {{(pid=71939) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 24 16:34:19.463697 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: [pid: 71939|app: 0|req: 564/1128] 10.222.0.53 () {56 vars in 1120 bytes} [Wed Nov 24 16:34:19 2021] GET /identity/v3/domains/default => generated 199 bytes in 48 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 24 16:34:19.470362 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8eee0c31-e493-41ac-a00a-275827e339e1 None None] Authenticating user token {{(pid=71938) process_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 24 16:34:19.479644 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8eee0c31-e493-41ac-a00a-275827e339e1 None None] Validating token access rules against request {{(pid=71938) validate_allowed_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 24 16:34:19.484073 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f50d45c1-ca3f-4a2a-b37d-53f91247f111 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f2ba2e8375b4e8c8792ee1e22b60427', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '00a5583c7b7443e98e7a1d31a0b638dc', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=71938) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 24 16:34:19.484754 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f50d45c1-ca3f-4a2a-b37d-53f91247f111 admin admin] REQUEST_METHOD: `POST` {{(pid=71938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 24 16:34:19.485097 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f50d45c1-ca3f-4a2a-b37d-53f91247f111 admin admin] SCRIPT_NAME: `/identity` {{(pid=71938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 24 16:34:19.485433 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f50d45c1-ca3f-4a2a-b37d-53f91247f111 admin admin] PATH_INFO: `/v3/users` {{(pid=71938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 24 16:34:19.486210 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f50d45c1-ca3f-4a2a-b37d-53f91247f111 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=71938) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:442}} Nov 24 16:34:19.515537 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f50d45c1-ca3f-4a2a-b37d-53f91247f111 admin admin] RBAC: Authorization granted {{(pid=71938) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 24 16:34:19.536944 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: [pid: 71938|app: 0|req: 565/1129] 10.222.0.53 () {60 vars in 1144 bytes} [Wed Nov 24 16:34:19 2021] POST /identity/v3/users => generated 285 bytes in 67 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 24 16:34:21.571898 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdf45f28-09a4-4862-b0bb-1d6892517027 None None] REQUEST_METHOD: `GET` {{(pid=71939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 24 16:34:21.572436 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdf45f28-09a4-4862-b0bb-1d6892517027 None None] SCRIPT_NAME: `/identity` {{(pid=71939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 24 16:34:21.572436 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdf45f28-09a4-4862-b0bb-1d6892517027 None None] PATH_INFO: `/` {{(pid=71939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 24 16:34:21.574447 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: [pid: 71939|app: 0|req: 565/1130] 10.222.0.53 () {54 vars in 915 bytes} [Wed Nov 24 16:34:21 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Nov 24 16:34:21.581038 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88fccc28-ec97-4d3e-8e63-ab6d86e8a7a6 None None] REQUEST_METHOD: `POST` {{(pid=71938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 24 16:34:21.581390 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88fccc28-ec97-4d3e-8e63-ab6d86e8a7a6 None None] SCRIPT_NAME: `/identity` {{(pid=71938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 24 16:34:21.581726 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88fccc28-ec97-4d3e-8e63-ab6d86e8a7a6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=71938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 24 16:34:21.605180 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.auth.core [None req-88fccc28-ec97-4d3e-8e63-ab6d86e8a7a6 None None] MFA Rules not processed for user `0f2ba2e8375b4e8c8792ee1e22b60427`. Rule list: `[]` (Enabled: `True`). {{(pid=71938) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:442}} Nov 24 16:34:21.606928 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.fernet_utils [None req-88fccc28-ec97-4d3e-8e63-ab6d86e8a7a6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=71938) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:289}} Nov 24 16:34:21.614153 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: [pid: 71938|app: 0|req: 566/1131] 10.222.0.53 () {58 vars in 1013 bytes} [Wed Nov 24 16:34:21 2021] POST /identity/v3/auth/tokens => generated 3413 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 24 16:34:21.636723 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da9cb2dc-b0b2-4465-aea6-3a5c3665e5b1 None None] REQUEST_METHOD: `POST` {{(pid=71939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 24 16:34:21.637071 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da9cb2dc-b0b2-4465-aea6-3a5c3665e5b1 None None] SCRIPT_NAME: `/identity` {{(pid=71939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 24 16:34:21.637437 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da9cb2dc-b0b2-4465-aea6-3a5c3665e5b1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=71939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 24 16:34:21.660653 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.auth.core [None req-da9cb2dc-b0b2-4465-aea6-3a5c3665e5b1 None None] MFA Rules not processed for user `0f2ba2e8375b4e8c8792ee1e22b60427`. Rule list: `[]` (Enabled: `True`). {{(pid=71939) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:442}} Nov 24 16:34:21.661867 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.fernet_utils [None req-da9cb2dc-b0b2-4465-aea6-3a5c3665e5b1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=71939) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:289}} Nov 24 16:34:21.669626 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: [pid: 71939|app: 0|req: 566/1132] 10.222.0.53 () {58 vars in 1013 bytes} [Wed Nov 24 16:34:21 2021] POST /identity/v3/auth/tokens => generated 3413 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 24 16:34:21.675492 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88fccc28-ec97-4d3e-8e63-ab6d86e8a7a6 None None] Authenticating user token {{(pid=71938) process_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 24 16:34:21.685712 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88fccc28-ec97-4d3e-8e63-ab6d86e8a7a6 None None] Validating token access rules against request {{(pid=71938) validate_allowed_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 24 16:34:21.689986 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2682a92-098c-4212-bdba-bde2832158bd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f2ba2e8375b4e8c8792ee1e22b60427', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '00a5583c7b7443e98e7a1d31a0b638dc', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=71938) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 24 16:34:21.690822 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2682a92-098c-4212-bdba-bde2832158bd admin admin] REQUEST_METHOD: `GET` {{(pid=71938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 24 16:34:21.691159 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2682a92-098c-4212-bdba-bde2832158bd admin admin] SCRIPT_NAME: `/identity` {{(pid=71938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 24 16:34:21.691490 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2682a92-098c-4212-bdba-bde2832158bd admin admin] PATH_INFO: `/v3/roles/admin` {{(pid=71938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 24 16:34:21.703298 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2682a92-098c-4212-bdba-bde2832158bd admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=71938) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:401}} Nov 24 16:34:21.710573 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: WARNING keystone.server.flask.application [None req-c2682a92-098c-4212-bdba-bde2832158bd admin admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Nov 24 16:34:21.711739 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: [pid: 71938|app: 0|req: 567/1133] 10.222.0.53 () {56 vars in 1108 bytes} [Wed Nov 24 16:34:21 2021] GET /identity/v3/roles/admin => generated 83 bytes in 37 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 24 16:34:21.718272 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da9cb2dc-b0b2-4465-aea6-3a5c3665e5b1 None None] Authenticating user token {{(pid=71939) process_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 24 16:34:21.727317 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da9cb2dc-b0b2-4465-aea6-3a5c3665e5b1 None None] Validating token access rules against request {{(pid=71939) validate_allowed_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 24 16:34:21.732216 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f98198f-cf78-4f2d-86e8-086f82356cb3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f2ba2e8375b4e8c8792ee1e22b60427', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '00a5583c7b7443e98e7a1d31a0b638dc', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=71939) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 24 16:34:21.732879 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f98198f-cf78-4f2d-86e8-086f82356cb3 admin admin] REQUEST_METHOD: `GET` {{(pid=71939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 24 16:34:21.733220 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f98198f-cf78-4f2d-86e8-086f82356cb3 admin admin] SCRIPT_NAME: `/identity` {{(pid=71939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 24 16:34:21.733555 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f98198f-cf78-4f2d-86e8-086f82356cb3 admin admin] PATH_INFO: `/v3/roles` {{(pid=71939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 24 16:34:21.734396 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f98198f-cf78-4f2d-86e8-086f82356cb3 admin admin] RBAC: Adding query filter params (name=admin) {{(pid=71939) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:161}} Nov 24 16:34:21.734748 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f98198f-cf78-4f2d-86e8-086f82356cb3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=71939) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:442}} Nov 24 16:34:21.763195 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f98198f-cf78-4f2d-86e8-086f82356cb3 admin admin] RBAC: Authorization granted {{(pid=71939) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 24 16:34:21.772237 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: [pid: 71939|app: 0|req: 567/1134] 10.222.0.53 () {56 vars in 1111 bytes} [Wed Nov 24 16:34:21 2021] GET /identity/v3/roles?name=admin => generated 339 bytes in 54 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 24 16:34:21.778156 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2682a92-098c-4212-bdba-bde2832158bd admin admin] Authenticating user token {{(pid=71938) process_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 24 16:34:21.788321 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2682a92-098c-4212-bdba-bde2832158bd admin admin] Validating token access rules against request {{(pid=71938) validate_allowed_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 24 16:34:21.792630 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e8f5093-b760-46ca-8f1a-152dca0d1c8c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f2ba2e8375b4e8c8792ee1e22b60427', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '00a5583c7b7443e98e7a1d31a0b638dc', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=71938) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 24 16:34:21.794005 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e8f5093-b760-46ca-8f1a-152dca0d1c8c admin admin] REQUEST_METHOD: `GET` {{(pid=71938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 24 16:34:21.794398 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e8f5093-b760-46ca-8f1a-152dca0d1c8c admin admin] SCRIPT_NAME: `/identity` {{(pid=71938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 24 16:34:21.794726 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e8f5093-b760-46ca-8f1a-152dca0d1c8c admin admin] PATH_INFO: `/v3/users/fa7ab8b6ab92447ba4bd0cbe4f158f5e` {{(pid=71938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 24 16:34:21.814270 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e8f5093-b760-46ca-8f1a-152dca0d1c8c admin admin] RBAC: Authorizing `identity:get_user(user_id=fa7ab8b6ab92447ba4bd0cbe4f158f5e)` {{(pid=71938) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:442}} Nov 24 16:34:21.843301 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e8f5093-b760-46ca-8f1a-152dca0d1c8c admin admin] RBAC: Authorization granted {{(pid=71938) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 24 16:34:21.844951 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: [pid: 71938|app: 0|req: 568/1135] 10.222.0.53 () {56 vars in 1189 bytes} [Wed Nov 24 16:34:21 2021] GET /identity/v3/users/fa7ab8b6ab92447ba4bd0cbe4f158f5e => generated 285 bytes in 67 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 24 16:34:21.851147 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f98198f-cf78-4f2d-86e8-086f82356cb3 admin admin] Authenticating user token {{(pid=71939) process_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 24 16:34:21.861612 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f98198f-cf78-4f2d-86e8-086f82356cb3 admin admin] Validating token access rules against request {{(pid=71939) validate_allowed_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 24 16:34:21.865999 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b2d688f-45a7-4554-a737-014884af3624 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f2ba2e8375b4e8c8792ee1e22b60427', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '00a5583c7b7443e98e7a1d31a0b638dc', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=71939) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 24 16:34:21.866691 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b2d688f-45a7-4554-a737-014884af3624 admin admin] REQUEST_METHOD: `GET` {{(pid=71939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 24 16:34:21.867030 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b2d688f-45a7-4554-a737-014884af3624 admin admin] SCRIPT_NAME: `/identity` {{(pid=71939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 24 16:34:21.867363 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b2d688f-45a7-4554-a737-014884af3624 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=71939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 24 16:34:21.876006 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b2d688f-45a7-4554-a737-014884af3624 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=71939) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:442}} Nov 24 16:34:21.903937 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b2d688f-45a7-4554-a737-014884af3624 admin admin] RBAC: Authorization granted {{(pid=71939) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 24 16:34:21.912877 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: [pid: 71939|app: 0|req: 568/1136] 10.222.0.53 () {58 vars in 1315 bytes} [Wed Nov 24 16:34:21 2021] GET /identity/v3/auth/tokens => generated 3413 bytes in 62 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 24 16:34:21.919431 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e8f5093-b760-46ca-8f1a-152dca0d1c8c admin admin] Authenticating user token {{(pid=71938) process_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 24 16:34:21.929276 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e8f5093-b760-46ca-8f1a-152dca0d1c8c admin admin] Validating token access rules against request {{(pid=71938) validate_allowed_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 24 16:34:21.933614 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51ca128a-635b-475a-a709-d6c183c7d4b5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f2ba2e8375b4e8c8792ee1e22b60427', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '00a5583c7b7443e98e7a1d31a0b638dc', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=71938) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 24 16:34:21.935095 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51ca128a-635b-475a-a709-d6c183c7d4b5 admin admin] REQUEST_METHOD: `GET` {{(pid=71938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 24 16:34:21.935433 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51ca128a-635b-475a-a709-d6c183c7d4b5 admin admin] SCRIPT_NAME: `/identity` {{(pid=71938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 24 16:34:21.935765 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51ca128a-635b-475a-a709-d6c183c7d4b5 admin admin] PATH_INFO: `/v3/projects/9a201f3aac424f189726a7325dabb612` {{(pid=71938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 24 16:34:21.936968 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51ca128a-635b-475a-a709-d6c183c7d4b5 admin admin] RBAC: Authorizing `identity:get_project(project_id=9a201f3aac424f189726a7325dabb612)` {{(pid=71938) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:442}} Nov 24 16:34:21.966436 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51ca128a-635b-475a-a709-d6c183c7d4b5 admin admin] RBAC: Authorization granted {{(pid=71938) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 24 16:34:21.968176 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: [pid: 71938|app: 0|req: 569/1137] 10.222.0.53 () {56 vars in 1198 bytes} [Wed Nov 24 16:34:21 2021] GET /identity/v3/projects/9a201f3aac424f189726a7325dabb612 => generated 311 bytes in 50 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 24 16:34:21.974303 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b2d688f-45a7-4554-a737-014884af3624 admin admin] Authenticating user token {{(pid=71939) process_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 24 16:34:21.983909 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b2d688f-45a7-4554-a737-014884af3624 admin admin] Validating token access rules against request {{(pid=71939) validate_allowed_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 24 16:34:21.988336 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00c0754c-9237-4d33-b2ad-adde49f57d44 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f2ba2e8375b4e8c8792ee1e22b60427', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '00a5583c7b7443e98e7a1d31a0b638dc', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=71939) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 24 16:34:21.988983 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00c0754c-9237-4d33-b2ad-adde49f57d44 admin admin] REQUEST_METHOD: `GET` {{(pid=71939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 24 16:34:21.989326 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00c0754c-9237-4d33-b2ad-adde49f57d44 admin admin] SCRIPT_NAME: `/identity` {{(pid=71939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 24 16:34:21.989661 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00c0754c-9237-4d33-b2ad-adde49f57d44 admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=71939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 24 16:34:21.990581 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00c0754c-9237-4d33-b2ad-adde49f57d44 admin admin] RBAC: Adding query filter params (role.id=5611724e350b41e19921b5961a342582, scope.project.id=9a201f3aac424f189726a7325dabb612, user.id=fa7ab8b6ab92447ba4bd0cbe4f158f5e) {{(pid=71939) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:161}} Nov 24 16:34:21.990941 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00c0754c-9237-4d33-b2ad-adde49f57d44 admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=71939) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:442}} Nov 24 16:34:22.019136 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00c0754c-9237-4d33-b2ad-adde49f57d44 admin admin] RBAC: Authorization granted {{(pid=71939) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 24 16:34:22.024719 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: [pid: 71939|app: 0|req: 569/1138] 10.222.0.53 () {56 vars in 1386 bytes} [Wed Nov 24 16:34:21 2021] GET /identity/v3/role_assignments?user.id=fa7ab8b6ab92447ba4bd0cbe4f158f5e&scope.project.id=9a201f3aac424f189726a7325dabb612&role.id=5611724e350b41e19921b5961a342582 => generated 259 bytes in 51 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 24 16:34:24.002972 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ecb5a82-e19a-4279-8a39-2190f8360b2d None None] REQUEST_METHOD: `GET` {{(pid=71938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 24 16:34:24.003521 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ecb5a82-e19a-4279-8a39-2190f8360b2d None None] SCRIPT_NAME: `/identity` {{(pid=71938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 24 16:34:24.003646 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ecb5a82-e19a-4279-8a39-2190f8360b2d None None] PATH_INFO: `/` {{(pid=71938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 24 16:34:24.005447 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: [pid: 71938|app: 0|req: 570/1139] 10.222.0.53 () {54 vars in 915 bytes} [Wed Nov 24 16:34:24 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 24 16:34:24.010999 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4885882a-0b16-42e3-9dca-8845cca1d23b None None] REQUEST_METHOD: `POST` {{(pid=71939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 24 16:34:24.011355 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4885882a-0b16-42e3-9dca-8845cca1d23b None None] SCRIPT_NAME: `/identity` {{(pid=71939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 24 16:34:24.011694 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4885882a-0b16-42e3-9dca-8845cca1d23b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=71939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 24 16:34:24.035070 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.auth.core [None req-4885882a-0b16-42e3-9dca-8845cca1d23b None None] MFA Rules not processed for user `0f2ba2e8375b4e8c8792ee1e22b60427`. Rule list: `[]` (Enabled: `True`). {{(pid=71939) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:442}} Nov 24 16:34:24.036293 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.fernet_utils [None req-4885882a-0b16-42e3-9dca-8845cca1d23b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=71939) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:289}} Nov 24 16:34:24.044117 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: [pid: 71939|app: 0|req: 570/1140] 10.222.0.53 () {58 vars in 1013 bytes} [Wed Nov 24 16:34:24 2021] POST /identity/v3/auth/tokens => generated 3413 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 24 16:34:24.066341 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ff4239f-5560-4d7b-bec8-0a203176ac1c None None] REQUEST_METHOD: `POST` {{(pid=71938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 24 16:34:24.066696 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ff4239f-5560-4d7b-bec8-0a203176ac1c None None] SCRIPT_NAME: `/identity` {{(pid=71938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 24 16:34:24.067038 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ff4239f-5560-4d7b-bec8-0a203176ac1c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=71938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 24 16:34:24.091080 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.auth.core [None req-2ff4239f-5560-4d7b-bec8-0a203176ac1c None None] MFA Rules not processed for user `0f2ba2e8375b4e8c8792ee1e22b60427`. Rule list: `[]` (Enabled: `True`). {{(pid=71938) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:442}} Nov 24 16:34:24.092306 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.fernet_utils [None req-2ff4239f-5560-4d7b-bec8-0a203176ac1c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=71938) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:289}} Nov 24 16:34:24.099697 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: [pid: 71938|app: 0|req: 571/1141] 10.222.0.53 () {58 vars in 1013 bytes} [Wed Nov 24 16:34:24 2021] POST /identity/v3/auth/tokens => generated 3413 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 24 16:34:24.106662 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4885882a-0b16-42e3-9dca-8845cca1d23b None None] Authenticating user token {{(pid=71939) process_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 24 16:34:24.116276 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4885882a-0b16-42e3-9dca-8845cca1d23b None None] Validating token access rules against request {{(pid=71939) validate_allowed_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 24 16:34:24.120591 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-774062b4-a764-48eb-bbdd-87c9fa18a440 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f2ba2e8375b4e8c8792ee1e22b60427', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '00a5583c7b7443e98e7a1d31a0b638dc', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=71939) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 24 16:34:24.121398 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-774062b4-a764-48eb-bbdd-87c9fa18a440 admin admin] REQUEST_METHOD: `GET` {{(pid=71939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 24 16:34:24.122385 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-774062b4-a764-48eb-bbdd-87c9fa18a440 admin admin] SCRIPT_NAME: `/identity` {{(pid=71939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 24 16:34:24.122718 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-774062b4-a764-48eb-bbdd-87c9fa18a440 admin admin] PATH_INFO: `/v3/roles/admin` {{(pid=71939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 24 16:34:24.134398 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-774062b4-a764-48eb-bbdd-87c9fa18a440 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=71939) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:401}} Nov 24 16:34:24.141693 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: WARNING keystone.server.flask.application [None req-774062b4-a764-48eb-bbdd-87c9fa18a440 admin admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Nov 24 16:34:24.142975 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: [pid: 71939|app: 0|req: 571/1142] 10.222.0.53 () {56 vars in 1108 bytes} [Wed Nov 24 16:34:24 2021] GET /identity/v3/roles/admin => generated 83 bytes in 37 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 24 16:34:24.149542 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ff4239f-5560-4d7b-bec8-0a203176ac1c None None] Authenticating user token {{(pid=71938) process_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 24 16:34:24.158759 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ff4239f-5560-4d7b-bec8-0a203176ac1c None None] Validating token access rules against request {{(pid=71938) validate_allowed_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 24 16:34:24.163253 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86470c09-aa83-411a-a81a-7947da8ea6b9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f2ba2e8375b4e8c8792ee1e22b60427', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '00a5583c7b7443e98e7a1d31a0b638dc', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=71938) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 24 16:34:24.163918 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86470c09-aa83-411a-a81a-7947da8ea6b9 admin admin] REQUEST_METHOD: `GET` {{(pid=71938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 24 16:34:24.164259 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86470c09-aa83-411a-a81a-7947da8ea6b9 admin admin] SCRIPT_NAME: `/identity` {{(pid=71938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 24 16:34:24.164596 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86470c09-aa83-411a-a81a-7947da8ea6b9 admin admin] PATH_INFO: `/v3/roles` {{(pid=71938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 24 16:34:24.165405 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86470c09-aa83-411a-a81a-7947da8ea6b9 admin admin] RBAC: Adding query filter params (name=admin) {{(pid=71938) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:161}} Nov 24 16:34:24.165763 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86470c09-aa83-411a-a81a-7947da8ea6b9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=71938) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:442}} Nov 24 16:34:24.195092 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86470c09-aa83-411a-a81a-7947da8ea6b9 admin admin] RBAC: Authorization granted {{(pid=71938) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 24 16:34:24.204739 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: [pid: 71938|app: 0|req: 572/1143] 10.222.0.53 () {56 vars in 1111 bytes} [Wed Nov 24 16:34:24 2021] GET /identity/v3/roles?name=admin => generated 339 bytes in 56 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 24 16:34:24.211082 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-774062b4-a764-48eb-bbdd-87c9fa18a440 admin admin] Authenticating user token {{(pid=71939) process_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 24 16:34:24.221745 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-774062b4-a764-48eb-bbdd-87c9fa18a440 admin admin] Validating token access rules against request {{(pid=71939) validate_allowed_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 24 16:34:24.226199 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-336eb970-5fd7-4f5b-bd8f-8e7b56f195f9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f2ba2e8375b4e8c8792ee1e22b60427', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '00a5583c7b7443e98e7a1d31a0b638dc', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=71939) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 24 16:34:24.227073 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-336eb970-5fd7-4f5b-bd8f-8e7b56f195f9 admin admin] REQUEST_METHOD: `GET` {{(pid=71939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 24 16:34:24.227407 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-336eb970-5fd7-4f5b-bd8f-8e7b56f195f9 admin admin] SCRIPT_NAME: `/identity` {{(pid=71939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 24 16:34:24.227736 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-336eb970-5fd7-4f5b-bd8f-8e7b56f195f9 admin admin] PATH_INFO: `/v3/users/fa7ab8b6ab92447ba4bd0cbe4f158f5e` {{(pid=71939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 24 16:34:24.228930 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-336eb970-5fd7-4f5b-bd8f-8e7b56f195f9 admin admin] RBAC: Authorizing `identity:get_user(user_id=fa7ab8b6ab92447ba4bd0cbe4f158f5e)` {{(pid=71939) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:442}} Nov 24 16:34:24.257871 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-336eb970-5fd7-4f5b-bd8f-8e7b56f195f9 admin admin] RBAC: Authorization granted {{(pid=71939) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 24 16:34:24.259510 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: [pid: 71939|app: 0|req: 572/1144] 10.222.0.53 () {56 vars in 1189 bytes} [Wed Nov 24 16:34:24 2021] GET /identity/v3/users/fa7ab8b6ab92447ba4bd0cbe4f158f5e => generated 285 bytes in 49 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 24 16:34:24.265460 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86470c09-aa83-411a-a81a-7947da8ea6b9 admin admin] Authenticating user token {{(pid=71938) process_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 24 16:34:24.275381 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86470c09-aa83-411a-a81a-7947da8ea6b9 admin admin] Validating token access rules against request {{(pid=71938) validate_allowed_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 24 16:34:24.280316 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-927de2ee-6957-4466-807f-a7bee6c3f6cb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f2ba2e8375b4e8c8792ee1e22b60427', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '00a5583c7b7443e98e7a1d31a0b638dc', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=71938) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 24 16:34:24.281183 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-927de2ee-6957-4466-807f-a7bee6c3f6cb admin admin] REQUEST_METHOD: `GET` {{(pid=71938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 24 16:34:24.281525 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-927de2ee-6957-4466-807f-a7bee6c3f6cb admin admin] SCRIPT_NAME: `/identity` {{(pid=71938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 24 16:34:24.281863 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-927de2ee-6957-4466-807f-a7bee6c3f6cb admin admin] PATH_INFO: `/v3/projects/9a201f3aac424f189726a7325dabb612` {{(pid=71938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 24 16:34:24.283100 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-927de2ee-6957-4466-807f-a7bee6c3f6cb admin admin] RBAC: Authorizing `identity:get_project(project_id=9a201f3aac424f189726a7325dabb612)` {{(pid=71938) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:442}} Nov 24 16:34:24.312411 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-927de2ee-6957-4466-807f-a7bee6c3f6cb admin admin] RBAC: Authorization granted {{(pid=71938) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 24 16:34:24.314097 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: [pid: 71938|app: 0|req: 573/1145] 10.222.0.53 () {56 vars in 1198 bytes} [Wed Nov 24 16:34:24 2021] GET /identity/v3/projects/9a201f3aac424f189726a7325dabb612 => generated 311 bytes in 49 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 24 16:34:24.320140 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-336eb970-5fd7-4f5b-bd8f-8e7b56f195f9 admin admin] Authenticating user token {{(pid=71939) process_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 24 16:34:24.330965 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-336eb970-5fd7-4f5b-bd8f-8e7b56f195f9 admin admin] Validating token access rules against request {{(pid=71939) validate_allowed_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 24 16:34:24.335497 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b17fe123-8985-4ffa-857a-27a427ceb7e0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f2ba2e8375b4e8c8792ee1e22b60427', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '00a5583c7b7443e98e7a1d31a0b638dc', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=71939) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 24 16:34:24.336380 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b17fe123-8985-4ffa-857a-27a427ceb7e0 admin admin] REQUEST_METHOD: `PUT` {{(pid=71939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 24 16:34:24.336718 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b17fe123-8985-4ffa-857a-27a427ceb7e0 admin admin] SCRIPT_NAME: `/identity` {{(pid=71939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 24 16:34:24.337052 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b17fe123-8985-4ffa-857a-27a427ceb7e0 admin admin] PATH_INFO: `/v3/projects/9a201f3aac424f189726a7325dabb612/users/fa7ab8b6ab92447ba4bd0cbe4f158f5e/roles/5611724e350b41e19921b5961a342582` {{(pid=71939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 24 16:34:24.339037 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b17fe123-8985-4ffa-857a-27a427ceb7e0 admin admin] RBAC: Authorizing `identity:create_grant(project_id=9a201f3aac424f189726a7325dabb612, user_id=fa7ab8b6ab92447ba4bd0cbe4f158f5e, role_id=5611724e350b41e19921b5961a342582)` {{(pid=71939) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:442}} Nov 24 16:34:24.369255 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b17fe123-8985-4ffa-857a-27a427ceb7e0 admin admin] RBAC: Authorization granted {{(pid=71939) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 24 16:34:24.380946 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: [pid: 71939|app: 0|req: 573/1146] 10.222.0.53 () {58 vars in 1451 bytes} [Wed Nov 24 16:34:24 2021] PUT /identity/v3/projects/9a201f3aac424f189726a7325dabb612/users/fa7ab8b6ab92447ba4bd0cbe4f158f5e/roles/5611724e350b41e19921b5961a342582 => generated 0 bytes in 61 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 24 16:34:26.349721 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7dba8b4-2aea-43d0-8a73-79a516332c93 None None] REQUEST_METHOD: `GET` {{(pid=71938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 24 16:34:26.350299 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7dba8b4-2aea-43d0-8a73-79a516332c93 None None] SCRIPT_NAME: `/identity` {{(pid=71938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 24 16:34:26.350430 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7dba8b4-2aea-43d0-8a73-79a516332c93 None None] PATH_INFO: `/` {{(pid=71938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 24 16:34:26.352236 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: [pid: 71938|app: 0|req: 574/1147] 10.222.0.53 () {54 vars in 915 bytes} [Wed Nov 24 16:34:26 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 24 16:34:26.358369 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bc94e5f-b5f6-44d9-9ea2-5a94347bc0f8 None None] REQUEST_METHOD: `POST` {{(pid=71939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 24 16:34:26.358720 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bc94e5f-b5f6-44d9-9ea2-5a94347bc0f8 None None] SCRIPT_NAME: `/identity` {{(pid=71939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 24 16:34:26.359052 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bc94e5f-b5f6-44d9-9ea2-5a94347bc0f8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=71939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 24 16:34:26.382810 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.auth.core [None req-0bc94e5f-b5f6-44d9-9ea2-5a94347bc0f8 None None] MFA Rules not processed for user `0f2ba2e8375b4e8c8792ee1e22b60427`. Rule list: `[]` (Enabled: `True`). {{(pid=71939) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:442}} Nov 24 16:34:26.384015 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.fernet_utils [None req-0bc94e5f-b5f6-44d9-9ea2-5a94347bc0f8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=71939) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:289}} Nov 24 16:34:26.451374 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: [pid: 71939|app: 0|req: 574/1148] 10.222.0.53 () {58 vars in 1013 bytes} [Wed Nov 24 16:34:26 2021] POST /identity/v3/auth/tokens => generated 3413 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 24 16:34:26.473723 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d13d127a-e46d-43ba-bc05-95fa138766a0 None None] REQUEST_METHOD: `POST` {{(pid=71938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 24 16:34:26.473987 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d13d127a-e46d-43ba-bc05-95fa138766a0 None None] SCRIPT_NAME: `/identity` {{(pid=71938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 24 16:34:26.474372 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d13d127a-e46d-43ba-bc05-95fa138766a0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=71938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 24 16:34:26.503086 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.auth.core [None req-d13d127a-e46d-43ba-bc05-95fa138766a0 None None] MFA Rules not processed for user `0f2ba2e8375b4e8c8792ee1e22b60427`. Rule list: `[]` (Enabled: `True`). {{(pid=71938) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:442}} Nov 24 16:34:26.504311 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.fernet_utils [None req-d13d127a-e46d-43ba-bc05-95fa138766a0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=71938) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:289}} Nov 24 16:34:26.511685 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: [pid: 71938|app: 0|req: 575/1149] 10.222.0.53 () {58 vars in 1013 bytes} [Wed Nov 24 16:34:26 2021] POST /identity/v3/auth/tokens => generated 3413 bytes in 39 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 24 16:34:26.518629 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bc94e5f-b5f6-44d9-9ea2-5a94347bc0f8 None None] Authenticating user token {{(pid=71939) process_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 24 16:34:26.528522 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bc94e5f-b5f6-44d9-9ea2-5a94347bc0f8 None None] Validating token access rules against request {{(pid=71939) validate_allowed_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 24 16:34:26.533040 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b58af872-95d0-4b3c-9666-7ca17f22be5a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f2ba2e8375b4e8c8792ee1e22b60427', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '00a5583c7b7443e98e7a1d31a0b638dc', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=71939) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 24 16:34:26.533857 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b58af872-95d0-4b3c-9666-7ca17f22be5a admin admin] REQUEST_METHOD: `GET` {{(pid=71939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 24 16:34:26.534230 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b58af872-95d0-4b3c-9666-7ca17f22be5a admin admin] SCRIPT_NAME: `/identity` {{(pid=71939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 24 16:34:26.534566 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b58af872-95d0-4b3c-9666-7ca17f22be5a admin admin] PATH_INFO: `/v3/roles/admin` {{(pid=71939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 24 16:34:26.546547 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b58af872-95d0-4b3c-9666-7ca17f22be5a admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=71939) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:401}} Nov 24 16:34:26.553908 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: WARNING keystone.server.flask.application [None req-b58af872-95d0-4b3c-9666-7ca17f22be5a admin admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Nov 24 16:34:26.555226 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: [pid: 71939|app: 0|req: 575/1150] 10.222.0.53 () {56 vars in 1108 bytes} [Wed Nov 24 16:34:26 2021] GET /identity/v3/roles/admin => generated 83 bytes in 37 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 24 16:34:26.562512 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d13d127a-e46d-43ba-bc05-95fa138766a0 None None] Authenticating user token {{(pid=71938) process_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 24 16:34:26.571714 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d13d127a-e46d-43ba-bc05-95fa138766a0 None None] Validating token access rules against request {{(pid=71938) validate_allowed_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 24 16:34:26.577034 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-988ad3bd-3851-4d68-8b61-c77ee57c2f38 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f2ba2e8375b4e8c8792ee1e22b60427', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '00a5583c7b7443e98e7a1d31a0b638dc', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=71938) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 24 16:34:26.577704 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-988ad3bd-3851-4d68-8b61-c77ee57c2f38 admin admin] REQUEST_METHOD: `GET` {{(pid=71938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 24 16:34:26.578060 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-988ad3bd-3851-4d68-8b61-c77ee57c2f38 admin admin] SCRIPT_NAME: `/identity` {{(pid=71938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 24 16:34:26.578422 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-988ad3bd-3851-4d68-8b61-c77ee57c2f38 admin admin] PATH_INFO: `/v3/roles` {{(pid=71938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 24 16:34:26.579234 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-988ad3bd-3851-4d68-8b61-c77ee57c2f38 admin admin] RBAC: Adding query filter params (name=admin) {{(pid=71938) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:161}} Nov 24 16:34:26.579588 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-988ad3bd-3851-4d68-8b61-c77ee57c2f38 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=71938) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:442}} Nov 24 16:34:26.607772 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-988ad3bd-3851-4d68-8b61-c77ee57c2f38 admin admin] RBAC: Authorization granted {{(pid=71938) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 24 16:34:26.616811 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: [pid: 71938|app: 0|req: 576/1151] 10.222.0.53 () {56 vars in 1111 bytes} [Wed Nov 24 16:34:26 2021] GET /identity/v3/roles?name=admin => generated 339 bytes in 55 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 24 16:34:26.623377 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b58af872-95d0-4b3c-9666-7ca17f22be5a admin admin] Authenticating user token {{(pid=71939) process_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 24 16:34:26.633857 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b58af872-95d0-4b3c-9666-7ca17f22be5a admin admin] Validating token access rules against request {{(pid=71939) validate_allowed_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 24 16:34:26.638796 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c3d8412-5fce-4cef-9fee-2149c07f9d4d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f2ba2e8375b4e8c8792ee1e22b60427', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '00a5583c7b7443e98e7a1d31a0b638dc', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=71939) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 24 16:34:26.639676 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c3d8412-5fce-4cef-9fee-2149c07f9d4d admin admin] REQUEST_METHOD: `GET` {{(pid=71939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 24 16:34:26.640019 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c3d8412-5fce-4cef-9fee-2149c07f9d4d admin admin] SCRIPT_NAME: `/identity` {{(pid=71939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 24 16:34:26.640358 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c3d8412-5fce-4cef-9fee-2149c07f9d4d admin admin] PATH_INFO: `/v3/users/fa7ab8b6ab92447ba4bd0cbe4f158f5e` {{(pid=71939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 24 16:34:26.641579 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c3d8412-5fce-4cef-9fee-2149c07f9d4d admin admin] RBAC: Authorizing `identity:get_user(user_id=fa7ab8b6ab92447ba4bd0cbe4f158f5e)` {{(pid=71939) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:442}} Nov 24 16:34:26.669953 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c3d8412-5fce-4cef-9fee-2149c07f9d4d admin admin] RBAC: Authorization granted {{(pid=71939) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 24 16:34:26.671570 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: [pid: 71939|app: 0|req: 576/1152] 10.222.0.53 () {56 vars in 1189 bytes} [Wed Nov 24 16:34:26 2021] GET /identity/v3/users/fa7ab8b6ab92447ba4bd0cbe4f158f5e => generated 285 bytes in 49 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 24 16:34:26.677390 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-988ad3bd-3851-4d68-8b61-c77ee57c2f38 admin admin] Authenticating user token {{(pid=71938) process_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 24 16:34:26.687689 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-988ad3bd-3851-4d68-8b61-c77ee57c2f38 admin admin] Validating token access rules against request {{(pid=71938) validate_allowed_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 24 16:34:26.691980 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0d9081a-342b-42ab-b91a-d6227a673cfd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f2ba2e8375b4e8c8792ee1e22b60427', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '00a5583c7b7443e98e7a1d31a0b638dc', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=71938) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 24 16:34:26.692614 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0d9081a-342b-42ab-b91a-d6227a673cfd admin admin] REQUEST_METHOD: `GET` {{(pid=71938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 24 16:34:26.692949 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0d9081a-342b-42ab-b91a-d6227a673cfd admin admin] SCRIPT_NAME: `/identity` {{(pid=71938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 24 16:34:26.693276 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0d9081a-342b-42ab-b91a-d6227a673cfd admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=71938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 24 16:34:26.702266 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0d9081a-342b-42ab-b91a-d6227a673cfd admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=71938) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:442}} Nov 24 16:34:26.730389 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0d9081a-342b-42ab-b91a-d6227a673cfd admin admin] RBAC: Authorization granted {{(pid=71938) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 24 16:34:26.739386 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: [pid: 71938|app: 0|req: 577/1153] 10.222.0.53 () {58 vars in 1315 bytes} [Wed Nov 24 16:34:26 2021] GET /identity/v3/auth/tokens => generated 3413 bytes in 62 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 24 16:34:26.745434 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c3d8412-5fce-4cef-9fee-2149c07f9d4d admin admin] Authenticating user token {{(pid=71939) process_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 24 16:34:26.755848 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c3d8412-5fce-4cef-9fee-2149c07f9d4d admin admin] Validating token access rules against request {{(pid=71939) validate_allowed_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 24 16:34:26.760631 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a4c7046-7f37-42d3-a011-b6bda5242bc3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f2ba2e8375b4e8c8792ee1e22b60427', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '00a5583c7b7443e98e7a1d31a0b638dc', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=71939) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 24 16:34:26.761498 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a4c7046-7f37-42d3-a011-b6bda5242bc3 admin admin] REQUEST_METHOD: `GET` {{(pid=71939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 24 16:34:26.761841 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a4c7046-7f37-42d3-a011-b6bda5242bc3 admin admin] SCRIPT_NAME: `/identity` {{(pid=71939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 24 16:34:26.762827 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a4c7046-7f37-42d3-a011-b6bda5242bc3 admin admin] PATH_INFO: `/v3/projects/9a201f3aac424f189726a7325dabb612` {{(pid=71939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 24 16:34:26.764116 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a4c7046-7f37-42d3-a011-b6bda5242bc3 admin admin] RBAC: Authorizing `identity:get_project(project_id=9a201f3aac424f189726a7325dabb612)` {{(pid=71939) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:442}} Nov 24 16:34:26.802325 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a4c7046-7f37-42d3-a011-b6bda5242bc3 admin admin] RBAC: Authorization granted {{(pid=71939) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 24 16:34:26.804168 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: [pid: 71939|app: 0|req: 577/1154] 10.222.0.53 () {56 vars in 1198 bytes} [Wed Nov 24 16:34:26 2021] GET /identity/v3/projects/9a201f3aac424f189726a7325dabb612 => generated 311 bytes in 59 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 24 16:34:26.811298 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0d9081a-342b-42ab-b91a-d6227a673cfd admin admin] Authenticating user token {{(pid=71938) process_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 24 16:34:26.820785 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0d9081a-342b-42ab-b91a-d6227a673cfd admin admin] Validating token access rules against request {{(pid=71938) validate_allowed_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 24 16:34:26.826139 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc951aa0-787d-4645-bcc0-45a669f0ef81 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f2ba2e8375b4e8c8792ee1e22b60427', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '00a5583c7b7443e98e7a1d31a0b638dc', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=71938) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 24 16:34:26.826793 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc951aa0-787d-4645-bcc0-45a669f0ef81 admin admin] REQUEST_METHOD: `GET` {{(pid=71938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 24 16:34:26.827134 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc951aa0-787d-4645-bcc0-45a669f0ef81 admin admin] SCRIPT_NAME: `/identity` {{(pid=71938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 24 16:34:26.827465 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc951aa0-787d-4645-bcc0-45a669f0ef81 admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=71938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 24 16:34:26.828352 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc951aa0-787d-4645-bcc0-45a669f0ef81 admin admin] RBAC: Adding query filter params (role.id=5611724e350b41e19921b5961a342582, scope.project.id=9a201f3aac424f189726a7325dabb612, user.id=fa7ab8b6ab92447ba4bd0cbe4f158f5e) {{(pid=71938) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:161}} Nov 24 16:34:26.828712 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc951aa0-787d-4645-bcc0-45a669f0ef81 admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=71938) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:442}} Nov 24 16:34:26.857619 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc951aa0-787d-4645-bcc0-45a669f0ef81 admin admin] RBAC: Authorization granted {{(pid=71938) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 24 16:34:26.863770 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: [pid: 71938|app: 0|req: 578/1155] 10.222.0.53 () {56 vars in 1386 bytes} [Wed Nov 24 16:34:26 2021] GET /identity/v3/role_assignments?user.id=fa7ab8b6ab92447ba4bd0cbe4f158f5e&scope.project.id=9a201f3aac424f189726a7325dabb612&role.id=5611724e350b41e19921b5961a342582 => generated 608 bytes in 53 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 24 16:34:28.863579 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a37fad2-7c7c-488b-8540-99b69e58a6be None None] REQUEST_METHOD: `GET` {{(pid=71939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 24 16:34:28.864099 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a37fad2-7c7c-488b-8540-99b69e58a6be None None] SCRIPT_NAME: `/identity` {{(pid=71939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 24 16:34:28.864222 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a37fad2-7c7c-488b-8540-99b69e58a6be None None] PATH_INFO: `/` {{(pid=71939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 24 16:34:28.866054 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: [pid: 71939|app: 0|req: 578/1156] 10.222.0.53 () {54 vars in 915 bytes} [Wed Nov 24 16:34:28 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 24 16:34:28.871625 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f9e7943-0287-48c8-86f1-8b56d7851310 None None] REQUEST_METHOD: `POST` {{(pid=71938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 24 16:34:28.871973 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f9e7943-0287-48c8-86f1-8b56d7851310 None None] SCRIPT_NAME: `/identity` {{(pid=71938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 24 16:34:28.872310 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f9e7943-0287-48c8-86f1-8b56d7851310 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=71938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 24 16:34:28.896037 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.auth.core [None req-8f9e7943-0287-48c8-86f1-8b56d7851310 None None] MFA Rules not processed for user `0f2ba2e8375b4e8c8792ee1e22b60427`. Rule list: `[]` (Enabled: `True`). {{(pid=71938) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:442}} Nov 24 16:34:28.897260 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.fernet_utils [None req-8f9e7943-0287-48c8-86f1-8b56d7851310 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=71938) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:289}} Nov 24 16:34:28.905069 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: [pid: 71938|app: 0|req: 579/1157] 10.222.0.53 () {58 vars in 1013 bytes} [Wed Nov 24 16:34:28 2021] POST /identity/v3/auth/tokens => generated 3413 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 24 16:34:28.927774 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8c24a6b-37a6-4728-9fb5-c487800da3fe None None] REQUEST_METHOD: `POST` {{(pid=71939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 24 16:34:28.928168 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8c24a6b-37a6-4728-9fb5-c487800da3fe None None] SCRIPT_NAME: `/identity` {{(pid=71939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 24 16:34:28.928511 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8c24a6b-37a6-4728-9fb5-c487800da3fe None None] PATH_INFO: `/v3/auth/tokens` {{(pid=71939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 24 16:34:28.952277 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.auth.core [None req-e8c24a6b-37a6-4728-9fb5-c487800da3fe None None] MFA Rules not processed for user `0f2ba2e8375b4e8c8792ee1e22b60427`. Rule list: `[]` (Enabled: `True`). {{(pid=71939) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:442}} Nov 24 16:34:28.953510 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.fernet_utils [None req-e8c24a6b-37a6-4728-9fb5-c487800da3fe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=71939) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:289}} Nov 24 16:34:28.960851 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: [pid: 71939|app: 0|req: 579/1158] 10.222.0.53 () {58 vars in 1013 bytes} [Wed Nov 24 16:34:28 2021] POST /identity/v3/auth/tokens => generated 3413 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 24 16:34:28.967543 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f9e7943-0287-48c8-86f1-8b56d7851310 None None] Authenticating user token {{(pid=71938) process_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 24 16:34:28.977241 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f9e7943-0287-48c8-86f1-8b56d7851310 None None] Validating token access rules against request {{(pid=71938) validate_allowed_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 24 16:34:28.981739 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b60b3fa-1a4e-479c-a931-00b4358715f3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f2ba2e8375b4e8c8792ee1e22b60427', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '00a5583c7b7443e98e7a1d31a0b638dc', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=71938) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 24 16:34:28.982601 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b60b3fa-1a4e-479c-a931-00b4358715f3 admin admin] REQUEST_METHOD: `GET` {{(pid=71938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 24 16:34:28.982947 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b60b3fa-1a4e-479c-a931-00b4358715f3 admin admin] SCRIPT_NAME: `/identity` {{(pid=71938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 24 16:34:28.983285 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b60b3fa-1a4e-479c-a931-00b4358715f3 admin admin] PATH_INFO: `/v3/domains/default` {{(pid=71938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 24 16:34:28.984465 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b60b3fa-1a4e-479c-a931-00b4358715f3 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=71938) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:442}} Nov 24 16:34:29.014264 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b60b3fa-1a4e-479c-a931-00b4358715f3 admin admin] RBAC: Authorization granted {{(pid=71938) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 24 16:34:29.015850 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: [pid: 71938|app: 0|req: 580/1159] 10.222.0.53 () {56 vars in 1120 bytes} [Wed Nov 24 16:34:28 2021] GET /identity/v3/domains/default => generated 199 bytes in 49 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 24 16:34:29.021574 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8c24a6b-37a6-4728-9fb5-c487800da3fe None None] Authenticating user token {{(pid=71939) process_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 24 16:34:29.030753 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8c24a6b-37a6-4728-9fb5-c487800da3fe None None] Validating token access rules against request {{(pid=71939) validate_allowed_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 24 16:34:29.035184 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e982181e-127d-4561-9183-cce030f61622 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f2ba2e8375b4e8c8792ee1e22b60427', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '00a5583c7b7443e98e7a1d31a0b638dc', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=71939) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 24 16:34:29.035856 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e982181e-127d-4561-9183-cce030f61622 admin admin] REQUEST_METHOD: `POST` {{(pid=71939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 24 16:34:29.036198 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e982181e-127d-4561-9183-cce030f61622 admin admin] SCRIPT_NAME: `/identity` {{(pid=71939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 24 16:34:29.036532 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e982181e-127d-4561-9183-cce030f61622 admin admin] PATH_INFO: `/v3/users` {{(pid=71939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 24 16:34:29.037281 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e982181e-127d-4561-9183-cce030f61622 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=71939) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:442}} Nov 24 16:34:29.066233 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e982181e-127d-4561-9183-cce030f61622 admin admin] RBAC: Authorization granted {{(pid=71939) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 24 16:34:29.087542 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: [pid: 71939|app: 0|req: 580/1160] 10.222.0.53 () {60 vars in 1144 bytes} [Wed Nov 24 16:34:29 2021] POST /identity/v3/users => generated 286 bytes in 66 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 24 16:34:31.110275 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fb44bdb-9168-488f-b781-2e7d3f3c56e2 None None] REQUEST_METHOD: `GET` {{(pid=71938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 24 16:34:31.110841 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fb44bdb-9168-488f-b781-2e7d3f3c56e2 None None] SCRIPT_NAME: `/identity` {{(pid=71938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 24 16:34:31.110952 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fb44bdb-9168-488f-b781-2e7d3f3c56e2 None None] PATH_INFO: `/` {{(pid=71938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 24 16:34:31.112731 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: [pid: 71938|app: 0|req: 581/1161] 10.222.0.53 () {54 vars in 915 bytes} [Wed Nov 24 16:34:31 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 24 16:34:31.118528 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cbad459-a446-4770-89d6-1139e349cb1d None None] REQUEST_METHOD: `POST` {{(pid=71939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 24 16:34:31.118887 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cbad459-a446-4770-89d6-1139e349cb1d None None] SCRIPT_NAME: `/identity` {{(pid=71939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 24 16:34:31.119227 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cbad459-a446-4770-89d6-1139e349cb1d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=71939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 24 16:34:31.143178 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.auth.core [None req-3cbad459-a446-4770-89d6-1139e349cb1d None None] MFA Rules not processed for user `0f2ba2e8375b4e8c8792ee1e22b60427`. Rule list: `[]` (Enabled: `True`). {{(pid=71939) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:442}} Nov 24 16:34:31.144409 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.fernet_utils [None req-3cbad459-a446-4770-89d6-1139e349cb1d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=71939) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:289}} Nov 24 16:34:31.151969 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: [pid: 71939|app: 0|req: 581/1162] 10.222.0.53 () {58 vars in 1013 bytes} [Wed Nov 24 16:34:31 2021] POST /identity/v3/auth/tokens => generated 3413 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 24 16:34:31.179250 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0eafb35-8539-4fb2-b42f-48089673f78c None None] REQUEST_METHOD: `POST` {{(pid=71938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 24 16:34:31.179708 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0eafb35-8539-4fb2-b42f-48089673f78c None None] SCRIPT_NAME: `/identity` {{(pid=71938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 24 16:34:31.180100 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0eafb35-8539-4fb2-b42f-48089673f78c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=71938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 24 16:34:31.215769 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.auth.core [None req-e0eafb35-8539-4fb2-b42f-48089673f78c None None] MFA Rules not processed for user `0f2ba2e8375b4e8c8792ee1e22b60427`. Rule list: `[]` (Enabled: `True`). {{(pid=71938) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:442}} Nov 24 16:34:31.217038 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.fernet_utils [None req-e0eafb35-8539-4fb2-b42f-48089673f78c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=71938) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:289}} Nov 24 16:34:31.224589 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: [pid: 71938|app: 0|req: 582/1163] 10.222.0.53 () {58 vars in 1013 bytes} [Wed Nov 24 16:34:31 2021] POST /identity/v3/auth/tokens => generated 3413 bytes in 47 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 24 16:34:31.231868 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cbad459-a446-4770-89d6-1139e349cb1d None None] Authenticating user token {{(pid=71939) process_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 24 16:34:31.243067 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cbad459-a446-4770-89d6-1139e349cb1d None None] Validating token access rules against request {{(pid=71939) validate_allowed_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 24 16:34:31.247465 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2085358-a28f-4eae-9430-5963b5f33db6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f2ba2e8375b4e8c8792ee1e22b60427', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '00a5583c7b7443e98e7a1d31a0b638dc', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=71939) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 24 16:34:31.248338 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2085358-a28f-4eae-9430-5963b5f33db6 admin admin] REQUEST_METHOD: `GET` {{(pid=71939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 24 16:34:31.248683 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2085358-a28f-4eae-9430-5963b5f33db6 admin admin] SCRIPT_NAME: `/identity` {{(pid=71939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 24 16:34:31.249010 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2085358-a28f-4eae-9430-5963b5f33db6 admin admin] PATH_INFO: `/v3/roles/0de27ef8b6e744cda429a0d133117dcd` {{(pid=71939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 24 16:34:31.250507 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2085358-a28f-4eae-9430-5963b5f33db6 admin admin] RBAC: Authorizing `identity:get_role(role_id=0de27ef8b6e744cda429a0d133117dcd)` {{(pid=71939) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:442}} Nov 24 16:34:31.278347 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: WARNING py.warnings [None req-d2085358-a28f-4eae-9430-5963b5f33db6 admin admin] /usr/local/lib/python3.6/dist-packages/oslo_policy/policy.py:1018: UserWarning: Policy identity:get_role failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 24 16:34:31.278347 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: warnings.warn(msg) Nov 24 16:34:31.278347 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: Nov 24 16:34:31.279356 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2085358-a28f-4eae-9430-5963b5f33db6 admin admin] RBAC: Authorization granted {{(pid=71939) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 24 16:34:31.280779 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: [pid: 71939|app: 0|req: 582/1164] 10.222.0.53 () {56 vars in 1189 bytes} [Wed Nov 24 16:34:31 2021] GET /identity/v3/roles/0de27ef8b6e744cda429a0d133117dcd => generated 223 bytes in 50 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 24 16:34:31.287053 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0eafb35-8539-4fb2-b42f-48089673f78c None None] Authenticating user token {{(pid=71938) process_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 24 16:34:31.296964 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0eafb35-8539-4fb2-b42f-48089673f78c None None] Validating token access rules against request {{(pid=71938) validate_allowed_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 24 16:34:31.301432 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e0183be-097e-4b5d-9210-0318c73e4eeb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f2ba2e8375b4e8c8792ee1e22b60427', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '00a5583c7b7443e98e7a1d31a0b638dc', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=71938) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 24 16:34:31.302350 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e0183be-097e-4b5d-9210-0318c73e4eeb admin admin] REQUEST_METHOD: `GET` {{(pid=71938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 24 16:34:31.302683 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e0183be-097e-4b5d-9210-0318c73e4eeb admin admin] SCRIPT_NAME: `/identity` {{(pid=71938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 24 16:34:31.303007 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e0183be-097e-4b5d-9210-0318c73e4eeb admin admin] PATH_INFO: `/v3/users/1b2e63172b3a40dcb77f3cff51152aec` {{(pid=71938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 24 16:34:31.322251 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e0183be-097e-4b5d-9210-0318c73e4eeb admin admin] RBAC: Authorizing `identity:get_user(user_id=1b2e63172b3a40dcb77f3cff51152aec)` {{(pid=71938) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:442}} Nov 24 16:34:31.352599 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e0183be-097e-4b5d-9210-0318c73e4eeb admin admin] RBAC: Authorization granted {{(pid=71938) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 24 16:34:31.354311 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: [pid: 71938|app: 0|req: 583/1165] 10.222.0.53 () {56 vars in 1189 bytes} [Wed Nov 24 16:34:31 2021] GET /identity/v3/users/1b2e63172b3a40dcb77f3cff51152aec => generated 286 bytes in 68 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 24 16:34:31.360796 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2085358-a28f-4eae-9430-5963b5f33db6 admin admin] Authenticating user token {{(pid=71939) process_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 24 16:34:31.371016 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2085358-a28f-4eae-9430-5963b5f33db6 admin admin] Validating token access rules against request {{(pid=71939) validate_allowed_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 24 16:34:31.375543 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25f85278-4cf9-4c3b-96bb-13bb13e0c7c8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f2ba2e8375b4e8c8792ee1e22b60427', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '00a5583c7b7443e98e7a1d31a0b638dc', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=71939) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 24 16:34:31.376189 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25f85278-4cf9-4c3b-96bb-13bb13e0c7c8 admin admin] REQUEST_METHOD: `GET` {{(pid=71939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 24 16:34:31.376527 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25f85278-4cf9-4c3b-96bb-13bb13e0c7c8 admin admin] SCRIPT_NAME: `/identity` {{(pid=71939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 24 16:34:31.376861 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25f85278-4cf9-4c3b-96bb-13bb13e0c7c8 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=71939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 24 16:34:31.385032 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25f85278-4cf9-4c3b-96bb-13bb13e0c7c8 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=71939) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:442}} Nov 24 16:34:31.414287 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25f85278-4cf9-4c3b-96bb-13bb13e0c7c8 admin admin] RBAC: Authorization granted {{(pid=71939) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 24 16:34:31.423566 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: [pid: 71939|app: 0|req: 583/1166] 10.222.0.53 () {58 vars in 1315 bytes} [Wed Nov 24 16:34:31 2021] GET /identity/v3/auth/tokens => generated 3413 bytes in 63 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 24 16:34:31.429988 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e0183be-097e-4b5d-9210-0318c73e4eeb admin admin] Authenticating user token {{(pid=71938) process_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 24 16:34:31.439913 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e0183be-097e-4b5d-9210-0318c73e4eeb admin admin] Validating token access rules against request {{(pid=71938) validate_allowed_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 24 16:34:31.444343 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b4e2654-4fd7-4feb-ba88-ffa1001d7c27 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f2ba2e8375b4e8c8792ee1e22b60427', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '00a5583c7b7443e98e7a1d31a0b638dc', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=71938) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 24 16:34:31.445216 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b4e2654-4fd7-4feb-ba88-ffa1001d7c27 admin admin] REQUEST_METHOD: `GET` {{(pid=71938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 24 16:34:31.445554 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b4e2654-4fd7-4feb-ba88-ffa1001d7c27 admin admin] SCRIPT_NAME: `/identity` {{(pid=71938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 24 16:34:31.445886 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b4e2654-4fd7-4feb-ba88-ffa1001d7c27 admin admin] PATH_INFO: `/v3/projects/9a201f3aac424f189726a7325dabb612` {{(pid=71938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 24 16:34:31.447138 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b4e2654-4fd7-4feb-ba88-ffa1001d7c27 admin admin] RBAC: Authorizing `identity:get_project(project_id=9a201f3aac424f189726a7325dabb612)` {{(pid=71938) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:442}} Nov 24 16:34:31.477717 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b4e2654-4fd7-4feb-ba88-ffa1001d7c27 admin admin] RBAC: Authorization granted {{(pid=71938) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 24 16:34:31.479466 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: [pid: 71938|app: 0|req: 584/1167] 10.222.0.53 () {56 vars in 1198 bytes} [Wed Nov 24 16:34:31 2021] GET /identity/v3/projects/9a201f3aac424f189726a7325dabb612 => generated 311 bytes in 50 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 24 16:34:31.486864 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25f85278-4cf9-4c3b-96bb-13bb13e0c7c8 admin admin] Authenticating user token {{(pid=71939) process_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 24 16:34:31.497210 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25f85278-4cf9-4c3b-96bb-13bb13e0c7c8 admin admin] Validating token access rules against request {{(pid=71939) validate_allowed_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 24 16:34:31.502093 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a84e5c9-9ebf-498a-aa38-a0f65c9beb3d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f2ba2e8375b4e8c8792ee1e22b60427', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '00a5583c7b7443e98e7a1d31a0b638dc', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=71939) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 24 16:34:31.502790 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a84e5c9-9ebf-498a-aa38-a0f65c9beb3d admin admin] REQUEST_METHOD: `GET` {{(pid=71939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 24 16:34:31.503132 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a84e5c9-9ebf-498a-aa38-a0f65c9beb3d admin admin] SCRIPT_NAME: `/identity` {{(pid=71939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 24 16:34:31.503468 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a84e5c9-9ebf-498a-aa38-a0f65c9beb3d admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=71939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 24 16:34:31.504377 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a84e5c9-9ebf-498a-aa38-a0f65c9beb3d admin admin] RBAC: Adding query filter params (role.id=0de27ef8b6e744cda429a0d133117dcd, scope.project.id=9a201f3aac424f189726a7325dabb612, user.id=1b2e63172b3a40dcb77f3cff51152aec) {{(pid=71939) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:161}} Nov 24 16:34:31.504736 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a84e5c9-9ebf-498a-aa38-a0f65c9beb3d admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=71939) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:442}} Nov 24 16:34:31.533154 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a84e5c9-9ebf-498a-aa38-a0f65c9beb3d admin admin] RBAC: Authorization granted {{(pid=71939) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 24 16:34:31.539798 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: [pid: 71939|app: 0|req: 584/1168] 10.222.0.53 () {56 vars in 1386 bytes} [Wed Nov 24 16:34:31 2021] GET /identity/v3/role_assignments?user.id=1b2e63172b3a40dcb77f3cff51152aec&scope.project.id=9a201f3aac424f189726a7325dabb612&role.id=0de27ef8b6e744cda429a0d133117dcd => generated 259 bytes in 54 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Nov 24 16:34:33.527240 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a6c1be2-8e2b-405f-ba36-cc6f463c2d6f None None] REQUEST_METHOD: `GET` {{(pid=71938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 24 16:34:33.528254 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a6c1be2-8e2b-405f-ba36-cc6f463c2d6f None None] SCRIPT_NAME: `/identity` {{(pid=71938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 24 16:34:33.528362 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a6c1be2-8e2b-405f-ba36-cc6f463c2d6f None None] PATH_INFO: `/` {{(pid=71938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 24 16:34:33.530169 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: [pid: 71938|app: 0|req: 585/1169] 10.222.0.53 () {54 vars in 915 bytes} [Wed Nov 24 16:34:33 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 24 16:34:33.535771 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b94b0d9e-c412-4ca7-bde0-89d0b2049c10 None None] REQUEST_METHOD: `POST` {{(pid=71939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 24 16:34:33.536101 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b94b0d9e-c412-4ca7-bde0-89d0b2049c10 None None] SCRIPT_NAME: `/identity` {{(pid=71939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 24 16:34:33.536429 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b94b0d9e-c412-4ca7-bde0-89d0b2049c10 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=71939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 24 16:34:33.560532 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.auth.core [None req-b94b0d9e-c412-4ca7-bde0-89d0b2049c10 None None] MFA Rules not processed for user `0f2ba2e8375b4e8c8792ee1e22b60427`. Rule list: `[]` (Enabled: `True`). {{(pid=71939) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:442}} Nov 24 16:34:33.561747 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.fernet_utils [None req-b94b0d9e-c412-4ca7-bde0-89d0b2049c10 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=71939) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:289}} Nov 24 16:34:33.569002 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: [pid: 71939|app: 0|req: 585/1170] 10.222.0.53 () {58 vars in 1013 bytes} [Wed Nov 24 16:34:33 2021] POST /identity/v3/auth/tokens => generated 3413 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 24 16:34:33.592197 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62941fc9-743a-4dc6-a781-2177c41ccc0f None None] REQUEST_METHOD: `POST` {{(pid=71938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 24 16:34:33.592548 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62941fc9-743a-4dc6-a781-2177c41ccc0f None None] SCRIPT_NAME: `/identity` {{(pid=71938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 24 16:34:33.592886 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62941fc9-743a-4dc6-a781-2177c41ccc0f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=71938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 24 16:34:33.618183 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.auth.core [None req-62941fc9-743a-4dc6-a781-2177c41ccc0f None None] MFA Rules not processed for user `0f2ba2e8375b4e8c8792ee1e22b60427`. Rule list: `[]` (Enabled: `True`). {{(pid=71938) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:442}} Nov 24 16:34:33.619438 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.fernet_utils [None req-62941fc9-743a-4dc6-a781-2177c41ccc0f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=71938) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:289}} Nov 24 16:34:33.626694 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: [pid: 71938|app: 0|req: 586/1171] 10.222.0.53 () {58 vars in 1013 bytes} [Wed Nov 24 16:34:33 2021] POST /identity/v3/auth/tokens => generated 3413 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 24 16:34:33.632879 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b94b0d9e-c412-4ca7-bde0-89d0b2049c10 None None] Authenticating user token {{(pid=71939) process_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 24 16:34:33.643078 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b94b0d9e-c412-4ca7-bde0-89d0b2049c10 None None] Validating token access rules against request {{(pid=71939) validate_allowed_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 24 16:34:33.647422 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-459f0850-7935-4c4f-8598-18a1f9305d30 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f2ba2e8375b4e8c8792ee1e22b60427', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '00a5583c7b7443e98e7a1d31a0b638dc', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=71939) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 24 16:34:33.648282 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-459f0850-7935-4c4f-8598-18a1f9305d30 admin admin] REQUEST_METHOD: `GET` {{(pid=71939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 24 16:34:33.648618 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-459f0850-7935-4c4f-8598-18a1f9305d30 admin admin] SCRIPT_NAME: `/identity` {{(pid=71939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 24 16:34:33.648945 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-459f0850-7935-4c4f-8598-18a1f9305d30 admin admin] PATH_INFO: `/v3/roles/0de27ef8b6e744cda429a0d133117dcd` {{(pid=71939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 24 16:34:33.650417 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-459f0850-7935-4c4f-8598-18a1f9305d30 admin admin] RBAC: Authorizing `identity:get_role(role_id=0de27ef8b6e744cda429a0d133117dcd)` {{(pid=71939) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:442}} Nov 24 16:34:33.679514 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-459f0850-7935-4c4f-8598-18a1f9305d30 admin admin] RBAC: Authorization granted {{(pid=71939) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 24 16:34:33.681012 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: [pid: 71939|app: 0|req: 586/1172] 10.222.0.53 () {56 vars in 1189 bytes} [Wed Nov 24 16:34:33 2021] GET /identity/v3/roles/0de27ef8b6e744cda429a0d133117dcd => generated 223 bytes in 49 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 24 16:34:33.687543 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62941fc9-743a-4dc6-a781-2177c41ccc0f None None] Authenticating user token {{(pid=71938) process_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 24 16:34:33.697018 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62941fc9-743a-4dc6-a781-2177c41ccc0f None None] Validating token access rules against request {{(pid=71938) validate_allowed_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 24 16:34:33.702363 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6af70a3-0679-4f13-a6dd-e7d06339c3cf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f2ba2e8375b4e8c8792ee1e22b60427', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '00a5583c7b7443e98e7a1d31a0b638dc', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=71938) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 24 16:34:33.703277 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6af70a3-0679-4f13-a6dd-e7d06339c3cf admin admin] REQUEST_METHOD: `GET` {{(pid=71938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 24 16:34:33.703620 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6af70a3-0679-4f13-a6dd-e7d06339c3cf admin admin] SCRIPT_NAME: `/identity` {{(pid=71938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 24 16:34:33.703956 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6af70a3-0679-4f13-a6dd-e7d06339c3cf admin admin] PATH_INFO: `/v3/users/1b2e63172b3a40dcb77f3cff51152aec` {{(pid=71938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 24 16:34:33.705274 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6af70a3-0679-4f13-a6dd-e7d06339c3cf admin admin] RBAC: Authorizing `identity:get_user(user_id=1b2e63172b3a40dcb77f3cff51152aec)` {{(pid=71938) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:442}} Nov 24 16:34:33.734632 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6af70a3-0679-4f13-a6dd-e7d06339c3cf admin admin] RBAC: Authorization granted {{(pid=71938) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 24 16:34:33.736333 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: [pid: 71938|app: 0|req: 587/1173] 10.222.0.53 () {56 vars in 1189 bytes} [Wed Nov 24 16:34:33 2021] GET /identity/v3/users/1b2e63172b3a40dcb77f3cff51152aec => generated 286 bytes in 49 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 24 16:34:33.742783 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-459f0850-7935-4c4f-8598-18a1f9305d30 admin admin] Authenticating user token {{(pid=71939) process_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 24 16:34:33.753735 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-459f0850-7935-4c4f-8598-18a1f9305d30 admin admin] Validating token access rules against request {{(pid=71939) validate_allowed_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 24 16:34:33.758131 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b33e997c-df60-4c18-8bd4-bde6430db65b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f2ba2e8375b4e8c8792ee1e22b60427', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '00a5583c7b7443e98e7a1d31a0b638dc', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=71939) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 24 16:34:33.758993 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b33e997c-df60-4c18-8bd4-bde6430db65b admin admin] REQUEST_METHOD: `GET` {{(pid=71939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 24 16:34:33.759331 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b33e997c-df60-4c18-8bd4-bde6430db65b admin admin] SCRIPT_NAME: `/identity` {{(pid=71939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 24 16:34:33.759668 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b33e997c-df60-4c18-8bd4-bde6430db65b admin admin] PATH_INFO: `/v3/projects/9a201f3aac424f189726a7325dabb612` {{(pid=71939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 24 16:34:33.760869 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b33e997c-df60-4c18-8bd4-bde6430db65b admin admin] RBAC: Authorizing `identity:get_project(project_id=9a201f3aac424f189726a7325dabb612)` {{(pid=71939) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:442}} Nov 24 16:34:33.790246 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b33e997c-df60-4c18-8bd4-bde6430db65b admin admin] RBAC: Authorization granted {{(pid=71939) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 24 16:34:33.791850 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: [pid: 71939|app: 0|req: 587/1174] 10.222.0.53 () {56 vars in 1198 bytes} [Wed Nov 24 16:34:33 2021] GET /identity/v3/projects/9a201f3aac424f189726a7325dabb612 => generated 311 bytes in 50 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 24 16:34:33.798119 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6af70a3-0679-4f13-a6dd-e7d06339c3cf admin admin] Authenticating user token {{(pid=71938) process_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 24 16:34:33.808074 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6af70a3-0679-4f13-a6dd-e7d06339c3cf admin admin] Validating token access rules against request {{(pid=71938) validate_allowed_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 24 16:34:33.812749 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-890dbf08-59e4-4b68-a14e-108af73427fb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f2ba2e8375b4e8c8792ee1e22b60427', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '00a5583c7b7443e98e7a1d31a0b638dc', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=71938) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 24 16:34:33.813634 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-890dbf08-59e4-4b68-a14e-108af73427fb admin admin] REQUEST_METHOD: `PUT` {{(pid=71938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 24 16:34:33.813967 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-890dbf08-59e4-4b68-a14e-108af73427fb admin admin] SCRIPT_NAME: `/identity` {{(pid=71938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 24 16:34:33.814329 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-890dbf08-59e4-4b68-a14e-108af73427fb admin admin] PATH_INFO: `/v3/projects/9a201f3aac424f189726a7325dabb612/users/1b2e63172b3a40dcb77f3cff51152aec/roles/0de27ef8b6e744cda429a0d133117dcd` {{(pid=71938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 24 16:34:33.816517 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-890dbf08-59e4-4b68-a14e-108af73427fb admin admin] RBAC: Authorizing `identity:create_grant(project_id=9a201f3aac424f189726a7325dabb612, user_id=1b2e63172b3a40dcb77f3cff51152aec, role_id=0de27ef8b6e744cda429a0d133117dcd)` {{(pid=71938) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:442}} Nov 24 16:34:33.847302 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-890dbf08-59e4-4b68-a14e-108af73427fb admin admin] RBAC: Authorization granted {{(pid=71938) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 24 16:34:33.859378 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: [pid: 71938|app: 0|req: 588/1175] 10.222.0.53 () {58 vars in 1451 bytes} [Wed Nov 24 16:34:33 2021] PUT /identity/v3/projects/9a201f3aac424f189726a7325dabb612/users/1b2e63172b3a40dcb77f3cff51152aec/roles/0de27ef8b6e744cda429a0d133117dcd => generated 0 bytes in 62 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 24 16:34:35.851949 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7952c8dc-9b9c-4e06-a436-25dd8267620e None None] REQUEST_METHOD: `GET` {{(pid=71939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 24 16:34:35.852559 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7952c8dc-9b9c-4e06-a436-25dd8267620e None None] SCRIPT_NAME: `/identity` {{(pid=71939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 24 16:34:35.852674 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7952c8dc-9b9c-4e06-a436-25dd8267620e None None] PATH_INFO: `/` {{(pid=71939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 24 16:34:35.854466 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: [pid: 71939|app: 0|req: 588/1176] 10.222.0.53 () {54 vars in 915 bytes} [Wed Nov 24 16:34:35 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 24 16:34:35.860111 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cb00a97-d46a-455e-bea5-a487d804b972 None None] REQUEST_METHOD: `POST` {{(pid=71938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 24 16:34:35.860457 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cb00a97-d46a-455e-bea5-a487d804b972 None None] SCRIPT_NAME: `/identity` {{(pid=71938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 24 16:34:35.860790 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cb00a97-d46a-455e-bea5-a487d804b972 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=71938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 24 16:34:35.889466 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.auth.core [None req-4cb00a97-d46a-455e-bea5-a487d804b972 None None] MFA Rules not processed for user `0f2ba2e8375b4e8c8792ee1e22b60427`. Rule list: `[]` (Enabled: `True`). {{(pid=71938) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:442}} Nov 24 16:34:35.890731 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.fernet_utils [None req-4cb00a97-d46a-455e-bea5-a487d804b972 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=71938) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:289}} Nov 24 16:34:35.962886 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: [pid: 71938|app: 0|req: 589/1177] 10.222.0.53 () {58 vars in 1013 bytes} [Wed Nov 24 16:34:35 2021] POST /identity/v3/auth/tokens => generated 3413 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 24 16:34:35.986228 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f91e0d4-f62a-4c37-a057-ab73e2160719 None None] REQUEST_METHOD: `POST` {{(pid=71939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 24 16:34:35.986582 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f91e0d4-f62a-4c37-a057-ab73e2160719 None None] SCRIPT_NAME: `/identity` {{(pid=71939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 24 16:34:35.986920 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f91e0d4-f62a-4c37-a057-ab73e2160719 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=71939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 24 16:34:36.011630 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.auth.core [None req-0f91e0d4-f62a-4c37-a057-ab73e2160719 None None] MFA Rules not processed for user `0f2ba2e8375b4e8c8792ee1e22b60427`. Rule list: `[]` (Enabled: `True`). {{(pid=71939) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:442}} Nov 24 16:34:36.013354 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.fernet_utils [None req-0f91e0d4-f62a-4c37-a057-ab73e2160719 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=71939) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:289}} Nov 24 16:34:36.020833 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: [pid: 71939|app: 0|req: 589/1178] 10.222.0.53 () {58 vars in 1013 bytes} [Wed Nov 24 16:34:35 2021] POST /identity/v3/auth/tokens => generated 3413 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 24 16:34:36.027211 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cb00a97-d46a-455e-bea5-a487d804b972 None None] Authenticating user token {{(pid=71938) process_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 24 16:34:36.037523 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cb00a97-d46a-455e-bea5-a487d804b972 None None] Validating token access rules against request {{(pid=71938) validate_allowed_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 24 16:34:36.041930 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f504da8d-10c8-4853-a396-8d6cc61cb24f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f2ba2e8375b4e8c8792ee1e22b60427', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '00a5583c7b7443e98e7a1d31a0b638dc', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=71938) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 24 16:34:36.042852 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f504da8d-10c8-4853-a396-8d6cc61cb24f admin admin] REQUEST_METHOD: `GET` {{(pid=71938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 24 16:34:36.043190 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f504da8d-10c8-4853-a396-8d6cc61cb24f admin admin] SCRIPT_NAME: `/identity` {{(pid=71938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 24 16:34:36.043523 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f504da8d-10c8-4853-a396-8d6cc61cb24f admin admin] PATH_INFO: `/v3/roles/0de27ef8b6e744cda429a0d133117dcd` {{(pid=71938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 24 16:34:36.044975 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f504da8d-10c8-4853-a396-8d6cc61cb24f admin admin] RBAC: Authorizing `identity:get_role(role_id=0de27ef8b6e744cda429a0d133117dcd)` {{(pid=71938) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:442}} Nov 24 16:34:36.072478 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: WARNING py.warnings [None req-f504da8d-10c8-4853-a396-8d6cc61cb24f admin admin] /usr/local/lib/python3.6/dist-packages/oslo_policy/policy.py:1018: UserWarning: Policy identity:get_role failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 24 16:34:36.072478 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: warnings.warn(msg) Nov 24 16:34:36.072478 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: Nov 24 16:34:36.073502 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f504da8d-10c8-4853-a396-8d6cc61cb24f admin admin] RBAC: Authorization granted {{(pid=71938) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 24 16:34:36.075525 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: [pid: 71938|app: 0|req: 590/1179] 10.222.0.53 () {56 vars in 1189 bytes} [Wed Nov 24 16:34:36 2021] GET /identity/v3/roles/0de27ef8b6e744cda429a0d133117dcd => generated 223 bytes in 49 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 24 16:34:36.081978 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f91e0d4-f62a-4c37-a057-ab73e2160719 None None] Authenticating user token {{(pid=71939) process_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 24 16:34:36.091867 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f91e0d4-f62a-4c37-a057-ab73e2160719 None None] Validating token access rules against request {{(pid=71939) validate_allowed_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 24 16:34:36.096218 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00f4a639-0c5a-4d44-9a2a-5c9fd4f87028 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f2ba2e8375b4e8c8792ee1e22b60427', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '00a5583c7b7443e98e7a1d31a0b638dc', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=71939) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 24 16:34:36.097103 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00f4a639-0c5a-4d44-9a2a-5c9fd4f87028 admin admin] REQUEST_METHOD: `GET` {{(pid=71939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 24 16:34:36.097434 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00f4a639-0c5a-4d44-9a2a-5c9fd4f87028 admin admin] SCRIPT_NAME: `/identity` {{(pid=71939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 24 16:34:36.097760 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00f4a639-0c5a-4d44-9a2a-5c9fd4f87028 admin admin] PATH_INFO: `/v3/users/1b2e63172b3a40dcb77f3cff51152aec` {{(pid=71939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 24 16:34:36.099009 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00f4a639-0c5a-4d44-9a2a-5c9fd4f87028 admin admin] RBAC: Authorizing `identity:get_user(user_id=1b2e63172b3a40dcb77f3cff51152aec)` {{(pid=71939) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:442}} Nov 24 16:34:36.127441 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00f4a639-0c5a-4d44-9a2a-5c9fd4f87028 admin admin] RBAC: Authorization granted {{(pid=71939) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 24 16:34:36.129175 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: [pid: 71939|app: 0|req: 590/1180] 10.222.0.53 () {56 vars in 1189 bytes} [Wed Nov 24 16:34:36 2021] GET /identity/v3/users/1b2e63172b3a40dcb77f3cff51152aec => generated 286 bytes in 48 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 24 16:34:36.135480 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f504da8d-10c8-4853-a396-8d6cc61cb24f admin admin] Authenticating user token {{(pid=71938) process_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 24 16:34:36.146258 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f504da8d-10c8-4853-a396-8d6cc61cb24f admin admin] Validating token access rules against request {{(pid=71938) validate_allowed_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 24 16:34:36.150744 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4ec4334-8c35-4f81-9dee-5fd585c72307 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f2ba2e8375b4e8c8792ee1e22b60427', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '00a5583c7b7443e98e7a1d31a0b638dc', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=71938) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 24 16:34:36.151401 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4ec4334-8c35-4f81-9dee-5fd585c72307 admin admin] REQUEST_METHOD: `GET` {{(pid=71938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 24 16:34:36.151747 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4ec4334-8c35-4f81-9dee-5fd585c72307 admin admin] SCRIPT_NAME: `/identity` {{(pid=71938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 24 16:34:36.152082 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4ec4334-8c35-4f81-9dee-5fd585c72307 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=71938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 24 16:34:36.161371 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4ec4334-8c35-4f81-9dee-5fd585c72307 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=71938) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:442}} Nov 24 16:34:36.190635 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4ec4334-8c35-4f81-9dee-5fd585c72307 admin admin] RBAC: Authorization granted {{(pid=71938) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 24 16:34:36.206483 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: [pid: 71938|app: 0|req: 591/1181] 10.222.0.53 () {58 vars in 1315 bytes} [Wed Nov 24 16:34:36 2021] GET /identity/v3/auth/tokens => generated 3413 bytes in 66 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 24 16:34:36.207742 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00f4a639-0c5a-4d44-9a2a-5c9fd4f87028 admin admin] Authenticating user token {{(pid=71939) process_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 24 16:34:36.218448 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00f4a639-0c5a-4d44-9a2a-5c9fd4f87028 admin admin] Validating token access rules against request {{(pid=71939) validate_allowed_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 24 16:34:36.222827 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5bb9244-07ad-45a5-86ae-fab6b3a5c90a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f2ba2e8375b4e8c8792ee1e22b60427', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '00a5583c7b7443e98e7a1d31a0b638dc', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=71939) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 24 16:34:36.223699 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5bb9244-07ad-45a5-86ae-fab6b3a5c90a admin admin] REQUEST_METHOD: `GET` {{(pid=71939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 24 16:34:36.224035 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5bb9244-07ad-45a5-86ae-fab6b3a5c90a admin admin] SCRIPT_NAME: `/identity` {{(pid=71939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 24 16:34:36.224365 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5bb9244-07ad-45a5-86ae-fab6b3a5c90a admin admin] PATH_INFO: `/v3/projects/9a201f3aac424f189726a7325dabb612` {{(pid=71939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 24 16:34:36.225554 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5bb9244-07ad-45a5-86ae-fab6b3a5c90a admin admin] RBAC: Authorizing `identity:get_project(project_id=9a201f3aac424f189726a7325dabb612)` {{(pid=71939) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:442}} Nov 24 16:34:36.254221 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5bb9244-07ad-45a5-86ae-fab6b3a5c90a admin admin] RBAC: Authorization granted {{(pid=71939) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 24 16:34:36.255884 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: [pid: 71939|app: 0|req: 591/1182] 10.222.0.53 () {56 vars in 1198 bytes} [Wed Nov 24 16:34:36 2021] GET /identity/v3/projects/9a201f3aac424f189726a7325dabb612 => generated 311 bytes in 49 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 24 16:34:36.262972 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4ec4334-8c35-4f81-9dee-5fd585c72307 admin admin] Authenticating user token {{(pid=71938) process_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 24 16:34:36.272074 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4ec4334-8c35-4f81-9dee-5fd585c72307 admin admin] Validating token access rules against request {{(pid=71938) validate_allowed_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 24 16:34:36.276553 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad9b630c-753e-4301-bc36-0a5e0746148c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f2ba2e8375b4e8c8792ee1e22b60427', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '00a5583c7b7443e98e7a1d31a0b638dc', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=71938) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 24 16:34:36.277204 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad9b630c-753e-4301-bc36-0a5e0746148c admin admin] REQUEST_METHOD: `GET` {{(pid=71938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 24 16:34:36.277570 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad9b630c-753e-4301-bc36-0a5e0746148c admin admin] SCRIPT_NAME: `/identity` {{(pid=71938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 24 16:34:36.277897 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad9b630c-753e-4301-bc36-0a5e0746148c admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=71938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 24 16:34:36.278805 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad9b630c-753e-4301-bc36-0a5e0746148c admin admin] RBAC: Adding query filter params (role.id=0de27ef8b6e744cda429a0d133117dcd, scope.project.id=9a201f3aac424f189726a7325dabb612, user.id=1b2e63172b3a40dcb77f3cff51152aec) {{(pid=71938) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:161}} Nov 24 16:34:36.279162 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad9b630c-753e-4301-bc36-0a5e0746148c admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=71938) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:442}} Nov 24 16:34:36.307187 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad9b630c-753e-4301-bc36-0a5e0746148c admin admin] RBAC: Authorization granted {{(pid=71938) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 24 16:34:36.313705 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: [pid: 71938|app: 0|req: 592/1183] 10.222.0.53 () {56 vars in 1386 bytes} [Wed Nov 24 16:34:36 2021] GET /identity/v3/role_assignments?user.id=1b2e63172b3a40dcb77f3cff51152aec&scope.project.id=9a201f3aac424f189726a7325dabb612&role.id=0de27ef8b6e744cda429a0d133117dcd => generated 608 bytes in 52 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 24 16:34:38.343699 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e79ebd5c-9fe3-42db-a21e-84df52bfb7af None None] REQUEST_METHOD: `GET` {{(pid=71939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 24 16:34:38.344409 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e79ebd5c-9fe3-42db-a21e-84df52bfb7af None None] SCRIPT_NAME: `/identity` {{(pid=71939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 24 16:34:38.344409 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e79ebd5c-9fe3-42db-a21e-84df52bfb7af None None] PATH_INFO: `/` {{(pid=71939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 24 16:34:38.346181 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: [pid: 71939|app: 0|req: 592/1184] 10.222.0.53 () {54 vars in 915 bytes} [Wed Nov 24 16:34:38 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 24 16:34:38.351911 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5797c2fc-1ec1-4369-a0a0-24afb87e331d None None] REQUEST_METHOD: `POST` {{(pid=71938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 24 16:34:38.352266 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5797c2fc-1ec1-4369-a0a0-24afb87e331d None None] SCRIPT_NAME: `/identity` {{(pid=71938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 24 16:34:38.352599 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5797c2fc-1ec1-4369-a0a0-24afb87e331d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=71938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 24 16:34:38.377332 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.auth.core [None req-5797c2fc-1ec1-4369-a0a0-24afb87e331d None None] MFA Rules not processed for user `0f2ba2e8375b4e8c8792ee1e22b60427`. Rule list: `[]` (Enabled: `True`). {{(pid=71938) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:442}} Nov 24 16:34:38.378573 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.fernet_utils [None req-5797c2fc-1ec1-4369-a0a0-24afb87e331d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=71938) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:289}} Nov 24 16:34:38.386641 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: [pid: 71938|app: 0|req: 593/1185] 10.222.0.53 () {58 vars in 1013 bytes} [Wed Nov 24 16:34:38 2021] POST /identity/v3/auth/tokens => generated 3413 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 24 16:34:38.410168 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-feddf2c3-1001-4b2a-8665-a8804f6eabb7 None None] REQUEST_METHOD: `POST` {{(pid=71939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 24 16:34:38.410521 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-feddf2c3-1001-4b2a-8665-a8804f6eabb7 None None] SCRIPT_NAME: `/identity` {{(pid=71939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 24 16:34:38.410861 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-feddf2c3-1001-4b2a-8665-a8804f6eabb7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=71939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 24 16:34:38.434934 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.auth.core [None req-feddf2c3-1001-4b2a-8665-a8804f6eabb7 None None] MFA Rules not processed for user `0f2ba2e8375b4e8c8792ee1e22b60427`. Rule list: `[]` (Enabled: `True`). {{(pid=71939) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:442}} Nov 24 16:34:38.436155 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.fernet_utils [None req-feddf2c3-1001-4b2a-8665-a8804f6eabb7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=71939) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:289}} Nov 24 16:34:38.443561 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: [pid: 71939|app: 0|req: 593/1186] 10.222.0.53 () {58 vars in 1013 bytes} [Wed Nov 24 16:34:38 2021] POST /identity/v3/auth/tokens => generated 3413 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 24 16:34:38.450420 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5797c2fc-1ec1-4369-a0a0-24afb87e331d None None] Authenticating user token {{(pid=71938) process_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 24 16:34:38.460524 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5797c2fc-1ec1-4369-a0a0-24afb87e331d None None] Validating token access rules against request {{(pid=71938) validate_allowed_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 24 16:34:38.464940 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-443773d8-8d26-46de-b55e-85df28104416 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f2ba2e8375b4e8c8792ee1e22b60427', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '00a5583c7b7443e98e7a1d31a0b638dc', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=71938) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 24 16:34:38.465757 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-443773d8-8d26-46de-b55e-85df28104416 admin admin] REQUEST_METHOD: `GET` {{(pid=71938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 24 16:34:38.466131 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-443773d8-8d26-46de-b55e-85df28104416 admin admin] SCRIPT_NAME: `/identity` {{(pid=71938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 24 16:34:38.466472 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-443773d8-8d26-46de-b55e-85df28104416 admin admin] PATH_INFO: `/v3/domains/default` {{(pid=71938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 24 16:34:38.467657 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-443773d8-8d26-46de-b55e-85df28104416 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=71938) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:442}} Nov 24 16:34:38.496655 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-443773d8-8d26-46de-b55e-85df28104416 admin admin] RBAC: Authorization granted {{(pid=71938) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 24 16:34:38.498351 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: [pid: 71938|app: 0|req: 594/1187] 10.222.0.53 () {56 vars in 1120 bytes} [Wed Nov 24 16:34:38 2021] GET /identity/v3/domains/default => generated 199 bytes in 49 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 24 16:34:38.504664 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-feddf2c3-1001-4b2a-8665-a8804f6eabb7 None None] Authenticating user token {{(pid=71939) process_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 24 16:34:38.514664 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-feddf2c3-1001-4b2a-8665-a8804f6eabb7 None None] Validating token access rules against request {{(pid=71939) validate_allowed_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 24 16:34:38.519060 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22bce2be-c21c-44a4-ba36-6562b7c53725 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f2ba2e8375b4e8c8792ee1e22b60427', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '00a5583c7b7443e98e7a1d31a0b638dc', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=71939) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 24 16:34:38.519713 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22bce2be-c21c-44a4-ba36-6562b7c53725 admin admin] REQUEST_METHOD: `POST` {{(pid=71939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 24 16:34:38.520049 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22bce2be-c21c-44a4-ba36-6562b7c53725 admin admin] SCRIPT_NAME: `/identity` {{(pid=71939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 24 16:34:38.520378 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22bce2be-c21c-44a4-ba36-6562b7c53725 admin admin] PATH_INFO: `/v3/projects` {{(pid=71939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 24 16:34:38.521115 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22bce2be-c21c-44a4-ba36-6562b7c53725 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=71939) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:442}} Nov 24 16:34:38.549467 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22bce2be-c21c-44a4-ba36-6562b7c53725 admin admin] RBAC: Authorization granted {{(pid=71939) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 24 16:34:38.577098 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: [pid: 71939|app: 0|req: 594/1188] 10.222.0.53 () {60 vars in 1152 bytes} [Wed Nov 24 16:34:38 2021] POST /identity/v3/projects => generated 311 bytes in 73 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 24 16:34:40.617884 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd84bf2e-2597-42e0-ad56-07e8fa38dd8c None None] REQUEST_METHOD: `GET` {{(pid=71938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 24 16:34:40.618430 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd84bf2e-2597-42e0-ad56-07e8fa38dd8c None None] SCRIPT_NAME: `/identity` {{(pid=71938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 24 16:34:40.618532 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd84bf2e-2597-42e0-ad56-07e8fa38dd8c None None] PATH_INFO: `/` {{(pid=71938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 24 16:34:40.620330 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: [pid: 71938|app: 0|req: 595/1189] 10.222.0.53 () {54 vars in 915 bytes} [Wed Nov 24 16:34:40 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 24 16:34:40.626772 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de99a097-f42d-4b3d-83fd-7fc1bbf8516d None None] REQUEST_METHOD: `POST` {{(pid=71939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 24 16:34:40.627129 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de99a097-f42d-4b3d-83fd-7fc1bbf8516d None None] SCRIPT_NAME: `/identity` {{(pid=71939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 24 16:34:40.627471 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de99a097-f42d-4b3d-83fd-7fc1bbf8516d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=71939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 24 16:34:40.651096 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.auth.core [None req-de99a097-f42d-4b3d-83fd-7fc1bbf8516d None None] MFA Rules not processed for user `0f2ba2e8375b4e8c8792ee1e22b60427`. Rule list: `[]` (Enabled: `True`). {{(pid=71939) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:442}} Nov 24 16:34:40.652344 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.fernet_utils [None req-de99a097-f42d-4b3d-83fd-7fc1bbf8516d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=71939) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:289}} Nov 24 16:34:40.722736 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: [pid: 71939|app: 0|req: 595/1190] 10.222.0.53 () {58 vars in 1013 bytes} [Wed Nov 24 16:34:40 2021] POST /identity/v3/auth/tokens => generated 3413 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 24 16:34:40.746184 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-143e0e9e-619e-4949-a5a3-eb58a2932089 None None] REQUEST_METHOD: `POST` {{(pid=71938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 24 16:34:40.746526 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-143e0e9e-619e-4949-a5a3-eb58a2932089 None None] SCRIPT_NAME: `/identity` {{(pid=71938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 24 16:34:40.746857 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-143e0e9e-619e-4949-a5a3-eb58a2932089 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=71938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 24 16:34:40.770590 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.auth.core [None req-143e0e9e-619e-4949-a5a3-eb58a2932089 None None] MFA Rules not processed for user `0f2ba2e8375b4e8c8792ee1e22b60427`. Rule list: `[]` (Enabled: `True`). {{(pid=71938) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:442}} Nov 24 16:34:40.771957 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.fernet_utils [None req-143e0e9e-619e-4949-a5a3-eb58a2932089 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=71938) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:289}} Nov 24 16:34:40.779874 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: [pid: 71938|app: 0|req: 596/1191] 10.222.0.53 () {58 vars in 1013 bytes} [Wed Nov 24 16:34:40 2021] POST /identity/v3/auth/tokens => generated 3413 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 24 16:34:40.786233 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de99a097-f42d-4b3d-83fd-7fc1bbf8516d None None] Authenticating user token {{(pid=71939) process_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 24 16:34:40.796637 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de99a097-f42d-4b3d-83fd-7fc1bbf8516d None None] Validating token access rules against request {{(pid=71939) validate_allowed_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 24 16:34:40.801020 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0e9dd1b-5b9b-40c6-b6c9-6b008fe0c6a5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f2ba2e8375b4e8c8792ee1e22b60427', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '00a5583c7b7443e98e7a1d31a0b638dc', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=71939) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 24 16:34:40.801833 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0e9dd1b-5b9b-40c6-b6c9-6b008fe0c6a5 admin admin] REQUEST_METHOD: `GET` {{(pid=71939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 24 16:34:40.802229 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0e9dd1b-5b9b-40c6-b6c9-6b008fe0c6a5 admin admin] SCRIPT_NAME: `/identity` {{(pid=71939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 24 16:34:40.802562 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0e9dd1b-5b9b-40c6-b6c9-6b008fe0c6a5 admin admin] PATH_INFO: `/v3/domains/default` {{(pid=71939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 24 16:34:40.803738 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0e9dd1b-5b9b-40c6-b6c9-6b008fe0c6a5 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=71939) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:442}} Nov 24 16:34:40.834948 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0e9dd1b-5b9b-40c6-b6c9-6b008fe0c6a5 admin admin] RBAC: Authorization granted {{(pid=71939) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 24 16:34:40.836690 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: [pid: 71939|app: 0|req: 596/1192] 10.222.0.53 () {56 vars in 1120 bytes} [Wed Nov 24 16:34:40 2021] GET /identity/v3/domains/default => generated 199 bytes in 51 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 24 16:34:40.843490 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-143e0e9e-619e-4949-a5a3-eb58a2932089 None None] Authenticating user token {{(pid=71938) process_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 24 16:34:40.853064 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-143e0e9e-619e-4949-a5a3-eb58a2932089 None None] Validating token access rules against request {{(pid=71938) validate_allowed_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 24 16:34:40.858368 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f723929-07d0-42cd-9487-062aae0fe967 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f2ba2e8375b4e8c8792ee1e22b60427', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '00a5583c7b7443e98e7a1d31a0b638dc', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=71938) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 24 16:34:40.859044 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f723929-07d0-42cd-9487-062aae0fe967 admin admin] REQUEST_METHOD: `POST` {{(pid=71938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 24 16:34:40.859387 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f723929-07d0-42cd-9487-062aae0fe967 admin admin] SCRIPT_NAME: `/identity` {{(pid=71938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 24 16:34:40.859725 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f723929-07d0-42cd-9487-062aae0fe967 admin admin] PATH_INFO: `/v3/users` {{(pid=71938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 24 16:34:40.860477 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f723929-07d0-42cd-9487-062aae0fe967 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=71938) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:442}} Nov 24 16:34:40.890182 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f723929-07d0-42cd-9487-062aae0fe967 admin admin] RBAC: Authorization granted {{(pid=71938) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 24 16:34:40.909486 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: [pid: 71938|app: 0|req: 597/1193] 10.222.0.53 () {60 vars in 1144 bytes} [Wed Nov 24 16:34:40 2021] POST /identity/v3/users => generated 286 bytes in 66 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 24 16:34:42.954231 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a22b66f9-c351-434a-8161-7ae9e71c2536 None None] REQUEST_METHOD: `GET` {{(pid=71939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 24 16:34:42.954832 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a22b66f9-c351-434a-8161-7ae9e71c2536 None None] SCRIPT_NAME: `/identity` {{(pid=71939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 24 16:34:42.954944 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a22b66f9-c351-434a-8161-7ae9e71c2536 None None] PATH_INFO: `/` {{(pid=71939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 24 16:34:42.956692 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: [pid: 71939|app: 0|req: 597/1194] 10.222.0.53 () {54 vars in 915 bytes} [Wed Nov 24 16:34:42 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 24 16:34:42.962448 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32ffdc39-5470-4109-b3fe-1a3c2062126c None None] REQUEST_METHOD: `POST` {{(pid=71938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 24 16:34:42.962801 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32ffdc39-5470-4109-b3fe-1a3c2062126c None None] SCRIPT_NAME: `/identity` {{(pid=71938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 24 16:34:42.963141 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32ffdc39-5470-4109-b3fe-1a3c2062126c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=71938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 24 16:34:42.989363 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.auth.core [None req-32ffdc39-5470-4109-b3fe-1a3c2062126c None None] MFA Rules not processed for user `0f2ba2e8375b4e8c8792ee1e22b60427`. Rule list: `[]` (Enabled: `True`). {{(pid=71938) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:442}} Nov 24 16:34:42.990615 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.fernet_utils [None req-32ffdc39-5470-4109-b3fe-1a3c2062126c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=71938) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:289}} Nov 24 16:34:42.998700 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: [pid: 71938|app: 0|req: 598/1195] 10.222.0.53 () {58 vars in 1013 bytes} [Wed Nov 24 16:34:42 2021] POST /identity/v3/auth/tokens => generated 3413 bytes in 37 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 24 16:34:43.021504 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ea5e5e6-bd8a-4fb0-8676-3ba292df3db5 None None] REQUEST_METHOD: `POST` {{(pid=71939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 24 16:34:43.021846 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ea5e5e6-bd8a-4fb0-8676-3ba292df3db5 None None] SCRIPT_NAME: `/identity` {{(pid=71939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 24 16:34:43.022231 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ea5e5e6-bd8a-4fb0-8676-3ba292df3db5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=71939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 24 16:34:43.047505 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.auth.core [None req-7ea5e5e6-bd8a-4fb0-8676-3ba292df3db5 None None] MFA Rules not processed for user `0f2ba2e8375b4e8c8792ee1e22b60427`. Rule list: `[]` (Enabled: `True`). {{(pid=71939) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:442}} Nov 24 16:34:43.048749 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.fernet_utils [None req-7ea5e5e6-bd8a-4fb0-8676-3ba292df3db5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=71939) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:289}} Nov 24 16:34:43.056081 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: [pid: 71939|app: 0|req: 598/1196] 10.222.0.53 () {58 vars in 1013 bytes} [Wed Nov 24 16:34:43 2021] POST /identity/v3/auth/tokens => generated 3413 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 24 16:34:43.062455 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32ffdc39-5470-4109-b3fe-1a3c2062126c None None] Authenticating user token {{(pid=71938) process_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 24 16:34:43.072730 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32ffdc39-5470-4109-b3fe-1a3c2062126c None None] Validating token access rules against request {{(pid=71938) validate_allowed_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 24 16:34:43.077587 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e5ca3c5-8d0c-48eb-a807-3c779a8df408 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f2ba2e8375b4e8c8792ee1e22b60427', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '00a5583c7b7443e98e7a1d31a0b638dc', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=71938) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 24 16:34:43.078439 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e5ca3c5-8d0c-48eb-a807-3c779a8df408 admin admin] REQUEST_METHOD: `GET` {{(pid=71938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 24 16:34:43.078784 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e5ca3c5-8d0c-48eb-a807-3c779a8df408 admin admin] SCRIPT_NAME: `/identity` {{(pid=71938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 24 16:34:43.079119 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e5ca3c5-8d0c-48eb-a807-3c779a8df408 admin admin] PATH_INFO: `/v3/roles/admin` {{(pid=71938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 24 16:34:43.092067 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e5ca3c5-8d0c-48eb-a807-3c779a8df408 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=71938) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:401}} Nov 24 16:34:43.099611 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: WARNING keystone.server.flask.application [None req-5e5ca3c5-8d0c-48eb-a807-3c779a8df408 admin admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Nov 24 16:34:43.100909 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: [pid: 71938|app: 0|req: 599/1197] 10.222.0.53 () {56 vars in 1108 bytes} [Wed Nov 24 16:34:43 2021] GET /identity/v3/roles/admin => generated 83 bytes in 39 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 24 16:34:43.108618 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ea5e5e6-bd8a-4fb0-8676-3ba292df3db5 None None] Authenticating user token {{(pid=71939) process_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 24 16:34:43.118018 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ea5e5e6-bd8a-4fb0-8676-3ba292df3db5 None None] Validating token access rules against request {{(pid=71939) validate_allowed_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 24 16:34:43.122469 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d0f943b-5ef5-4f4c-ab8a-0b0151a30dc3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f2ba2e8375b4e8c8792ee1e22b60427', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '00a5583c7b7443e98e7a1d31a0b638dc', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=71939) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 24 16:34:43.123151 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d0f943b-5ef5-4f4c-ab8a-0b0151a30dc3 admin admin] REQUEST_METHOD: `GET` {{(pid=71939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 24 16:34:43.123489 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d0f943b-5ef5-4f4c-ab8a-0b0151a30dc3 admin admin] SCRIPT_NAME: `/identity` {{(pid=71939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 24 16:34:43.123820 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d0f943b-5ef5-4f4c-ab8a-0b0151a30dc3 admin admin] PATH_INFO: `/v3/roles` {{(pid=71939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 24 16:34:43.124634 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d0f943b-5ef5-4f4c-ab8a-0b0151a30dc3 admin admin] RBAC: Adding query filter params (name=admin) {{(pid=71939) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:161}} Nov 24 16:34:43.124985 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d0f943b-5ef5-4f4c-ab8a-0b0151a30dc3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=71939) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:442}} Nov 24 16:34:43.153544 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d0f943b-5ef5-4f4c-ab8a-0b0151a30dc3 admin admin] RBAC: Authorization granted {{(pid=71939) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 24 16:34:43.163444 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: [pid: 71939|app: 0|req: 599/1198] 10.222.0.53 () {56 vars in 1111 bytes} [Wed Nov 24 16:34:43 2021] GET /identity/v3/roles?name=admin => generated 339 bytes in 55 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 24 16:34:43.170511 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e5ca3c5-8d0c-48eb-a807-3c779a8df408 admin admin] Authenticating user token {{(pid=71938) process_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 24 16:34:43.181178 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e5ca3c5-8d0c-48eb-a807-3c779a8df408 admin admin] Validating token access rules against request {{(pid=71938) validate_allowed_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 24 16:34:43.185900 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31f830a7-8a0d-4419-920f-edd44f0b8669 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f2ba2e8375b4e8c8792ee1e22b60427', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '00a5583c7b7443e98e7a1d31a0b638dc', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=71938) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 24 16:34:43.186859 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31f830a7-8a0d-4419-920f-edd44f0b8669 admin admin] REQUEST_METHOD: `GET` {{(pid=71938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 24 16:34:43.187203 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31f830a7-8a0d-4419-920f-edd44f0b8669 admin admin] SCRIPT_NAME: `/identity` {{(pid=71938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 24 16:34:43.187539 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31f830a7-8a0d-4419-920f-edd44f0b8669 admin admin] PATH_INFO: `/v3/users/a75b9ce272c04194a264dcd20640b55b` {{(pid=71938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 24 16:34:43.207533 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31f830a7-8a0d-4419-920f-edd44f0b8669 admin admin] RBAC: Authorizing `identity:get_user(user_id=a75b9ce272c04194a264dcd20640b55b)` {{(pid=71938) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:442}} Nov 24 16:34:43.237346 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31f830a7-8a0d-4419-920f-edd44f0b8669 admin admin] RBAC: Authorization granted {{(pid=71938) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 24 16:34:43.239103 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: [pid: 71938|app: 0|req: 600/1199] 10.222.0.53 () {56 vars in 1189 bytes} [Wed Nov 24 16:34:43 2021] GET /identity/v3/users/a75b9ce272c04194a264dcd20640b55b => generated 286 bytes in 69 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 24 16:34:43.245351 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d0f943b-5ef5-4f4c-ab8a-0b0151a30dc3 admin admin] Authenticating user token {{(pid=71939) process_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 24 16:34:43.255436 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d0f943b-5ef5-4f4c-ab8a-0b0151a30dc3 admin admin] Validating token access rules against request {{(pid=71939) validate_allowed_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 24 16:34:43.259847 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae6ede73-60a2-4072-9bc1-36740060fb30 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f2ba2e8375b4e8c8792ee1e22b60427', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '00a5583c7b7443e98e7a1d31a0b638dc', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=71939) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 24 16:34:43.260497 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae6ede73-60a2-4072-9bc1-36740060fb30 admin admin] REQUEST_METHOD: `GET` {{(pid=71939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 24 16:34:43.260841 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae6ede73-60a2-4072-9bc1-36740060fb30 admin admin] SCRIPT_NAME: `/identity` {{(pid=71939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 24 16:34:43.261177 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae6ede73-60a2-4072-9bc1-36740060fb30 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=71939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 24 16:34:43.269406 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae6ede73-60a2-4072-9bc1-36740060fb30 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=71939) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:442}} Nov 24 16:34:43.298627 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae6ede73-60a2-4072-9bc1-36740060fb30 admin admin] RBAC: Authorization granted {{(pid=71939) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 24 16:34:43.308174 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: [pid: 71939|app: 0|req: 600/1200] 10.222.0.53 () {58 vars in 1315 bytes} [Wed Nov 24 16:34:43 2021] GET /identity/v3/auth/tokens => generated 3413 bytes in 63 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 24 16:34:43.314809 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31f830a7-8a0d-4419-920f-edd44f0b8669 admin admin] Authenticating user token {{(pid=71938) process_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 24 16:34:43.325829 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31f830a7-8a0d-4419-920f-edd44f0b8669 admin admin] Validating token access rules against request {{(pid=71938) validate_allowed_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 24 16:34:43.331318 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1badb38-428c-44a9-af01-8e4e2a0ca3dc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f2ba2e8375b4e8c8792ee1e22b60427', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '00a5583c7b7443e98e7a1d31a0b638dc', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=71938) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 24 16:34:43.332208 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1badb38-428c-44a9-af01-8e4e2a0ca3dc admin admin] REQUEST_METHOD: `GET` {{(pid=71938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 24 16:34:43.332553 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1badb38-428c-44a9-af01-8e4e2a0ca3dc admin admin] SCRIPT_NAME: `/identity` {{(pid=71938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 24 16:34:43.332886 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1badb38-428c-44a9-af01-8e4e2a0ca3dc admin admin] PATH_INFO: `/v3/projects/bb8d9361b6cd4b5da0aa50649fd0a2ba` {{(pid=71938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 24 16:34:43.334124 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1badb38-428c-44a9-af01-8e4e2a0ca3dc admin admin] RBAC: Authorizing `identity:get_project(project_id=bb8d9361b6cd4b5da0aa50649fd0a2ba)` {{(pid=71938) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:442}} Nov 24 16:34:43.363442 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1badb38-428c-44a9-af01-8e4e2a0ca3dc admin admin] RBAC: Authorization granted {{(pid=71938) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 24 16:34:43.365281 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: [pid: 71938|app: 0|req: 601/1201] 10.222.0.53 () {56 vars in 1198 bytes} [Wed Nov 24 16:34:43 2021] GET /identity/v3/projects/bb8d9361b6cd4b5da0aa50649fd0a2ba => generated 311 bytes in 51 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 24 16:34:43.371926 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae6ede73-60a2-4072-9bc1-36740060fb30 admin admin] Authenticating user token {{(pid=71939) process_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 24 16:34:43.381342 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae6ede73-60a2-4072-9bc1-36740060fb30 admin admin] Validating token access rules against request {{(pid=71939) validate_allowed_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 24 16:34:43.386205 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27606810-2769-466a-ab5a-d77be422600f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f2ba2e8375b4e8c8792ee1e22b60427', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '00a5583c7b7443e98e7a1d31a0b638dc', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=71939) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 24 16:34:43.387371 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27606810-2769-466a-ab5a-d77be422600f admin admin] REQUEST_METHOD: `GET` {{(pid=71939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 24 16:34:43.387705 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27606810-2769-466a-ab5a-d77be422600f admin admin] SCRIPT_NAME: `/identity` {{(pid=71939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 24 16:34:43.388040 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27606810-2769-466a-ab5a-d77be422600f admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=71939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 24 16:34:43.388944 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27606810-2769-466a-ab5a-d77be422600f admin admin] RBAC: Adding query filter params (role.id=5611724e350b41e19921b5961a342582, scope.project.id=bb8d9361b6cd4b5da0aa50649fd0a2ba, user.id=a75b9ce272c04194a264dcd20640b55b) {{(pid=71939) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:161}} Nov 24 16:34:43.389306 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27606810-2769-466a-ab5a-d77be422600f admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=71939) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:442}} Nov 24 16:34:43.418312 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27606810-2769-466a-ab5a-d77be422600f admin admin] RBAC: Authorization granted {{(pid=71939) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 24 16:34:43.424653 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: [pid: 71939|app: 0|req: 601/1202] 10.222.0.53 () {56 vars in 1386 bytes} [Wed Nov 24 16:34:43 2021] GET /identity/v3/role_assignments?user.id=a75b9ce272c04194a264dcd20640b55b&scope.project.id=bb8d9361b6cd4b5da0aa50649fd0a2ba&role.id=5611724e350b41e19921b5961a342582 => generated 259 bytes in 53 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 24 16:34:45.423075 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cff3675-45e1-45a4-b447-887355ed2de6 None None] REQUEST_METHOD: `GET` {{(pid=71938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 24 16:34:45.423633 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cff3675-45e1-45a4-b447-887355ed2de6 None None] SCRIPT_NAME: `/identity` {{(pid=71938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 24 16:34:45.423751 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cff3675-45e1-45a4-b447-887355ed2de6 None None] PATH_INFO: `/` {{(pid=71938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 24 16:34:45.425560 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: [pid: 71938|app: 0|req: 602/1203] 10.222.0.53 () {54 vars in 915 bytes} [Wed Nov 24 16:34:45 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 24 16:34:45.431964 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2dfbd16-570f-4ee6-b25f-0f15ab6d6639 None None] REQUEST_METHOD: `POST` {{(pid=71939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 24 16:34:45.432323 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2dfbd16-570f-4ee6-b25f-0f15ab6d6639 None None] SCRIPT_NAME: `/identity` {{(pid=71939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 24 16:34:45.432664 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2dfbd16-570f-4ee6-b25f-0f15ab6d6639 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=71939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 24 16:34:45.457632 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.auth.core [None req-c2dfbd16-570f-4ee6-b25f-0f15ab6d6639 None None] MFA Rules not processed for user `0f2ba2e8375b4e8c8792ee1e22b60427`. Rule list: `[]` (Enabled: `True`). {{(pid=71939) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:442}} Nov 24 16:34:45.458896 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.fernet_utils [None req-c2dfbd16-570f-4ee6-b25f-0f15ab6d6639 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=71939) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:289}} Nov 24 16:34:45.466336 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: [pid: 71939|app: 0|req: 602/1204] 10.222.0.53 () {58 vars in 1013 bytes} [Wed Nov 24 16:34:45 2021] POST /identity/v3/auth/tokens => generated 3413 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 24 16:34:45.488657 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c9208b0-7ce9-4adc-bb8a-c53604add0ed None None] REQUEST_METHOD: `POST` {{(pid=71938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 24 16:34:45.489008 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c9208b0-7ce9-4adc-bb8a-c53604add0ed None None] SCRIPT_NAME: `/identity` {{(pid=71938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 24 16:34:45.489343 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c9208b0-7ce9-4adc-bb8a-c53604add0ed None None] PATH_INFO: `/v3/auth/tokens` {{(pid=71938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 24 16:34:45.514232 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.auth.core [None req-3c9208b0-7ce9-4adc-bb8a-c53604add0ed None None] MFA Rules not processed for user `0f2ba2e8375b4e8c8792ee1e22b60427`. Rule list: `[]` (Enabled: `True`). {{(pid=71938) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:442}} Nov 24 16:34:45.515451 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.fernet_utils [None req-3c9208b0-7ce9-4adc-bb8a-c53604add0ed None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=71938) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:289}} Nov 24 16:34:45.522825 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: [pid: 71938|app: 0|req: 603/1205] 10.222.0.53 () {58 vars in 1013 bytes} [Wed Nov 24 16:34:45 2021] POST /identity/v3/auth/tokens => generated 3413 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 24 16:34:45.529297 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2dfbd16-570f-4ee6-b25f-0f15ab6d6639 None None] Authenticating user token {{(pid=71939) process_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 24 16:34:45.539737 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2dfbd16-570f-4ee6-b25f-0f15ab6d6639 None None] Validating token access rules against request {{(pid=71939) validate_allowed_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 24 16:34:45.544495 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f4e6d7b-1e88-4d7c-822c-6e54a2093d69 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f2ba2e8375b4e8c8792ee1e22b60427', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '00a5583c7b7443e98e7a1d31a0b638dc', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=71939) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 24 16:34:45.545447 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f4e6d7b-1e88-4d7c-822c-6e54a2093d69 admin admin] REQUEST_METHOD: `GET` {{(pid=71939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 24 16:34:45.545789 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f4e6d7b-1e88-4d7c-822c-6e54a2093d69 admin admin] SCRIPT_NAME: `/identity` {{(pid=71939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 24 16:34:45.546154 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f4e6d7b-1e88-4d7c-822c-6e54a2093d69 admin admin] PATH_INFO: `/v3/roles/admin` {{(pid=71939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 24 16:34:45.559353 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f4e6d7b-1e88-4d7c-822c-6e54a2093d69 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=71939) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:401}} Nov 24 16:34:45.567152 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: WARNING keystone.server.flask.application [None req-2f4e6d7b-1e88-4d7c-822c-6e54a2093d69 admin admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Nov 24 16:34:45.568400 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: [pid: 71939|app: 0|req: 603/1206] 10.222.0.53 () {56 vars in 1108 bytes} [Wed Nov 24 16:34:45 2021] GET /identity/v3/roles/admin => generated 83 bytes in 40 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 24 16:34:45.577270 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c9208b0-7ce9-4adc-bb8a-c53604add0ed None None] Authenticating user token {{(pid=71938) process_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 24 16:34:45.589191 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c9208b0-7ce9-4adc-bb8a-c53604add0ed None None] Validating token access rules against request {{(pid=71938) validate_allowed_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 24 16:34:45.594921 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72289895-a701-4d54-a6a7-46d8cc3b3c12 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f2ba2e8375b4e8c8792ee1e22b60427', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '00a5583c7b7443e98e7a1d31a0b638dc', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=71938) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 24 16:34:45.595691 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72289895-a701-4d54-a6a7-46d8cc3b3c12 admin admin] REQUEST_METHOD: `GET` {{(pid=71938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 24 16:34:45.596069 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72289895-a701-4d54-a6a7-46d8cc3b3c12 admin admin] SCRIPT_NAME: `/identity` {{(pid=71938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 24 16:34:45.596443 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72289895-a701-4d54-a6a7-46d8cc3b3c12 admin admin] PATH_INFO: `/v3/roles` {{(pid=71938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 24 16:34:45.597431 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72289895-a701-4d54-a6a7-46d8cc3b3c12 admin admin] RBAC: Adding query filter params (name=admin) {{(pid=71938) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:161}} Nov 24 16:34:45.597845 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72289895-a701-4d54-a6a7-46d8cc3b3c12 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=71938) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:442}} Nov 24 16:34:45.629617 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72289895-a701-4d54-a6a7-46d8cc3b3c12 admin admin] RBAC: Authorization granted {{(pid=71938) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 24 16:34:45.639513 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: [pid: 71938|app: 0|req: 604/1207] 10.222.0.53 () {56 vars in 1111 bytes} [Wed Nov 24 16:34:45 2021] GET /identity/v3/roles?name=admin => generated 339 bytes in 63 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 24 16:34:45.645921 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f4e6d7b-1e88-4d7c-822c-6e54a2093d69 admin admin] Authenticating user token {{(pid=71939) process_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 24 16:34:45.656841 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f4e6d7b-1e88-4d7c-822c-6e54a2093d69 admin admin] Validating token access rules against request {{(pid=71939) validate_allowed_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 24 16:34:45.661314 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-732389c1-286c-472e-8510-f09da4296fdc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f2ba2e8375b4e8c8792ee1e22b60427', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '00a5583c7b7443e98e7a1d31a0b638dc', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=71939) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 24 16:34:45.662234 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-732389c1-286c-472e-8510-f09da4296fdc admin admin] REQUEST_METHOD: `GET` {{(pid=71939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 24 16:34:45.662579 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-732389c1-286c-472e-8510-f09da4296fdc admin admin] SCRIPT_NAME: `/identity` {{(pid=71939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 24 16:34:45.662912 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-732389c1-286c-472e-8510-f09da4296fdc admin admin] PATH_INFO: `/v3/users/a75b9ce272c04194a264dcd20640b55b` {{(pid=71939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 24 16:34:45.664206 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-732389c1-286c-472e-8510-f09da4296fdc admin admin] RBAC: Authorizing `identity:get_user(user_id=a75b9ce272c04194a264dcd20640b55b)` {{(pid=71939) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:442}} Nov 24 16:34:45.693854 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-732389c1-286c-472e-8510-f09da4296fdc admin admin] RBAC: Authorization granted {{(pid=71939) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 24 16:34:45.695575 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: [pid: 71939|app: 0|req: 604/1208] 10.222.0.53 () {56 vars in 1189 bytes} [Wed Nov 24 16:34:45 2021] GET /identity/v3/users/a75b9ce272c04194a264dcd20640b55b => generated 286 bytes in 50 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 24 16:34:45.702229 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72289895-a701-4d54-a6a7-46d8cc3b3c12 admin admin] Authenticating user token {{(pid=71938) process_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 24 16:34:45.713328 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72289895-a701-4d54-a6a7-46d8cc3b3c12 admin admin] Validating token access rules against request {{(pid=71938) validate_allowed_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 24 16:34:45.717963 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca372739-6d15-44e7-a2f9-fb0b2933fa92 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f2ba2e8375b4e8c8792ee1e22b60427', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '00a5583c7b7443e98e7a1d31a0b638dc', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=71938) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 24 16:34:45.718844 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca372739-6d15-44e7-a2f9-fb0b2933fa92 admin admin] REQUEST_METHOD: `GET` {{(pid=71938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 24 16:34:45.719181 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca372739-6d15-44e7-a2f9-fb0b2933fa92 admin admin] SCRIPT_NAME: `/identity` {{(pid=71938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 24 16:34:45.719537 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca372739-6d15-44e7-a2f9-fb0b2933fa92 admin admin] PATH_INFO: `/v3/projects/bb8d9361b6cd4b5da0aa50649fd0a2ba` {{(pid=71938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 24 16:34:45.720789 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca372739-6d15-44e7-a2f9-fb0b2933fa92 admin admin] RBAC: Authorizing `identity:get_project(project_id=bb8d9361b6cd4b5da0aa50649fd0a2ba)` {{(pid=71938) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:442}} Nov 24 16:34:45.751393 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca372739-6d15-44e7-a2f9-fb0b2933fa92 admin admin] RBAC: Authorization granted {{(pid=71938) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 24 16:34:45.753127 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: [pid: 71938|app: 0|req: 605/1209] 10.222.0.53 () {56 vars in 1198 bytes} [Wed Nov 24 16:34:45 2021] GET /identity/v3/projects/bb8d9361b6cd4b5da0aa50649fd0a2ba => generated 311 bytes in 51 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 24 16:34:45.759581 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-732389c1-286c-472e-8510-f09da4296fdc admin admin] Authenticating user token {{(pid=71939) process_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 24 16:34:45.769687 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-732389c1-286c-472e-8510-f09da4296fdc admin admin] Validating token access rules against request {{(pid=71939) validate_allowed_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 24 16:34:45.774494 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31cf6608-74d0-48c5-a81b-0f0ee79d721f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f2ba2e8375b4e8c8792ee1e22b60427', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '00a5583c7b7443e98e7a1d31a0b638dc', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=71939) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 24 16:34:45.775397 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31cf6608-74d0-48c5-a81b-0f0ee79d721f admin admin] REQUEST_METHOD: `PUT` {{(pid=71939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 24 16:34:45.775735 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31cf6608-74d0-48c5-a81b-0f0ee79d721f admin admin] SCRIPT_NAME: `/identity` {{(pid=71939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 24 16:34:45.776068 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31cf6608-74d0-48c5-a81b-0f0ee79d721f admin admin] PATH_INFO: `/v3/projects/bb8d9361b6cd4b5da0aa50649fd0a2ba/users/a75b9ce272c04194a264dcd20640b55b/roles/5611724e350b41e19921b5961a342582` {{(pid=71939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 24 16:34:45.778089 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31cf6608-74d0-48c5-a81b-0f0ee79d721f admin admin] RBAC: Authorizing `identity:create_grant(project_id=bb8d9361b6cd4b5da0aa50649fd0a2ba, user_id=a75b9ce272c04194a264dcd20640b55b, role_id=5611724e350b41e19921b5961a342582)` {{(pid=71939) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:442}} Nov 24 16:34:45.807680 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31cf6608-74d0-48c5-a81b-0f0ee79d721f admin admin] RBAC: Authorization granted {{(pid=71939) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 24 16:34:45.819972 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: [pid: 71939|app: 0|req: 605/1210] 10.222.0.53 () {58 vars in 1451 bytes} [Wed Nov 24 16:34:45 2021] PUT /identity/v3/projects/bb8d9361b6cd4b5da0aa50649fd0a2ba/users/a75b9ce272c04194a264dcd20640b55b/roles/5611724e350b41e19921b5961a342582 => generated 0 bytes in 61 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 24 16:34:47.810816 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdf796a4-3ca8-4695-a4bf-560172ed3da5 None None] REQUEST_METHOD: `GET` {{(pid=71938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 24 16:34:47.811380 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdf796a4-3ca8-4695-a4bf-560172ed3da5 None None] SCRIPT_NAME: `/identity` {{(pid=71938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 24 16:34:47.811470 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdf796a4-3ca8-4695-a4bf-560172ed3da5 None None] PATH_INFO: `/` {{(pid=71938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 24 16:34:47.813271 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: [pid: 71938|app: 0|req: 606/1211] 10.222.0.53 () {54 vars in 915 bytes} [Wed Nov 24 16:34:47 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 24 16:34:47.818890 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb65d93d-18fb-49ff-8786-0c16483a243b None None] REQUEST_METHOD: `POST` {{(pid=71939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 24 16:34:47.819249 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb65d93d-18fb-49ff-8786-0c16483a243b None None] SCRIPT_NAME: `/identity` {{(pid=71939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 24 16:34:47.819592 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb65d93d-18fb-49ff-8786-0c16483a243b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=71939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 24 16:34:47.843980 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.auth.core [None req-fb65d93d-18fb-49ff-8786-0c16483a243b None None] MFA Rules not processed for user `0f2ba2e8375b4e8c8792ee1e22b60427`. Rule list: `[]` (Enabled: `True`). {{(pid=71939) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:442}} Nov 24 16:34:47.845211 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.fernet_utils [None req-fb65d93d-18fb-49ff-8786-0c16483a243b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=71939) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:289}} Nov 24 16:34:47.912668 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: [pid: 71939|app: 0|req: 606/1212] 10.222.0.53 () {58 vars in 1013 bytes} [Wed Nov 24 16:34:47 2021] POST /identity/v3/auth/tokens => generated 3413 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 24 16:34:47.942142 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35d54776-8328-4ea2-9679-25278de35b97 None None] REQUEST_METHOD: `POST` {{(pid=71938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 24 16:34:47.942496 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35d54776-8328-4ea2-9679-25278de35b97 None None] SCRIPT_NAME: `/identity` {{(pid=71938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 24 16:34:47.942843 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35d54776-8328-4ea2-9679-25278de35b97 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=71938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 24 16:34:47.972824 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.auth.core [None req-35d54776-8328-4ea2-9679-25278de35b97 None None] MFA Rules not processed for user `0f2ba2e8375b4e8c8792ee1e22b60427`. Rule list: `[]` (Enabled: `True`). {{(pid=71938) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:442}} Nov 24 16:34:47.975171 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.fernet_utils [None req-35d54776-8328-4ea2-9679-25278de35b97 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=71938) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:289}} Nov 24 16:34:47.985276 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: [pid: 71938|app: 0|req: 607/1213] 10.222.0.53 () {58 vars in 1013 bytes} [Wed Nov 24 16:34:47 2021] POST /identity/v3/auth/tokens => generated 3413 bytes in 45 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 24 16:34:47.991879 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb65d93d-18fb-49ff-8786-0c16483a243b None None] Authenticating user token {{(pid=71939) process_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 24 16:34:48.002375 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb65d93d-18fb-49ff-8786-0c16483a243b None None] Validating token access rules against request {{(pid=71939) validate_allowed_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 24 16:34:48.006746 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44d632ab-5f9b-4e69-89f8-a19c120a4cd7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f2ba2e8375b4e8c8792ee1e22b60427', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '00a5583c7b7443e98e7a1d31a0b638dc', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=71939) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 24 16:34:48.007559 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44d632ab-5f9b-4e69-89f8-a19c120a4cd7 admin admin] REQUEST_METHOD: `GET` {{(pid=71939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 24 16:34:48.007900 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44d632ab-5f9b-4e69-89f8-a19c120a4cd7 admin admin] SCRIPT_NAME: `/identity` {{(pid=71939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 24 16:34:48.008236 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44d632ab-5f9b-4e69-89f8-a19c120a4cd7 admin admin] PATH_INFO: `/v3/roles/admin` {{(pid=71939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 24 16:34:48.020050 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44d632ab-5f9b-4e69-89f8-a19c120a4cd7 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=71939) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:401}} Nov 24 16:34:48.027543 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: WARNING keystone.server.flask.application [None req-44d632ab-5f9b-4e69-89f8-a19c120a4cd7 admin admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Nov 24 16:34:48.028748 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: [pid: 71939|app: 0|req: 607/1214] 10.222.0.53 () {56 vars in 1108 bytes} [Wed Nov 24 16:34:47 2021] GET /identity/v3/roles/admin => generated 83 bytes in 38 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 24 16:34:48.035731 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35d54776-8328-4ea2-9679-25278de35b97 None None] Authenticating user token {{(pid=71938) process_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 24 16:34:48.045634 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35d54776-8328-4ea2-9679-25278de35b97 None None] Validating token access rules against request {{(pid=71938) validate_allowed_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 24 16:34:48.050272 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3146593d-7f1a-4280-bad4-d7645f3538e8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f2ba2e8375b4e8c8792ee1e22b60427', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '00a5583c7b7443e98e7a1d31a0b638dc', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=71938) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 24 16:34:48.050951 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3146593d-7f1a-4280-bad4-d7645f3538e8 admin admin] REQUEST_METHOD: `GET` {{(pid=71938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 24 16:34:48.051294 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3146593d-7f1a-4280-bad4-d7645f3538e8 admin admin] SCRIPT_NAME: `/identity` {{(pid=71938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 24 16:34:48.051627 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3146593d-7f1a-4280-bad4-d7645f3538e8 admin admin] PATH_INFO: `/v3/roles` {{(pid=71938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 24 16:34:48.052440 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3146593d-7f1a-4280-bad4-d7645f3538e8 admin admin] RBAC: Adding query filter params (name=admin) {{(pid=71938) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:161}} Nov 24 16:34:48.052794 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3146593d-7f1a-4280-bad4-d7645f3538e8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=71938) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:442}} Nov 24 16:34:48.081743 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3146593d-7f1a-4280-bad4-d7645f3538e8 admin admin] RBAC: Authorization granted {{(pid=71938) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 24 16:34:48.091040 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: [pid: 71938|app: 0|req: 608/1215] 10.222.0.53 () {56 vars in 1111 bytes} [Wed Nov 24 16:34:48 2021] GET /identity/v3/roles?name=admin => generated 339 bytes in 56 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 24 16:34:48.097282 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44d632ab-5f9b-4e69-89f8-a19c120a4cd7 admin admin] Authenticating user token {{(pid=71939) process_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 24 16:34:48.110175 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44d632ab-5f9b-4e69-89f8-a19c120a4cd7 admin admin] Validating token access rules against request {{(pid=71939) validate_allowed_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 24 16:34:48.114553 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d10820a-f522-48ee-9525-9991ec6505f3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f2ba2e8375b4e8c8792ee1e22b60427', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '00a5583c7b7443e98e7a1d31a0b638dc', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=71939) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 24 16:34:48.115428 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d10820a-f522-48ee-9525-9991ec6505f3 admin admin] REQUEST_METHOD: `GET` {{(pid=71939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 24 16:34:48.115766 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d10820a-f522-48ee-9525-9991ec6505f3 admin admin] SCRIPT_NAME: `/identity` {{(pid=71939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 24 16:34:48.116094 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d10820a-f522-48ee-9525-9991ec6505f3 admin admin] PATH_INFO: `/v3/users/a75b9ce272c04194a264dcd20640b55b` {{(pid=71939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 24 16:34:48.117301 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d10820a-f522-48ee-9525-9991ec6505f3 admin admin] RBAC: Authorizing `identity:get_user(user_id=a75b9ce272c04194a264dcd20640b55b)` {{(pid=71939) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:442}} Nov 24 16:34:48.146278 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d10820a-f522-48ee-9525-9991ec6505f3 admin admin] RBAC: Authorization granted {{(pid=71939) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 24 16:34:48.147992 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: [pid: 71939|app: 0|req: 608/1216] 10.222.0.53 () {56 vars in 1189 bytes} [Wed Nov 24 16:34:48 2021] GET /identity/v3/users/a75b9ce272c04194a264dcd20640b55b => generated 286 bytes in 51 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 24 16:34:48.154300 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3146593d-7f1a-4280-bad4-d7645f3538e8 admin admin] Authenticating user token {{(pid=71938) process_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 24 16:34:48.164351 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3146593d-7f1a-4280-bad4-d7645f3538e8 admin admin] Validating token access rules against request {{(pid=71938) validate_allowed_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 24 16:34:48.169475 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05ae8c9e-de39-43f4-80e9-26162b29b17c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f2ba2e8375b4e8c8792ee1e22b60427', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '00a5583c7b7443e98e7a1d31a0b638dc', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=71938) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 24 16:34:48.170157 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05ae8c9e-de39-43f4-80e9-26162b29b17c admin admin] REQUEST_METHOD: `GET` {{(pid=71938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 24 16:34:48.170501 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05ae8c9e-de39-43f4-80e9-26162b29b17c admin admin] SCRIPT_NAME: `/identity` {{(pid=71938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 24 16:34:48.170837 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05ae8c9e-de39-43f4-80e9-26162b29b17c admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=71938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 24 16:34:48.179582 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05ae8c9e-de39-43f4-80e9-26162b29b17c admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=71938) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:442}} Nov 24 16:34:48.208897 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05ae8c9e-de39-43f4-80e9-26162b29b17c admin admin] RBAC: Authorization granted {{(pid=71938) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 24 16:34:48.219485 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: [pid: 71938|app: 0|req: 609/1217] 10.222.0.53 () {58 vars in 1315 bytes} [Wed Nov 24 16:34:48 2021] GET /identity/v3/auth/tokens => generated 3413 bytes in 66 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 24 16:34:48.226437 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d10820a-f522-48ee-9525-9991ec6505f3 admin admin] Authenticating user token {{(pid=71939) process_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 24 16:34:48.237010 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d10820a-f522-48ee-9525-9991ec6505f3 admin admin] Validating token access rules against request {{(pid=71939) validate_allowed_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 24 16:34:48.241490 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-199de4b5-ec85-4765-b7aa-7c7623dca018 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f2ba2e8375b4e8c8792ee1e22b60427', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '00a5583c7b7443e98e7a1d31a0b638dc', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=71939) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 24 16:34:48.242387 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-199de4b5-ec85-4765-b7aa-7c7623dca018 admin admin] REQUEST_METHOD: `GET` {{(pid=71939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 24 16:34:48.242726 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-199de4b5-ec85-4765-b7aa-7c7623dca018 admin admin] SCRIPT_NAME: `/identity` {{(pid=71939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 24 16:34:48.243056 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-199de4b5-ec85-4765-b7aa-7c7623dca018 admin admin] PATH_INFO: `/v3/projects/bb8d9361b6cd4b5da0aa50649fd0a2ba` {{(pid=71939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 24 16:34:48.244250 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-199de4b5-ec85-4765-b7aa-7c7623dca018 admin admin] RBAC: Authorizing `identity:get_project(project_id=bb8d9361b6cd4b5da0aa50649fd0a2ba)` {{(pid=71939) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:442}} Nov 24 16:34:48.276056 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-199de4b5-ec85-4765-b7aa-7c7623dca018 admin admin] RBAC: Authorization granted {{(pid=71939) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 24 16:34:48.278500 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: [pid: 71939|app: 0|req: 609/1218] 10.222.0.53 () {56 vars in 1198 bytes} [Wed Nov 24 16:34:48 2021] GET /identity/v3/projects/bb8d9361b6cd4b5da0aa50649fd0a2ba => generated 311 bytes in 53 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Nov 24 16:34:48.285360 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05ae8c9e-de39-43f4-80e9-26162b29b17c admin admin] Authenticating user token {{(pid=71938) process_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 24 16:34:48.295330 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05ae8c9e-de39-43f4-80e9-26162b29b17c admin admin] Validating token access rules against request {{(pid=71938) validate_allowed_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 24 16:34:48.299812 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44c6ad88-5e4b-46e0-86a9-1efd3da31fd5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f2ba2e8375b4e8c8792ee1e22b60427', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '00a5583c7b7443e98e7a1d31a0b638dc', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=71938) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 24 16:34:48.300473 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44c6ad88-5e4b-46e0-86a9-1efd3da31fd5 admin admin] REQUEST_METHOD: `GET` {{(pid=71938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 24 16:34:48.300813 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44c6ad88-5e4b-46e0-86a9-1efd3da31fd5 admin admin] SCRIPT_NAME: `/identity` {{(pid=71938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 24 16:34:48.301150 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44c6ad88-5e4b-46e0-86a9-1efd3da31fd5 admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=71938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 24 16:34:48.302053 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44c6ad88-5e4b-46e0-86a9-1efd3da31fd5 admin admin] RBAC: Adding query filter params (role.id=5611724e350b41e19921b5961a342582, scope.project.id=bb8d9361b6cd4b5da0aa50649fd0a2ba, user.id=a75b9ce272c04194a264dcd20640b55b) {{(pid=71938) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:161}} Nov 24 16:34:48.302432 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44c6ad88-5e4b-46e0-86a9-1efd3da31fd5 admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=71938) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:442}} Nov 24 16:34:48.331628 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44c6ad88-5e4b-46e0-86a9-1efd3da31fd5 admin admin] RBAC: Authorization granted {{(pid=71938) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 24 16:34:48.338439 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: [pid: 71938|app: 0|req: 610/1219] 10.222.0.53 () {56 vars in 1386 bytes} [Wed Nov 24 16:34:48 2021] GET /identity/v3/role_assignments?user.id=a75b9ce272c04194a264dcd20640b55b&scope.project.id=bb8d9361b6cd4b5da0aa50649fd0a2ba&role.id=5611724e350b41e19921b5961a342582 => generated 608 bytes in 54 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 24 16:34:50.353929 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69cd4244-6a2f-42f9-815e-b8379191e6af None None] REQUEST_METHOD: `GET` {{(pid=71939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 24 16:34:50.354503 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69cd4244-6a2f-42f9-815e-b8379191e6af None None] SCRIPT_NAME: `/identity` {{(pid=71939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 24 16:34:50.354636 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69cd4244-6a2f-42f9-815e-b8379191e6af None None] PATH_INFO: `/` {{(pid=71939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 24 16:34:50.356478 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: [pid: 71939|app: 0|req: 610/1220] 10.222.0.53 () {54 vars in 915 bytes} [Wed Nov 24 16:34:50 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 24 16:34:50.362137 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86b0ca64-29a2-4240-89ac-3be0e0ad9bf2 None None] REQUEST_METHOD: `POST` {{(pid=71938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 24 16:34:50.362492 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86b0ca64-29a2-4240-89ac-3be0e0ad9bf2 None None] SCRIPT_NAME: `/identity` {{(pid=71938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 24 16:34:50.362834 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86b0ca64-29a2-4240-89ac-3be0e0ad9bf2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=71938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 24 16:34:50.387288 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.auth.core [None req-86b0ca64-29a2-4240-89ac-3be0e0ad9bf2 None None] MFA Rules not processed for user `0f2ba2e8375b4e8c8792ee1e22b60427`. Rule list: `[]` (Enabled: `True`). {{(pid=71938) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:442}} Nov 24 16:34:50.388518 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.fernet_utils [None req-86b0ca64-29a2-4240-89ac-3be0e0ad9bf2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=71938) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:289}} Nov 24 16:34:50.395992 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: [pid: 71938|app: 0|req: 611/1221] 10.222.0.53 () {58 vars in 1013 bytes} [Wed Nov 24 16:34:50 2021] POST /identity/v3/auth/tokens => generated 3413 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 24 16:34:50.418641 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e69b1b0-ff07-4e5b-a500-3b0cb6b3617f None None] REQUEST_METHOD: `POST` {{(pid=71939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 24 16:34:50.418994 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e69b1b0-ff07-4e5b-a500-3b0cb6b3617f None None] SCRIPT_NAME: `/identity` {{(pid=71939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 24 16:34:50.419328 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e69b1b0-ff07-4e5b-a500-3b0cb6b3617f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=71939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 24 16:34:50.443380 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.auth.core [None req-5e69b1b0-ff07-4e5b-a500-3b0cb6b3617f None None] MFA Rules not processed for user `0f2ba2e8375b4e8c8792ee1e22b60427`. Rule list: `[]` (Enabled: `True`). {{(pid=71939) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:442}} Nov 24 16:34:50.444610 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.fernet_utils [None req-5e69b1b0-ff07-4e5b-a500-3b0cb6b3617f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=71939) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:289}} Nov 24 16:34:50.452764 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: [pid: 71939|app: 0|req: 611/1222] 10.222.0.53 () {58 vars in 1013 bytes} [Wed Nov 24 16:34:50 2021] POST /identity/v3/auth/tokens => generated 3413 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 24 16:34:50.459182 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86b0ca64-29a2-4240-89ac-3be0e0ad9bf2 None None] Authenticating user token {{(pid=71938) process_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 24 16:34:50.469040 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86b0ca64-29a2-4240-89ac-3be0e0ad9bf2 None None] Validating token access rules against request {{(pid=71938) validate_allowed_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 24 16:34:50.473332 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df54e6c7-35b3-48fb-85a1-a21212cac3c4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f2ba2e8375b4e8c8792ee1e22b60427', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '00a5583c7b7443e98e7a1d31a0b638dc', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=71938) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 24 16:34:50.474065 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df54e6c7-35b3-48fb-85a1-a21212cac3c4 admin admin] REQUEST_METHOD: `GET` {{(pid=71938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 24 16:34:50.474397 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df54e6c7-35b3-48fb-85a1-a21212cac3c4 admin admin] SCRIPT_NAME: `/identity` {{(pid=71938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 24 16:34:50.474775 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df54e6c7-35b3-48fb-85a1-a21212cac3c4 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=71938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 24 16:34:50.483337 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df54e6c7-35b3-48fb-85a1-a21212cac3c4 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=71938) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:442}} Nov 24 16:34:50.512918 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df54e6c7-35b3-48fb-85a1-a21212cac3c4 admin admin] RBAC: Authorization granted {{(pid=71938) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 24 16:34:50.522696 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: [pid: 71938|app: 0|req: 612/1223] 10.222.0.53 () {58 vars in 1315 bytes} [Wed Nov 24 16:34:50 2021] GET /identity/v3/auth/tokens => generated 3413 bytes in 64 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 24 16:34:50.529235 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e69b1b0-ff07-4e5b-a500-3b0cb6b3617f None None] Authenticating user token {{(pid=71939) process_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 24 16:34:50.538554 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e69b1b0-ff07-4e5b-a500-3b0cb6b3617f None None] Validating token access rules against request {{(pid=71939) validate_allowed_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 24 16:34:50.543198 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90acc12b-73b9-466f-a249-2bc2977d17c0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f2ba2e8375b4e8c8792ee1e22b60427', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '00a5583c7b7443e98e7a1d31a0b638dc', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=71939) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 24 16:34:50.544017 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90acc12b-73b9-466f-a249-2bc2977d17c0 admin admin] REQUEST_METHOD: `GET` {{(pid=71939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 24 16:34:50.544352 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90acc12b-73b9-466f-a249-2bc2977d17c0 admin admin] SCRIPT_NAME: `/identity` {{(pid=71939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 24 16:34:50.544677 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90acc12b-73b9-466f-a249-2bc2977d17c0 admin admin] PATH_INFO: `/v3/domains/swift_test` {{(pid=71939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 24 16:34:50.553223 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90acc12b-73b9-466f-a249-2bc2977d17c0 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=swift_test)` {{(pid=71939) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:442}} Nov 24 16:34:50.582905 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90acc12b-73b9-466f-a249-2bc2977d17c0 admin admin] RBAC: Authorization granted {{(pid=71939) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 24 16:34:50.601022 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: WARNING keystone.server.flask.application [None req-90acc12b-73b9-466f-a249-2bc2977d17c0 admin admin] Could not find domain: swift_test.: keystone.exception.DomainNotFound: Could not find domain: swift_test. Nov 24 16:34:50.602343 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: [pid: 71939|app: 0|req: 612/1224] 10.222.0.53 () {56 vars in 1129 bytes} [Wed Nov 24 16:34:50 2021] GET /identity/v3/domains/swift_test => generated 90 bytes in 74 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 24 16:34:50.609652 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df54e6c7-35b3-48fb-85a1-a21212cac3c4 admin admin] Authenticating user token {{(pid=71938) process_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 24 16:34:50.618907 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df54e6c7-35b3-48fb-85a1-a21212cac3c4 admin admin] Validating token access rules against request {{(pid=71938) validate_allowed_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 24 16:34:50.623872 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dee0ee65-e6fb-4d9f-9b42-d1a2f8862ccf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f2ba2e8375b4e8c8792ee1e22b60427', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '00a5583c7b7443e98e7a1d31a0b638dc', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=71938) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 24 16:34:50.624533 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dee0ee65-e6fb-4d9f-9b42-d1a2f8862ccf admin admin] REQUEST_METHOD: `GET` {{(pid=71938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 24 16:34:50.624866 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dee0ee65-e6fb-4d9f-9b42-d1a2f8862ccf admin admin] SCRIPT_NAME: `/identity` {{(pid=71938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 24 16:34:50.625194 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dee0ee65-e6fb-4d9f-9b42-d1a2f8862ccf admin admin] PATH_INFO: `/v3/domains` {{(pid=71938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 24 16:34:50.625969 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dee0ee65-e6fb-4d9f-9b42-d1a2f8862ccf admin admin] RBAC: Adding query filter params (name=swift_test) {{(pid=71938) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:161}} Nov 24 16:34:50.626346 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dee0ee65-e6fb-4d9f-9b42-d1a2f8862ccf admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=71938) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:442}} Nov 24 16:34:50.655508 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dee0ee65-e6fb-4d9f-9b42-d1a2f8862ccf admin admin] RBAC: Authorization granted {{(pid=71938) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 24 16:34:50.664622 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: [pid: 71938|app: 0|req: 613/1225] 10.222.0.53 () {56 vars in 1127 bytes} [Wed Nov 24 16:34:50 2021] GET /identity/v3/domains?name=swift_test => generated 125 bytes in 55 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 24 16:34:52.624239 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-587e273f-6bed-45ca-9851-d55cc7accde8 None None] REQUEST_METHOD: `GET` {{(pid=71939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 24 16:34:52.624739 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-587e273f-6bed-45ca-9851-d55cc7accde8 None None] SCRIPT_NAME: `/identity` {{(pid=71939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 24 16:34:52.624828 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-587e273f-6bed-45ca-9851-d55cc7accde8 None None] PATH_INFO: `/` {{(pid=71939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 24 16:34:52.626685 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: [pid: 71939|app: 0|req: 613/1226] 10.222.0.53 () {54 vars in 915 bytes} [Wed Nov 24 16:34:52 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 24 16:34:52.632475 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96c6b8f2-0218-4a0d-aae1-59c041080d7c None None] REQUEST_METHOD: `POST` {{(pid=71938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 24 16:34:52.632819 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96c6b8f2-0218-4a0d-aae1-59c041080d7c None None] SCRIPT_NAME: `/identity` {{(pid=71938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 24 16:34:52.633149 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96c6b8f2-0218-4a0d-aae1-59c041080d7c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=71938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 24 16:34:52.658374 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.auth.core [None req-96c6b8f2-0218-4a0d-aae1-59c041080d7c None None] MFA Rules not processed for user `0f2ba2e8375b4e8c8792ee1e22b60427`. Rule list: `[]` (Enabled: `True`). {{(pid=71938) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:442}} Nov 24 16:34:52.659568 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.fernet_utils [None req-96c6b8f2-0218-4a0d-aae1-59c041080d7c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=71938) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:289}} Nov 24 16:34:52.667280 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: [pid: 71938|app: 0|req: 614/1227] 10.222.0.53 () {58 vars in 1013 bytes} [Wed Nov 24 16:34:52 2021] POST /identity/v3/auth/tokens => generated 3413 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 24 16:34:52.689817 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b75e5bd8-5382-48e8-8429-b8357464d7f9 None None] REQUEST_METHOD: `POST` {{(pid=71939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 24 16:34:52.690221 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b75e5bd8-5382-48e8-8429-b8357464d7f9 None None] SCRIPT_NAME: `/identity` {{(pid=71939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 24 16:34:52.690559 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b75e5bd8-5382-48e8-8429-b8357464d7f9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=71939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 24 16:34:52.713573 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.auth.core [None req-b75e5bd8-5382-48e8-8429-b8357464d7f9 None None] MFA Rules not processed for user `0f2ba2e8375b4e8c8792ee1e22b60427`. Rule list: `[]` (Enabled: `True`). {{(pid=71939) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:442}} Nov 24 16:34:52.715315 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.fernet_utils [None req-b75e5bd8-5382-48e8-8429-b8357464d7f9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=71939) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:289}} Nov 24 16:34:52.722592 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: [pid: 71939|app: 0|req: 614/1228] 10.222.0.53 () {58 vars in 1013 bytes} [Wed Nov 24 16:34:52 2021] POST /identity/v3/auth/tokens => generated 3413 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 24 16:34:52.728625 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96c6b8f2-0218-4a0d-aae1-59c041080d7c None None] Authenticating user token {{(pid=71938) process_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 24 16:34:52.738725 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96c6b8f2-0218-4a0d-aae1-59c041080d7c None None] Validating token access rules against request {{(pid=71938) validate_allowed_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 24 16:34:52.743147 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5165e49-d9b8-436b-85ba-f757a8b6338b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f2ba2e8375b4e8c8792ee1e22b60427', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '00a5583c7b7443e98e7a1d31a0b638dc', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=71938) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 24 16:34:52.743805 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5165e49-d9b8-436b-85ba-f757a8b6338b admin admin] REQUEST_METHOD: `POST` {{(pid=71938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 24 16:34:52.744138 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5165e49-d9b8-436b-85ba-f757a8b6338b admin admin] SCRIPT_NAME: `/identity` {{(pid=71938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 24 16:34:52.744461 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5165e49-d9b8-436b-85ba-f757a8b6338b admin admin] PATH_INFO: `/v3/domains` {{(pid=71938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 24 16:34:52.745235 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5165e49-d9b8-436b-85ba-f757a8b6338b admin admin] RBAC: Authorizing `identity:create_domain()` {{(pid=71938) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:442}} Nov 24 16:34:52.772637 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: WARNING py.warnings [None req-f5165e49-d9b8-436b-85ba-f757a8b6338b admin admin] /usr/local/lib/python3.6/dist-packages/oslo_policy/policy.py:1018: UserWarning: Policy identity:create_domain failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 24 16:34:52.772637 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: warnings.warn(msg) Nov 24 16:34:52.772637 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: Nov 24 16:34:52.773636 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5165e49-d9b8-436b-85ba-f757a8b6338b admin admin] RBAC: Authorization granted {{(pid=71938) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 24 16:34:52.787566 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: [pid: 71938|app: 0|req: 615/1229] 10.222.0.53 () {60 vars in 1150 bytes} [Wed Nov 24 16:34:52 2021] POST /identity/v3/domains => generated 267 bytes in 59 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 24 16:34:54.789123 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aadb2362-b39b-4982-b2c8-37f8f4f89cf3 None None] REQUEST_METHOD: `GET` {{(pid=71939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 24 16:34:54.789673 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aadb2362-b39b-4982-b2c8-37f8f4f89cf3 None None] SCRIPT_NAME: `/identity` {{(pid=71939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 24 16:34:54.789764 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aadb2362-b39b-4982-b2c8-37f8f4f89cf3 None None] PATH_INFO: `/` {{(pid=71939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 24 16:34:54.791629 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: [pid: 71939|app: 0|req: 615/1230] 10.222.0.53 () {54 vars in 915 bytes} [Wed Nov 24 16:34:54 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 24 16:34:54.797753 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a385dc55-6138-405c-8836-76e60c1ed803 None None] REQUEST_METHOD: `POST` {{(pid=71938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 24 16:34:54.798134 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a385dc55-6138-405c-8836-76e60c1ed803 None None] SCRIPT_NAME: `/identity` {{(pid=71938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 24 16:34:54.798469 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a385dc55-6138-405c-8836-76e60c1ed803 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=71938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 24 16:34:54.822518 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.auth.core [None req-a385dc55-6138-405c-8836-76e60c1ed803 None None] MFA Rules not processed for user `0f2ba2e8375b4e8c8792ee1e22b60427`. Rule list: `[]` (Enabled: `True`). {{(pid=71938) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:442}} Nov 24 16:34:54.823727 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.fernet_utils [None req-a385dc55-6138-405c-8836-76e60c1ed803 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=71938) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:289}} Nov 24 16:34:54.891223 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: [pid: 71938|app: 0|req: 616/1231] 10.222.0.53 () {58 vars in 1013 bytes} [Wed Nov 24 16:34:54 2021] POST /identity/v3/auth/tokens => generated 3413 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 24 16:34:54.913498 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c2afeda-7af3-4014-ab7a-9a9821e027d6 None None] REQUEST_METHOD: `POST` {{(pid=71939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 24 16:34:54.913842 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c2afeda-7af3-4014-ab7a-9a9821e027d6 None None] SCRIPT_NAME: `/identity` {{(pid=71939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 24 16:34:54.914229 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c2afeda-7af3-4014-ab7a-9a9821e027d6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=71939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 24 16:34:54.938733 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.auth.core [None req-4c2afeda-7af3-4014-ab7a-9a9821e027d6 None None] MFA Rules not processed for user `0f2ba2e8375b4e8c8792ee1e22b60427`. Rule list: `[]` (Enabled: `True`). {{(pid=71939) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:442}} Nov 24 16:34:54.940414 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.fernet_utils [None req-4c2afeda-7af3-4014-ab7a-9a9821e027d6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=71939) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:289}} Nov 24 16:34:54.948560 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: [pid: 71939|app: 0|req: 616/1232] 10.222.0.53 () {58 vars in 1013 bytes} [Wed Nov 24 16:34:54 2021] POST /identity/v3/auth/tokens => generated 3413 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 24 16:34:54.955077 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a385dc55-6138-405c-8836-76e60c1ed803 None None] Authenticating user token {{(pid=71938) process_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 24 16:34:54.965400 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a385dc55-6138-405c-8836-76e60c1ed803 None None] Validating token access rules against request {{(pid=71938) validate_allowed_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 24 16:34:54.969892 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a096a8c1-071e-4b23-9494-9c6d2ef1a131 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f2ba2e8375b4e8c8792ee1e22b60427', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '00a5583c7b7443e98e7a1d31a0b638dc', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=71938) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 24 16:34:54.970821 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a096a8c1-071e-4b23-9494-9c6d2ef1a131 admin admin] REQUEST_METHOD: `GET` {{(pid=71938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 24 16:34:54.971157 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a096a8c1-071e-4b23-9494-9c6d2ef1a131 admin admin] SCRIPT_NAME: `/identity` {{(pid=71938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 24 16:34:54.971487 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a096a8c1-071e-4b23-9494-9c6d2ef1a131 admin admin] PATH_INFO: `/v3/domains/5a258b10102643d3be0acb00af15955b` {{(pid=71938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 24 16:34:54.984562 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a096a8c1-071e-4b23-9494-9c6d2ef1a131 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=5a258b10102643d3be0acb00af15955b)` {{(pid=71938) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:442}} Nov 24 16:34:55.012997 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a096a8c1-071e-4b23-9494-9c6d2ef1a131 admin admin] RBAC: Authorization granted {{(pid=71938) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 24 16:34:55.014665 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: [pid: 71938|app: 0|req: 617/1233] 10.222.0.53 () {56 vars in 1195 bytes} [Wed Nov 24 16:34:54 2021] GET /identity/v3/domains/5a258b10102643d3be0acb00af15955b => generated 267 bytes in 60 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 24 16:34:55.020861 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c2afeda-7af3-4014-ab7a-9a9821e027d6 None None] Authenticating user token {{(pid=71939) process_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 24 16:34:55.030553 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c2afeda-7af3-4014-ab7a-9a9821e027d6 None None] Validating token access rules against request {{(pid=71939) validate_allowed_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 24 16:34:55.034873 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32c00808-0c1c-4399-b6f5-99b324dae66e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f2ba2e8375b4e8c8792ee1e22b60427', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '00a5583c7b7443e98e7a1d31a0b638dc', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=71939) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 24 16:34:55.035526 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32c00808-0c1c-4399-b6f5-99b324dae66e admin admin] REQUEST_METHOD: `POST` {{(pid=71939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 24 16:34:55.035861 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32c00808-0c1c-4399-b6f5-99b324dae66e admin admin] SCRIPT_NAME: `/identity` {{(pid=71939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 24 16:34:55.036189 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32c00808-0c1c-4399-b6f5-99b324dae66e admin admin] PATH_INFO: `/v3/projects` {{(pid=71939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 24 16:34:55.036919 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32c00808-0c1c-4399-b6f5-99b324dae66e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=71939) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:442}} Nov 24 16:34:55.065796 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32c00808-0c1c-4399-b6f5-99b324dae66e admin admin] RBAC: Authorization granted {{(pid=71939) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 24 16:34:55.093094 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: [pid: 71939|app: 0|req: 617/1234] 10.222.0.53 () {60 vars in 1153 bytes} [Wed Nov 24 16:34:55 2021] POST /identity/v3/projects => generated 361 bytes in 73 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 24 16:34:57.146065 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4226bab7-451e-45d5-962a-216c94756cfe None None] REQUEST_METHOD: `GET` {{(pid=71938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 24 16:34:57.146593 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4226bab7-451e-45d5-962a-216c94756cfe None None] SCRIPT_NAME: `/identity` {{(pid=71938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 24 16:34:57.146762 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4226bab7-451e-45d5-962a-216c94756cfe None None] PATH_INFO: `/` {{(pid=71938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 24 16:34:57.148598 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: [pid: 71938|app: 0|req: 618/1235] 10.222.0.53 () {54 vars in 915 bytes} [Wed Nov 24 16:34:57 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 24 16:34:57.154193 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e297107-32e8-4708-a6d2-aa9d55790bae None None] REQUEST_METHOD: `POST` {{(pid=71939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 24 16:34:57.154545 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e297107-32e8-4708-a6d2-aa9d55790bae None None] SCRIPT_NAME: `/identity` {{(pid=71939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 24 16:34:57.154882 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e297107-32e8-4708-a6d2-aa9d55790bae None None] PATH_INFO: `/v3/auth/tokens` {{(pid=71939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 24 16:34:57.178130 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.auth.core [None req-8e297107-32e8-4708-a6d2-aa9d55790bae None None] MFA Rules not processed for user `0f2ba2e8375b4e8c8792ee1e22b60427`. Rule list: `[]` (Enabled: `True`). {{(pid=71939) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:442}} Nov 24 16:34:57.179339 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.fernet_utils [None req-8e297107-32e8-4708-a6d2-aa9d55790bae None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=71939) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:289}} Nov 24 16:34:57.245796 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: [pid: 71939|app: 0|req: 618/1236] 10.222.0.53 () {58 vars in 1013 bytes} [Wed Nov 24 16:34:57 2021] POST /identity/v3/auth/tokens => generated 3413 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 24 16:34:57.268048 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a38c763-06b1-47df-b37b-0d4c401eff5f None None] REQUEST_METHOD: `POST` {{(pid=71938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 24 16:34:57.268404 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a38c763-06b1-47df-b37b-0d4c401eff5f None None] SCRIPT_NAME: `/identity` {{(pid=71938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 24 16:34:57.268744 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a38c763-06b1-47df-b37b-0d4c401eff5f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=71938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 24 16:34:57.293333 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.auth.core [None req-6a38c763-06b1-47df-b37b-0d4c401eff5f None None] MFA Rules not processed for user `0f2ba2e8375b4e8c8792ee1e22b60427`. Rule list: `[]` (Enabled: `True`). {{(pid=71938) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:442}} Nov 24 16:34:57.294595 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.fernet_utils [None req-6a38c763-06b1-47df-b37b-0d4c401eff5f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=71938) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:289}} Nov 24 16:34:57.301861 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: [pid: 71938|app: 0|req: 619/1237] 10.222.0.53 () {58 vars in 1013 bytes} [Wed Nov 24 16:34:57 2021] POST /identity/v3/auth/tokens => generated 3413 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 24 16:34:57.308152 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e297107-32e8-4708-a6d2-aa9d55790bae None None] Authenticating user token {{(pid=71939) process_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 24 16:34:57.317814 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e297107-32e8-4708-a6d2-aa9d55790bae None None] Validating token access rules against request {{(pid=71939) validate_allowed_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 24 16:34:57.322190 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb4ddad4-fcd7-4a61-8a77-4f518e7e9650 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f2ba2e8375b4e8c8792ee1e22b60427', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '00a5583c7b7443e98e7a1d31a0b638dc', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=71939) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 24 16:34:57.323062 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb4ddad4-fcd7-4a61-8a77-4f518e7e9650 admin admin] REQUEST_METHOD: `GET` {{(pid=71939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 24 16:34:57.323402 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb4ddad4-fcd7-4a61-8a77-4f518e7e9650 admin admin] SCRIPT_NAME: `/identity` {{(pid=71939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 24 16:34:57.323734 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb4ddad4-fcd7-4a61-8a77-4f518e7e9650 admin admin] PATH_INFO: `/v3/domains/5a258b10102643d3be0acb00af15955b` {{(pid=71939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 24 16:34:57.324915 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb4ddad4-fcd7-4a61-8a77-4f518e7e9650 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=5a258b10102643d3be0acb00af15955b)` {{(pid=71939) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:442}} Nov 24 16:34:57.354410 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb4ddad4-fcd7-4a61-8a77-4f518e7e9650 admin admin] RBAC: Authorization granted {{(pid=71939) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 24 16:34:57.356879 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: [pid: 71939|app: 0|req: 619/1238] 10.222.0.53 () {56 vars in 1195 bytes} [Wed Nov 24 16:34:57 2021] GET /identity/v3/domains/5a258b10102643d3be0acb00af15955b => generated 267 bytes in 49 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 24 16:34:57.362955 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a38c763-06b1-47df-b37b-0d4c401eff5f None None] Authenticating user token {{(pid=71938) process_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 24 16:34:57.372858 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a38c763-06b1-47df-b37b-0d4c401eff5f None None] Validating token access rules against request {{(pid=71938) validate_allowed_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 24 16:34:57.378314 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80af5996-9e68-4f63-b06f-13fb77af2f37 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f2ba2e8375b4e8c8792ee1e22b60427', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '00a5583c7b7443e98e7a1d31a0b638dc', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=71938) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 24 16:34:57.379526 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80af5996-9e68-4f63-b06f-13fb77af2f37 admin admin] REQUEST_METHOD: `POST` {{(pid=71938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 24 16:34:57.380130 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80af5996-9e68-4f63-b06f-13fb77af2f37 admin admin] SCRIPT_NAME: `/identity` {{(pid=71938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 24 16:34:57.380748 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80af5996-9e68-4f63-b06f-13fb77af2f37 admin admin] PATH_INFO: `/v3/users` {{(pid=71938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 24 16:34:57.381975 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80af5996-9e68-4f63-b06f-13fb77af2f37 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=71938) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:442}} Nov 24 16:34:57.412764 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80af5996-9e68-4f63-b06f-13fb77af2f37 admin admin] RBAC: Authorization granted {{(pid=71938) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 24 16:34:57.434709 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: [pid: 71938|app: 0|req: 620/1239] 10.222.0.53 () {60 vars in 1144 bytes} [Wed Nov 24 16:34:57 2021] POST /identity/v3/users => generated 311 bytes in 72 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 24 16:34:59.451737 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56368fe8-1f32-45cf-8b9d-481c45379fc2 None None] REQUEST_METHOD: `GET` {{(pid=71939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 24 16:34:59.452280 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56368fe8-1f32-45cf-8b9d-481c45379fc2 None None] SCRIPT_NAME: `/identity` {{(pid=71939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 24 16:34:59.452393 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56368fe8-1f32-45cf-8b9d-481c45379fc2 None None] PATH_INFO: `/` {{(pid=71939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 24 16:34:59.454248 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: [pid: 71939|app: 0|req: 620/1240] 10.222.0.53 () {54 vars in 915 bytes} [Wed Nov 24 16:34:59 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 24 16:34:59.459889 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b5c4801-a621-42ce-9242-38dbae408a9f None None] REQUEST_METHOD: `POST` {{(pid=71938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 24 16:34:59.460241 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b5c4801-a621-42ce-9242-38dbae408a9f None None] SCRIPT_NAME: `/identity` {{(pid=71938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 24 16:34:59.460628 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b5c4801-a621-42ce-9242-38dbae408a9f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=71938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 24 16:34:59.484036 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.auth.core [None req-0b5c4801-a621-42ce-9242-38dbae408a9f None None] MFA Rules not processed for user `0f2ba2e8375b4e8c8792ee1e22b60427`. Rule list: `[]` (Enabled: `True`). {{(pid=71938) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:442}} Nov 24 16:34:59.485257 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.fernet_utils [None req-0b5c4801-a621-42ce-9242-38dbae408a9f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=71938) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:289}} Nov 24 16:34:59.493203 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: [pid: 71938|app: 0|req: 621/1241] 10.222.0.53 () {58 vars in 1013 bytes} [Wed Nov 24 16:34:59 2021] POST /identity/v3/auth/tokens => generated 3413 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 24 16:34:59.516417 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59ae6b01-000e-49ad-baa9-e53b49ef9950 None None] REQUEST_METHOD: `POST` {{(pid=71939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 24 16:34:59.516765 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59ae6b01-000e-49ad-baa9-e53b49ef9950 None None] SCRIPT_NAME: `/identity` {{(pid=71939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 24 16:34:59.517104 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59ae6b01-000e-49ad-baa9-e53b49ef9950 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=71939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 24 16:34:59.540389 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.auth.core [None req-59ae6b01-000e-49ad-baa9-e53b49ef9950 None None] MFA Rules not processed for user `0f2ba2e8375b4e8c8792ee1e22b60427`. Rule list: `[]` (Enabled: `True`). {{(pid=71939) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:442}} Nov 24 16:34:59.541606 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.fernet_utils [None req-59ae6b01-000e-49ad-baa9-e53b49ef9950 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=71939) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:289}} Nov 24 16:34:59.548895 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: [pid: 71939|app: 0|req: 621/1242] 10.222.0.53 () {58 vars in 1013 bytes} [Wed Nov 24 16:34:59 2021] POST /identity/v3/auth/tokens => generated 3413 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 24 16:34:59.554848 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b5c4801-a621-42ce-9242-38dbae408a9f None None] Authenticating user token {{(pid=71938) process_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 24 16:34:59.564954 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b5c4801-a621-42ce-9242-38dbae408a9f None None] Validating token access rules against request {{(pid=71938) validate_allowed_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 24 16:34:59.569516 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87003caa-c764-4080-9ae7-f73200daa47c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f2ba2e8375b4e8c8792ee1e22b60427', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '00a5583c7b7443e98e7a1d31a0b638dc', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=71938) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 24 16:34:59.570356 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87003caa-c764-4080-9ae7-f73200daa47c admin admin] REQUEST_METHOD: `GET` {{(pid=71938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 24 16:34:59.570698 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87003caa-c764-4080-9ae7-f73200daa47c admin admin] SCRIPT_NAME: `/identity` {{(pid=71938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 24 16:34:59.571033 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87003caa-c764-4080-9ae7-f73200daa47c admin admin] PATH_INFO: `/v3/roles/admin` {{(pid=71938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 24 16:34:59.583690 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87003caa-c764-4080-9ae7-f73200daa47c admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=71938) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:401}} Nov 24 16:34:59.591139 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: WARNING keystone.server.flask.application [None req-87003caa-c764-4080-9ae7-f73200daa47c admin admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Nov 24 16:34:59.592382 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: [pid: 71938|app: 0|req: 622/1243] 10.222.0.53 () {56 vars in 1108 bytes} [Wed Nov 24 16:34:59 2021] GET /identity/v3/roles/admin => generated 83 bytes in 38 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 24 16:34:59.598809 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59ae6b01-000e-49ad-baa9-e53b49ef9950 None None] Authenticating user token {{(pid=71939) process_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 24 16:34:59.607873 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59ae6b01-000e-49ad-baa9-e53b49ef9950 None None] Validating token access rules against request {{(pid=71939) validate_allowed_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 24 16:34:59.612345 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab4722ed-8853-4967-9f06-30ca962efd12 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f2ba2e8375b4e8c8792ee1e22b60427', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '00a5583c7b7443e98e7a1d31a0b638dc', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=71939) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 24 16:34:59.613011 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab4722ed-8853-4967-9f06-30ca962efd12 admin admin] REQUEST_METHOD: `GET` {{(pid=71939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 24 16:34:59.613351 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab4722ed-8853-4967-9f06-30ca962efd12 admin admin] SCRIPT_NAME: `/identity` {{(pid=71939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 24 16:34:59.613685 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab4722ed-8853-4967-9f06-30ca962efd12 admin admin] PATH_INFO: `/v3/roles` {{(pid=71939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 24 16:34:59.614528 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab4722ed-8853-4967-9f06-30ca962efd12 admin admin] RBAC: Adding query filter params (name=admin) {{(pid=71939) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:161}} Nov 24 16:34:59.614883 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab4722ed-8853-4967-9f06-30ca962efd12 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=71939) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:442}} Nov 24 16:34:59.644111 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab4722ed-8853-4967-9f06-30ca962efd12 admin admin] RBAC: Authorization granted {{(pid=71939) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 24 16:34:59.653215 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: [pid: 71939|app: 0|req: 622/1244] 10.222.0.53 () {56 vars in 1111 bytes} [Wed Nov 24 16:34:59 2021] GET /identity/v3/roles?name=admin => generated 339 bytes in 55 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 24 16:34:59.659139 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87003caa-c764-4080-9ae7-f73200daa47c admin admin] Authenticating user token {{(pid=71938) process_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 24 16:34:59.669336 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87003caa-c764-4080-9ae7-f73200daa47c admin admin] Validating token access rules against request {{(pid=71938) validate_allowed_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 24 16:34:59.673779 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e97845f-5019-4635-af89-6f44dfab6b71 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f2ba2e8375b4e8c8792ee1e22b60427', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '00a5583c7b7443e98e7a1d31a0b638dc', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=71938) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 24 16:34:59.674683 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e97845f-5019-4635-af89-6f44dfab6b71 admin admin] REQUEST_METHOD: `GET` {{(pid=71938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 24 16:34:59.675027 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e97845f-5019-4635-af89-6f44dfab6b71 admin admin] SCRIPT_NAME: `/identity` {{(pid=71938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 24 16:34:59.675364 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e97845f-5019-4635-af89-6f44dfab6b71 admin admin] PATH_INFO: `/v3/users/b6aa8933b599426b8bfdbc95d7f91113` {{(pid=71938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 24 16:34:59.695171 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e97845f-5019-4635-af89-6f44dfab6b71 admin admin] RBAC: Authorizing `identity:get_user(user_id=b6aa8933b599426b8bfdbc95d7f91113)` {{(pid=71938) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:442}} Nov 24 16:34:59.725010 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e97845f-5019-4635-af89-6f44dfab6b71 admin admin] RBAC: Authorization granted {{(pid=71938) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 24 16:34:59.726709 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: [pid: 71938|app: 0|req: 623/1245] 10.222.0.53 () {56 vars in 1189 bytes} [Wed Nov 24 16:34:59 2021] GET /identity/v3/users/b6aa8933b599426b8bfdbc95d7f91113 => generated 311 bytes in 68 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 24 16:34:59.732525 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab4722ed-8853-4967-9f06-30ca962efd12 admin admin] Authenticating user token {{(pid=71939) process_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 24 16:34:59.742324 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab4722ed-8853-4967-9f06-30ca962efd12 admin admin] Validating token access rules against request {{(pid=71939) validate_allowed_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 24 16:34:59.747156 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bb5f552-eaed-46bd-a5c4-988e51725c5f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f2ba2e8375b4e8c8792ee1e22b60427', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '00a5583c7b7443e98e7a1d31a0b638dc', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=71939) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 24 16:34:59.747795 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bb5f552-eaed-46bd-a5c4-988e51725c5f admin admin] REQUEST_METHOD: `GET` {{(pid=71939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 24 16:34:59.748133 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bb5f552-eaed-46bd-a5c4-988e51725c5f admin admin] SCRIPT_NAME: `/identity` {{(pid=71939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 24 16:34:59.748464 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bb5f552-eaed-46bd-a5c4-988e51725c5f admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=71939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 24 16:34:59.756529 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bb5f552-eaed-46bd-a5c4-988e51725c5f admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=71939) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:442}} Nov 24 16:34:59.784932 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bb5f552-eaed-46bd-a5c4-988e51725c5f admin admin] RBAC: Authorization granted {{(pid=71939) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 24 16:34:59.793917 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: [pid: 71939|app: 0|req: 623/1246] 10.222.0.53 () {58 vars in 1315 bytes} [Wed Nov 24 16:34:59 2021] GET /identity/v3/auth/tokens => generated 3413 bytes in 62 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 24 16:34:59.800156 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e97845f-5019-4635-af89-6f44dfab6b71 admin admin] Authenticating user token {{(pid=71938) process_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 24 16:34:59.810504 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e97845f-5019-4635-af89-6f44dfab6b71 admin admin] Validating token access rules against request {{(pid=71938) validate_allowed_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 24 16:34:59.814916 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92468e29-ada3-457d-abf8-bf7bffa07804 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f2ba2e8375b4e8c8792ee1e22b60427', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '00a5583c7b7443e98e7a1d31a0b638dc', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=71938) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 24 16:34:59.815785 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92468e29-ada3-457d-abf8-bf7bffa07804 admin admin] REQUEST_METHOD: `GET` {{(pid=71938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 24 16:34:59.816127 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92468e29-ada3-457d-abf8-bf7bffa07804 admin admin] SCRIPT_NAME: `/identity` {{(pid=71938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 24 16:34:59.816463 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92468e29-ada3-457d-abf8-bf7bffa07804 admin admin] PATH_INFO: `/v3/projects/84a0b6d6793940989784e4617b95caf6` {{(pid=71938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 24 16:34:59.817670 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92468e29-ada3-457d-abf8-bf7bffa07804 admin admin] RBAC: Authorizing `identity:get_project(project_id=84a0b6d6793940989784e4617b95caf6)` {{(pid=71938) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:442}} Nov 24 16:34:59.847116 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92468e29-ada3-457d-abf8-bf7bffa07804 admin admin] RBAC: Authorization granted {{(pid=71938) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 24 16:34:59.848776 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: [pid: 71938|app: 0|req: 624/1247] 10.222.0.53 () {56 vars in 1198 bytes} [Wed Nov 24 16:34:59 2021] GET /identity/v3/projects/84a0b6d6793940989784e4617b95caf6 => generated 361 bytes in 49 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 24 16:34:59.855378 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bb5f552-eaed-46bd-a5c4-988e51725c5f admin admin] Authenticating user token {{(pid=71939) process_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 24 16:34:59.864319 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bb5f552-eaed-46bd-a5c4-988e51725c5f admin admin] Validating token access rules against request {{(pid=71939) validate_allowed_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 24 16:34:59.869256 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31e34b14-9841-481b-a4b7-f23dfcb6a499 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f2ba2e8375b4e8c8792ee1e22b60427', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '00a5583c7b7443e98e7a1d31a0b638dc', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=71939) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 24 16:34:59.869898 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31e34b14-9841-481b-a4b7-f23dfcb6a499 admin admin] REQUEST_METHOD: `GET` {{(pid=71939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 24 16:34:59.870281 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31e34b14-9841-481b-a4b7-f23dfcb6a499 admin admin] SCRIPT_NAME: `/identity` {{(pid=71939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 24 16:34:59.871221 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31e34b14-9841-481b-a4b7-f23dfcb6a499 admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=71939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 24 16:34:59.872099 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31e34b14-9841-481b-a4b7-f23dfcb6a499 admin admin] RBAC: Adding query filter params (role.id=5611724e350b41e19921b5961a342582, scope.project.id=84a0b6d6793940989784e4617b95caf6, user.id=b6aa8933b599426b8bfdbc95d7f91113) {{(pid=71939) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:161}} Nov 24 16:34:59.872455 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31e34b14-9841-481b-a4b7-f23dfcb6a499 admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=71939) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:442}} Nov 24 16:34:59.901550 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31e34b14-9841-481b-a4b7-f23dfcb6a499 admin admin] RBAC: Authorization granted {{(pid=71939) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 24 16:34:59.907929 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: [pid: 71939|app: 0|req: 624/1248] 10.222.0.53 () {56 vars in 1386 bytes} [Wed Nov 24 16:34:59 2021] GET /identity/v3/role_assignments?user.id=b6aa8933b599426b8bfdbc95d7f91113&scope.project.id=84a0b6d6793940989784e4617b95caf6&role.id=5611724e350b41e19921b5961a342582 => generated 259 bytes in 53 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 24 16:35:01.892135 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa8ec2b1-ccfa-44a2-8c26-42cc15b2708d None None] REQUEST_METHOD: `GET` {{(pid=71938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 24 16:35:01.892747 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa8ec2b1-ccfa-44a2-8c26-42cc15b2708d None None] SCRIPT_NAME: `/identity` {{(pid=71938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 24 16:35:01.892747 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa8ec2b1-ccfa-44a2-8c26-42cc15b2708d None None] PATH_INFO: `/` {{(pid=71938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 24 16:35:01.894729 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: [pid: 71938|app: 0|req: 625/1249] 10.222.0.53 () {54 vars in 915 bytes} [Wed Nov 24 16:35:01 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 24 16:35:01.900153 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f2946bd-678d-482d-951a-f6ed57099178 None None] REQUEST_METHOD: `POST` {{(pid=71939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 24 16:35:01.900504 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f2946bd-678d-482d-951a-f6ed57099178 None None] SCRIPT_NAME: `/identity` {{(pid=71939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 24 16:35:01.900842 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f2946bd-678d-482d-951a-f6ed57099178 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=71939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 24 16:35:01.924170 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.auth.core [None req-7f2946bd-678d-482d-951a-f6ed57099178 None None] MFA Rules not processed for user `0f2ba2e8375b4e8c8792ee1e22b60427`. Rule list: `[]` (Enabled: `True`). {{(pid=71939) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:442}} Nov 24 16:35:01.925387 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.fernet_utils [None req-7f2946bd-678d-482d-951a-f6ed57099178 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=71939) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:289}} Nov 24 16:35:01.932638 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: [pid: 71939|app: 0|req: 625/1250] 10.222.0.53 () {58 vars in 1013 bytes} [Wed Nov 24 16:35:01 2021] POST /identity/v3/auth/tokens => generated 3413 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 24 16:35:01.955734 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2cd3188-998e-4546-9631-1416b7ff9345 None None] REQUEST_METHOD: `POST` {{(pid=71938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 24 16:35:01.956085 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2cd3188-998e-4546-9631-1416b7ff9345 None None] SCRIPT_NAME: `/identity` {{(pid=71938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 24 16:35:01.956420 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2cd3188-998e-4546-9631-1416b7ff9345 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=71938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 24 16:35:01.979740 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.auth.core [None req-b2cd3188-998e-4546-9631-1416b7ff9345 None None] MFA Rules not processed for user `0f2ba2e8375b4e8c8792ee1e22b60427`. Rule list: `[]` (Enabled: `True`). {{(pid=71938) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:442}} Nov 24 16:35:01.980960 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.fernet_utils [None req-b2cd3188-998e-4546-9631-1416b7ff9345 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=71938) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:289}} Nov 24 16:35:01.988751 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: [pid: 71938|app: 0|req: 626/1251] 10.222.0.53 () {58 vars in 1013 bytes} [Wed Nov 24 16:35:01 2021] POST /identity/v3/auth/tokens => generated 3413 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 24 16:35:01.994834 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f2946bd-678d-482d-951a-f6ed57099178 None None] Authenticating user token {{(pid=71939) process_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 24 16:35:02.004966 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f2946bd-678d-482d-951a-f6ed57099178 None None] Validating token access rules against request {{(pid=71939) validate_allowed_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 24 16:35:02.009300 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e670c77-0c6b-4b79-9cf4-54490bed97fd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f2ba2e8375b4e8c8792ee1e22b60427', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '00a5583c7b7443e98e7a1d31a0b638dc', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=71939) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 24 16:35:02.010134 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e670c77-0c6b-4b79-9cf4-54490bed97fd admin admin] REQUEST_METHOD: `GET` {{(pid=71939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 24 16:35:02.010477 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e670c77-0c6b-4b79-9cf4-54490bed97fd admin admin] SCRIPT_NAME: `/identity` {{(pid=71939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 24 16:35:02.010813 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e670c77-0c6b-4b79-9cf4-54490bed97fd admin admin] PATH_INFO: `/v3/roles/admin` {{(pid=71939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 24 16:35:02.023142 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e670c77-0c6b-4b79-9cf4-54490bed97fd admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=71939) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:401}} Nov 24 16:35:02.031200 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: WARNING keystone.server.flask.application [None req-1e670c77-0c6b-4b79-9cf4-54490bed97fd admin admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Nov 24 16:35:02.032461 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: [pid: 71939|app: 0|req: 626/1252] 10.222.0.53 () {56 vars in 1108 bytes} [Wed Nov 24 16:35:01 2021] GET /identity/v3/roles/admin => generated 83 bytes in 38 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 24 16:35:02.038895 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2cd3188-998e-4546-9631-1416b7ff9345 None None] Authenticating user token {{(pid=71938) process_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 24 16:35:02.048624 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2cd3188-998e-4546-9631-1416b7ff9345 None None] Validating token access rules against request {{(pid=71938) validate_allowed_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 24 16:35:02.053053 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c25fddb-f644-4b1e-b3b8-573814bf7c8e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f2ba2e8375b4e8c8792ee1e22b60427', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '00a5583c7b7443e98e7a1d31a0b638dc', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=71938) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 24 16:35:02.053719 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c25fddb-f644-4b1e-b3b8-573814bf7c8e admin admin] REQUEST_METHOD: `GET` {{(pid=71938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 24 16:35:02.054150 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c25fddb-f644-4b1e-b3b8-573814bf7c8e admin admin] SCRIPT_NAME: `/identity` {{(pid=71938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 24 16:35:02.054424 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c25fddb-f644-4b1e-b3b8-573814bf7c8e admin admin] PATH_INFO: `/v3/roles` {{(pid=71938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 24 16:35:02.055233 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c25fddb-f644-4b1e-b3b8-573814bf7c8e admin admin] RBAC: Adding query filter params (name=admin) {{(pid=71938) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:161}} Nov 24 16:35:02.055586 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c25fddb-f644-4b1e-b3b8-573814bf7c8e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=71938) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:442}} Nov 24 16:35:02.084419 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c25fddb-f644-4b1e-b3b8-573814bf7c8e admin admin] RBAC: Authorization granted {{(pid=71938) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 24 16:35:02.094063 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: [pid: 71938|app: 0|req: 627/1253] 10.222.0.53 () {56 vars in 1111 bytes} [Wed Nov 24 16:35:02 2021] GET /identity/v3/roles?name=admin => generated 339 bytes in 56 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 24 16:35:02.099965 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e670c77-0c6b-4b79-9cf4-54490bed97fd admin admin] Authenticating user token {{(pid=71939) process_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 24 16:35:02.110282 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e670c77-0c6b-4b79-9cf4-54490bed97fd admin admin] Validating token access rules against request {{(pid=71939) validate_allowed_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 24 16:35:02.114721 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0935c774-46df-49ab-9a38-10a4c12ee4dc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f2ba2e8375b4e8c8792ee1e22b60427', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '00a5583c7b7443e98e7a1d31a0b638dc', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=71939) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 24 16:35:02.115618 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0935c774-46df-49ab-9a38-10a4c12ee4dc admin admin] REQUEST_METHOD: `GET` {{(pid=71939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 24 16:35:02.115957 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0935c774-46df-49ab-9a38-10a4c12ee4dc admin admin] SCRIPT_NAME: `/identity` {{(pid=71939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 24 16:35:02.116293 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0935c774-46df-49ab-9a38-10a4c12ee4dc admin admin] PATH_INFO: `/v3/users/b6aa8933b599426b8bfdbc95d7f91113` {{(pid=71939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 24 16:35:02.117497 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0935c774-46df-49ab-9a38-10a4c12ee4dc admin admin] RBAC: Authorizing `identity:get_user(user_id=b6aa8933b599426b8bfdbc95d7f91113)` {{(pid=71939) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:442}} Nov 24 16:35:02.146850 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0935c774-46df-49ab-9a38-10a4c12ee4dc admin admin] RBAC: Authorization granted {{(pid=71939) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 24 16:35:02.148457 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: [pid: 71939|app: 0|req: 627/1254] 10.222.0.53 () {56 vars in 1189 bytes} [Wed Nov 24 16:35:02 2021] GET /identity/v3/users/b6aa8933b599426b8bfdbc95d7f91113 => generated 311 bytes in 49 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 24 16:35:02.154854 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c25fddb-f644-4b1e-b3b8-573814bf7c8e admin admin] Authenticating user token {{(pid=71938) process_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 24 16:35:02.164827 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c25fddb-f644-4b1e-b3b8-573814bf7c8e admin admin] Validating token access rules against request {{(pid=71938) validate_allowed_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 24 16:35:02.169246 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3f0f06a-a497-41e2-ab33-7c019859d235 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f2ba2e8375b4e8c8792ee1e22b60427', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '00a5583c7b7443e98e7a1d31a0b638dc', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=71938) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 24 16:35:02.170168 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3f0f06a-a497-41e2-ab33-7c019859d235 admin admin] REQUEST_METHOD: `GET` {{(pid=71938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 24 16:35:02.170514 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3f0f06a-a497-41e2-ab33-7c019859d235 admin admin] SCRIPT_NAME: `/identity` {{(pid=71938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 24 16:35:02.170847 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3f0f06a-a497-41e2-ab33-7c019859d235 admin admin] PATH_INFO: `/v3/projects/84a0b6d6793940989784e4617b95caf6` {{(pid=71938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 24 16:35:02.172057 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3f0f06a-a497-41e2-ab33-7c019859d235 admin admin] RBAC: Authorizing `identity:get_project(project_id=84a0b6d6793940989784e4617b95caf6)` {{(pid=71938) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:442}} Nov 24 16:35:02.201443 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3f0f06a-a497-41e2-ab33-7c019859d235 admin admin] RBAC: Authorization granted {{(pid=71938) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 24 16:35:02.203268 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: [pid: 71938|app: 0|req: 628/1255] 10.222.0.53 () {56 vars in 1198 bytes} [Wed Nov 24 16:35:02 2021] GET /identity/v3/projects/84a0b6d6793940989784e4617b95caf6 => generated 361 bytes in 49 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 24 16:35:02.209956 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0935c774-46df-49ab-9a38-10a4c12ee4dc admin admin] Authenticating user token {{(pid=71939) process_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 24 16:35:02.220670 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0935c774-46df-49ab-9a38-10a4c12ee4dc admin admin] Validating token access rules against request {{(pid=71939) validate_allowed_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 24 16:35:02.225103 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a611043f-92f1-41e8-9107-511cdb01d6bd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f2ba2e8375b4e8c8792ee1e22b60427', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '00a5583c7b7443e98e7a1d31a0b638dc', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=71939) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 24 16:35:02.225996 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a611043f-92f1-41e8-9107-511cdb01d6bd admin admin] REQUEST_METHOD: `PUT` {{(pid=71939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 24 16:35:02.226391 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a611043f-92f1-41e8-9107-511cdb01d6bd admin admin] SCRIPT_NAME: `/identity` {{(pid=71939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 24 16:35:02.226728 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a611043f-92f1-41e8-9107-511cdb01d6bd admin admin] PATH_INFO: `/v3/projects/84a0b6d6793940989784e4617b95caf6/users/b6aa8933b599426b8bfdbc95d7f91113/roles/5611724e350b41e19921b5961a342582` {{(pid=71939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 24 16:35:02.228669 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a611043f-92f1-41e8-9107-511cdb01d6bd admin admin] RBAC: Authorizing `identity:create_grant(project_id=84a0b6d6793940989784e4617b95caf6, user_id=b6aa8933b599426b8bfdbc95d7f91113, role_id=5611724e350b41e19921b5961a342582)` {{(pid=71939) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:442}} Nov 24 16:35:02.257767 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a611043f-92f1-41e8-9107-511cdb01d6bd admin admin] RBAC: Authorization granted {{(pid=71939) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 24 16:35:02.270521 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: [pid: 71939|app: 0|req: 628/1256] 10.222.0.53 () {58 vars in 1451 bytes} [Wed Nov 24 16:35:02 2021] PUT /identity/v3/projects/84a0b6d6793940989784e4617b95caf6/users/b6aa8933b599426b8bfdbc95d7f91113/roles/5611724e350b41e19921b5961a342582 => generated 0 bytes in 61 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 24 16:35:04.239753 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bfd5534-5f3b-49d8-9ab0-27e80a4b8ea4 None None] REQUEST_METHOD: `GET` {{(pid=71938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 24 16:35:04.240205 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bfd5534-5f3b-49d8-9ab0-27e80a4b8ea4 None None] SCRIPT_NAME: `/identity` {{(pid=71938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 24 16:35:04.240410 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bfd5534-5f3b-49d8-9ab0-27e80a4b8ea4 None None] PATH_INFO: `/` {{(pid=71938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 24 16:35:04.242302 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: [pid: 71938|app: 0|req: 629/1257] 10.222.0.53 () {54 vars in 915 bytes} [Wed Nov 24 16:35:04 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 24 16:35:04.247700 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8f7caaa-c27a-4214-a510-eb18a49c96e6 None None] REQUEST_METHOD: `POST` {{(pid=71939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 24 16:35:04.248051 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8f7caaa-c27a-4214-a510-eb18a49c96e6 None None] SCRIPT_NAME: `/identity` {{(pid=71939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 24 16:35:04.248392 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8f7caaa-c27a-4214-a510-eb18a49c96e6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=71939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 24 16:35:04.273326 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.auth.core [None req-d8f7caaa-c27a-4214-a510-eb18a49c96e6 None None] MFA Rules not processed for user `0f2ba2e8375b4e8c8792ee1e22b60427`. Rule list: `[]` (Enabled: `True`). {{(pid=71939) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:442}} Nov 24 16:35:04.274570 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.fernet_utils [None req-d8f7caaa-c27a-4214-a510-eb18a49c96e6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=71939) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:289}} Nov 24 16:35:04.416603 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: [pid: 71939|app: 0|req: 629/1258] 10.222.0.53 () {58 vars in 1013 bytes} [Wed Nov 24 16:35:04 2021] POST /identity/v3/auth/tokens => generated 3413 bytes in 170 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 24 16:35:04.439869 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06a1d737-83fb-4d26-89d5-e7dd18783628 None None] REQUEST_METHOD: `POST` {{(pid=71938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 24 16:35:04.440215 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06a1d737-83fb-4d26-89d5-e7dd18783628 None None] SCRIPT_NAME: `/identity` {{(pid=71938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 24 16:35:04.440556 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06a1d737-83fb-4d26-89d5-e7dd18783628 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=71938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 24 16:35:04.464099 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.auth.core [None req-06a1d737-83fb-4d26-89d5-e7dd18783628 None None] MFA Rules not processed for user `0f2ba2e8375b4e8c8792ee1e22b60427`. Rule list: `[]` (Enabled: `True`). {{(pid=71938) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:442}} Nov 24 16:35:04.465286 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.fernet_utils [None req-06a1d737-83fb-4d26-89d5-e7dd18783628 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=71938) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:289}} Nov 24 16:35:04.472902 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: [pid: 71938|app: 0|req: 630/1259] 10.222.0.53 () {58 vars in 1013 bytes} [Wed Nov 24 16:35:04 2021] POST /identity/v3/auth/tokens => generated 3413 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 24 16:35:04.478852 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8f7caaa-c27a-4214-a510-eb18a49c96e6 None None] Authenticating user token {{(pid=71939) process_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 24 16:35:04.488918 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8f7caaa-c27a-4214-a510-eb18a49c96e6 None None] Validating token access rules against request {{(pid=71939) validate_allowed_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 24 16:35:04.493346 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c5893c2-aee9-426f-9984-69ad5f17a2dc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f2ba2e8375b4e8c8792ee1e22b60427', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '00a5583c7b7443e98e7a1d31a0b638dc', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=71939) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 24 16:35:04.494178 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c5893c2-aee9-426f-9984-69ad5f17a2dc admin admin] REQUEST_METHOD: `GET` {{(pid=71939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 24 16:35:04.494524 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c5893c2-aee9-426f-9984-69ad5f17a2dc admin admin] SCRIPT_NAME: `/identity` {{(pid=71939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 24 16:35:04.494861 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c5893c2-aee9-426f-9984-69ad5f17a2dc admin admin] PATH_INFO: `/v3/roles/admin` {{(pid=71939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 24 16:35:04.507385 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c5893c2-aee9-426f-9984-69ad5f17a2dc admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=71939) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:401}} Nov 24 16:35:04.514699 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: WARNING keystone.server.flask.application [None req-7c5893c2-aee9-426f-9984-69ad5f17a2dc admin admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Nov 24 16:35:04.515989 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: [pid: 71939|app: 0|req: 630/1260] 10.222.0.53 () {56 vars in 1108 bytes} [Wed Nov 24 16:35:04 2021] GET /identity/v3/roles/admin => generated 83 bytes in 38 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 24 16:35:04.522631 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06a1d737-83fb-4d26-89d5-e7dd18783628 None None] Authenticating user token {{(pid=71938) process_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 24 16:35:04.531838 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06a1d737-83fb-4d26-89d5-e7dd18783628 None None] Validating token access rules against request {{(pid=71938) validate_allowed_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 24 16:35:04.536568 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f46f18d-7fef-4185-9058-6b13300c5733 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f2ba2e8375b4e8c8792ee1e22b60427', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '00a5583c7b7443e98e7a1d31a0b638dc', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=71938) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 24 16:35:04.536963 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f46f18d-7fef-4185-9058-6b13300c5733 admin admin] REQUEST_METHOD: `GET` {{(pid=71938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 24 16:35:04.537302 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f46f18d-7fef-4185-9058-6b13300c5733 admin admin] SCRIPT_NAME: `/identity` {{(pid=71938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 24 16:35:04.537632 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f46f18d-7fef-4185-9058-6b13300c5733 admin admin] PATH_INFO: `/v3/roles` {{(pid=71938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 24 16:35:04.538463 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f46f18d-7fef-4185-9058-6b13300c5733 admin admin] RBAC: Adding query filter params (name=admin) {{(pid=71938) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:161}} Nov 24 16:35:04.538814 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f46f18d-7fef-4185-9058-6b13300c5733 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=71938) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:442}} Nov 24 16:35:04.568131 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f46f18d-7fef-4185-9058-6b13300c5733 admin admin] RBAC: Authorization granted {{(pid=71938) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 24 16:35:04.577414 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: [pid: 71938|app: 0|req: 631/1261] 10.222.0.53 () {56 vars in 1111 bytes} [Wed Nov 24 16:35:04 2021] GET /identity/v3/roles?name=admin => generated 339 bytes in 55 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 24 16:35:04.583411 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c5893c2-aee9-426f-9984-69ad5f17a2dc admin admin] Authenticating user token {{(pid=71939) process_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 24 16:35:04.593414 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c5893c2-aee9-426f-9984-69ad5f17a2dc admin admin] Validating token access rules against request {{(pid=71939) validate_allowed_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 24 16:35:04.597660 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fadc7b4-60ee-464c-a536-1be7875399e0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f2ba2e8375b4e8c8792ee1e22b60427', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '00a5583c7b7443e98e7a1d31a0b638dc', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=71939) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 24 16:35:04.598544 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fadc7b4-60ee-464c-a536-1be7875399e0 admin admin] REQUEST_METHOD: `GET` {{(pid=71939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 24 16:35:04.599036 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fadc7b4-60ee-464c-a536-1be7875399e0 admin admin] SCRIPT_NAME: `/identity` {{(pid=71939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 24 16:35:04.599212 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fadc7b4-60ee-464c-a536-1be7875399e0 admin admin] PATH_INFO: `/v3/users/b6aa8933b599426b8bfdbc95d7f91113` {{(pid=71939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 24 16:35:04.600402 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fadc7b4-60ee-464c-a536-1be7875399e0 admin admin] RBAC: Authorizing `identity:get_user(user_id=b6aa8933b599426b8bfdbc95d7f91113)` {{(pid=71939) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:442}} Nov 24 16:35:04.629722 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fadc7b4-60ee-464c-a536-1be7875399e0 admin admin] RBAC: Authorization granted {{(pid=71939) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 24 16:35:04.631410 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: [pid: 71939|app: 0|req: 631/1262] 10.222.0.53 () {56 vars in 1189 bytes} [Wed Nov 24 16:35:04 2021] GET /identity/v3/users/b6aa8933b599426b8bfdbc95d7f91113 => generated 311 bytes in 49 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 24 16:35:04.637215 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f46f18d-7fef-4185-9058-6b13300c5733 admin admin] Authenticating user token {{(pid=71938) process_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 24 16:35:04.646943 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f46f18d-7fef-4185-9058-6b13300c5733 admin admin] Validating token access rules against request {{(pid=71938) validate_allowed_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 24 16:35:04.651336 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83c38e5f-3489-417a-ba97-f0fac0338be6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f2ba2e8375b4e8c8792ee1e22b60427', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '00a5583c7b7443e98e7a1d31a0b638dc', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=71938) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 24 16:35:04.652124 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83c38e5f-3489-417a-ba97-f0fac0338be6 admin admin] REQUEST_METHOD: `GET` {{(pid=71938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 24 16:35:04.652463 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83c38e5f-3489-417a-ba97-f0fac0338be6 admin admin] SCRIPT_NAME: `/identity` {{(pid=71938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 24 16:35:04.652796 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83c38e5f-3489-417a-ba97-f0fac0338be6 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=71938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 24 16:35:04.660943 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83c38e5f-3489-417a-ba97-f0fac0338be6 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=71938) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:442}} Nov 24 16:35:04.690343 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83c38e5f-3489-417a-ba97-f0fac0338be6 admin admin] RBAC: Authorization granted {{(pid=71938) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 24 16:35:04.699512 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: [pid: 71938|app: 0|req: 632/1263] 10.222.0.53 () {58 vars in 1315 bytes} [Wed Nov 24 16:35:04 2021] GET /identity/v3/auth/tokens => generated 3413 bytes in 63 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 24 16:35:04.705650 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fadc7b4-60ee-464c-a536-1be7875399e0 admin admin] Authenticating user token {{(pid=71939) process_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 24 16:35:04.715736 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fadc7b4-60ee-464c-a536-1be7875399e0 admin admin] Validating token access rules against request {{(pid=71939) validate_allowed_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 24 16:35:04.719953 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6c7152c-ba02-4f06-aafe-8d42a05afd9d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f2ba2e8375b4e8c8792ee1e22b60427', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '00a5583c7b7443e98e7a1d31a0b638dc', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=71939) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 24 16:35:04.720788 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6c7152c-ba02-4f06-aafe-8d42a05afd9d admin admin] REQUEST_METHOD: `GET` {{(pid=71939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 24 16:35:04.721128 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6c7152c-ba02-4f06-aafe-8d42a05afd9d admin admin] SCRIPT_NAME: `/identity` {{(pid=71939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 24 16:35:04.721454 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6c7152c-ba02-4f06-aafe-8d42a05afd9d admin admin] PATH_INFO: `/v3/projects/84a0b6d6793940989784e4617b95caf6` {{(pid=71939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 24 16:35:04.722656 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6c7152c-ba02-4f06-aafe-8d42a05afd9d admin admin] RBAC: Authorizing `identity:get_project(project_id=84a0b6d6793940989784e4617b95caf6)` {{(pid=71939) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:442}} Nov 24 16:35:04.751185 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6c7152c-ba02-4f06-aafe-8d42a05afd9d admin admin] RBAC: Authorization granted {{(pid=71939) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 24 16:35:04.752832 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: [pid: 71939|app: 0|req: 632/1264] 10.222.0.53 () {56 vars in 1198 bytes} [Wed Nov 24 16:35:04 2021] GET /identity/v3/projects/84a0b6d6793940989784e4617b95caf6 => generated 361 bytes in 48 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 24 16:35:04.758913 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83c38e5f-3489-417a-ba97-f0fac0338be6 admin admin] Authenticating user token {{(pid=71938) process_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 24 16:35:04.767951 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83c38e5f-3489-417a-ba97-f0fac0338be6 admin admin] Validating token access rules against request {{(pid=71938) validate_allowed_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 24 16:35:04.772379 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c907db9-b570-4aee-bad8-6096cdc670ad admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f2ba2e8375b4e8c8792ee1e22b60427', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '00a5583c7b7443e98e7a1d31a0b638dc', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=71938) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 24 16:35:04.773031 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c907db9-b570-4aee-bad8-6096cdc670ad admin admin] REQUEST_METHOD: `GET` {{(pid=71938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 24 16:35:04.773372 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c907db9-b570-4aee-bad8-6096cdc670ad admin admin] SCRIPT_NAME: `/identity` {{(pid=71938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 24 16:35:04.773708 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c907db9-b570-4aee-bad8-6096cdc670ad admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=71938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 24 16:35:04.774629 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c907db9-b570-4aee-bad8-6096cdc670ad admin admin] RBAC: Adding query filter params (role.id=5611724e350b41e19921b5961a342582, scope.project.id=84a0b6d6793940989784e4617b95caf6, user.id=b6aa8933b599426b8bfdbc95d7f91113) {{(pid=71938) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:161}} Nov 24 16:35:04.774993 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c907db9-b570-4aee-bad8-6096cdc670ad admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=71938) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:442}} Nov 24 16:35:04.804394 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c907db9-b570-4aee-bad8-6096cdc670ad admin admin] RBAC: Authorization granted {{(pid=71938) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 24 16:35:04.810649 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: [pid: 71938|app: 0|req: 633/1265] 10.222.0.53 () {56 vars in 1386 bytes} [Wed Nov 24 16:35:04 2021] GET /identity/v3/role_assignments?user.id=b6aa8933b599426b8bfdbc95d7f91113&scope.project.id=84a0b6d6793940989784e4617b95caf6&role.id=5611724e350b41e19921b5961a342582 => generated 608 bytes in 52 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 24 16:36:56.361867 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fc80829-b14a-431c-a8ff-0d235ca807b0 None None] REQUEST_METHOD: `GET` {{(pid=71939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 24 16:36:56.362493 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fc80829-b14a-431c-a8ff-0d235ca807b0 None None] SCRIPT_NAME: `/identity` {{(pid=71939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 24 16:36:56.362611 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fc80829-b14a-431c-a8ff-0d235ca807b0 None None] PATH_INFO: `/` {{(pid=71939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 24 16:36:56.364391 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: [pid: 71939|app: 0|req: 633/1266] 10.222.0.53 () {54 vars in 915 bytes} [Wed Nov 24 16:36:56 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 24 16:36:56.370543 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57d6ac78-c0ad-4ee4-95e7-f4f5f3b75eb9 None None] REQUEST_METHOD: `POST` {{(pid=71938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 24 16:36:56.370895 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57d6ac78-c0ad-4ee4-95e7-f4f5f3b75eb9 None None] SCRIPT_NAME: `/identity` {{(pid=71938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 24 16:36:56.371231 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57d6ac78-c0ad-4ee4-95e7-f4f5f3b75eb9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=71938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 24 16:36:56.395326 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.auth.core [None req-57d6ac78-c0ad-4ee4-95e7-f4f5f3b75eb9 None None] MFA Rules not processed for user `0f2ba2e8375b4e8c8792ee1e22b60427`. Rule list: `[]` (Enabled: `True`). {{(pid=71938) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:442}} Nov 24 16:36:56.396538 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.fernet_utils [None req-57d6ac78-c0ad-4ee4-95e7-f4f5f3b75eb9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=71938) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:289}} Nov 24 16:36:56.403886 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: [pid: 71938|app: 0|req: 634/1267] 10.222.0.53 () {58 vars in 1013 bytes} [Wed Nov 24 16:36:56 2021] POST /identity/v3/auth/tokens => generated 3413 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 24 16:36:56.426175 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed63315d-f087-4698-9e2b-602bf02dd557 None None] REQUEST_METHOD: `POST` {{(pid=71939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 24 16:36:56.426524 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed63315d-f087-4698-9e2b-602bf02dd557 None None] SCRIPT_NAME: `/identity` {{(pid=71939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 24 16:36:56.426862 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed63315d-f087-4698-9e2b-602bf02dd557 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=71939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 24 16:36:56.451390 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.auth.core [None req-ed63315d-f087-4698-9e2b-602bf02dd557 None None] MFA Rules not processed for user `0f2ba2e8375b4e8c8792ee1e22b60427`. Rule list: `[]` (Enabled: `True`). {{(pid=71939) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:442}} Nov 24 16:36:56.452607 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.fernet_utils [None req-ed63315d-f087-4698-9e2b-602bf02dd557 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=71939) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:289}} Nov 24 16:36:56.459894 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: [pid: 71939|app: 0|req: 634/1268] 10.222.0.53 () {58 vars in 1013 bytes} [Wed Nov 24 16:36:56 2021] POST /identity/v3/auth/tokens => generated 3413 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 24 16:36:56.465959 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57d6ac78-c0ad-4ee4-95e7-f4f5f3b75eb9 None None] Authenticating user token {{(pid=71938) process_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 24 16:36:56.475718 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57d6ac78-c0ad-4ee4-95e7-f4f5f3b75eb9 None None] Validating token access rules against request {{(pid=71938) validate_allowed_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 24 16:36:56.480113 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a22a00c-a17d-420a-a913-7a2251576526 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f2ba2e8375b4e8c8792ee1e22b60427', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '00a5583c7b7443e98e7a1d31a0b638dc', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=71938) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 24 16:36:56.480917 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a22a00c-a17d-420a-a913-7a2251576526 admin admin] REQUEST_METHOD: `GET` {{(pid=71938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 24 16:36:56.481256 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a22a00c-a17d-420a-a913-7a2251576526 admin admin] SCRIPT_NAME: `/identity` {{(pid=71938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 24 16:36:56.481590 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a22a00c-a17d-420a-a913-7a2251576526 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=71938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 24 16:36:56.496323 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a22a00c-a17d-420a-a913-7a2251576526 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=71938) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:442}} Nov 24 16:36:56.525658 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a22a00c-a17d-420a-a913-7a2251576526 admin admin] RBAC: Authorization granted {{(pid=71938) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 24 16:36:56.544520 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: WARNING keystone.server.flask.application [None req-2a22a00c-a17d-420a-a913-7a2251576526 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Nov 24 16:36:56.545698 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: [pid: 71938|app: 0|req: 635/1269] 10.222.0.53 () {56 vars in 1120 bytes} [Wed Nov 24 16:36:56 2021] GET /identity/v3/domains/Default => generated 87 bytes in 80 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 24 16:36:56.552529 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed63315d-f087-4698-9e2b-602bf02dd557 None None] Authenticating user token {{(pid=71939) process_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 24 16:36:56.562325 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed63315d-f087-4698-9e2b-602bf02dd557 None None] Validating token access rules against request {{(pid=71939) validate_allowed_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 24 16:36:56.566826 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9251e194-e58d-4672-9260-cdd4bdcadf4d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f2ba2e8375b4e8c8792ee1e22b60427', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '00a5583c7b7443e98e7a1d31a0b638dc', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=71939) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 24 16:36:56.567486 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9251e194-e58d-4672-9260-cdd4bdcadf4d admin admin] REQUEST_METHOD: `GET` {{(pid=71939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 24 16:36:56.567831 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9251e194-e58d-4672-9260-cdd4bdcadf4d admin admin] SCRIPT_NAME: `/identity` {{(pid=71939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 24 16:36:56.568166 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9251e194-e58d-4672-9260-cdd4bdcadf4d admin admin] PATH_INFO: `/v3/domains` {{(pid=71939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 24 16:36:56.568946 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9251e194-e58d-4672-9260-cdd4bdcadf4d admin admin] RBAC: Adding query filter params (name=Default) {{(pid=71939) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:161}} Nov 24 16:36:56.569297 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9251e194-e58d-4672-9260-cdd4bdcadf4d admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=71939) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:442}} Nov 24 16:36:56.597114 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9251e194-e58d-4672-9260-cdd4bdcadf4d admin admin] RBAC: Authorization granted {{(pid=71939) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 24 16:36:56.611065 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: [pid: 71939|app: 0|req: 635/1270] 10.222.0.53 () {56 vars in 1121 bytes} [Wed Nov 24 16:36:56 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 59 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 24 16:36:56.617426 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a22a00c-a17d-420a-a913-7a2251576526 admin admin] Authenticating user token {{(pid=71938) process_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 24 16:36:56.627983 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a22a00c-a17d-420a-a913-7a2251576526 admin admin] Validating token access rules against request {{(pid=71938) validate_allowed_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 24 16:36:56.632414 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91de1454-d5f0-470a-bb7d-3fcda549c288 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f2ba2e8375b4e8c8792ee1e22b60427', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '00a5583c7b7443e98e7a1d31a0b638dc', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=71938) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 24 16:36:56.633076 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91de1454-d5f0-470a-bb7d-3fcda549c288 admin admin] REQUEST_METHOD: `POST` {{(pid=71938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 24 16:36:56.633413 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91de1454-d5f0-470a-bb7d-3fcda549c288 admin admin] SCRIPT_NAME: `/identity` {{(pid=71938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 24 16:36:56.633742 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91de1454-d5f0-470a-bb7d-3fcda549c288 admin admin] PATH_INFO: `/v3/users` {{(pid=71938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 24 16:36:56.634524 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91de1454-d5f0-470a-bb7d-3fcda549c288 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=71938) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:442}} Nov 24 16:36:56.664063 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91de1454-d5f0-470a-bb7d-3fcda549c288 admin admin] RBAC: Authorization granted {{(pid=71938) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 24 16:36:56.690979 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: [pid: 71938|app: 0|req: 636/1271] 10.222.0.53 () {60 vars in 1143 bytes} [Wed Nov 24 16:36:56 2021] POST /identity/v3/users => generated 251 bytes in 74 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 24 16:36:58.710218 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8519982-b39a-467f-8042-1e54170a31ca None None] REQUEST_METHOD: `GET` {{(pid=71939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 24 16:36:58.710775 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8519982-b39a-467f-8042-1e54170a31ca None None] SCRIPT_NAME: `/identity` {{(pid=71939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 24 16:36:58.710892 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8519982-b39a-467f-8042-1e54170a31ca None None] PATH_INFO: `/` {{(pid=71939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 24 16:36:58.712711 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: [pid: 71939|app: 0|req: 636/1272] 10.222.0.53 () {54 vars in 915 bytes} [Wed Nov 24 16:36:58 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 24 16:36:58.718299 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-807d336e-75f1-4f56-8db3-13b1d4d8aefb None None] REQUEST_METHOD: `POST` {{(pid=71938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 24 16:36:58.718652 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-807d336e-75f1-4f56-8db3-13b1d4d8aefb None None] SCRIPT_NAME: `/identity` {{(pid=71938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 24 16:36:58.718988 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-807d336e-75f1-4f56-8db3-13b1d4d8aefb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=71938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 24 16:36:58.742341 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.auth.core [None req-807d336e-75f1-4f56-8db3-13b1d4d8aefb None None] MFA Rules not processed for user `0f2ba2e8375b4e8c8792ee1e22b60427`. Rule list: `[]` (Enabled: `True`). {{(pid=71938) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:442}} Nov 24 16:36:58.743554 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.fernet_utils [None req-807d336e-75f1-4f56-8db3-13b1d4d8aefb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=71938) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:289}} Nov 24 16:36:58.750782 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: [pid: 71938|app: 0|req: 637/1273] 10.222.0.53 () {58 vars in 1013 bytes} [Wed Nov 24 16:36:58 2021] POST /identity/v3/auth/tokens => generated 3413 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 24 16:36:58.773607 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e652723-2bc2-4169-a204-19bf1515871c None None] REQUEST_METHOD: `POST` {{(pid=71939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 24 16:36:58.773951 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e652723-2bc2-4169-a204-19bf1515871c None None] SCRIPT_NAME: `/identity` {{(pid=71939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 24 16:36:58.774368 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e652723-2bc2-4169-a204-19bf1515871c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=71939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 24 16:36:58.797061 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.auth.core [None req-2e652723-2bc2-4169-a204-19bf1515871c None None] MFA Rules not processed for user `0f2ba2e8375b4e8c8792ee1e22b60427`. Rule list: `[]` (Enabled: `True`). {{(pid=71939) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:442}} Nov 24 16:36:58.798303 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.fernet_utils [None req-2e652723-2bc2-4169-a204-19bf1515871c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=71939) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:289}} Nov 24 16:36:58.805655 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: [pid: 71939|app: 0|req: 637/1274] 10.222.0.53 () {58 vars in 1013 bytes} [Wed Nov 24 16:36:58 2021] POST /identity/v3/auth/tokens => generated 3413 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 24 16:36:58.811572 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-807d336e-75f1-4f56-8db3-13b1d4d8aefb None None] Authenticating user token {{(pid=71938) process_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 24 16:36:58.821597 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-807d336e-75f1-4f56-8db3-13b1d4d8aefb None None] Validating token access rules against request {{(pid=71938) validate_allowed_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 24 16:36:58.826332 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a27b13af-9427-48a8-b963-7edbe2aaa306 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f2ba2e8375b4e8c8792ee1e22b60427', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '00a5583c7b7443e98e7a1d31a0b638dc', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=71938) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 24 16:36:58.827138 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a27b13af-9427-48a8-b963-7edbe2aaa306 admin admin] REQUEST_METHOD: `GET` {{(pid=71938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 24 16:36:58.827475 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a27b13af-9427-48a8-b963-7edbe2aaa306 admin admin] SCRIPT_NAME: `/identity` {{(pid=71938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 24 16:36:58.827804 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a27b13af-9427-48a8-b963-7edbe2aaa306 admin admin] PATH_INFO: `/v3/roles/service` {{(pid=71938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 24 16:36:58.840240 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a27b13af-9427-48a8-b963-7edbe2aaa306 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=71938) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:401}} Nov 24 16:36:58.847596 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: WARNING keystone.server.flask.application [None req-a27b13af-9427-48a8-b963-7edbe2aaa306 admin admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Nov 24 16:36:58.848782 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: [pid: 71938|app: 0|req: 638/1275] 10.222.0.53 () {56 vars in 1114 bytes} [Wed Nov 24 16:36:58 2021] GET /identity/v3/roles/service => generated 85 bytes in 38 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 24 16:36:58.855244 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e652723-2bc2-4169-a204-19bf1515871c None None] Authenticating user token {{(pid=71939) process_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 24 16:36:58.864183 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e652723-2bc2-4169-a204-19bf1515871c None None] Validating token access rules against request {{(pid=71939) validate_allowed_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 24 16:36:58.868708 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3eab1ec2-0423-4ed3-869d-c0c27ffb67ce admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f2ba2e8375b4e8c8792ee1e22b60427', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '00a5583c7b7443e98e7a1d31a0b638dc', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=71939) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 24 16:36:58.869367 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3eab1ec2-0423-4ed3-869d-c0c27ffb67ce admin admin] REQUEST_METHOD: `GET` {{(pid=71939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 24 16:36:58.869704 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3eab1ec2-0423-4ed3-869d-c0c27ffb67ce admin admin] SCRIPT_NAME: `/identity` {{(pid=71939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 24 16:36:58.870067 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3eab1ec2-0423-4ed3-869d-c0c27ffb67ce admin admin] PATH_INFO: `/v3/roles` {{(pid=71939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 24 16:36:58.870907 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3eab1ec2-0423-4ed3-869d-c0c27ffb67ce admin admin] RBAC: Adding query filter params (name=service) {{(pid=71939) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:161}} Nov 24 16:36:58.871256 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3eab1ec2-0423-4ed3-869d-c0c27ffb67ce admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=71939) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:442}} Nov 24 16:36:58.900084 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3eab1ec2-0423-4ed3-869d-c0c27ffb67ce admin admin] RBAC: Authorization granted {{(pid=71939) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 24 16:36:58.909064 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: [pid: 71939|app: 0|req: 638/1276] 10.222.0.53 () {56 vars in 1115 bytes} [Wed Nov 24 16:36:58 2021] GET /identity/v3/roles?name=service => generated 326 bytes in 54 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 24 16:36:58.914972 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a27b13af-9427-48a8-b963-7edbe2aaa306 admin admin] Authenticating user token {{(pid=71938) process_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 24 16:36:58.925203 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a27b13af-9427-48a8-b963-7edbe2aaa306 admin admin] Validating token access rules against request {{(pid=71938) validate_allowed_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 24 16:36:58.929502 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-136e1852-ebdd-4249-b081-b224a6268135 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f2ba2e8375b4e8c8792ee1e22b60427', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '00a5583c7b7443e98e7a1d31a0b638dc', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=71938) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 24 16:36:58.930319 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-136e1852-ebdd-4249-b081-b224a6268135 admin admin] REQUEST_METHOD: `GET` {{(pid=71938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 24 16:36:58.930655 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-136e1852-ebdd-4249-b081-b224a6268135 admin admin] SCRIPT_NAME: `/identity` {{(pid=71938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 24 16:36:58.930981 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-136e1852-ebdd-4249-b081-b224a6268135 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=71938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 24 16:36:58.942571 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-136e1852-ebdd-4249-b081-b224a6268135 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=71938) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:442}} Nov 24 16:36:58.972002 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-136e1852-ebdd-4249-b081-b224a6268135 admin admin] RBAC: Authorization granted {{(pid=71938) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 24 16:36:58.990678 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: WARNING keystone.server.flask.application [None req-136e1852-ebdd-4249-b081-b224a6268135 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Nov 24 16:36:58.991838 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: [pid: 71938|app: 0|req: 639/1277] 10.222.0.53 () {56 vars in 1120 bytes} [Wed Nov 24 16:36:58 2021] GET /identity/v3/domains/Default => generated 87 bytes in 77 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 24 16:36:58.997768 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3eab1ec2-0423-4ed3-869d-c0c27ffb67ce admin admin] Authenticating user token {{(pid=71939) process_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 24 16:36:59.007995 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3eab1ec2-0423-4ed3-869d-c0c27ffb67ce admin admin] Validating token access rules against request {{(pid=71939) validate_allowed_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 24 16:36:59.012469 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8074b29-3169-4de2-bbe6-8cb43e4ce370 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f2ba2e8375b4e8c8792ee1e22b60427', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '00a5583c7b7443e98e7a1d31a0b638dc', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=71939) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 24 16:36:59.013125 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8074b29-3169-4de2-bbe6-8cb43e4ce370 admin admin] REQUEST_METHOD: `GET` {{(pid=71939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 24 16:36:59.013470 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8074b29-3169-4de2-bbe6-8cb43e4ce370 admin admin] SCRIPT_NAME: `/identity` {{(pid=71939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 24 16:36:59.013805 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8074b29-3169-4de2-bbe6-8cb43e4ce370 admin admin] PATH_INFO: `/v3/domains` {{(pid=71939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 24 16:36:59.014658 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8074b29-3169-4de2-bbe6-8cb43e4ce370 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=71939) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:161}} Nov 24 16:36:59.015014 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8074b29-3169-4de2-bbe6-8cb43e4ce370 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=71939) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:442}} Nov 24 16:36:59.043487 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8074b29-3169-4de2-bbe6-8cb43e4ce370 admin admin] RBAC: Authorization granted {{(pid=71939) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 24 16:36:59.056770 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: [pid: 71939|app: 0|req: 639/1278] 10.222.0.53 () {56 vars in 1121 bytes} [Wed Nov 24 16:36:58 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 59 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 24 16:36:59.062678 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-136e1852-ebdd-4249-b081-b224a6268135 admin admin] Authenticating user token {{(pid=71938) process_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 24 16:36:59.073343 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-136e1852-ebdd-4249-b081-b224a6268135 admin admin] Validating token access rules against request {{(pid=71938) validate_allowed_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 24 16:36:59.078652 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cdf16f8-6c64-452e-b5e4-76b2d357a7c8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f2ba2e8375b4e8c8792ee1e22b60427', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '00a5583c7b7443e98e7a1d31a0b638dc', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=71938) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 24 16:36:59.079460 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cdf16f8-6c64-452e-b5e4-76b2d357a7c8 admin admin] REQUEST_METHOD: `GET` {{(pid=71938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 24 16:36:59.079801 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cdf16f8-6c64-452e-b5e4-76b2d357a7c8 admin admin] SCRIPT_NAME: `/identity` {{(pid=71938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 24 16:36:59.080139 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cdf16f8-6c64-452e-b5e4-76b2d357a7c8 admin admin] PATH_INFO: `/v3/users/placement` {{(pid=71938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 24 16:36:59.094076 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cdf16f8-6c64-452e-b5e4-76b2d357a7c8 admin admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=71938) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:442}} Nov 24 16:36:59.122731 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cdf16f8-6c64-452e-b5e4-76b2d357a7c8 admin admin] RBAC: Authorization granted {{(pid=71938) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 24 16:36:59.142647 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: WARNING keystone.server.flask.application [None req-1cdf16f8-6c64-452e-b5e4-76b2d357a7c8 admin admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Nov 24 16:36:59.143803 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: [pid: 71938|app: 0|req: 640/1279] 10.222.0.53 () {56 vars in 1120 bytes} [Wed Nov 24 16:36:59 2021] GET /identity/v3/users/placement => generated 87 bytes in 82 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 24 16:36:59.150603 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8074b29-3169-4de2-bbe6-8cb43e4ce370 admin admin] Authenticating user token {{(pid=71939) process_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 24 16:36:59.160411 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8074b29-3169-4de2-bbe6-8cb43e4ce370 admin admin] Validating token access rules against request {{(pid=71939) validate_allowed_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 24 16:36:59.164820 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d3f2d7d-5490-4cb5-88c5-ad0cf54f5eca admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f2ba2e8375b4e8c8792ee1e22b60427', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '00a5583c7b7443e98e7a1d31a0b638dc', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=71939) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 24 16:36:59.165486 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d3f2d7d-5490-4cb5-88c5-ad0cf54f5eca admin admin] REQUEST_METHOD: `GET` {{(pid=71939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 24 16:36:59.165830 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d3f2d7d-5490-4cb5-88c5-ad0cf54f5eca admin admin] SCRIPT_NAME: `/identity` {{(pid=71939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 24 16:36:59.166190 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d3f2d7d-5490-4cb5-88c5-ad0cf54f5eca admin admin] PATH_INFO: `/v3/users` {{(pid=71939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 24 16:36:59.167097 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d3f2d7d-5490-4cb5-88c5-ad0cf54f5eca admin admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=71939) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:161}} Nov 24 16:36:59.167457 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d3f2d7d-5490-4cb5-88c5-ad0cf54f5eca admin admin] RBAC: Authorizing `identity:list_users()` {{(pid=71939) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:442}} Nov 24 16:36:59.196976 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d3f2d7d-5490-4cb5-88c5-ad0cf54f5eca admin admin] RBAC: Authorization granted {{(pid=71939) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 24 16:36:59.228359 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: [pid: 71939|app: 0|req: 640/1280] 10.222.0.53 () {56 vars in 1155 bytes} [Wed Nov 24 16:36:59 2021] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 78 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 24 16:36:59.234591 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cdf16f8-6c64-452e-b5e4-76b2d357a7c8 admin admin] Authenticating user token {{(pid=71938) process_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 24 16:36:59.245179 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cdf16f8-6c64-452e-b5e4-76b2d357a7c8 admin admin] Validating token access rules against request {{(pid=71938) validate_allowed_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 24 16:36:59.249594 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed127b6f-1c91-426a-b626-596ca05a1851 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f2ba2e8375b4e8c8792ee1e22b60427', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '00a5583c7b7443e98e7a1d31a0b638dc', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=71938) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 24 16:36:59.250269 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed127b6f-1c91-426a-b626-596ca05a1851 admin admin] REQUEST_METHOD: `GET` {{(pid=71938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 24 16:36:59.250609 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed127b6f-1c91-426a-b626-596ca05a1851 admin admin] SCRIPT_NAME: `/identity` {{(pid=71938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 24 16:36:59.250941 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed127b6f-1c91-426a-b626-596ca05a1851 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=71938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 24 16:36:59.259695 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed127b6f-1c91-426a-b626-596ca05a1851 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=71938) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:442}} Nov 24 16:36:59.287959 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed127b6f-1c91-426a-b626-596ca05a1851 admin admin] RBAC: Authorization granted {{(pid=71938) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 24 16:36:59.297642 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: [pid: 71938|app: 0|req: 641/1281] 10.222.0.53 () {58 vars in 1315 bytes} [Wed Nov 24 16:36:59 2021] GET /identity/v3/auth/tokens => generated 3413 bytes in 64 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 24 16:36:59.304628 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d3f2d7d-5490-4cb5-88c5-ad0cf54f5eca admin admin] Authenticating user token {{(pid=71939) process_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 24 16:36:59.315795 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d3f2d7d-5490-4cb5-88c5-ad0cf54f5eca admin admin] Validating token access rules against request {{(pid=71939) validate_allowed_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 24 16:36:59.320939 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e7bbac5-680f-465e-ac6e-120ef7314e90 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f2ba2e8375b4e8c8792ee1e22b60427', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '00a5583c7b7443e98e7a1d31a0b638dc', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=71939) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 24 16:36:59.321748 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e7bbac5-680f-465e-ac6e-120ef7314e90 admin admin] REQUEST_METHOD: `GET` {{(pid=71939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 24 16:36:59.322106 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e7bbac5-680f-465e-ac6e-120ef7314e90 admin admin] SCRIPT_NAME: `/identity` {{(pid=71939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 24 16:36:59.322439 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e7bbac5-680f-465e-ac6e-120ef7314e90 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=71939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 24 16:36:59.335158 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e7bbac5-680f-465e-ac6e-120ef7314e90 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=71939) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:442}} Nov 24 16:36:59.363114 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e7bbac5-680f-465e-ac6e-120ef7314e90 admin admin] RBAC: Authorization granted {{(pid=71939) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 24 16:36:59.383028 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: WARNING keystone.server.flask.application [None req-2e7bbac5-680f-465e-ac6e-120ef7314e90 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Nov 24 16:36:59.384201 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: [pid: 71939|app: 0|req: 641/1282] 10.222.0.53 () {56 vars in 1120 bytes} [Wed Nov 24 16:36:59 2021] GET /identity/v3/domains/Default => generated 87 bytes in 80 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 24 16:36:59.390428 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed127b6f-1c91-426a-b626-596ca05a1851 admin admin] Authenticating user token {{(pid=71938) process_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 24 16:36:59.399645 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed127b6f-1c91-426a-b626-596ca05a1851 admin admin] Validating token access rules against request {{(pid=71938) validate_allowed_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 24 16:36:59.404090 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e27f23f-3f08-4281-8655-b91a1fc4941a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f2ba2e8375b4e8c8792ee1e22b60427', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '00a5583c7b7443e98e7a1d31a0b638dc', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=71938) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 24 16:36:59.404753 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e27f23f-3f08-4281-8655-b91a1fc4941a admin admin] REQUEST_METHOD: `GET` {{(pid=71938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 24 16:36:59.405093 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e27f23f-3f08-4281-8655-b91a1fc4941a admin admin] SCRIPT_NAME: `/identity` {{(pid=71938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 24 16:36:59.405425 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e27f23f-3f08-4281-8655-b91a1fc4941a admin admin] PATH_INFO: `/v3/domains` {{(pid=71938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 24 16:36:59.406237 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e27f23f-3f08-4281-8655-b91a1fc4941a admin admin] RBAC: Adding query filter params (name=Default) {{(pid=71938) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:161}} Nov 24 16:36:59.406590 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e27f23f-3f08-4281-8655-b91a1fc4941a admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=71938) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:442}} Nov 24 16:36:59.435562 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e27f23f-3f08-4281-8655-b91a1fc4941a admin admin] RBAC: Authorization granted {{(pid=71938) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 24 16:36:59.448974 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: [pid: 71938|app: 0|req: 642/1283] 10.222.0.53 () {56 vars in 1121 bytes} [Wed Nov 24 16:36:59 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 59 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 24 16:36:59.455146 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e7bbac5-680f-465e-ac6e-120ef7314e90 admin admin] Authenticating user token {{(pid=71939) process_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 24 16:36:59.464821 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e7bbac5-680f-465e-ac6e-120ef7314e90 admin admin] Validating token access rules against request {{(pid=71939) validate_allowed_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 24 16:36:59.469049 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f35618a2-98d4-4781-90ff-95742d7b6def admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f2ba2e8375b4e8c8792ee1e22b60427', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '00a5583c7b7443e98e7a1d31a0b638dc', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=71939) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 24 16:36:59.469834 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f35618a2-98d4-4781-90ff-95742d7b6def admin admin] REQUEST_METHOD: `GET` {{(pid=71939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 24 16:36:59.470193 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f35618a2-98d4-4781-90ff-95742d7b6def admin admin] SCRIPT_NAME: `/identity` {{(pid=71939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 24 16:36:59.470516 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f35618a2-98d4-4781-90ff-95742d7b6def admin admin] PATH_INFO: `/v3/projects/service` {{(pid=71939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 24 16:36:59.479657 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f35618a2-98d4-4781-90ff-95742d7b6def admin admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=71939) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:442}} Nov 24 16:36:59.508639 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f35618a2-98d4-4781-90ff-95742d7b6def admin admin] RBAC: Authorization granted {{(pid=71939) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 24 16:36:59.523959 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: WARNING keystone.server.flask.application [None req-f35618a2-98d4-4781-90ff-95742d7b6def admin admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Nov 24 16:36:59.525147 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: [pid: 71939|app: 0|req: 642/1284] 10.222.0.53 () {56 vars in 1123 bytes} [Wed Nov 24 16:36:59 2021] GET /identity/v3/projects/service => generated 88 bytes in 70 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Nov 24 16:36:59.531276 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e27f23f-3f08-4281-8655-b91a1fc4941a admin admin] Authenticating user token {{(pid=71938) process_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 24 16:36:59.541657 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e27f23f-3f08-4281-8655-b91a1fc4941a admin admin] Validating token access rules against request {{(pid=71938) validate_allowed_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 24 16:36:59.546009 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa4fcdf7-7e31-4e46-870f-a8ddcfd77eb3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f2ba2e8375b4e8c8792ee1e22b60427', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '00a5583c7b7443e98e7a1d31a0b638dc', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=71938) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 24 16:36:59.546720 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa4fcdf7-7e31-4e46-870f-a8ddcfd77eb3 admin admin] REQUEST_METHOD: `GET` {{(pid=71938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 24 16:36:59.547061 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa4fcdf7-7e31-4e46-870f-a8ddcfd77eb3 admin admin] SCRIPT_NAME: `/identity` {{(pid=71938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 24 16:36:59.547397 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa4fcdf7-7e31-4e46-870f-a8ddcfd77eb3 admin admin] PATH_INFO: `/v3/projects` {{(pid=71938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 24 16:36:59.548240 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa4fcdf7-7e31-4e46-870f-a8ddcfd77eb3 admin admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=71938) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:161}} Nov 24 16:36:59.548598 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa4fcdf7-7e31-4e46-870f-a8ddcfd77eb3 admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=71938) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:442}} Nov 24 16:36:59.578054 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa4fcdf7-7e31-4e46-870f-a8ddcfd77eb3 admin admin] RBAC: Authorization granted {{(pid=71938) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 24 16:36:59.591663 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: [pid: 71938|app: 0|req: 643/1285] 10.222.0.53 () {56 vars in 1160 bytes} [Wed Nov 24 16:36:59 2021] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 61 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 24 16:36:59.597804 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f35618a2-98d4-4781-90ff-95742d7b6def admin admin] Authenticating user token {{(pid=71939) process_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 24 16:36:59.608162 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f35618a2-98d4-4781-90ff-95742d7b6def admin admin] Validating token access rules against request {{(pid=71939) validate_allowed_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 24 16:36:59.612586 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47a4047f-7dcb-4301-87f0-6ae3dc5ac02d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f2ba2e8375b4e8c8792ee1e22b60427', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '00a5583c7b7443e98e7a1d31a0b638dc', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=71939) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 24 16:36:59.613227 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47a4047f-7dcb-4301-87f0-6ae3dc5ac02d admin admin] REQUEST_METHOD: `GET` {{(pid=71939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 24 16:36:59.613570 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47a4047f-7dcb-4301-87f0-6ae3dc5ac02d admin admin] SCRIPT_NAME: `/identity` {{(pid=71939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 24 16:36:59.613904 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47a4047f-7dcb-4301-87f0-6ae3dc5ac02d admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=71939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 24 16:36:59.614822 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47a4047f-7dcb-4301-87f0-6ae3dc5ac02d admin admin] RBAC: Adding query filter params (role.id=2d4a51004ce34308a7a33e68bf2cfc74, scope.project.id=3b3940d4ae1c4177ae29c02377bb4b0b, user.id=a919320c9e2a48d7ba33453b5929d7ee) {{(pid=71939) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:161}} Nov 24 16:36:59.615180 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47a4047f-7dcb-4301-87f0-6ae3dc5ac02d admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=71939) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:442}} Nov 24 16:36:59.643973 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47a4047f-7dcb-4301-87f0-6ae3dc5ac02d admin admin] RBAC: Authorization granted {{(pid=71939) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 24 16:36:59.649633 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: [pid: 71939|app: 0|req: 643/1286] 10.222.0.53 () {56 vars in 1386 bytes} [Wed Nov 24 16:36:59 2021] GET /identity/v3/role_assignments?user.id=a919320c9e2a48d7ba33453b5929d7ee&scope.project.id=3b3940d4ae1c4177ae29c02377bb4b0b&role.id=2d4a51004ce34308a7a33e68bf2cfc74 => generated 259 bytes in 52 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 24 16:37:01.615279 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-604a1436-ed74-4f7d-9988-9fa6ac7bdc2a None None] REQUEST_METHOD: `GET` {{(pid=71938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 24 16:37:01.616286 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-604a1436-ed74-4f7d-9988-9fa6ac7bdc2a None None] SCRIPT_NAME: `/identity` {{(pid=71938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 24 16:37:01.616463 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-604a1436-ed74-4f7d-9988-9fa6ac7bdc2a None None] PATH_INFO: `/` {{(pid=71938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 24 16:37:01.618191 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: [pid: 71938|app: 0|req: 644/1287] 10.222.0.53 () {54 vars in 915 bytes} [Wed Nov 24 16:37:01 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 24 16:37:01.623705 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1c45add-7e87-421c-bccb-13178fe05c8a None None] REQUEST_METHOD: `POST` {{(pid=71939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 24 16:37:01.624062 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1c45add-7e87-421c-bccb-13178fe05c8a None None] SCRIPT_NAME: `/identity` {{(pid=71939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 24 16:37:01.624400 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1c45add-7e87-421c-bccb-13178fe05c8a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=71939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 24 16:37:01.650084 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.auth.core [None req-a1c45add-7e87-421c-bccb-13178fe05c8a None None] MFA Rules not processed for user `0f2ba2e8375b4e8c8792ee1e22b60427`. Rule list: `[]` (Enabled: `True`). {{(pid=71939) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:442}} Nov 24 16:37:01.651316 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.fernet_utils [None req-a1c45add-7e87-421c-bccb-13178fe05c8a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=71939) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:289}} Nov 24 16:37:01.658603 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: [pid: 71939|app: 0|req: 644/1288] 10.222.0.53 () {58 vars in 1013 bytes} [Wed Nov 24 16:37:01 2021] POST /identity/v3/auth/tokens => generated 3413 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Nov 24 16:37:01.681543 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8d2b22a-962d-46d9-97a8-1d1f6de4afb2 None None] REQUEST_METHOD: `POST` {{(pid=71938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 24 16:37:01.681892 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8d2b22a-962d-46d9-97a8-1d1f6de4afb2 None None] SCRIPT_NAME: `/identity` {{(pid=71938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 24 16:37:01.682279 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8d2b22a-962d-46d9-97a8-1d1f6de4afb2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=71938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 24 16:37:01.706153 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.auth.core [None req-a8d2b22a-962d-46d9-97a8-1d1f6de4afb2 None None] MFA Rules not processed for user `0f2ba2e8375b4e8c8792ee1e22b60427`. Rule list: `[]` (Enabled: `True`). {{(pid=71938) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:442}} Nov 24 16:37:01.707377 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.fernet_utils [None req-a8d2b22a-962d-46d9-97a8-1d1f6de4afb2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=71938) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:289}} Nov 24 16:37:01.714916 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: [pid: 71938|app: 0|req: 645/1289] 10.222.0.53 () {58 vars in 1013 bytes} [Wed Nov 24 16:37:01 2021] POST /identity/v3/auth/tokens => generated 3413 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 24 16:37:01.720940 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1c45add-7e87-421c-bccb-13178fe05c8a None None] Authenticating user token {{(pid=71939) process_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 24 16:37:01.730533 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1c45add-7e87-421c-bccb-13178fe05c8a None None] Validating token access rules against request {{(pid=71939) validate_allowed_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 24 16:37:01.734879 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdc39161-b359-4488-a968-fca109f89b99 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f2ba2e8375b4e8c8792ee1e22b60427', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '00a5583c7b7443e98e7a1d31a0b638dc', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=71939) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 24 16:37:01.735688 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdc39161-b359-4488-a968-fca109f89b99 admin admin] REQUEST_METHOD: `GET` {{(pid=71939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 24 16:37:01.736031 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdc39161-b359-4488-a968-fca109f89b99 admin admin] SCRIPT_NAME: `/identity` {{(pid=71939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 24 16:37:01.736371 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdc39161-b359-4488-a968-fca109f89b99 admin admin] PATH_INFO: `/v3/roles/service` {{(pid=71939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 24 16:37:01.748623 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdc39161-b359-4488-a968-fca109f89b99 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=71939) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:401}} Nov 24 16:37:01.756592 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: WARNING keystone.server.flask.application [None req-bdc39161-b359-4488-a968-fca109f89b99 admin admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Nov 24 16:37:01.757775 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: [pid: 71939|app: 0|req: 645/1290] 10.222.0.53 () {56 vars in 1114 bytes} [Wed Nov 24 16:37:01 2021] GET /identity/v3/roles/service => generated 85 bytes in 37 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 24 16:37:01.764240 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8d2b22a-962d-46d9-97a8-1d1f6de4afb2 None None] Authenticating user token {{(pid=71938) process_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 24 16:37:01.773263 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8d2b22a-962d-46d9-97a8-1d1f6de4afb2 None None] Validating token access rules against request {{(pid=71938) validate_allowed_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 24 16:37:01.777691 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2344d72-feb4-4464-84ac-71188cf0943a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f2ba2e8375b4e8c8792ee1e22b60427', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '00a5583c7b7443e98e7a1d31a0b638dc', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=71938) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 24 16:37:01.778388 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2344d72-feb4-4464-84ac-71188cf0943a admin admin] REQUEST_METHOD: `GET` {{(pid=71938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 24 16:37:01.778731 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2344d72-feb4-4464-84ac-71188cf0943a admin admin] SCRIPT_NAME: `/identity` {{(pid=71938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 24 16:37:01.779066 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2344d72-feb4-4464-84ac-71188cf0943a admin admin] PATH_INFO: `/v3/roles` {{(pid=71938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 24 16:37:01.779872 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2344d72-feb4-4464-84ac-71188cf0943a admin admin] RBAC: Adding query filter params (name=service) {{(pid=71938) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:161}} Nov 24 16:37:01.780228 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2344d72-feb4-4464-84ac-71188cf0943a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=71938) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:442}} Nov 24 16:37:01.809460 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2344d72-feb4-4464-84ac-71188cf0943a admin admin] RBAC: Authorization granted {{(pid=71938) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 24 16:37:01.818358 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: [pid: 71938|app: 0|req: 646/1291] 10.222.0.53 () {56 vars in 1115 bytes} [Wed Nov 24 16:37:01 2021] GET /identity/v3/roles?name=service => generated 326 bytes in 55 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 24 16:37:01.824754 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdc39161-b359-4488-a968-fca109f89b99 admin admin] Authenticating user token {{(pid=71939) process_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 24 16:37:01.835035 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdc39161-b359-4488-a968-fca109f89b99 admin admin] Validating token access rules against request {{(pid=71939) validate_allowed_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 24 16:37:01.839390 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb248989-8da1-4cdb-9853-61b758fa0b16 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f2ba2e8375b4e8c8792ee1e22b60427', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '00a5583c7b7443e98e7a1d31a0b638dc', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=71939) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 24 16:37:01.840175 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb248989-8da1-4cdb-9853-61b758fa0b16 admin admin] REQUEST_METHOD: `GET` {{(pid=71939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 24 16:37:01.840510 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb248989-8da1-4cdb-9853-61b758fa0b16 admin admin] SCRIPT_NAME: `/identity` {{(pid=71939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 24 16:37:01.840841 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb248989-8da1-4cdb-9853-61b758fa0b16 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=71939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 24 16:37:01.853050 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb248989-8da1-4cdb-9853-61b758fa0b16 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=71939) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:442}} Nov 24 16:37:01.881447 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb248989-8da1-4cdb-9853-61b758fa0b16 admin admin] RBAC: Authorization granted {{(pid=71939) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 24 16:37:01.900093 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: WARNING keystone.server.flask.application [None req-cb248989-8da1-4cdb-9853-61b758fa0b16 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Nov 24 16:37:01.901242 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: [pid: 71939|app: 0|req: 646/1292] 10.222.0.53 () {56 vars in 1120 bytes} [Wed Nov 24 16:37:01 2021] GET /identity/v3/domains/Default => generated 87 bytes in 77 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 24 16:37:01.907458 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2344d72-feb4-4464-84ac-71188cf0943a admin admin] Authenticating user token {{(pid=71938) process_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 24 16:37:01.917852 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2344d72-feb4-4464-84ac-71188cf0943a admin admin] Validating token access rules against request {{(pid=71938) validate_allowed_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 24 16:37:01.922298 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6f0fc8d-0b63-4eed-86c7-d43f0c63cd8a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f2ba2e8375b4e8c8792ee1e22b60427', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '00a5583c7b7443e98e7a1d31a0b638dc', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=71938) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 24 16:37:01.922960 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6f0fc8d-0b63-4eed-86c7-d43f0c63cd8a admin admin] REQUEST_METHOD: `GET` {{(pid=71938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 24 16:37:01.923303 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6f0fc8d-0b63-4eed-86c7-d43f0c63cd8a admin admin] SCRIPT_NAME: `/identity` {{(pid=71938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 24 16:37:01.923638 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6f0fc8d-0b63-4eed-86c7-d43f0c63cd8a admin admin] PATH_INFO: `/v3/domains` {{(pid=71938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 24 16:37:01.924417 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6f0fc8d-0b63-4eed-86c7-d43f0c63cd8a admin admin] RBAC: Adding query filter params (name=Default) {{(pid=71938) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:161}} Nov 24 16:37:01.924770 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6f0fc8d-0b63-4eed-86c7-d43f0c63cd8a admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=71938) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:442}} Nov 24 16:37:01.954260 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6f0fc8d-0b63-4eed-86c7-d43f0c63cd8a admin admin] RBAC: Authorization granted {{(pid=71938) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 24 16:37:01.968478 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: [pid: 71938|app: 0|req: 647/1293] 10.222.0.53 () {56 vars in 1121 bytes} [Wed Nov 24 16:37:01 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 61 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 24 16:37:01.974322 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb248989-8da1-4cdb-9853-61b758fa0b16 admin admin] Authenticating user token {{(pid=71939) process_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 24 16:37:01.984301 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb248989-8da1-4cdb-9853-61b758fa0b16 admin admin] Validating token access rules against request {{(pid=71939) validate_allowed_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 24 16:37:01.988663 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dad798d-93fe-47a5-a6d1-7d6fa0c8a73a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f2ba2e8375b4e8c8792ee1e22b60427', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '00a5583c7b7443e98e7a1d31a0b638dc', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=71939) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 24 16:37:01.989465 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dad798d-93fe-47a5-a6d1-7d6fa0c8a73a admin admin] REQUEST_METHOD: `GET` {{(pid=71939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 24 16:37:01.989798 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dad798d-93fe-47a5-a6d1-7d6fa0c8a73a admin admin] SCRIPT_NAME: `/identity` {{(pid=71939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 24 16:37:01.990153 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dad798d-93fe-47a5-a6d1-7d6fa0c8a73a admin admin] PATH_INFO: `/v3/users/placement` {{(pid=71939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 24 16:37:02.003571 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4dad798d-93fe-47a5-a6d1-7d6fa0c8a73a admin admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=71939) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:442}} Nov 24 16:37:02.033112 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4dad798d-93fe-47a5-a6d1-7d6fa0c8a73a admin admin] RBAC: Authorization granted {{(pid=71939) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 24 16:37:02.052802 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: WARNING keystone.server.flask.application [None req-4dad798d-93fe-47a5-a6d1-7d6fa0c8a73a admin admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Nov 24 16:37:02.054013 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: [pid: 71939|app: 0|req: 647/1294] 10.222.0.53 () {56 vars in 1120 bytes} [Wed Nov 24 16:37:01 2021] GET /identity/v3/users/placement => generated 87 bytes in 80 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 24 16:37:02.060347 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6f0fc8d-0b63-4eed-86c7-d43f0c63cd8a admin admin] Authenticating user token {{(pid=71938) process_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 24 16:37:02.070814 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6f0fc8d-0b63-4eed-86c7-d43f0c63cd8a admin admin] Validating token access rules against request {{(pid=71938) validate_allowed_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 24 16:37:02.075548 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0d78947-1d20-45b6-8fab-9ad649c8546d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f2ba2e8375b4e8c8792ee1e22b60427', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '00a5583c7b7443e98e7a1d31a0b638dc', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=71938) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 24 16:37:02.076222 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0d78947-1d20-45b6-8fab-9ad649c8546d admin admin] REQUEST_METHOD: `GET` {{(pid=71938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 24 16:37:02.076562 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0d78947-1d20-45b6-8fab-9ad649c8546d admin admin] SCRIPT_NAME: `/identity` {{(pid=71938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 24 16:37:02.076895 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0d78947-1d20-45b6-8fab-9ad649c8546d admin admin] PATH_INFO: `/v3/users` {{(pid=71938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 24 16:37:02.077799 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0d78947-1d20-45b6-8fab-9ad649c8546d admin admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=71938) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:161}} Nov 24 16:37:02.078186 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0d78947-1d20-45b6-8fab-9ad649c8546d admin admin] RBAC: Authorizing `identity:list_users()` {{(pid=71938) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:442}} Nov 24 16:37:02.107351 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0d78947-1d20-45b6-8fab-9ad649c8546d admin admin] RBAC: Authorization granted {{(pid=71938) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 24 16:37:02.138686 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: [pid: 71938|app: 0|req: 648/1295] 10.222.0.53 () {56 vars in 1155 bytes} [Wed Nov 24 16:37:02 2021] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 79 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 24 16:37:02.144556 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dad798d-93fe-47a5-a6d1-7d6fa0c8a73a admin admin] Authenticating user token {{(pid=71939) process_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 24 16:37:02.154923 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dad798d-93fe-47a5-a6d1-7d6fa0c8a73a admin admin] Validating token access rules against request {{(pid=71939) validate_allowed_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 24 16:37:02.159274 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4577120-8322-4c16-9271-07e7310b4d60 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f2ba2e8375b4e8c8792ee1e22b60427', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '00a5583c7b7443e98e7a1d31a0b638dc', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=71939) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 24 16:37:02.160066 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4577120-8322-4c16-9271-07e7310b4d60 admin admin] REQUEST_METHOD: `GET` {{(pid=71939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 24 16:37:02.160400 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4577120-8322-4c16-9271-07e7310b4d60 admin admin] SCRIPT_NAME: `/identity` {{(pid=71939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 24 16:37:02.160727 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4577120-8322-4c16-9271-07e7310b4d60 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=71939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 24 16:37:02.173547 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4577120-8322-4c16-9271-07e7310b4d60 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=71939) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:442}} Nov 24 16:37:02.202900 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4577120-8322-4c16-9271-07e7310b4d60 admin admin] RBAC: Authorization granted {{(pid=71939) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 24 16:37:02.221789 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: WARNING keystone.server.flask.application [None req-d4577120-8322-4c16-9271-07e7310b4d60 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Nov 24 16:37:02.223039 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: [pid: 71939|app: 0|req: 648/1296] 10.222.0.53 () {56 vars in 1120 bytes} [Wed Nov 24 16:37:02 2021] GET /identity/v3/domains/Default => generated 87 bytes in 79 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 24 16:37:02.229400 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0d78947-1d20-45b6-8fab-9ad649c8546d admin admin] Authenticating user token {{(pid=71938) process_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 24 16:37:02.239387 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0d78947-1d20-45b6-8fab-9ad649c8546d admin admin] Validating token access rules against request {{(pid=71938) validate_allowed_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 24 16:37:02.244335 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7da5935d-b154-476c-b112-c8280a8d1056 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f2ba2e8375b4e8c8792ee1e22b60427', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '00a5583c7b7443e98e7a1d31a0b638dc', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=71938) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 24 16:37:02.245004 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7da5935d-b154-476c-b112-c8280a8d1056 admin admin] REQUEST_METHOD: `GET` {{(pid=71938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 24 16:37:02.245348 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7da5935d-b154-476c-b112-c8280a8d1056 admin admin] SCRIPT_NAME: `/identity` {{(pid=71938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 24 16:37:02.245683 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7da5935d-b154-476c-b112-c8280a8d1056 admin admin] PATH_INFO: `/v3/domains` {{(pid=71938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 24 16:37:02.246499 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7da5935d-b154-476c-b112-c8280a8d1056 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=71938) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:161}} Nov 24 16:37:02.246852 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7da5935d-b154-476c-b112-c8280a8d1056 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=71938) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:442}} Nov 24 16:37:02.275556 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7da5935d-b154-476c-b112-c8280a8d1056 admin admin] RBAC: Authorization granted {{(pid=71938) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 24 16:37:02.288283 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: [pid: 71938|app: 0|req: 649/1297] 10.222.0.53 () {56 vars in 1121 bytes} [Wed Nov 24 16:37:02 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 59 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 24 16:37:02.294645 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4577120-8322-4c16-9271-07e7310b4d60 admin admin] Authenticating user token {{(pid=71939) process_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 24 16:37:02.305152 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4577120-8322-4c16-9271-07e7310b4d60 admin admin] Validating token access rules against request {{(pid=71939) validate_allowed_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 24 16:37:02.309563 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfa2bdc9-9694-4648-90cb-f52277a8ebe2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f2ba2e8375b4e8c8792ee1e22b60427', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '00a5583c7b7443e98e7a1d31a0b638dc', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=71939) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 24 16:37:02.310387 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfa2bdc9-9694-4648-90cb-f52277a8ebe2 admin admin] REQUEST_METHOD: `GET` {{(pid=71939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 24 16:37:02.310727 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfa2bdc9-9694-4648-90cb-f52277a8ebe2 admin admin] SCRIPT_NAME: `/identity` {{(pid=71939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 24 16:37:02.311061 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfa2bdc9-9694-4648-90cb-f52277a8ebe2 admin admin] PATH_INFO: `/v3/projects/service` {{(pid=71939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 24 16:37:02.320903 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfa2bdc9-9694-4648-90cb-f52277a8ebe2 admin admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=71939) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:442}} Nov 24 16:37:02.349894 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfa2bdc9-9694-4648-90cb-f52277a8ebe2 admin admin] RBAC: Authorization granted {{(pid=71939) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 24 16:37:02.364817 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: WARNING keystone.server.flask.application [None req-bfa2bdc9-9694-4648-90cb-f52277a8ebe2 admin admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Nov 24 16:37:02.366762 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: [pid: 71939|app: 0|req: 649/1298] 10.222.0.53 () {56 vars in 1123 bytes} [Wed Nov 24 16:37:02 2021] GET /identity/v3/projects/service => generated 88 bytes in 73 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 24 16:37:02.373068 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7da5935d-b154-476c-b112-c8280a8d1056 admin admin] Authenticating user token {{(pid=71938) process_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 24 16:37:02.383688 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7da5935d-b154-476c-b112-c8280a8d1056 admin admin] Validating token access rules against request {{(pid=71938) validate_allowed_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 24 16:37:02.388091 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-162615ce-8d37-40cd-a1fb-0f64b23a10cf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f2ba2e8375b4e8c8792ee1e22b60427', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '00a5583c7b7443e98e7a1d31a0b638dc', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=71938) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 24 16:37:02.388800 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-162615ce-8d37-40cd-a1fb-0f64b23a10cf admin admin] REQUEST_METHOD: `GET` {{(pid=71938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 24 16:37:02.389104 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-162615ce-8d37-40cd-a1fb-0f64b23a10cf admin admin] SCRIPT_NAME: `/identity` {{(pid=71938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 24 16:37:02.389437 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-162615ce-8d37-40cd-a1fb-0f64b23a10cf admin admin] PATH_INFO: `/v3/projects` {{(pid=71938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 24 16:37:02.390338 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-162615ce-8d37-40cd-a1fb-0f64b23a10cf admin admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=71938) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:161}} Nov 24 16:37:02.390699 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-162615ce-8d37-40cd-a1fb-0f64b23a10cf admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=71938) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:442}} Nov 24 16:37:02.419549 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-162615ce-8d37-40cd-a1fb-0f64b23a10cf admin admin] RBAC: Authorization granted {{(pid=71938) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 24 16:37:02.435460 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: [pid: 71938|app: 0|req: 650/1299] 10.222.0.53 () {56 vars in 1160 bytes} [Wed Nov 24 16:37:02 2021] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 63 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 24 16:37:02.442017 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfa2bdc9-9694-4648-90cb-f52277a8ebe2 admin admin] Authenticating user token {{(pid=71939) process_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 24 16:37:02.452806 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfa2bdc9-9694-4648-90cb-f52277a8ebe2 admin admin] Validating token access rules against request {{(pid=71939) validate_allowed_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 24 16:37:02.457158 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-511a14c6-6032-4368-aa3f-7bc6c4d53142 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f2ba2e8375b4e8c8792ee1e22b60427', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '00a5583c7b7443e98e7a1d31a0b638dc', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=71939) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 24 16:37:02.458151 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-511a14c6-6032-4368-aa3f-7bc6c4d53142 admin admin] REQUEST_METHOD: `PUT` {{(pid=71939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 24 16:37:02.458419 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-511a14c6-6032-4368-aa3f-7bc6c4d53142 admin admin] SCRIPT_NAME: `/identity` {{(pid=71939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 24 16:37:02.458778 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-511a14c6-6032-4368-aa3f-7bc6c4d53142 admin admin] PATH_INFO: `/v3/projects/3b3940d4ae1c4177ae29c02377bb4b0b/users/a919320c9e2a48d7ba33453b5929d7ee/roles/2d4a51004ce34308a7a33e68bf2cfc74` {{(pid=71939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 24 16:37:02.479400 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-511a14c6-6032-4368-aa3f-7bc6c4d53142 admin admin] RBAC: Authorizing `identity:create_grant(project_id=3b3940d4ae1c4177ae29c02377bb4b0b, user_id=a919320c9e2a48d7ba33453b5929d7ee, role_id=2d4a51004ce34308a7a33e68bf2cfc74)` {{(pid=71939) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:442}} Nov 24 16:37:02.510140 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-511a14c6-6032-4368-aa3f-7bc6c4d53142 admin admin] RBAC: Authorization granted {{(pid=71939) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 24 16:37:02.521732 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: [pid: 71939|app: 0|req: 650/1300] 10.222.0.53 () {58 vars in 1451 bytes} [Wed Nov 24 16:37:02 2021] PUT /identity/v3/projects/3b3940d4ae1c4177ae29c02377bb4b0b/users/a919320c9e2a48d7ba33453b5929d7ee/roles/2d4a51004ce34308a7a33e68bf2cfc74 => generated 0 bytes in 80 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 24 16:37:04.498124 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01738b16-ca42-4834-a80f-c1dd4b3c02d1 None None] REQUEST_METHOD: `GET` {{(pid=71938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 24 16:37:04.498622 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01738b16-ca42-4834-a80f-c1dd4b3c02d1 None None] SCRIPT_NAME: `/identity` {{(pid=71938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 24 16:37:04.498730 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01738b16-ca42-4834-a80f-c1dd4b3c02d1 None None] PATH_INFO: `/` {{(pid=71938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 24 16:37:04.500514 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: [pid: 71938|app: 0|req: 651/1301] 10.222.0.53 () {54 vars in 915 bytes} [Wed Nov 24 16:37:04 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 24 16:37:04.506779 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a873c5fb-854e-49d0-9dbe-042b9202003b None None] REQUEST_METHOD: `POST` {{(pid=71939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 24 16:37:04.507131 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a873c5fb-854e-49d0-9dbe-042b9202003b None None] SCRIPT_NAME: `/identity` {{(pid=71939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 24 16:37:04.507469 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a873c5fb-854e-49d0-9dbe-042b9202003b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=71939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 24 16:37:04.530788 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.auth.core [None req-a873c5fb-854e-49d0-9dbe-042b9202003b None None] MFA Rules not processed for user `0f2ba2e8375b4e8c8792ee1e22b60427`. Rule list: `[]` (Enabled: `True`). {{(pid=71939) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:442}} Nov 24 16:37:04.532004 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.fernet_utils [None req-a873c5fb-854e-49d0-9dbe-042b9202003b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=71939) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:289}} Nov 24 16:37:04.598280 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: [pid: 71939|app: 0|req: 651/1302] 10.222.0.53 () {58 vars in 1013 bytes} [Wed Nov 24 16:37:04 2021] POST /identity/v3/auth/tokens => generated 3413 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 24 16:37:04.620874 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10b0b666-1a9d-4544-ad49-2fd2fb34a43e None None] REQUEST_METHOD: `POST` {{(pid=71938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 24 16:37:04.621221 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10b0b666-1a9d-4544-ad49-2fd2fb34a43e None None] SCRIPT_NAME: `/identity` {{(pid=71938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 24 16:37:04.621557 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10b0b666-1a9d-4544-ad49-2fd2fb34a43e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=71938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 24 16:37:04.644912 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.auth.core [None req-10b0b666-1a9d-4544-ad49-2fd2fb34a43e None None] MFA Rules not processed for user `0f2ba2e8375b4e8c8792ee1e22b60427`. Rule list: `[]` (Enabled: `True`). {{(pid=71938) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:442}} Nov 24 16:37:04.646151 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.fernet_utils [None req-10b0b666-1a9d-4544-ad49-2fd2fb34a43e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=71938) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:289}} Nov 24 16:37:04.653387 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: [pid: 71938|app: 0|req: 652/1303] 10.222.0.53 () {58 vars in 1013 bytes} [Wed Nov 24 16:37:04 2021] POST /identity/v3/auth/tokens => generated 3413 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 24 16:37:04.659378 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a873c5fb-854e-49d0-9dbe-042b9202003b None None] Authenticating user token {{(pid=71939) process_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 24 16:37:04.668855 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a873c5fb-854e-49d0-9dbe-042b9202003b None None] Validating token access rules against request {{(pid=71939) validate_allowed_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 24 16:37:04.673169 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bc7daaa-9df1-466f-a0ec-85344b444f9a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f2ba2e8375b4e8c8792ee1e22b60427', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '00a5583c7b7443e98e7a1d31a0b638dc', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=71939) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 24 16:37:04.673996 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bc7daaa-9df1-466f-a0ec-85344b444f9a admin admin] REQUEST_METHOD: `GET` {{(pid=71939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 24 16:37:04.674347 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bc7daaa-9df1-466f-a0ec-85344b444f9a admin admin] SCRIPT_NAME: `/identity` {{(pid=71939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 24 16:37:04.674681 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bc7daaa-9df1-466f-a0ec-85344b444f9a admin admin] PATH_INFO: `/v3/roles/service` {{(pid=71939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 24 16:37:04.686814 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bc7daaa-9df1-466f-a0ec-85344b444f9a admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=71939) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:401}} Nov 24 16:37:04.694872 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: WARNING keystone.server.flask.application [None req-7bc7daaa-9df1-466f-a0ec-85344b444f9a admin admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Nov 24 16:37:04.696051 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: [pid: 71939|app: 0|req: 652/1304] 10.222.0.53 () {56 vars in 1114 bytes} [Wed Nov 24 16:37:04 2021] GET /identity/v3/roles/service => generated 85 bytes in 37 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 24 16:37:04.703038 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10b0b666-1a9d-4544-ad49-2fd2fb34a43e None None] Authenticating user token {{(pid=71938) process_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 24 16:37:04.712173 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10b0b666-1a9d-4544-ad49-2fd2fb34a43e None None] Validating token access rules against request {{(pid=71938) validate_allowed_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 24 16:37:04.716578 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07a328ce-4c87-4a13-baa9-96a97c1c8ef3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f2ba2e8375b4e8c8792ee1e22b60427', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '00a5583c7b7443e98e7a1d31a0b638dc', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=71938) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 24 16:37:04.717242 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07a328ce-4c87-4a13-baa9-96a97c1c8ef3 admin admin] REQUEST_METHOD: `GET` {{(pid=71938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 24 16:37:04.717582 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07a328ce-4c87-4a13-baa9-96a97c1c8ef3 admin admin] SCRIPT_NAME: `/identity` {{(pid=71938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 24 16:37:04.717918 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07a328ce-4c87-4a13-baa9-96a97c1c8ef3 admin admin] PATH_INFO: `/v3/roles` {{(pid=71938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 24 16:37:04.718756 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07a328ce-4c87-4a13-baa9-96a97c1c8ef3 admin admin] RBAC: Adding query filter params (name=service) {{(pid=71938) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:161}} Nov 24 16:37:04.719113 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07a328ce-4c87-4a13-baa9-96a97c1c8ef3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=71938) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:442}} Nov 24 16:37:04.747627 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07a328ce-4c87-4a13-baa9-96a97c1c8ef3 admin admin] RBAC: Authorization granted {{(pid=71938) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 24 16:37:04.760430 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: [pid: 71938|app: 0|req: 653/1305] 10.222.0.53 () {56 vars in 1115 bytes} [Wed Nov 24 16:37:04 2021] GET /identity/v3/roles?name=service => generated 326 bytes in 58 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 24 16:37:04.766547 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bc7daaa-9df1-466f-a0ec-85344b444f9a admin admin] Authenticating user token {{(pid=71939) process_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 24 16:37:04.776925 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bc7daaa-9df1-466f-a0ec-85344b444f9a admin admin] Validating token access rules against request {{(pid=71939) validate_allowed_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 24 16:37:04.781300 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d78b07c-fe9d-484a-b4e4-2a485a508171 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f2ba2e8375b4e8c8792ee1e22b60427', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '00a5583c7b7443e98e7a1d31a0b638dc', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=71939) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 24 16:37:04.782139 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d78b07c-fe9d-484a-b4e4-2a485a508171 admin admin] REQUEST_METHOD: `GET` {{(pid=71939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 24 16:37:04.782484 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d78b07c-fe9d-484a-b4e4-2a485a508171 admin admin] SCRIPT_NAME: `/identity` {{(pid=71939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 24 16:37:04.782818 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d78b07c-fe9d-484a-b4e4-2a485a508171 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=71939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 24 16:37:04.795019 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d78b07c-fe9d-484a-b4e4-2a485a508171 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=71939) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:442}} Nov 24 16:37:04.823867 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d78b07c-fe9d-484a-b4e4-2a485a508171 admin admin] RBAC: Authorization granted {{(pid=71939) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 24 16:37:04.843065 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: WARNING keystone.server.flask.application [None req-7d78b07c-fe9d-484a-b4e4-2a485a508171 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Nov 24 16:37:04.844225 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: [pid: 71939|app: 0|req: 653/1306] 10.222.0.53 () {56 vars in 1120 bytes} [Wed Nov 24 16:37:04 2021] GET /identity/v3/domains/Default => generated 87 bytes in 78 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 24 16:37:04.850873 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07a328ce-4c87-4a13-baa9-96a97c1c8ef3 admin admin] Authenticating user token {{(pid=71938) process_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 24 16:37:04.860676 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07a328ce-4c87-4a13-baa9-96a97c1c8ef3 admin admin] Validating token access rules against request {{(pid=71938) validate_allowed_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 24 16:37:04.865080 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc5cf7a7-f43a-49f2-9f44-24844f5134f3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f2ba2e8375b4e8c8792ee1e22b60427', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '00a5583c7b7443e98e7a1d31a0b638dc', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=71938) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 24 16:37:04.866415 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc5cf7a7-f43a-49f2-9f44-24844f5134f3 admin admin] REQUEST_METHOD: `GET` {{(pid=71938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 24 16:37:04.866762 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc5cf7a7-f43a-49f2-9f44-24844f5134f3 admin admin] SCRIPT_NAME: `/identity` {{(pid=71938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 24 16:37:04.867098 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc5cf7a7-f43a-49f2-9f44-24844f5134f3 admin admin] PATH_INFO: `/v3/domains` {{(pid=71938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 24 16:37:04.867878 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc5cf7a7-f43a-49f2-9f44-24844f5134f3 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=71938) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:161}} Nov 24 16:37:04.868233 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc5cf7a7-f43a-49f2-9f44-24844f5134f3 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=71938) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:442}} Nov 24 16:37:04.896209 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc5cf7a7-f43a-49f2-9f44-24844f5134f3 admin admin] RBAC: Authorization granted {{(pid=71938) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 24 16:37:04.909625 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: [pid: 71938|app: 0|req: 654/1307] 10.222.0.53 () {56 vars in 1121 bytes} [Wed Nov 24 16:37:04 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 60 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 24 16:37:04.916253 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d78b07c-fe9d-484a-b4e4-2a485a508171 admin admin] Authenticating user token {{(pid=71939) process_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 24 16:37:04.926177 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d78b07c-fe9d-484a-b4e4-2a485a508171 admin admin] Validating token access rules against request {{(pid=71939) validate_allowed_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 24 16:37:04.931201 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4a7de82-4dd3-4583-b39d-417d40948d36 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f2ba2e8375b4e8c8792ee1e22b60427', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '00a5583c7b7443e98e7a1d31a0b638dc', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=71939) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 24 16:37:04.932012 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4a7de82-4dd3-4583-b39d-417d40948d36 admin admin] REQUEST_METHOD: `GET` {{(pid=71939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 24 16:37:04.932356 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4a7de82-4dd3-4583-b39d-417d40948d36 admin admin] SCRIPT_NAME: `/identity` {{(pid=71939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 24 16:37:04.932693 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4a7de82-4dd3-4583-b39d-417d40948d36 admin admin] PATH_INFO: `/v3/users/placement` {{(pid=71939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 24 16:37:04.948370 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4a7de82-4dd3-4583-b39d-417d40948d36 admin admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=71939) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:442}} Nov 24 16:37:04.978839 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4a7de82-4dd3-4583-b39d-417d40948d36 admin admin] RBAC: Authorization granted {{(pid=71939) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 24 16:37:04.998998 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: WARNING keystone.server.flask.application [None req-e4a7de82-4dd3-4583-b39d-417d40948d36 admin admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Nov 24 16:37:05.000191 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: [pid: 71939|app: 0|req: 654/1308] 10.222.0.53 () {56 vars in 1120 bytes} [Wed Nov 24 16:37:04 2021] GET /identity/v3/users/placement => generated 87 bytes in 84 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 24 16:37:05.006543 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc5cf7a7-f43a-49f2-9f44-24844f5134f3 admin admin] Authenticating user token {{(pid=71938) process_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 24 16:37:05.016409 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc5cf7a7-f43a-49f2-9f44-24844f5134f3 admin admin] Validating token access rules against request {{(pid=71938) validate_allowed_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 24 16:37:05.020711 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6204162b-99a4-43f1-821e-71edad18ba22 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f2ba2e8375b4e8c8792ee1e22b60427', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '00a5583c7b7443e98e7a1d31a0b638dc', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=71938) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 24 16:37:05.021377 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6204162b-99a4-43f1-821e-71edad18ba22 admin admin] REQUEST_METHOD: `GET` {{(pid=71938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 24 16:37:05.021717 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6204162b-99a4-43f1-821e-71edad18ba22 admin admin] SCRIPT_NAME: `/identity` {{(pid=71938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 24 16:37:05.022073 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6204162b-99a4-43f1-821e-71edad18ba22 admin admin] PATH_INFO: `/v3/users` {{(pid=71938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 24 16:37:05.022985 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6204162b-99a4-43f1-821e-71edad18ba22 admin admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=71938) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:161}} Nov 24 16:37:05.023336 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6204162b-99a4-43f1-821e-71edad18ba22 admin admin] RBAC: Authorizing `identity:list_users()` {{(pid=71938) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:442}} Nov 24 16:37:05.057361 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6204162b-99a4-43f1-821e-71edad18ba22 admin admin] RBAC: Authorization granted {{(pid=71938) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 24 16:37:05.088902 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: [pid: 71938|app: 0|req: 655/1309] 10.222.0.53 () {56 vars in 1155 bytes} [Wed Nov 24 16:37:05 2021] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 83 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 24 16:37:05.095270 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4a7de82-4dd3-4583-b39d-417d40948d36 admin admin] Authenticating user token {{(pid=71939) process_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 24 16:37:05.106128 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4a7de82-4dd3-4583-b39d-417d40948d36 admin admin] Validating token access rules against request {{(pid=71939) validate_allowed_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 24 16:37:05.110537 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11c3e3a6-bb00-4f76-818b-43c27a2fb1b8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f2ba2e8375b4e8c8792ee1e22b60427', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '00a5583c7b7443e98e7a1d31a0b638dc', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=71939) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 24 16:37:05.111173 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11c3e3a6-bb00-4f76-818b-43c27a2fb1b8 admin admin] REQUEST_METHOD: `GET` {{(pid=71939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 24 16:37:05.111507 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11c3e3a6-bb00-4f76-818b-43c27a2fb1b8 admin admin] SCRIPT_NAME: `/identity` {{(pid=71939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 24 16:37:05.111835 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11c3e3a6-bb00-4f76-818b-43c27a2fb1b8 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=71939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 24 16:37:05.120465 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11c3e3a6-bb00-4f76-818b-43c27a2fb1b8 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=71939) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:442}} Nov 24 16:37:05.148663 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11c3e3a6-bb00-4f76-818b-43c27a2fb1b8 admin admin] RBAC: Authorization granted {{(pid=71939) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 24 16:37:05.158200 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: [pid: 71939|app: 0|req: 655/1310] 10.222.0.53 () {58 vars in 1315 bytes} [Wed Nov 24 16:37:05 2021] GET /identity/v3/auth/tokens => generated 3413 bytes in 63 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 24 16:37:05.165198 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6204162b-99a4-43f1-821e-71edad18ba22 admin admin] Authenticating user token {{(pid=71938) process_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 24 16:37:05.175362 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6204162b-99a4-43f1-821e-71edad18ba22 admin admin] Validating token access rules against request {{(pid=71938) validate_allowed_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 24 16:37:05.179770 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e5b0f10-4e2e-4c06-98eb-99b712d2d574 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f2ba2e8375b4e8c8792ee1e22b60427', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '00a5583c7b7443e98e7a1d31a0b638dc', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=71938) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 24 16:37:05.180581 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e5b0f10-4e2e-4c06-98eb-99b712d2d574 admin admin] REQUEST_METHOD: `GET` {{(pid=71938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 24 16:37:05.180923 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e5b0f10-4e2e-4c06-98eb-99b712d2d574 admin admin] SCRIPT_NAME: `/identity` {{(pid=71938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 24 16:37:05.181259 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e5b0f10-4e2e-4c06-98eb-99b712d2d574 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=71938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 24 16:37:05.193726 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e5b0f10-4e2e-4c06-98eb-99b712d2d574 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=71938) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:442}} Nov 24 16:37:05.222856 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e5b0f10-4e2e-4c06-98eb-99b712d2d574 admin admin] RBAC: Authorization granted {{(pid=71938) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 24 16:37:05.242316 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: WARNING keystone.server.flask.application [None req-2e5b0f10-4e2e-4c06-98eb-99b712d2d574 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Nov 24 16:37:05.243531 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: [pid: 71938|app: 0|req: 656/1311] 10.222.0.53 () {56 vars in 1120 bytes} [Wed Nov 24 16:37:05 2021] GET /identity/v3/domains/Default => generated 87 bytes in 79 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 24 16:37:05.249816 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11c3e3a6-bb00-4f76-818b-43c27a2fb1b8 admin admin] Authenticating user token {{(pid=71939) process_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 24 16:37:05.259083 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11c3e3a6-bb00-4f76-818b-43c27a2fb1b8 admin admin] Validating token access rules against request {{(pid=71939) validate_allowed_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 24 16:37:05.263540 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04a54a78-a800-41ab-8ae5-85ab14268ed5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f2ba2e8375b4e8c8792ee1e22b60427', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '00a5583c7b7443e98e7a1d31a0b638dc', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=71939) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 24 16:37:05.264206 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04a54a78-a800-41ab-8ae5-85ab14268ed5 admin admin] REQUEST_METHOD: `GET` {{(pid=71939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 24 16:37:05.264547 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04a54a78-a800-41ab-8ae5-85ab14268ed5 admin admin] SCRIPT_NAME: `/identity` {{(pid=71939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 24 16:37:05.264881 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04a54a78-a800-41ab-8ae5-85ab14268ed5 admin admin] PATH_INFO: `/v3/domains` {{(pid=71939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 24 16:37:05.265660 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04a54a78-a800-41ab-8ae5-85ab14268ed5 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=71939) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:161}} Nov 24 16:37:05.266010 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04a54a78-a800-41ab-8ae5-85ab14268ed5 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=71939) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:442}} Nov 24 16:37:05.294923 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04a54a78-a800-41ab-8ae5-85ab14268ed5 admin admin] RBAC: Authorization granted {{(pid=71939) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 24 16:37:05.309274 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: [pid: 71939|app: 0|req: 656/1312] 10.222.0.53 () {56 vars in 1121 bytes} [Wed Nov 24 16:37:05 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 60 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 24 16:37:05.315307 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e5b0f10-4e2e-4c06-98eb-99b712d2d574 admin admin] Authenticating user token {{(pid=71938) process_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 24 16:37:05.325426 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e5b0f10-4e2e-4c06-98eb-99b712d2d574 admin admin] Validating token access rules against request {{(pid=71938) validate_allowed_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 24 16:37:05.330172 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ef23b33-85b1-4f52-8f77-80aa2552f1d6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f2ba2e8375b4e8c8792ee1e22b60427', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '00a5583c7b7443e98e7a1d31a0b638dc', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=71938) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 24 16:37:05.330975 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ef23b33-85b1-4f52-8f77-80aa2552f1d6 admin admin] REQUEST_METHOD: `GET` {{(pid=71938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 24 16:37:05.331309 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ef23b33-85b1-4f52-8f77-80aa2552f1d6 admin admin] SCRIPT_NAME: `/identity` {{(pid=71938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 24 16:37:05.331636 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ef23b33-85b1-4f52-8f77-80aa2552f1d6 admin admin] PATH_INFO: `/v3/projects/service` {{(pid=71938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 24 16:37:05.341576 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ef23b33-85b1-4f52-8f77-80aa2552f1d6 admin admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=71938) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:442}} Nov 24 16:37:05.373019 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ef23b33-85b1-4f52-8f77-80aa2552f1d6 admin admin] RBAC: Authorization granted {{(pid=71938) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 24 16:37:05.389112 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: WARNING keystone.server.flask.application [None req-2ef23b33-85b1-4f52-8f77-80aa2552f1d6 admin admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Nov 24 16:37:05.391391 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: [pid: 71938|app: 0|req: 657/1313] 10.222.0.53 () {56 vars in 1123 bytes} [Wed Nov 24 16:37:05 2021] GET /identity/v3/projects/service => generated 88 bytes in 77 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 24 16:37:05.399030 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04a54a78-a800-41ab-8ae5-85ab14268ed5 admin admin] Authenticating user token {{(pid=71939) process_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 24 16:37:05.409614 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04a54a78-a800-41ab-8ae5-85ab14268ed5 admin admin] Validating token access rules against request {{(pid=71939) validate_allowed_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 24 16:37:05.414718 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed755c08-4011-4604-bf2a-e2d54f624137 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f2ba2e8375b4e8c8792ee1e22b60427', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '00a5583c7b7443e98e7a1d31a0b638dc', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=71939) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 24 16:37:05.415377 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed755c08-4011-4604-bf2a-e2d54f624137 admin admin] REQUEST_METHOD: `GET` {{(pid=71939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 24 16:37:05.415711 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed755c08-4011-4604-bf2a-e2d54f624137 admin admin] SCRIPT_NAME: `/identity` {{(pid=71939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 24 16:37:05.416040 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed755c08-4011-4604-bf2a-e2d54f624137 admin admin] PATH_INFO: `/v3/projects` {{(pid=71939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 24 16:37:05.416882 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed755c08-4011-4604-bf2a-e2d54f624137 admin admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=71939) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:161}} Nov 24 16:37:05.417230 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed755c08-4011-4604-bf2a-e2d54f624137 admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=71939) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:442}} Nov 24 16:37:05.446646 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed755c08-4011-4604-bf2a-e2d54f624137 admin admin] RBAC: Authorization granted {{(pid=71939) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 24 16:37:05.461543 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: [pid: 71939|app: 0|req: 657/1314] 10.222.0.53 () {56 vars in 1160 bytes} [Wed Nov 24 16:37:05 2021] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 63 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 24 16:37:05.468090 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ef23b33-85b1-4f52-8f77-80aa2552f1d6 admin admin] Authenticating user token {{(pid=71938) process_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 24 16:37:05.478662 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ef23b33-85b1-4f52-8f77-80aa2552f1d6 admin admin] Validating token access rules against request {{(pid=71938) validate_allowed_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 24 16:37:05.483053 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2db011f1-b76c-4c2d-844f-caeaad5126c1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f2ba2e8375b4e8c8792ee1e22b60427', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '00a5583c7b7443e98e7a1d31a0b638dc', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=71938) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 24 16:37:05.483706 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2db011f1-b76c-4c2d-844f-caeaad5126c1 admin admin] REQUEST_METHOD: `GET` {{(pid=71938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 24 16:37:05.484046 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2db011f1-b76c-4c2d-844f-caeaad5126c1 admin admin] SCRIPT_NAME: `/identity` {{(pid=71938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 24 16:37:05.484378 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2db011f1-b76c-4c2d-844f-caeaad5126c1 admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=71938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 24 16:37:05.485264 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2db011f1-b76c-4c2d-844f-caeaad5126c1 admin admin] RBAC: Adding query filter params (role.id=2d4a51004ce34308a7a33e68bf2cfc74, scope.project.id=3b3940d4ae1c4177ae29c02377bb4b0b, user.id=a919320c9e2a48d7ba33453b5929d7ee) {{(pid=71938) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:161}} Nov 24 16:37:05.485613 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2db011f1-b76c-4c2d-844f-caeaad5126c1 admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=71938) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:442}} Nov 24 16:37:05.514791 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2db011f1-b76c-4c2d-844f-caeaad5126c1 admin admin] RBAC: Authorization granted {{(pid=71938) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 24 16:37:05.521001 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: [pid: 71938|app: 0|req: 658/1315] 10.222.0.53 () {56 vars in 1386 bytes} [Wed Nov 24 16:37:05 2021] GET /identity/v3/role_assignments?user.id=a919320c9e2a48d7ba33453b5929d7ee&scope.project.id=3b3940d4ae1c4177ae29c02377bb4b0b&role.id=2d4a51004ce34308a7a33e68bf2cfc74 => generated 608 bytes in 53 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 24 16:37:07.631651 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e23f30f8-dc65-40ce-bd73-07e6114ac439 None None] REQUEST_METHOD: `GET` {{(pid=71939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 24 16:37:07.632244 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e23f30f8-dc65-40ce-bd73-07e6114ac439 None None] SCRIPT_NAME: `/identity` {{(pid=71939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 24 16:37:07.632360 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e23f30f8-dc65-40ce-bd73-07e6114ac439 None None] PATH_INFO: `/` {{(pid=71939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 24 16:37:07.634156 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: [pid: 71939|app: 0|req: 658/1316] 10.222.0.53 () {54 vars in 915 bytes} [Wed Nov 24 16:37:07 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 24 16:37:07.640393 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e16454e-71de-4f66-9647-6cbb739aae7c None None] REQUEST_METHOD: `POST` {{(pid=71938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 24 16:37:07.640744 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e16454e-71de-4f66-9647-6cbb739aae7c None None] SCRIPT_NAME: `/identity` {{(pid=71938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 24 16:37:07.641082 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e16454e-71de-4f66-9647-6cbb739aae7c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=71938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 24 16:37:07.665406 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.auth.core [None req-1e16454e-71de-4f66-9647-6cbb739aae7c None None] MFA Rules not processed for user `0f2ba2e8375b4e8c8792ee1e22b60427`. Rule list: `[]` (Enabled: `True`). {{(pid=71938) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:442}} Nov 24 16:37:07.666668 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.fernet_utils [None req-1e16454e-71de-4f66-9647-6cbb739aae7c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=71938) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:289}} Nov 24 16:37:07.673987 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: [pid: 71938|app: 0|req: 659/1317] 10.222.0.53 () {58 vars in 1013 bytes} [Wed Nov 24 16:37:07 2021] POST /identity/v3/auth/tokens => generated 3413 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 24 16:37:07.702629 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b57cbc6-d1ec-4fe6-aa4f-7fabfd11da2b None None] REQUEST_METHOD: `POST` {{(pid=71939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 24 16:37:07.702966 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b57cbc6-d1ec-4fe6-aa4f-7fabfd11da2b None None] SCRIPT_NAME: `/identity` {{(pid=71939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 24 16:37:07.703299 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b57cbc6-d1ec-4fe6-aa4f-7fabfd11da2b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=71939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 24 16:37:07.727350 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.auth.core [None req-8b57cbc6-d1ec-4fe6-aa4f-7fabfd11da2b None None] MFA Rules not processed for user `0f2ba2e8375b4e8c8792ee1e22b60427`. Rule list: `[]` (Enabled: `True`). {{(pid=71939) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:442}} Nov 24 16:37:07.728562 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.fernet_utils [None req-8b57cbc6-d1ec-4fe6-aa4f-7fabfd11da2b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=71939) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:289}} Nov 24 16:37:07.736835 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: [pid: 71939|app: 0|req: 659/1318] 10.222.0.53 () {58 vars in 1013 bytes} [Wed Nov 24 16:37:07 2021] POST /identity/v3/auth/tokens => generated 3413 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 24 16:37:07.743658 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e16454e-71de-4f66-9647-6cbb739aae7c None None] Authenticating user token {{(pid=71938) process_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 24 16:37:07.753436 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e16454e-71de-4f66-9647-6cbb739aae7c None None] Validating token access rules against request {{(pid=71938) validate_allowed_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 24 16:37:07.758590 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42e94b17-1cd0-4ce3-9256-b3489b7b3941 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f2ba2e8375b4e8c8792ee1e22b60427', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '00a5583c7b7443e98e7a1d31a0b638dc', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=71938) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 24 16:37:07.759402 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42e94b17-1cd0-4ce3-9256-b3489b7b3941 admin admin] REQUEST_METHOD: `GET` {{(pid=71938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 24 16:37:07.759741 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42e94b17-1cd0-4ce3-9256-b3489b7b3941 admin admin] SCRIPT_NAME: `/identity` {{(pid=71938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 24 16:37:07.760072 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42e94b17-1cd0-4ce3-9256-b3489b7b3941 admin admin] PATH_INFO: `/v3/roles/admin` {{(pid=71938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 24 16:37:07.771880 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42e94b17-1cd0-4ce3-9256-b3489b7b3941 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=71938) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:401}} Nov 24 16:37:07.779302 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: WARNING keystone.server.flask.application [None req-42e94b17-1cd0-4ce3-9256-b3489b7b3941 admin admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Nov 24 16:37:07.780475 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: [pid: 71938|app: 0|req: 660/1319] 10.222.0.53 () {56 vars in 1108 bytes} [Wed Nov 24 16:37:07 2021] GET /identity/v3/roles/admin => generated 83 bytes in 37 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 24 16:37:07.787019 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b57cbc6-d1ec-4fe6-aa4f-7fabfd11da2b None None] Authenticating user token {{(pid=71939) process_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 24 16:37:07.796468 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b57cbc6-d1ec-4fe6-aa4f-7fabfd11da2b None None] Validating token access rules against request {{(pid=71939) validate_allowed_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 24 16:37:07.800828 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6b9dbf7-825b-4db6-ac8a-bb7215d2d1ab admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f2ba2e8375b4e8c8792ee1e22b60427', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '00a5583c7b7443e98e7a1d31a0b638dc', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=71939) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 24 16:37:07.801485 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6b9dbf7-825b-4db6-ac8a-bb7215d2d1ab admin admin] REQUEST_METHOD: `GET` {{(pid=71939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 24 16:37:07.801819 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6b9dbf7-825b-4db6-ac8a-bb7215d2d1ab admin admin] SCRIPT_NAME: `/identity` {{(pid=71939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 24 16:37:07.802195 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6b9dbf7-825b-4db6-ac8a-bb7215d2d1ab admin admin] PATH_INFO: `/v3/roles` {{(pid=71939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 24 16:37:07.803579 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6b9dbf7-825b-4db6-ac8a-bb7215d2d1ab admin admin] RBAC: Adding query filter params (name=admin) {{(pid=71939) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:161}} Nov 24 16:37:07.803922 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6b9dbf7-825b-4db6-ac8a-bb7215d2d1ab admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=71939) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:442}} Nov 24 16:37:07.831773 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6b9dbf7-825b-4db6-ac8a-bb7215d2d1ab admin admin] RBAC: Authorization granted {{(pid=71939) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 24 16:37:07.840681 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: [pid: 71939|app: 0|req: 660/1320] 10.222.0.53 () {56 vars in 1111 bytes} [Wed Nov 24 16:37:07 2021] GET /identity/v3/roles?name=admin => generated 339 bytes in 54 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 24 16:37:07.846697 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42e94b17-1cd0-4ce3-9256-b3489b7b3941 admin admin] Authenticating user token {{(pid=71938) process_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 24 16:37:07.857565 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42e94b17-1cd0-4ce3-9256-b3489b7b3941 admin admin] Validating token access rules against request {{(pid=71938) validate_allowed_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 24 16:37:07.862058 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84b5008e-a10a-4598-90e6-4354f4a74cf5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f2ba2e8375b4e8c8792ee1e22b60427', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '00a5583c7b7443e98e7a1d31a0b638dc', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=71938) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 24 16:37:07.862852 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84b5008e-a10a-4598-90e6-4354f4a74cf5 admin admin] REQUEST_METHOD: `GET` {{(pid=71938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 24 16:37:07.863195 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84b5008e-a10a-4598-90e6-4354f4a74cf5 admin admin] SCRIPT_NAME: `/identity` {{(pid=71938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 24 16:37:07.863528 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84b5008e-a10a-4598-90e6-4354f4a74cf5 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=71938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 24 16:37:07.875915 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84b5008e-a10a-4598-90e6-4354f4a74cf5 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=71938) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:442}} Nov 24 16:37:07.904391 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84b5008e-a10a-4598-90e6-4354f4a74cf5 admin admin] RBAC: Authorization granted {{(pid=71938) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 24 16:37:07.923791 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: WARNING keystone.server.flask.application [None req-84b5008e-a10a-4598-90e6-4354f4a74cf5 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Nov 24 16:37:07.924964 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: [pid: 71938|app: 0|req: 661/1321] 10.222.0.53 () {56 vars in 1120 bytes} [Wed Nov 24 16:37:07 2021] GET /identity/v3/domains/Default => generated 87 bytes in 79 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 24 16:37:07.931613 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6b9dbf7-825b-4db6-ac8a-bb7215d2d1ab admin admin] Authenticating user token {{(pid=71939) process_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 24 16:37:07.941267 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6b9dbf7-825b-4db6-ac8a-bb7215d2d1ab admin admin] Validating token access rules against request {{(pid=71939) validate_allowed_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 24 16:37:07.945666 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2de9830a-7e81-438a-b30d-beb913c802ad admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f2ba2e8375b4e8c8792ee1e22b60427', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '00a5583c7b7443e98e7a1d31a0b638dc', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=71939) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 24 16:37:07.946365 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2de9830a-7e81-438a-b30d-beb913c802ad admin admin] REQUEST_METHOD: `GET` {{(pid=71939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 24 16:37:07.946700 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2de9830a-7e81-438a-b30d-beb913c802ad admin admin] SCRIPT_NAME: `/identity` {{(pid=71939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 24 16:37:07.947027 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2de9830a-7e81-438a-b30d-beb913c802ad admin admin] PATH_INFO: `/v3/domains` {{(pid=71939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 24 16:37:07.947795 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2de9830a-7e81-438a-b30d-beb913c802ad admin admin] RBAC: Adding query filter params (name=Default) {{(pid=71939) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:161}} Nov 24 16:37:07.948142 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2de9830a-7e81-438a-b30d-beb913c802ad admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=71939) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:442}} Nov 24 16:37:07.976655 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2de9830a-7e81-438a-b30d-beb913c802ad admin admin] RBAC: Authorization granted {{(pid=71939) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 24 16:37:07.989678 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: [pid: 71939|app: 0|req: 661/1322] 10.222.0.53 () {56 vars in 1121 bytes} [Wed Nov 24 16:37:07 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 59 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 24 16:37:07.996166 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84b5008e-a10a-4598-90e6-4354f4a74cf5 admin admin] Authenticating user token {{(pid=71938) process_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 24 16:37:08.005930 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84b5008e-a10a-4598-90e6-4354f4a74cf5 admin admin] Validating token access rules against request {{(pid=71938) validate_allowed_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 24 16:37:08.011342 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fd4ac90-6e48-4dbc-9a65-db9f55a2cbc6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f2ba2e8375b4e8c8792ee1e22b60427', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '00a5583c7b7443e98e7a1d31a0b638dc', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=71938) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 24 16:37:08.012158 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fd4ac90-6e48-4dbc-9a65-db9f55a2cbc6 admin admin] REQUEST_METHOD: `GET` {{(pid=71938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 24 16:37:08.012500 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fd4ac90-6e48-4dbc-9a65-db9f55a2cbc6 admin admin] SCRIPT_NAME: `/identity` {{(pid=71938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 24 16:37:08.012835 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fd4ac90-6e48-4dbc-9a65-db9f55a2cbc6 admin admin] PATH_INFO: `/v3/users/placement` {{(pid=71938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 24 16:37:08.033429 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fd4ac90-6e48-4dbc-9a65-db9f55a2cbc6 admin admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=71938) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:442}} Nov 24 16:37:08.067239 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fd4ac90-6e48-4dbc-9a65-db9f55a2cbc6 admin admin] RBAC: Authorization granted {{(pid=71938) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 24 16:37:08.088862 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: WARNING keystone.server.flask.application [None req-5fd4ac90-6e48-4dbc-9a65-db9f55a2cbc6 admin admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Nov 24 16:37:08.090107 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: [pid: 71938|app: 0|req: 662/1323] 10.222.0.53 () {56 vars in 1120 bytes} [Wed Nov 24 16:37:07 2021] GET /identity/v3/users/placement => generated 87 bytes in 94 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 24 16:37:08.096665 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2de9830a-7e81-438a-b30d-beb913c802ad admin admin] Authenticating user token {{(pid=71939) process_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 24 16:37:08.108025 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2de9830a-7e81-438a-b30d-beb913c802ad admin admin] Validating token access rules against request {{(pid=71939) validate_allowed_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 24 16:37:08.112913 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-642f2bde-bbaa-45ec-bbc6-c29cbee01373 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f2ba2e8375b4e8c8792ee1e22b60427', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '00a5583c7b7443e98e7a1d31a0b638dc', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=71939) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 24 16:37:08.113592 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-642f2bde-bbaa-45ec-bbc6-c29cbee01373 admin admin] REQUEST_METHOD: `GET` {{(pid=71939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 24 16:37:08.113930 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-642f2bde-bbaa-45ec-bbc6-c29cbee01373 admin admin] SCRIPT_NAME: `/identity` {{(pid=71939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 24 16:37:08.114334 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-642f2bde-bbaa-45ec-bbc6-c29cbee01373 admin admin] PATH_INFO: `/v3/users` {{(pid=71939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 24 16:37:08.115242 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-642f2bde-bbaa-45ec-bbc6-c29cbee01373 admin admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=71939) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:161}} Nov 24 16:37:08.115598 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-642f2bde-bbaa-45ec-bbc6-c29cbee01373 admin admin] RBAC: Authorizing `identity:list_users()` {{(pid=71939) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:442}} Nov 24 16:37:08.145437 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-642f2bde-bbaa-45ec-bbc6-c29cbee01373 admin admin] RBAC: Authorization granted {{(pid=71939) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 24 16:37:08.177984 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: [pid: 71939|app: 0|req: 662/1324] 10.222.0.53 () {56 vars in 1155 bytes} [Wed Nov 24 16:37:08 2021] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 82 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 24 16:37:08.184344 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fd4ac90-6e48-4dbc-9a65-db9f55a2cbc6 admin admin] Authenticating user token {{(pid=71938) process_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 24 16:37:08.194489 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fd4ac90-6e48-4dbc-9a65-db9f55a2cbc6 admin admin] Validating token access rules against request {{(pid=71938) validate_allowed_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 24 16:37:08.198928 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57d82026-c47e-4114-b52d-0f32e70f5480 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f2ba2e8375b4e8c8792ee1e22b60427', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '00a5583c7b7443e98e7a1d31a0b638dc', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=71938) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 24 16:37:08.199844 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57d82026-c47e-4114-b52d-0f32e70f5480 admin admin] REQUEST_METHOD: `GET` {{(pid=71938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 24 16:37:08.200180 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57d82026-c47e-4114-b52d-0f32e70f5480 admin admin] SCRIPT_NAME: `/identity` {{(pid=71938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 24 16:37:08.200586 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57d82026-c47e-4114-b52d-0f32e70f5480 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=71938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 24 16:37:08.209813 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57d82026-c47e-4114-b52d-0f32e70f5480 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=71938) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:442}} Nov 24 16:37:08.239203 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57d82026-c47e-4114-b52d-0f32e70f5480 admin admin] RBAC: Authorization granted {{(pid=71938) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 24 16:37:08.248931 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: [pid: 71938|app: 0|req: 663/1325] 10.222.0.53 () {58 vars in 1315 bytes} [Wed Nov 24 16:37:08 2021] GET /identity/v3/auth/tokens => generated 3413 bytes in 65 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 24 16:37:08.255510 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-642f2bde-bbaa-45ec-bbc6-c29cbee01373 admin admin] Authenticating user token {{(pid=71939) process_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 24 16:37:08.265554 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-642f2bde-bbaa-45ec-bbc6-c29cbee01373 admin admin] Validating token access rules against request {{(pid=71939) validate_allowed_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 24 16:37:08.269913 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9570f0e2-79fe-44f5-a534-9b240245f169 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f2ba2e8375b4e8c8792ee1e22b60427', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '00a5583c7b7443e98e7a1d31a0b638dc', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=71939) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 24 16:37:08.270753 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9570f0e2-79fe-44f5-a534-9b240245f169 admin admin] REQUEST_METHOD: `GET` {{(pid=71939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 24 16:37:08.271093 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9570f0e2-79fe-44f5-a534-9b240245f169 admin admin] SCRIPT_NAME: `/identity` {{(pid=71939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 24 16:37:08.271430 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9570f0e2-79fe-44f5-a534-9b240245f169 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=71939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 24 16:37:08.284268 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9570f0e2-79fe-44f5-a534-9b240245f169 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=71939) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:442}} Nov 24 16:37:08.313070 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9570f0e2-79fe-44f5-a534-9b240245f169 admin admin] RBAC: Authorization granted {{(pid=71939) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 24 16:37:08.332220 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: WARNING keystone.server.flask.application [None req-9570f0e2-79fe-44f5-a534-9b240245f169 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Nov 24 16:37:08.333418 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: [pid: 71939|app: 0|req: 663/1326] 10.222.0.53 () {56 vars in 1120 bytes} [Wed Nov 24 16:37:08 2021] GET /identity/v3/domains/Default => generated 87 bytes in 78 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 24 16:37:08.340313 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57d82026-c47e-4114-b52d-0f32e70f5480 admin admin] Authenticating user token {{(pid=71938) process_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 24 16:37:08.349901 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57d82026-c47e-4114-b52d-0f32e70f5480 admin admin] Validating token access rules against request {{(pid=71938) validate_allowed_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 24 16:37:08.354911 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2fc395d-3042-48b2-945b-3ed7a52c8769 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f2ba2e8375b4e8c8792ee1e22b60427', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '00a5583c7b7443e98e7a1d31a0b638dc', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=71938) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 24 16:37:08.355614 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2fc395d-3042-48b2-945b-3ed7a52c8769 admin admin] REQUEST_METHOD: `GET` {{(pid=71938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 24 16:37:08.355954 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2fc395d-3042-48b2-945b-3ed7a52c8769 admin admin] SCRIPT_NAME: `/identity` {{(pid=71938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 24 16:37:08.356286 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2fc395d-3042-48b2-945b-3ed7a52c8769 admin admin] PATH_INFO: `/v3/domains` {{(pid=71938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 24 16:37:08.357063 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2fc395d-3042-48b2-945b-3ed7a52c8769 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=71938) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:161}} Nov 24 16:37:08.357411 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2fc395d-3042-48b2-945b-3ed7a52c8769 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=71938) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:442}} Nov 24 16:37:08.385731 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2fc395d-3042-48b2-945b-3ed7a52c8769 admin admin] RBAC: Authorization granted {{(pid=71938) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 24 16:37:08.399523 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: [pid: 71938|app: 0|req: 664/1327] 10.222.0.53 () {56 vars in 1121 bytes} [Wed Nov 24 16:37:08 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 60 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 24 16:37:08.405596 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9570f0e2-79fe-44f5-a534-9b240245f169 admin admin] Authenticating user token {{(pid=71939) process_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 24 16:37:08.416337 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9570f0e2-79fe-44f5-a534-9b240245f169 admin admin] Validating token access rules against request {{(pid=71939) validate_allowed_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 24 16:37:08.420700 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fbc2e36-9c88-49da-84ed-85d23f60210b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f2ba2e8375b4e8c8792ee1e22b60427', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '00a5583c7b7443e98e7a1d31a0b638dc', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=71939) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 24 16:37:08.421497 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fbc2e36-9c88-49da-84ed-85d23f60210b admin admin] REQUEST_METHOD: `GET` {{(pid=71939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 24 16:37:08.421834 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fbc2e36-9c88-49da-84ed-85d23f60210b admin admin] SCRIPT_NAME: `/identity` {{(pid=71939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 24 16:37:08.422198 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fbc2e36-9c88-49da-84ed-85d23f60210b admin admin] PATH_INFO: `/v3/projects/service` {{(pid=71939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 24 16:37:08.431635 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fbc2e36-9c88-49da-84ed-85d23f60210b admin admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=71939) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:442}} Nov 24 16:37:08.460949 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fbc2e36-9c88-49da-84ed-85d23f60210b admin admin] RBAC: Authorization granted {{(pid=71939) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 24 16:37:08.476768 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: WARNING keystone.server.flask.application [None req-2fbc2e36-9c88-49da-84ed-85d23f60210b admin admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Nov 24 16:37:08.477948 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: [pid: 71939|app: 0|req: 664/1328] 10.222.0.53 () {56 vars in 1123 bytes} [Wed Nov 24 16:37:08 2021] GET /identity/v3/projects/service => generated 88 bytes in 73 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 24 16:37:08.484415 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2fc395d-3042-48b2-945b-3ed7a52c8769 admin admin] Authenticating user token {{(pid=71938) process_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 24 16:37:08.494504 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2fc395d-3042-48b2-945b-3ed7a52c8769 admin admin] Validating token access rules against request {{(pid=71938) validate_allowed_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 24 16:37:08.498874 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4aea5bd-af2e-4722-a824-977983c51aab admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f2ba2e8375b4e8c8792ee1e22b60427', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '00a5583c7b7443e98e7a1d31a0b638dc', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=71938) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 24 16:37:08.499539 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4aea5bd-af2e-4722-a824-977983c51aab admin admin] REQUEST_METHOD: `GET` {{(pid=71938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 24 16:37:08.499882 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4aea5bd-af2e-4722-a824-977983c51aab admin admin] SCRIPT_NAME: `/identity` {{(pid=71938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 24 16:37:08.500262 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4aea5bd-af2e-4722-a824-977983c51aab admin admin] PATH_INFO: `/v3/projects` {{(pid=71938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 24 16:37:08.501114 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4aea5bd-af2e-4722-a824-977983c51aab admin admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=71938) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:161}} Nov 24 16:37:08.501475 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4aea5bd-af2e-4722-a824-977983c51aab admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=71938) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:442}} Nov 24 16:37:08.531104 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4aea5bd-af2e-4722-a824-977983c51aab admin admin] RBAC: Authorization granted {{(pid=71938) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 24 16:37:08.546983 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: [pid: 71938|app: 0|req: 665/1329] 10.222.0.53 () {56 vars in 1160 bytes} [Wed Nov 24 16:37:08 2021] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 63 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 24 16:37:08.553586 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fbc2e36-9c88-49da-84ed-85d23f60210b admin admin] Authenticating user token {{(pid=71939) process_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 24 16:37:08.563510 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fbc2e36-9c88-49da-84ed-85d23f60210b admin admin] Validating token access rules against request {{(pid=71939) validate_allowed_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 24 16:37:08.567848 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5724453-7688-4206-8ae9-2bed7e24476f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f2ba2e8375b4e8c8792ee1e22b60427', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '00a5583c7b7443e98e7a1d31a0b638dc', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=71939) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 24 16:37:08.568493 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5724453-7688-4206-8ae9-2bed7e24476f admin admin] REQUEST_METHOD: `GET` {{(pid=71939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 24 16:37:08.568834 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5724453-7688-4206-8ae9-2bed7e24476f admin admin] SCRIPT_NAME: `/identity` {{(pid=71939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 24 16:37:08.569165 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5724453-7688-4206-8ae9-2bed7e24476f admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=71939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 24 16:37:08.570699 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5724453-7688-4206-8ae9-2bed7e24476f admin admin] RBAC: Adding query filter params (role.id=5611724e350b41e19921b5961a342582, scope.project.id=3b3940d4ae1c4177ae29c02377bb4b0b, user.id=a919320c9e2a48d7ba33453b5929d7ee) {{(pid=71939) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:161}} Nov 24 16:37:08.571059 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5724453-7688-4206-8ae9-2bed7e24476f admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=71939) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:442}} Nov 24 16:37:08.600795 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5724453-7688-4206-8ae9-2bed7e24476f admin admin] RBAC: Authorization granted {{(pid=71939) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 24 16:37:08.606622 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: [pid: 71939|app: 0|req: 665/1330] 10.222.0.53 () {56 vars in 1386 bytes} [Wed Nov 24 16:37:08 2021] GET /identity/v3/role_assignments?user.id=a919320c9e2a48d7ba33453b5929d7ee&scope.project.id=3b3940d4ae1c4177ae29c02377bb4b0b&role.id=5611724e350b41e19921b5961a342582 => generated 259 bytes in 54 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 24 16:37:10.589242 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8962521c-525f-44a1-8f99-4389275c3c09 None None] REQUEST_METHOD: `GET` {{(pid=71938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 24 16:37:10.589734 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8962521c-525f-44a1-8f99-4389275c3c09 None None] SCRIPT_NAME: `/identity` {{(pid=71938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 24 16:37:10.589854 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8962521c-525f-44a1-8f99-4389275c3c09 None None] PATH_INFO: `/` {{(pid=71938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 24 16:37:10.591674 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: [pid: 71938|app: 0|req: 666/1331] 10.222.0.53 () {54 vars in 915 bytes} [Wed Nov 24 16:37:10 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 24 16:37:10.597250 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b04fc51-f940-4baa-8a84-915e18c387ba None None] REQUEST_METHOD: `POST` {{(pid=71939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 24 16:37:10.597604 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b04fc51-f940-4baa-8a84-915e18c387ba None None] SCRIPT_NAME: `/identity` {{(pid=71939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 24 16:37:10.597945 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b04fc51-f940-4baa-8a84-915e18c387ba None None] PATH_INFO: `/v3/auth/tokens` {{(pid=71939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 24 16:37:10.622616 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.auth.core [None req-1b04fc51-f940-4baa-8a84-915e18c387ba None None] MFA Rules not processed for user `0f2ba2e8375b4e8c8792ee1e22b60427`. Rule list: `[]` (Enabled: `True`). {{(pid=71939) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:442}} Nov 24 16:37:10.623825 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.fernet_utils [None req-1b04fc51-f940-4baa-8a84-915e18c387ba None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=71939) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:289}} Nov 24 16:37:10.631074 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: [pid: 71939|app: 0|req: 666/1332] 10.222.0.53 () {58 vars in 1013 bytes} [Wed Nov 24 16:37:10 2021] POST /identity/v3/auth/tokens => generated 3413 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 24 16:37:10.653153 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9575f15-196d-4da3-82d9-44dc0449b4c3 None None] REQUEST_METHOD: `POST` {{(pid=71938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 24 16:37:10.653592 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9575f15-196d-4da3-82d9-44dc0449b4c3 None None] SCRIPT_NAME: `/identity` {{(pid=71938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 24 16:37:10.654003 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9575f15-196d-4da3-82d9-44dc0449b4c3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=71938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 24 16:37:10.676886 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.auth.core [None req-b9575f15-196d-4da3-82d9-44dc0449b4c3 None None] MFA Rules not processed for user `0f2ba2e8375b4e8c8792ee1e22b60427`. Rule list: `[]` (Enabled: `True`). {{(pid=71938) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:442}} Nov 24 16:37:10.678126 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.fernet_utils [None req-b9575f15-196d-4da3-82d9-44dc0449b4c3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=71938) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:289}} Nov 24 16:37:10.685899 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: [pid: 71938|app: 0|req: 667/1333] 10.222.0.53 () {58 vars in 1013 bytes} [Wed Nov 24 16:37:10 2021] POST /identity/v3/auth/tokens => generated 3413 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 24 16:37:10.691738 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b04fc51-f940-4baa-8a84-915e18c387ba None None] Authenticating user token {{(pid=71939) process_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 24 16:37:10.702096 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b04fc51-f940-4baa-8a84-915e18c387ba None None] Validating token access rules against request {{(pid=71939) validate_allowed_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 24 16:37:10.706404 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f42cbb03-426c-4d89-971f-de102519366a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f2ba2e8375b4e8c8792ee1e22b60427', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '00a5583c7b7443e98e7a1d31a0b638dc', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=71939) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 24 16:37:10.707206 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f42cbb03-426c-4d89-971f-de102519366a admin admin] REQUEST_METHOD: `GET` {{(pid=71939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 24 16:37:10.707547 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f42cbb03-426c-4d89-971f-de102519366a admin admin] SCRIPT_NAME: `/identity` {{(pid=71939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 24 16:37:10.707880 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f42cbb03-426c-4d89-971f-de102519366a admin admin] PATH_INFO: `/v3/roles/admin` {{(pid=71939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 24 16:37:10.719499 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f42cbb03-426c-4d89-971f-de102519366a admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=71939) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:401}} Nov 24 16:37:10.727336 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: WARNING keystone.server.flask.application [None req-f42cbb03-426c-4d89-971f-de102519366a admin admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Nov 24 16:37:10.728497 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: [pid: 71939|app: 0|req: 667/1334] 10.222.0.53 () {56 vars in 1108 bytes} [Wed Nov 24 16:37:10 2021] GET /identity/v3/roles/admin => generated 83 bytes in 37 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 24 16:37:10.734987 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9575f15-196d-4da3-82d9-44dc0449b4c3 None None] Authenticating user token {{(pid=71938) process_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 24 16:37:10.745063 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9575f15-196d-4da3-82d9-44dc0449b4c3 None None] Validating token access rules against request {{(pid=71938) validate_allowed_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 24 16:37:10.749437 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58da1018-9387-43a2-bc09-05801e1f9afc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f2ba2e8375b4e8c8792ee1e22b60427', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '00a5583c7b7443e98e7a1d31a0b638dc', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=71938) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 24 16:37:10.750126 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58da1018-9387-43a2-bc09-05801e1f9afc admin admin] REQUEST_METHOD: `GET` {{(pid=71938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 24 16:37:10.750470 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58da1018-9387-43a2-bc09-05801e1f9afc admin admin] SCRIPT_NAME: `/identity` {{(pid=71938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 24 16:37:10.750803 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58da1018-9387-43a2-bc09-05801e1f9afc admin admin] PATH_INFO: `/v3/roles` {{(pid=71938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 24 16:37:10.751612 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58da1018-9387-43a2-bc09-05801e1f9afc admin admin] RBAC: Adding query filter params (name=admin) {{(pid=71938) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:161}} Nov 24 16:37:10.751966 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58da1018-9387-43a2-bc09-05801e1f9afc admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=71938) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:442}} Nov 24 16:37:10.779886 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58da1018-9387-43a2-bc09-05801e1f9afc admin admin] RBAC: Authorization granted {{(pid=71938) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 24 16:37:10.789419 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: [pid: 71938|app: 0|req: 668/1335] 10.222.0.53 () {56 vars in 1111 bytes} [Wed Nov 24 16:37:10 2021] GET /identity/v3/roles?name=admin => generated 339 bytes in 55 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 24 16:37:10.795181 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f42cbb03-426c-4d89-971f-de102519366a admin admin] Authenticating user token {{(pid=71939) process_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 24 16:37:10.805880 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f42cbb03-426c-4d89-971f-de102519366a admin admin] Validating token access rules against request {{(pid=71939) validate_allowed_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 24 16:37:10.810260 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b34602fd-d745-4786-9cf1-1a593c6b9087 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f2ba2e8375b4e8c8792ee1e22b60427', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '00a5583c7b7443e98e7a1d31a0b638dc', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=71939) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 24 16:37:10.811042 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b34602fd-d745-4786-9cf1-1a593c6b9087 admin admin] REQUEST_METHOD: `GET` {{(pid=71939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 24 16:37:10.811381 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b34602fd-d745-4786-9cf1-1a593c6b9087 admin admin] SCRIPT_NAME: `/identity` {{(pid=71939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 24 16:37:10.811711 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b34602fd-d745-4786-9cf1-1a593c6b9087 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=71939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 24 16:37:10.823295 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b34602fd-d745-4786-9cf1-1a593c6b9087 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=71939) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:442}} Nov 24 16:37:10.852124 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b34602fd-d745-4786-9cf1-1a593c6b9087 admin admin] RBAC: Authorization granted {{(pid=71939) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 24 16:37:10.871480 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: WARNING keystone.server.flask.application [None req-b34602fd-d745-4786-9cf1-1a593c6b9087 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Nov 24 16:37:10.872646 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: [pid: 71939|app: 0|req: 668/1336] 10.222.0.53 () {56 vars in 1120 bytes} [Wed Nov 24 16:37:10 2021] GET /identity/v3/domains/Default => generated 87 bytes in 78 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 24 16:37:10.878641 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58da1018-9387-43a2-bc09-05801e1f9afc admin admin] Authenticating user token {{(pid=71938) process_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 24 16:37:10.888402 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58da1018-9387-43a2-bc09-05801e1f9afc admin admin] Validating token access rules against request {{(pid=71938) validate_allowed_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 24 16:37:10.893083 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64d4f2aa-38b0-4b81-ab1a-ea54bebb8b50 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f2ba2e8375b4e8c8792ee1e22b60427', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '00a5583c7b7443e98e7a1d31a0b638dc', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=71938) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 24 16:37:10.893737 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64d4f2aa-38b0-4b81-ab1a-ea54bebb8b50 admin admin] REQUEST_METHOD: `GET` {{(pid=71938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 24 16:37:10.894105 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64d4f2aa-38b0-4b81-ab1a-ea54bebb8b50 admin admin] SCRIPT_NAME: `/identity` {{(pid=71938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 24 16:37:10.894444 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64d4f2aa-38b0-4b81-ab1a-ea54bebb8b50 admin admin] PATH_INFO: `/v3/domains` {{(pid=71938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 24 16:37:10.895230 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64d4f2aa-38b0-4b81-ab1a-ea54bebb8b50 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=71938) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:161}} Nov 24 16:37:10.895587 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64d4f2aa-38b0-4b81-ab1a-ea54bebb8b50 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=71938) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:442}} Nov 24 16:37:10.923951 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64d4f2aa-38b0-4b81-ab1a-ea54bebb8b50 admin admin] RBAC: Authorization granted {{(pid=71938) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 24 16:37:10.937760 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: [pid: 71938|app: 0|req: 669/1337] 10.222.0.53 () {56 vars in 1121 bytes} [Wed Nov 24 16:37:10 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 60 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 24 16:37:10.943610 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b34602fd-d745-4786-9cf1-1a593c6b9087 admin admin] Authenticating user token {{(pid=71939) process_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 24 16:37:10.953622 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b34602fd-d745-4786-9cf1-1a593c6b9087 admin admin] Validating token access rules against request {{(pid=71939) validate_allowed_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 24 16:37:10.957989 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3ca2c09-179c-4dc2-955f-8db945eda7e6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f2ba2e8375b4e8c8792ee1e22b60427', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '00a5583c7b7443e98e7a1d31a0b638dc', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=71939) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 24 16:37:10.958834 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3ca2c09-179c-4dc2-955f-8db945eda7e6 admin admin] REQUEST_METHOD: `GET` {{(pid=71939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 24 16:37:10.959172 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3ca2c09-179c-4dc2-955f-8db945eda7e6 admin admin] SCRIPT_NAME: `/identity` {{(pid=71939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 24 16:37:10.959505 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3ca2c09-179c-4dc2-955f-8db945eda7e6 admin admin] PATH_INFO: `/v3/users/placement` {{(pid=71939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 24 16:37:10.974988 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3ca2c09-179c-4dc2-955f-8db945eda7e6 admin admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=71939) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:442}} Nov 24 16:37:11.004150 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3ca2c09-179c-4dc2-955f-8db945eda7e6 admin admin] RBAC: Authorization granted {{(pid=71939) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 24 16:37:11.023625 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: WARNING keystone.server.flask.application [None req-d3ca2c09-179c-4dc2-955f-8db945eda7e6 admin admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Nov 24 16:37:11.024788 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: [pid: 71939|app: 0|req: 669/1338] 10.222.0.53 () {56 vars in 1120 bytes} [Wed Nov 24 16:37:10 2021] GET /identity/v3/users/placement => generated 87 bytes in 82 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 24 16:37:11.031010 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64d4f2aa-38b0-4b81-ab1a-ea54bebb8b50 admin admin] Authenticating user token {{(pid=71938) process_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 24 16:37:11.041434 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64d4f2aa-38b0-4b81-ab1a-ea54bebb8b50 admin admin] Validating token access rules against request {{(pid=71938) validate_allowed_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 24 16:37:11.045807 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf45bd5a-4d79-45f3-8d62-43c510c9f4bf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f2ba2e8375b4e8c8792ee1e22b60427', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '00a5583c7b7443e98e7a1d31a0b638dc', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=71938) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 24 16:37:11.046499 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf45bd5a-4d79-45f3-8d62-43c510c9f4bf admin admin] REQUEST_METHOD: `GET` {{(pid=71938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 24 16:37:11.046841 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf45bd5a-4d79-45f3-8d62-43c510c9f4bf admin admin] SCRIPT_NAME: `/identity` {{(pid=71938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 24 16:37:11.047173 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf45bd5a-4d79-45f3-8d62-43c510c9f4bf admin admin] PATH_INFO: `/v3/users` {{(pid=71938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 24 16:37:11.048085 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf45bd5a-4d79-45f3-8d62-43c510c9f4bf admin admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=71938) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:161}} Nov 24 16:37:11.048444 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf45bd5a-4d79-45f3-8d62-43c510c9f4bf admin admin] RBAC: Authorizing `identity:list_users()` {{(pid=71938) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:442}} Nov 24 16:37:11.077678 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf45bd5a-4d79-45f3-8d62-43c510c9f4bf admin admin] RBAC: Authorization granted {{(pid=71938) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 24 16:37:11.113475 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: [pid: 71938|app: 0|req: 670/1339] 10.222.0.53 () {56 vars in 1155 bytes} [Wed Nov 24 16:37:11 2021] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 83 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 24 16:37:11.120296 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3ca2c09-179c-4dc2-955f-8db945eda7e6 admin admin] Authenticating user token {{(pid=71939) process_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 24 16:37:11.130342 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3ca2c09-179c-4dc2-955f-8db945eda7e6 admin admin] Validating token access rules against request {{(pid=71939) validate_allowed_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 24 16:37:11.134841 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d90ad306-eeb6-4b82-b442-a5a7186495a4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f2ba2e8375b4e8c8792ee1e22b60427', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '00a5583c7b7443e98e7a1d31a0b638dc', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=71939) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 24 16:37:11.135641 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d90ad306-eeb6-4b82-b442-a5a7186495a4 admin admin] REQUEST_METHOD: `GET` {{(pid=71939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 24 16:37:11.135979 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d90ad306-eeb6-4b82-b442-a5a7186495a4 admin admin] SCRIPT_NAME: `/identity` {{(pid=71939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 24 16:37:11.136310 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d90ad306-eeb6-4b82-b442-a5a7186495a4 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=71939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 24 16:37:11.149371 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d90ad306-eeb6-4b82-b442-a5a7186495a4 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=71939) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:442}} Nov 24 16:37:11.178375 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d90ad306-eeb6-4b82-b442-a5a7186495a4 admin admin] RBAC: Authorization granted {{(pid=71939) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 24 16:37:11.197180 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: WARNING keystone.server.flask.application [None req-d90ad306-eeb6-4b82-b442-a5a7186495a4 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Nov 24 16:37:11.198533 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: [pid: 71939|app: 0|req: 670/1340] 10.222.0.53 () {56 vars in 1120 bytes} [Wed Nov 24 16:37:11 2021] GET /identity/v3/domains/Default => generated 87 bytes in 79 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 24 16:37:11.204983 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf45bd5a-4d79-45f3-8d62-43c510c9f4bf admin admin] Authenticating user token {{(pid=71938) process_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 24 16:37:11.216268 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf45bd5a-4d79-45f3-8d62-43c510c9f4bf admin admin] Validating token access rules against request {{(pid=71938) validate_allowed_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 24 16:37:11.220631 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-281c83ca-a2d4-4609-b2f1-f3eefcadaa45 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f2ba2e8375b4e8c8792ee1e22b60427', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '00a5583c7b7443e98e7a1d31a0b638dc', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=71938) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 24 16:37:11.221296 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-281c83ca-a2d4-4609-b2f1-f3eefcadaa45 admin admin] REQUEST_METHOD: `GET` {{(pid=71938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 24 16:37:11.221703 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-281c83ca-a2d4-4609-b2f1-f3eefcadaa45 admin admin] SCRIPT_NAME: `/identity` {{(pid=71938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 24 16:37:11.222119 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-281c83ca-a2d4-4609-b2f1-f3eefcadaa45 admin admin] PATH_INFO: `/v3/domains` {{(pid=71938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 24 16:37:11.222960 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-281c83ca-a2d4-4609-b2f1-f3eefcadaa45 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=71938) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:161}} Nov 24 16:37:11.223422 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-281c83ca-a2d4-4609-b2f1-f3eefcadaa45 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=71938) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:442}} Nov 24 16:37:11.252746 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-281c83ca-a2d4-4609-b2f1-f3eefcadaa45 admin admin] RBAC: Authorization granted {{(pid=71938) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 24 16:37:11.265495 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: [pid: 71938|app: 0|req: 671/1341] 10.222.0.53 () {56 vars in 1121 bytes} [Wed Nov 24 16:37:11 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 61 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 24 16:37:11.271681 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d90ad306-eeb6-4b82-b442-a5a7186495a4 admin admin] Authenticating user token {{(pid=71939) process_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 24 16:37:11.282052 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d90ad306-eeb6-4b82-b442-a5a7186495a4 admin admin] Validating token access rules against request {{(pid=71939) validate_allowed_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 24 16:37:11.286420 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ac9ca5b-f828-4cd6-b50e-2abc5838bb70 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f2ba2e8375b4e8c8792ee1e22b60427', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '00a5583c7b7443e98e7a1d31a0b638dc', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=71939) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 24 16:37:11.287219 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ac9ca5b-f828-4cd6-b50e-2abc5838bb70 admin admin] REQUEST_METHOD: `GET` {{(pid=71939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 24 16:37:11.287558 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ac9ca5b-f828-4cd6-b50e-2abc5838bb70 admin admin] SCRIPT_NAME: `/identity` {{(pid=71939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 24 16:37:11.287888 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ac9ca5b-f828-4cd6-b50e-2abc5838bb70 admin admin] PATH_INFO: `/v3/projects/service` {{(pid=71939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 24 16:37:11.297651 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ac9ca5b-f828-4cd6-b50e-2abc5838bb70 admin admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=71939) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:442}} Nov 24 16:37:11.325747 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ac9ca5b-f828-4cd6-b50e-2abc5838bb70 admin admin] RBAC: Authorization granted {{(pid=71939) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 24 16:37:11.341476 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: WARNING keystone.server.flask.application [None req-8ac9ca5b-f828-4cd6-b50e-2abc5838bb70 admin admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Nov 24 16:37:11.342650 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: [pid: 71939|app: 0|req: 671/1342] 10.222.0.53 () {56 vars in 1123 bytes} [Wed Nov 24 16:37:11 2021] GET /identity/v3/projects/service => generated 88 bytes in 71 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 24 16:37:11.348715 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-281c83ca-a2d4-4609-b2f1-f3eefcadaa45 admin admin] Authenticating user token {{(pid=71938) process_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 24 16:37:11.358982 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-281c83ca-a2d4-4609-b2f1-f3eefcadaa45 admin admin] Validating token access rules against request {{(pid=71938) validate_allowed_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 24 16:37:11.363301 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-baf394ae-2066-423f-b33c-3f519a53f014 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f2ba2e8375b4e8c8792ee1e22b60427', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '00a5583c7b7443e98e7a1d31a0b638dc', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=71938) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 24 16:37:11.363997 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baf394ae-2066-423f-b33c-3f519a53f014 admin admin] REQUEST_METHOD: `GET` {{(pid=71938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 24 16:37:11.364290 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baf394ae-2066-423f-b33c-3f519a53f014 admin admin] SCRIPT_NAME: `/identity` {{(pid=71938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 24 16:37:11.364618 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baf394ae-2066-423f-b33c-3f519a53f014 admin admin] PATH_INFO: `/v3/projects` {{(pid=71938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 24 16:37:11.365454 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-baf394ae-2066-423f-b33c-3f519a53f014 admin admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=71938) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:161}} Nov 24 16:37:11.365807 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-baf394ae-2066-423f-b33c-3f519a53f014 admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=71938) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:442}} Nov 24 16:37:11.394479 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-baf394ae-2066-423f-b33c-3f519a53f014 admin admin] RBAC: Authorization granted {{(pid=71938) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 24 16:37:11.409012 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: [pid: 71938|app: 0|req: 672/1343] 10.222.0.53 () {56 vars in 1160 bytes} [Wed Nov 24 16:37:11 2021] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 61 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 24 16:37:11.416161 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ac9ca5b-f828-4cd6-b50e-2abc5838bb70 admin admin] Authenticating user token {{(pid=71939) process_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 24 16:37:11.426107 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ac9ca5b-f828-4cd6-b50e-2abc5838bb70 admin admin] Validating token access rules against request {{(pid=71939) validate_allowed_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 24 16:37:11.430610 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fba2aff-8d8e-40dd-b767-f9cd2885227c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f2ba2e8375b4e8c8792ee1e22b60427', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '00a5583c7b7443e98e7a1d31a0b638dc', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=71939) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 24 16:37:11.431504 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fba2aff-8d8e-40dd-b767-f9cd2885227c admin admin] REQUEST_METHOD: `PUT` {{(pid=71939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 24 16:37:11.431841 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fba2aff-8d8e-40dd-b767-f9cd2885227c admin admin] SCRIPT_NAME: `/identity` {{(pid=71939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 24 16:37:11.432172 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fba2aff-8d8e-40dd-b767-f9cd2885227c admin admin] PATH_INFO: `/v3/projects/3b3940d4ae1c4177ae29c02377bb4b0b/users/a919320c9e2a48d7ba33453b5929d7ee/roles/5611724e350b41e19921b5961a342582` {{(pid=71939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 24 16:37:11.434151 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fba2aff-8d8e-40dd-b767-f9cd2885227c admin admin] RBAC: Authorizing `identity:create_grant(project_id=3b3940d4ae1c4177ae29c02377bb4b0b, user_id=a919320c9e2a48d7ba33453b5929d7ee, role_id=5611724e350b41e19921b5961a342582)` {{(pid=71939) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:442}} Nov 24 16:37:11.463904 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fba2aff-8d8e-40dd-b767-f9cd2885227c admin admin] RBAC: Authorization granted {{(pid=71939) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 24 16:37:11.475570 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: [pid: 71939|app: 0|req: 672/1344] 10.222.0.53 () {58 vars in 1451 bytes} [Wed Nov 24 16:37:11 2021] PUT /identity/v3/projects/3b3940d4ae1c4177ae29c02377bb4b0b/users/a919320c9e2a48d7ba33453b5929d7ee/roles/5611724e350b41e19921b5961a342582 => generated 0 bytes in 60 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 24 16:37:13.455507 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6117ed6f-08e2-41d3-a9f6-2b9c412b6404 None None] REQUEST_METHOD: `GET` {{(pid=71938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 24 16:37:13.456046 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6117ed6f-08e2-41d3-a9f6-2b9c412b6404 None None] SCRIPT_NAME: `/identity` {{(pid=71938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 24 16:37:13.456173 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6117ed6f-08e2-41d3-a9f6-2b9c412b6404 None None] PATH_INFO: `/` {{(pid=71938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 24 16:37:13.457981 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: [pid: 71938|app: 0|req: 673/1345] 10.222.0.53 () {54 vars in 915 bytes} [Wed Nov 24 16:37:13 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 24 16:37:13.463882 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c9ace68-9f5a-4277-a06f-c10c3b0f4bd7 None None] REQUEST_METHOD: `POST` {{(pid=71939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 24 16:37:13.464184 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c9ace68-9f5a-4277-a06f-c10c3b0f4bd7 None None] SCRIPT_NAME: `/identity` {{(pid=71939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 24 16:37:13.464524 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c9ace68-9f5a-4277-a06f-c10c3b0f4bd7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=71939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 24 16:37:13.487893 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.auth.core [None req-4c9ace68-9f5a-4277-a06f-c10c3b0f4bd7 None None] MFA Rules not processed for user `0f2ba2e8375b4e8c8792ee1e22b60427`. Rule list: `[]` (Enabled: `True`). {{(pid=71939) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:442}} Nov 24 16:37:13.489112 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.fernet_utils [None req-4c9ace68-9f5a-4277-a06f-c10c3b0f4bd7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=71939) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:289}} Nov 24 16:37:13.557290 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: [pid: 71939|app: 0|req: 673/1346] 10.222.0.53 () {58 vars in 1013 bytes} [Wed Nov 24 16:37:13 2021] POST /identity/v3/auth/tokens => generated 3413 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 24 16:37:13.580524 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8fa671c-b21b-4aab-a272-2d609d6b3559 None None] REQUEST_METHOD: `POST` {{(pid=71938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 24 16:37:13.580872 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8fa671c-b21b-4aab-a272-2d609d6b3559 None None] SCRIPT_NAME: `/identity` {{(pid=71938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 24 16:37:13.581212 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8fa671c-b21b-4aab-a272-2d609d6b3559 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=71938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 24 16:37:13.604209 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.auth.core [None req-d8fa671c-b21b-4aab-a272-2d609d6b3559 None None] MFA Rules not processed for user `0f2ba2e8375b4e8c8792ee1e22b60427`. Rule list: `[]` (Enabled: `True`). {{(pid=71938) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:442}} Nov 24 16:37:13.605430 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.fernet_utils [None req-d8fa671c-b21b-4aab-a272-2d609d6b3559 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=71938) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:289}} Nov 24 16:37:13.612697 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: [pid: 71938|app: 0|req: 674/1347] 10.222.0.53 () {58 vars in 1013 bytes} [Wed Nov 24 16:37:13 2021] POST /identity/v3/auth/tokens => generated 3413 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 24 16:37:13.619312 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c9ace68-9f5a-4277-a06f-c10c3b0f4bd7 None None] Authenticating user token {{(pid=71939) process_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 24 16:37:13.629004 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c9ace68-9f5a-4277-a06f-c10c3b0f4bd7 None None] Validating token access rules against request {{(pid=71939) validate_allowed_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 24 16:37:13.633954 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd486920-9b7e-4c93-bae3-c3cf2e7302a2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f2ba2e8375b4e8c8792ee1e22b60427', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '00a5583c7b7443e98e7a1d31a0b638dc', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=71939) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 24 16:37:13.634803 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd486920-9b7e-4c93-bae3-c3cf2e7302a2 admin admin] REQUEST_METHOD: `GET` {{(pid=71939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 24 16:37:13.635144 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd486920-9b7e-4c93-bae3-c3cf2e7302a2 admin admin] SCRIPT_NAME: `/identity` {{(pid=71939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 24 16:37:13.635474 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd486920-9b7e-4c93-bae3-c3cf2e7302a2 admin admin] PATH_INFO: `/v3/roles/admin` {{(pid=71939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 24 16:37:13.647229 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd486920-9b7e-4c93-bae3-c3cf2e7302a2 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=71939) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:401}} Nov 24 16:37:13.654617 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: WARNING keystone.server.flask.application [None req-cd486920-9b7e-4c93-bae3-c3cf2e7302a2 admin admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Nov 24 16:37:13.655777 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: [pid: 71939|app: 0|req: 674/1348] 10.222.0.53 () {56 vars in 1108 bytes} [Wed Nov 24 16:37:13 2021] GET /identity/v3/roles/admin => generated 83 bytes in 37 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 24 16:37:13.662466 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8fa671c-b21b-4aab-a272-2d609d6b3559 None None] Authenticating user token {{(pid=71938) process_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 24 16:37:13.671492 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8fa671c-b21b-4aab-a272-2d609d6b3559 None None] Validating token access rules against request {{(pid=71938) validate_allowed_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 24 16:37:13.676004 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77113e63-efb1-48f4-bafb-061e7865e17c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f2ba2e8375b4e8c8792ee1e22b60427', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '00a5583c7b7443e98e7a1d31a0b638dc', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=71938) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 24 16:37:13.676671 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77113e63-efb1-48f4-bafb-061e7865e17c admin admin] REQUEST_METHOD: `GET` {{(pid=71938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 24 16:37:13.677014 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77113e63-efb1-48f4-bafb-061e7865e17c admin admin] SCRIPT_NAME: `/identity` {{(pid=71938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 24 16:37:13.677350 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77113e63-efb1-48f4-bafb-061e7865e17c admin admin] PATH_INFO: `/v3/roles` {{(pid=71938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 24 16:37:13.678186 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77113e63-efb1-48f4-bafb-061e7865e17c admin admin] RBAC: Adding query filter params (name=admin) {{(pid=71938) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:161}} Nov 24 16:37:13.678544 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77113e63-efb1-48f4-bafb-061e7865e17c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=71938) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:442}} Nov 24 16:37:13.708012 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77113e63-efb1-48f4-bafb-061e7865e17c admin admin] RBAC: Authorization granted {{(pid=71938) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 24 16:37:13.717097 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: [pid: 71938|app: 0|req: 675/1349] 10.222.0.53 () {56 vars in 1111 bytes} [Wed Nov 24 16:37:13 2021] GET /identity/v3/roles?name=admin => generated 339 bytes in 55 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 24 16:37:13.722974 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd486920-9b7e-4c93-bae3-c3cf2e7302a2 admin admin] Authenticating user token {{(pid=71939) process_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 24 16:37:13.733588 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd486920-9b7e-4c93-bae3-c3cf2e7302a2 admin admin] Validating token access rules against request {{(pid=71939) validate_allowed_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 24 16:37:13.738264 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edf499f1-df74-4744-a9d0-2e0b38285356 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f2ba2e8375b4e8c8792ee1e22b60427', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '00a5583c7b7443e98e7a1d31a0b638dc', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=71939) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 24 16:37:13.739432 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edf499f1-df74-4744-a9d0-2e0b38285356 admin admin] REQUEST_METHOD: `GET` {{(pid=71939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 24 16:37:13.739432 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edf499f1-df74-4744-a9d0-2e0b38285356 admin admin] SCRIPT_NAME: `/identity` {{(pid=71939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 24 16:37:13.739698 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edf499f1-df74-4744-a9d0-2e0b38285356 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=71939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 24 16:37:13.752062 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edf499f1-df74-4744-a9d0-2e0b38285356 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=71939) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:442}} Nov 24 16:37:13.780155 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edf499f1-df74-4744-a9d0-2e0b38285356 admin admin] RBAC: Authorization granted {{(pid=71939) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 24 16:37:13.799466 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: WARNING keystone.server.flask.application [None req-edf499f1-df74-4744-a9d0-2e0b38285356 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Nov 24 16:37:13.800648 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: [pid: 71939|app: 0|req: 675/1350] 10.222.0.53 () {56 vars in 1120 bytes} [Wed Nov 24 16:37:13 2021] GET /identity/v3/domains/Default => generated 87 bytes in 78 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 24 16:37:13.807462 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77113e63-efb1-48f4-bafb-061e7865e17c admin admin] Authenticating user token {{(pid=71938) process_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 24 16:37:13.817300 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77113e63-efb1-48f4-bafb-061e7865e17c admin admin] Validating token access rules against request {{(pid=71938) validate_allowed_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 24 16:37:13.821826 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb0ec848-ea7c-4d0d-9ae3-1bbd73431e7f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f2ba2e8375b4e8c8792ee1e22b60427', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '00a5583c7b7443e98e7a1d31a0b638dc', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=71938) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 24 16:37:13.822520 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb0ec848-ea7c-4d0d-9ae3-1bbd73431e7f admin admin] REQUEST_METHOD: `GET` {{(pid=71938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 24 16:37:13.822860 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb0ec848-ea7c-4d0d-9ae3-1bbd73431e7f admin admin] SCRIPT_NAME: `/identity` {{(pid=71938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 24 16:37:13.823193 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb0ec848-ea7c-4d0d-9ae3-1bbd73431e7f admin admin] PATH_INFO: `/v3/domains` {{(pid=71938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 24 16:37:13.823970 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb0ec848-ea7c-4d0d-9ae3-1bbd73431e7f admin admin] RBAC: Adding query filter params (name=Default) {{(pid=71938) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:161}} Nov 24 16:37:13.824575 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb0ec848-ea7c-4d0d-9ae3-1bbd73431e7f admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=71938) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:442}} Nov 24 16:37:13.853362 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb0ec848-ea7c-4d0d-9ae3-1bbd73431e7f admin admin] RBAC: Authorization granted {{(pid=71938) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 24 16:37:13.867316 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: [pid: 71938|app: 0|req: 676/1351] 10.222.0.53 () {56 vars in 1121 bytes} [Wed Nov 24 16:37:13 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 60 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 24 16:37:13.873133 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edf499f1-df74-4744-a9d0-2e0b38285356 admin admin] Authenticating user token {{(pid=71939) process_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 24 16:37:13.882851 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edf499f1-df74-4744-a9d0-2e0b38285356 admin admin] Validating token access rules against request {{(pid=71939) validate_allowed_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 24 16:37:13.887181 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc886455-a181-461a-9ba3-889006c51bd8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f2ba2e8375b4e8c8792ee1e22b60427', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '00a5583c7b7443e98e7a1d31a0b638dc', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=71939) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 24 16:37:13.887976 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc886455-a181-461a-9ba3-889006c51bd8 admin admin] REQUEST_METHOD: `GET` {{(pid=71939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 24 16:37:13.888311 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc886455-a181-461a-9ba3-889006c51bd8 admin admin] SCRIPT_NAME: `/identity` {{(pid=71939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 24 16:37:13.888639 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc886455-a181-461a-9ba3-889006c51bd8 admin admin] PATH_INFO: `/v3/users/placement` {{(pid=71939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 24 16:37:13.901762 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc886455-a181-461a-9ba3-889006c51bd8 admin admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=71939) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:442}} Nov 24 16:37:13.931159 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc886455-a181-461a-9ba3-889006c51bd8 admin admin] RBAC: Authorization granted {{(pid=71939) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 24 16:37:13.951073 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: WARNING keystone.server.flask.application [None req-cc886455-a181-461a-9ba3-889006c51bd8 admin admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Nov 24 16:37:13.952232 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: [pid: 71939|app: 0|req: 676/1352] 10.222.0.53 () {56 vars in 1120 bytes} [Wed Nov 24 16:37:13 2021] GET /identity/v3/users/placement => generated 87 bytes in 80 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 24 16:37:13.958557 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb0ec848-ea7c-4d0d-9ae3-1bbd73431e7f admin admin] Authenticating user token {{(pid=71938) process_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 24 16:37:13.968428 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb0ec848-ea7c-4d0d-9ae3-1bbd73431e7f admin admin] Validating token access rules against request {{(pid=71938) validate_allowed_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 24 16:37:13.972776 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e02416ef-f554-4d4e-9f52-a65c7c57773d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f2ba2e8375b4e8c8792ee1e22b60427', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '00a5583c7b7443e98e7a1d31a0b638dc', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=71938) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 24 16:37:13.973442 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e02416ef-f554-4d4e-9f52-a65c7c57773d admin admin] REQUEST_METHOD: `GET` {{(pid=71938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 24 16:37:13.973779 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e02416ef-f554-4d4e-9f52-a65c7c57773d admin admin] SCRIPT_NAME: `/identity` {{(pid=71938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 24 16:37:13.974150 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e02416ef-f554-4d4e-9f52-a65c7c57773d admin admin] PATH_INFO: `/v3/users` {{(pid=71938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 24 16:37:13.975046 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e02416ef-f554-4d4e-9f52-a65c7c57773d admin admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=71938) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:161}} Nov 24 16:37:13.975401 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e02416ef-f554-4d4e-9f52-a65c7c57773d admin admin] RBAC: Authorizing `identity:list_users()` {{(pid=71938) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:442}} Nov 24 16:37:14.004840 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e02416ef-f554-4d4e-9f52-a65c7c57773d admin admin] RBAC: Authorization granted {{(pid=71938) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 24 16:37:14.035250 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: [pid: 71938|app: 0|req: 677/1353] 10.222.0.53 () {56 vars in 1155 bytes} [Wed Nov 24 16:37:13 2021] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 77 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 24 16:37:14.041908 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc886455-a181-461a-9ba3-889006c51bd8 admin admin] Authenticating user token {{(pid=71939) process_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 24 16:37:14.051637 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc886455-a181-461a-9ba3-889006c51bd8 admin admin] Validating token access rules against request {{(pid=71939) validate_allowed_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 24 16:37:14.056505 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-241b4a35-c03f-47c7-8e75-1c34d218c833 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f2ba2e8375b4e8c8792ee1e22b60427', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '00a5583c7b7443e98e7a1d31a0b638dc', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=71939) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 24 16:37:14.057145 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-241b4a35-c03f-47c7-8e75-1c34d218c833 admin admin] REQUEST_METHOD: `GET` {{(pid=71939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 24 16:37:14.057505 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-241b4a35-c03f-47c7-8e75-1c34d218c833 admin admin] SCRIPT_NAME: `/identity` {{(pid=71939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 24 16:37:14.057834 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-241b4a35-c03f-47c7-8e75-1c34d218c833 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=71939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 24 16:37:14.066687 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-241b4a35-c03f-47c7-8e75-1c34d218c833 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=71939) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:442}} Nov 24 16:37:14.094808 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-241b4a35-c03f-47c7-8e75-1c34d218c833 admin admin] RBAC: Authorization granted {{(pid=71939) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 24 16:37:14.104212 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: [pid: 71939|app: 0|req: 677/1354] 10.222.0.53 () {58 vars in 1315 bytes} [Wed Nov 24 16:37:14 2021] GET /identity/v3/auth/tokens => generated 3413 bytes in 63 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 24 16:37:14.110441 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e02416ef-f554-4d4e-9f52-a65c7c57773d admin admin] Authenticating user token {{(pid=71938) process_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 24 16:37:14.120766 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e02416ef-f554-4d4e-9f52-a65c7c57773d admin admin] Validating token access rules against request {{(pid=71938) validate_allowed_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 24 16:37:14.125133 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-269c49ae-f542-4428-8605-9d91e5a33585 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f2ba2e8375b4e8c8792ee1e22b60427', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '00a5583c7b7443e98e7a1d31a0b638dc', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=71938) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 24 16:37:14.125939 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-269c49ae-f542-4428-8605-9d91e5a33585 admin admin] REQUEST_METHOD: `GET` {{(pid=71938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 24 16:37:14.126305 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-269c49ae-f542-4428-8605-9d91e5a33585 admin admin] SCRIPT_NAME: `/identity` {{(pid=71938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 24 16:37:14.126666 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-269c49ae-f542-4428-8605-9d91e5a33585 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=71938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 24 16:37:14.138629 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-269c49ae-f542-4428-8605-9d91e5a33585 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=71938) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:442}} Nov 24 16:37:14.167842 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-269c49ae-f542-4428-8605-9d91e5a33585 admin admin] RBAC: Authorization granted {{(pid=71938) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 24 16:37:14.186386 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: WARNING keystone.server.flask.application [None req-269c49ae-f542-4428-8605-9d91e5a33585 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Nov 24 16:37:14.187714 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: [pid: 71938|app: 0|req: 678/1355] 10.222.0.53 () {56 vars in 1120 bytes} [Wed Nov 24 16:37:14 2021] GET /identity/v3/domains/Default => generated 87 bytes in 78 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 24 16:37:14.193941 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-241b4a35-c03f-47c7-8e75-1c34d218c833 admin admin] Authenticating user token {{(pid=71939) process_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 24 16:37:14.203517 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-241b4a35-c03f-47c7-8e75-1c34d218c833 admin admin] Validating token access rules against request {{(pid=71939) validate_allowed_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 24 16:37:14.207976 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9913bb1-2546-4f47-bf10-e3d091f47f3a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f2ba2e8375b4e8c8792ee1e22b60427', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '00a5583c7b7443e98e7a1d31a0b638dc', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=71939) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 24 16:37:14.208640 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9913bb1-2546-4f47-bf10-e3d091f47f3a admin admin] REQUEST_METHOD: `GET` {{(pid=71939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 24 16:37:14.208984 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9913bb1-2546-4f47-bf10-e3d091f47f3a admin admin] SCRIPT_NAME: `/identity` {{(pid=71939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 24 16:37:14.209328 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9913bb1-2546-4f47-bf10-e3d091f47f3a admin admin] PATH_INFO: `/v3/domains` {{(pid=71939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 24 16:37:14.210667 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9913bb1-2546-4f47-bf10-e3d091f47f3a admin admin] RBAC: Adding query filter params (name=Default) {{(pid=71939) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:161}} Nov 24 16:37:14.211023 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9913bb1-2546-4f47-bf10-e3d091f47f3a admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=71939) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:442}} Nov 24 16:37:14.239475 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9913bb1-2546-4f47-bf10-e3d091f47f3a admin admin] RBAC: Authorization granted {{(pid=71939) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 24 16:37:14.252191 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: [pid: 71939|app: 0|req: 678/1356] 10.222.0.53 () {56 vars in 1121 bytes} [Wed Nov 24 16:37:14 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 59 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 24 16:37:14.258373 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-269c49ae-f542-4428-8605-9d91e5a33585 admin admin] Authenticating user token {{(pid=71938) process_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 24 16:37:14.268320 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-269c49ae-f542-4428-8605-9d91e5a33585 admin admin] Validating token access rules against request {{(pid=71938) validate_allowed_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 24 16:37:14.273376 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-652e9fdb-a9db-4f66-834e-50aa2d175c09 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f2ba2e8375b4e8c8792ee1e22b60427', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '00a5583c7b7443e98e7a1d31a0b638dc', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=71938) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 24 16:37:14.274242 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-652e9fdb-a9db-4f66-834e-50aa2d175c09 admin admin] REQUEST_METHOD: `GET` {{(pid=71938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 24 16:37:14.274560 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-652e9fdb-a9db-4f66-834e-50aa2d175c09 admin admin] SCRIPT_NAME: `/identity` {{(pid=71938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 24 16:37:14.274893 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-652e9fdb-a9db-4f66-834e-50aa2d175c09 admin admin] PATH_INFO: `/v3/projects/service` {{(pid=71938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 24 16:37:14.284448 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-652e9fdb-a9db-4f66-834e-50aa2d175c09 admin admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=71938) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:442}} Nov 24 16:37:14.313976 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-652e9fdb-a9db-4f66-834e-50aa2d175c09 admin admin] RBAC: Authorization granted {{(pid=71938) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 24 16:37:14.330284 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: WARNING keystone.server.flask.application [None req-652e9fdb-a9db-4f66-834e-50aa2d175c09 admin admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Nov 24 16:37:14.331481 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: [pid: 71938|app: 0|req: 679/1357] 10.222.0.53 () {56 vars in 1123 bytes} [Wed Nov 24 16:37:14 2021] GET /identity/v3/projects/service => generated 88 bytes in 74 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 24 16:37:14.337886 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9913bb1-2546-4f47-bf10-e3d091f47f3a admin admin] Authenticating user token {{(pid=71939) process_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 24 16:37:14.347723 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9913bb1-2546-4f47-bf10-e3d091f47f3a admin admin] Validating token access rules against request {{(pid=71939) validate_allowed_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 24 16:37:14.352162 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52ae1193-c940-4fd0-9447-af2794dd7df6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f2ba2e8375b4e8c8792ee1e22b60427', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '00a5583c7b7443e98e7a1d31a0b638dc', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=71939) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 24 16:37:14.352814 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52ae1193-c940-4fd0-9447-af2794dd7df6 admin admin] REQUEST_METHOD: `GET` {{(pid=71939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 24 16:37:14.353147 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52ae1193-c940-4fd0-9447-af2794dd7df6 admin admin] SCRIPT_NAME: `/identity` {{(pid=71939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 24 16:37:14.353512 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52ae1193-c940-4fd0-9447-af2794dd7df6 admin admin] PATH_INFO: `/v3/projects` {{(pid=71939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 24 16:37:14.354388 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52ae1193-c940-4fd0-9447-af2794dd7df6 admin admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=71939) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:161}} Nov 24 16:37:14.354745 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52ae1193-c940-4fd0-9447-af2794dd7df6 admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=71939) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:442}} Nov 24 16:37:14.384120 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52ae1193-c940-4fd0-9447-af2794dd7df6 admin admin] RBAC: Authorization granted {{(pid=71939) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 24 16:37:14.397716 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: [pid: 71939|app: 0|req: 679/1358] 10.222.0.53 () {56 vars in 1160 bytes} [Wed Nov 24 16:37:14 2021] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 60 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 24 16:37:14.404176 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-652e9fdb-a9db-4f66-834e-50aa2d175c09 admin admin] Authenticating user token {{(pid=71938) process_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 24 16:37:14.414297 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-652e9fdb-a9db-4f66-834e-50aa2d175c09 admin admin] Validating token access rules against request {{(pid=71938) validate_allowed_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 24 16:37:14.418621 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53b91bac-049d-4ec8-84f9-5c9595193370 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f2ba2e8375b4e8c8792ee1e22b60427', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '00a5583c7b7443e98e7a1d31a0b638dc', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=71938) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 24 16:37:14.419272 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53b91bac-049d-4ec8-84f9-5c9595193370 admin admin] REQUEST_METHOD: `GET` {{(pid=71938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 24 16:37:14.419609 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53b91bac-049d-4ec8-84f9-5c9595193370 admin admin] SCRIPT_NAME: `/identity` {{(pid=71938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 24 16:37:14.419940 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53b91bac-049d-4ec8-84f9-5c9595193370 admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=71938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 24 16:37:14.420829 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53b91bac-049d-4ec8-84f9-5c9595193370 admin admin] RBAC: Adding query filter params (role.id=5611724e350b41e19921b5961a342582, scope.project.id=3b3940d4ae1c4177ae29c02377bb4b0b, user.id=a919320c9e2a48d7ba33453b5929d7ee) {{(pid=71938) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:161}} Nov 24 16:37:14.421188 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53b91bac-049d-4ec8-84f9-5c9595193370 admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=71938) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:442}} Nov 24 16:37:14.451728 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53b91bac-049d-4ec8-84f9-5c9595193370 admin admin] RBAC: Authorization granted {{(pid=71938) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 24 16:37:14.458260 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: [pid: 71938|app: 0|req: 680/1359] 10.222.0.53 () {56 vars in 1386 bytes} [Wed Nov 24 16:37:14 2021] GET /identity/v3/role_assignments?user.id=a919320c9e2a48d7ba33453b5929d7ee&scope.project.id=3b3940d4ae1c4177ae29c02377bb4b0b&role.id=5611724e350b41e19921b5961a342582 => generated 608 bytes in 55 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 24 16:37:16.482831 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1c9010c-ec8b-4f87-9755-b7d07129ca92 None None] REQUEST_METHOD: `GET` {{(pid=71939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 24 16:37:16.483341 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1c9010c-ec8b-4f87-9755-b7d07129ca92 None None] SCRIPT_NAME: `/identity` {{(pid=71939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 24 16:37:16.483429 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1c9010c-ec8b-4f87-9755-b7d07129ca92 None None] PATH_INFO: `/` {{(pid=71939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 24 16:37:16.485213 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: [pid: 71939|app: 0|req: 680/1360] 10.222.0.53 () {54 vars in 915 bytes} [Wed Nov 24 16:37:16 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 24 16:37:16.490864 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9acefbcf-ac56-48a3-8bc5-3b47dbd84848 None None] REQUEST_METHOD: `POST` {{(pid=71938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 24 16:37:16.491767 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9acefbcf-ac56-48a3-8bc5-3b47dbd84848 None None] SCRIPT_NAME: `/identity` {{(pid=71938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 24 16:37:16.492102 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9acefbcf-ac56-48a3-8bc5-3b47dbd84848 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=71938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 24 16:37:16.518734 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.auth.core [None req-9acefbcf-ac56-48a3-8bc5-3b47dbd84848 None None] MFA Rules not processed for user `0f2ba2e8375b4e8c8792ee1e22b60427`. Rule list: `[]` (Enabled: `True`). {{(pid=71938) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:442}} Nov 24 16:37:16.519964 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.fernet_utils [None req-9acefbcf-ac56-48a3-8bc5-3b47dbd84848 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=71938) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:289}} Nov 24 16:37:16.527299 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: [pid: 71938|app: 0|req: 681/1361] 10.222.0.53 () {58 vars in 1013 bytes} [Wed Nov 24 16:37:16 2021] POST /identity/v3/auth/tokens => generated 3413 bytes in 37 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 24 16:37:16.549422 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a2fd642-27ff-47d0-9729-f563e20fbb7c None None] REQUEST_METHOD: `POST` {{(pid=71939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 24 16:37:16.549765 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a2fd642-27ff-47d0-9729-f563e20fbb7c None None] SCRIPT_NAME: `/identity` {{(pid=71939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 24 16:37:16.550123 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a2fd642-27ff-47d0-9729-f563e20fbb7c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=71939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 24 16:37:16.574762 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.auth.core [None req-1a2fd642-27ff-47d0-9729-f563e20fbb7c None None] MFA Rules not processed for user `0f2ba2e8375b4e8c8792ee1e22b60427`. Rule list: `[]` (Enabled: `True`). {{(pid=71939) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:442}} Nov 24 16:37:16.575960 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.fernet_utils [None req-1a2fd642-27ff-47d0-9729-f563e20fbb7c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=71939) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:289}} Nov 24 16:37:16.583188 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: [pid: 71939|app: 0|req: 681/1362] 10.222.0.53 () {58 vars in 1013 bytes} [Wed Nov 24 16:37:16 2021] POST /identity/v3/auth/tokens => generated 3413 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 24 16:37:16.589278 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9acefbcf-ac56-48a3-8bc5-3b47dbd84848 None None] Authenticating user token {{(pid=71938) process_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 24 16:37:16.598895 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9acefbcf-ac56-48a3-8bc5-3b47dbd84848 None None] Validating token access rules against request {{(pid=71938) validate_allowed_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 24 16:37:16.603222 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-deacf49b-9307-412a-854a-18334ad8bd5e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f2ba2e8375b4e8c8792ee1e22b60427', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '00a5583c7b7443e98e7a1d31a0b638dc', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=71938) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 24 16:37:16.604034 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-deacf49b-9307-412a-854a-18334ad8bd5e admin admin] REQUEST_METHOD: `GET` {{(pid=71938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 24 16:37:16.604371 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-deacf49b-9307-412a-854a-18334ad8bd5e admin admin] SCRIPT_NAME: `/identity` {{(pid=71938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 24 16:37:16.604703 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-deacf49b-9307-412a-854a-18334ad8bd5e admin admin] PATH_INFO: `/v3/services/placement` {{(pid=71938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 24 16:37:16.605412 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-deacf49b-9307-412a-854a-18334ad8bd5e admin admin] RBAC: Authorizing `identity:get_service(service_id=placement)` {{(pid=71938) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:442}} Nov 24 16:37:16.634620 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-deacf49b-9307-412a-854a-18334ad8bd5e admin admin] RBAC: Authorization granted {{(pid=71938) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 24 16:37:16.646141 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: WARNING keystone.server.flask.application [None req-deacf49b-9307-412a-854a-18334ad8bd5e admin admin] Could not find service: placement.: keystone.exception.ServiceNotFound: Could not find service: placement. Nov 24 16:37:16.647313 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: [pid: 71938|app: 0|req: 682/1363] 10.222.0.53 () {56 vars in 1129 bytes} [Wed Nov 24 16:37:16 2021] GET /identity/v3/services/placement => generated 90 bytes in 59 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 24 16:37:16.654160 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a2fd642-27ff-47d0-9729-f563e20fbb7c None None] Authenticating user token {{(pid=71939) process_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 24 16:37:16.663210 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a2fd642-27ff-47d0-9729-f563e20fbb7c None None] Validating token access rules against request {{(pid=71939) validate_allowed_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 24 16:37:16.667558 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31bb047e-4cd3-4733-a2da-edadaa0a3223 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f2ba2e8375b4e8c8792ee1e22b60427', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '00a5583c7b7443e98e7a1d31a0b638dc', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=71939) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 24 16:37:16.668214 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31bb047e-4cd3-4733-a2da-edadaa0a3223 admin admin] REQUEST_METHOD: `GET` {{(pid=71939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 24 16:37:16.668552 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31bb047e-4cd3-4733-a2da-edadaa0a3223 admin admin] SCRIPT_NAME: `/identity` {{(pid=71939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 24 16:37:16.668879 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31bb047e-4cd3-4733-a2da-edadaa0a3223 admin admin] PATH_INFO: `/v3/services` {{(pid=71939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 24 16:37:16.669642 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31bb047e-4cd3-4733-a2da-edadaa0a3223 admin admin] RBAC: Adding query filter params (name=placement) {{(pid=71939) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:161}} Nov 24 16:37:16.669990 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31bb047e-4cd3-4733-a2da-edadaa0a3223 admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=71939) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:442}} Nov 24 16:37:16.699761 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31bb047e-4cd3-4733-a2da-edadaa0a3223 admin admin] RBAC: Authorization granted {{(pid=71939) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 24 16:37:16.705102 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: [pid: 71939|app: 0|req: 682/1364] 10.222.0.53 () {56 vars in 1128 bytes} [Wed Nov 24 16:37:16 2021] GET /identity/v3/services?name=placement => generated 126 bytes in 51 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 24 16:37:16.711186 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-deacf49b-9307-412a-854a-18334ad8bd5e admin admin] Authenticating user token {{(pid=71938) process_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 24 16:37:16.720949 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-deacf49b-9307-412a-854a-18334ad8bd5e admin admin] Validating token access rules against request {{(pid=71938) validate_allowed_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 24 16:37:16.725339 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-341d18a2-7ff7-44a6-982e-2089b2393e82 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f2ba2e8375b4e8c8792ee1e22b60427', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '00a5583c7b7443e98e7a1d31a0b638dc', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=71938) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 24 16:37:16.726537 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-341d18a2-7ff7-44a6-982e-2089b2393e82 admin admin] REQUEST_METHOD: `GET` {{(pid=71938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 24 16:37:16.726876 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-341d18a2-7ff7-44a6-982e-2089b2393e82 admin admin] SCRIPT_NAME: `/identity` {{(pid=71938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 24 16:37:16.727205 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-341d18a2-7ff7-44a6-982e-2089b2393e82 admin admin] PATH_INFO: `/v3/services` {{(pid=71938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 24 16:37:16.727964 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-341d18a2-7ff7-44a6-982e-2089b2393e82 admin admin] RBAC: Adding query filter params (type=placement) {{(pid=71938) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:161}} Nov 24 16:37:16.728311 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-341d18a2-7ff7-44a6-982e-2089b2393e82 admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=71938) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:442}} Nov 24 16:37:16.756665 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-341d18a2-7ff7-44a6-982e-2089b2393e82 admin admin] RBAC: Authorization granted {{(pid=71938) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 24 16:37:16.761224 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: [pid: 71938|app: 0|req: 683/1365] 10.222.0.53 () {56 vars in 1128 bytes} [Wed Nov 24 16:37:16 2021] GET /identity/v3/services?type=placement => generated 126 bytes in 51 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Nov 24 16:37:18.745811 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9e74d61-5a8f-4f4c-ac93-ab81fdcb2934 None None] REQUEST_METHOD: `GET` {{(pid=71939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 24 16:37:18.746371 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9e74d61-5a8f-4f4c-ac93-ab81fdcb2934 None None] SCRIPT_NAME: `/identity` {{(pid=71939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 24 16:37:18.746553 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9e74d61-5a8f-4f4c-ac93-ab81fdcb2934 None None] PATH_INFO: `/` {{(pid=71939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 24 16:37:18.748424 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: [pid: 71939|app: 0|req: 683/1366] 10.222.0.53 () {54 vars in 915 bytes} [Wed Nov 24 16:37:18 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 24 16:37:18.754614 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-419d26f5-bea8-460c-ad0e-2fd3cf535bf1 None None] REQUEST_METHOD: `POST` {{(pid=71938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 24 16:37:18.754960 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-419d26f5-bea8-460c-ad0e-2fd3cf535bf1 None None] SCRIPT_NAME: `/identity` {{(pid=71938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 24 16:37:18.755297 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-419d26f5-bea8-460c-ad0e-2fd3cf535bf1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=71938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 24 16:37:18.780064 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.auth.core [None req-419d26f5-bea8-460c-ad0e-2fd3cf535bf1 None None] MFA Rules not processed for user `0f2ba2e8375b4e8c8792ee1e22b60427`. Rule list: `[]` (Enabled: `True`). {{(pid=71938) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:442}} Nov 24 16:37:18.781286 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.fernet_utils [None req-419d26f5-bea8-460c-ad0e-2fd3cf535bf1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=71938) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:289}} Nov 24 16:37:18.789310 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: [pid: 71938|app: 0|req: 684/1367] 10.222.0.53 () {58 vars in 1013 bytes} [Wed Nov 24 16:37:18 2021] POST /identity/v3/auth/tokens => generated 3413 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 24 16:37:18.812652 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea289fec-b695-46ab-ada0-2dbf6e66a61a None None] REQUEST_METHOD: `POST` {{(pid=71939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 24 16:37:18.812987 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea289fec-b695-46ab-ada0-2dbf6e66a61a None None] SCRIPT_NAME: `/identity` {{(pid=71939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 24 16:37:18.813322 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea289fec-b695-46ab-ada0-2dbf6e66a61a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=71939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 24 16:37:18.839291 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.auth.core [None req-ea289fec-b695-46ab-ada0-2dbf6e66a61a None None] MFA Rules not processed for user `0f2ba2e8375b4e8c8792ee1e22b60427`. Rule list: `[]` (Enabled: `True`). {{(pid=71939) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:442}} Nov 24 16:37:18.840494 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.fernet_utils [None req-ea289fec-b695-46ab-ada0-2dbf6e66a61a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=71939) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:289}} Nov 24 16:37:18.847636 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: [pid: 71939|app: 0|req: 684/1368] 10.222.0.53 () {58 vars in 1013 bytes} [Wed Nov 24 16:37:18 2021] POST /identity/v3/auth/tokens => generated 3413 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 24 16:37:18.854619 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-419d26f5-bea8-460c-ad0e-2fd3cf535bf1 None None] Authenticating user token {{(pid=71938) process_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 24 16:37:18.864278 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-419d26f5-bea8-460c-ad0e-2fd3cf535bf1 None None] Validating token access rules against request {{(pid=71938) validate_allowed_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 24 16:37:18.869274 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8be1c281-8c83-4f24-8b67-df192e9ff560 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f2ba2e8375b4e8c8792ee1e22b60427', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '00a5583c7b7443e98e7a1d31a0b638dc', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=71938) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 24 16:37:18.869942 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8be1c281-8c83-4f24-8b67-df192e9ff560 admin admin] REQUEST_METHOD: `POST` {{(pid=71938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 24 16:37:18.870317 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8be1c281-8c83-4f24-8b67-df192e9ff560 admin admin] SCRIPT_NAME: `/identity` {{(pid=71938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 24 16:37:18.870654 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8be1c281-8c83-4f24-8b67-df192e9ff560 admin admin] PATH_INFO: `/v3/services` {{(pid=71938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 24 16:37:18.871425 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8be1c281-8c83-4f24-8b67-df192e9ff560 admin admin] RBAC: Authorizing `identity:create_service()` {{(pid=71938) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:442}} Nov 24 16:37:18.899934 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8be1c281-8c83-4f24-8b67-df192e9ff560 admin admin] RBAC: Authorization granted {{(pid=71938) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 24 16:37:18.912096 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: [pid: 71938|app: 0|req: 685/1369] 10.222.0.53 () {60 vars in 1153 bytes} [Wed Nov 24 16:37:18 2021] POST /identity/v3/services => generated 246 bytes in 58 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 24 16:37:20.926410 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea0ed758-1ab5-404e-ae72-eb8b46c6ccce None None] REQUEST_METHOD: `GET` {{(pid=71939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 24 16:37:20.926969 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea0ed758-1ab5-404e-ae72-eb8b46c6ccce None None] SCRIPT_NAME: `/identity` {{(pid=71939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 24 16:37:20.927079 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea0ed758-1ab5-404e-ae72-eb8b46c6ccce None None] PATH_INFO: `/` {{(pid=71939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 24 16:37:20.928851 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: [pid: 71939|app: 0|req: 685/1370] 10.222.0.53 () {54 vars in 915 bytes} [Wed Nov 24 16:37:20 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 24 16:37:20.934352 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-832fe2e1-dd89-46ba-8e2f-802af3f8c6da None None] REQUEST_METHOD: `POST` {{(pid=71938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 24 16:37:20.934704 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-832fe2e1-dd89-46ba-8e2f-802af3f8c6da None None] SCRIPT_NAME: `/identity` {{(pid=71938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 24 16:37:20.935040 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-832fe2e1-dd89-46ba-8e2f-802af3f8c6da None None] PATH_INFO: `/v3/auth/tokens` {{(pid=71938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 24 16:37:20.958680 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.auth.core [None req-832fe2e1-dd89-46ba-8e2f-802af3f8c6da None None] MFA Rules not processed for user `0f2ba2e8375b4e8c8792ee1e22b60427`. Rule list: `[]` (Enabled: `True`). {{(pid=71938) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:442}} Nov 24 16:37:20.960395 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.fernet_utils [None req-832fe2e1-dd89-46ba-8e2f-802af3f8c6da None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=71938) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:289}} Nov 24 16:37:20.979247 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: [pid: 71938|app: 0|req: 686/1371] 10.222.0.53 () {58 vars in 1013 bytes} [Wed Nov 24 16:37:20 2021] POST /identity/v3/auth/tokens => generated 3516 bytes in 46 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 24 16:37:21.001082 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3387745a-1ea2-4af8-9c94-67a76221b982 None None] REQUEST_METHOD: `POST` {{(pid=71939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 24 16:37:21.001524 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3387745a-1ea2-4af8-9c94-67a76221b982 None None] SCRIPT_NAME: `/identity` {{(pid=71939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 24 16:37:21.001767 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3387745a-1ea2-4af8-9c94-67a76221b982 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=71939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 24 16:37:21.025053 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.auth.core [None req-3387745a-1ea2-4af8-9c94-67a76221b982 None None] MFA Rules not processed for user `0f2ba2e8375b4e8c8792ee1e22b60427`. Rule list: `[]` (Enabled: `True`). {{(pid=71939) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:442}} Nov 24 16:37:21.026303 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.fernet_utils [None req-3387745a-1ea2-4af8-9c94-67a76221b982 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=71939) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:289}} Nov 24 16:37:21.033537 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: [pid: 71939|app: 0|req: 686/1372] 10.222.0.53 () {58 vars in 1013 bytes} [Wed Nov 24 16:37:20 2021] POST /identity/v3/auth/tokens => generated 3516 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 24 16:37:21.040432 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-832fe2e1-dd89-46ba-8e2f-802af3f8c6da None None] Authenticating user token {{(pid=71938) process_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 24 16:37:21.050014 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-832fe2e1-dd89-46ba-8e2f-802af3f8c6da None None] Validating token access rules against request {{(pid=71938) validate_allowed_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 24 16:37:21.054487 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-781038d7-f63f-4c47-b25b-7793fb42f7d6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f2ba2e8375b4e8c8792ee1e22b60427', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '00a5583c7b7443e98e7a1d31a0b638dc', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=71938) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 24 16:37:21.055295 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-781038d7-f63f-4c47-b25b-7793fb42f7d6 admin admin] REQUEST_METHOD: `GET` {{(pid=71938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 24 16:37:21.055635 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-781038d7-f63f-4c47-b25b-7793fb42f7d6 admin admin] SCRIPT_NAME: `/identity` {{(pid=71938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 24 16:37:21.055966 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-781038d7-f63f-4c47-b25b-7793fb42f7d6 admin admin] PATH_INFO: `/v3/services/placement` {{(pid=71938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 24 16:37:21.056676 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-781038d7-f63f-4c47-b25b-7793fb42f7d6 admin admin] RBAC: Authorizing `identity:get_service(service_id=placement)` {{(pid=71938) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:442}} Nov 24 16:37:21.085359 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-781038d7-f63f-4c47-b25b-7793fb42f7d6 admin admin] RBAC: Authorization granted {{(pid=71938) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 24 16:37:21.096827 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: WARNING keystone.server.flask.application [None req-781038d7-f63f-4c47-b25b-7793fb42f7d6 admin admin] Could not find service: placement.: keystone.exception.ServiceNotFound: Could not find service: placement. Nov 24 16:37:21.097976 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: [pid: 71938|app: 0|req: 687/1373] 10.222.0.53 () {56 vars in 1129 bytes} [Wed Nov 24 16:37:21 2021] GET /identity/v3/services/placement => generated 90 bytes in 58 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 24 16:37:21.105620 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3387745a-1ea2-4af8-9c94-67a76221b982 None None] Authenticating user token {{(pid=71939) process_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 24 16:37:21.115347 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3387745a-1ea2-4af8-9c94-67a76221b982 None None] Validating token access rules against request {{(pid=71939) validate_allowed_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 24 16:37:21.121079 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38d73ba5-9d88-499e-a7b3-6e77a2758e2e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f2ba2e8375b4e8c8792ee1e22b60427', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '00a5583c7b7443e98e7a1d31a0b638dc', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=71939) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 24 16:37:21.121760 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38d73ba5-9d88-499e-a7b3-6e77a2758e2e admin admin] REQUEST_METHOD: `GET` {{(pid=71939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 24 16:37:21.122132 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38d73ba5-9d88-499e-a7b3-6e77a2758e2e admin admin] SCRIPT_NAME: `/identity` {{(pid=71939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 24 16:37:21.122470 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38d73ba5-9d88-499e-a7b3-6e77a2758e2e admin admin] PATH_INFO: `/v3/services` {{(pid=71939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 24 16:37:21.123248 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38d73ba5-9d88-499e-a7b3-6e77a2758e2e admin admin] RBAC: Adding query filter params (name=placement) {{(pid=71939) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:161}} Nov 24 16:37:21.123601 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38d73ba5-9d88-499e-a7b3-6e77a2758e2e admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=71939) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:442}} Nov 24 16:37:21.152015 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38d73ba5-9d88-499e-a7b3-6e77a2758e2e admin admin] RBAC: Authorization granted {{(pid=71939) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 24 16:37:21.158040 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: [pid: 71939|app: 0|req: 687/1374] 10.222.0.53 () {56 vars in 1128 bytes} [Wed Nov 24 16:37:21 2021] GET /identity/v3/services?name=placement => generated 358 bytes in 53 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 24 16:37:21.164539 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-781038d7-f63f-4c47-b25b-7793fb42f7d6 admin admin] Authenticating user token {{(pid=71938) process_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 24 16:37:21.174650 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-781038d7-f63f-4c47-b25b-7793fb42f7d6 admin admin] Validating token access rules against request {{(pid=71938) validate_allowed_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 24 16:37:21.179628 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9db6efa0-95e2-45fb-b0ca-a8c17f55ee1c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f2ba2e8375b4e8c8792ee1e22b60427', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '00a5583c7b7443e98e7a1d31a0b638dc', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=71938) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 24 16:37:21.180235 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9db6efa0-95e2-45fb-b0ca-a8c17f55ee1c admin admin] REQUEST_METHOD: `GET` {{(pid=71938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 24 16:37:21.180571 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9db6efa0-95e2-45fb-b0ca-a8c17f55ee1c admin admin] SCRIPT_NAME: `/identity` {{(pid=71938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 24 16:37:21.180900 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9db6efa0-95e2-45fb-b0ca-a8c17f55ee1c admin admin] PATH_INFO: `/v3/endpoints` {{(pid=71938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 24 16:37:21.181754 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9db6efa0-95e2-45fb-b0ca-a8c17f55ee1c admin admin] RBAC: Adding query filter params (interface=public, service_id=282441c456704731bda1e5c380a2c4b0, region_id=RegionOne) {{(pid=71938) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:161}} Nov 24 16:37:21.182140 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9db6efa0-95e2-45fb-b0ca-a8c17f55ee1c admin admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=71938) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:442}} Nov 24 16:37:21.214643 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9db6efa0-95e2-45fb-b0ca-a8c17f55ee1c admin admin] RBAC: Authorization granted {{(pid=71938) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 24 16:37:21.220733 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: [pid: 71938|app: 0|req: 688/1375] 10.222.0.53 () {56 vars in 1263 bytes} [Wed Nov 24 16:37:21 2021] GET /identity/v3/endpoints?service_id=282441c456704731bda1e5c380a2c4b0&interface=public®ion_id=RegionOne => generated 194 bytes in 57 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 24 16:37:21.227783 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38d73ba5-9d88-499e-a7b3-6e77a2758e2e admin admin] Authenticating user token {{(pid=71939) process_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 24 16:37:21.237669 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38d73ba5-9d88-499e-a7b3-6e77a2758e2e admin admin] Validating token access rules against request {{(pid=71939) validate_allowed_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 24 16:37:21.242767 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0a84dc4-7286-448d-bd28-92aba7f4f397 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f2ba2e8375b4e8c8792ee1e22b60427', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '00a5583c7b7443e98e7a1d31a0b638dc', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=71939) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 24 16:37:21.243434 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0a84dc4-7286-448d-bd28-92aba7f4f397 admin admin] REQUEST_METHOD: `GET` {{(pid=71939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 24 16:37:21.243777 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0a84dc4-7286-448d-bd28-92aba7f4f397 admin admin] SCRIPT_NAME: `/identity` {{(pid=71939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 24 16:37:21.244113 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0a84dc4-7286-448d-bd28-92aba7f4f397 admin admin] PATH_INFO: `/v3/services` {{(pid=71939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 24 16:37:21.244850 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0a84dc4-7286-448d-bd28-92aba7f4f397 admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=71939) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:442}} Nov 24 16:37:21.272678 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0a84dc4-7286-448d-bd28-92aba7f4f397 admin admin] RBAC: Authorization granted {{(pid=71939) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 24 16:37:21.280514 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: [pid: 71939|app: 0|req: 688/1376] 10.222.0.53 () {56 vars in 1099 bytes} [Wed Nov 24 16:37:21 2021] GET /identity/v3/services => generated 2430 bytes in 53 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 24 16:37:23.294314 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b91da8a6-d023-4cf7-8a77-cac0582cf494 None None] REQUEST_METHOD: `GET` {{(pid=71938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 24 16:37:23.294820 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b91da8a6-d023-4cf7-8a77-cac0582cf494 None None] SCRIPT_NAME: `/identity` {{(pid=71938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 24 16:37:23.294952 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b91da8a6-d023-4cf7-8a77-cac0582cf494 None None] PATH_INFO: `/` {{(pid=71938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 24 16:37:23.296774 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: [pid: 71938|app: 0|req: 689/1377] 10.222.0.53 () {54 vars in 915 bytes} [Wed Nov 24 16:37:23 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 24 16:37:23.302469 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f20c0ddf-c240-4bfb-b45d-dcac6342133d None None] REQUEST_METHOD: `POST` {{(pid=71939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 24 16:37:23.302823 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f20c0ddf-c240-4bfb-b45d-dcac6342133d None None] SCRIPT_NAME: `/identity` {{(pid=71939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 24 16:37:23.303201 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f20c0ddf-c240-4bfb-b45d-dcac6342133d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=71939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 24 16:37:23.328409 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.auth.core [None req-f20c0ddf-c240-4bfb-b45d-dcac6342133d None None] MFA Rules not processed for user `0f2ba2e8375b4e8c8792ee1e22b60427`. Rule list: `[]` (Enabled: `True`). {{(pid=71939) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:442}} Nov 24 16:37:23.329647 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.fernet_utils [None req-f20c0ddf-c240-4bfb-b45d-dcac6342133d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=71939) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:289}} Nov 24 16:37:23.337106 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: [pid: 71939|app: 0|req: 689/1378] 10.222.0.53 () {58 vars in 1013 bytes} [Wed Nov 24 16:37:23 2021] POST /identity/v3/auth/tokens => generated 3516 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 24 16:37:23.359711 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d71b6bbc-528d-45a2-a549-9ed85c57296c None None] REQUEST_METHOD: `POST` {{(pid=71938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 24 16:37:23.360059 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d71b6bbc-528d-45a2-a549-9ed85c57296c None None] SCRIPT_NAME: `/identity` {{(pid=71938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 24 16:37:23.360402 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d71b6bbc-528d-45a2-a549-9ed85c57296c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=71938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 24 16:37:23.385297 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.auth.core [None req-d71b6bbc-528d-45a2-a549-9ed85c57296c None None] MFA Rules not processed for user `0f2ba2e8375b4e8c8792ee1e22b60427`. Rule list: `[]` (Enabled: `True`). {{(pid=71938) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:442}} Nov 24 16:37:23.386636 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.fernet_utils [None req-d71b6bbc-528d-45a2-a549-9ed85c57296c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=71938) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:289}} Nov 24 16:37:23.394667 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: [pid: 71938|app: 0|req: 690/1379] 10.222.0.53 () {58 vars in 1013 bytes} [Wed Nov 24 16:37:23 2021] POST /identity/v3/auth/tokens => generated 3516 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 24 16:37:23.404489 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f20c0ddf-c240-4bfb-b45d-dcac6342133d None None] Authenticating user token {{(pid=71939) process_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 24 16:37:23.415868 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f20c0ddf-c240-4bfb-b45d-dcac6342133d None None] Validating token access rules against request {{(pid=71939) validate_allowed_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 24 16:37:23.420316 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83302122-bb21-48f0-a90f-4a842ee45f14 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f2ba2e8375b4e8c8792ee1e22b60427', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '00a5583c7b7443e98e7a1d31a0b638dc', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=71939) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 24 16:37:23.421137 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83302122-bb21-48f0-a90f-4a842ee45f14 admin admin] REQUEST_METHOD: `GET` {{(pid=71939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 24 16:37:23.421478 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83302122-bb21-48f0-a90f-4a842ee45f14 admin admin] SCRIPT_NAME: `/identity` {{(pid=71939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 24 16:37:23.421815 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83302122-bb21-48f0-a90f-4a842ee45f14 admin admin] PATH_INFO: `/v3/services/placement` {{(pid=71939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 24 16:37:23.422569 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83302122-bb21-48f0-a90f-4a842ee45f14 admin admin] RBAC: Authorizing `identity:get_service(service_id=placement)` {{(pid=71939) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:442}} Nov 24 16:37:23.451838 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83302122-bb21-48f0-a90f-4a842ee45f14 admin admin] RBAC: Authorization granted {{(pid=71939) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 24 16:37:23.463765 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: WARNING keystone.server.flask.application [None req-83302122-bb21-48f0-a90f-4a842ee45f14 admin admin] Could not find service: placement.: keystone.exception.ServiceNotFound: Could not find service: placement. Nov 24 16:37:23.464935 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: [pid: 71939|app: 0|req: 690/1380] 10.222.0.53 () {56 vars in 1129 bytes} [Wed Nov 24 16:37:23 2021] GET /identity/v3/services/placement => generated 90 bytes in 62 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 24 16:37:23.472024 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d71b6bbc-528d-45a2-a549-9ed85c57296c None None] Authenticating user token {{(pid=71938) process_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 24 16:37:23.481914 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d71b6bbc-528d-45a2-a549-9ed85c57296c None None] Validating token access rules against request {{(pid=71938) validate_allowed_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 24 16:37:23.486986 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3362e65d-bfe8-4d4b-ba53-d4f98c2dc625 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f2ba2e8375b4e8c8792ee1e22b60427', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '00a5583c7b7443e98e7a1d31a0b638dc', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=71938) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 24 16:37:23.487653 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3362e65d-bfe8-4d4b-ba53-d4f98c2dc625 admin admin] REQUEST_METHOD: `GET` {{(pid=71938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 24 16:37:23.487992 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3362e65d-bfe8-4d4b-ba53-d4f98c2dc625 admin admin] SCRIPT_NAME: `/identity` {{(pid=71938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 24 16:37:23.488324 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3362e65d-bfe8-4d4b-ba53-d4f98c2dc625 admin admin] PATH_INFO: `/v3/services` {{(pid=71938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 24 16:37:23.489103 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3362e65d-bfe8-4d4b-ba53-d4f98c2dc625 admin admin] RBAC: Adding query filter params (name=placement) {{(pid=71938) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:161}} Nov 24 16:37:23.489456 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3362e65d-bfe8-4d4b-ba53-d4f98c2dc625 admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=71938) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:442}} Nov 24 16:37:23.518277 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3362e65d-bfe8-4d4b-ba53-d4f98c2dc625 admin admin] RBAC: Authorization granted {{(pid=71938) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 24 16:37:23.524298 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: [pid: 71938|app: 0|req: 691/1381] 10.222.0.53 () {56 vars in 1128 bytes} [Wed Nov 24 16:37:23 2021] GET /identity/v3/services?name=placement => generated 358 bytes in 53 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 24 16:37:23.530591 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83302122-bb21-48f0-a90f-4a842ee45f14 admin admin] Authenticating user token {{(pid=71939) process_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 24 16:37:23.541109 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83302122-bb21-48f0-a90f-4a842ee45f14 admin admin] Validating token access rules against request {{(pid=71939) validate_allowed_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 24 16:37:23.545535 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31aa3cf0-993f-47c1-b471-b0c5cbf9ab75 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f2ba2e8375b4e8c8792ee1e22b60427', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '00a5583c7b7443e98e7a1d31a0b638dc', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=71939) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 24 16:37:23.546259 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31aa3cf0-993f-47c1-b471-b0c5cbf9ab75 admin admin] REQUEST_METHOD: `POST` {{(pid=71939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 24 16:37:23.546607 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31aa3cf0-993f-47c1-b471-b0c5cbf9ab75 admin admin] SCRIPT_NAME: `/identity` {{(pid=71939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 24 16:37:23.546944 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31aa3cf0-993f-47c1-b471-b0c5cbf9ab75 admin admin] PATH_INFO: `/v3/endpoints` {{(pid=71939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 24 16:37:23.547731 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31aa3cf0-993f-47c1-b471-b0c5cbf9ab75 admin admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=71939) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:442}} Nov 24 16:37:23.576450 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31aa3cf0-993f-47c1-b471-b0c5cbf9ab75 admin admin] RBAC: Authorization granted {{(pid=71939) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 24 16:37:23.593979 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: [pid: 71939|app: 0|req: 691/1382] 10.222.0.53 () {60 vars in 1156 bytes} [Wed Nov 24 16:37:23 2021] POST /identity/v3/endpoints => generated 331 bytes in 64 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 24 16:39:23.681434 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6b56c1e-67f7-4cec-9c38-faaed02be28a None None] REQUEST_METHOD: `GET` {{(pid=71938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 24 16:39:23.682014 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6b56c1e-67f7-4cec-9c38-faaed02be28a None None] SCRIPT_NAME: `/identity` {{(pid=71938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 24 16:39:23.682187 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6b56c1e-67f7-4cec-9c38-faaed02be28a None None] PATH_INFO: `/` {{(pid=71938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 24 16:39:23.683940 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: [pid: 71938|app: 0|req: 692/1383] 10.222.0.53 () {54 vars in 915 bytes} [Wed Nov 24 16:39:23 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 24 16:39:23.690258 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49cbcff5-ff04-4ed6-8d07-1bbd78de15c6 None None] REQUEST_METHOD: `POST` {{(pid=71939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 24 16:39:23.690613 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49cbcff5-ff04-4ed6-8d07-1bbd78de15c6 None None] SCRIPT_NAME: `/identity` {{(pid=71939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 24 16:39:23.690957 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49cbcff5-ff04-4ed6-8d07-1bbd78de15c6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=71939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 24 16:39:23.790199 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.auth.core [None req-49cbcff5-ff04-4ed6-8d07-1bbd78de15c6 None None] MFA Rules not processed for user `0f2ba2e8375b4e8c8792ee1e22b60427`. Rule list: `[]` (Enabled: `True`). {{(pid=71939) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:442}} Nov 24 16:39:23.791436 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.fernet_utils [None req-49cbcff5-ff04-4ed6-8d07-1bbd78de15c6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=71939) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:289}} Nov 24 16:39:23.904364 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: [pid: 71939|app: 0|req: 692/1384] 10.222.0.53 () {58 vars in 1013 bytes} [Wed Nov 24 16:39:23 2021] POST /identity/v3/auth/tokens => generated 3669 bytes in 215 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 24 16:39:23.930906 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d3e5d80-57c7-47e3-955b-a5c725640fcb None None] REQUEST_METHOD: `POST` {{(pid=71938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 24 16:39:23.931249 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d3e5d80-57c7-47e3-955b-a5c725640fcb None None] SCRIPT_NAME: `/identity` {{(pid=71938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 24 16:39:23.931629 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d3e5d80-57c7-47e3-955b-a5c725640fcb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=71938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 24 16:39:24.022734 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.auth.core [None req-2d3e5d80-57c7-47e3-955b-a5c725640fcb None None] MFA Rules not processed for user `0f2ba2e8375b4e8c8792ee1e22b60427`. Rule list: `[]` (Enabled: `True`). {{(pid=71938) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:442}} Nov 24 16:39:24.023965 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.fernet_utils [None req-2d3e5d80-57c7-47e3-955b-a5c725640fcb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=71938) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:289}} Nov 24 16:39:24.138907 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: [pid: 71938|app: 0|req: 693/1385] 10.222.0.53 () {58 vars in 1013 bytes} [Wed Nov 24 16:39:23 2021] POST /identity/v3/auth/tokens => generated 3669 bytes in 209 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 24 16:39:24.175033 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cbc5e24-66d9-4363-bee7-53d7b4af0626 None None] REQUEST_METHOD: `GET` {{(pid=71939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 24 16:39:24.175390 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cbc5e24-66d9-4363-bee7-53d7b4af0626 None None] SCRIPT_NAME: `/identity` {{(pid=71939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 24 16:39:24.175731 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cbc5e24-66d9-4363-bee7-53d7b4af0626 None None] PATH_INFO: `/` {{(pid=71939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 24 16:39:24.177559 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: [pid: 71939|app: 0|req: 693/1386] 10.222.0.53 () {54 vars in 945 bytes} [Wed Nov 24 16:39:24 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 24 16:39:24.183077 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0cc44ef-9361-41f8-8422-581e23072a27 None None] REQUEST_METHOD: `POST` {{(pid=71938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 24 16:39:24.183371 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0cc44ef-9361-41f8-8422-581e23072a27 None None] SCRIPT_NAME: `/identity` {{(pid=71938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 24 16:39:24.183705 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0cc44ef-9361-41f8-8422-581e23072a27 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=71938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 24 16:39:24.286860 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.auth.core [None req-e0cc44ef-9361-41f8-8422-581e23072a27 None None] MFA Rules not processed for user `af9e91f8d56c491d99fab4346754ce2e`. Rule list: `[]` (Enabled: `True`). {{(pid=71938) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:442}} Nov 24 16:39:24.288061 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.fernet_utils [None req-e0cc44ef-9361-41f8-8422-581e23072a27 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=71938) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:289}} Nov 24 16:39:24.382852 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: [pid: 71938|app: 0|req: 694/1387] 10.222.0.53 () {58 vars in 1043 bytes} [Wed Nov 24 16:39:24 2021] POST /identity/v3/auth/tokens => generated 3550 bytes in 201 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 24 16:39:24.390871 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cbc5e24-66d9-4363-bee7-53d7b4af0626 None None] Authenticating user token {{(pid=71939) process_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 24 16:39:24.392540 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.fernet_utils [None req-1cbc5e24-66d9-4363-bee7-53d7b4af0626 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=71939) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:289}} Nov 24 16:39:24.519740 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cbc5e24-66d9-4363-bee7-53d7b4af0626 None None] Validating token access rules against request {{(pid=71939) validate_allowed_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 24 16:39:24.608401 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-202c30df-69df-456c-900c-926be2e81631 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'af9e91f8d56c491d99fab4346754ce2e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3b3940d4ae1c4177ae29c02377bb4b0b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=71939) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 24 16:39:24.609056 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-202c30df-69df-456c-900c-926be2e81631 service glance] REQUEST_METHOD: `GET` {{(pid=71939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 24 16:39:24.609402 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-202c30df-69df-456c-900c-926be2e81631 service glance] SCRIPT_NAME: `/identity` {{(pid=71939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 24 16:39:24.609741 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-202c30df-69df-456c-900c-926be2e81631 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=71939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 24 16:39:24.611462 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.fernet_utils [None req-202c30df-69df-456c-900c-926be2e81631 service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=71939) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:289}} Nov 24 16:39:24.741101 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-202c30df-69df-456c-900c-926be2e81631 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=71939) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:442}} Nov 24 16:39:24.770795 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-202c30df-69df-456c-900c-926be2e81631 service glance] RBAC: Authorization granted {{(pid=71939) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 24 16:39:24.791758 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: [pid: 71939|app: 0|req: 694/1388] 10.222.0.53 () {60 vars in 1356 bytes} [Wed Nov 24 16:39:24 2021] GET /identity/v3/auth/tokens => generated 3669 bytes in 401 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 24 16:39:25.342282 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0866a32-3e6b-4db9-8400-dec01365a8b4 None None] REQUEST_METHOD: `POST` {{(pid=71938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 24 16:39:25.342666 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0866a32-3e6b-4db9-8400-dec01365a8b4 None None] SCRIPT_NAME: `/identity` {{(pid=71938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 24 16:39:25.343007 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0866a32-3e6b-4db9-8400-dec01365a8b4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=71938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 24 16:39:25.436450 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.auth.core [None req-d0866a32-3e6b-4db9-8400-dec01365a8b4 None None] MFA Rules not processed for user `f8a135ac0e4744a98258dc7f6c12e741`. Rule list: `[]` (Enabled: `True`). {{(pid=71938) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:442}} Nov 24 16:39:25.437671 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.fernet_utils [None req-d0866a32-3e6b-4db9-8400-dec01365a8b4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=71938) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:289}} Nov 24 16:39:25.539839 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: [pid: 71938|app: 0|req: 695/1389] 10.222.0.53 () {58 vars in 999 bytes} [Wed Nov 24 16:39:25 2021] POST /identity/v3/auth/tokens => generated 3625 bytes in 199 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 24 16:39:25.584909 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99c2563e-27cf-4972-9143-09e14465f9b0 None None] REQUEST_METHOD: `GET` {{(pid=71939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 24 16:39:25.585201 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99c2563e-27cf-4972-9143-09e14465f9b0 None None] SCRIPT_NAME: `/identity` {{(pid=71939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 24 16:39:25.585534 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99c2563e-27cf-4972-9143-09e14465f9b0 None None] PATH_INFO: `/` {{(pid=71939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 24 16:39:25.587430 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: [pid: 71939|app: 0|req: 695/1390] 10.222.0.53 () {54 vars in 931 bytes} [Wed Nov 24 16:39:25 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 24 16:39:25.594433 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9861489b-af81-4766-bd34-675fe2417291 None None] REQUEST_METHOD: `POST` {{(pid=71938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 24 16:39:25.594787 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9861489b-af81-4766-bd34-675fe2417291 None None] SCRIPT_NAME: `/identity` {{(pid=71938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 24 16:39:25.595128 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9861489b-af81-4766-bd34-675fe2417291 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=71938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 24 16:39:25.699771 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.auth.core [None req-9861489b-af81-4766-bd34-675fe2417291 None None] MFA Rules not processed for user `1a4cec9543ba4b7da4ecb1e6e8681302`. Rule list: `[]` (Enabled: `True`). {{(pid=71938) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:442}} Nov 24 16:39:25.701036 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.fernet_utils [None req-9861489b-af81-4766-bd34-675fe2417291 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=71938) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:289}} Nov 24 16:39:25.826825 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: [pid: 71938|app: 0|req: 696/1391] 10.222.0.53 () {58 vars in 1029 bytes} [Wed Nov 24 16:39:25 2021] POST /identity/v3/auth/tokens => generated 3734 bytes in 233 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 24 16:39:25.837130 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99c2563e-27cf-4972-9143-09e14465f9b0 None None] Authenticating user token {{(pid=71939) process_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 24 16:39:25.838683 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.fernet_utils [None req-99c2563e-27cf-4972-9143-09e14465f9b0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=71939) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:289}} Nov 24 16:39:26.009287 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99c2563e-27cf-4972-9143-09e14465f9b0 None None] Validating token access rules against request {{(pid=71939) validate_allowed_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 24 16:39:26.130108 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a29ef06-e11c-48ff-a86b-66ba1b034dc8 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a4cec9543ba4b7da4ecb1e6e8681302', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3b3940d4ae1c4177ae29c02377bb4b0b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=71939) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 24 16:39:26.130792 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a29ef06-e11c-48ff-a86b-66ba1b034dc8 service swift] REQUEST_METHOD: `GET` {{(pid=71939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 24 16:39:26.131134 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a29ef06-e11c-48ff-a86b-66ba1b034dc8 service swift] SCRIPT_NAME: `/identity` {{(pid=71939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 24 16:39:26.131469 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a29ef06-e11c-48ff-a86b-66ba1b034dc8 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=71939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 24 16:39:26.133210 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.fernet_utils [None req-1a29ef06-e11c-48ff-a86b-66ba1b034dc8 service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=71939) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:289}} Nov 24 16:39:26.235755 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a29ef06-e11c-48ff-a86b-66ba1b034dc8 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=71939) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:442}} Nov 24 16:39:26.263664 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a29ef06-e11c-48ff-a86b-66ba1b034dc8 service swift] RBAC: Authorization granted {{(pid=71939) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 24 16:39:26.271965 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: [pid: 71939|app: 0|req: 696/1392] 10.222.0.53 () {60 vars in 1375 bytes} [Wed Nov 24 16:39:25 2021] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 435 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Nov 24 16:40:07.467497 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ec1f3d9-a6d7-4672-b650-05520a44486a None None] REQUEST_METHOD: `GET` {{(pid=71938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 24 16:40:07.467945 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ec1f3d9-a6d7-4672-b650-05520a44486a None None] SCRIPT_NAME: `/identity` {{(pid=71938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 24 16:40:07.468125 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ec1f3d9-a6d7-4672-b650-05520a44486a None None] PATH_INFO: `/` {{(pid=71938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 24 16:40:07.475141 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: [pid: 71938|app: 0|req: 697/1393] 10.222.0.53 () {54 vars in 915 bytes} [Wed Nov 24 16:40:07 2021] GET /identity => generated 270 bytes in 9 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 24 16:40:07.476701 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b58002e-2f35-497c-a31a-52a32639499a None None] REQUEST_METHOD: `POST` {{(pid=71939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 24 16:40:07.477385 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b58002e-2f35-497c-a31a-52a32639499a None None] SCRIPT_NAME: `/identity` {{(pid=71939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 24 16:40:07.477385 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b58002e-2f35-497c-a31a-52a32639499a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=71939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 24 16:40:07.609848 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.auth.core [None req-9b58002e-2f35-497c-a31a-52a32639499a None None] MFA Rules not processed for user `0f2ba2e8375b4e8c8792ee1e22b60427`. Rule list: `[]` (Enabled: `True`). {{(pid=71939) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:442}} Nov 24 16:40:07.611408 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.fernet_utils [None req-9b58002e-2f35-497c-a31a-52a32639499a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=71939) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:289}} Nov 24 16:40:07.744630 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: [pid: 71939|app: 0|req: 697/1394] 10.222.0.53 () {58 vars in 1013 bytes} [Wed Nov 24 16:40:07 2021] POST /identity/v3/auth/tokens => generated 3669 bytes in 269 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 24 16:40:07.767122 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95573135-707d-43fa-a62c-8f8437bf0017 None None] REQUEST_METHOD: `POST` {{(pid=71938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 24 16:40:07.767379 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95573135-707d-43fa-a62c-8f8437bf0017 None None] SCRIPT_NAME: `/identity` {{(pid=71938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 24 16:40:07.767946 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95573135-707d-43fa-a62c-8f8437bf0017 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=71938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 24 16:40:07.793508 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.auth.core [None req-95573135-707d-43fa-a62c-8f8437bf0017 None None] MFA Rules not processed for user `0f2ba2e8375b4e8c8792ee1e22b60427`. Rule list: `[]` (Enabled: `True`). {{(pid=71938) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:442}} Nov 24 16:40:07.795320 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.fernet_utils [None req-95573135-707d-43fa-a62c-8f8437bf0017 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=71938) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:289}} Nov 24 16:40:07.805813 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: [pid: 71938|app: 0|req: 698/1395] 10.222.0.53 () {58 vars in 1013 bytes} [Wed Nov 24 16:40:07 2021] POST /identity/v3/auth/tokens => generated 3669 bytes in 40 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 24 16:40:07.812555 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b58002e-2f35-497c-a31a-52a32639499a None None] Authenticating user token {{(pid=71939) process_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 24 16:40:07.824764 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b58002e-2f35-497c-a31a-52a32639499a None None] Validating token access rules against request {{(pid=71939) validate_allowed_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 24 16:40:07.829424 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd781e00-78d7-4e76-aa4e-0f0d4b22f3df admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f2ba2e8375b4e8c8792ee1e22b60427', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '00a5583c7b7443e98e7a1d31a0b638dc', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=71939) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 24 16:40:07.830068 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd781e00-78d7-4e76-aa4e-0f0d4b22f3df admin admin] REQUEST_METHOD: `GET` {{(pid=71939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 24 16:40:07.830466 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd781e00-78d7-4e76-aa4e-0f0d4b22f3df admin admin] SCRIPT_NAME: `/identity` {{(pid=71939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 24 16:40:07.830908 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd781e00-78d7-4e76-aa4e-0f0d4b22f3df admin admin] PATH_INFO: `/v3/projects` {{(pid=71939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 24 16:40:07.831783 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd781e00-78d7-4e76-aa4e-0f0d4b22f3df admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=71939) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:442}} Nov 24 16:40:07.862853 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd781e00-78d7-4e76-aa4e-0f0d4b22f3df admin admin] RBAC: Authorization granted {{(pid=71939) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 24 16:40:07.892073 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: [pid: 71939|app: 0|req: 698/1396] 10.222.0.53 () {56 vars in 1099 bytes} [Wed Nov 24 16:40:07 2021] GET /identity/v3/projects => generated 2553 bytes in 71 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 24 16:40:09.977300 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cda4b577-e4a3-4fe0-90ed-ddf72648f240 None None] REQUEST_METHOD: `GET` {{(pid=71938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 24 16:40:09.977855 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cda4b577-e4a3-4fe0-90ed-ddf72648f240 None None] SCRIPT_NAME: `/identity` {{(pid=71938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 24 16:40:09.977969 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cda4b577-e4a3-4fe0-90ed-ddf72648f240 None None] PATH_INFO: `/` {{(pid=71938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 24 16:40:09.979935 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: [pid: 71938|app: 0|req: 699/1397] 10.222.0.53 () {54 vars in 915 bytes} [Wed Nov 24 16:40:09 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 24 16:40:09.985946 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b23be69-1a7b-49ea-9720-1a550779db9d None None] REQUEST_METHOD: `POST` {{(pid=71939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 24 16:40:09.986325 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b23be69-1a7b-49ea-9720-1a550779db9d None None] SCRIPT_NAME: `/identity` {{(pid=71939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 24 16:40:09.986658 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b23be69-1a7b-49ea-9720-1a550779db9d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=71939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 24 16:40:10.010655 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.auth.core [None req-2b23be69-1a7b-49ea-9720-1a550779db9d None None] MFA Rules not processed for user `0f2ba2e8375b4e8c8792ee1e22b60427`. Rule list: `[]` (Enabled: `True`). {{(pid=71939) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:442}} Nov 24 16:40:10.012209 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.fernet_utils [None req-2b23be69-1a7b-49ea-9720-1a550779db9d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=71939) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:289}} Nov 24 16:40:10.020174 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: [pid: 71939|app: 0|req: 699/1398] 10.222.0.53 () {58 vars in 1013 bytes} [Wed Nov 24 16:40:09 2021] POST /identity/v3/auth/tokens => generated 3669 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 24 16:40:10.045716 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-989f5862-194e-455c-b7be-8fb4ae2537d9 None None] REQUEST_METHOD: `POST` {{(pid=71938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 24 16:40:10.046160 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-989f5862-194e-455c-b7be-8fb4ae2537d9 None None] SCRIPT_NAME: `/identity` {{(pid=71938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 24 16:40:10.046541 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-989f5862-194e-455c-b7be-8fb4ae2537d9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=71938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 24 16:40:10.071372 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.auth.core [None req-989f5862-194e-455c-b7be-8fb4ae2537d9 None None] MFA Rules not processed for user `0f2ba2e8375b4e8c8792ee1e22b60427`. Rule list: `[]` (Enabled: `True`). {{(pid=71938) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:442}} Nov 24 16:40:10.072834 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.fernet_utils [None req-989f5862-194e-455c-b7be-8fb4ae2537d9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=71938) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:289}} Nov 24 16:40:10.080265 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: [pid: 71938|app: 0|req: 700/1399] 10.222.0.53 () {58 vars in 1013 bytes} [Wed Nov 24 16:40:10 2021] POST /identity/v3/auth/tokens => generated 3669 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 24 16:40:10.118434 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a3cdeda-20db-4e93-9f3a-f6fa26023c08 None None] REQUEST_METHOD: `GET` {{(pid=71939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 24 16:40:10.118789 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a3cdeda-20db-4e93-9f3a-f6fa26023c08 None None] SCRIPT_NAME: `/identity` {{(pid=71939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 24 16:40:10.119131 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a3cdeda-20db-4e93-9f3a-f6fa26023c08 None None] PATH_INFO: `/` {{(pid=71939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 24 16:40:10.121647 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: [pid: 71939|app: 0|req: 700/1400] 10.222.0.53 () {54 vars in 951 bytes} [Wed Nov 24 16:40:10 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 24 16:40:10.127986 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-334e241c-5643-437c-a258-2b992523177b None None] REQUEST_METHOD: `POST` {{(pid=71938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 24 16:40:10.128333 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-334e241c-5643-437c-a258-2b992523177b None None] SCRIPT_NAME: `/identity` {{(pid=71938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 24 16:40:10.128664 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-334e241c-5643-437c-a258-2b992523177b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=71938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 24 16:40:10.299716 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.auth.core [None req-334e241c-5643-437c-a258-2b992523177b None None] MFA Rules not processed for user `c90f21b9cdcb413282461fa83cb6b7a5`. Rule list: `[]` (Enabled: `True`). {{(pid=71938) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:442}} Nov 24 16:40:10.300861 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.fernet_utils [None req-334e241c-5643-437c-a258-2b992523177b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=71938) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:289}} Nov 24 16:40:10.397113 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: [pid: 71938|app: 0|req: 701/1401] 10.222.0.53 () {58 vars in 1049 bytes} [Wed Nov 24 16:40:10 2021] POST /identity/v3/auth/tokens => generated 3551 bytes in 270 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 24 16:40:10.407785 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a3cdeda-20db-4e93-9f3a-f6fa26023c08 None None] Authenticating user token {{(pid=71939) process_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 24 16:40:10.419026 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a3cdeda-20db-4e93-9f3a-f6fa26023c08 None None] Validating token access rules against request {{(pid=71939) validate_allowed_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 24 16:40:10.423047 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb8e9f46-d297-4510-975f-82b5266c8d8c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c90f21b9cdcb413282461fa83cb6b7a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3b3940d4ae1c4177ae29c02377bb4b0b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=71939) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 24 16:40:10.423694 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb8e9f46-d297-4510-975f-82b5266c8d8c service neutron] REQUEST_METHOD: `GET` {{(pid=71939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 24 16:40:10.424040 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb8e9f46-d297-4510-975f-82b5266c8d8c service neutron] SCRIPT_NAME: `/identity` {{(pid=71939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 24 16:40:10.424387 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb8e9f46-d297-4510-975f-82b5266c8d8c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=71939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 24 16:40:10.436014 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb8e9f46-d297-4510-975f-82b5266c8d8c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=71939) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:442}} Nov 24 16:40:10.464525 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb8e9f46-d297-4510-975f-82b5266c8d8c service neutron] RBAC: Authorization granted {{(pid=71939) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 24 16:40:10.474158 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: [pid: 71939|app: 0|req: 701/1402] 10.222.0.53 () {60 vars in 1356 bytes} [Wed Nov 24 16:40:10 2021] GET /identity/v3/auth/tokens => generated 3669 bytes in 67 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 24 16:40:13.000681 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef80fcb3-9ef8-401f-af38-af9ba560ee89 None None] REQUEST_METHOD: `GET` {{(pid=71938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 24 16:40:13.001219 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef80fcb3-9ef8-401f-af38-af9ba560ee89 None None] SCRIPT_NAME: `/identity` {{(pid=71938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 24 16:40:13.001330 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef80fcb3-9ef8-401f-af38-af9ba560ee89 None None] PATH_INFO: `/` {{(pid=71938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 24 16:40:13.003267 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: [pid: 71938|app: 0|req: 702/1403] 10.222.0.53 () {54 vars in 915 bytes} [Wed Nov 24 16:40:12 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 24 16:40:13.008792 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3eb19da8-fdc9-4893-92ae-1214f7d08051 None None] REQUEST_METHOD: `POST` {{(pid=71939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 24 16:40:13.009141 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3eb19da8-fdc9-4893-92ae-1214f7d08051 None None] SCRIPT_NAME: `/identity` {{(pid=71939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 24 16:40:13.009480 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3eb19da8-fdc9-4893-92ae-1214f7d08051 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=71939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 24 16:40:13.033346 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.auth.core [None req-3eb19da8-fdc9-4893-92ae-1214f7d08051 None None] MFA Rules not processed for user `0f2ba2e8375b4e8c8792ee1e22b60427`. Rule list: `[]` (Enabled: `True`). {{(pid=71939) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:442}} Nov 24 16:40:13.034571 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.fernet_utils [None req-3eb19da8-fdc9-4893-92ae-1214f7d08051 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=71939) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:289}} Nov 24 16:40:13.041993 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: [pid: 71939|app: 0|req: 702/1404] 10.222.0.53 () {58 vars in 1013 bytes} [Wed Nov 24 16:40:13 2021] POST /identity/v3/auth/tokens => generated 3669 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 24 16:40:13.068372 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7d9009d-959c-4a52-99c3-1bad4859c966 None None] REQUEST_METHOD: `POST` {{(pid=71938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 24 16:40:13.068665 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7d9009d-959c-4a52-99c3-1bad4859c966 None None] SCRIPT_NAME: `/identity` {{(pid=71938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 24 16:40:13.069006 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7d9009d-959c-4a52-99c3-1bad4859c966 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=71938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 24 16:40:13.092721 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.auth.core [None req-f7d9009d-959c-4a52-99c3-1bad4859c966 None None] MFA Rules not processed for user `0f2ba2e8375b4e8c8792ee1e22b60427`. Rule list: `[]` (Enabled: `True`). {{(pid=71938) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:442}} Nov 24 16:40:13.094069 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.fernet_utils [None req-f7d9009d-959c-4a52-99c3-1bad4859c966 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=71938) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:289}} Nov 24 16:40:13.101496 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: [pid: 71938|app: 0|req: 703/1405] 10.222.0.53 () {58 vars in 1013 bytes} [Wed Nov 24 16:40:13 2021] POST /identity/v3/auth/tokens => generated 3669 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 24 16:40:13.124189 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3eb19da8-fdc9-4893-92ae-1214f7d08051 None None] Authenticating user token {{(pid=71939) process_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 24 16:40:13.133887 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3eb19da8-fdc9-4893-92ae-1214f7d08051 None None] Validating token access rules against request {{(pid=71939) validate_allowed_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 24 16:40:13.137623 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d8cc3d6-2a99-4c91-abca-1914725bd68d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c90f21b9cdcb413282461fa83cb6b7a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3b3940d4ae1c4177ae29c02377bb4b0b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=71939) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 24 16:40:13.138336 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d8cc3d6-2a99-4c91-abca-1914725bd68d service neutron] REQUEST_METHOD: `GET` {{(pid=71939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 24 16:40:13.138674 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d8cc3d6-2a99-4c91-abca-1914725bd68d service neutron] SCRIPT_NAME: `/identity` {{(pid=71939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 24 16:40:13.139003 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d8cc3d6-2a99-4c91-abca-1914725bd68d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=71939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 24 16:40:13.148477 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d8cc3d6-2a99-4c91-abca-1914725bd68d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=71939) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:442}} Nov 24 16:40:13.178382 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d8cc3d6-2a99-4c91-abca-1914725bd68d service neutron] RBAC: Authorization granted {{(pid=71939) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 24 16:40:13.191504 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: [pid: 71939|app: 0|req: 703/1406] 10.222.0.53 () {60 vars in 1356 bytes} [Wed Nov 24 16:40:13 2021] GET /identity/v3/auth/tokens => generated 3669 bytes in 68 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 24 16:40:15.695308 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a74e9e37-e56f-4117-b70a-9bf2e3bf57b2 None None] REQUEST_METHOD: `GET` {{(pid=71938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 24 16:40:15.695893 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a74e9e37-e56f-4117-b70a-9bf2e3bf57b2 None None] SCRIPT_NAME: `/identity` {{(pid=71938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 24 16:40:15.696003 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a74e9e37-e56f-4117-b70a-9bf2e3bf57b2 None None] PATH_INFO: `/` {{(pid=71938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 24 16:40:15.698146 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: [pid: 71938|app: 0|req: 704/1407] 10.222.0.53 () {54 vars in 915 bytes} [Wed Nov 24 16:40:15 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 24 16:40:15.704306 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7339314-bc4a-47f2-8189-42e580d028ea None None] REQUEST_METHOD: `POST` {{(pid=71939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 24 16:40:15.704665 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7339314-bc4a-47f2-8189-42e580d028ea None None] SCRIPT_NAME: `/identity` {{(pid=71939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 24 16:40:15.705003 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7339314-bc4a-47f2-8189-42e580d028ea None None] PATH_INFO: `/v3/auth/tokens` {{(pid=71939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 24 16:40:15.728549 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.auth.core [None req-a7339314-bc4a-47f2-8189-42e580d028ea None None] MFA Rules not processed for user `0f2ba2e8375b4e8c8792ee1e22b60427`. Rule list: `[]` (Enabled: `True`). {{(pid=71939) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:442}} Nov 24 16:40:15.729780 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.fernet_utils [None req-a7339314-bc4a-47f2-8189-42e580d028ea None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=71939) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:289}} Nov 24 16:40:15.737179 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: [pid: 71939|app: 0|req: 704/1408] 10.222.0.53 () {58 vars in 1013 bytes} [Wed Nov 24 16:40:15 2021] POST /identity/v3/auth/tokens => generated 3669 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 24 16:40:15.766014 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63827a83-9625-4308-a182-9f7a1a062be4 None None] REQUEST_METHOD: `POST` {{(pid=71938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 24 16:40:15.766448 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63827a83-9625-4308-a182-9f7a1a062be4 None None] SCRIPT_NAME: `/identity` {{(pid=71938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 24 16:40:15.766820 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63827a83-9625-4308-a182-9f7a1a062be4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=71938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 24 16:40:15.789791 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.auth.core [None req-63827a83-9625-4308-a182-9f7a1a062be4 None None] MFA Rules not processed for user `0f2ba2e8375b4e8c8792ee1e22b60427`. Rule list: `[]` (Enabled: `True`). {{(pid=71938) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:442}} Nov 24 16:40:15.791069 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.fernet_utils [None req-63827a83-9625-4308-a182-9f7a1a062be4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=71938) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:289}} Nov 24 16:40:15.799160 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: [pid: 71938|app: 0|req: 705/1409] 10.222.0.53 () {58 vars in 1013 bytes} [Wed Nov 24 16:40:15 2021] POST /identity/v3/auth/tokens => generated 3669 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 24 16:40:15.813991 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7339314-bc4a-47f2-8189-42e580d028ea None None] Authenticating user token {{(pid=71939) process_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 24 16:40:15.824189 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7339314-bc4a-47f2-8189-42e580d028ea None None] Validating token access rules against request {{(pid=71939) validate_allowed_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 24 16:40:15.828545 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40bd9fc4-9504-43ff-be87-5ef0d0d324f9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f2ba2e8375b4e8c8792ee1e22b60427', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '00a5583c7b7443e98e7a1d31a0b638dc', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=71939) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 24 16:40:15.829419 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40bd9fc4-9504-43ff-be87-5ef0d0d324f9 admin admin] REQUEST_METHOD: `GET` {{(pid=71939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 24 16:40:15.829758 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40bd9fc4-9504-43ff-be87-5ef0d0d324f9 admin admin] SCRIPT_NAME: `/identity` {{(pid=71939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 24 16:40:15.830113 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40bd9fc4-9504-43ff-be87-5ef0d0d324f9 admin admin] PATH_INFO: `/v3/projects/6a75e77ca1684c808c57b448b83e73d2` {{(pid=71939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 24 16:40:15.842633 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40bd9fc4-9504-43ff-be87-5ef0d0d324f9 admin admin] RBAC: Authorizing `identity:get_project(project_id=6a75e77ca1684c808c57b448b83e73d2)` {{(pid=71939) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:442}} Nov 24 16:40:15.871967 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40bd9fc4-9504-43ff-be87-5ef0d0d324f9 admin admin] RBAC: Authorization granted {{(pid=71939) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 24 16:40:15.873665 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: [pid: 71939|app: 0|req: 705/1410] 10.222.0.53 () {56 vars in 1198 bytes} [Wed Nov 24 16:40:15 2021] GET /identity/v3/projects/6a75e77ca1684c808c57b448b83e73d2 => generated 298 bytes in 60 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 24 16:40:15.886671 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63827a83-9625-4308-a182-9f7a1a062be4 None None] Authenticating user token {{(pid=71938) process_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 24 16:40:15.896402 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63827a83-9625-4308-a182-9f7a1a062be4 None None] Validating token access rules against request {{(pid=71938) validate_allowed_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 24 16:40:15.899889 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e93b9b2e-fef3-4b77-a96c-219cdfaa83be service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c90f21b9cdcb413282461fa83cb6b7a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3b3940d4ae1c4177ae29c02377bb4b0b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=71938) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 24 16:40:15.900533 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e93b9b2e-fef3-4b77-a96c-219cdfaa83be service neutron] REQUEST_METHOD: `GET` {{(pid=71938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 24 16:40:15.900869 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e93b9b2e-fef3-4b77-a96c-219cdfaa83be service neutron] SCRIPT_NAME: `/identity` {{(pid=71938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 24 16:40:15.901201 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e93b9b2e-fef3-4b77-a96c-219cdfaa83be service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=71938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 24 16:40:15.910522 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e93b9b2e-fef3-4b77-a96c-219cdfaa83be service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=71938) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:442}} Nov 24 16:40:15.941416 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e93b9b2e-fef3-4b77-a96c-219cdfaa83be service neutron] RBAC: Authorization granted {{(pid=71938) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 24 16:40:15.951872 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: [pid: 71938|app: 0|req: 706/1411] 10.222.0.53 () {60 vars in 1356 bytes} [Wed Nov 24 16:40:15 2021] GET /identity/v3/auth/tokens => generated 3669 bytes in 66 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 24 16:40:18.549419 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adb45e84-441c-4eb2-a9ce-1513c6ecf364 None None] REQUEST_METHOD: `GET` {{(pid=71939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 24 16:40:18.549918 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adb45e84-441c-4eb2-a9ce-1513c6ecf364 None None] SCRIPT_NAME: `/identity` {{(pid=71939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 24 16:40:18.550044 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adb45e84-441c-4eb2-a9ce-1513c6ecf364 None None] PATH_INFO: `/` {{(pid=71939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 24 16:40:18.551902 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: [pid: 71939|app: 0|req: 706/1412] 10.222.0.53 () {54 vars in 915 bytes} [Wed Nov 24 16:40:18 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 24 16:40:18.557600 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b27bfb05-3462-4624-a8da-45af2566c54d None None] REQUEST_METHOD: `POST` {{(pid=71938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 24 16:40:18.558000 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b27bfb05-3462-4624-a8da-45af2566c54d None None] SCRIPT_NAME: `/identity` {{(pid=71938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 24 16:40:18.558408 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b27bfb05-3462-4624-a8da-45af2566c54d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=71938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 24 16:40:18.582200 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.auth.core [None req-b27bfb05-3462-4624-a8da-45af2566c54d None None] MFA Rules not processed for user `0f2ba2e8375b4e8c8792ee1e22b60427`. Rule list: `[]` (Enabled: `True`). {{(pid=71938) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:442}} Nov 24 16:40:18.583419 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.fernet_utils [None req-b27bfb05-3462-4624-a8da-45af2566c54d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=71938) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:289}} Nov 24 16:40:18.591320 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: [pid: 71938|app: 0|req: 707/1413] 10.222.0.53 () {58 vars in 1013 bytes} [Wed Nov 24 16:40:18 2021] POST /identity/v3/auth/tokens => generated 3669 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 24 16:40:18.619305 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddc88ac8-9fb2-42fb-841a-8e15d5dfd891 None None] REQUEST_METHOD: `POST` {{(pid=71939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 24 16:40:18.619684 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddc88ac8-9fb2-42fb-841a-8e15d5dfd891 None None] SCRIPT_NAME: `/identity` {{(pid=71939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 24 16:40:18.620024 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddc88ac8-9fb2-42fb-841a-8e15d5dfd891 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=71939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 24 16:40:18.644742 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.auth.core [None req-ddc88ac8-9fb2-42fb-841a-8e15d5dfd891 None None] MFA Rules not processed for user `0f2ba2e8375b4e8c8792ee1e22b60427`. Rule list: `[]` (Enabled: `True`). {{(pid=71939) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:442}} Nov 24 16:40:18.645996 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.fernet_utils [None req-ddc88ac8-9fb2-42fb-841a-8e15d5dfd891 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=71939) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:289}} Nov 24 16:40:18.653962 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: [pid: 71939|app: 0|req: 707/1414] 10.222.0.53 () {58 vars in 1013 bytes} [Wed Nov 24 16:40:18 2021] POST /identity/v3/auth/tokens => generated 3669 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 24 16:40:18.668565 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b27bfb05-3462-4624-a8da-45af2566c54d None None] Authenticating user token {{(pid=71938) process_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 24 16:40:18.678176 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b27bfb05-3462-4624-a8da-45af2566c54d None None] Validating token access rules against request {{(pid=71938) validate_allowed_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 24 16:40:18.682492 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d28b9a74-181b-40ec-858c-22d9bc60ed4f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f2ba2e8375b4e8c8792ee1e22b60427', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '00a5583c7b7443e98e7a1d31a0b638dc', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=71938) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 24 16:40:18.683360 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d28b9a74-181b-40ec-858c-22d9bc60ed4f admin admin] REQUEST_METHOD: `GET` {{(pid=71938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 24 16:40:18.683687 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d28b9a74-181b-40ec-858c-22d9bc60ed4f admin admin] SCRIPT_NAME: `/identity` {{(pid=71938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 24 16:40:18.684010 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d28b9a74-181b-40ec-858c-22d9bc60ed4f admin admin] PATH_INFO: `/v3/projects/6a75e77ca1684c808c57b448b83e73d2` {{(pid=71938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 24 16:40:18.685203 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d28b9a74-181b-40ec-858c-22d9bc60ed4f admin admin] RBAC: Authorizing `identity:get_project(project_id=6a75e77ca1684c808c57b448b83e73d2)` {{(pid=71938) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:442}} Nov 24 16:40:18.713997 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d28b9a74-181b-40ec-858c-22d9bc60ed4f admin admin] RBAC: Authorization granted {{(pid=71938) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 24 16:40:18.716182 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: [pid: 71938|app: 0|req: 708/1415] 10.222.0.53 () {56 vars in 1198 bytes} [Wed Nov 24 16:40:18 2021] GET /identity/v3/projects/6a75e77ca1684c808c57b448b83e73d2 => generated 298 bytes in 49 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 24 16:40:18.728928 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddc88ac8-9fb2-42fb-841a-8e15d5dfd891 None None] Authenticating user token {{(pid=71939) process_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 24 16:40:18.739030 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddc88ac8-9fb2-42fb-841a-8e15d5dfd891 None None] Validating token access rules against request {{(pid=71939) validate_allowed_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 24 16:40:18.742554 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb0bd205-dae8-480d-9cfb-f2969868283e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c90f21b9cdcb413282461fa83cb6b7a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3b3940d4ae1c4177ae29c02377bb4b0b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=71939) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 24 16:40:18.743196 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb0bd205-dae8-480d-9cfb-f2969868283e service neutron] REQUEST_METHOD: `GET` {{(pid=71939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 24 16:40:18.743536 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb0bd205-dae8-480d-9cfb-f2969868283e service neutron] SCRIPT_NAME: `/identity` {{(pid=71939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 24 16:40:18.743893 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb0bd205-dae8-480d-9cfb-f2969868283e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=71939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 24 16:40:18.753175 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb0bd205-dae8-480d-9cfb-f2969868283e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=71939) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:442}} Nov 24 16:40:18.781666 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb0bd205-dae8-480d-9cfb-f2969868283e service neutron] RBAC: Authorization granted {{(pid=71939) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 24 16:40:18.791233 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: [pid: 71939|app: 0|req: 708/1416] 10.222.0.53 () {60 vars in 1356 bytes} [Wed Nov 24 16:40:18 2021] GET /identity/v3/auth/tokens => generated 3669 bytes in 63 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 24 16:40:21.506492 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d2a320c-a714-4156-89c9-0fd62b72201b None None] REQUEST_METHOD: `GET` {{(pid=71938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 24 16:40:21.507048 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d2a320c-a714-4156-89c9-0fd62b72201b None None] SCRIPT_NAME: `/identity` {{(pid=71938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 24 16:40:21.507048 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d2a320c-a714-4156-89c9-0fd62b72201b None None] PATH_INFO: `/` {{(pid=71938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 24 16:40:21.508875 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: [pid: 71938|app: 0|req: 709/1417] 10.222.0.53 () {54 vars in 915 bytes} [Wed Nov 24 16:40:21 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 24 16:40:21.515122 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-588843d1-aba6-4a89-a9f0-cdab019529dd None None] REQUEST_METHOD: `POST` {{(pid=71939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 24 16:40:21.515551 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-588843d1-aba6-4a89-a9f0-cdab019529dd None None] SCRIPT_NAME: `/identity` {{(pid=71939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 24 16:40:21.515961 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-588843d1-aba6-4a89-a9f0-cdab019529dd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=71939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 24 16:40:21.540153 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.auth.core [None req-588843d1-aba6-4a89-a9f0-cdab019529dd None None] MFA Rules not processed for user `0f2ba2e8375b4e8c8792ee1e22b60427`. Rule list: `[]` (Enabled: `True`). {{(pid=71939) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:442}} Nov 24 16:40:21.541365 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.fernet_utils [None req-588843d1-aba6-4a89-a9f0-cdab019529dd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=71939) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:289}} Nov 24 16:40:21.549476 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: [pid: 71939|app: 0|req: 709/1418] 10.222.0.53 () {58 vars in 1013 bytes} [Wed Nov 24 16:40:21 2021] POST /identity/v3/auth/tokens => generated 3669 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 24 16:40:21.574188 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91870645-24a2-44e6-9ff5-3cadd13c09bf None None] REQUEST_METHOD: `POST` {{(pid=71938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 24 16:40:21.574530 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91870645-24a2-44e6-9ff5-3cadd13c09bf None None] SCRIPT_NAME: `/identity` {{(pid=71938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 24 16:40:21.574864 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91870645-24a2-44e6-9ff5-3cadd13c09bf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=71938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 24 16:40:21.598957 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.auth.core [None req-91870645-24a2-44e6-9ff5-3cadd13c09bf None None] MFA Rules not processed for user `0f2ba2e8375b4e8c8792ee1e22b60427`. Rule list: `[]` (Enabled: `True`). {{(pid=71938) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:442}} Nov 24 16:40:21.600147 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.fernet_utils [None req-91870645-24a2-44e6-9ff5-3cadd13c09bf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=71938) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:289}} Nov 24 16:40:21.608163 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: [pid: 71938|app: 0|req: 710/1419] 10.222.0.53 () {58 vars in 1013 bytes} [Wed Nov 24 16:40:21 2021] POST /identity/v3/auth/tokens => generated 3669 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 24 16:40:21.626603 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-588843d1-aba6-4a89-a9f0-cdab019529dd None None] Authenticating user token {{(pid=71939) process_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 24 16:40:21.636344 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-588843d1-aba6-4a89-a9f0-cdab019529dd None None] Validating token access rules against request {{(pid=71939) validate_allowed_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 24 16:40:21.640027 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-311b4643-c5ba-44e7-afdb-0c46994657fe service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c90f21b9cdcb413282461fa83cb6b7a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3b3940d4ae1c4177ae29c02377bb4b0b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=71939) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 24 16:40:21.640681 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-311b4643-c5ba-44e7-afdb-0c46994657fe service neutron] REQUEST_METHOD: `GET` {{(pid=71939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 24 16:40:21.641020 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-311b4643-c5ba-44e7-afdb-0c46994657fe service neutron] SCRIPT_NAME: `/identity` {{(pid=71939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 24 16:40:21.641397 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-311b4643-c5ba-44e7-afdb-0c46994657fe service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=71939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 24 16:40:21.650841 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-311b4643-c5ba-44e7-afdb-0c46994657fe service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=71939) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:442}} Nov 24 16:40:21.679946 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-311b4643-c5ba-44e7-afdb-0c46994657fe service neutron] RBAC: Authorization granted {{(pid=71939) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 24 16:40:21.690346 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: [pid: 71939|app: 0|req: 710/1420] 10.222.0.53 () {60 vars in 1356 bytes} [Wed Nov 24 16:40:21 2021] GET /identity/v3/auth/tokens => generated 3669 bytes in 64 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 24 16:40:23.798504 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ce484de-523a-40c9-a381-a82dc1fe7b05 None None] REQUEST_METHOD: `GET` {{(pid=71938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 24 16:40:23.799013 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ce484de-523a-40c9-a381-a82dc1fe7b05 None None] SCRIPT_NAME: `/identity` {{(pid=71938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 24 16:40:23.799144 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ce484de-523a-40c9-a381-a82dc1fe7b05 None None] PATH_INFO: `/` {{(pid=71938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 24 16:40:23.801004 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: [pid: 71938|app: 0|req: 711/1421] 10.222.0.53 () {54 vars in 915 bytes} [Wed Nov 24 16:40:23 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 24 16:40:23.806954 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eff32b63-e6e0-44c3-9eb5-40fe11f942ab None None] REQUEST_METHOD: `POST` {{(pid=71939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 24 16:40:23.807313 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eff32b63-e6e0-44c3-9eb5-40fe11f942ab None None] SCRIPT_NAME: `/identity` {{(pid=71939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 24 16:40:23.807658 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eff32b63-e6e0-44c3-9eb5-40fe11f942ab None None] PATH_INFO: `/v3/auth/tokens` {{(pid=71939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 24 16:40:23.832547 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.auth.core [None req-eff32b63-e6e0-44c3-9eb5-40fe11f942ab None None] MFA Rules not processed for user `0f2ba2e8375b4e8c8792ee1e22b60427`. Rule list: `[]` (Enabled: `True`). {{(pid=71939) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:442}} Nov 24 16:40:23.833844 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.fernet_utils [None req-eff32b63-e6e0-44c3-9eb5-40fe11f942ab None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=71939) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:289}} Nov 24 16:40:23.842650 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: [pid: 71939|app: 0|req: 711/1422] 10.222.0.53 () {58 vars in 1013 bytes} [Wed Nov 24 16:40:23 2021] POST /identity/v3/auth/tokens => generated 3669 bytes in 37 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 24 16:40:23.867775 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71f1c74a-33e3-442c-a237-5a00f2f4ff8f None None] REQUEST_METHOD: `POST` {{(pid=71938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 24 16:40:23.868124 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71f1c74a-33e3-442c-a237-5a00f2f4ff8f None None] SCRIPT_NAME: `/identity` {{(pid=71938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 24 16:40:23.868448 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71f1c74a-33e3-442c-a237-5a00f2f4ff8f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=71938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 24 16:40:23.893738 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.auth.core [None req-71f1c74a-33e3-442c-a237-5a00f2f4ff8f None None] MFA Rules not processed for user `0f2ba2e8375b4e8c8792ee1e22b60427`. Rule list: `[]` (Enabled: `True`). {{(pid=71938) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:442}} Nov 24 16:40:23.895054 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.fernet_utils [None req-71f1c74a-33e3-442c-a237-5a00f2f4ff8f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=71938) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:289}} Nov 24 16:40:23.903400 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: [pid: 71938|app: 0|req: 712/1423] 10.222.0.53 () {58 vars in 1013 bytes} [Wed Nov 24 16:40:23 2021] POST /identity/v3/auth/tokens => generated 3669 bytes in 37 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 24 16:40:23.922593 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eff32b63-e6e0-44c3-9eb5-40fe11f942ab None None] Authenticating user token {{(pid=71939) process_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 24 16:40:23.932255 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eff32b63-e6e0-44c3-9eb5-40fe11f942ab None None] Validating token access rules against request {{(pid=71939) validate_allowed_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 24 16:40:23.935855 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b92cf8f8-e95d-42ad-8bb8-e324820bff93 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c90f21b9cdcb413282461fa83cb6b7a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3b3940d4ae1c4177ae29c02377bb4b0b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=71939) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 24 16:40:23.936502 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b92cf8f8-e95d-42ad-8bb8-e324820bff93 service neutron] REQUEST_METHOD: `GET` {{(pid=71939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 24 16:40:23.936840 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b92cf8f8-e95d-42ad-8bb8-e324820bff93 service neutron] SCRIPT_NAME: `/identity` {{(pid=71939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 24 16:40:23.937173 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b92cf8f8-e95d-42ad-8bb8-e324820bff93 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=71939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 24 16:40:23.946967 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b92cf8f8-e95d-42ad-8bb8-e324820bff93 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=71939) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:442}} Nov 24 16:40:23.977604 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b92cf8f8-e95d-42ad-8bb8-e324820bff93 service neutron] RBAC: Authorization granted {{(pid=71939) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 24 16:40:23.988409 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: [pid: 71939|app: 0|req: 712/1424] 10.222.0.53 () {60 vars in 1356 bytes} [Wed Nov 24 16:40:23 2021] GET /identity/v3/auth/tokens => generated 3669 bytes in 66 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 24 16:40:26.086466 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2886bd5-134a-4bd3-98d2-c71e5fa161bd None None] REQUEST_METHOD: `GET` {{(pid=71938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 24 16:40:26.086983 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2886bd5-134a-4bd3-98d2-c71e5fa161bd None None] SCRIPT_NAME: `/identity` {{(pid=71938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 24 16:40:26.087114 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2886bd5-134a-4bd3-98d2-c71e5fa161bd None None] PATH_INFO: `/` {{(pid=71938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 24 16:40:26.089505 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: [pid: 71938|app: 0|req: 713/1425] 10.222.0.53 () {54 vars in 915 bytes} [Wed Nov 24 16:40:26 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 24 16:40:26.095744 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b071f4c-aaa6-4850-b8fc-40011b8df8bf None None] REQUEST_METHOD: `POST` {{(pid=71939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 24 16:40:26.096092 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b071f4c-aaa6-4850-b8fc-40011b8df8bf None None] SCRIPT_NAME: `/identity` {{(pid=71939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 24 16:40:26.096430 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b071f4c-aaa6-4850-b8fc-40011b8df8bf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=71939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 24 16:40:26.121202 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.auth.core [None req-6b071f4c-aaa6-4850-b8fc-40011b8df8bf None None] MFA Rules not processed for user `0f2ba2e8375b4e8c8792ee1e22b60427`. Rule list: `[]` (Enabled: `True`). {{(pid=71939) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:442}} Nov 24 16:40:26.122512 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.fernet_utils [None req-6b071f4c-aaa6-4850-b8fc-40011b8df8bf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=71939) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:289}} Nov 24 16:40:26.130074 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: [pid: 71939|app: 0|req: 713/1426] 10.222.0.53 () {58 vars in 1013 bytes} [Wed Nov 24 16:40:26 2021] POST /identity/v3/auth/tokens => generated 3669 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 24 16:40:26.156352 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef28aa07-7ad4-4696-a7b0-1c9d67c5f9bb None None] REQUEST_METHOD: `POST` {{(pid=71938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 24 16:40:26.156707 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef28aa07-7ad4-4696-a7b0-1c9d67c5f9bb None None] SCRIPT_NAME: `/identity` {{(pid=71938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 24 16:40:26.157094 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef28aa07-7ad4-4696-a7b0-1c9d67c5f9bb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=71938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 24 16:40:26.183975 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.auth.core [None req-ef28aa07-7ad4-4696-a7b0-1c9d67c5f9bb None None] MFA Rules not processed for user `0f2ba2e8375b4e8c8792ee1e22b60427`. Rule list: `[]` (Enabled: `True`). {{(pid=71938) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:442}} Nov 24 16:40:26.185353 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.fernet_utils [None req-ef28aa07-7ad4-4696-a7b0-1c9d67c5f9bb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=71938) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:289}} Nov 24 16:40:26.194131 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: [pid: 71938|app: 0|req: 714/1427] 10.222.0.53 () {58 vars in 1013 bytes} [Wed Nov 24 16:40:26 2021] POST /identity/v3/auth/tokens => generated 3669 bytes in 39 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 24 16:40:26.208419 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b071f4c-aaa6-4850-b8fc-40011b8df8bf None None] Authenticating user token {{(pid=71939) process_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 24 16:40:26.219356 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b071f4c-aaa6-4850-b8fc-40011b8df8bf None None] Validating token access rules against request {{(pid=71939) validate_allowed_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 24 16:40:26.223970 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d82423f-f899-4b3a-80f2-33e07202696d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f2ba2e8375b4e8c8792ee1e22b60427', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '00a5583c7b7443e98e7a1d31a0b638dc', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=71939) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 24 16:40:26.224841 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d82423f-f899-4b3a-80f2-33e07202696d admin admin] REQUEST_METHOD: `GET` {{(pid=71939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 24 16:40:26.225160 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d82423f-f899-4b3a-80f2-33e07202696d admin admin] SCRIPT_NAME: `/identity` {{(pid=71939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 24 16:40:26.225490 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d82423f-f899-4b3a-80f2-33e07202696d admin admin] PATH_INFO: `/v3/projects/6a75e77ca1684c808c57b448b83e73d2` {{(pid=71939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 24 16:40:26.226745 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d82423f-f899-4b3a-80f2-33e07202696d admin admin] RBAC: Authorizing `identity:get_project(project_id=6a75e77ca1684c808c57b448b83e73d2)` {{(pid=71939) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:442}} Nov 24 16:40:26.255823 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d82423f-f899-4b3a-80f2-33e07202696d admin admin] RBAC: Authorization granted {{(pid=71939) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 24 16:40:26.257576 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: [pid: 71939|app: 0|req: 714/1428] 10.222.0.53 () {56 vars in 1198 bytes} [Wed Nov 24 16:40:26 2021] GET /identity/v3/projects/6a75e77ca1684c808c57b448b83e73d2 => generated 298 bytes in 50 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 24 16:40:26.270520 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef28aa07-7ad4-4696-a7b0-1c9d67c5f9bb None None] Authenticating user token {{(pid=71938) process_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 24 16:40:26.282005 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef28aa07-7ad4-4696-a7b0-1c9d67c5f9bb None None] Validating token access rules against request {{(pid=71938) validate_allowed_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 24 16:40:26.285759 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55bf6c36-bae5-4e8d-b574-708c8242267e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c90f21b9cdcb413282461fa83cb6b7a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3b3940d4ae1c4177ae29c02377bb4b0b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=71938) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 24 16:40:26.287105 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55bf6c36-bae5-4e8d-b574-708c8242267e service neutron] REQUEST_METHOD: `GET` {{(pid=71938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 24 16:40:26.287454 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55bf6c36-bae5-4e8d-b574-708c8242267e service neutron] SCRIPT_NAME: `/identity` {{(pid=71938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 24 16:40:26.287790 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55bf6c36-bae5-4e8d-b574-708c8242267e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=71938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 24 16:40:26.298398 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55bf6c36-bae5-4e8d-b574-708c8242267e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=71938) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:442}} Nov 24 16:40:26.327009 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55bf6c36-bae5-4e8d-b574-708c8242267e service neutron] RBAC: Authorization granted {{(pid=71938) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 24 16:40:26.336867 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: [pid: 71938|app: 0|req: 715/1429] 10.222.0.53 () {60 vars in 1356 bytes} [Wed Nov 24 16:40:26 2021] GET /identity/v3/auth/tokens => generated 3669 bytes in 67 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 24 16:40:28.594438 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c440a93c-4669-4340-8c05-4f0e9f13a6a4 None None] REQUEST_METHOD: `GET` {{(pid=71939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 24 16:40:28.594935 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c440a93c-4669-4340-8c05-4f0e9f13a6a4 None None] SCRIPT_NAME: `/identity` {{(pid=71939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 24 16:40:28.595040 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c440a93c-4669-4340-8c05-4f0e9f13a6a4 None None] PATH_INFO: `/` {{(pid=71939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 24 16:40:28.596847 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: [pid: 71939|app: 0|req: 715/1430] 10.222.0.53 () {54 vars in 915 bytes} [Wed Nov 24 16:40:28 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 24 16:40:28.602679 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68dc9b98-fb6d-4110-92b4-74396dd624f7 None None] REQUEST_METHOD: `POST` {{(pid=71938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 24 16:40:28.603030 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68dc9b98-fb6d-4110-92b4-74396dd624f7 None None] SCRIPT_NAME: `/identity` {{(pid=71938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 24 16:40:28.603366 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68dc9b98-fb6d-4110-92b4-74396dd624f7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=71938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 24 16:40:28.627967 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.auth.core [None req-68dc9b98-fb6d-4110-92b4-74396dd624f7 None None] MFA Rules not processed for user `0f2ba2e8375b4e8c8792ee1e22b60427`. Rule list: `[]` (Enabled: `True`). {{(pid=71938) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:442}} Nov 24 16:40:28.629179 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.fernet_utils [None req-68dc9b98-fb6d-4110-92b4-74396dd624f7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=71938) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:289}} Nov 24 16:40:28.636590 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: [pid: 71938|app: 0|req: 716/1431] 10.222.0.53 () {58 vars in 1013 bytes} [Wed Nov 24 16:40:28 2021] POST /identity/v3/auth/tokens => generated 3669 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 24 16:40:28.661010 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ef659ff-ec87-4a3b-8389-65e604efb3fd None None] REQUEST_METHOD: `POST` {{(pid=71939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 24 16:40:28.661399 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ef659ff-ec87-4a3b-8389-65e604efb3fd None None] SCRIPT_NAME: `/identity` {{(pid=71939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 24 16:40:28.661730 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ef659ff-ec87-4a3b-8389-65e604efb3fd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=71939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 24 16:40:28.685982 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.auth.core [None req-4ef659ff-ec87-4a3b-8389-65e604efb3fd None None] MFA Rules not processed for user `0f2ba2e8375b4e8c8792ee1e22b60427`. Rule list: `[]` (Enabled: `True`). {{(pid=71939) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:442}} Nov 24 16:40:28.687225 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.fernet_utils [None req-4ef659ff-ec87-4a3b-8389-65e604efb3fd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=71939) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:289}} Nov 24 16:40:28.694563 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: [pid: 71939|app: 0|req: 716/1432] 10.222.0.53 () {58 vars in 1013 bytes} [Wed Nov 24 16:40:28 2021] POST /identity/v3/auth/tokens => generated 3669 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 24 16:40:28.713463 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68dc9b98-fb6d-4110-92b4-74396dd624f7 None None] Authenticating user token {{(pid=71938) process_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 24 16:40:28.723333 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68dc9b98-fb6d-4110-92b4-74396dd624f7 None None] Validating token access rules against request {{(pid=71938) validate_allowed_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 24 16:40:28.726944 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c593e762-1f5e-4132-a11d-7ca2938866a6 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c90f21b9cdcb413282461fa83cb6b7a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3b3940d4ae1c4177ae29c02377bb4b0b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=71938) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 24 16:40:28.727595 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c593e762-1f5e-4132-a11d-7ca2938866a6 service neutron] REQUEST_METHOD: `GET` {{(pid=71938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 24 16:40:28.727938 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c593e762-1f5e-4132-a11d-7ca2938866a6 service neutron] SCRIPT_NAME: `/identity` {{(pid=71938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 24 16:40:28.728284 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c593e762-1f5e-4132-a11d-7ca2938866a6 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=71938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 24 16:40:28.738661 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c593e762-1f5e-4132-a11d-7ca2938866a6 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=71938) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:442}} Nov 24 16:40:28.767295 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c593e762-1f5e-4132-a11d-7ca2938866a6 service neutron] RBAC: Authorization granted {{(pid=71938) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 24 16:40:28.776914 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: [pid: 71938|app: 0|req: 717/1433] 10.222.0.53 () {60 vars in 1356 bytes} [Wed Nov 24 16:40:28 2021] GET /identity/v3/auth/tokens => generated 3669 bytes in 64 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 24 16:40:30.861580 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cc45d85-9d7f-40e8-93d5-958101e30cd1 None None] REQUEST_METHOD: `GET` {{(pid=71939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 24 16:40:30.862119 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cc45d85-9d7f-40e8-93d5-958101e30cd1 None None] SCRIPT_NAME: `/identity` {{(pid=71939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 24 16:40:30.862230 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cc45d85-9d7f-40e8-93d5-958101e30cd1 None None] PATH_INFO: `/` {{(pid=71939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 24 16:40:30.864068 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: [pid: 71939|app: 0|req: 717/1434] 10.222.0.53 () {54 vars in 915 bytes} [Wed Nov 24 16:40:30 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 24 16:40:30.869853 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc6f716a-926e-48f7-9321-bdde9e8701c3 None None] REQUEST_METHOD: `POST` {{(pid=71938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 24 16:40:30.870875 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc6f716a-926e-48f7-9321-bdde9e8701c3 None None] SCRIPT_NAME: `/identity` {{(pid=71938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 24 16:40:30.871219 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc6f716a-926e-48f7-9321-bdde9e8701c3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=71938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 24 16:40:30.894732 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.auth.core [None req-dc6f716a-926e-48f7-9321-bdde9e8701c3 None None] MFA Rules not processed for user `0f2ba2e8375b4e8c8792ee1e22b60427`. Rule list: `[]` (Enabled: `True`). {{(pid=71938) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:442}} Nov 24 16:40:30.895942 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.fernet_utils [None req-dc6f716a-926e-48f7-9321-bdde9e8701c3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=71938) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:289}} Nov 24 16:40:30.903338 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: [pid: 71938|app: 0|req: 718/1435] 10.222.0.53 () {58 vars in 1013 bytes} [Wed Nov 24 16:40:30 2021] POST /identity/v3/auth/tokens => generated 3669 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 24 16:40:30.931732 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5457e520-d9c8-4fdf-86f6-c0bc10b37320 None None] REQUEST_METHOD: `POST` {{(pid=71939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 24 16:40:30.932078 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5457e520-d9c8-4fdf-86f6-c0bc10b37320 None None] SCRIPT_NAME: `/identity` {{(pid=71939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 24 16:40:30.932413 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5457e520-d9c8-4fdf-86f6-c0bc10b37320 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=71939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 24 16:40:30.956046 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.auth.core [None req-5457e520-d9c8-4fdf-86f6-c0bc10b37320 None None] MFA Rules not processed for user `0f2ba2e8375b4e8c8792ee1e22b60427`. Rule list: `[]` (Enabled: `True`). {{(pid=71939) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:442}} Nov 24 16:40:30.957253 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.fernet_utils [None req-5457e520-d9c8-4fdf-86f6-c0bc10b37320 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=71939) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:289}} Nov 24 16:40:30.964670 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: [pid: 71939|app: 0|req: 718/1436] 10.222.0.53 () {58 vars in 1013 bytes} [Wed Nov 24 16:40:30 2021] POST /identity/v3/auth/tokens => generated 3669 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 24 16:40:30.985055 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc6f716a-926e-48f7-9321-bdde9e8701c3 None None] Authenticating user token {{(pid=71938) process_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 24 16:40:30.994861 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc6f716a-926e-48f7-9321-bdde9e8701c3 None None] Validating token access rules against request {{(pid=71938) validate_allowed_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 24 16:40:30.999481 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42307a27-24e1-40eb-b81f-048e988b2fa9 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c90f21b9cdcb413282461fa83cb6b7a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3b3940d4ae1c4177ae29c02377bb4b0b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=71938) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 24 16:40:31.000133 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42307a27-24e1-40eb-b81f-048e988b2fa9 service neutron] REQUEST_METHOD: `GET` {{(pid=71938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 24 16:40:31.000474 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42307a27-24e1-40eb-b81f-048e988b2fa9 service neutron] SCRIPT_NAME: `/identity` {{(pid=71938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 24 16:40:31.000809 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42307a27-24e1-40eb-b81f-048e988b2fa9 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=71938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 24 16:40:31.009959 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42307a27-24e1-40eb-b81f-048e988b2fa9 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=71938) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:442}} Nov 24 16:40:31.038010 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42307a27-24e1-40eb-b81f-048e988b2fa9 service neutron] RBAC: Authorization granted {{(pid=71938) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 24 16:40:31.048198 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: [pid: 71938|app: 0|req: 719/1437] 10.222.0.53 () {60 vars in 1356 bytes} [Wed Nov 24 16:40:30 2021] GET /identity/v3/auth/tokens => generated 3669 bytes in 64 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 24 16:40:33.619089 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e3649e3-96ce-4407-992b-f2413ed88edd None None] REQUEST_METHOD: `GET` {{(pid=71939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 24 16:40:33.619585 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e3649e3-96ce-4407-992b-f2413ed88edd None None] SCRIPT_NAME: `/identity` {{(pid=71939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 24 16:40:33.619691 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e3649e3-96ce-4407-992b-f2413ed88edd None None] PATH_INFO: `/` {{(pid=71939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 24 16:40:33.621544 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: [pid: 71939|app: 0|req: 719/1438] 10.222.0.53 () {54 vars in 915 bytes} [Wed Nov 24 16:40:33 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 24 16:40:33.627617 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7eaee748-4a6b-46fb-8715-d2ed25b9aded None None] REQUEST_METHOD: `POST` {{(pid=71938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 24 16:40:33.627971 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7eaee748-4a6b-46fb-8715-d2ed25b9aded None None] SCRIPT_NAME: `/identity` {{(pid=71938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 24 16:40:33.628311 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7eaee748-4a6b-46fb-8715-d2ed25b9aded None None] PATH_INFO: `/v3/auth/tokens` {{(pid=71938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 24 16:40:33.652623 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.auth.core [None req-7eaee748-4a6b-46fb-8715-d2ed25b9aded None None] MFA Rules not processed for user `0f2ba2e8375b4e8c8792ee1e22b60427`. Rule list: `[]` (Enabled: `True`). {{(pid=71938) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:442}} Nov 24 16:40:33.653850 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.fernet_utils [None req-7eaee748-4a6b-46fb-8715-d2ed25b9aded None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=71938) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:289}} Nov 24 16:40:33.661269 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: [pid: 71938|app: 0|req: 720/1439] 10.222.0.53 () {58 vars in 1013 bytes} [Wed Nov 24 16:40:33 2021] POST /identity/v3/auth/tokens => generated 3669 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 24 16:40:33.686046 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85713f09-aeb8-4f60-b2b2-52cec3dca24c None None] REQUEST_METHOD: `POST` {{(pid=71939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 24 16:40:33.686432 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85713f09-aeb8-4f60-b2b2-52cec3dca24c None None] SCRIPT_NAME: `/identity` {{(pid=71939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 24 16:40:33.686776 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85713f09-aeb8-4f60-b2b2-52cec3dca24c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=71939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 24 16:40:33.709950 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.auth.core [None req-85713f09-aeb8-4f60-b2b2-52cec3dca24c None None] MFA Rules not processed for user `0f2ba2e8375b4e8c8792ee1e22b60427`. Rule list: `[]` (Enabled: `True`). {{(pid=71939) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:442}} Nov 24 16:40:33.711199 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.fernet_utils [None req-85713f09-aeb8-4f60-b2b2-52cec3dca24c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=71939) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:289}} Nov 24 16:40:33.719155 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: [pid: 71939|app: 0|req: 720/1440] 10.222.0.53 () {58 vars in 1013 bytes} [Wed Nov 24 16:40:33 2021] POST /identity/v3/auth/tokens => generated 3669 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 24 16:40:33.739386 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7eaee748-4a6b-46fb-8715-d2ed25b9aded None None] Authenticating user token {{(pid=71938) process_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 24 16:40:33.749202 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7eaee748-4a6b-46fb-8715-d2ed25b9aded None None] Validating token access rules against request {{(pid=71938) validate_allowed_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 24 16:40:33.752725 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e18e0677-ac55-457e-b93b-bcd8ff2c5954 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c90f21b9cdcb413282461fa83cb6b7a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3b3940d4ae1c4177ae29c02377bb4b0b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=71938) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 24 16:40:33.753374 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e18e0677-ac55-457e-b93b-bcd8ff2c5954 service neutron] REQUEST_METHOD: `GET` {{(pid=71938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 24 16:40:33.753714 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e18e0677-ac55-457e-b93b-bcd8ff2c5954 service neutron] SCRIPT_NAME: `/identity` {{(pid=71938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 24 16:40:33.754054 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e18e0677-ac55-457e-b93b-bcd8ff2c5954 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=71938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 24 16:40:33.763280 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e18e0677-ac55-457e-b93b-bcd8ff2c5954 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=71938) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:442}} Nov 24 16:40:33.792783 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e18e0677-ac55-457e-b93b-bcd8ff2c5954 service neutron] RBAC: Authorization granted {{(pid=71938) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 24 16:40:33.802380 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: [pid: 71938|app: 0|req: 721/1441] 10.222.0.53 () {60 vars in 1356 bytes} [Wed Nov 24 16:40:33 2021] GET /identity/v3/auth/tokens => generated 3669 bytes in 64 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 24 16:40:38.428818 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fff48c25-5be2-425d-a55b-1c06796b768f None None] REQUEST_METHOD: `GET` {{(pid=71939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 24 16:40:38.429300 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fff48c25-5be2-425d-a55b-1c06796b768f None None] SCRIPT_NAME: `/identity` {{(pid=71939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 24 16:40:38.429482 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fff48c25-5be2-425d-a55b-1c06796b768f None None] PATH_INFO: `/` {{(pid=71939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 24 16:40:38.431387 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: [pid: 71939|app: 0|req: 721/1442] 10.222.0.53 () {54 vars in 915 bytes} [Wed Nov 24 16:40:38 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 24 16:40:38.437697 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b2c851b-7e94-4583-9994-28d138c3a75f None None] REQUEST_METHOD: `POST` {{(pid=71938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 24 16:40:38.438082 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b2c851b-7e94-4583-9994-28d138c3a75f None None] SCRIPT_NAME: `/identity` {{(pid=71938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 24 16:40:38.438672 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b2c851b-7e94-4583-9994-28d138c3a75f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=71938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 24 16:40:38.462596 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.auth.core [None req-9b2c851b-7e94-4583-9994-28d138c3a75f None None] MFA Rules not processed for user `0f2ba2e8375b4e8c8792ee1e22b60427`. Rule list: `[]` (Enabled: `True`). {{(pid=71938) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:442}} Nov 24 16:40:38.463862 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.fernet_utils [None req-9b2c851b-7e94-4583-9994-28d138c3a75f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=71938) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:289}} Nov 24 16:40:38.471462 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: [pid: 71938|app: 0|req: 722/1443] 10.222.0.53 () {58 vars in 1013 bytes} [Wed Nov 24 16:40:38 2021] POST /identity/v3/auth/tokens => generated 3669 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 24 16:40:38.500624 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84d4a3f9-9a2d-4698-a508-c7b4e95ba2d1 None None] REQUEST_METHOD: `POST` {{(pid=71939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 24 16:40:38.500972 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84d4a3f9-9a2d-4698-a508-c7b4e95ba2d1 None None] SCRIPT_NAME: `/identity` {{(pid=71939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 24 16:40:38.501310 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84d4a3f9-9a2d-4698-a508-c7b4e95ba2d1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=71939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 24 16:40:38.524308 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.auth.core [None req-84d4a3f9-9a2d-4698-a508-c7b4e95ba2d1 None None] MFA Rules not processed for user `0f2ba2e8375b4e8c8792ee1e22b60427`. Rule list: `[]` (Enabled: `True`). {{(pid=71939) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:442}} Nov 24 16:40:38.525526 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.fernet_utils [None req-84d4a3f9-9a2d-4698-a508-c7b4e95ba2d1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=71939) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:289}} Nov 24 16:40:38.533323 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: [pid: 71939|app: 0|req: 722/1444] 10.222.0.53 () {58 vars in 1013 bytes} [Wed Nov 24 16:40:38 2021] POST /identity/v3/auth/tokens => generated 3669 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 24 16:40:38.553777 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b2c851b-7e94-4583-9994-28d138c3a75f None None] Authenticating user token {{(pid=71938) process_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 24 16:40:38.564739 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b2c851b-7e94-4583-9994-28d138c3a75f None None] Validating token access rules against request {{(pid=71938) validate_allowed_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 24 16:40:38.568296 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c8ea346-a348-4069-b7e2-8752a720da9d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c90f21b9cdcb413282461fa83cb6b7a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3b3940d4ae1c4177ae29c02377bb4b0b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=71938) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 24 16:40:38.568934 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c8ea346-a348-4069-b7e2-8752a720da9d service neutron] REQUEST_METHOD: `GET` {{(pid=71938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 24 16:40:38.569271 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c8ea346-a348-4069-b7e2-8752a720da9d service neutron] SCRIPT_NAME: `/identity` {{(pid=71938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 24 16:40:38.569602 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c8ea346-a348-4069-b7e2-8752a720da9d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=71938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 24 16:40:38.579105 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c8ea346-a348-4069-b7e2-8752a720da9d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=71938) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:442}} Nov 24 16:40:38.608317 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c8ea346-a348-4069-b7e2-8752a720da9d service neutron] RBAC: Authorization granted {{(pid=71938) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 24 16:40:38.618090 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: [pid: 71938|app: 0|req: 723/1445] 10.222.0.53 () {60 vars in 1356 bytes} [Wed Nov 24 16:40:38 2021] GET /identity/v3/auth/tokens => generated 3669 bytes in 65 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 24 16:40:41.455041 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7496ed24-a762-4eea-9473-60fb8d4563f2 None None] REQUEST_METHOD: `GET` {{(pid=71939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 24 16:40:41.455574 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7496ed24-a762-4eea-9473-60fb8d4563f2 None None] SCRIPT_NAME: `/identity` {{(pid=71939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 24 16:40:41.455699 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7496ed24-a762-4eea-9473-60fb8d4563f2 None None] PATH_INFO: `/` {{(pid=71939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 24 16:40:41.457561 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: [pid: 71939|app: 0|req: 723/1446] 10.222.0.53 () {54 vars in 915 bytes} [Wed Nov 24 16:40:41 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 24 16:40:41.463603 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cfd3243-2a5f-4ce0-aadd-42ad90d7109c None None] REQUEST_METHOD: `POST` {{(pid=71938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 24 16:40:41.463959 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cfd3243-2a5f-4ce0-aadd-42ad90d7109c None None] SCRIPT_NAME: `/identity` {{(pid=71938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 24 16:40:41.464300 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cfd3243-2a5f-4ce0-aadd-42ad90d7109c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=71938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 24 16:40:41.488948 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.auth.core [None req-0cfd3243-2a5f-4ce0-aadd-42ad90d7109c None None] MFA Rules not processed for user `0f2ba2e8375b4e8c8792ee1e22b60427`. Rule list: `[]` (Enabled: `True`). {{(pid=71938) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:442}} Nov 24 16:40:41.490212 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.fernet_utils [None req-0cfd3243-2a5f-4ce0-aadd-42ad90d7109c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=71938) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:289}} Nov 24 16:40:41.498642 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: [pid: 71938|app: 0|req: 724/1447] 10.222.0.53 () {58 vars in 1013 bytes} [Wed Nov 24 16:40:41 2021] POST /identity/v3/auth/tokens => generated 3669 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 24 16:40:41.523564 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82f6a1ed-e45c-4db7-85b6-55a5ce9f8b61 None None] REQUEST_METHOD: `POST` {{(pid=71939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 24 16:40:41.523916 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82f6a1ed-e45c-4db7-85b6-55a5ce9f8b61 None None] SCRIPT_NAME: `/identity` {{(pid=71939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 24 16:40:41.524256 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82f6a1ed-e45c-4db7-85b6-55a5ce9f8b61 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=71939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 24 16:40:41.550065 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.auth.core [None req-82f6a1ed-e45c-4db7-85b6-55a5ce9f8b61 None None] MFA Rules not processed for user `0f2ba2e8375b4e8c8792ee1e22b60427`. Rule list: `[]` (Enabled: `True`). {{(pid=71939) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:442}} Nov 24 16:40:41.551331 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.fernet_utils [None req-82f6a1ed-e45c-4db7-85b6-55a5ce9f8b61 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=71939) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:289}} Nov 24 16:40:41.559859 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: [pid: 71939|app: 0|req: 724/1448] 10.222.0.53 () {58 vars in 1013 bytes} [Wed Nov 24 16:40:41 2021] POST /identity/v3/auth/tokens => generated 3669 bytes in 37 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 24 16:40:41.581043 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cfd3243-2a5f-4ce0-aadd-42ad90d7109c None None] Authenticating user token {{(pid=71938) process_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 24 16:40:41.595306 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cfd3243-2a5f-4ce0-aadd-42ad90d7109c None None] Validating token access rules against request {{(pid=71938) validate_allowed_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 24 16:40:41.598997 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29ad3014-141d-493f-a7b9-5a32a7ab0e55 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c90f21b9cdcb413282461fa83cb6b7a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3b3940d4ae1c4177ae29c02377bb4b0b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=71938) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 24 16:40:41.599647 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29ad3014-141d-493f-a7b9-5a32a7ab0e55 service neutron] REQUEST_METHOD: `GET` {{(pid=71938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 24 16:40:41.599989 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29ad3014-141d-493f-a7b9-5a32a7ab0e55 service neutron] SCRIPT_NAME: `/identity` {{(pid=71938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 24 16:40:41.600312 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29ad3014-141d-493f-a7b9-5a32a7ab0e55 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=71938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 24 16:40:41.610968 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29ad3014-141d-493f-a7b9-5a32a7ab0e55 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=71938) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:442}} Nov 24 16:40:41.640912 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29ad3014-141d-493f-a7b9-5a32a7ab0e55 service neutron] RBAC: Authorization granted {{(pid=71938) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 24 16:40:41.651924 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: [pid: 71938|app: 0|req: 725/1449] 10.222.0.53 () {60 vars in 1356 bytes} [Wed Nov 24 16:40:41 2021] GET /identity/v3/auth/tokens => generated 3669 bytes in 72 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 24 16:40:46.312045 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d54cf28-5c27-4a52-880c-6d1f86b54f62 None None] REQUEST_METHOD: `GET` {{(pid=71939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 24 16:40:46.312525 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d54cf28-5c27-4a52-880c-6d1f86b54f62 None None] SCRIPT_NAME: `/identity` {{(pid=71939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 24 16:40:46.312620 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d54cf28-5c27-4a52-880c-6d1f86b54f62 None None] PATH_INFO: `/` {{(pid=71939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 24 16:40:46.314865 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: [pid: 71939|app: 0|req: 725/1450] 10.222.0.53 () {54 vars in 915 bytes} [Wed Nov 24 16:40:46 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 24 16:40:46.320665 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89c7d758-767a-4001-8951-2c6071286b43 None None] REQUEST_METHOD: `POST` {{(pid=71938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 24 16:40:46.321020 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89c7d758-767a-4001-8951-2c6071286b43 None None] SCRIPT_NAME: `/identity` {{(pid=71938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 24 16:40:46.321362 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89c7d758-767a-4001-8951-2c6071286b43 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=71938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 24 16:40:46.347170 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.auth.core [None req-89c7d758-767a-4001-8951-2c6071286b43 None None] MFA Rules not processed for user `0f2ba2e8375b4e8c8792ee1e22b60427`. Rule list: `[]` (Enabled: `True`). {{(pid=71938) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:442}} Nov 24 16:40:46.348423 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.fernet_utils [None req-89c7d758-767a-4001-8951-2c6071286b43 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=71938) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:289}} Nov 24 16:40:46.357067 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: [pid: 71938|app: 0|req: 726/1451] 10.222.0.53 () {58 vars in 1013 bytes} [Wed Nov 24 16:40:46 2021] POST /identity/v3/auth/tokens => generated 3669 bytes in 37 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 24 16:40:46.382654 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06632043-e395-433a-89ac-535c9f13f72a None None] REQUEST_METHOD: `POST` {{(pid=71939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 24 16:40:46.383001 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06632043-e395-433a-89ac-535c9f13f72a None None] SCRIPT_NAME: `/identity` {{(pid=71939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 24 16:40:46.383339 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06632043-e395-433a-89ac-535c9f13f72a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=71939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 24 16:40:46.407620 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.auth.core [None req-06632043-e395-433a-89ac-535c9f13f72a None None] MFA Rules not processed for user `0f2ba2e8375b4e8c8792ee1e22b60427`. Rule list: `[]` (Enabled: `True`). {{(pid=71939) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:442}} Nov 24 16:40:46.408869 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.fernet_utils [None req-06632043-e395-433a-89ac-535c9f13f72a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=71939) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:289}} Nov 24 16:40:46.416672 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: [pid: 71939|app: 0|req: 726/1452] 10.222.0.53 () {58 vars in 1013 bytes} [Wed Nov 24 16:40:46 2021] POST /identity/v3/auth/tokens => generated 3669 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 24 16:40:46.437733 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89c7d758-767a-4001-8951-2c6071286b43 None None] Authenticating user token {{(pid=71938) process_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 24 16:40:46.448667 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89c7d758-767a-4001-8951-2c6071286b43 None None] Validating token access rules against request {{(pid=71938) validate_allowed_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 24 16:40:46.453351 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbb00f3b-36ca-48e7-b3a3-5afdcfd81a51 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c90f21b9cdcb413282461fa83cb6b7a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3b3940d4ae1c4177ae29c02377bb4b0b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=71938) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 24 16:40:46.454046 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbb00f3b-36ca-48e7-b3a3-5afdcfd81a51 service neutron] REQUEST_METHOD: `GET` {{(pid=71938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 24 16:40:46.454397 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbb00f3b-36ca-48e7-b3a3-5afdcfd81a51 service neutron] SCRIPT_NAME: `/identity` {{(pid=71938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 24 16:40:46.454731 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbb00f3b-36ca-48e7-b3a3-5afdcfd81a51 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=71938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 24 16:40:46.465721 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbb00f3b-36ca-48e7-b3a3-5afdcfd81a51 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=71938) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:442}} Nov 24 16:40:46.493956 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbb00f3b-36ca-48e7-b3a3-5afdcfd81a51 service neutron] RBAC: Authorization granted {{(pid=71938) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 24 16:40:46.505399 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: [pid: 71938|app: 0|req: 727/1453] 10.222.0.53 () {60 vars in 1356 bytes} [Wed Nov 24 16:40:46 2021] GET /identity/v3/auth/tokens => generated 3669 bytes in 68 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 24 16:40:50.988376 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44f43054-c442-49e6-a949-0703d87343eb None None] REQUEST_METHOD: `GET` {{(pid=71939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 24 16:40:50.989285 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44f43054-c442-49e6-a949-0703d87343eb None None] SCRIPT_NAME: `/identity` {{(pid=71939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 24 16:40:50.989820 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44f43054-c442-49e6-a949-0703d87343eb None None] PATH_INFO: `/` {{(pid=71939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 24 16:40:50.991932 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: [pid: 71939|app: 0|req: 727/1454] 10.222.0.53 () {54 vars in 910 bytes} [Wed Nov 24 16:40:50 2021] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 24 16:40:51.001103 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-543915c6-ef7e-4e64-a3f2-5b629db36049 None None] REQUEST_METHOD: `POST` {{(pid=71938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 24 16:40:51.001742 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-543915c6-ef7e-4e64-a3f2-5b629db36049 None None] SCRIPT_NAME: `/identity` {{(pid=71938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 24 16:40:51.002249 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-543915c6-ef7e-4e64-a3f2-5b629db36049 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=71938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 24 16:40:51.108741 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.auth.core [None req-543915c6-ef7e-4e64-a3f2-5b629db36049 None None] MFA Rules not processed for user `a919320c9e2a48d7ba33453b5929d7ee`. Rule list: `[]` (Enabled: `True`). {{(pid=71938) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:442}} Nov 24 16:40:51.112292 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.fernet_utils [None req-543915c6-ef7e-4e64-a3f2-5b629db36049 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=71938) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:289}} Nov 24 16:40:51.288935 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: [pid: 71938|app: 0|req: 728/1455] 10.222.0.53 () {58 vars in 1008 bytes} [Wed Nov 24 16:40:50 2021] POST /identity/v3/auth/tokens => generated 3738 bytes in 289 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 24 16:40:51.866193 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e17c7068-f6a5-4467-aa66-e9efdea82e83 None None] REQUEST_METHOD: `GET` {{(pid=71939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 24 16:40:51.866464 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e17c7068-f6a5-4467-aa66-e9efdea82e83 None None] SCRIPT_NAME: `/identity` {{(pid=71939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 24 16:40:51.866934 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e17c7068-f6a5-4467-aa66-e9efdea82e83 None None] PATH_INFO: `/` {{(pid=71939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 24 16:40:51.868718 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: [pid: 71939|app: 0|req: 728/1456] 10.222.0.53 () {54 vars in 910 bytes} [Wed Nov 24 16:40:51 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Nov 24 16:40:51.876629 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcdfaf0f-281d-45fd-99bb-e106ff5c521f None None] REQUEST_METHOD: `POST` {{(pid=71938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 24 16:40:51.876989 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcdfaf0f-281d-45fd-99bb-e106ff5c521f None None] SCRIPT_NAME: `/identity` {{(pid=71938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 24 16:40:51.877332 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcdfaf0f-281d-45fd-99bb-e106ff5c521f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=71938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 24 16:40:51.938514 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.auth.core [None req-fcdfaf0f-281d-45fd-99bb-e106ff5c521f None None] MFA Rules not processed for user `a919320c9e2a48d7ba33453b5929d7ee`. Rule list: `[]` (Enabled: `True`). {{(pid=71938) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:442}} Nov 24 16:40:51.941281 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.fernet_utils [None req-fcdfaf0f-281d-45fd-99bb-e106ff5c521f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=71938) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:289}} Nov 24 16:40:51.961694 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: [pid: 71938|app: 0|req: 729/1457] 10.222.0.53 () {58 vars in 1008 bytes} [Wed Nov 24 16:40:51 2021] POST /identity/v3/auth/tokens => generated 3738 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 24 16:40:55.232149 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35648a81-91bb-45f0-9e57-c85289e97953 None None] REQUEST_METHOD: `GET` {{(pid=71939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 24 16:40:55.232658 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35648a81-91bb-45f0-9e57-c85289e97953 None None] SCRIPT_NAME: `/identity` {{(pid=71939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 24 16:40:55.232792 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35648a81-91bb-45f0-9e57-c85289e97953 None None] PATH_INFO: `/` {{(pid=71939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 24 16:40:55.235112 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: [pid: 71939|app: 0|req: 729/1458] 10.222.0.53 () {54 vars in 910 bytes} [Wed Nov 24 16:40:55 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 24 16:40:55.241309 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f323d227-77c7-498f-8e72-af5800c768f7 None None] REQUEST_METHOD: `POST` {{(pid=71938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 24 16:40:55.241475 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f323d227-77c7-498f-8e72-af5800c768f7 None None] SCRIPT_NAME: `/identity` {{(pid=71938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 24 16:40:55.242078 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f323d227-77c7-498f-8e72-af5800c768f7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=71938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 24 16:40:55.267602 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.auth.core [None req-f323d227-77c7-498f-8e72-af5800c768f7 None None] MFA Rules not processed for user `a919320c9e2a48d7ba33453b5929d7ee`. Rule list: `[]` (Enabled: `True`). {{(pid=71938) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:442}} Nov 24 16:40:55.268846 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.fernet_utils [None req-f323d227-77c7-498f-8e72-af5800c768f7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=71938) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:289}} Nov 24 16:40:55.280312 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: [pid: 71938|app: 0|req: 730/1459] 10.222.0.53 () {58 vars in 1008 bytes} [Wed Nov 24 16:40:55 2021] POST /identity/v3/auth/tokens => generated 3738 bytes in 40 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 24 16:40:56.720802 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-793991ea-29ba-4808-ab67-ae55b9e84a7e None None] REQUEST_METHOD: `GET` {{(pid=71939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 24 16:40:56.721364 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-793991ea-29ba-4808-ab67-ae55b9e84a7e None None] SCRIPT_NAME: `/identity` {{(pid=71939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 24 16:40:56.721477 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-793991ea-29ba-4808-ab67-ae55b9e84a7e None None] PATH_INFO: `/` {{(pid=71939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 24 16:40:56.723465 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: [pid: 71939|app: 0|req: 730/1460] 10.222.0.53 () {54 vars in 910 bytes} [Wed Nov 24 16:40:56 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 24 16:40:56.729675 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cbfe2af-b655-455a-9fdd-80fe174e1496 None None] REQUEST_METHOD: `POST` {{(pid=71938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 24 16:40:56.730141 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cbfe2af-b655-455a-9fdd-80fe174e1496 None None] SCRIPT_NAME: `/identity` {{(pid=71938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 24 16:40:56.730555 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cbfe2af-b655-455a-9fdd-80fe174e1496 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=71938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 24 16:40:56.754175 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.auth.core [None req-1cbfe2af-b655-455a-9fdd-80fe174e1496 None None] MFA Rules not processed for user `a919320c9e2a48d7ba33453b5929d7ee`. Rule list: `[]` (Enabled: `True`). {{(pid=71938) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:442}} Nov 24 16:40:56.755725 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.fernet_utils [None req-1cbfe2af-b655-455a-9fdd-80fe174e1496 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=71938) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:289}} Nov 24 16:40:56.764088 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: [pid: 71938|app: 0|req: 731/1461] 10.222.0.53 () {58 vars in 1008 bytes} [Wed Nov 24 16:40:56 2021] POST /identity/v3/auth/tokens => generated 3738 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 24 16:41:00.420370 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb9f3083-f40d-4060-8d50-6e28aa149acf None None] REQUEST_METHOD: `GET` {{(pid=71939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 24 16:41:00.420939 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb9f3083-f40d-4060-8d50-6e28aa149acf None None] SCRIPT_NAME: `/identity` {{(pid=71939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 24 16:41:00.421077 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb9f3083-f40d-4060-8d50-6e28aa149acf None None] PATH_INFO: `/` {{(pid=71939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 24 16:41:00.422955 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: [pid: 71939|app: 0|req: 731/1462] 10.222.0.53 () {54 vars in 915 bytes} [Wed Nov 24 16:41:00 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 24 16:41:00.428547 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b8170d9-8be7-4461-9f50-d8507baab4ee None None] REQUEST_METHOD: `POST` {{(pid=71938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 24 16:41:00.428901 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b8170d9-8be7-4461-9f50-d8507baab4ee None None] SCRIPT_NAME: `/identity` {{(pid=71938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 24 16:41:00.429242 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b8170d9-8be7-4461-9f50-d8507baab4ee None None] PATH_INFO: `/v3/auth/tokens` {{(pid=71938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 24 16:41:00.452814 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.auth.core [None req-4b8170d9-8be7-4461-9f50-d8507baab4ee None None] MFA Rules not processed for user `0f2ba2e8375b4e8c8792ee1e22b60427`. Rule list: `[]` (Enabled: `True`). {{(pid=71938) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:442}} Nov 24 16:41:00.454094 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.fernet_utils [None req-4b8170d9-8be7-4461-9f50-d8507baab4ee None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=71938) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:289}} Nov 24 16:41:00.461715 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: [pid: 71938|app: 0|req: 732/1463] 10.222.0.53 () {58 vars in 1013 bytes} [Wed Nov 24 16:41:00 2021] POST /identity/v3/auth/tokens => generated 3669 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 24 16:41:00.602300 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48293cc4-c166-4177-bc84-ed7211010f27 None None] REQUEST_METHOD: `POST` {{(pid=71939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 24 16:41:00.602581 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48293cc4-c166-4177-bc84-ed7211010f27 None None] SCRIPT_NAME: `/identity` {{(pid=71939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 24 16:41:00.602922 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48293cc4-c166-4177-bc84-ed7211010f27 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=71939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 24 16:41:00.626633 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.auth.core [None req-48293cc4-c166-4177-bc84-ed7211010f27 None None] MFA Rules not processed for user `0f2ba2e8375b4e8c8792ee1e22b60427`. Rule list: `[]` (Enabled: `True`). {{(pid=71939) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:442}} Nov 24 16:41:00.628003 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.fernet_utils [None req-48293cc4-c166-4177-bc84-ed7211010f27 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=71939) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:289}} Nov 24 16:41:00.635322 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: [pid: 71939|app: 0|req: 732/1464] 10.222.0.53 () {58 vars in 1013 bytes} [Wed Nov 24 16:41:00 2021] POST /identity/v3/auth/tokens => generated 3669 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 24 16:41:00.655862 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8201f11-8902-4199-a984-80213b9a1744 None None] REQUEST_METHOD: `GET` {{(pid=71938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 24 16:41:00.656214 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8201f11-8902-4199-a984-80213b9a1744 None None] SCRIPT_NAME: `/identity` {{(pid=71938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 24 16:41:00.656557 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8201f11-8902-4199-a984-80213b9a1744 None None] PATH_INFO: `/` {{(pid=71938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 24 16:41:00.658434 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: [pid: 71938|app: 0|req: 733/1465] 10.222.0.53 () {54 vars in 943 bytes} [Wed Nov 24 16:41:00 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 24 16:41:00.670660 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8b97362-2798-488a-9c30-2bcb23007aae None None] REQUEST_METHOD: `POST` {{(pid=71939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 24 16:41:00.671014 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8b97362-2798-488a-9c30-2bcb23007aae None None] SCRIPT_NAME: `/identity` {{(pid=71939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 24 16:41:00.671351 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8b97362-2798-488a-9c30-2bcb23007aae None None] PATH_INFO: `/v3/auth/tokens` {{(pid=71939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 24 16:41:00.744575 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.auth.core [None req-a8b97362-2798-488a-9c30-2bcb23007aae None None] MFA Rules not processed for user `3e196802d4d5432482b6d2eabc25f74e`. Rule list: `[]` (Enabled: `True`). {{(pid=71939) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:442}} Nov 24 16:41:00.745803 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.fernet_utils [None req-a8b97362-2798-488a-9c30-2bcb23007aae None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=71939) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:289}} Nov 24 16:41:00.844038 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: [pid: 71939|app: 0|req: 733/1466] 10.222.0.53 () {58 vars in 1041 bytes} [Wed Nov 24 16:41:00 2021] POST /identity/v3/auth/tokens => generated 3802 bytes in 174 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 24 16:41:00.852682 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8201f11-8902-4199-a984-80213b9a1744 None None] Authenticating user token {{(pid=71938) process_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 24 16:41:00.866903 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8201f11-8902-4199-a984-80213b9a1744 None None] Validating token access rules against request {{(pid=71938) validate_allowed_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 24 16:41:00.872511 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6e75b44-3497-4a64-a3b6-a537d70ace33 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e196802d4d5432482b6d2eabc25f74e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3b3940d4ae1c4177ae29c02377bb4b0b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'service', 'ResellerAdmin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=71938) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 24 16:41:00.873167 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6e75b44-3497-4a64-a3b6-a537d70ace33 service nova] REQUEST_METHOD: `GET` {{(pid=71938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 24 16:41:00.873507 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6e75b44-3497-4a64-a3b6-a537d70ace33 service nova] SCRIPT_NAME: `/identity` {{(pid=71938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 24 16:41:00.873845 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6e75b44-3497-4a64-a3b6-a537d70ace33 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=71938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 24 16:41:00.882979 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6e75b44-3497-4a64-a3b6-a537d70ace33 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=71938) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:442}} Nov 24 16:41:00.912419 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6e75b44-3497-4a64-a3b6-a537d70ace33 service nova] RBAC: Authorization granted {{(pid=71938) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 24 16:41:00.922584 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: [pid: 71938|app: 0|req: 734/1467] 10.222.0.53 () {60 vars in 1356 bytes} [Wed Nov 24 16:41:00 2021] GET /identity/v3/auth/tokens => generated 3669 bytes in 71 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Nov 24 16:41:03.172835 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-752e2017-48c4-4372-adee-e61c2ae9a3ad None None] REQUEST_METHOD: `GET` {{(pid=71939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 24 16:41:03.173367 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-752e2017-48c4-4372-adee-e61c2ae9a3ad None None] SCRIPT_NAME: `/identity` {{(pid=71939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 24 16:41:03.173478 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-752e2017-48c4-4372-adee-e61c2ae9a3ad None None] PATH_INFO: `/` {{(pid=71939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 24 16:41:03.175444 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: [pid: 71939|app: 0|req: 734/1468] 10.222.0.53 () {54 vars in 915 bytes} [Wed Nov 24 16:41:03 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 24 16:41:03.181427 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ae5bd8e-f0b5-4557-b537-03a9ed749538 None None] REQUEST_METHOD: `POST` {{(pid=71938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 24 16:41:03.181918 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ae5bd8e-f0b5-4557-b537-03a9ed749538 None None] SCRIPT_NAME: `/identity` {{(pid=71938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 24 16:41:03.182376 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ae5bd8e-f0b5-4557-b537-03a9ed749538 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=71938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 24 16:41:03.208051 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.auth.core [None req-1ae5bd8e-f0b5-4557-b537-03a9ed749538 None None] MFA Rules not processed for user `0f2ba2e8375b4e8c8792ee1e22b60427`. Rule list: `[]` (Enabled: `True`). {{(pid=71938) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:442}} Nov 24 16:41:03.209294 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.fernet_utils [None req-1ae5bd8e-f0b5-4557-b537-03a9ed749538 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=71938) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:289}} Nov 24 16:41:03.217617 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: [pid: 71938|app: 0|req: 735/1469] 10.222.0.53 () {58 vars in 1013 bytes} [Wed Nov 24 16:41:03 2021] POST /identity/v3/auth/tokens => generated 3669 bytes in 37 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 24 16:41:03.364103 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc4735b2-7814-4bec-b39e-2139b993f6c7 None None] REQUEST_METHOD: `POST` {{(pid=71939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 24 16:41:03.364448 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc4735b2-7814-4bec-b39e-2139b993f6c7 None None] SCRIPT_NAME: `/identity` {{(pid=71939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 24 16:41:03.364795 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc4735b2-7814-4bec-b39e-2139b993f6c7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=71939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 24 16:41:03.388885 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.auth.core [None req-dc4735b2-7814-4bec-b39e-2139b993f6c7 None None] MFA Rules not processed for user `0f2ba2e8375b4e8c8792ee1e22b60427`. Rule list: `[]` (Enabled: `True`). {{(pid=71939) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:442}} Nov 24 16:41:03.390185 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.fernet_utils [None req-dc4735b2-7814-4bec-b39e-2139b993f6c7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=71939) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:289}} Nov 24 16:41:03.397706 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: [pid: 71939|app: 0|req: 735/1470] 10.222.0.53 () {58 vars in 1013 bytes} [Wed Nov 24 16:41:03 2021] POST /identity/v3/auth/tokens => generated 3669 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 24 16:41:03.419147 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3f52c39-4790-4ac8-b337-9a94bd0d5653 None None] REQUEST_METHOD: `GET` {{(pid=71938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 24 16:41:03.419483 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3f52c39-4790-4ac8-b337-9a94bd0d5653 None None] SCRIPT_NAME: `/identity` {{(pid=71938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 24 16:41:03.419815 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3f52c39-4790-4ac8-b337-9a94bd0d5653 None None] PATH_INFO: `/` {{(pid=71938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 24 16:41:03.421710 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: [pid: 71938|app: 0|req: 736/1471] 10.222.0.53 () {54 vars in 943 bytes} [Wed Nov 24 16:41:03 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 24 16:41:03.427567 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99b1e15d-c5a8-4067-9f96-12355d31d223 None None] REQUEST_METHOD: `POST` {{(pid=71939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 24 16:41:03.427869 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99b1e15d-c5a8-4067-9f96-12355d31d223 None None] SCRIPT_NAME: `/identity` {{(pid=71939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 24 16:41:03.428209 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99b1e15d-c5a8-4067-9f96-12355d31d223 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=71939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 24 16:41:03.453401 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.auth.core [None req-99b1e15d-c5a8-4067-9f96-12355d31d223 None None] MFA Rules not processed for user `3e196802d4d5432482b6d2eabc25f74e`. Rule list: `[]` (Enabled: `True`). {{(pid=71939) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:442}} Nov 24 16:41:03.454671 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.fernet_utils [None req-99b1e15d-c5a8-4067-9f96-12355d31d223 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=71939) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:289}} Nov 24 16:41:03.463566 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: [pid: 71939|app: 0|req: 736/1472] 10.222.0.53 () {58 vars in 1041 bytes} [Wed Nov 24 16:41:03 2021] POST /identity/v3/auth/tokens => generated 3802 bytes in 37 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 24 16:41:03.472316 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3f52c39-4790-4ac8-b337-9a94bd0d5653 None None] Authenticating user token {{(pid=71938) process_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 24 16:41:03.487585 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3f52c39-4790-4ac8-b337-9a94bd0d5653 None None] Validating token access rules against request {{(pid=71938) validate_allowed_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 24 16:41:03.493472 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef8b4c46-68ea-404f-ae4f-275fc97d1572 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e196802d4d5432482b6d2eabc25f74e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3b3940d4ae1c4177ae29c02377bb4b0b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'service', 'ResellerAdmin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=71938) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 24 16:41:03.494106 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef8b4c46-68ea-404f-ae4f-275fc97d1572 service nova] REQUEST_METHOD: `GET` {{(pid=71938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 24 16:41:03.494955 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef8b4c46-68ea-404f-ae4f-275fc97d1572 service nova] SCRIPT_NAME: `/identity` {{(pid=71938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 24 16:41:03.495291 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef8b4c46-68ea-404f-ae4f-275fc97d1572 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=71938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 24 16:41:03.504573 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef8b4c46-68ea-404f-ae4f-275fc97d1572 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=71938) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:442}} Nov 24 16:41:03.534257 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef8b4c46-68ea-404f-ae4f-275fc97d1572 service nova] RBAC: Authorization granted {{(pid=71938) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 24 16:41:03.545407 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: [pid: 71938|app: 0|req: 737/1473] 10.222.0.53 () {60 vars in 1356 bytes} [Wed Nov 24 16:41:03 2021] GET /identity/v3/auth/tokens => generated 3669 bytes in 74 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 24 16:41:05.922881 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bcfb27f-0d06-4fd5-be0c-6bad19cab81a None None] REQUEST_METHOD: `GET` {{(pid=71939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 24 16:41:05.923416 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bcfb27f-0d06-4fd5-be0c-6bad19cab81a None None] SCRIPT_NAME: `/identity` {{(pid=71939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 24 16:41:05.923524 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bcfb27f-0d06-4fd5-be0c-6bad19cab81a None None] PATH_INFO: `/` {{(pid=71939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 24 16:41:05.925354 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: [pid: 71939|app: 0|req: 737/1474] 10.222.0.53 () {54 vars in 915 bytes} [Wed Nov 24 16:41:05 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 24 16:41:05.931502 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c4806ae-799e-403e-afd4-005c0509c017 None None] REQUEST_METHOD: `POST` {{(pid=71938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 24 16:41:05.932358 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c4806ae-799e-403e-afd4-005c0509c017 None None] SCRIPT_NAME: `/identity` {{(pid=71938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 24 16:41:05.932755 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c4806ae-799e-403e-afd4-005c0509c017 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=71938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 24 16:41:05.958769 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.auth.core [None req-9c4806ae-799e-403e-afd4-005c0509c017 None None] MFA Rules not processed for user `0f2ba2e8375b4e8c8792ee1e22b60427`. Rule list: `[]` (Enabled: `True`). {{(pid=71938) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:442}} Nov 24 16:41:05.960017 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.fernet_utils [None req-9c4806ae-799e-403e-afd4-005c0509c017 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=71938) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:289}} Nov 24 16:41:05.967841 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: [pid: 71938|app: 0|req: 738/1475] 10.222.0.53 () {58 vars in 1013 bytes} [Wed Nov 24 16:41:05 2021] POST /identity/v3/auth/tokens => generated 3669 bytes in 38 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 24 16:41:06.122635 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d729d36e-ac0e-45da-8ee8-fe8b7b5281c5 None None] REQUEST_METHOD: `POST` {{(pid=71939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 24 16:41:06.122986 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d729d36e-ac0e-45da-8ee8-fe8b7b5281c5 None None] SCRIPT_NAME: `/identity` {{(pid=71939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 24 16:41:06.123328 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d729d36e-ac0e-45da-8ee8-fe8b7b5281c5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=71939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 24 16:41:06.146876 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.auth.core [None req-d729d36e-ac0e-45da-8ee8-fe8b7b5281c5 None None] MFA Rules not processed for user `0f2ba2e8375b4e8c8792ee1e22b60427`. Rule list: `[]` (Enabled: `True`). {{(pid=71939) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:442}} Nov 24 16:41:06.148165 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.fernet_utils [None req-d729d36e-ac0e-45da-8ee8-fe8b7b5281c5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=71939) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:289}} Nov 24 16:41:06.155752 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: [pid: 71939|app: 0|req: 738/1476] 10.222.0.53 () {58 vars in 1013 bytes} [Wed Nov 24 16:41:06 2021] POST /identity/v3/auth/tokens => generated 3669 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 24 16:41:06.170063 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c4806ae-799e-403e-afd4-005c0509c017 None None] Authenticating user token {{(pid=71938) process_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 24 16:41:06.183344 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c4806ae-799e-403e-afd4-005c0509c017 None None] Validating token access rules against request {{(pid=71938) validate_allowed_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 24 16:41:06.189259 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb9fc82f-4ad3-488d-b03a-2d8c5f5e43e4 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e196802d4d5432482b6d2eabc25f74e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3b3940d4ae1c4177ae29c02377bb4b0b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'service', 'ResellerAdmin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=71938) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 24 16:41:06.189932 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb9fc82f-4ad3-488d-b03a-2d8c5f5e43e4 service nova] REQUEST_METHOD: `GET` {{(pid=71938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 24 16:41:06.190377 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb9fc82f-4ad3-488d-b03a-2d8c5f5e43e4 service nova] SCRIPT_NAME: `/identity` {{(pid=71938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 24 16:41:06.190717 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb9fc82f-4ad3-488d-b03a-2d8c5f5e43e4 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=71938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 24 16:41:06.200857 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb9fc82f-4ad3-488d-b03a-2d8c5f5e43e4 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=71938) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:442}} Nov 24 16:41:06.231223 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb9fc82f-4ad3-488d-b03a-2d8c5f5e43e4 service nova] RBAC: Authorization granted {{(pid=71938) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 24 16:41:06.242351 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: [pid: 71938|app: 0|req: 739/1477] 10.222.0.53 () {60 vars in 1356 bytes} [Wed Nov 24 16:41:06 2021] GET /identity/v3/auth/tokens => generated 3669 bytes in 73 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 24 16:41:08.409566 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abedecd6-e584-46eb-b485-dbb6d566a5e1 None None] REQUEST_METHOD: `GET` {{(pid=71939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 24 16:41:08.410176 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abedecd6-e584-46eb-b485-dbb6d566a5e1 None None] SCRIPT_NAME: `/identity` {{(pid=71939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 24 16:41:08.410293 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abedecd6-e584-46eb-b485-dbb6d566a5e1 None None] PATH_INFO: `/` {{(pid=71939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 24 16:41:08.412220 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: [pid: 71939|app: 0|req: 739/1478] 10.222.0.53 () {54 vars in 915 bytes} [Wed Nov 24 16:41:08 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 24 16:41:08.417957 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87a3b89a-9e61-4cc2-bd9d-bdd11a915223 None None] REQUEST_METHOD: `POST` {{(pid=71938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 24 16:41:08.418348 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87a3b89a-9e61-4cc2-bd9d-bdd11a915223 None None] SCRIPT_NAME: `/identity` {{(pid=71938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 24 16:41:08.418689 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87a3b89a-9e61-4cc2-bd9d-bdd11a915223 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=71938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 24 16:41:08.443437 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.auth.core [None req-87a3b89a-9e61-4cc2-bd9d-bdd11a915223 None None] MFA Rules not processed for user `0f2ba2e8375b4e8c8792ee1e22b60427`. Rule list: `[]` (Enabled: `True`). {{(pid=71938) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:442}} Nov 24 16:41:08.444692 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.fernet_utils [None req-87a3b89a-9e61-4cc2-bd9d-bdd11a915223 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=71938) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:289}} Nov 24 16:41:08.453577 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: [pid: 71938|app: 0|req: 740/1479] 10.222.0.53 () {58 vars in 1013 bytes} [Wed Nov 24 16:41:08 2021] POST /identity/v3/auth/tokens => generated 3669 bytes in 37 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 24 16:41:08.610002 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a9abe51-e078-44c4-9a28-eed5ddef4f1a None None] REQUEST_METHOD: `POST` {{(pid=71939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 24 16:41:08.610494 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a9abe51-e078-44c4-9a28-eed5ddef4f1a None None] SCRIPT_NAME: `/identity` {{(pid=71939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 24 16:41:08.610880 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a9abe51-e078-44c4-9a28-eed5ddef4f1a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=71939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 24 16:41:08.634494 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.auth.core [None req-2a9abe51-e078-44c4-9a28-eed5ddef4f1a None None] MFA Rules not processed for user `0f2ba2e8375b4e8c8792ee1e22b60427`. Rule list: `[]` (Enabled: `True`). {{(pid=71939) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:442}} Nov 24 16:41:08.636266 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.fernet_utils [None req-2a9abe51-e078-44c4-9a28-eed5ddef4f1a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=71939) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:289}} Nov 24 16:41:08.644085 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: [pid: 71939|app: 0|req: 740/1480] 10.222.0.53 () {58 vars in 1013 bytes} [Wed Nov 24 16:41:08 2021] POST /identity/v3/auth/tokens => generated 3669 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 24 16:41:08.656824 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87a3b89a-9e61-4cc2-bd9d-bdd11a915223 None None] Authenticating user token {{(pid=71938) process_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 24 16:41:08.669444 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87a3b89a-9e61-4cc2-bd9d-bdd11a915223 None None] Validating token access rules against request {{(pid=71938) validate_allowed_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 24 16:41:08.675082 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ec356c0-1dcc-42f1-8bdd-fccdcdda7f36 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e196802d4d5432482b6d2eabc25f74e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3b3940d4ae1c4177ae29c02377bb4b0b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'service', 'ResellerAdmin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=71938) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 24 16:41:08.675739 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ec356c0-1dcc-42f1-8bdd-fccdcdda7f36 service nova] REQUEST_METHOD: `GET` {{(pid=71938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 24 16:41:08.676087 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ec356c0-1dcc-42f1-8bdd-fccdcdda7f36 service nova] SCRIPT_NAME: `/identity` {{(pid=71938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 24 16:41:08.676421 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ec356c0-1dcc-42f1-8bdd-fccdcdda7f36 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=71938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 24 16:41:08.688064 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ec356c0-1dcc-42f1-8bdd-fccdcdda7f36 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=71938) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:442}} Nov 24 16:41:08.723103 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ec356c0-1dcc-42f1-8bdd-fccdcdda7f36 service nova] RBAC: Authorization granted {{(pid=71938) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 24 16:41:08.734010 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: [pid: 71938|app: 0|req: 741/1481] 10.222.0.53 () {60 vars in 1356 bytes} [Wed Nov 24 16:41:08 2021] GET /identity/v3/auth/tokens => generated 3669 bytes in 78 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 24 16:41:10.898289 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aeecc8fa-8560-46fd-96fd-71151a07174d None None] REQUEST_METHOD: `GET` {{(pid=71939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 24 16:41:10.898847 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aeecc8fa-8560-46fd-96fd-71151a07174d None None] SCRIPT_NAME: `/identity` {{(pid=71939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 24 16:41:10.898967 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aeecc8fa-8560-46fd-96fd-71151a07174d None None] PATH_INFO: `/` {{(pid=71939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 24 16:41:10.902816 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: [pid: 71939|app: 0|req: 741/1482] 10.222.0.53 () {54 vars in 915 bytes} [Wed Nov 24 16:41:10 2021] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 24 16:41:10.912035 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88a2cb2a-00ec-45f8-b64a-43382c8b2a0d None None] REQUEST_METHOD: `POST` {{(pid=71938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 24 16:41:10.912380 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88a2cb2a-00ec-45f8-b64a-43382c8b2a0d None None] SCRIPT_NAME: `/identity` {{(pid=71938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 24 16:41:10.912722 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88a2cb2a-00ec-45f8-b64a-43382c8b2a0d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=71938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 24 16:41:10.936720 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.auth.core [None req-88a2cb2a-00ec-45f8-b64a-43382c8b2a0d None None] MFA Rules not processed for user `0f2ba2e8375b4e8c8792ee1e22b60427`. Rule list: `[]` (Enabled: `True`). {{(pid=71938) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:442}} Nov 24 16:41:10.937976 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.fernet_utils [None req-88a2cb2a-00ec-45f8-b64a-43382c8b2a0d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=71938) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:289}} Nov 24 16:41:10.945532 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: [pid: 71938|app: 0|req: 742/1483] 10.222.0.53 () {58 vars in 1013 bytes} [Wed Nov 24 16:41:10 2021] POST /identity/v3/auth/tokens => generated 3669 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 24 16:41:11.091723 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaa9bd20-0025-45f9-82a6-622c9d149525 None None] REQUEST_METHOD: `POST` {{(pid=71939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 24 16:41:11.092061 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaa9bd20-0025-45f9-82a6-622c9d149525 None None] SCRIPT_NAME: `/identity` {{(pid=71939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 24 16:41:11.092408 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaa9bd20-0025-45f9-82a6-622c9d149525 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=71939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 24 16:41:11.117676 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.auth.core [None req-eaa9bd20-0025-45f9-82a6-622c9d149525 None None] MFA Rules not processed for user `0f2ba2e8375b4e8c8792ee1e22b60427`. Rule list: `[]` (Enabled: `True`). {{(pid=71939) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:442}} Nov 24 16:41:11.119583 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.fernet_utils [None req-eaa9bd20-0025-45f9-82a6-622c9d149525 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=71939) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:289}} Nov 24 16:41:11.128509 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: [pid: 71939|app: 0|req: 742/1484] 10.222.0.53 () {58 vars in 1013 bytes} [Wed Nov 24 16:41:11 2021] POST /identity/v3/auth/tokens => generated 3669 bytes in 38 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 24 16:41:11.144377 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88a2cb2a-00ec-45f8-b64a-43382c8b2a0d None None] Authenticating user token {{(pid=71938) process_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 24 16:41:11.158211 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88a2cb2a-00ec-45f8-b64a-43382c8b2a0d None None] Validating token access rules against request {{(pid=71938) validate_allowed_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 24 16:41:11.163857 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03491fdc-4a15-472d-8c15-21c5be0b203a service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e196802d4d5432482b6d2eabc25f74e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3b3940d4ae1c4177ae29c02377bb4b0b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'service', 'ResellerAdmin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=71938) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 24 16:41:11.164640 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03491fdc-4a15-472d-8c15-21c5be0b203a service nova] REQUEST_METHOD: `GET` {{(pid=71938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 24 16:41:11.164990 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03491fdc-4a15-472d-8c15-21c5be0b203a service nova] SCRIPT_NAME: `/identity` {{(pid=71938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 24 16:41:11.165318 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03491fdc-4a15-472d-8c15-21c5be0b203a service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=71938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 24 16:41:11.175245 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03491fdc-4a15-472d-8c15-21c5be0b203a service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=71938) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:442}} Nov 24 16:41:11.207226 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03491fdc-4a15-472d-8c15-21c5be0b203a service nova] RBAC: Authorization granted {{(pid=71938) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 24 16:41:11.218607 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: [pid: 71938|app: 0|req: 743/1485] 10.222.0.53 () {60 vars in 1356 bytes} [Wed Nov 24 16:41:11 2021] GET /identity/v3/auth/tokens => generated 3669 bytes in 75 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 24 16:41:13.411886 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9274bff4-a6b9-4aff-8507-f12673c4dfcf None None] REQUEST_METHOD: `GET` {{(pid=71939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 24 16:41:13.411886 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9274bff4-a6b9-4aff-8507-f12673c4dfcf None None] SCRIPT_NAME: `/identity` {{(pid=71939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 24 16:41:13.413271 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9274bff4-a6b9-4aff-8507-f12673c4dfcf None None] PATH_INFO: `/` {{(pid=71939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 24 16:41:13.414522 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: [pid: 71939|app: 0|req: 743/1486] 10.222.0.53 () {54 vars in 915 bytes} [Wed Nov 24 16:41:13 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 24 16:41:13.421176 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38433ffa-8148-4083-b2cc-77c17c0884af None None] REQUEST_METHOD: `POST` {{(pid=71938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 24 16:41:13.421512 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38433ffa-8148-4083-b2cc-77c17c0884af None None] SCRIPT_NAME: `/identity` {{(pid=71938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 24 16:41:13.421844 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38433ffa-8148-4083-b2cc-77c17c0884af None None] PATH_INFO: `/v3/auth/tokens` {{(pid=71938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 24 16:41:13.445741 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.auth.core [None req-38433ffa-8148-4083-b2cc-77c17c0884af None None] MFA Rules not processed for user `0f2ba2e8375b4e8c8792ee1e22b60427`. Rule list: `[]` (Enabled: `True`). {{(pid=71938) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:442}} Nov 24 16:41:13.447288 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.fernet_utils [None req-38433ffa-8148-4083-b2cc-77c17c0884af None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=71938) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:289}} Nov 24 16:41:13.455134 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: [pid: 71938|app: 0|req: 744/1487] 10.222.0.53 () {58 vars in 1013 bytes} [Wed Nov 24 16:41:13 2021] POST /identity/v3/auth/tokens => generated 3669 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 24 16:41:13.600071 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab8c3f60-ed5d-4211-bf7e-f2b2b7e5c5c1 None None] REQUEST_METHOD: `POST` {{(pid=71939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 24 16:41:13.600343 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab8c3f60-ed5d-4211-bf7e-f2b2b7e5c5c1 None None] SCRIPT_NAME: `/identity` {{(pid=71939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 24 16:41:13.600617 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab8c3f60-ed5d-4211-bf7e-f2b2b7e5c5c1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=71939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 24 16:41:13.626806 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.auth.core [None req-ab8c3f60-ed5d-4211-bf7e-f2b2b7e5c5c1 None None] MFA Rules not processed for user `0f2ba2e8375b4e8c8792ee1e22b60427`. Rule list: `[]` (Enabled: `True`). {{(pid=71939) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:442}} Nov 24 16:41:13.627726 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.fernet_utils [None req-ab8c3f60-ed5d-4211-bf7e-f2b2b7e5c5c1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=71939) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:289}} Nov 24 16:41:13.636038 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: [pid: 71939|app: 0|req: 744/1488] 10.222.0.53 () {58 vars in 1013 bytes} [Wed Nov 24 16:41:13 2021] POST /identity/v3/auth/tokens => generated 3669 bytes in 37 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 24 16:41:13.648112 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38433ffa-8148-4083-b2cc-77c17c0884af None None] Authenticating user token {{(pid=71938) process_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 24 16:41:13.663092 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38433ffa-8148-4083-b2cc-77c17c0884af None None] Validating token access rules against request {{(pid=71938) validate_allowed_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 24 16:41:13.669280 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a1811b0-49de-40e7-a9e8-a5510c07be8e service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e196802d4d5432482b6d2eabc25f74e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3b3940d4ae1c4177ae29c02377bb4b0b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'service', 'ResellerAdmin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=71938) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 24 16:41:13.670393 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a1811b0-49de-40e7-a9e8-a5510c07be8e service nova] REQUEST_METHOD: `GET` {{(pid=71938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 24 16:41:13.670960 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a1811b0-49de-40e7-a9e8-a5510c07be8e service nova] SCRIPT_NAME: `/identity` {{(pid=71938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 24 16:41:13.671523 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a1811b0-49de-40e7-a9e8-a5510c07be8e service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=71938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 24 16:41:13.684149 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a1811b0-49de-40e7-a9e8-a5510c07be8e service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=71938) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:442}} Nov 24 16:41:13.722700 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a1811b0-49de-40e7-a9e8-a5510c07be8e service nova] RBAC: Authorization granted {{(pid=71938) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 24 16:41:13.738183 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: [pid: 71938|app: 0|req: 745/1489] 10.222.0.53 () {60 vars in 1356 bytes} [Wed Nov 24 16:41:13 2021] GET /identity/v3/auth/tokens => generated 3669 bytes in 91 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Nov 24 16:41:15.887305 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d8b31f9-bff7-4d79-8acf-95b0fe39c9c7 None None] REQUEST_METHOD: `GET` {{(pid=71939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 24 16:41:15.887927 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d8b31f9-bff7-4d79-8acf-95b0fe39c9c7 None None] SCRIPT_NAME: `/identity` {{(pid=71939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 24 16:41:15.888049 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d8b31f9-bff7-4d79-8acf-95b0fe39c9c7 None None] PATH_INFO: `/` {{(pid=71939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 24 16:41:15.889825 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: [pid: 71939|app: 0|req: 745/1490] 10.222.0.53 () {54 vars in 915 bytes} [Wed Nov 24 16:41:15 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 24 16:41:15.895572 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85ea5da0-aa8b-4cf6-9bf2-2a3fcc181f00 None None] REQUEST_METHOD: `POST` {{(pid=71938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 24 16:41:15.895923 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85ea5da0-aa8b-4cf6-9bf2-2a3fcc181f00 None None] SCRIPT_NAME: `/identity` {{(pid=71938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 24 16:41:15.896263 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85ea5da0-aa8b-4cf6-9bf2-2a3fcc181f00 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=71938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 24 16:41:15.920708 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.auth.core [None req-85ea5da0-aa8b-4cf6-9bf2-2a3fcc181f00 None None] MFA Rules not processed for user `0f2ba2e8375b4e8c8792ee1e22b60427`. Rule list: `[]` (Enabled: `True`). {{(pid=71938) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:442}} Nov 24 16:41:15.921950 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.fernet_utils [None req-85ea5da0-aa8b-4cf6-9bf2-2a3fcc181f00 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=71938) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:289}} Nov 24 16:41:15.930216 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: [pid: 71938|app: 0|req: 746/1491] 10.222.0.53 () {58 vars in 1013 bytes} [Wed Nov 24 16:41:15 2021] POST /identity/v3/auth/tokens => generated 3669 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 24 16:41:16.071263 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e01f2b20-8aa7-4695-ab7f-937f325eb828 None None] REQUEST_METHOD: `POST` {{(pid=71939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 24 16:41:16.071615 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e01f2b20-8aa7-4695-ab7f-937f325eb828 None None] SCRIPT_NAME: `/identity` {{(pid=71939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 24 16:41:16.072240 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e01f2b20-8aa7-4695-ab7f-937f325eb828 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=71939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 24 16:41:16.095378 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.auth.core [None req-e01f2b20-8aa7-4695-ab7f-937f325eb828 None None] MFA Rules not processed for user `0f2ba2e8375b4e8c8792ee1e22b60427`. Rule list: `[]` (Enabled: `True`). {{(pid=71939) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:442}} Nov 24 16:41:16.096592 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.fernet_utils [None req-e01f2b20-8aa7-4695-ab7f-937f325eb828 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=71939) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:289}} Nov 24 16:41:16.104619 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: [pid: 71939|app: 0|req: 746/1492] 10.222.0.53 () {58 vars in 1013 bytes} [Wed Nov 24 16:41:16 2021] POST /identity/v3/auth/tokens => generated 3669 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 24 16:41:16.116195 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85ea5da0-aa8b-4cf6-9bf2-2a3fcc181f00 None None] Authenticating user token {{(pid=71938) process_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 24 16:41:16.128982 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85ea5da0-aa8b-4cf6-9bf2-2a3fcc181f00 None None] Validating token access rules against request {{(pid=71938) validate_allowed_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 24 16:41:16.134347 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7bce4c3-c447-4db0-be91-7e489a9d7d9e service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e196802d4d5432482b6d2eabc25f74e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3b3940d4ae1c4177ae29c02377bb4b0b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'service', 'ResellerAdmin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=71938) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 24 16:41:16.134988 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7bce4c3-c447-4db0-be91-7e489a9d7d9e service nova] REQUEST_METHOD: `GET` {{(pid=71938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 24 16:41:16.135327 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7bce4c3-c447-4db0-be91-7e489a9d7d9e service nova] SCRIPT_NAME: `/identity` {{(pid=71938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 24 16:41:16.135661 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7bce4c3-c447-4db0-be91-7e489a9d7d9e service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=71938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 24 16:41:16.145547 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7bce4c3-c447-4db0-be91-7e489a9d7d9e service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=71938) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:442}} Nov 24 16:41:16.174673 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7bce4c3-c447-4db0-be91-7e489a9d7d9e service nova] RBAC: Authorization granted {{(pid=71938) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 24 16:41:16.186741 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: [pid: 71938|app: 0|req: 747/1493] 10.222.0.53 () {60 vars in 1356 bytes} [Wed Nov 24 16:41:16 2021] GET /identity/v3/auth/tokens => generated 3669 bytes in 71 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 24 16:41:18.238914 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7aa8ac64-e3e7-4873-9a25-20314e63e68a None None] REQUEST_METHOD: `GET` {{(pid=71939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 24 16:41:18.239392 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7aa8ac64-e3e7-4873-9a25-20314e63e68a None None] SCRIPT_NAME: `/identity` {{(pid=71939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 24 16:41:18.239589 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7aa8ac64-e3e7-4873-9a25-20314e63e68a None None] PATH_INFO: `/` {{(pid=71939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 24 16:41:18.241485 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: [pid: 71939|app: 0|req: 747/1494] 10.222.0.53 () {54 vars in 915 bytes} [Wed Nov 24 16:41:18 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 24 16:41:18.247257 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3db50f2b-c6d2-4d23-b1da-d4ddd2af9568 None None] REQUEST_METHOD: `POST` {{(pid=71938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 24 16:41:18.247653 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3db50f2b-c6d2-4d23-b1da-d4ddd2af9568 None None] SCRIPT_NAME: `/identity` {{(pid=71938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 24 16:41:18.247993 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3db50f2b-c6d2-4d23-b1da-d4ddd2af9568 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=71938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 24 16:41:18.272591 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.auth.core [None req-3db50f2b-c6d2-4d23-b1da-d4ddd2af9568 None None] MFA Rules not processed for user `0f2ba2e8375b4e8c8792ee1e22b60427`. Rule list: `[]` (Enabled: `True`). {{(pid=71938) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:442}} Nov 24 16:41:18.273803 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.fernet_utils [None req-3db50f2b-c6d2-4d23-b1da-d4ddd2af9568 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=71938) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:289}} Nov 24 16:41:18.281891 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: [pid: 71938|app: 0|req: 748/1495] 10.222.0.53 () {58 vars in 1013 bytes} [Wed Nov 24 16:41:18 2021] POST /identity/v3/auth/tokens => generated 3669 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 24 16:41:18.425225 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-272ca1ca-d371-4c17-a9db-19be4a952e7c None None] REQUEST_METHOD: `POST` {{(pid=71939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 24 16:41:18.425573 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-272ca1ca-d371-4c17-a9db-19be4a952e7c None None] SCRIPT_NAME: `/identity` {{(pid=71939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 24 16:41:18.425912 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-272ca1ca-d371-4c17-a9db-19be4a952e7c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=71939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 24 16:41:18.451854 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.auth.core [None req-272ca1ca-d371-4c17-a9db-19be4a952e7c None None] MFA Rules not processed for user `0f2ba2e8375b4e8c8792ee1e22b60427`. Rule list: `[]` (Enabled: `True`). {{(pid=71939) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:442}} Nov 24 16:41:18.453079 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.fernet_utils [None req-272ca1ca-d371-4c17-a9db-19be4a952e7c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=71939) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:289}} Nov 24 16:41:18.460724 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: [pid: 71939|app: 0|req: 748/1496] 10.222.0.53 () {58 vars in 1013 bytes} [Wed Nov 24 16:41:18 2021] POST /identity/v3/auth/tokens => generated 3669 bytes in 37 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 24 16:41:18.472845 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3db50f2b-c6d2-4d23-b1da-d4ddd2af9568 None None] Authenticating user token {{(pid=71938) process_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 24 16:41:18.485598 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3db50f2b-c6d2-4d23-b1da-d4ddd2af9568 None None] Validating token access rules against request {{(pid=71938) validate_allowed_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 24 16:41:18.491069 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-778f728d-c847-4224-b5e8-d7a4564eb304 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e196802d4d5432482b6d2eabc25f74e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3b3940d4ae1c4177ae29c02377bb4b0b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'service', 'ResellerAdmin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=71938) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 24 16:41:18.491721 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-778f728d-c847-4224-b5e8-d7a4564eb304 service nova] REQUEST_METHOD: `GET` {{(pid=71938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 24 16:41:18.492061 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-778f728d-c847-4224-b5e8-d7a4564eb304 service nova] SCRIPT_NAME: `/identity` {{(pid=71938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 24 16:41:18.492393 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-778f728d-c847-4224-b5e8-d7a4564eb304 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=71938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 24 16:41:18.501646 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-778f728d-c847-4224-b5e8-d7a4564eb304 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=71938) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:442}} Nov 24 16:41:18.530536 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-778f728d-c847-4224-b5e8-d7a4564eb304 service nova] RBAC: Authorization granted {{(pid=71938) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 24 16:41:18.540508 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: [pid: 71938|app: 0|req: 749/1497] 10.222.0.53 () {60 vars in 1356 bytes} [Wed Nov 24 16:41:18 2021] GET /identity/v3/auth/tokens => generated 3669 bytes in 68 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 24 16:41:20.663736 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5c55ad7-c641-4f66-a6ed-5df68e84c8b6 None None] REQUEST_METHOD: `GET` {{(pid=71939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 24 16:41:20.664269 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5c55ad7-c641-4f66-a6ed-5df68e84c8b6 None None] SCRIPT_NAME: `/identity` {{(pid=71939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 24 16:41:20.664398 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5c55ad7-c641-4f66-a6ed-5df68e84c8b6 None None] PATH_INFO: `/` {{(pid=71939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 24 16:41:20.666395 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: [pid: 71939|app: 0|req: 749/1498] 10.222.0.53 () {54 vars in 915 bytes} [Wed Nov 24 16:41:20 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 24 16:41:20.672086 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f40dc179-f344-4df8-8851-a941e8ac419c None None] REQUEST_METHOD: `POST` {{(pid=71938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 24 16:41:20.672439 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f40dc179-f344-4df8-8851-a941e8ac419c None None] SCRIPT_NAME: `/identity` {{(pid=71938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 24 16:41:20.672777 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f40dc179-f344-4df8-8851-a941e8ac419c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=71938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 24 16:41:20.699182 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.auth.core [None req-f40dc179-f344-4df8-8851-a941e8ac419c None None] MFA Rules not processed for user `0f2ba2e8375b4e8c8792ee1e22b60427`. Rule list: `[]` (Enabled: `True`). {{(pid=71938) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:442}} Nov 24 16:41:20.700397 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.fernet_utils [None req-f40dc179-f344-4df8-8851-a941e8ac419c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=71938) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:289}} Nov 24 16:41:20.707900 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: [pid: 71938|app: 0|req: 750/1499] 10.222.0.53 () {58 vars in 1013 bytes} [Wed Nov 24 16:41:20 2021] POST /identity/v3/auth/tokens => generated 3669 bytes in 37 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 24 16:41:20.851314 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c64cb2d9-a912-499a-bfbe-32dcebfd4030 None None] REQUEST_METHOD: `POST` {{(pid=71939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 24 16:41:20.851664 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c64cb2d9-a912-499a-bfbe-32dcebfd4030 None None] SCRIPT_NAME: `/identity` {{(pid=71939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 24 16:41:20.851999 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c64cb2d9-a912-499a-bfbe-32dcebfd4030 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=71939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 24 16:41:20.875728 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.auth.core [None req-c64cb2d9-a912-499a-bfbe-32dcebfd4030 None None] MFA Rules not processed for user `0f2ba2e8375b4e8c8792ee1e22b60427`. Rule list: `[]` (Enabled: `True`). {{(pid=71939) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:442}} Nov 24 16:41:20.876954 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.fernet_utils [None req-c64cb2d9-a912-499a-bfbe-32dcebfd4030 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=71939) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:289}} Nov 24 16:41:20.884988 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: [pid: 71939|app: 0|req: 750/1500] 10.222.0.53 () {58 vars in 1013 bytes} [Wed Nov 24 16:41:20 2021] POST /identity/v3/auth/tokens => generated 3669 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 24 16:41:20.896653 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f40dc179-f344-4df8-8851-a941e8ac419c None None] Authenticating user token {{(pid=71938) process_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 24 16:41:20.909004 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f40dc179-f344-4df8-8851-a941e8ac419c None None] Validating token access rules against request {{(pid=71938) validate_allowed_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 24 16:41:20.914418 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25982827-7a53-464b-a8ea-7a678c0689f7 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e196802d4d5432482b6d2eabc25f74e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3b3940d4ae1c4177ae29c02377bb4b0b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'service', 'ResellerAdmin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=71938) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 24 16:41:20.915021 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25982827-7a53-464b-a8ea-7a678c0689f7 service nova] REQUEST_METHOD: `GET` {{(pid=71938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 24 16:41:20.915364 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25982827-7a53-464b-a8ea-7a678c0689f7 service nova] SCRIPT_NAME: `/identity` {{(pid=71938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 24 16:41:20.915781 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25982827-7a53-464b-a8ea-7a678c0689f7 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=71938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 24 16:41:20.924422 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25982827-7a53-464b-a8ea-7a678c0689f7 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=71938) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:442}} Nov 24 16:41:20.954236 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25982827-7a53-464b-a8ea-7a678c0689f7 service nova] RBAC: Authorization granted {{(pid=71938) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 24 16:41:20.965155 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: [pid: 71938|app: 0|req: 751/1501] 10.222.0.53 () {60 vars in 1356 bytes} [Wed Nov 24 16:41:20 2021] GET /identity/v3/auth/tokens => generated 3669 bytes in 69 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 24 16:41:23.085072 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b350f30d-6677-4108-ad1c-4d6871ddae03 None None] REQUEST_METHOD: `GET` {{(pid=71939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 24 16:41:23.085581 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b350f30d-6677-4108-ad1c-4d6871ddae03 None None] SCRIPT_NAME: `/identity` {{(pid=71939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 24 16:41:23.085675 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b350f30d-6677-4108-ad1c-4d6871ddae03 None None] PATH_INFO: `/` {{(pid=71939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 24 16:41:23.088049 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: [pid: 71939|app: 0|req: 751/1502] 10.222.0.53 () {54 vars in 915 bytes} [Wed Nov 24 16:41:23 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 24 16:41:23.094213 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31152a8d-424a-4531-82c7-5fc6643b1d18 None None] REQUEST_METHOD: `POST` {{(pid=71938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 24 16:41:23.094561 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31152a8d-424a-4531-82c7-5fc6643b1d18 None None] SCRIPT_NAME: `/identity` {{(pid=71938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 24 16:41:23.094896 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31152a8d-424a-4531-82c7-5fc6643b1d18 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=71938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 24 16:41:23.119440 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.auth.core [None req-31152a8d-424a-4531-82c7-5fc6643b1d18 None None] MFA Rules not processed for user `0f2ba2e8375b4e8c8792ee1e22b60427`. Rule list: `[]` (Enabled: `True`). {{(pid=71938) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:442}} Nov 24 16:41:23.120723 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.fernet_utils [None req-31152a8d-424a-4531-82c7-5fc6643b1d18 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=71938) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:289}} Nov 24 16:41:23.128265 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: [pid: 71938|app: 0|req: 752/1503] 10.222.0.53 () {58 vars in 1013 bytes} [Wed Nov 24 16:41:23 2021] POST /identity/v3/auth/tokens => generated 3669 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 24 16:41:23.283425 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6580405f-84eb-4200-92cc-d5e0cd3ffb27 None None] REQUEST_METHOD: `POST` {{(pid=71939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 24 16:41:23.283767 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6580405f-84eb-4200-92cc-d5e0cd3ffb27 None None] SCRIPT_NAME: `/identity` {{(pid=71939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 24 16:41:23.284095 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6580405f-84eb-4200-92cc-d5e0cd3ffb27 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=71939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 24 16:41:23.307984 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.auth.core [None req-6580405f-84eb-4200-92cc-d5e0cd3ffb27 None None] MFA Rules not processed for user `0f2ba2e8375b4e8c8792ee1e22b60427`. Rule list: `[]` (Enabled: `True`). {{(pid=71939) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:442}} Nov 24 16:41:23.309192 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.fernet_utils [None req-6580405f-84eb-4200-92cc-d5e0cd3ffb27 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=71939) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:289}} Nov 24 16:41:23.316493 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: [pid: 71939|app: 0|req: 752/1504] 10.222.0.53 () {58 vars in 1013 bytes} [Wed Nov 24 16:41:23 2021] POST /identity/v3/auth/tokens => generated 3669 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 24 16:41:23.328806 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31152a8d-424a-4531-82c7-5fc6643b1d18 None None] Authenticating user token {{(pid=71938) process_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 24 16:41:23.341097 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31152a8d-424a-4531-82c7-5fc6643b1d18 None None] Validating token access rules against request {{(pid=71938) validate_allowed_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 24 16:41:23.346455 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56db7abc-335f-4204-9824-818dd7b1ba2c service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e196802d4d5432482b6d2eabc25f74e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3b3940d4ae1c4177ae29c02377bb4b0b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'service', 'ResellerAdmin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=71938) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 24 16:41:23.347109 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56db7abc-335f-4204-9824-818dd7b1ba2c service nova] REQUEST_METHOD: `GET` {{(pid=71938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 24 16:41:23.347453 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56db7abc-335f-4204-9824-818dd7b1ba2c service nova] SCRIPT_NAME: `/identity` {{(pid=71938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 24 16:41:23.347819 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56db7abc-335f-4204-9824-818dd7b1ba2c service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=71938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 24 16:41:23.356861 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56db7abc-335f-4204-9824-818dd7b1ba2c service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=71938) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:442}} Nov 24 16:41:23.385592 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56db7abc-335f-4204-9824-818dd7b1ba2c service nova] RBAC: Authorization granted {{(pid=71938) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 24 16:41:23.395355 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: [pid: 71938|app: 0|req: 753/1505] 10.222.0.53 () {60 vars in 1356 bytes} [Wed Nov 24 16:41:23 2021] GET /identity/v3/auth/tokens => generated 3669 bytes in 68 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 24 16:41:25.519461 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acf3e853-5af7-4c59-a898-8270e4dfcad4 None None] REQUEST_METHOD: `GET` {{(pid=71939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 24 16:41:25.520008 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acf3e853-5af7-4c59-a898-8270e4dfcad4 None None] SCRIPT_NAME: `/identity` {{(pid=71939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 24 16:41:25.520008 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acf3e853-5af7-4c59-a898-8270e4dfcad4 None None] PATH_INFO: `/` {{(pid=71939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 24 16:41:25.521917 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: [pid: 71939|app: 0|req: 753/1506] 10.222.0.53 () {54 vars in 915 bytes} [Wed Nov 24 16:41:25 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 24 16:41:25.527528 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed48b41d-c80f-4005-8102-4fb01954e69d None None] REQUEST_METHOD: `POST` {{(pid=71938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 24 16:41:25.527906 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed48b41d-c80f-4005-8102-4fb01954e69d None None] SCRIPT_NAME: `/identity` {{(pid=71938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 24 16:41:25.528246 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed48b41d-c80f-4005-8102-4fb01954e69d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=71938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 24 16:41:25.552361 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.auth.core [None req-ed48b41d-c80f-4005-8102-4fb01954e69d None None] MFA Rules not processed for user `0f2ba2e8375b4e8c8792ee1e22b60427`. Rule list: `[]` (Enabled: `True`). {{(pid=71938) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:442}} Nov 24 16:41:25.553584 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.fernet_utils [None req-ed48b41d-c80f-4005-8102-4fb01954e69d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=71938) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:289}} Nov 24 16:41:25.561789 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: [pid: 71938|app: 0|req: 754/1507] 10.222.0.53 () {58 vars in 1013 bytes} [Wed Nov 24 16:41:25 2021] POST /identity/v3/auth/tokens => generated 3669 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 24 16:41:25.705567 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c6105ac-0488-4c6e-97a5-4a5f61a4e699 None None] REQUEST_METHOD: `POST` {{(pid=71939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 24 16:41:25.705914 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c6105ac-0488-4c6e-97a5-4a5f61a4e699 None None] SCRIPT_NAME: `/identity` {{(pid=71939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 24 16:41:25.706307 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c6105ac-0488-4c6e-97a5-4a5f61a4e699 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=71939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 24 16:41:25.729732 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.auth.core [None req-5c6105ac-0488-4c6e-97a5-4a5f61a4e699 None None] MFA Rules not processed for user `0f2ba2e8375b4e8c8792ee1e22b60427`. Rule list: `[]` (Enabled: `True`). {{(pid=71939) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:442}} Nov 24 16:41:25.730969 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.fernet_utils [None req-5c6105ac-0488-4c6e-97a5-4a5f61a4e699 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=71939) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:289}} Nov 24 16:41:25.738380 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: [pid: 71939|app: 0|req: 754/1508] 10.222.0.53 () {58 vars in 1013 bytes} [Wed Nov 24 16:41:25 2021] POST /identity/v3/auth/tokens => generated 3669 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Nov 24 16:41:25.750563 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed48b41d-c80f-4005-8102-4fb01954e69d None None] Authenticating user token {{(pid=71938) process_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 24 16:41:25.762871 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed48b41d-c80f-4005-8102-4fb01954e69d None None] Validating token access rules against request {{(pid=71938) validate_allowed_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 24 16:41:25.768250 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64f9af03-7e1b-4de2-a8c5-423760454c40 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e196802d4d5432482b6d2eabc25f74e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3b3940d4ae1c4177ae29c02377bb4b0b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'service', 'ResellerAdmin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=71938) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 24 16:41:25.768904 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64f9af03-7e1b-4de2-a8c5-423760454c40 service nova] REQUEST_METHOD: `GET` {{(pid=71938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 24 16:41:25.769247 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64f9af03-7e1b-4de2-a8c5-423760454c40 service nova] SCRIPT_NAME: `/identity` {{(pid=71938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 24 16:41:25.769627 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64f9af03-7e1b-4de2-a8c5-423760454c40 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=71938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 24 16:41:25.778099 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64f9af03-7e1b-4de2-a8c5-423760454c40 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=71938) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:442}} Nov 24 16:41:25.807708 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64f9af03-7e1b-4de2-a8c5-423760454c40 service nova] RBAC: Authorization granted {{(pid=71938) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 24 16:41:25.817529 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: [pid: 71938|app: 0|req: 755/1509] 10.222.0.53 () {60 vars in 1356 bytes} [Wed Nov 24 16:41:25 2021] GET /identity/v3/auth/tokens => generated 3669 bytes in 68 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 24 16:41:27.983066 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-444a17c9-9807-4aad-9b5a-72efe2bf25ac None None] REQUEST_METHOD: `GET` {{(pid=71939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 24 16:41:27.983632 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-444a17c9-9807-4aad-9b5a-72efe2bf25ac None None] SCRIPT_NAME: `/identity` {{(pid=71939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 24 16:41:27.983746 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-444a17c9-9807-4aad-9b5a-72efe2bf25ac None None] PATH_INFO: `/` {{(pid=71939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 24 16:41:27.985576 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: [pid: 71939|app: 0|req: 755/1510] 10.222.0.53 () {54 vars in 915 bytes} [Wed Nov 24 16:41:27 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 24 16:41:27.991118 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f489a30c-cfe7-4d4c-b322-16477b8936cf None None] REQUEST_METHOD: `POST` {{(pid=71938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 24 16:41:27.991470 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f489a30c-cfe7-4d4c-b322-16477b8936cf None None] SCRIPT_NAME: `/identity` {{(pid=71938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 24 16:41:27.991808 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f489a30c-cfe7-4d4c-b322-16477b8936cf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=71938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 24 16:41:28.016102 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.auth.core [None req-f489a30c-cfe7-4d4c-b322-16477b8936cf None None] MFA Rules not processed for user `0f2ba2e8375b4e8c8792ee1e22b60427`. Rule list: `[]` (Enabled: `True`). {{(pid=71938) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:442}} Nov 24 16:41:28.017328 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.fernet_utils [None req-f489a30c-cfe7-4d4c-b322-16477b8936cf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=71938) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:289}} Nov 24 16:41:28.024881 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: [pid: 71938|app: 0|req: 756/1511] 10.222.0.53 () {58 vars in 1013 bytes} [Wed Nov 24 16:41:27 2021] POST /identity/v3/auth/tokens => generated 3669 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 24 16:41:28.168892 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-369ba649-3256-4b11-80bc-283c3a46c6b9 None None] REQUEST_METHOD: `POST` {{(pid=71939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 24 16:41:28.169235 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-369ba649-3256-4b11-80bc-283c3a46c6b9 None None] SCRIPT_NAME: `/identity` {{(pid=71939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 24 16:41:28.169569 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-369ba649-3256-4b11-80bc-283c3a46c6b9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=71939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 24 16:41:28.192666 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.auth.core [None req-369ba649-3256-4b11-80bc-283c3a46c6b9 None None] MFA Rules not processed for user `0f2ba2e8375b4e8c8792ee1e22b60427`. Rule list: `[]` (Enabled: `True`). {{(pid=71939) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:442}} Nov 24 16:41:28.193873 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.fernet_utils [None req-369ba649-3256-4b11-80bc-283c3a46c6b9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=71939) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:289}} Nov 24 16:41:28.204634 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: [pid: 71939|app: 0|req: 756/1512] 10.222.0.53 () {58 vars in 1013 bytes} [Wed Nov 24 16:41:28 2021] POST /identity/v3/auth/tokens => generated 3669 bytes in 37 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 24 16:41:28.216922 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f489a30c-cfe7-4d4c-b322-16477b8936cf None None] Authenticating user token {{(pid=71938) process_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 24 16:41:28.230716 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f489a30c-cfe7-4d4c-b322-16477b8936cf None None] Validating token access rules against request {{(pid=71938) validate_allowed_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 24 16:41:28.236283 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4055f23-8439-4782-a110-71194cf6e3b2 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e196802d4d5432482b6d2eabc25f74e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3b3940d4ae1c4177ae29c02377bb4b0b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'service', 'ResellerAdmin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=71938) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 24 16:41:28.236892 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4055f23-8439-4782-a110-71194cf6e3b2 service nova] REQUEST_METHOD: `GET` {{(pid=71938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 24 16:41:28.237229 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4055f23-8439-4782-a110-71194cf6e3b2 service nova] SCRIPT_NAME: `/identity` {{(pid=71938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 24 16:41:28.237559 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4055f23-8439-4782-a110-71194cf6e3b2 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=71938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 24 16:41:28.246263 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4055f23-8439-4782-a110-71194cf6e3b2 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=71938) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:442}} Nov 24 16:41:28.274308 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4055f23-8439-4782-a110-71194cf6e3b2 service nova] RBAC: Authorization granted {{(pid=71938) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 24 16:41:28.284345 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: [pid: 71938|app: 0|req: 757/1513] 10.222.0.53 () {60 vars in 1356 bytes} [Wed Nov 24 16:41:28 2021] GET /identity/v3/auth/tokens => generated 3669 bytes in 68 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 24 16:41:38.083989 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb0afb3d-caf3-416a-a1ca-8ac1b6f181e0 None None] REQUEST_METHOD: `GET` {{(pid=71939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 24 16:41:38.084544 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb0afb3d-caf3-416a-a1ca-8ac1b6f181e0 None None] SCRIPT_NAME: `/identity` {{(pid=71939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 24 16:41:38.084653 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb0afb3d-caf3-416a-a1ca-8ac1b6f181e0 None None] PATH_INFO: `/` {{(pid=71939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 24 16:41:38.086666 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: [pid: 71939|app: 0|req: 757/1514] 10.222.0.53 () {54 vars in 915 bytes} [Wed Nov 24 16:41:38 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 24 16:41:38.093013 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01e4afee-150e-4f1a-a70d-35e57d532820 None None] REQUEST_METHOD: `POST` {{(pid=71938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 24 16:41:38.093287 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01e4afee-150e-4f1a-a70d-35e57d532820 None None] SCRIPT_NAME: `/identity` {{(pid=71938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 24 16:41:38.093598 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01e4afee-150e-4f1a-a70d-35e57d532820 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=71938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 24 16:41:38.118440 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.auth.core [None req-01e4afee-150e-4f1a-a70d-35e57d532820 None None] MFA Rules not processed for user `0f2ba2e8375b4e8c8792ee1e22b60427`. Rule list: `[]` (Enabled: `True`). {{(pid=71938) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:442}} Nov 24 16:41:38.119862 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.fernet_utils [None req-01e4afee-150e-4f1a-a70d-35e57d532820 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=71938) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:289}} Nov 24 16:41:38.127304 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: [pid: 71938|app: 0|req: 758/1515] 10.222.0.53 () {58 vars in 1013 bytes} [Wed Nov 24 16:41:38 2021] POST /identity/v3/auth/tokens => generated 3669 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 24 16:41:38.181150 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-723819b8-40a4-4752-b9d4-b44409c9f863 None None] REQUEST_METHOD: `POST` {{(pid=71939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 24 16:41:38.181493 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-723819b8-40a4-4752-b9d4-b44409c9f863 None None] SCRIPT_NAME: `/identity` {{(pid=71939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 24 16:41:38.181860 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-723819b8-40a4-4752-b9d4-b44409c9f863 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=71939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 24 16:41:38.208711 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.auth.core [None req-723819b8-40a4-4752-b9d4-b44409c9f863 None None] MFA Rules not processed for user `0f2ba2e8375b4e8c8792ee1e22b60427`. Rule list: `[]` (Enabled: `True`). {{(pid=71939) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:442}} Nov 24 16:41:38.210756 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.fernet_utils [None req-723819b8-40a4-4752-b9d4-b44409c9f863 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=71939) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:289}} Nov 24 16:41:38.222187 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: [pid: 71939|app: 0|req: 758/1516] 10.222.0.53 () {58 vars in 1013 bytes} [Wed Nov 24 16:41:38 2021] POST /identity/v3/auth/tokens => generated 3669 bytes in 42 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 24 16:41:38.273747 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cfd5489-16b8-42ed-a7fb-34faec38e711 None None] REQUEST_METHOD: `GET` {{(pid=71938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 24 16:41:38.274019 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cfd5489-16b8-42ed-a7fb-34faec38e711 None None] SCRIPT_NAME: `/identity` {{(pid=71938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 24 16:41:38.274447 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cfd5489-16b8-42ed-a7fb-34faec38e711 None None] PATH_INFO: `/` {{(pid=71938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 24 16:41:38.276400 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: [pid: 71938|app: 0|req: 759/1517] 10.222.0.53 () {54 vars in 950 bytes} [Wed Nov 24 16:41:38 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 24 16:41:38.281960 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73612ac3-f33c-422c-bda0-163c8df32a5b None None] REQUEST_METHOD: `POST` {{(pid=71939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 24 16:41:38.282349 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73612ac3-f33c-422c-bda0-163c8df32a5b None None] SCRIPT_NAME: `/identity` {{(pid=71939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 24 16:41:38.282733 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73612ac3-f33c-422c-bda0-163c8df32a5b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=71939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 24 16:41:38.356273 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.auth.core [None req-73612ac3-f33c-422c-bda0-163c8df32a5b None None] MFA Rules not processed for user `a12374a3093a401a97c343ff0854184d`. Rule list: `[]` (Enabled: `True`). {{(pid=71939) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:442}} Nov 24 16:41:38.357520 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.fernet_utils [None req-73612ac3-f33c-422c-bda0-163c8df32a5b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=71939) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:289}} Nov 24 16:41:38.430437 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: [pid: 71939|app: 0|req: 759/1518] 10.222.0.53 () {58 vars in 1048 bytes} [Wed Nov 24 16:41:38 2021] POST /identity/v3/auth/tokens => generated 3550 bytes in 149 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 24 16:41:38.439381 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cfd5489-16b8-42ed-a7fb-34faec38e711 None None] Authenticating user token {{(pid=71938) process_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 24 16:41:38.451215 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cfd5489-16b8-42ed-a7fb-34faec38e711 None None] Validating token access rules against request {{(pid=71938) validate_allowed_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 24 16:41:38.455303 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b30a6696-fd62-4b3f-b2ab-4715c8699278 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a12374a3093a401a97c343ff0854184d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3b3940d4ae1c4177ae29c02377bb4b0b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=71938) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 24 16:41:38.455966 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b30a6696-fd62-4b3f-b2ab-4715c8699278 service cinder] REQUEST_METHOD: `GET` {{(pid=71938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 24 16:41:38.456308 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b30a6696-fd62-4b3f-b2ab-4715c8699278 service cinder] SCRIPT_NAME: `/identity` {{(pid=71938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 24 16:41:38.456638 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b30a6696-fd62-4b3f-b2ab-4715c8699278 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=71938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 24 16:41:38.467208 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b30a6696-fd62-4b3f-b2ab-4715c8699278 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=71938) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:442}} Nov 24 16:41:38.496963 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b30a6696-fd62-4b3f-b2ab-4715c8699278 service cinder] RBAC: Authorization granted {{(pid=71938) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 24 16:41:38.508073 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: [pid: 71938|app: 0|req: 760/1519] 10.222.0.53 () {60 vars in 1356 bytes} [Wed Nov 24 16:41:38 2021] GET /identity/v3/auth/tokens => generated 3669 bytes in 69 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 24 16:41:41.645481 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-955b7b3a-3cac-46e6-ab93-4ce93c6d35f1 None None] REQUEST_METHOD: `GET` {{(pid=71939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 24 16:41:41.646062 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-955b7b3a-3cac-46e6-ab93-4ce93c6d35f1 None None] SCRIPT_NAME: `/identity` {{(pid=71939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 24 16:41:41.646179 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-955b7b3a-3cac-46e6-ab93-4ce93c6d35f1 None None] PATH_INFO: `/` {{(pid=71939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 24 16:41:41.648043 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: [pid: 71939|app: 0|req: 760/1520] 10.222.0.53 () {54 vars in 915 bytes} [Wed Nov 24 16:41:41 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 24 16:41:41.654430 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72601bd0-b211-4638-bbe4-640c2ddd2276 None None] REQUEST_METHOD: `POST` {{(pid=71938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 24 16:41:41.654783 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72601bd0-b211-4638-bbe4-640c2ddd2276 None None] SCRIPT_NAME: `/identity` {{(pid=71938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 24 16:41:41.655118 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72601bd0-b211-4638-bbe4-640c2ddd2276 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=71938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 24 16:41:41.678937 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.auth.core [None req-72601bd0-b211-4638-bbe4-640c2ddd2276 None None] MFA Rules not processed for user `0f2ba2e8375b4e8c8792ee1e22b60427`. Rule list: `[]` (Enabled: `True`). {{(pid=71938) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:442}} Nov 24 16:41:41.680155 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.fernet_utils [None req-72601bd0-b211-4638-bbe4-640c2ddd2276 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=71938) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:289}} Nov 24 16:41:41.688393 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: [pid: 71938|app: 0|req: 761/1521] 10.222.0.53 () {58 vars in 1013 bytes} [Wed Nov 24 16:41:41 2021] POST /identity/v3/auth/tokens => generated 3669 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 24 16:41:41.711539 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-965509d6-fd03-4ba2-b83c-231551896de8 None None] REQUEST_METHOD: `POST` {{(pid=71939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 24 16:41:41.711923 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-965509d6-fd03-4ba2-b83c-231551896de8 None None] SCRIPT_NAME: `/identity` {{(pid=71939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 24 16:41:41.712297 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-965509d6-fd03-4ba2-b83c-231551896de8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=71939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 24 16:41:41.736465 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.auth.core [None req-965509d6-fd03-4ba2-b83c-231551896de8 None None] MFA Rules not processed for user `0f2ba2e8375b4e8c8792ee1e22b60427`. Rule list: `[]` (Enabled: `True`). {{(pid=71939) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:442}} Nov 24 16:41:41.737693 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.fernet_utils [None req-965509d6-fd03-4ba2-b83c-231551896de8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=71939) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:289}} Nov 24 16:41:41.745441 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: [pid: 71939|app: 0|req: 761/1522] 10.222.0.53 () {58 vars in 1013 bytes} [Wed Nov 24 16:41:41 2021] POST /identity/v3/auth/tokens => generated 3669 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 24 16:41:41.751620 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72601bd0-b211-4638-bbe4-640c2ddd2276 None None] Authenticating user token {{(pid=71938) process_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 24 16:41:41.761890 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72601bd0-b211-4638-bbe4-640c2ddd2276 None None] Validating token access rules against request {{(pid=71938) validate_allowed_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 24 16:41:41.766265 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08c4490d-ba6c-45b8-9b00-f5a184a206be admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f2ba2e8375b4e8c8792ee1e22b60427', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '00a5583c7b7443e98e7a1d31a0b638dc', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=71938) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 24 16:41:41.766919 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08c4490d-ba6c-45b8-9b00-f5a184a206be admin admin] REQUEST_METHOD: `GET` {{(pid=71938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 24 16:41:41.767254 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08c4490d-ba6c-45b8-9b00-f5a184a206be admin admin] SCRIPT_NAME: `/identity` {{(pid=71938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 24 16:41:41.767583 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08c4490d-ba6c-45b8-9b00-f5a184a206be admin admin] PATH_INFO: `/v3/projects` {{(pid=71938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 24 16:41:41.768366 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08c4490d-ba6c-45b8-9b00-f5a184a206be admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=71938) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:442}} Nov 24 16:41:41.796673 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08c4490d-ba6c-45b8-9b00-f5a184a206be admin admin] RBAC: Authorization granted {{(pid=71938) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 24 16:41:41.813754 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: [pid: 71938|app: 0|req: 762/1523] 10.222.0.53 () {56 vars in 1099 bytes} [Wed Nov 24 16:41:41 2021] GET /identity/v3/projects => generated 2553 bytes in 63 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 24 16:41:43.806461 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d63c4a44-8438-4ff2-92c0-d599d325b84f None None] REQUEST_METHOD: `GET` {{(pid=71939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 24 16:41:43.807166 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d63c4a44-8438-4ff2-92c0-d599d325b84f None None] SCRIPT_NAME: `/identity` {{(pid=71939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 24 16:41:43.807166 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d63c4a44-8438-4ff2-92c0-d599d325b84f None None] PATH_INFO: `/` {{(pid=71939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 24 16:41:43.808920 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: [pid: 71939|app: 0|req: 762/1524] 10.222.0.53 () {54 vars in 915 bytes} [Wed Nov 24 16:41:43 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 24 16:41:43.814592 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c9e5b07-5b0b-47ce-9d55-127eafb56073 None None] REQUEST_METHOD: `POST` {{(pid=71938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 24 16:41:43.814952 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c9e5b07-5b0b-47ce-9d55-127eafb56073 None None] SCRIPT_NAME: `/identity` {{(pid=71938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 24 16:41:43.815296 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c9e5b07-5b0b-47ce-9d55-127eafb56073 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=71938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 24 16:41:43.838729 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.auth.core [None req-9c9e5b07-5b0b-47ce-9d55-127eafb56073 None None] MFA Rules not processed for user `0f2ba2e8375b4e8c8792ee1e22b60427`. Rule list: `[]` (Enabled: `True`). {{(pid=71938) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:442}} Nov 24 16:41:43.839955 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.fernet_utils [None req-9c9e5b07-5b0b-47ce-9d55-127eafb56073 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=71938) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:289}} Nov 24 16:41:43.847417 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: [pid: 71938|app: 0|req: 763/1525] 10.222.0.53 () {58 vars in 1013 bytes} [Wed Nov 24 16:41:43 2021] POST /identity/v3/auth/tokens => generated 3669 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 24 16:41:43.870333 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adc1d433-f65e-4be1-9c64-b0521776cc6e None None] REQUEST_METHOD: `POST` {{(pid=71939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 24 16:41:43.870679 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adc1d433-f65e-4be1-9c64-b0521776cc6e None None] SCRIPT_NAME: `/identity` {{(pid=71939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 24 16:41:43.871021 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adc1d433-f65e-4be1-9c64-b0521776cc6e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=71939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 24 16:41:43.893795 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.auth.core [None req-adc1d433-f65e-4be1-9c64-b0521776cc6e None None] MFA Rules not processed for user `0f2ba2e8375b4e8c8792ee1e22b60427`. Rule list: `[]` (Enabled: `True`). {{(pid=71939) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:442}} Nov 24 16:41:43.895041 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.fernet_utils [None req-adc1d433-f65e-4be1-9c64-b0521776cc6e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=71939) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:289}} Nov 24 16:41:43.903137 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: [pid: 71939|app: 0|req: 763/1526] 10.222.0.53 () {58 vars in 1013 bytes} [Wed Nov 24 16:41:43 2021] POST /identity/v3/auth/tokens => generated 3669 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 24 16:41:43.909257 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c9e5b07-5b0b-47ce-9d55-127eafb56073 None None] Authenticating user token {{(pid=71938) process_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 24 16:41:43.919799 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c9e5b07-5b0b-47ce-9d55-127eafb56073 None None] Validating token access rules against request {{(pid=71938) validate_allowed_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 24 16:41:43.924286 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e7b20ab-7da1-4afd-bb40-9f62690c16f9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f2ba2e8375b4e8c8792ee1e22b60427', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '00a5583c7b7443e98e7a1d31a0b638dc', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=71938) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 24 16:41:43.925236 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e7b20ab-7da1-4afd-bb40-9f62690c16f9 admin admin] REQUEST_METHOD: `GET` {{(pid=71938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 24 16:41:43.925568 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e7b20ab-7da1-4afd-bb40-9f62690c16f9 admin admin] SCRIPT_NAME: `/identity` {{(pid=71938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 24 16:41:43.925898 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e7b20ab-7da1-4afd-bb40-9f62690c16f9 admin admin] PATH_INFO: `/v3/projects/00a5583c7b7443e98e7a1d31a0b638dc` {{(pid=71938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 24 16:41:43.927143 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e7b20ab-7da1-4afd-bb40-9f62690c16f9 admin admin] RBAC: Authorizing `identity:get_project(project_id=00a5583c7b7443e98e7a1d31a0b638dc)` {{(pid=71938) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:442}} Nov 24 16:41:43.955943 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e7b20ab-7da1-4afd-bb40-9f62690c16f9 admin admin] RBAC: Authorization granted {{(pid=71938) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 24 16:41:43.957621 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: [pid: 71938|app: 0|req: 764/1527] 10.222.0.53 () {56 vars in 1198 bytes} [Wed Nov 24 16:41:43 2021] GET /identity/v3/projects/00a5583c7b7443e98e7a1d31a0b638dc => generated 344 bytes in 49 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 24 16:41:43.964589 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adc1d433-f65e-4be1-9c64-b0521776cc6e None None] Authenticating user token {{(pid=71939) process_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 24 16:41:43.974400 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adc1d433-f65e-4be1-9c64-b0521776cc6e None None] Validating token access rules against request {{(pid=71939) validate_allowed_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 24 16:41:43.981451 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1304aa8f-d5fd-423d-b632-2c6aebb0f2fb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f2ba2e8375b4e8c8792ee1e22b60427', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '00a5583c7b7443e98e7a1d31a0b638dc', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=71939) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 24 16:41:43.982162 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1304aa8f-d5fd-423d-b632-2c6aebb0f2fb admin admin] REQUEST_METHOD: `GET` {{(pid=71939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 24 16:41:43.982500 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1304aa8f-d5fd-423d-b632-2c6aebb0f2fb admin admin] SCRIPT_NAME: `/identity` {{(pid=71939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 24 16:41:43.982835 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1304aa8f-d5fd-423d-b632-2c6aebb0f2fb admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=71939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 24 16:41:43.983667 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1304aa8f-d5fd-423d-b632-2c6aebb0f2fb admin admin] RBAC: Adding query filter params (scope.project.id=00a5583c7b7443e98e7a1d31a0b638dc) {{(pid=71939) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:161}} Nov 24 16:41:43.984019 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1304aa8f-d5fd-423d-b632-2c6aebb0f2fb admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=71939) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:442}} Nov 24 16:41:44.016781 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1304aa8f-d5fd-423d-b632-2c6aebb0f2fb admin admin] RBAC: Authorization granted {{(pid=71939) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 24 16:41:44.023699 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: [pid: 71939|app: 0|req: 764/1528] 10.222.0.53 () {56 vars in 1222 bytes} [Wed Nov 24 16:41:43 2021] GET /identity/v3/role_assignments?scope.project.id=00a5583c7b7443e98e7a1d31a0b638dc => generated 879 bytes in 60 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 24 16:41:44.031054 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e7b20ab-7da1-4afd-bb40-9f62690c16f9 admin admin] Authenticating user token {{(pid=71938) process_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 24 16:41:44.043433 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e7b20ab-7da1-4afd-bb40-9f62690c16f9 admin admin] Validating token access rules against request {{(pid=71938) validate_allowed_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 24 16:41:44.047981 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93a86a1c-e32a-420a-9ec0-e1de219a3d00 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f2ba2e8375b4e8c8792ee1e22b60427', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '00a5583c7b7443e98e7a1d31a0b638dc', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=71938) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 24 16:41:44.048872 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93a86a1c-e32a-420a-9ec0-e1de219a3d00 admin admin] REQUEST_METHOD: `GET` {{(pid=71938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 24 16:41:44.049245 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93a86a1c-e32a-420a-9ec0-e1de219a3d00 admin admin] SCRIPT_NAME: `/identity` {{(pid=71938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 24 16:41:44.049577 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93a86a1c-e32a-420a-9ec0-e1de219a3d00 admin admin] PATH_INFO: `/v3/users/0f2ba2e8375b4e8c8792ee1e22b60427` {{(pid=71938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 24 16:41:44.050809 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93a86a1c-e32a-420a-9ec0-e1de219a3d00 admin admin] RBAC: Authorizing `identity:get_user(user_id=0f2ba2e8375b4e8c8792ee1e22b60427)` {{(pid=71938) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:442}} Nov 24 16:41:44.079519 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93a86a1c-e32a-420a-9ec0-e1de219a3d00 admin admin] RBAC: Authorization granted {{(pid=71938) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 24 16:41:44.081123 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: [pid: 71938|app: 0|req: 765/1529] 10.222.0.53 () {56 vars in 1189 bytes} [Wed Nov 24 16:41:44 2021] GET /identity/v3/users/0f2ba2e8375b4e8c8792ee1e22b60427 => generated 247 bytes in 51 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 24 16:41:46.085949 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90a6a2ec-6571-4033-950b-9ac287b56762 None None] REQUEST_METHOD: `GET` {{(pid=71939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 24 16:41:46.086555 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90a6a2ec-6571-4033-950b-9ac287b56762 None None] SCRIPT_NAME: `/identity` {{(pid=71939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 24 16:41:46.086650 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90a6a2ec-6571-4033-950b-9ac287b56762 None None] PATH_INFO: `/` {{(pid=71939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 24 16:41:46.088487 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: [pid: 71939|app: 0|req: 765/1530] 10.222.0.53 () {54 vars in 915 bytes} [Wed Nov 24 16:41:46 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 24 16:41:46.094107 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0164ff1-c4a9-4883-9028-b46aec8e712f None None] REQUEST_METHOD: `POST` {{(pid=71938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 24 16:41:46.094468 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0164ff1-c4a9-4883-9028-b46aec8e712f None None] SCRIPT_NAME: `/identity` {{(pid=71938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 24 16:41:46.094808 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0164ff1-c4a9-4883-9028-b46aec8e712f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=71938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 24 16:41:46.119896 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.auth.core [None req-d0164ff1-c4a9-4883-9028-b46aec8e712f None None] MFA Rules not processed for user `0f2ba2e8375b4e8c8792ee1e22b60427`. Rule list: `[]` (Enabled: `True`). {{(pid=71938) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:442}} Nov 24 16:41:46.121124 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.fernet_utils [None req-d0164ff1-c4a9-4883-9028-b46aec8e712f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=71938) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:289}} Nov 24 16:41:46.128624 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: [pid: 71938|app: 0|req: 766/1531] 10.222.0.53 () {58 vars in 1013 bytes} [Wed Nov 24 16:41:46 2021] POST /identity/v3/auth/tokens => generated 3669 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 24 16:41:46.150989 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cb08cc7-279a-4c3c-ae12-72c2d07d29e0 None None] REQUEST_METHOD: `POST` {{(pid=71939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 24 16:41:46.151331 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cb08cc7-279a-4c3c-ae12-72c2d07d29e0 None None] SCRIPT_NAME: `/identity` {{(pid=71939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 24 16:41:46.151661 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cb08cc7-279a-4c3c-ae12-72c2d07d29e0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=71939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 24 16:41:46.176014 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.auth.core [None req-3cb08cc7-279a-4c3c-ae12-72c2d07d29e0 None None] MFA Rules not processed for user `0f2ba2e8375b4e8c8792ee1e22b60427`. Rule list: `[]` (Enabled: `True`). {{(pid=71939) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:442}} Nov 24 16:41:46.177243 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.fernet_utils [None req-3cb08cc7-279a-4c3c-ae12-72c2d07d29e0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=71939) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:289}} Nov 24 16:41:46.184718 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: [pid: 71939|app: 0|req: 766/1532] 10.222.0.53 () {58 vars in 1013 bytes} [Wed Nov 24 16:41:46 2021] POST /identity/v3/auth/tokens => generated 3669 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 24 16:41:46.191021 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0164ff1-c4a9-4883-9028-b46aec8e712f None None] Authenticating user token {{(pid=71938) process_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 24 16:41:46.201424 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0164ff1-c4a9-4883-9028-b46aec8e712f None None] Validating token access rules against request {{(pid=71938) validate_allowed_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 24 16:41:46.205939 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46e1461e-f44f-4a27-bc35-24ca0d6fcfb5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f2ba2e8375b4e8c8792ee1e22b60427', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '00a5583c7b7443e98e7a1d31a0b638dc', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=71938) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 24 16:41:46.206848 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46e1461e-f44f-4a27-bc35-24ca0d6fcfb5 admin admin] REQUEST_METHOD: `GET` {{(pid=71938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 24 16:41:46.207191 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46e1461e-f44f-4a27-bc35-24ca0d6fcfb5 admin admin] SCRIPT_NAME: `/identity` {{(pid=71938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 24 16:41:46.207529 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46e1461e-f44f-4a27-bc35-24ca0d6fcfb5 admin admin] PATH_INFO: `/v3/projects/6a75e77ca1684c808c57b448b83e73d2` {{(pid=71938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 24 16:41:46.208867 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46e1461e-f44f-4a27-bc35-24ca0d6fcfb5 admin admin] RBAC: Authorizing `identity:get_project(project_id=6a75e77ca1684c808c57b448b83e73d2)` {{(pid=71938) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:442}} Nov 24 16:41:46.238920 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46e1461e-f44f-4a27-bc35-24ca0d6fcfb5 admin admin] RBAC: Authorization granted {{(pid=71938) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 24 16:41:46.240693 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: [pid: 71938|app: 0|req: 767/1533] 10.222.0.53 () {56 vars in 1198 bytes} [Wed Nov 24 16:41:46 2021] GET /identity/v3/projects/6a75e77ca1684c808c57b448b83e73d2 => generated 298 bytes in 50 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 24 16:41:46.248087 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cb08cc7-279a-4c3c-ae12-72c2d07d29e0 None None] Authenticating user token {{(pid=71939) process_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 24 16:41:46.257606 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cb08cc7-279a-4c3c-ae12-72c2d07d29e0 None None] Validating token access rules against request {{(pid=71939) validate_allowed_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 24 16:41:46.262334 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4093bc34-ba5a-4d25-84b0-4088acf30833 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f2ba2e8375b4e8c8792ee1e22b60427', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '00a5583c7b7443e98e7a1d31a0b638dc', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=71939) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 24 16:41:46.262983 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4093bc34-ba5a-4d25-84b0-4088acf30833 admin admin] REQUEST_METHOD: `GET` {{(pid=71939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 24 16:41:46.263327 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4093bc34-ba5a-4d25-84b0-4088acf30833 admin admin] SCRIPT_NAME: `/identity` {{(pid=71939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 24 16:41:46.263656 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4093bc34-ba5a-4d25-84b0-4088acf30833 admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=71939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 24 16:41:46.264477 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4093bc34-ba5a-4d25-84b0-4088acf30833 admin admin] RBAC: Adding query filter params (scope.project.id=6a75e77ca1684c808c57b448b83e73d2) {{(pid=71939) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:161}} Nov 24 16:41:46.264826 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4093bc34-ba5a-4d25-84b0-4088acf30833 admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=71939) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:442}} Nov 24 16:41:46.296279 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4093bc34-ba5a-4d25-84b0-4088acf30833 admin admin] RBAC: Authorization granted {{(pid=71939) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 24 16:41:46.303647 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: [pid: 71939|app: 0|req: 767/1534] 10.222.0.53 () {56 vars in 1222 bytes} [Wed Nov 24 16:41:46 2021] GET /identity/v3/role_assignments?scope.project.id=6a75e77ca1684c808c57b448b83e73d2 => generated 1934 bytes in 57 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 24 16:41:46.310267 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46e1461e-f44f-4a27-bc35-24ca0d6fcfb5 admin admin] Authenticating user token {{(pid=71938) process_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 24 16:41:46.320370 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46e1461e-f44f-4a27-bc35-24ca0d6fcfb5 admin admin] Validating token access rules against request {{(pid=71938) validate_allowed_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 24 16:41:46.325118 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-282820f8-cddf-4ca3-99af-be371405a63f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f2ba2e8375b4e8c8792ee1e22b60427', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '00a5583c7b7443e98e7a1d31a0b638dc', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=71938) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 24 16:41:46.326001 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-282820f8-cddf-4ca3-99af-be371405a63f admin admin] REQUEST_METHOD: `GET` {{(pid=71938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 24 16:41:46.326358 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-282820f8-cddf-4ca3-99af-be371405a63f admin admin] SCRIPT_NAME: `/identity` {{(pid=71938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 24 16:41:46.326688 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-282820f8-cddf-4ca3-99af-be371405a63f admin admin] PATH_INFO: `/v3/users/0f2ba2e8375b4e8c8792ee1e22b60427` {{(pid=71938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 24 16:41:46.328349 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-282820f8-cddf-4ca3-99af-be371405a63f admin admin] RBAC: Authorizing `identity:get_user(user_id=0f2ba2e8375b4e8c8792ee1e22b60427)` {{(pid=71938) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:442}} Nov 24 16:41:46.357658 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-282820f8-cddf-4ca3-99af-be371405a63f admin admin] RBAC: Authorization granted {{(pid=71938) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 24 16:41:46.359261 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: [pid: 71938|app: 0|req: 768/1535] 10.222.0.53 () {56 vars in 1189 bytes} [Wed Nov 24 16:41:46 2021] GET /identity/v3/users/0f2ba2e8375b4e8c8792ee1e22b60427 => generated 247 bytes in 50 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 24 16:41:46.365433 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4093bc34-ba5a-4d25-84b0-4088acf30833 admin admin] Authenticating user token {{(pid=71939) process_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 24 16:41:46.375901 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4093bc34-ba5a-4d25-84b0-4088acf30833 admin admin] Validating token access rules against request {{(pid=71939) validate_allowed_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 24 16:41:46.380365 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7fae447-7b04-494c-9bb0-99c3be4a98ae admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f2ba2e8375b4e8c8792ee1e22b60427', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '00a5583c7b7443e98e7a1d31a0b638dc', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=71939) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 24 16:41:46.381241 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7fae447-7b04-494c-9bb0-99c3be4a98ae admin admin] REQUEST_METHOD: `GET` {{(pid=71939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 24 16:41:46.381584 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7fae447-7b04-494c-9bb0-99c3be4a98ae admin admin] SCRIPT_NAME: `/identity` {{(pid=71939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 24 16:41:46.381918 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7fae447-7b04-494c-9bb0-99c3be4a98ae admin admin] PATH_INFO: `/v3/users/a38b605a5d8b4fd286a841b891d7b4c4` {{(pid=71939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 24 16:41:46.402224 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7fae447-7b04-494c-9bb0-99c3be4a98ae admin admin] RBAC: Authorizing `identity:get_user(user_id=a38b605a5d8b4fd286a841b891d7b4c4)` {{(pid=71939) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:442}} Nov 24 16:41:46.430465 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7fae447-7b04-494c-9bb0-99c3be4a98ae admin admin] RBAC: Authorization granted {{(pid=71939) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 24 16:41:46.432601 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: [pid: 71939|app: 0|req: 768/1536] 10.222.0.53 () {56 vars in 1189 bytes} [Wed Nov 24 16:41:46 2021] GET /identity/v3/users/a38b605a5d8b4fd286a841b891d7b4c4 => generated 275 bytes in 68 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 24 16:41:48.487452 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c522d2d0-c9ce-4d42-bfac-a6364644a7e5 None None] REQUEST_METHOD: `GET` {{(pid=71938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 24 16:41:48.487991 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c522d2d0-c9ce-4d42-bfac-a6364644a7e5 None None] SCRIPT_NAME: `/identity` {{(pid=71938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 24 16:41:48.487991 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c522d2d0-c9ce-4d42-bfac-a6364644a7e5 None None] PATH_INFO: `/` {{(pid=71938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 24 16:41:48.489847 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: [pid: 71938|app: 0|req: 769/1537] 10.222.0.53 () {54 vars in 915 bytes} [Wed Nov 24 16:41:48 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Nov 24 16:41:48.496278 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ac2cca0-16b6-44f7-b53c-51ed994527c7 None None] REQUEST_METHOD: `POST` {{(pid=71939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 24 16:41:48.496659 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ac2cca0-16b6-44f7-b53c-51ed994527c7 None None] SCRIPT_NAME: `/identity` {{(pid=71939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 24 16:41:48.496991 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ac2cca0-16b6-44f7-b53c-51ed994527c7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=71939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 24 16:41:48.521199 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.auth.core [None req-3ac2cca0-16b6-44f7-b53c-51ed994527c7 None None] MFA Rules not processed for user `0f2ba2e8375b4e8c8792ee1e22b60427`. Rule list: `[]` (Enabled: `True`). {{(pid=71939) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:442}} Nov 24 16:41:48.522453 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.fernet_utils [None req-3ac2cca0-16b6-44f7-b53c-51ed994527c7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=71939) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:289}} Nov 24 16:41:48.530265 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: [pid: 71939|app: 0|req: 769/1538] 10.222.0.53 () {58 vars in 1013 bytes} [Wed Nov 24 16:41:48 2021] POST /identity/v3/auth/tokens => generated 3669 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 24 16:41:48.552321 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a4db5c7-1bc5-495f-95d9-82456a0e4f64 None None] REQUEST_METHOD: `POST` {{(pid=71938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 24 16:41:48.552674 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a4db5c7-1bc5-495f-95d9-82456a0e4f64 None None] SCRIPT_NAME: `/identity` {{(pid=71938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 24 16:41:48.553023 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a4db5c7-1bc5-495f-95d9-82456a0e4f64 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=71938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 24 16:41:48.578423 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.auth.core [None req-0a4db5c7-1bc5-495f-95d9-82456a0e4f64 None None] MFA Rules not processed for user `0f2ba2e8375b4e8c8792ee1e22b60427`. Rule list: `[]` (Enabled: `True`). {{(pid=71938) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:442}} Nov 24 16:41:48.579650 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.fernet_utils [None req-0a4db5c7-1bc5-495f-95d9-82456a0e4f64 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=71938) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:289}} Nov 24 16:41:48.587127 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: [pid: 71938|app: 0|req: 770/1539] 10.222.0.53 () {58 vars in 1013 bytes} [Wed Nov 24 16:41:48 2021] POST /identity/v3/auth/tokens => generated 3669 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 24 16:41:48.593633 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ac2cca0-16b6-44f7-b53c-51ed994527c7 None None] Authenticating user token {{(pid=71939) process_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 24 16:41:48.603719 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ac2cca0-16b6-44f7-b53c-51ed994527c7 None None] Validating token access rules against request {{(pid=71939) validate_allowed_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 24 16:41:48.608261 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa582bcf-53fd-4a07-b053-f0bafe01993f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f2ba2e8375b4e8c8792ee1e22b60427', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '00a5583c7b7443e98e7a1d31a0b638dc', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=71939) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 24 16:41:48.609132 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa582bcf-53fd-4a07-b053-f0bafe01993f admin admin] REQUEST_METHOD: `GET` {{(pid=71939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 24 16:41:48.609477 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa582bcf-53fd-4a07-b053-f0bafe01993f admin admin] SCRIPT_NAME: `/identity` {{(pid=71939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 24 16:41:48.609813 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa582bcf-53fd-4a07-b053-f0bafe01993f admin admin] PATH_INFO: `/v3/projects/7cdfba1dd86043ea9b1cf6498535c213` {{(pid=71939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 24 16:41:48.623244 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa582bcf-53fd-4a07-b053-f0bafe01993f admin admin] RBAC: Authorizing `identity:get_project(project_id=7cdfba1dd86043ea9b1cf6498535c213)` {{(pid=71939) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:442}} Nov 24 16:41:48.653427 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa582bcf-53fd-4a07-b053-f0bafe01993f admin admin] RBAC: Authorization granted {{(pid=71939) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 24 16:41:48.655247 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: [pid: 71939|app: 0|req: 770/1540] 10.222.0.53 () {56 vars in 1198 bytes} [Wed Nov 24 16:41:48 2021] GET /identity/v3/projects/7cdfba1dd86043ea9b1cf6498535c213 => generated 302 bytes in 62 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 24 16:41:48.661997 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a4db5c7-1bc5-495f-95d9-82456a0e4f64 None None] Authenticating user token {{(pid=71938) process_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 24 16:41:48.671396 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a4db5c7-1bc5-495f-95d9-82456a0e4f64 None None] Validating token access rules against request {{(pid=71938) validate_allowed_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 24 16:41:48.675877 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4b95e81-06d5-4258-b5c8-068cbfc5db86 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f2ba2e8375b4e8c8792ee1e22b60427', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '00a5583c7b7443e98e7a1d31a0b638dc', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=71938) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 24 16:41:48.676534 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4b95e81-06d5-4258-b5c8-068cbfc5db86 admin admin] REQUEST_METHOD: `GET` {{(pid=71938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 24 16:41:48.676866 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4b95e81-06d5-4258-b5c8-068cbfc5db86 admin admin] SCRIPT_NAME: `/identity` {{(pid=71938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 24 16:41:48.677196 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4b95e81-06d5-4258-b5c8-068cbfc5db86 admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=71938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 24 16:41:48.678017 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4b95e81-06d5-4258-b5c8-068cbfc5db86 admin admin] RBAC: Adding query filter params (scope.project.id=7cdfba1dd86043ea9b1cf6498535c213) {{(pid=71938) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:161}} Nov 24 16:41:48.678405 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4b95e81-06d5-4258-b5c8-068cbfc5db86 admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=71938) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:442}} Nov 24 16:41:48.708083 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4b95e81-06d5-4258-b5c8-068cbfc5db86 admin admin] RBAC: Authorization granted {{(pid=71938) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 24 16:41:48.715225 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: [pid: 71938|app: 0|req: 771/1541] 10.222.0.53 () {56 vars in 1222 bytes} [Wed Nov 24 16:41:48 2021] GET /identity/v3/role_assignments?scope.project.id=7cdfba1dd86043ea9b1cf6498535c213 => generated 1934 bytes in 54 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 24 16:41:48.721747 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa582bcf-53fd-4a07-b053-f0bafe01993f admin admin] Authenticating user token {{(pid=71939) process_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 24 16:41:48.731834 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa582bcf-53fd-4a07-b053-f0bafe01993f admin admin] Validating token access rules against request {{(pid=71939) validate_allowed_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 24 16:41:48.736310 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be3201a6-e281-4eb7-aff6-ffd3f748b3d0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f2ba2e8375b4e8c8792ee1e22b60427', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '00a5583c7b7443e98e7a1d31a0b638dc', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=71939) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 24 16:41:48.737195 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be3201a6-e281-4eb7-aff6-ffd3f748b3d0 admin admin] REQUEST_METHOD: `GET` {{(pid=71939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 24 16:41:48.737592 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be3201a6-e281-4eb7-aff6-ffd3f748b3d0 admin admin] SCRIPT_NAME: `/identity` {{(pid=71939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 24 16:41:48.737876 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be3201a6-e281-4eb7-aff6-ffd3f748b3d0 admin admin] PATH_INFO: `/v3/users/0f2ba2e8375b4e8c8792ee1e22b60427` {{(pid=71939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 24 16:41:48.739141 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be3201a6-e281-4eb7-aff6-ffd3f748b3d0 admin admin] RBAC: Authorizing `identity:get_user(user_id=0f2ba2e8375b4e8c8792ee1e22b60427)` {{(pid=71939) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:442}} Nov 24 16:41:48.768941 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be3201a6-e281-4eb7-aff6-ffd3f748b3d0 admin admin] RBAC: Authorization granted {{(pid=71939) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 24 16:41:48.770580 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: [pid: 71939|app: 0|req: 771/1542] 10.222.0.53 () {56 vars in 1189 bytes} [Wed Nov 24 16:41:48 2021] GET /identity/v3/users/0f2ba2e8375b4e8c8792ee1e22b60427 => generated 247 bytes in 49 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 24 16:41:48.776849 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4b95e81-06d5-4258-b5c8-068cbfc5db86 admin admin] Authenticating user token {{(pid=71938) process_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 24 16:41:48.787053 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4b95e81-06d5-4258-b5c8-068cbfc5db86 admin admin] Validating token access rules against request {{(pid=71938) validate_allowed_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 24 16:41:48.792115 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5adb9865-2fd5-41fe-90c6-4779f667a4b4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f2ba2e8375b4e8c8792ee1e22b60427', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '00a5583c7b7443e98e7a1d31a0b638dc', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=71938) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 24 16:41:48.793008 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5adb9865-2fd5-41fe-90c6-4779f667a4b4 admin admin] REQUEST_METHOD: `GET` {{(pid=71938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 24 16:41:48.793344 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5adb9865-2fd5-41fe-90c6-4779f667a4b4 admin admin] SCRIPT_NAME: `/identity` {{(pid=71938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 24 16:41:48.793674 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5adb9865-2fd5-41fe-90c6-4779f667a4b4 admin admin] PATH_INFO: `/v3/users/00c86a8d8abf438f80ab7423cb0e9a4c` {{(pid=71938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 24 16:41:48.814078 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5adb9865-2fd5-41fe-90c6-4779f667a4b4 admin admin] RBAC: Authorizing `identity:get_user(user_id=00c86a8d8abf438f80ab7423cb0e9a4c)` {{(pid=71938) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:442}} Nov 24 16:41:48.842918 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5adb9865-2fd5-41fe-90c6-4779f667a4b4 admin admin] RBAC: Authorization granted {{(pid=71938) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 24 16:41:48.844602 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: [pid: 71938|app: 0|req: 772/1543] 10.222.0.53 () {56 vars in 1189 bytes} [Wed Nov 24 16:41:48 2021] GET /identity/v3/users/00c86a8d8abf438f80ab7423cb0e9a4c => generated 283 bytes in 68 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 24 16:41:50.886789 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea315426-85b6-4ef7-84ea-71ad6bf0724d None None] REQUEST_METHOD: `GET` {{(pid=71939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 24 16:41:50.887307 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea315426-85b6-4ef7-84ea-71ad6bf0724d None None] SCRIPT_NAME: `/identity` {{(pid=71939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 24 16:41:50.887458 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea315426-85b6-4ef7-84ea-71ad6bf0724d None None] PATH_INFO: `/` {{(pid=71939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 24 16:41:50.889308 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: [pid: 71939|app: 0|req: 772/1544] 10.222.0.53 () {54 vars in 915 bytes} [Wed Nov 24 16:41:50 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 24 16:41:50.895273 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1068d55a-22f7-4088-825a-7fcd615240be None None] REQUEST_METHOD: `POST` {{(pid=71938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 24 16:41:50.895631 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1068d55a-22f7-4088-825a-7fcd615240be None None] SCRIPT_NAME: `/identity` {{(pid=71938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 24 16:41:50.895973 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1068d55a-22f7-4088-825a-7fcd615240be None None] PATH_INFO: `/v3/auth/tokens` {{(pid=71938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 24 16:41:50.920864 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.auth.core [None req-1068d55a-22f7-4088-825a-7fcd615240be None None] MFA Rules not processed for user `0f2ba2e8375b4e8c8792ee1e22b60427`. Rule list: `[]` (Enabled: `True`). {{(pid=71938) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:442}} Nov 24 16:41:50.922114 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.fernet_utils [None req-1068d55a-22f7-4088-825a-7fcd615240be None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=71938) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:289}} Nov 24 16:41:50.929523 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: [pid: 71938|app: 0|req: 773/1545] 10.222.0.53 () {58 vars in 1013 bytes} [Wed Nov 24 16:41:50 2021] POST /identity/v3/auth/tokens => generated 3669 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 24 16:41:50.951253 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bffc736-10cc-40fc-a55c-92b5dd1c65c4 None None] REQUEST_METHOD: `POST` {{(pid=71939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 24 16:41:50.951601 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bffc736-10cc-40fc-a55c-92b5dd1c65c4 None None] SCRIPT_NAME: `/identity` {{(pid=71939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 24 16:41:50.951930 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bffc736-10cc-40fc-a55c-92b5dd1c65c4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=71939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 24 16:41:50.976674 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.auth.core [None req-9bffc736-10cc-40fc-a55c-92b5dd1c65c4 None None] MFA Rules not processed for user `0f2ba2e8375b4e8c8792ee1e22b60427`. Rule list: `[]` (Enabled: `True`). {{(pid=71939) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:442}} Nov 24 16:41:50.978600 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.fernet_utils [None req-9bffc736-10cc-40fc-a55c-92b5dd1c65c4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=71939) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:289}} Nov 24 16:41:50.985939 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: [pid: 71939|app: 0|req: 773/1546] 10.222.0.53 () {58 vars in 1013 bytes} [Wed Nov 24 16:41:50 2021] POST /identity/v3/auth/tokens => generated 3669 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 24 16:41:50.992014 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1068d55a-22f7-4088-825a-7fcd615240be None None] Authenticating user token {{(pid=71938) process_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 24 16:41:51.002319 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1068d55a-22f7-4088-825a-7fcd615240be None None] Validating token access rules against request {{(pid=71938) validate_allowed_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 24 16:41:51.007077 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc51d8f1-9d66-4337-a998-77567c335081 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f2ba2e8375b4e8c8792ee1e22b60427', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '00a5583c7b7443e98e7a1d31a0b638dc', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=71938) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 24 16:41:51.008009 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc51d8f1-9d66-4337-a998-77567c335081 admin admin] REQUEST_METHOD: `GET` {{(pid=71938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 24 16:41:51.008351 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc51d8f1-9d66-4337-a998-77567c335081 admin admin] SCRIPT_NAME: `/identity` {{(pid=71938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 24 16:41:51.008685 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc51d8f1-9d66-4337-a998-77567c335081 admin admin] PATH_INFO: `/v3/projects/84a0b6d6793940989784e4617b95caf6` {{(pid=71938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 24 16:41:51.023447 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc51d8f1-9d66-4337-a998-77567c335081 admin admin] RBAC: Authorizing `identity:get_project(project_id=84a0b6d6793940989784e4617b95caf6)` {{(pid=71938) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:442}} Nov 24 16:41:51.053097 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc51d8f1-9d66-4337-a998-77567c335081 admin admin] RBAC: Authorization granted {{(pid=71938) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 24 16:41:51.054868 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: [pid: 71938|app: 0|req: 774/1547] 10.222.0.53 () {56 vars in 1198 bytes} [Wed Nov 24 16:41:50 2021] GET /identity/v3/projects/84a0b6d6793940989784e4617b95caf6 => generated 361 bytes in 63 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 24 16:41:51.061560 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bffc736-10cc-40fc-a55c-92b5dd1c65c4 None None] Authenticating user token {{(pid=71939) process_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 24 16:41:51.070782 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bffc736-10cc-40fc-a55c-92b5dd1c65c4 None None] Validating token access rules against request {{(pid=71939) validate_allowed_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 24 16:41:51.076095 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2f849aa-e28c-4709-b51d-6a522d4a07a1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f2ba2e8375b4e8c8792ee1e22b60427', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '00a5583c7b7443e98e7a1d31a0b638dc', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=71939) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 24 16:41:51.076750 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2f849aa-e28c-4709-b51d-6a522d4a07a1 admin admin] REQUEST_METHOD: `GET` {{(pid=71939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 24 16:41:51.077092 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2f849aa-e28c-4709-b51d-6a522d4a07a1 admin admin] SCRIPT_NAME: `/identity` {{(pid=71939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 24 16:41:51.077432 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2f849aa-e28c-4709-b51d-6a522d4a07a1 admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=71939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 24 16:41:51.078318 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2f849aa-e28c-4709-b51d-6a522d4a07a1 admin admin] RBAC: Adding query filter params (scope.project.id=84a0b6d6793940989784e4617b95caf6) {{(pid=71939) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:161}} Nov 24 16:41:51.078670 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2f849aa-e28c-4709-b51d-6a522d4a07a1 admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=71939) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:442}} Nov 24 16:41:51.107622 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2f849aa-e28c-4709-b51d-6a522d4a07a1 admin admin] RBAC: Authorization granted {{(pid=71939) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 24 16:41:51.113296 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: [pid: 71939|app: 0|req: 774/1548] 10.222.0.53 () {56 vars in 1222 bytes} [Wed Nov 24 16:41:51 2021] GET /identity/v3/role_assignments?scope.project.id=84a0b6d6793940989784e4617b95caf6 => generated 526 bytes in 52 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 24 16:41:51.119322 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc51d8f1-9d66-4337-a998-77567c335081 admin admin] Authenticating user token {{(pid=71938) process_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 24 16:41:51.129180 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc51d8f1-9d66-4337-a998-77567c335081 admin admin] Validating token access rules against request {{(pid=71938) validate_allowed_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 24 16:41:51.134049 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f6ce528-f45e-4b91-8c91-a9609f5c8284 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f2ba2e8375b4e8c8792ee1e22b60427', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '00a5583c7b7443e98e7a1d31a0b638dc', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=71938) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 24 16:41:51.135284 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f6ce528-f45e-4b91-8c91-a9609f5c8284 admin admin] REQUEST_METHOD: `GET` {{(pid=71938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 24 16:41:51.135284 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f6ce528-f45e-4b91-8c91-a9609f5c8284 admin admin] SCRIPT_NAME: `/identity` {{(pid=71938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 24 16:41:51.135634 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f6ce528-f45e-4b91-8c91-a9609f5c8284 admin admin] PATH_INFO: `/v3/users/b6aa8933b599426b8bfdbc95d7f91113` {{(pid=71938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 24 16:41:51.159152 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f6ce528-f45e-4b91-8c91-a9609f5c8284 admin admin] RBAC: Authorizing `identity:get_user(user_id=b6aa8933b599426b8bfdbc95d7f91113)` {{(pid=71938) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:442}} Nov 24 16:41:51.188246 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f6ce528-f45e-4b91-8c91-a9609f5c8284 admin admin] RBAC: Authorization granted {{(pid=71938) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 24 16:41:51.189991 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: [pid: 71938|app: 0|req: 775/1549] 10.222.0.53 () {56 vars in 1189 bytes} [Wed Nov 24 16:41:51 2021] GET /identity/v3/users/b6aa8933b599426b8bfdbc95d7f91113 => generated 311 bytes in 71 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 24 16:41:53.226200 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1afd167-a0c3-4542-a41a-8909dcaeff75 None None] REQUEST_METHOD: `GET` {{(pid=71939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 24 16:41:53.226725 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1afd167-a0c3-4542-a41a-8909dcaeff75 None None] SCRIPT_NAME: `/identity` {{(pid=71939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 24 16:41:53.226833 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1afd167-a0c3-4542-a41a-8909dcaeff75 None None] PATH_INFO: `/` {{(pid=71939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 24 16:41:53.229389 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: [pid: 71939|app: 0|req: 775/1550] 10.222.0.53 () {54 vars in 915 bytes} [Wed Nov 24 16:41:53 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 24 16:41:53.235456 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-826eac26-5c71-47f5-a464-d437962b12bc None None] REQUEST_METHOD: `POST` {{(pid=71938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 24 16:41:53.235801 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-826eac26-5c71-47f5-a464-d437962b12bc None None] SCRIPT_NAME: `/identity` {{(pid=71938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 24 16:41:53.236137 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-826eac26-5c71-47f5-a464-d437962b12bc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=71938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 24 16:41:53.259579 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.auth.core [None req-826eac26-5c71-47f5-a464-d437962b12bc None None] MFA Rules not processed for user `0f2ba2e8375b4e8c8792ee1e22b60427`. Rule list: `[]` (Enabled: `True`). {{(pid=71938) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:442}} Nov 24 16:41:53.260793 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.fernet_utils [None req-826eac26-5c71-47f5-a464-d437962b12bc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=71938) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:289}} Nov 24 16:41:53.268140 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: [pid: 71938|app: 0|req: 776/1551] 10.222.0.53 () {58 vars in 1013 bytes} [Wed Nov 24 16:41:53 2021] POST /identity/v3/auth/tokens => generated 3669 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 24 16:41:53.291553 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e5015d1-106a-4fa1-ba5a-4c8412baee0f None None] REQUEST_METHOD: `POST` {{(pid=71939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 24 16:41:53.291905 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e5015d1-106a-4fa1-ba5a-4c8412baee0f None None] SCRIPT_NAME: `/identity` {{(pid=71939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 24 16:41:53.292242 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e5015d1-106a-4fa1-ba5a-4c8412baee0f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=71939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 24 16:41:53.315695 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.auth.core [None req-6e5015d1-106a-4fa1-ba5a-4c8412baee0f None None] MFA Rules not processed for user `0f2ba2e8375b4e8c8792ee1e22b60427`. Rule list: `[]` (Enabled: `True`). {{(pid=71939) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:442}} Nov 24 16:41:53.316916 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.fernet_utils [None req-6e5015d1-106a-4fa1-ba5a-4c8412baee0f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=71939) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:289}} Nov 24 16:41:53.326056 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: [pid: 71939|app: 0|req: 776/1552] 10.222.0.53 () {58 vars in 1013 bytes} [Wed Nov 24 16:41:53 2021] POST /identity/v3/auth/tokens => generated 3669 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 24 16:41:53.332365 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-826eac26-5c71-47f5-a464-d437962b12bc None None] Authenticating user token {{(pid=71938) process_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 24 16:41:53.342666 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-826eac26-5c71-47f5-a464-d437962b12bc None None] Validating token access rules against request {{(pid=71938) validate_allowed_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 24 16:41:53.347054 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb269104-bb2c-4c1e-abbb-ef8cd15d38ff admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f2ba2e8375b4e8c8792ee1e22b60427', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '00a5583c7b7443e98e7a1d31a0b638dc', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=71938) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 24 16:41:53.347916 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb269104-bb2c-4c1e-abbb-ef8cd15d38ff admin admin] REQUEST_METHOD: `GET` {{(pid=71938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 24 16:41:53.348248 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb269104-bb2c-4c1e-abbb-ef8cd15d38ff admin admin] SCRIPT_NAME: `/identity` {{(pid=71938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 24 16:41:53.348573 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb269104-bb2c-4c1e-abbb-ef8cd15d38ff admin admin] PATH_INFO: `/v3/projects/9a201f3aac424f189726a7325dabb612` {{(pid=71938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 24 16:41:53.361175 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb269104-bb2c-4c1e-abbb-ef8cd15d38ff admin admin] RBAC: Authorizing `identity:get_project(project_id=9a201f3aac424f189726a7325dabb612)` {{(pid=71938) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:442}} Nov 24 16:41:53.390162 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb269104-bb2c-4c1e-abbb-ef8cd15d38ff admin admin] RBAC: Authorization granted {{(pid=71938) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 24 16:41:53.391902 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: [pid: 71938|app: 0|req: 777/1553] 10.222.0.53 () {56 vars in 1198 bytes} [Wed Nov 24 16:41:53 2021] GET /identity/v3/projects/9a201f3aac424f189726a7325dabb612 => generated 311 bytes in 60 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 24 16:41:53.398475 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e5015d1-106a-4fa1-ba5a-4c8412baee0f None None] Authenticating user token {{(pid=71939) process_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 24 16:41:53.408467 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e5015d1-106a-4fa1-ba5a-4c8412baee0f None None] Validating token access rules against request {{(pid=71939) validate_allowed_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 24 16:41:53.413141 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5887695c-bba0-475b-9c08-b1c464f16fc5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f2ba2e8375b4e8c8792ee1e22b60427', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '00a5583c7b7443e98e7a1d31a0b638dc', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=71939) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 24 16:41:53.413794 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5887695c-bba0-475b-9c08-b1c464f16fc5 admin admin] REQUEST_METHOD: `GET` {{(pid=71939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 24 16:41:53.414164 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5887695c-bba0-475b-9c08-b1c464f16fc5 admin admin] SCRIPT_NAME: `/identity` {{(pid=71939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 24 16:41:53.414500 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5887695c-bba0-475b-9c08-b1c464f16fc5 admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=71939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 24 16:41:53.415328 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5887695c-bba0-475b-9c08-b1c464f16fc5 admin admin] RBAC: Adding query filter params (scope.project.id=9a201f3aac424f189726a7325dabb612) {{(pid=71939) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:161}} Nov 24 16:41:53.415680 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5887695c-bba0-475b-9c08-b1c464f16fc5 admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=71939) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:442}} Nov 24 16:41:53.443916 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5887695c-bba0-475b-9c08-b1c464f16fc5 admin admin] RBAC: Authorization granted {{(pid=71939) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 24 16:41:53.450724 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: [pid: 71939|app: 0|req: 777/1554] 10.222.0.53 () {56 vars in 1222 bytes} [Wed Nov 24 16:41:53 2021] GET /identity/v3/role_assignments?scope.project.id=9a201f3aac424f189726a7325dabb612 => generated 877 bytes in 53 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 24 16:41:53.456889 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb269104-bb2c-4c1e-abbb-ef8cd15d38ff admin admin] Authenticating user token {{(pid=71938) process_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 24 16:41:53.467007 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb269104-bb2c-4c1e-abbb-ef8cd15d38ff admin admin] Validating token access rules against request {{(pid=71938) validate_allowed_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 24 16:41:53.471457 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c67aebbf-ca4a-4650-a7d8-42d41455451f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f2ba2e8375b4e8c8792ee1e22b60427', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '00a5583c7b7443e98e7a1d31a0b638dc', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=71938) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 24 16:41:53.472362 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c67aebbf-ca4a-4650-a7d8-42d41455451f admin admin] REQUEST_METHOD: `GET` {{(pid=71938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 24 16:41:53.472678 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c67aebbf-ca4a-4650-a7d8-42d41455451f admin admin] SCRIPT_NAME: `/identity` {{(pid=71938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 24 16:41:53.473013 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c67aebbf-ca4a-4650-a7d8-42d41455451f admin admin] PATH_INFO: `/v3/users/fa7ab8b6ab92447ba4bd0cbe4f158f5e` {{(pid=71938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 24 16:41:53.492943 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c67aebbf-ca4a-4650-a7d8-42d41455451f admin admin] RBAC: Authorizing `identity:get_user(user_id=fa7ab8b6ab92447ba4bd0cbe4f158f5e)` {{(pid=71938) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:442}} Nov 24 16:41:53.522667 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c67aebbf-ca4a-4650-a7d8-42d41455451f admin admin] RBAC: Authorization granted {{(pid=71938) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 24 16:41:53.524333 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: [pid: 71938|app: 0|req: 778/1555] 10.222.0.53 () {56 vars in 1189 bytes} [Wed Nov 24 16:41:53 2021] GET /identity/v3/users/fa7ab8b6ab92447ba4bd0cbe4f158f5e => generated 285 bytes in 68 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 24 16:41:53.530539 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5887695c-bba0-475b-9c08-b1c464f16fc5 admin admin] Authenticating user token {{(pid=71939) process_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 24 16:41:53.541004 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5887695c-bba0-475b-9c08-b1c464f16fc5 admin admin] Validating token access rules against request {{(pid=71939) validate_allowed_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 24 16:41:53.545433 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98bfc5ca-e5dd-4864-8387-0fc9fa2dac11 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f2ba2e8375b4e8c8792ee1e22b60427', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '00a5583c7b7443e98e7a1d31a0b638dc', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=71939) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 24 16:41:53.546364 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98bfc5ca-e5dd-4864-8387-0fc9fa2dac11 admin admin] REQUEST_METHOD: `GET` {{(pid=71939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 24 16:41:53.546706 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98bfc5ca-e5dd-4864-8387-0fc9fa2dac11 admin admin] SCRIPT_NAME: `/identity` {{(pid=71939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 24 16:41:53.547039 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98bfc5ca-e5dd-4864-8387-0fc9fa2dac11 admin admin] PATH_INFO: `/v3/users/1b2e63172b3a40dcb77f3cff51152aec` {{(pid=71939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 24 16:41:53.567604 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98bfc5ca-e5dd-4864-8387-0fc9fa2dac11 admin admin] RBAC: Authorizing `identity:get_user(user_id=1b2e63172b3a40dcb77f3cff51152aec)` {{(pid=71939) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:442}} Nov 24 16:41:53.596181 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98bfc5ca-e5dd-4864-8387-0fc9fa2dac11 admin admin] RBAC: Authorization granted {{(pid=71939) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 24 16:41:53.597864 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: [pid: 71939|app: 0|req: 778/1556] 10.222.0.53 () {56 vars in 1189 bytes} [Wed Nov 24 16:41:53 2021] GET /identity/v3/users/1b2e63172b3a40dcb77f3cff51152aec => generated 286 bytes in 68 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 24 16:41:55.672268 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c331554-b205-4231-82d7-1a1df3dc9d51 None None] REQUEST_METHOD: `GET` {{(pid=71938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 24 16:41:55.672883 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c331554-b205-4231-82d7-1a1df3dc9d51 None None] SCRIPT_NAME: `/identity` {{(pid=71938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 24 16:41:55.673500 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c331554-b205-4231-82d7-1a1df3dc9d51 None None] PATH_INFO: `/` {{(pid=71938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 24 16:41:55.676010 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: [pid: 71938|app: 0|req: 779/1557] 10.222.0.53 () {54 vars in 915 bytes} [Wed Nov 24 16:41:55 2021] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 24 16:41:55.683572 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29119c71-3320-4a38-b4db-a3d5ee377a8a None None] REQUEST_METHOD: `POST` {{(pid=71939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 24 16:41:55.683986 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29119c71-3320-4a38-b4db-a3d5ee377a8a None None] SCRIPT_NAME: `/identity` {{(pid=71939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 24 16:41:55.684303 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29119c71-3320-4a38-b4db-a3d5ee377a8a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=71939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 24 16:41:55.723540 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.auth.core [None req-29119c71-3320-4a38-b4db-a3d5ee377a8a None None] MFA Rules not processed for user `0f2ba2e8375b4e8c8792ee1e22b60427`. Rule list: `[]` (Enabled: `True`). {{(pid=71939) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:442}} Nov 24 16:41:55.725447 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.fernet_utils [None req-29119c71-3320-4a38-b4db-a3d5ee377a8a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=71939) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:289}} Nov 24 16:41:55.735594 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: [pid: 71939|app: 0|req: 779/1558] 10.222.0.53 () {58 vars in 1013 bytes} [Wed Nov 24 16:41:55 2021] POST /identity/v3/auth/tokens => generated 3669 bytes in 53 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 24 16:41:55.758115 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a651c47-43cf-4947-9159-38027740bc07 None None] REQUEST_METHOD: `POST` {{(pid=71938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 24 16:41:55.758487 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a651c47-43cf-4947-9159-38027740bc07 None None] SCRIPT_NAME: `/identity` {{(pid=71938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 24 16:41:55.758822 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a651c47-43cf-4947-9159-38027740bc07 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=71938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 24 16:41:55.782608 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.auth.core [None req-3a651c47-43cf-4947-9159-38027740bc07 None None] MFA Rules not processed for user `0f2ba2e8375b4e8c8792ee1e22b60427`. Rule list: `[]` (Enabled: `True`). {{(pid=71938) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:442}} Nov 24 16:41:55.783803 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.fernet_utils [None req-3a651c47-43cf-4947-9159-38027740bc07 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=71938) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:289}} Nov 24 16:41:55.791743 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: [pid: 71938|app: 0|req: 780/1559] 10.222.0.53 () {58 vars in 1013 bytes} [Wed Nov 24 16:41:55 2021] POST /identity/v3/auth/tokens => generated 3669 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 24 16:41:55.798061 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29119c71-3320-4a38-b4db-a3d5ee377a8a None None] Authenticating user token {{(pid=71939) process_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 24 16:41:55.808338 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29119c71-3320-4a38-b4db-a3d5ee377a8a None None] Validating token access rules against request {{(pid=71939) validate_allowed_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 24 16:41:55.812753 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c8be081-0b57-4d7e-8783-e10f4d65dadb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f2ba2e8375b4e8c8792ee1e22b60427', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '00a5583c7b7443e98e7a1d31a0b638dc', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=71939) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 24 16:41:55.813616 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c8be081-0b57-4d7e-8783-e10f4d65dadb admin admin] REQUEST_METHOD: `GET` {{(pid=71939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 24 16:41:55.813953 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c8be081-0b57-4d7e-8783-e10f4d65dadb admin admin] SCRIPT_NAME: `/identity` {{(pid=71939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 24 16:41:55.814315 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c8be081-0b57-4d7e-8783-e10f4d65dadb admin admin] PATH_INFO: `/v3/projects/bb8d9361b6cd4b5da0aa50649fd0a2ba` {{(pid=71939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 24 16:41:55.827022 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c8be081-0b57-4d7e-8783-e10f4d65dadb admin admin] RBAC: Authorizing `identity:get_project(project_id=bb8d9361b6cd4b5da0aa50649fd0a2ba)` {{(pid=71939) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:442}} Nov 24 16:41:55.855848 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c8be081-0b57-4d7e-8783-e10f4d65dadb admin admin] RBAC: Authorization granted {{(pid=71939) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 24 16:41:55.857541 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: [pid: 71939|app: 0|req: 780/1560] 10.222.0.53 () {56 vars in 1198 bytes} [Wed Nov 24 16:41:55 2021] GET /identity/v3/projects/bb8d9361b6cd4b5da0aa50649fd0a2ba => generated 311 bytes in 60 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 24 16:41:55.864121 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a651c47-43cf-4947-9159-38027740bc07 None None] Authenticating user token {{(pid=71938) process_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 24 16:41:55.874199 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a651c47-43cf-4947-9159-38027740bc07 None None] Validating token access rules against request {{(pid=71938) validate_allowed_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 24 16:41:55.878730 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-326a5548-b1d5-4b2e-a34d-f1a864eaf17e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f2ba2e8375b4e8c8792ee1e22b60427', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '00a5583c7b7443e98e7a1d31a0b638dc', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=71938) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 24 16:41:55.879386 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-326a5548-b1d5-4b2e-a34d-f1a864eaf17e admin admin] REQUEST_METHOD: `GET` {{(pid=71938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 24 16:41:55.879727 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-326a5548-b1d5-4b2e-a34d-f1a864eaf17e admin admin] SCRIPT_NAME: `/identity` {{(pid=71938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 24 16:41:55.880059 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-326a5548-b1d5-4b2e-a34d-f1a864eaf17e admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=71938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 24 16:41:55.880888 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-326a5548-b1d5-4b2e-a34d-f1a864eaf17e admin admin] RBAC: Adding query filter params (scope.project.id=bb8d9361b6cd4b5da0aa50649fd0a2ba) {{(pid=71938) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:161}} Nov 24 16:41:55.881246 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-326a5548-b1d5-4b2e-a34d-f1a864eaf17e admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=71938) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:442}} Nov 24 16:41:55.910152 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-326a5548-b1d5-4b2e-a34d-f1a864eaf17e admin admin] RBAC: Authorization granted {{(pid=71938) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 24 16:41:55.916502 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: [pid: 71938|app: 0|req: 781/1561] 10.222.0.53 () {56 vars in 1222 bytes} [Wed Nov 24 16:41:55 2021] GET /identity/v3/role_assignments?scope.project.id=bb8d9361b6cd4b5da0aa50649fd0a2ba => generated 526 bytes in 53 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 24 16:41:55.922645 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c8be081-0b57-4d7e-8783-e10f4d65dadb admin admin] Authenticating user token {{(pid=71939) process_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 24 16:41:55.932574 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c8be081-0b57-4d7e-8783-e10f4d65dadb admin admin] Validating token access rules against request {{(pid=71939) validate_allowed_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 24 16:41:55.937083 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f44df9d-0341-4a17-9f69-06defa632467 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f2ba2e8375b4e8c8792ee1e22b60427', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '00a5583c7b7443e98e7a1d31a0b638dc', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=71939) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 24 16:41:55.938127 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f44df9d-0341-4a17-9f69-06defa632467 admin admin] REQUEST_METHOD: `GET` {{(pid=71939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 24 16:41:55.938470 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f44df9d-0341-4a17-9f69-06defa632467 admin admin] SCRIPT_NAME: `/identity` {{(pid=71939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 24 16:41:55.938997 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f44df9d-0341-4a17-9f69-06defa632467 admin admin] PATH_INFO: `/v3/users/a75b9ce272c04194a264dcd20640b55b` {{(pid=71939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 24 16:41:55.958967 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f44df9d-0341-4a17-9f69-06defa632467 admin admin] RBAC: Authorizing `identity:get_user(user_id=a75b9ce272c04194a264dcd20640b55b)` {{(pid=71939) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:442}} Nov 24 16:41:55.988593 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f44df9d-0341-4a17-9f69-06defa632467 admin admin] RBAC: Authorization granted {{(pid=71939) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 24 16:41:55.990274 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: [pid: 71939|app: 0|req: 781/1562] 10.222.0.53 () {56 vars in 1189 bytes} [Wed Nov 24 16:41:55 2021] GET /identity/v3/users/a75b9ce272c04194a264dcd20640b55b => generated 286 bytes in 68 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 24 16:41:58.032039 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19d7ad32-953c-4229-af79-05b855ba082b None None] REQUEST_METHOD: `GET` {{(pid=71938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 24 16:41:58.032617 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19d7ad32-953c-4229-af79-05b855ba082b None None] SCRIPT_NAME: `/identity` {{(pid=71938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 24 16:41:58.032713 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19d7ad32-953c-4229-af79-05b855ba082b None None] PATH_INFO: `/` {{(pid=71938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 24 16:41:58.034530 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: [pid: 71938|app: 0|req: 782/1563] 10.222.0.53 () {54 vars in 915 bytes} [Wed Nov 24 16:41:58 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 24 16:41:58.040964 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9554a7cb-c413-41a2-b86f-9996fbfb1525 None None] REQUEST_METHOD: `POST` {{(pid=71939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 24 16:41:58.041319 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9554a7cb-c413-41a2-b86f-9996fbfb1525 None None] SCRIPT_NAME: `/identity` {{(pid=71939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 24 16:41:58.041657 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9554a7cb-c413-41a2-b86f-9996fbfb1525 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=71939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 24 16:41:58.067125 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.auth.core [None req-9554a7cb-c413-41a2-b86f-9996fbfb1525 None None] MFA Rules not processed for user `0f2ba2e8375b4e8c8792ee1e22b60427`. Rule list: `[]` (Enabled: `True`). {{(pid=71939) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:442}} Nov 24 16:41:58.068342 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.fernet_utils [None req-9554a7cb-c413-41a2-b86f-9996fbfb1525 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=71939) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:289}} Nov 24 16:41:58.076033 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: [pid: 71939|app: 0|req: 782/1564] 10.222.0.53 () {58 vars in 1013 bytes} [Wed Nov 24 16:41:58 2021] POST /identity/v3/auth/tokens => generated 3669 bytes in 37 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 24 16:41:58.097713 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ada9528c-bc62-4d82-a25c-62e71c7cb292 None None] REQUEST_METHOD: `POST` {{(pid=71938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 24 16:41:58.098094 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ada9528c-bc62-4d82-a25c-62e71c7cb292 None None] SCRIPT_NAME: `/identity` {{(pid=71938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 24 16:41:58.098437 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ada9528c-bc62-4d82-a25c-62e71c7cb292 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=71938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 24 16:41:58.123158 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.auth.core [None req-ada9528c-bc62-4d82-a25c-62e71c7cb292 None None] MFA Rules not processed for user `0f2ba2e8375b4e8c8792ee1e22b60427`. Rule list: `[]` (Enabled: `True`). {{(pid=71938) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:442}} Nov 24 16:41:58.124358 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.fernet_utils [None req-ada9528c-bc62-4d82-a25c-62e71c7cb292 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=71938) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:289}} Nov 24 16:41:58.131797 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: [pid: 71938|app: 0|req: 783/1565] 10.222.0.53 () {58 vars in 1013 bytes} [Wed Nov 24 16:41:58 2021] POST /identity/v3/auth/tokens => generated 3669 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 24 16:41:58.138101 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9554a7cb-c413-41a2-b86f-9996fbfb1525 None None] Authenticating user token {{(pid=71939) process_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 24 16:41:58.147644 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9554a7cb-c413-41a2-b86f-9996fbfb1525 None None] Validating token access rules against request {{(pid=71939) validate_allowed_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 24 16:41:58.152544 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa19a4a8-840f-4ad8-8a25-ac83d65c6c7f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f2ba2e8375b4e8c8792ee1e22b60427', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '00a5583c7b7443e98e7a1d31a0b638dc', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=71939) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 24 16:41:58.153393 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa19a4a8-840f-4ad8-8a25-ac83d65c6c7f admin admin] REQUEST_METHOD: `GET` {{(pid=71939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 24 16:41:58.153725 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa19a4a8-840f-4ad8-8a25-ac83d65c6c7f admin admin] SCRIPT_NAME: `/identity` {{(pid=71939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 24 16:41:58.154069 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa19a4a8-840f-4ad8-8a25-ac83d65c6c7f admin admin] PATH_INFO: `/v3/projects/d96b97f0d3f24f6d8a8cdbe939730585` {{(pid=71939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 24 16:41:58.167114 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa19a4a8-840f-4ad8-8a25-ac83d65c6c7f admin admin] RBAC: Authorizing `identity:get_project(project_id=d96b97f0d3f24f6d8a8cdbe939730585)` {{(pid=71939) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:442}} Nov 24 16:41:58.195464 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa19a4a8-840f-4ad8-8a25-ac83d65c6c7f admin admin] RBAC: Authorization granted {{(pid=71939) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 24 16:41:58.202084 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: [pid: 71939|app: 0|req: 783/1566] 10.222.0.53 () {56 vars in 1198 bytes} [Wed Nov 24 16:41:58 2021] GET /identity/v3/projects/d96b97f0d3f24f6d8a8cdbe939730585 => generated 312 bytes in 60 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 24 16:41:58.204287 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ada9528c-bc62-4d82-a25c-62e71c7cb292 None None] Authenticating user token {{(pid=71938) process_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 24 16:41:58.214731 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ada9528c-bc62-4d82-a25c-62e71c7cb292 None None] Validating token access rules against request {{(pid=71938) validate_allowed_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 24 16:41:58.219342 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98c1ac44-6431-46d6-a601-8ab215d9d03e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f2ba2e8375b4e8c8792ee1e22b60427', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '00a5583c7b7443e98e7a1d31a0b638dc', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=71938) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 24 16:41:58.220013 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98c1ac44-6431-46d6-a601-8ab215d9d03e admin admin] REQUEST_METHOD: `GET` {{(pid=71938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 24 16:41:58.220356 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98c1ac44-6431-46d6-a601-8ab215d9d03e admin admin] SCRIPT_NAME: `/identity` {{(pid=71938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 24 16:41:58.220705 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98c1ac44-6431-46d6-a601-8ab215d9d03e admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=71938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 24 16:41:58.221532 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98c1ac44-6431-46d6-a601-8ab215d9d03e admin admin] RBAC: Adding query filter params (scope.project.id=d96b97f0d3f24f6d8a8cdbe939730585) {{(pid=71938) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:161}} Nov 24 16:41:58.221887 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98c1ac44-6431-46d6-a601-8ab215d9d03e admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=71938) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:442}} Nov 24 16:41:58.251267 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98c1ac44-6431-46d6-a601-8ab215d9d03e admin admin] RBAC: Authorization granted {{(pid=71938) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 24 16:41:58.257597 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: [pid: 71938|app: 0|req: 784/1567] 10.222.0.53 () {56 vars in 1222 bytes} [Wed Nov 24 16:41:58 2021] GET /identity/v3/role_assignments?scope.project.id=d96b97f0d3f24f6d8a8cdbe939730585 => generated 526 bytes in 54 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 24 16:41:58.264187 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa19a4a8-840f-4ad8-8a25-ac83d65c6c7f admin admin] Authenticating user token {{(pid=71939) process_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 24 16:41:58.274564 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa19a4a8-840f-4ad8-8a25-ac83d65c6c7f admin admin] Validating token access rules against request {{(pid=71939) validate_allowed_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 24 16:41:58.279050 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8ed6f50-882b-4bbc-bccc-e02c921a67bc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f2ba2e8375b4e8c8792ee1e22b60427', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '00a5583c7b7443e98e7a1d31a0b638dc', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=71939) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 24 16:41:58.279922 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8ed6f50-882b-4bbc-bccc-e02c921a67bc admin admin] REQUEST_METHOD: `GET` {{(pid=71939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 24 16:41:58.280255 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8ed6f50-882b-4bbc-bccc-e02c921a67bc admin admin] SCRIPT_NAME: `/identity` {{(pid=71939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 24 16:41:58.280585 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8ed6f50-882b-4bbc-bccc-e02c921a67bc admin admin] PATH_INFO: `/v3/users/a38b605a5d8b4fd286a841b891d7b4c4` {{(pid=71939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 24 16:41:58.281787 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8ed6f50-882b-4bbc-bccc-e02c921a67bc admin admin] RBAC: Authorizing `identity:get_user(user_id=a38b605a5d8b4fd286a841b891d7b4c4)` {{(pid=71939) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:442}} Nov 24 16:41:58.310800 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8ed6f50-882b-4bbc-bccc-e02c921a67bc admin admin] RBAC: Authorization granted {{(pid=71939) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 24 16:41:58.312388 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: [pid: 71939|app: 0|req: 784/1568] 10.222.0.53 () {56 vars in 1189 bytes} [Wed Nov 24 16:41:58 2021] GET /identity/v3/users/a38b605a5d8b4fd286a841b891d7b4c4 => generated 275 bytes in 49 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 24 16:42:03.203789 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8b203ad-c878-4583-b720-9eabc49563a5 None None] REQUEST_METHOD: `GET` {{(pid=71938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 24 16:42:03.204315 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8b203ad-c878-4583-b720-9eabc49563a5 None None] SCRIPT_NAME: `/identity` {{(pid=71938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 24 16:42:03.204652 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8b203ad-c878-4583-b720-9eabc49563a5 None None] PATH_INFO: `/` {{(pid=71938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 24 16:42:03.206588 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: [pid: 71938|app: 0|req: 785/1569] 10.222.0.53 () {54 vars in 907 bytes} [Wed Nov 24 16:42:03 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 24 16:42:03.212926 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41da4984-eab0-4e99-b48e-0186d0826ab4 None None] REQUEST_METHOD: `POST` {{(pid=71939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 24 16:42:03.213353 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41da4984-eab0-4e99-b48e-0186d0826ab4 None None] SCRIPT_NAME: `/identity` {{(pid=71939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 24 16:42:03.214158 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41da4984-eab0-4e99-b48e-0186d0826ab4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=71939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 24 16:42:03.238518 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.auth.core [None req-41da4984-eab0-4e99-b48e-0186d0826ab4 None None] MFA Rules not processed for user `a919320c9e2a48d7ba33453b5929d7ee`. Rule list: `[]` (Enabled: `True`). {{(pid=71939) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:442}} Nov 24 16:42:03.239752 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.fernet_utils [None req-41da4984-eab0-4e99-b48e-0186d0826ab4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=71939) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:289}} Nov 24 16:42:03.247891 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: [pid: 71939|app: 0|req: 785/1570] 10.222.0.53 () {58 vars in 1005 bytes} [Wed Nov 24 16:42:03 2021] POST /identity/v3/auth/tokens => generated 3738 bytes in 37 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 24 16:42:03.308088 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4eccab6a-3471-4a28-b5d0-5f588cd8ff4b None None] REQUEST_METHOD: `GET` {{(pid=71938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 24 16:42:03.308431 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4eccab6a-3471-4a28-b5d0-5f588cd8ff4b None None] SCRIPT_NAME: `/identity` {{(pid=71938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 24 16:42:03.308773 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4eccab6a-3471-4a28-b5d0-5f588cd8ff4b None None] PATH_INFO: `/` {{(pid=71938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 24 16:42:03.310635 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: [pid: 71938|app: 0|req: 786/1571] 10.222.0.53 () {54 vars in 907 bytes} [Wed Nov 24 16:42:03 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 24 16:42:03.315802 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf7058d4-ad18-45c2-be23-f4d9758767b5 None None] REQUEST_METHOD: `POST` {{(pid=71939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 24 16:42:03.316156 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf7058d4-ad18-45c2-be23-f4d9758767b5 None None] SCRIPT_NAME: `/identity` {{(pid=71939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 24 16:42:03.316491 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf7058d4-ad18-45c2-be23-f4d9758767b5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=71939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 24 16:42:03.341375 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.auth.core [None req-cf7058d4-ad18-45c2-be23-f4d9758767b5 None None] MFA Rules not processed for user `3e196802d4d5432482b6d2eabc25f74e`. Rule list: `[]` (Enabled: `True`). {{(pid=71939) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:442}} Nov 24 16:42:03.342671 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.fernet_utils [None req-cf7058d4-ad18-45c2-be23-f4d9758767b5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=71939) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:289}} Nov 24 16:42:03.351166 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: [pid: 71939|app: 0|req: 786/1572] 10.222.0.53 () {58 vars in 1005 bytes} [Wed Nov 24 16:42:03 2021] POST /identity/v3/auth/tokens => generated 3802 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 24 16:42:05.748525 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f01c2a1-0d1c-40ea-a226-c85546ce85da None None] REQUEST_METHOD: `GET` {{(pid=71938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 24 16:42:05.749091 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f01c2a1-0d1c-40ea-a226-c85546ce85da None None] SCRIPT_NAME: `/identity` {{(pid=71938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 24 16:42:05.749203 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f01c2a1-0d1c-40ea-a226-c85546ce85da None None] PATH_INFO: `/` {{(pid=71938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 24 16:42:05.751124 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: [pid: 71938|app: 0|req: 787/1573] 10.222.0.53 () {54 vars in 915 bytes} [Wed Nov 24 16:42:05 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 24 16:42:05.756739 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ae6a1d5-0d01-4774-aa26-fd2dbca8f1f2 None None] REQUEST_METHOD: `POST` {{(pid=71939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 24 16:42:05.757087 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ae6a1d5-0d01-4774-aa26-fd2dbca8f1f2 None None] SCRIPT_NAME: `/identity` {{(pid=71939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 24 16:42:05.757422 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ae6a1d5-0d01-4774-aa26-fd2dbca8f1f2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=71939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 24 16:42:05.780802 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.auth.core [None req-9ae6a1d5-0d01-4774-aa26-fd2dbca8f1f2 None None] MFA Rules not processed for user `0f2ba2e8375b4e8c8792ee1e22b60427`. Rule list: `[]` (Enabled: `True`). {{(pid=71939) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:442}} Nov 24 16:42:05.782008 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.fernet_utils [None req-9ae6a1d5-0d01-4774-aa26-fd2dbca8f1f2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=71939) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:289}} Nov 24 16:42:05.789327 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: [pid: 71939|app: 0|req: 787/1574] 10.222.0.53 () {58 vars in 1013 bytes} [Wed Nov 24 16:42:05 2021] POST /identity/v3/auth/tokens => generated 3669 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 24 16:42:05.937061 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e001068b-8581-4b4c-8ebe-79ad9213d7bd None None] REQUEST_METHOD: `POST` {{(pid=71938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 24 16:42:05.937406 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e001068b-8581-4b4c-8ebe-79ad9213d7bd None None] SCRIPT_NAME: `/identity` {{(pid=71938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 24 16:42:05.937745 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e001068b-8581-4b4c-8ebe-79ad9213d7bd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=71938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 24 16:42:05.962190 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.auth.core [None req-e001068b-8581-4b4c-8ebe-79ad9213d7bd None None] MFA Rules not processed for user `0f2ba2e8375b4e8c8792ee1e22b60427`. Rule list: `[]` (Enabled: `True`). {{(pid=71938) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:442}} Nov 24 16:42:05.963417 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.fernet_utils [None req-e001068b-8581-4b4c-8ebe-79ad9213d7bd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=71938) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:289}} Nov 24 16:42:05.970847 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: [pid: 71938|app: 0|req: 788/1575] 10.222.0.53 () {58 vars in 1013 bytes} [Wed Nov 24 16:42:05 2021] POST /identity/v3/auth/tokens => generated 3669 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 24 16:42:05.982321 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ae6a1d5-0d01-4774-aa26-fd2dbca8f1f2 None None] Authenticating user token {{(pid=71939) process_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 24 16:42:05.995054 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ae6a1d5-0d01-4774-aa26-fd2dbca8f1f2 None None] Validating token access rules against request {{(pid=71939) validate_allowed_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 24 16:42:06.000490 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a47c0476-46a0-462f-ac1f-1040fd3e573c service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e196802d4d5432482b6d2eabc25f74e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3b3940d4ae1c4177ae29c02377bb4b0b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'service', 'ResellerAdmin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=71939) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 24 16:42:06.001095 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a47c0476-46a0-462f-ac1f-1040fd3e573c service nova] REQUEST_METHOD: `GET` {{(pid=71939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 24 16:42:06.001439 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a47c0476-46a0-462f-ac1f-1040fd3e573c service nova] SCRIPT_NAME: `/identity` {{(pid=71939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 24 16:42:06.001774 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a47c0476-46a0-462f-ac1f-1040fd3e573c service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=71939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 24 16:42:06.011035 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a47c0476-46a0-462f-ac1f-1040fd3e573c service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=71939) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:442}} Nov 24 16:42:06.039034 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a47c0476-46a0-462f-ac1f-1040fd3e573c service nova] RBAC: Authorization granted {{(pid=71939) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 24 16:42:06.049260 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: [pid: 71939|app: 0|req: 788/1576] 10.222.0.53 () {60 vars in 1356 bytes} [Wed Nov 24 16:42:05 2021] GET /identity/v3/auth/tokens => generated 3669 bytes in 67 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 24 16:42:07.645209 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37171522-edbb-4a4e-8a5e-d4220ae28cd5 None None] REQUEST_METHOD: `GET` {{(pid=71938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 24 16:42:07.645720 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37171522-edbb-4a4e-8a5e-d4220ae28cd5 None None] SCRIPT_NAME: `/identity` {{(pid=71938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 24 16:42:07.645882 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37171522-edbb-4a4e-8a5e-d4220ae28cd5 None None] PATH_INFO: `/` {{(pid=71938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 24 16:42:07.647845 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: [pid: 71938|app: 0|req: 789/1577] 10.222.0.53 () {54 vars in 900 bytes} [Wed Nov 24 16:42:07 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 24 16:42:07.653090 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c906889-692b-430b-b8b6-b0639e523bf1 None None] REQUEST_METHOD: `POST` {{(pid=71939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 24 16:42:07.653465 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c906889-692b-430b-b8b6-b0639e523bf1 None None] SCRIPT_NAME: `/identity` {{(pid=71939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 24 16:42:07.653802 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c906889-692b-430b-b8b6-b0639e523bf1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=71939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 24 16:42:07.678188 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.auth.core [None req-6c906889-692b-430b-b8b6-b0639e523bf1 None None] MFA Rules not processed for user `0f2ba2e8375b4e8c8792ee1e22b60427`. Rule list: `[]` (Enabled: `True`). {{(pid=71939) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:442}} Nov 24 16:42:07.679419 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.fernet_utils [None req-6c906889-692b-430b-b8b6-b0639e523bf1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=71939) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:289}} Nov 24 16:42:07.687527 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: [pid: 71939|app: 0|req: 789/1578] 10.222.0.53 () {58 vars in 998 bytes} [Wed Nov 24 16:42:07 2021] POST /identity/v3/auth/tokens => generated 3669 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 24 16:42:07.826951 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37171522-edbb-4a4e-8a5e-d4220ae28cd5 None None] Authenticating user token {{(pid=71938) process_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 24 16:42:07.841588 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37171522-edbb-4a4e-8a5e-d4220ae28cd5 None None] Validating token access rules against request {{(pid=71938) validate_allowed_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 24 16:42:07.846849 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6af79aa2-7102-4453-90bb-d406a9790a60 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e196802d4d5432482b6d2eabc25f74e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3b3940d4ae1c4177ae29c02377bb4b0b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'service', 'ResellerAdmin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=71938) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 24 16:42:07.847496 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6af79aa2-7102-4453-90bb-d406a9790a60 service nova] REQUEST_METHOD: `GET` {{(pid=71938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 24 16:42:07.847838 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6af79aa2-7102-4453-90bb-d406a9790a60 service nova] SCRIPT_NAME: `/identity` {{(pid=71938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 24 16:42:07.848171 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6af79aa2-7102-4453-90bb-d406a9790a60 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=71938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 24 16:42:07.857326 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6af79aa2-7102-4453-90bb-d406a9790a60 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=71938) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:442}} Nov 24 16:42:07.886400 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6af79aa2-7102-4453-90bb-d406a9790a60 service nova] RBAC: Authorization granted {{(pid=71938) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 24 16:42:07.895951 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: [pid: 71938|app: 0|req: 790/1579] 10.222.0.53 () {60 vars in 1356 bytes} [Wed Nov 24 16:42:07 2021] GET /identity/v3/auth/tokens => generated 3669 bytes in 70 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 24 16:42:09.575723 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8418e6d3-673e-44eb-aa6a-1107f3cb97bf None None] REQUEST_METHOD: `GET` {{(pid=71939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 24 16:42:09.576233 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8418e6d3-673e-44eb-aa6a-1107f3cb97bf None None] SCRIPT_NAME: `/identity` {{(pid=71939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 24 16:42:09.576347 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8418e6d3-673e-44eb-aa6a-1107f3cb97bf None None] PATH_INFO: `/` {{(pid=71939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 24 16:42:09.578241 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: [pid: 71939|app: 0|req: 790/1580] 10.222.0.53 () {54 vars in 900 bytes} [Wed Nov 24 16:42:09 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Nov 24 16:42:09.583554 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ac36f7b-e0d8-49cb-aa3a-213d89c07719 None None] REQUEST_METHOD: `POST` {{(pid=71938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 24 16:42:09.583906 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ac36f7b-e0d8-49cb-aa3a-213d89c07719 None None] SCRIPT_NAME: `/identity` {{(pid=71938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 24 16:42:09.584299 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ac36f7b-e0d8-49cb-aa3a-213d89c07719 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=71938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 24 16:42:09.608243 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.auth.core [None req-3ac36f7b-e0d8-49cb-aa3a-213d89c07719 None None] MFA Rules not processed for user `0f2ba2e8375b4e8c8792ee1e22b60427`. Rule list: `[]` (Enabled: `True`). {{(pid=71938) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:442}} Nov 24 16:42:09.609454 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.fernet_utils [None req-3ac36f7b-e0d8-49cb-aa3a-213d89c07719 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=71938) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:289}} Nov 24 16:42:09.616882 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: [pid: 71938|app: 0|req: 791/1581] 10.222.0.53 () {58 vars in 998 bytes} [Wed Nov 24 16:42:09 2021] POST /identity/v3/auth/tokens => generated 3669 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 24 16:42:09.753774 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8418e6d3-673e-44eb-aa6a-1107f3cb97bf None None] Authenticating user token {{(pid=71939) process_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 24 16:42:09.769250 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8418e6d3-673e-44eb-aa6a-1107f3cb97bf None None] Validating token access rules against request {{(pid=71939) validate_allowed_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 24 16:42:09.774632 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbc61bce-6695-4261-a963-8d103abf3a15 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e196802d4d5432482b6d2eabc25f74e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3b3940d4ae1c4177ae29c02377bb4b0b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'service', 'ResellerAdmin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=71939) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 24 16:42:09.775483 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbc61bce-6695-4261-a963-8d103abf3a15 service nova] REQUEST_METHOD: `GET` {{(pid=71939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 24 16:42:09.775812 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbc61bce-6695-4261-a963-8d103abf3a15 service nova] SCRIPT_NAME: `/identity` {{(pid=71939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 24 16:42:09.776142 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbc61bce-6695-4261-a963-8d103abf3a15 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=71939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 24 16:42:09.784785 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbc61bce-6695-4261-a963-8d103abf3a15 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=71939) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:442}} Nov 24 16:42:09.813819 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbc61bce-6695-4261-a963-8d103abf3a15 service nova] RBAC: Authorization granted {{(pid=71939) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 24 16:42:09.823786 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: [pid: 71939|app: 0|req: 791/1582] 10.222.0.53 () {60 vars in 1356 bytes} [Wed Nov 24 16:42:09 2021] GET /identity/v3/auth/tokens => generated 3669 bytes in 71 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 24 16:42:11.476196 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80fff996-bfa9-445d-a160-505c39d00561 None None] REQUEST_METHOD: `GET` {{(pid=71938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 24 16:42:11.477284 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80fff996-bfa9-445d-a160-505c39d00561 None None] SCRIPT_NAME: `/identity` {{(pid=71938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 24 16:42:11.477505 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80fff996-bfa9-445d-a160-505c39d00561 None None] PATH_INFO: `/` {{(pid=71938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 24 16:42:11.479488 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: [pid: 71938|app: 0|req: 792/1583] 10.222.0.53 () {54 vars in 900 bytes} [Wed Nov 24 16:42:11 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 24 16:42:11.484724 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2564c50-06b5-4c69-8b7d-2b98141100b6 None None] REQUEST_METHOD: `POST` {{(pid=71939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 24 16:42:11.485071 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2564c50-06b5-4c69-8b7d-2b98141100b6 None None] SCRIPT_NAME: `/identity` {{(pid=71939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 24 16:42:11.485404 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2564c50-06b5-4c69-8b7d-2b98141100b6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=71939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 24 16:42:11.509808 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.auth.core [None req-f2564c50-06b5-4c69-8b7d-2b98141100b6 None None] MFA Rules not processed for user `0f2ba2e8375b4e8c8792ee1e22b60427`. Rule list: `[]` (Enabled: `True`). {{(pid=71939) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:442}} Nov 24 16:42:11.511052 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.fernet_utils [None req-f2564c50-06b5-4c69-8b7d-2b98141100b6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=71939) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:289}} Nov 24 16:42:11.518417 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: [pid: 71939|app: 0|req: 792/1584] 10.222.0.53 () {58 vars in 998 bytes} [Wed Nov 24 16:42:11 2021] POST /identity/v3/auth/tokens => generated 3669 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Nov 24 16:42:11.656535 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80fff996-bfa9-445d-a160-505c39d00561 None None] Authenticating user token {{(pid=71938) process_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 24 16:42:11.671500 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80fff996-bfa9-445d-a160-505c39d00561 None None] Validating token access rules against request {{(pid=71938) validate_allowed_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 24 16:42:11.676970 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-184a4fd7-7fab-449f-b61b-2b428a02eed4 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e196802d4d5432482b6d2eabc25f74e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3b3940d4ae1c4177ae29c02377bb4b0b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'service', 'ResellerAdmin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=71938) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 24 16:42:11.677621 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-184a4fd7-7fab-449f-b61b-2b428a02eed4 service nova] REQUEST_METHOD: `GET` {{(pid=71938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 24 16:42:11.677959 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-184a4fd7-7fab-449f-b61b-2b428a02eed4 service nova] SCRIPT_NAME: `/identity` {{(pid=71938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 24 16:42:11.678320 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-184a4fd7-7fab-449f-b61b-2b428a02eed4 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=71938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 24 16:42:11.686786 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-184a4fd7-7fab-449f-b61b-2b428a02eed4 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=71938) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:442}} Nov 24 16:42:11.715696 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-184a4fd7-7fab-449f-b61b-2b428a02eed4 service nova] RBAC: Authorization granted {{(pid=71938) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 24 16:42:11.725191 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: [pid: 71938|app: 0|req: 793/1585] 10.222.0.53 () {60 vars in 1356 bytes} [Wed Nov 24 16:42:11 2021] GET /identity/v3/auth/tokens => generated 3669 bytes in 69 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 24 16:42:13.364341 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-991ead59-21d0-4e69-9b98-f7f7a6b211a1 None None] REQUEST_METHOD: `GET` {{(pid=71939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 24 16:42:13.364881 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-991ead59-21d0-4e69-9b98-f7f7a6b211a1 None None] SCRIPT_NAME: `/identity` {{(pid=71939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 24 16:42:13.365018 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-991ead59-21d0-4e69-9b98-f7f7a6b211a1 None None] PATH_INFO: `/` {{(pid=71939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 24 16:42:13.366840 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: [pid: 71939|app: 0|req: 793/1586] 10.222.0.53 () {54 vars in 900 bytes} [Wed Nov 24 16:42:13 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Nov 24 16:42:13.372805 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-298d6526-f337-4b43-9972-e64dd43ee523 None None] REQUEST_METHOD: `POST` {{(pid=71938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 24 16:42:13.373155 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-298d6526-f337-4b43-9972-e64dd43ee523 None None] SCRIPT_NAME: `/identity` {{(pid=71938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 24 16:42:13.373492 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-298d6526-f337-4b43-9972-e64dd43ee523 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=71938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 24 16:42:13.397634 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.auth.core [None req-298d6526-f337-4b43-9972-e64dd43ee523 None None] MFA Rules not processed for user `0f2ba2e8375b4e8c8792ee1e22b60427`. Rule list: `[]` (Enabled: `True`). {{(pid=71938) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:442}} Nov 24 16:42:13.398884 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.fernet_utils [None req-298d6526-f337-4b43-9972-e64dd43ee523 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=71938) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:289}} Nov 24 16:42:13.406215 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: [pid: 71938|app: 0|req: 794/1587] 10.222.0.53 () {58 vars in 998 bytes} [Wed Nov 24 16:42:13 2021] POST /identity/v3/auth/tokens => generated 3669 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 24 16:42:13.544240 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-991ead59-21d0-4e69-9b98-f7f7a6b211a1 None None] Authenticating user token {{(pid=71939) process_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 24 16:42:13.559226 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-991ead59-21d0-4e69-9b98-f7f7a6b211a1 None None] Validating token access rules against request {{(pid=71939) validate_allowed_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 24 16:42:13.564531 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab19e54c-422d-4372-b9b4-c967193dc765 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e196802d4d5432482b6d2eabc25f74e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3b3940d4ae1c4177ae29c02377bb4b0b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'service', 'ResellerAdmin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=71939) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 24 16:42:13.565182 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab19e54c-422d-4372-b9b4-c967193dc765 service nova] REQUEST_METHOD: `GET` {{(pid=71939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 24 16:42:13.565524 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab19e54c-422d-4372-b9b4-c967193dc765 service nova] SCRIPT_NAME: `/identity` {{(pid=71939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 24 16:42:13.565862 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab19e54c-422d-4372-b9b4-c967193dc765 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=71939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 24 16:42:13.575427 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab19e54c-422d-4372-b9b4-c967193dc765 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=71939) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:442}} Nov 24 16:42:13.604014 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab19e54c-422d-4372-b9b4-c967193dc765 service nova] RBAC: Authorization granted {{(pid=71939) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 24 16:42:13.613621 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: [pid: 71939|app: 0|req: 794/1588] 10.222.0.53 () {60 vars in 1356 bytes} [Wed Nov 24 16:42:13 2021] GET /identity/v3/auth/tokens => generated 3669 bytes in 70 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 24 16:42:15.175243 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-944cb7f2-fd55-4c6a-92ef-d2ba1f3fe020 None None] REQUEST_METHOD: `GET` {{(pid=71938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 24 16:42:15.175791 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-944cb7f2-fd55-4c6a-92ef-d2ba1f3fe020 None None] SCRIPT_NAME: `/identity` {{(pid=71938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 24 16:42:15.175921 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-944cb7f2-fd55-4c6a-92ef-d2ba1f3fe020 None None] PATH_INFO: `/` {{(pid=71938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 24 16:42:15.177736 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: [pid: 71938|app: 0|req: 795/1589] 10.222.0.53 () {54 vars in 900 bytes} [Wed Nov 24 16:42:15 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 24 16:42:15.183615 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27f13d0f-eb25-4a06-b85a-c61a8cd2146f None None] REQUEST_METHOD: `POST` {{(pid=71939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 24 16:42:15.183978 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27f13d0f-eb25-4a06-b85a-c61a8cd2146f None None] SCRIPT_NAME: `/identity` {{(pid=71939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 24 16:42:15.184323 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27f13d0f-eb25-4a06-b85a-c61a8cd2146f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=71939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 24 16:42:15.209237 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.auth.core [None req-27f13d0f-eb25-4a06-b85a-c61a8cd2146f None None] MFA Rules not processed for user `0f2ba2e8375b4e8c8792ee1e22b60427`. Rule list: `[]` (Enabled: `True`). {{(pid=71939) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:442}} Nov 24 16:42:15.210492 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.fernet_utils [None req-27f13d0f-eb25-4a06-b85a-c61a8cd2146f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=71939) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:289}} Nov 24 16:42:15.218496 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: [pid: 71939|app: 0|req: 795/1590] 10.222.0.53 () {58 vars in 998 bytes} [Wed Nov 24 16:42:15 2021] POST /identity/v3/auth/tokens => generated 3669 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 24 16:42:15.358746 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-944cb7f2-fd55-4c6a-92ef-d2ba1f3fe020 None None] Authenticating user token {{(pid=71938) process_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 24 16:42:15.375736 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-944cb7f2-fd55-4c6a-92ef-d2ba1f3fe020 None None] Validating token access rules against request {{(pid=71938) validate_allowed_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 24 16:42:15.385960 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e2939f9-eca1-4e6c-a227-6caeb3f2eb7a service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e196802d4d5432482b6d2eabc25f74e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3b3940d4ae1c4177ae29c02377bb4b0b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'service', 'ResellerAdmin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=71938) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 24 16:42:15.386765 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e2939f9-eca1-4e6c-a227-6caeb3f2eb7a service nova] REQUEST_METHOD: `GET` {{(pid=71938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 24 16:42:15.387110 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e2939f9-eca1-4e6c-a227-6caeb3f2eb7a service nova] SCRIPT_NAME: `/identity` {{(pid=71938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 24 16:42:15.387446 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e2939f9-eca1-4e6c-a227-6caeb3f2eb7a service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=71938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 24 16:42:15.396812 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e2939f9-eca1-4e6c-a227-6caeb3f2eb7a service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=71938) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:442}} Nov 24 16:42:15.426169 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e2939f9-eca1-4e6c-a227-6caeb3f2eb7a service nova] RBAC: Authorization granted {{(pid=71938) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 24 16:42:15.436272 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: [pid: 71938|app: 0|req: 796/1591] 10.222.0.53 () {60 vars in 1356 bytes} [Wed Nov 24 16:42:15 2021] GET /identity/v3/auth/tokens => generated 3669 bytes in 78 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 24 16:42:17.007072 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ebcae8c-32cd-425d-8b15-5b8d93fdcfac None None] REQUEST_METHOD: `GET` {{(pid=71939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 24 16:42:17.007625 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ebcae8c-32cd-425d-8b15-5b8d93fdcfac None None] SCRIPT_NAME: `/identity` {{(pid=71939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 24 16:42:17.007731 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ebcae8c-32cd-425d-8b15-5b8d93fdcfac None None] PATH_INFO: `/` {{(pid=71939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 24 16:42:17.009647 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: [pid: 71939|app: 0|req: 796/1592] 10.222.0.53 () {54 vars in 900 bytes} [Wed Nov 24 16:42:17 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 24 16:42:17.014886 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-219b07d6-220b-43ec-959b-4f4dd38b15cd None None] REQUEST_METHOD: `POST` {{(pid=71938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 24 16:42:17.015252 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-219b07d6-220b-43ec-959b-4f4dd38b15cd None None] SCRIPT_NAME: `/identity` {{(pid=71938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 24 16:42:17.015582 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-219b07d6-220b-43ec-959b-4f4dd38b15cd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=71938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 24 16:42:17.041105 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.auth.core [None req-219b07d6-220b-43ec-959b-4f4dd38b15cd None None] MFA Rules not processed for user `0f2ba2e8375b4e8c8792ee1e22b60427`. Rule list: `[]` (Enabled: `True`). {{(pid=71938) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:442}} Nov 24 16:42:17.042379 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.fernet_utils [None req-219b07d6-220b-43ec-959b-4f4dd38b15cd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=71938) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:289}} Nov 24 16:42:17.049931 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: [pid: 71938|app: 0|req: 797/1593] 10.222.0.53 () {58 vars in 998 bytes} [Wed Nov 24 16:42:17 2021] POST /identity/v3/auth/tokens => generated 3669 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 24 16:42:17.188183 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ebcae8c-32cd-425d-8b15-5b8d93fdcfac None None] Authenticating user token {{(pid=71939) process_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 24 16:42:17.203401 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ebcae8c-32cd-425d-8b15-5b8d93fdcfac None None] Validating token access rules against request {{(pid=71939) validate_allowed_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 24 16:42:17.208787 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0c99ef3-a48a-46cf-8716-8143fa9294f2 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e196802d4d5432482b6d2eabc25f74e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3b3940d4ae1c4177ae29c02377bb4b0b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'service', 'ResellerAdmin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=71939) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 24 16:42:17.209439 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0c99ef3-a48a-46cf-8716-8143fa9294f2 service nova] REQUEST_METHOD: `GET` {{(pid=71939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 24 16:42:17.209784 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0c99ef3-a48a-46cf-8716-8143fa9294f2 service nova] SCRIPT_NAME: `/identity` {{(pid=71939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 24 16:42:17.210152 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0c99ef3-a48a-46cf-8716-8143fa9294f2 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=71939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 24 16:42:17.219328 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0c99ef3-a48a-46cf-8716-8143fa9294f2 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=71939) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:442}} Nov 24 16:42:17.247940 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0c99ef3-a48a-46cf-8716-8143fa9294f2 service nova] RBAC: Authorization granted {{(pid=71939) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 24 16:42:17.257956 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: [pid: 71939|app: 0|req: 797/1594] 10.222.0.53 () {60 vars in 1356 bytes} [Wed Nov 24 16:42:17 2021] GET /identity/v3/auth/tokens => generated 3669 bytes in 70 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 24 16:42:18.807929 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-823051f5-6e6f-4a70-9314-7d5f7c4f5f81 None None] REQUEST_METHOD: `GET` {{(pid=71938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 24 16:42:18.808486 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-823051f5-6e6f-4a70-9314-7d5f7c4f5f81 None None] SCRIPT_NAME: `/identity` {{(pid=71938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 24 16:42:18.808597 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-823051f5-6e6f-4a70-9314-7d5f7c4f5f81 None None] PATH_INFO: `/` {{(pid=71938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 24 16:42:18.810425 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: [pid: 71938|app: 0|req: 798/1595] 10.222.0.53 () {54 vars in 900 bytes} [Wed Nov 24 16:42:18 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 24 16:42:18.815572 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bd68db7-fb9b-42ae-9291-cff47e46f1e8 None None] REQUEST_METHOD: `POST` {{(pid=71939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 24 16:42:18.815926 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bd68db7-fb9b-42ae-9291-cff47e46f1e8 None None] SCRIPT_NAME: `/identity` {{(pid=71939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 24 16:42:18.816269 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bd68db7-fb9b-42ae-9291-cff47e46f1e8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=71939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 24 16:42:18.840326 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.auth.core [None req-4bd68db7-fb9b-42ae-9291-cff47e46f1e8 None None] MFA Rules not processed for user `0f2ba2e8375b4e8c8792ee1e22b60427`. Rule list: `[]` (Enabled: `True`). {{(pid=71939) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:442}} Nov 24 16:42:18.841558 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.fernet_utils [None req-4bd68db7-fb9b-42ae-9291-cff47e46f1e8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=71939) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:289}} Nov 24 16:42:18.849028 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: [pid: 71939|app: 0|req: 798/1596] 10.222.0.53 () {58 vars in 998 bytes} [Wed Nov 24 16:42:18 2021] POST /identity/v3/auth/tokens => generated 3669 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 24 16:42:18.986259 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-823051f5-6e6f-4a70-9314-7d5f7c4f5f81 None None] Authenticating user token {{(pid=71938) process_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 24 16:42:19.001123 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-823051f5-6e6f-4a70-9314-7d5f7c4f5f81 None None] Validating token access rules against request {{(pid=71938) validate_allowed_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 24 16:42:19.006361 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3476174-892e-4e7f-bb6e-fa1ec3dd8e42 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e196802d4d5432482b6d2eabc25f74e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3b3940d4ae1c4177ae29c02377bb4b0b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'service', 'ResellerAdmin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=71938) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 24 16:42:19.007003 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3476174-892e-4e7f-bb6e-fa1ec3dd8e42 service nova] REQUEST_METHOD: `GET` {{(pid=71938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 24 16:42:19.007337 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3476174-892e-4e7f-bb6e-fa1ec3dd8e42 service nova] SCRIPT_NAME: `/identity` {{(pid=71938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 24 16:42:19.007665 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3476174-892e-4e7f-bb6e-fa1ec3dd8e42 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=71938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 24 16:42:19.016772 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3476174-892e-4e7f-bb6e-fa1ec3dd8e42 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=71938) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:442}} Nov 24 16:42:19.045388 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3476174-892e-4e7f-bb6e-fa1ec3dd8e42 service nova] RBAC: Authorization granted {{(pid=71938) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 24 16:42:19.055027 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: [pid: 71938|app: 0|req: 799/1597] 10.222.0.53 () {60 vars in 1356 bytes} [Wed Nov 24 16:42:18 2021] GET /identity/v3/auth/tokens => generated 3669 bytes in 69 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 24 16:42:20.646173 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aea43537-fc85-4ed0-9818-5a58db1b773a None None] REQUEST_METHOD: `GET` {{(pid=71939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 24 16:42:20.646701 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aea43537-fc85-4ed0-9818-5a58db1b773a None None] SCRIPT_NAME: `/identity` {{(pid=71939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 24 16:42:20.646890 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aea43537-fc85-4ed0-9818-5a58db1b773a None None] PATH_INFO: `/` {{(pid=71939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 24 16:42:20.649248 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: [pid: 71939|app: 0|req: 799/1598] 10.222.0.53 () {54 vars in 900 bytes} [Wed Nov 24 16:42:20 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 24 16:42:20.655449 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7249c5d7-876e-4e9f-86d6-90be98def312 None None] REQUEST_METHOD: `POST` {{(pid=71938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 24 16:42:20.655816 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7249c5d7-876e-4e9f-86d6-90be98def312 None None] SCRIPT_NAME: `/identity` {{(pid=71938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 24 16:42:20.656180 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7249c5d7-876e-4e9f-86d6-90be98def312 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=71938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 24 16:42:20.684164 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.auth.core [None req-7249c5d7-876e-4e9f-86d6-90be98def312 None None] MFA Rules not processed for user `0f2ba2e8375b4e8c8792ee1e22b60427`. Rule list: `[]` (Enabled: `True`). {{(pid=71938) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:442}} Nov 24 16:42:20.685456 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.fernet_utils [None req-7249c5d7-876e-4e9f-86d6-90be98def312 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=71938) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:289}} Nov 24 16:42:20.694101 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: [pid: 71938|app: 0|req: 800/1599] 10.222.0.53 () {58 vars in 998 bytes} [Wed Nov 24 16:42:20 2021] POST /identity/v3/auth/tokens => generated 3669 bytes in 40 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 24 16:42:20.833427 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aea43537-fc85-4ed0-9818-5a58db1b773a None None] Authenticating user token {{(pid=71939) process_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 24 16:42:20.848652 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aea43537-fc85-4ed0-9818-5a58db1b773a None None] Validating token access rules against request {{(pid=71939) validate_allowed_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 24 16:42:20.854837 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e04e33e-1d1b-4d3e-9770-36404c8ca0ec service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e196802d4d5432482b6d2eabc25f74e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3b3940d4ae1c4177ae29c02377bb4b0b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'service', 'ResellerAdmin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=71939) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 24 16:42:20.855493 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e04e33e-1d1b-4d3e-9770-36404c8ca0ec service nova] REQUEST_METHOD: `GET` {{(pid=71939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 24 16:42:20.855829 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e04e33e-1d1b-4d3e-9770-36404c8ca0ec service nova] SCRIPT_NAME: `/identity` {{(pid=71939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 24 16:42:20.856242 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e04e33e-1d1b-4d3e-9770-36404c8ca0ec service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=71939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 24 16:42:20.865894 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e04e33e-1d1b-4d3e-9770-36404c8ca0ec service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=71939) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:442}} Nov 24 16:42:20.895642 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e04e33e-1d1b-4d3e-9770-36404c8ca0ec service nova] RBAC: Authorization granted {{(pid=71939) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 24 16:42:20.906156 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: [pid: 71939|app: 0|req: 800/1600] 10.222.0.53 () {60 vars in 1356 bytes} [Wed Nov 24 16:42:20 2021] GET /identity/v3/auth/tokens => generated 3669 bytes in 73 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 24 16:42:22.918271 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc2294a2-ba06-4f31-ac21-30ee84384ca5 None None] REQUEST_METHOD: `GET` {{(pid=71938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 24 16:42:22.918784 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc2294a2-ba06-4f31-ac21-30ee84384ca5 None None] SCRIPT_NAME: `/identity` {{(pid=71938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 24 16:42:22.918914 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc2294a2-ba06-4f31-ac21-30ee84384ca5 None None] PATH_INFO: `/` {{(pid=71938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 24 16:42:22.920801 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: [pid: 71938|app: 0|req: 801/1601] 10.222.0.53 () {54 vars in 915 bytes} [Wed Nov 24 16:42:22 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 24 16:42:22.926606 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cd61974-90ab-458c-892a-494c6e50a7b0 None None] REQUEST_METHOD: `POST` {{(pid=71939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 24 16:42:22.926958 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cd61974-90ab-458c-892a-494c6e50a7b0 None None] SCRIPT_NAME: `/identity` {{(pid=71939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 24 16:42:22.927294 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cd61974-90ab-458c-892a-494c6e50a7b0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=71939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 24 16:42:22.950954 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.auth.core [None req-8cd61974-90ab-458c-892a-494c6e50a7b0 None None] MFA Rules not processed for user `0f2ba2e8375b4e8c8792ee1e22b60427`. Rule list: `[]` (Enabled: `True`). {{(pid=71939) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:442}} Nov 24 16:42:22.952173 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.fernet_utils [None req-8cd61974-90ab-458c-892a-494c6e50a7b0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=71939) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:289}} Nov 24 16:42:22.959588 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: [pid: 71939|app: 0|req: 801/1602] 10.222.0.53 () {58 vars in 1013 bytes} [Wed Nov 24 16:42:22 2021] POST /identity/v3/auth/tokens => generated 3669 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 24 16:42:22.986984 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6283c590-4c98-4c80-971f-c73491eafbbd None None] REQUEST_METHOD: `POST` {{(pid=71938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 24 16:42:22.987339 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6283c590-4c98-4c80-971f-c73491eafbbd None None] SCRIPT_NAME: `/identity` {{(pid=71938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 24 16:42:22.987678 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6283c590-4c98-4c80-971f-c73491eafbbd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=71938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 24 16:42:23.012786 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.auth.core [None req-6283c590-4c98-4c80-971f-c73491eafbbd None None] MFA Rules not processed for user `0f2ba2e8375b4e8c8792ee1e22b60427`. Rule list: `[]` (Enabled: `True`). {{(pid=71938) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:442}} Nov 24 16:42:23.013958 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.fernet_utils [None req-6283c590-4c98-4c80-971f-c73491eafbbd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=71938) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:289}} Nov 24 16:42:23.021380 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: [pid: 71938|app: 0|req: 802/1603] 10.222.0.53 () {58 vars in 1013 bytes} [Wed Nov 24 16:42:22 2021] POST /identity/v3/auth/tokens => generated 3669 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 24 16:42:23.042431 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cd61974-90ab-458c-892a-494c6e50a7b0 None None] Authenticating user token {{(pid=71939) process_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 24 16:42:23.052202 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cd61974-90ab-458c-892a-494c6e50a7b0 None None] Validating token access rules against request {{(pid=71939) validate_allowed_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 24 16:42:23.055820 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71e18690-6bc2-4040-955f-9fa5aaefd766 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c90f21b9cdcb413282461fa83cb6b7a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3b3940d4ae1c4177ae29c02377bb4b0b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=71939) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 24 16:42:23.056477 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71e18690-6bc2-4040-955f-9fa5aaefd766 service neutron] REQUEST_METHOD: `GET` {{(pid=71939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 24 16:42:23.056817 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71e18690-6bc2-4040-955f-9fa5aaefd766 service neutron] SCRIPT_NAME: `/identity` {{(pid=71939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 24 16:42:23.057146 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71e18690-6bc2-4040-955f-9fa5aaefd766 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=71939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 24 16:42:23.066379 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71e18690-6bc2-4040-955f-9fa5aaefd766 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=71939) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:442}} Nov 24 16:42:23.094884 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71e18690-6bc2-4040-955f-9fa5aaefd766 service neutron] RBAC: Authorization granted {{(pid=71939) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 24 16:42:23.105529 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: [pid: 71939|app: 0|req: 802/1604] 10.222.0.53 () {60 vars in 1356 bytes} [Wed Nov 24 16:42:23 2021] GET /identity/v3/auth/tokens => generated 3669 bytes in 64 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 24 16:42:25.412570 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91183288-9002-4df4-b4ec-1b88f8c4ad49 None None] REQUEST_METHOD: `GET` {{(pid=71938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 24 16:42:25.413114 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91183288-9002-4df4-b4ec-1b88f8c4ad49 None None] SCRIPT_NAME: `/identity` {{(pid=71938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 24 16:42:25.413223 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91183288-9002-4df4-b4ec-1b88f8c4ad49 None None] PATH_INFO: `/` {{(pid=71938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 24 16:42:25.415098 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: [pid: 71938|app: 0|req: 803/1605] 10.222.0.53 () {54 vars in 915 bytes} [Wed Nov 24 16:42:25 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 24 16:42:25.421062 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-504f37bf-71e6-4989-a9c4-f3ce45b00166 None None] REQUEST_METHOD: `POST` {{(pid=71939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 24 16:42:25.421417 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-504f37bf-71e6-4989-a9c4-f3ce45b00166 None None] SCRIPT_NAME: `/identity` {{(pid=71939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 24 16:42:25.421762 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-504f37bf-71e6-4989-a9c4-f3ce45b00166 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=71939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 24 16:42:25.446818 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.auth.core [None req-504f37bf-71e6-4989-a9c4-f3ce45b00166 None None] MFA Rules not processed for user `0f2ba2e8375b4e8c8792ee1e22b60427`. Rule list: `[]` (Enabled: `True`). {{(pid=71939) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:442}} Nov 24 16:42:25.448176 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.fernet_utils [None req-504f37bf-71e6-4989-a9c4-f3ce45b00166 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=71939) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:289}} Nov 24 16:42:25.455578 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: [pid: 71939|app: 0|req: 803/1606] 10.222.0.53 () {58 vars in 1013 bytes} [Wed Nov 24 16:42:25 2021] POST /identity/v3/auth/tokens => generated 3669 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 24 16:42:25.480703 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a633fa41-98e3-4f6c-b073-2aa5ec3793cd None None] REQUEST_METHOD: `POST` {{(pid=71938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 24 16:42:25.480993 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a633fa41-98e3-4f6c-b073-2aa5ec3793cd None None] SCRIPT_NAME: `/identity` {{(pid=71938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 24 16:42:25.481329 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a633fa41-98e3-4f6c-b073-2aa5ec3793cd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=71938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 24 16:42:25.504847 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.auth.core [None req-a633fa41-98e3-4f6c-b073-2aa5ec3793cd None None] MFA Rules not processed for user `0f2ba2e8375b4e8c8792ee1e22b60427`. Rule list: `[]` (Enabled: `True`). {{(pid=71938) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:442}} Nov 24 16:42:25.506081 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.fernet_utils [None req-a633fa41-98e3-4f6c-b073-2aa5ec3793cd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=71938) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:289}} Nov 24 16:42:25.514433 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: [pid: 71938|app: 0|req: 804/1607] 10.222.0.53 () {58 vars in 1013 bytes} [Wed Nov 24 16:42:25 2021] POST /identity/v3/auth/tokens => generated 3669 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 24 16:42:25.533808 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-504f37bf-71e6-4989-a9c4-f3ce45b00166 None None] Authenticating user token {{(pid=71939) process_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 24 16:42:25.544623 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-504f37bf-71e6-4989-a9c4-f3ce45b00166 None None] Validating token access rules against request {{(pid=71939) validate_allowed_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 24 16:42:25.548188 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58fcac40-8c92-4fca-94ea-17f3160714ee service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c90f21b9cdcb413282461fa83cb6b7a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3b3940d4ae1c4177ae29c02377bb4b0b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=71939) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 24 16:42:25.548838 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58fcac40-8c92-4fca-94ea-17f3160714ee service neutron] REQUEST_METHOD: `GET` {{(pid=71939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 24 16:42:25.549182 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58fcac40-8c92-4fca-94ea-17f3160714ee service neutron] SCRIPT_NAME: `/identity` {{(pid=71939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 24 16:42:25.549516 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58fcac40-8c92-4fca-94ea-17f3160714ee service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=71939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 24 16:42:25.559510 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58fcac40-8c92-4fca-94ea-17f3160714ee service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=71939) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:442}} Nov 24 16:42:25.587856 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58fcac40-8c92-4fca-94ea-17f3160714ee service neutron] RBAC: Authorization granted {{(pid=71939) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 24 16:42:25.597713 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: [pid: 71939|app: 0|req: 804/1608] 10.222.0.53 () {60 vars in 1356 bytes} [Wed Nov 24 16:42:25 2021] GET /identity/v3/auth/tokens => generated 3669 bytes in 64 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 24 16:42:28.095723 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5a48200-7ac4-4606-b790-aedb5c58ace8 None None] REQUEST_METHOD: `GET` {{(pid=71938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 24 16:42:28.096268 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5a48200-7ac4-4606-b790-aedb5c58ace8 None None] SCRIPT_NAME: `/identity` {{(pid=71938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 24 16:42:28.096268 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5a48200-7ac4-4606-b790-aedb5c58ace8 None None] PATH_INFO: `/` {{(pid=71938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 24 16:42:28.098150 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: [pid: 71938|app: 0|req: 805/1609] 10.222.0.53 () {54 vars in 915 bytes} [Wed Nov 24 16:42:28 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 24 16:42:28.104748 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-249f3882-8a29-435a-82f7-395d7125e8cc None None] REQUEST_METHOD: `POST` {{(pid=71939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 24 16:42:28.105099 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-249f3882-8a29-435a-82f7-395d7125e8cc None None] SCRIPT_NAME: `/identity` {{(pid=71939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 24 16:42:28.105439 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-249f3882-8a29-435a-82f7-395d7125e8cc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=71939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 24 16:42:28.129707 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.auth.core [None req-249f3882-8a29-435a-82f7-395d7125e8cc None None] MFA Rules not processed for user `0f2ba2e8375b4e8c8792ee1e22b60427`. Rule list: `[]` (Enabled: `True`). {{(pid=71939) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:442}} Nov 24 16:42:28.130947 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.fernet_utils [None req-249f3882-8a29-435a-82f7-395d7125e8cc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=71939) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:289}} Nov 24 16:42:28.138551 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: [pid: 71939|app: 0|req: 805/1610] 10.222.0.53 () {58 vars in 1013 bytes} [Wed Nov 24 16:42:28 2021] POST /identity/v3/auth/tokens => generated 3669 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Nov 24 16:42:28.166366 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b03efae1-075c-48b6-ab23-9850051f21b7 None None] REQUEST_METHOD: `POST` {{(pid=71938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 24 16:42:28.166720 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b03efae1-075c-48b6-ab23-9850051f21b7 None None] SCRIPT_NAME: `/identity` {{(pid=71938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 24 16:42:28.167061 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b03efae1-075c-48b6-ab23-9850051f21b7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=71938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 24 16:42:28.191082 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.auth.core [None req-b03efae1-075c-48b6-ab23-9850051f21b7 None None] MFA Rules not processed for user `0f2ba2e8375b4e8c8792ee1e22b60427`. Rule list: `[]` (Enabled: `True`). {{(pid=71938) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:442}} Nov 24 16:42:28.192311 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.fernet_utils [None req-b03efae1-075c-48b6-ab23-9850051f21b7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=71938) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:289}} Nov 24 16:42:28.201215 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: [pid: 71938|app: 0|req: 806/1611] 10.222.0.53 () {58 vars in 1013 bytes} [Wed Nov 24 16:42:28 2021] POST /identity/v3/auth/tokens => generated 3669 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 24 16:42:28.237215 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8d23a5b-c218-4c6d-86b2-1a1e4777e76d None None] REQUEST_METHOD: `GET` {{(pid=71939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 24 16:42:28.237578 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8d23a5b-c218-4c6d-86b2-1a1e4777e76d None None] SCRIPT_NAME: `/identity` {{(pid=71939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 24 16:42:28.237907 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8d23a5b-c218-4c6d-86b2-1a1e4777e76d None None] PATH_INFO: `/` {{(pid=71939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 24 16:42:28.239797 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: [pid: 71939|app: 0|req: 806/1612] 10.222.0.53 () {54 vars in 951 bytes} [Wed Nov 24 16:42:28 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 24 16:42:28.247057 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-509a6aca-a443-44bc-8245-db2aea95c739 None None] REQUEST_METHOD: `POST` {{(pid=71938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 24 16:42:28.247407 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-509a6aca-a443-44bc-8245-db2aea95c739 None None] SCRIPT_NAME: `/identity` {{(pid=71938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 24 16:42:28.247746 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-509a6aca-a443-44bc-8245-db2aea95c739 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=71938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 24 16:42:28.271315 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.auth.core [None req-509a6aca-a443-44bc-8245-db2aea95c739 None None] MFA Rules not processed for user `c90f21b9cdcb413282461fa83cb6b7a5`. Rule list: `[]` (Enabled: `True`). {{(pid=71938) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:442}} Nov 24 16:42:28.272584 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.fernet_utils [None req-509a6aca-a443-44bc-8245-db2aea95c739 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=71938) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:289}} Nov 24 16:42:28.279350 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: [pid: 71938|app: 0|req: 807/1613] 10.222.0.53 () {58 vars in 1049 bytes} [Wed Nov 24 16:42:28 2021] POST /identity/v3/auth/tokens => generated 3551 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 24 16:42:28.288546 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8d23a5b-c218-4c6d-86b2-1a1e4777e76d None None] Authenticating user token {{(pid=71939) process_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 24 16:42:28.300496 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8d23a5b-c218-4c6d-86b2-1a1e4777e76d None None] Validating token access rules against request {{(pid=71939) validate_allowed_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 24 16:42:28.304092 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd51292c-d52d-4f41-8d48-f09752cce4e1 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c90f21b9cdcb413282461fa83cb6b7a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3b3940d4ae1c4177ae29c02377bb4b0b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=71939) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 24 16:42:28.304732 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd51292c-d52d-4f41-8d48-f09752cce4e1 service neutron] REQUEST_METHOD: `GET` {{(pid=71939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 24 16:42:28.305071 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd51292c-d52d-4f41-8d48-f09752cce4e1 service neutron] SCRIPT_NAME: `/identity` {{(pid=71939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 24 16:42:28.305405 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd51292c-d52d-4f41-8d48-f09752cce4e1 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=71939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 24 16:42:28.314810 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd51292c-d52d-4f41-8d48-f09752cce4e1 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=71939) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:442}} Nov 24 16:42:28.346087 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd51292c-d52d-4f41-8d48-f09752cce4e1 service neutron] RBAC: Authorization granted {{(pid=71939) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 24 16:42:28.357844 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: [pid: 71939|app: 0|req: 807/1614] 10.222.0.53 () {60 vars in 1356 bytes} [Wed Nov 24 16:42:28 2021] GET /identity/v3/auth/tokens => generated 3669 bytes in 70 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 24 16:42:31.250295 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dd8e386-1c1d-4026-aa6a-336630fd2d88 None None] REQUEST_METHOD: `GET` {{(pid=71938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 24 16:42:31.250766 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dd8e386-1c1d-4026-aa6a-336630fd2d88 None None] SCRIPT_NAME: `/identity` {{(pid=71938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 24 16:42:31.250967 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dd8e386-1c1d-4026-aa6a-336630fd2d88 None None] PATH_INFO: `/` {{(pid=71938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 24 16:42:31.252840 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: [pid: 71938|app: 0|req: 808/1615] 10.222.0.53 () {54 vars in 915 bytes} [Wed Nov 24 16:42:31 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 24 16:42:31.259431 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b3f1b72-fc67-4c04-85be-715195910dc8 None None] REQUEST_METHOD: `POST` {{(pid=71939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 24 16:42:31.259784 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b3f1b72-fc67-4c04-85be-715195910dc8 None None] SCRIPT_NAME: `/identity` {{(pid=71939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 24 16:42:31.260131 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b3f1b72-fc67-4c04-85be-715195910dc8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=71939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 24 16:42:31.285199 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.auth.core [None req-7b3f1b72-fc67-4c04-85be-715195910dc8 None None] MFA Rules not processed for user `0f2ba2e8375b4e8c8792ee1e22b60427`. Rule list: `[]` (Enabled: `True`). {{(pid=71939) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:442}} Nov 24 16:42:31.286462 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.fernet_utils [None req-7b3f1b72-fc67-4c04-85be-715195910dc8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=71939) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:289}} Nov 24 16:42:31.293884 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: [pid: 71939|app: 0|req: 808/1616] 10.222.0.53 () {58 vars in 1013 bytes} [Wed Nov 24 16:42:31 2021] POST /identity/v3/auth/tokens => generated 3669 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 24 16:42:31.322457 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49cc3589-0eaa-40d3-bf81-6230b0bdecc8 None None] REQUEST_METHOD: `POST` {{(pid=71938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 24 16:42:31.322809 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49cc3589-0eaa-40d3-bf81-6230b0bdecc8 None None] SCRIPT_NAME: `/identity` {{(pid=71938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 24 16:42:31.323149 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49cc3589-0eaa-40d3-bf81-6230b0bdecc8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=71938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 24 16:42:31.346746 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.auth.core [None req-49cc3589-0eaa-40d3-bf81-6230b0bdecc8 None None] MFA Rules not processed for user `0f2ba2e8375b4e8c8792ee1e22b60427`. Rule list: `[]` (Enabled: `True`). {{(pid=71938) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:442}} Nov 24 16:42:31.348009 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.fernet_utils [None req-49cc3589-0eaa-40d3-bf81-6230b0bdecc8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=71938) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:289}} Nov 24 16:42:31.355476 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: [pid: 71938|app: 0|req: 809/1617] 10.222.0.53 () {58 vars in 1013 bytes} [Wed Nov 24 16:42:31 2021] POST /identity/v3/auth/tokens => generated 3669 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 24 16:42:31.377411 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b3f1b72-fc67-4c04-85be-715195910dc8 None None] Authenticating user token {{(pid=71939) process_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 24 16:42:31.387925 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b3f1b72-fc67-4c04-85be-715195910dc8 None None] Validating token access rules against request {{(pid=71939) validate_allowed_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 24 16:42:31.391459 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1da4a72-0c70-40e8-b8bb-898897194afb service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c90f21b9cdcb413282461fa83cb6b7a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3b3940d4ae1c4177ae29c02377bb4b0b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=71939) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 24 16:42:31.392094 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1da4a72-0c70-40e8-b8bb-898897194afb service neutron] REQUEST_METHOD: `GET` {{(pid=71939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 24 16:42:31.392436 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1da4a72-0c70-40e8-b8bb-898897194afb service neutron] SCRIPT_NAME: `/identity` {{(pid=71939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 24 16:42:31.392768 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1da4a72-0c70-40e8-b8bb-898897194afb service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=71939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 24 16:42:31.402141 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1da4a72-0c70-40e8-b8bb-898897194afb service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=71939) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:442}} Nov 24 16:42:31.430237 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1da4a72-0c70-40e8-b8bb-898897194afb service neutron] RBAC: Authorization granted {{(pid=71939) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 24 16:42:31.439703 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: [pid: 71939|app: 0|req: 809/1618] 10.222.0.53 () {60 vars in 1356 bytes} [Wed Nov 24 16:42:31 2021] GET /identity/v3/auth/tokens => generated 3669 bytes in 63 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 24 16:42:33.560820 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e43b4af-db1b-4a19-9192-4ac8a7dd6dd9 None None] REQUEST_METHOD: `GET` {{(pid=71938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 24 16:42:33.561330 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e43b4af-db1b-4a19-9192-4ac8a7dd6dd9 None None] SCRIPT_NAME: `/identity` {{(pid=71938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 24 16:42:33.561436 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e43b4af-db1b-4a19-9192-4ac8a7dd6dd9 None None] PATH_INFO: `/` {{(pid=71938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 24 16:42:33.563253 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: [pid: 71938|app: 0|req: 810/1619] 10.222.0.53 () {54 vars in 915 bytes} [Wed Nov 24 16:42:33 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 24 16:42:33.569056 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-503087b6-1d97-4384-a651-4cbf06ee5247 None None] REQUEST_METHOD: `POST` {{(pid=71939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 24 16:42:33.569407 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-503087b6-1d97-4384-a651-4cbf06ee5247 None None] SCRIPT_NAME: `/identity` {{(pid=71939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 24 16:42:33.569749 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-503087b6-1d97-4384-a651-4cbf06ee5247 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=71939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 24 16:42:33.594220 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.auth.core [None req-503087b6-1d97-4384-a651-4cbf06ee5247 None None] MFA Rules not processed for user `0f2ba2e8375b4e8c8792ee1e22b60427`. Rule list: `[]` (Enabled: `True`). {{(pid=71939) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:442}} Nov 24 16:42:33.595455 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.fernet_utils [None req-503087b6-1d97-4384-a651-4cbf06ee5247 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=71939) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:289}} Nov 24 16:42:33.602941 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: [pid: 71939|app: 0|req: 810/1620] 10.222.0.53 () {58 vars in 1013 bytes} [Wed Nov 24 16:42:33 2021] POST /identity/v3/auth/tokens => generated 3669 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 24 16:42:33.630260 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9c2ae18-cd32-4280-9834-f2660ad048fb None None] REQUEST_METHOD: `POST` {{(pid=71938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 24 16:42:33.630588 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9c2ae18-cd32-4280-9834-f2660ad048fb None None] SCRIPT_NAME: `/identity` {{(pid=71938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 24 16:42:33.630927 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9c2ae18-cd32-4280-9834-f2660ad048fb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=71938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 24 16:42:33.654625 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.auth.core [None req-b9c2ae18-cd32-4280-9834-f2660ad048fb None None] MFA Rules not processed for user `0f2ba2e8375b4e8c8792ee1e22b60427`. Rule list: `[]` (Enabled: `True`). {{(pid=71938) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:442}} Nov 24 16:42:33.655831 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.fernet_utils [None req-b9c2ae18-cd32-4280-9834-f2660ad048fb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=71938) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:289}} Nov 24 16:42:33.663176 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: [pid: 71938|app: 0|req: 811/1621] 10.222.0.53 () {58 vars in 1013 bytes} [Wed Nov 24 16:42:33 2021] POST /identity/v3/auth/tokens => generated 3669 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 24 16:42:33.683131 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-503087b6-1d97-4384-a651-4cbf06ee5247 None None] Authenticating user token {{(pid=71939) process_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 24 16:42:33.692863 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-503087b6-1d97-4384-a651-4cbf06ee5247 None None] Validating token access rules against request {{(pid=71939) validate_allowed_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 24 16:42:33.697283 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3766f5b1-6689-4ec2-9443-549f125da1d7 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c90f21b9cdcb413282461fa83cb6b7a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3b3940d4ae1c4177ae29c02377bb4b0b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=71939) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 24 16:42:33.697927 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3766f5b1-6689-4ec2-9443-549f125da1d7 service neutron] REQUEST_METHOD: `GET` {{(pid=71939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 24 16:42:33.698295 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3766f5b1-6689-4ec2-9443-549f125da1d7 service neutron] SCRIPT_NAME: `/identity` {{(pid=71939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 24 16:42:33.698650 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3766f5b1-6689-4ec2-9443-549f125da1d7 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=71939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 24 16:42:33.707781 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3766f5b1-6689-4ec2-9443-549f125da1d7 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=71939) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:442}} Nov 24 16:42:33.735483 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3766f5b1-6689-4ec2-9443-549f125da1d7 service neutron] RBAC: Authorization granted {{(pid=71939) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 24 16:42:33.745648 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: [pid: 71939|app: 0|req: 811/1622] 10.222.0.53 () {60 vars in 1356 bytes} [Wed Nov 24 16:42:33 2021] GET /identity/v3/auth/tokens => generated 3669 bytes in 63 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 24 16:42:35.855746 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56f1009d-926e-49b1-818b-334537013bb0 None None] REQUEST_METHOD: `GET` {{(pid=71938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 24 16:42:35.856340 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56f1009d-926e-49b1-818b-334537013bb0 None None] SCRIPT_NAME: `/identity` {{(pid=71938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 24 16:42:35.856457 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56f1009d-926e-49b1-818b-334537013bb0 None None] PATH_INFO: `/` {{(pid=71938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 24 16:42:35.858373 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: [pid: 71938|app: 0|req: 812/1623] 10.222.0.53 () {54 vars in 915 bytes} [Wed Nov 24 16:42:35 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 24 16:42:35.864283 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0eea4b88-329f-4ae2-a2b1-d9b59b7f8a1b None None] REQUEST_METHOD: `POST` {{(pid=71939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 24 16:42:35.864631 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0eea4b88-329f-4ae2-a2b1-d9b59b7f8a1b None None] SCRIPT_NAME: `/identity` {{(pid=71939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 24 16:42:35.864970 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0eea4b88-329f-4ae2-a2b1-d9b59b7f8a1b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=71939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 24 16:42:35.889704 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.auth.core [None req-0eea4b88-329f-4ae2-a2b1-d9b59b7f8a1b None None] MFA Rules not processed for user `0f2ba2e8375b4e8c8792ee1e22b60427`. Rule list: `[]` (Enabled: `True`). {{(pid=71939) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:442}} Nov 24 16:42:35.890967 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.fernet_utils [None req-0eea4b88-329f-4ae2-a2b1-d9b59b7f8a1b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=71939) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:289}} Nov 24 16:42:35.898413 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: [pid: 71939|app: 0|req: 812/1624] 10.222.0.53 () {58 vars in 1013 bytes} [Wed Nov 24 16:42:35 2021] POST /identity/v3/auth/tokens => generated 3669 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 24 16:42:35.925444 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0c78d69-716a-4dfd-95b5-5056b98483ce None None] REQUEST_METHOD: `POST` {{(pid=71938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 24 16:42:35.925798 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0c78d69-716a-4dfd-95b5-5056b98483ce None None] SCRIPT_NAME: `/identity` {{(pid=71938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 24 16:42:35.926172 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0c78d69-716a-4dfd-95b5-5056b98483ce None None] PATH_INFO: `/v3/auth/tokens` {{(pid=71938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 24 16:42:35.950967 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.auth.core [None req-e0c78d69-716a-4dfd-95b5-5056b98483ce None None] MFA Rules not processed for user `0f2ba2e8375b4e8c8792ee1e22b60427`. Rule list: `[]` (Enabled: `True`). {{(pid=71938) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:442}} Nov 24 16:42:35.952192 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.fernet_utils [None req-e0c78d69-716a-4dfd-95b5-5056b98483ce None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=71938) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:289}} Nov 24 16:42:35.959635 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: [pid: 71938|app: 0|req: 813/1625] 10.222.0.53 () {58 vars in 1013 bytes} [Wed Nov 24 16:42:35 2021] POST /identity/v3/auth/tokens => generated 3669 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 24 16:42:35.979124 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0eea4b88-329f-4ae2-a2b1-d9b59b7f8a1b None None] Authenticating user token {{(pid=71939) process_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 24 16:42:35.988880 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0eea4b88-329f-4ae2-a2b1-d9b59b7f8a1b None None] Validating token access rules against request {{(pid=71939) validate_allowed_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 24 16:42:35.993130 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81d9e2f6-969a-4f57-b20e-0bdaf86727eb service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c90f21b9cdcb413282461fa83cb6b7a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3b3940d4ae1c4177ae29c02377bb4b0b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=71939) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 24 16:42:35.993789 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81d9e2f6-969a-4f57-b20e-0bdaf86727eb service neutron] REQUEST_METHOD: `GET` {{(pid=71939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 24 16:42:35.994158 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81d9e2f6-969a-4f57-b20e-0bdaf86727eb service neutron] SCRIPT_NAME: `/identity` {{(pid=71939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 24 16:42:35.994499 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81d9e2f6-969a-4f57-b20e-0bdaf86727eb service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=71939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 24 16:42:36.003701 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81d9e2f6-969a-4f57-b20e-0bdaf86727eb service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=71939) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:442}} Nov 24 16:42:36.032134 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81d9e2f6-969a-4f57-b20e-0bdaf86727eb service neutron] RBAC: Authorization granted {{(pid=71939) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 24 16:42:36.042323 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: [pid: 71939|app: 0|req: 813/1626] 10.222.0.53 () {60 vars in 1356 bytes} [Wed Nov 24 16:42:35 2021] GET /identity/v3/auth/tokens => generated 3669 bytes in 64 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 24 16:42:38.166890 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb39eeaa-bab3-4982-90ff-9594b2306bcc None None] REQUEST_METHOD: `GET` {{(pid=71938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 24 16:42:38.167452 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb39eeaa-bab3-4982-90ff-9594b2306bcc None None] SCRIPT_NAME: `/identity` {{(pid=71938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 24 16:42:38.167567 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb39eeaa-bab3-4982-90ff-9594b2306bcc None None] PATH_INFO: `/` {{(pid=71938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 24 16:42:38.169407 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: [pid: 71938|app: 0|req: 814/1627] 10.222.0.53 () {54 vars in 915 bytes} [Wed Nov 24 16:42:38 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 24 16:42:38.175172 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06c10e9b-4f14-49a9-93d3-85f7dd44de16 None None] REQUEST_METHOD: `POST` {{(pid=71939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 24 16:42:38.175522 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06c10e9b-4f14-49a9-93d3-85f7dd44de16 None None] SCRIPT_NAME: `/identity` {{(pid=71939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 24 16:42:38.175867 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06c10e9b-4f14-49a9-93d3-85f7dd44de16 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=71939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 24 16:42:38.199881 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.auth.core [None req-06c10e9b-4f14-49a9-93d3-85f7dd44de16 None None] MFA Rules not processed for user `0f2ba2e8375b4e8c8792ee1e22b60427`. Rule list: `[]` (Enabled: `True`). {{(pid=71939) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:442}} Nov 24 16:42:38.201114 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.fernet_utils [None req-06c10e9b-4f14-49a9-93d3-85f7dd44de16 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=71939) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:289}} Nov 24 16:42:38.208754 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: [pid: 71939|app: 0|req: 814/1628] 10.222.0.53 () {58 vars in 1013 bytes} [Wed Nov 24 16:42:38 2021] POST /identity/v3/auth/tokens => generated 3669 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 24 16:42:38.245212 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4e198e3-363a-41d9-bc1b-cff4ee9a1650 None None] REQUEST_METHOD: `POST` {{(pid=71938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 24 16:42:38.245584 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4e198e3-363a-41d9-bc1b-cff4ee9a1650 None None] SCRIPT_NAME: `/identity` {{(pid=71938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 24 16:42:38.245937 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4e198e3-363a-41d9-bc1b-cff4ee9a1650 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=71938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 24 16:42:38.269542 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.auth.core [None req-b4e198e3-363a-41d9-bc1b-cff4ee9a1650 None None] MFA Rules not processed for user `0f2ba2e8375b4e8c8792ee1e22b60427`. Rule list: `[]` (Enabled: `True`). {{(pid=71938) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:442}} Nov 24 16:42:38.270843 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.fernet_utils [None req-b4e198e3-363a-41d9-bc1b-cff4ee9a1650 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=71938) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:289}} Nov 24 16:42:38.278835 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: [pid: 71938|app: 0|req: 815/1629] 10.222.0.53 () {58 vars in 1013 bytes} [Wed Nov 24 16:42:38 2021] POST /identity/v3/auth/tokens => generated 3669 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 24 16:42:38.298135 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06c10e9b-4f14-49a9-93d3-85f7dd44de16 None None] Authenticating user token {{(pid=71939) process_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 24 16:42:38.307874 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06c10e9b-4f14-49a9-93d3-85f7dd44de16 None None] Validating token access rules against request {{(pid=71939) validate_allowed_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 24 16:42:38.311469 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63b937c4-8e24-4d72-86c9-d1602f52f00d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c90f21b9cdcb413282461fa83cb6b7a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3b3940d4ae1c4177ae29c02377bb4b0b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=71939) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 24 16:42:38.312122 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63b937c4-8e24-4d72-86c9-d1602f52f00d service neutron] REQUEST_METHOD: `GET` {{(pid=71939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 24 16:42:38.312462 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63b937c4-8e24-4d72-86c9-d1602f52f00d service neutron] SCRIPT_NAME: `/identity` {{(pid=71939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 24 16:42:38.312798 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63b937c4-8e24-4d72-86c9-d1602f52f00d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=71939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 24 16:42:38.322878 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63b937c4-8e24-4d72-86c9-d1602f52f00d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=71939) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:442}} Nov 24 16:42:38.351927 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63b937c4-8e24-4d72-86c9-d1602f52f00d service neutron] RBAC: Authorization granted {{(pid=71939) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 24 16:42:38.361628 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: [pid: 71939|app: 0|req: 815/1630] 10.222.0.53 () {60 vars in 1356 bytes} [Wed Nov 24 16:42:38 2021] GET /identity/v3/auth/tokens => generated 3669 bytes in 64 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 24 16:42:40.420626 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-642645c2-d6ba-445f-afc5-5e275b2f156f None None] REQUEST_METHOD: `GET` {{(pid=71938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 24 16:42:40.421182 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-642645c2-d6ba-445f-afc5-5e275b2f156f None None] SCRIPT_NAME: `/identity` {{(pid=71938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 24 16:42:40.421298 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-642645c2-d6ba-445f-afc5-5e275b2f156f None None] PATH_INFO: `/` {{(pid=71938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 24 16:42:40.423174 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: [pid: 71938|app: 0|req: 816/1631] 10.222.0.53 () {54 vars in 915 bytes} [Wed Nov 24 16:42:40 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 24 16:42:40.429008 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-303bda93-0da9-4632-8afc-a66ee78350ad None None] REQUEST_METHOD: `POST` {{(pid=71939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 24 16:42:40.429866 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-303bda93-0da9-4632-8afc-a66ee78350ad None None] SCRIPT_NAME: `/identity` {{(pid=71939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 24 16:42:40.430275 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-303bda93-0da9-4632-8afc-a66ee78350ad None None] PATH_INFO: `/v3/auth/tokens` {{(pid=71939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 24 16:42:40.454676 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.auth.core [None req-303bda93-0da9-4632-8afc-a66ee78350ad None None] MFA Rules not processed for user `0f2ba2e8375b4e8c8792ee1e22b60427`. Rule list: `[]` (Enabled: `True`). {{(pid=71939) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:442}} Nov 24 16:42:40.455889 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.fernet_utils [None req-303bda93-0da9-4632-8afc-a66ee78350ad None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=71939) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:289}} Nov 24 16:42:40.463519 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: [pid: 71939|app: 0|req: 816/1632] 10.222.0.53 () {58 vars in 1013 bytes} [Wed Nov 24 16:42:40 2021] POST /identity/v3/auth/tokens => generated 3669 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 24 16:42:40.496438 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-839d6d95-52c5-4bb7-ac7f-a6e4ce0b112c None None] REQUEST_METHOD: `POST` {{(pid=71938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 24 16:42:40.496715 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-839d6d95-52c5-4bb7-ac7f-a6e4ce0b112c None None] SCRIPT_NAME: `/identity` {{(pid=71938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 24 16:42:40.497057 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-839d6d95-52c5-4bb7-ac7f-a6e4ce0b112c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=71938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 24 16:42:40.520970 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.auth.core [None req-839d6d95-52c5-4bb7-ac7f-a6e4ce0b112c None None] MFA Rules not processed for user `0f2ba2e8375b4e8c8792ee1e22b60427`. Rule list: `[]` (Enabled: `True`). {{(pid=71938) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:442}} Nov 24 16:42:40.522206 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.fernet_utils [None req-839d6d95-52c5-4bb7-ac7f-a6e4ce0b112c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=71938) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:289}} Nov 24 16:42:40.530469 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: [pid: 71938|app: 0|req: 817/1633] 10.222.0.53 () {58 vars in 1013 bytes} [Wed Nov 24 16:42:40 2021] POST /identity/v3/auth/tokens => generated 3669 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 24 16:42:40.551709 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-303bda93-0da9-4632-8afc-a66ee78350ad None None] Authenticating user token {{(pid=71939) process_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 24 16:42:40.561771 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-303bda93-0da9-4632-8afc-a66ee78350ad None None] Validating token access rules against request {{(pid=71939) validate_allowed_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 24 16:42:40.565325 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13e14aa3-6683-414d-a490-8498aa9bd354 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c90f21b9cdcb413282461fa83cb6b7a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3b3940d4ae1c4177ae29c02377bb4b0b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=71939) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 24 16:42:40.565979 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13e14aa3-6683-414d-a490-8498aa9bd354 service neutron] REQUEST_METHOD: `GET` {{(pid=71939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 24 16:42:40.566382 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13e14aa3-6683-414d-a490-8498aa9bd354 service neutron] SCRIPT_NAME: `/identity` {{(pid=71939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 24 16:42:40.566714 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13e14aa3-6683-414d-a490-8498aa9bd354 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=71939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 24 16:42:40.576960 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13e14aa3-6683-414d-a490-8498aa9bd354 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=71939) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:442}} Nov 24 16:42:40.605151 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13e14aa3-6683-414d-a490-8498aa9bd354 service neutron] RBAC: Authorization granted {{(pid=71939) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 24 16:42:40.614987 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: [pid: 71939|app: 0|req: 817/1634] 10.222.0.53 () {60 vars in 1356 bytes} [Wed Nov 24 16:42:40 2021] GET /identity/v3/auth/tokens => generated 3669 bytes in 64 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 24 16:42:42.682088 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9fd07c4-dac4-4d16-ab5c-f44f7d416bee None None] REQUEST_METHOD: `GET` {{(pid=71938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 24 16:42:42.682688 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9fd07c4-dac4-4d16-ab5c-f44f7d416bee None None] SCRIPT_NAME: `/identity` {{(pid=71938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 24 16:42:42.682813 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9fd07c4-dac4-4d16-ab5c-f44f7d416bee None None] PATH_INFO: `/` {{(pid=71938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 24 16:42:42.684679 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: [pid: 71938|app: 0|req: 818/1635] 10.222.0.53 () {54 vars in 915 bytes} [Wed Nov 24 16:42:42 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 24 16:42:42.690273 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-582c26d5-1142-4f80-ab58-e182058c31a2 None None] REQUEST_METHOD: `POST` {{(pid=71939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 24 16:42:42.690620 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-582c26d5-1142-4f80-ab58-e182058c31a2 None None] SCRIPT_NAME: `/identity` {{(pid=71939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 24 16:42:42.690952 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-582c26d5-1142-4f80-ab58-e182058c31a2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=71939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 24 16:42:42.715160 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.auth.core [None req-582c26d5-1142-4f80-ab58-e182058c31a2 None None] MFA Rules not processed for user `0f2ba2e8375b4e8c8792ee1e22b60427`. Rule list: `[]` (Enabled: `True`). {{(pid=71939) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:442}} Nov 24 16:42:42.716363 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.fernet_utils [None req-582c26d5-1142-4f80-ab58-e182058c31a2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=71939) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:289}} Nov 24 16:42:42.723694 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: [pid: 71939|app: 0|req: 818/1636] 10.222.0.53 () {58 vars in 1013 bytes} [Wed Nov 24 16:42:42 2021] POST /identity/v3/auth/tokens => generated 3669 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 24 16:42:42.752078 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a67ada3b-877c-4bc2-8760-c2732ef6dc5e None None] REQUEST_METHOD: `POST` {{(pid=71938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 24 16:42:42.752432 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a67ada3b-877c-4bc2-8760-c2732ef6dc5e None None] SCRIPT_NAME: `/identity` {{(pid=71938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 24 16:42:42.752774 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a67ada3b-877c-4bc2-8760-c2732ef6dc5e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=71938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 24 16:42:42.776640 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.auth.core [None req-a67ada3b-877c-4bc2-8760-c2732ef6dc5e None None] MFA Rules not processed for user `0f2ba2e8375b4e8c8792ee1e22b60427`. Rule list: `[]` (Enabled: `True`). {{(pid=71938) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:442}} Nov 24 16:42:42.778247 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.fernet_utils [None req-a67ada3b-877c-4bc2-8760-c2732ef6dc5e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=71938) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:289}} Nov 24 16:42:42.785784 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: [pid: 71938|app: 0|req: 819/1637] 10.222.0.53 () {58 vars in 1013 bytes} [Wed Nov 24 16:42:42 2021] POST /identity/v3/auth/tokens => generated 3669 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 24 16:42:42.805892 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-582c26d5-1142-4f80-ab58-e182058c31a2 None None] Authenticating user token {{(pid=71939) process_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 24 16:42:42.815791 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-582c26d5-1142-4f80-ab58-e182058c31a2 None None] Validating token access rules against request {{(pid=71939) validate_allowed_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 24 16:42:42.819329 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75e319b6-42a3-4b3a-9e6e-fba66603c403 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c90f21b9cdcb413282461fa83cb6b7a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3b3940d4ae1c4177ae29c02377bb4b0b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=71939) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 24 16:42:42.820485 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75e319b6-42a3-4b3a-9e6e-fba66603c403 service neutron] REQUEST_METHOD: `GET` {{(pid=71939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 24 16:42:42.821076 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75e319b6-42a3-4b3a-9e6e-fba66603c403 service neutron] SCRIPT_NAME: `/identity` {{(pid=71939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 24 16:42:42.821409 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75e319b6-42a3-4b3a-9e6e-fba66603c403 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=71939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 24 16:42:42.830635 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75e319b6-42a3-4b3a-9e6e-fba66603c403 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=71939) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:442}} Nov 24 16:42:42.859014 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75e319b6-42a3-4b3a-9e6e-fba66603c403 service neutron] RBAC: Authorization granted {{(pid=71939) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 24 16:42:42.868815 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: [pid: 71939|app: 0|req: 819/1638] 10.222.0.53 () {60 vars in 1356 bytes} [Wed Nov 24 16:42:42 2021] GET /identity/v3/auth/tokens => generated 3669 bytes in 64 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 24 16:42:45.134223 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0eb8dcc7-6280-4cf8-b364-65e95423fffb None None] REQUEST_METHOD: `GET` {{(pid=71938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 24 16:42:45.134795 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0eb8dcc7-6280-4cf8-b364-65e95423fffb None None] SCRIPT_NAME: `/identity` {{(pid=71938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 24 16:42:45.134921 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0eb8dcc7-6280-4cf8-b364-65e95423fffb None None] PATH_INFO: `/` {{(pid=71938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 24 16:42:45.136874 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: [pid: 71938|app: 0|req: 820/1639] 10.222.0.53 () {54 vars in 915 bytes} [Wed Nov 24 16:42:45 2021] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 24 16:42:45.142853 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6cfa275-a476-449a-9019-50ac4fa325f1 None None] REQUEST_METHOD: `POST` {{(pid=71939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 24 16:42:45.143205 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6cfa275-a476-449a-9019-50ac4fa325f1 None None] SCRIPT_NAME: `/identity` {{(pid=71939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 24 16:42:45.143585 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6cfa275-a476-449a-9019-50ac4fa325f1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=71939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 24 16:42:45.169810 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.auth.core [None req-f6cfa275-a476-449a-9019-50ac4fa325f1 None None] MFA Rules not processed for user `0f2ba2e8375b4e8c8792ee1e22b60427`. Rule list: `[]` (Enabled: `True`). {{(pid=71939) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:442}} Nov 24 16:42:45.171158 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.fernet_utils [None req-f6cfa275-a476-449a-9019-50ac4fa325f1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=71939) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:289}} Nov 24 16:42:45.180291 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: [pid: 71939|app: 0|req: 820/1640] 10.222.0.53 () {58 vars in 1013 bytes} [Wed Nov 24 16:42:45 2021] POST /identity/v3/auth/tokens => generated 3669 bytes in 39 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 24 16:42:45.211283 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f5a6d45-b645-46ce-99f8-201ef9e10883 None None] REQUEST_METHOD: `POST` {{(pid=71938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 24 16:42:45.211602 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f5a6d45-b645-46ce-99f8-201ef9e10883 None None] SCRIPT_NAME: `/identity` {{(pid=71938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 24 16:42:45.211935 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f5a6d45-b645-46ce-99f8-201ef9e10883 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=71938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 24 16:42:45.241822 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.auth.core [None req-7f5a6d45-b645-46ce-99f8-201ef9e10883 None None] MFA Rules not processed for user `0f2ba2e8375b4e8c8792ee1e22b60427`. Rule list: `[]` (Enabled: `True`). {{(pid=71938) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:442}} Nov 24 16:42:45.243089 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.fernet_utils [None req-7f5a6d45-b645-46ce-99f8-201ef9e10883 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=71938) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:289}} Nov 24 16:42:45.254947 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: [pid: 71938|app: 0|req: 821/1641] 10.222.0.53 () {58 vars in 1013 bytes} [Wed Nov 24 16:42:45 2021] POST /identity/v3/auth/tokens => generated 3669 bytes in 45 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 24 16:42:45.276904 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6cfa275-a476-449a-9019-50ac4fa325f1 None None] Authenticating user token {{(pid=71939) process_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 24 16:42:45.287318 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6cfa275-a476-449a-9019-50ac4fa325f1 None None] Validating token access rules against request {{(pid=71939) validate_allowed_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 24 16:42:45.291252 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eade510e-75cd-4a46-8c2e-18a528cec5af service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c90f21b9cdcb413282461fa83cb6b7a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3b3940d4ae1c4177ae29c02377bb4b0b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=71939) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 24 16:42:45.291921 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eade510e-75cd-4a46-8c2e-18a528cec5af service neutron] REQUEST_METHOD: `GET` {{(pid=71939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 24 16:42:45.292260 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eade510e-75cd-4a46-8c2e-18a528cec5af service neutron] SCRIPT_NAME: `/identity` {{(pid=71939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 24 16:42:45.292599 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eade510e-75cd-4a46-8c2e-18a528cec5af service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=71939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 24 16:42:45.302712 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eade510e-75cd-4a46-8c2e-18a528cec5af service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=71939) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:442}} Nov 24 16:42:45.332182 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eade510e-75cd-4a46-8c2e-18a528cec5af service neutron] RBAC: Authorization granted {{(pid=71939) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 24 16:42:45.344979 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: [pid: 71939|app: 0|req: 821/1642] 10.222.0.53 () {60 vars in 1356 bytes} [Wed Nov 24 16:42:45 2021] GET /identity/v3/auth/tokens => generated 3669 bytes in 69 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 24 16:42:59.179194 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95e3af7e-f34f-49a1-aefb-75427d86083c None None] REQUEST_METHOD: `GET` {{(pid=71938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 24 16:42:59.179737 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95e3af7e-f34f-49a1-aefb-75427d86083c None None] SCRIPT_NAME: `/identity` {{(pid=71938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 24 16:42:59.179922 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95e3af7e-f34f-49a1-aefb-75427d86083c None None] PATH_INFO: `/` {{(pid=71938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 24 16:42:59.181876 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: [pid: 71938|app: 0|req: 822/1643] 10.222.0.53 () {54 vars in 915 bytes} [Wed Nov 24 16:42:59 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 24 16:42:59.188214 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0daf5db6-8838-4c48-b2a3-cd625c94ebc4 None None] REQUEST_METHOD: `POST` {{(pid=71939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 24 16:42:59.188641 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0daf5db6-8838-4c48-b2a3-cd625c94ebc4 None None] SCRIPT_NAME: `/identity` {{(pid=71939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 24 16:42:59.189050 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0daf5db6-8838-4c48-b2a3-cd625c94ebc4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=71939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 24 16:42:59.213941 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.auth.core [None req-0daf5db6-8838-4c48-b2a3-cd625c94ebc4 None None] MFA Rules not processed for user `0f2ba2e8375b4e8c8792ee1e22b60427`. Rule list: `[]` (Enabled: `True`). {{(pid=71939) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:442}} Nov 24 16:42:59.215186 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.fernet_utils [None req-0daf5db6-8838-4c48-b2a3-cd625c94ebc4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=71939) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:289}} Nov 24 16:42:59.223420 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: [pid: 71939|app: 0|req: 822/1644] 10.222.0.53 () {58 vars in 1013 bytes} [Wed Nov 24 16:42:59 2021] POST /identity/v3/auth/tokens => generated 3669 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 24 16:42:59.249657 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d21defa-48be-47a9-a64f-cd0e0c3c861d None None] REQUEST_METHOD: `POST` {{(pid=71938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 24 16:42:59.250014 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d21defa-48be-47a9-a64f-cd0e0c3c861d None None] SCRIPT_NAME: `/identity` {{(pid=71938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 24 16:42:59.250402 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d21defa-48be-47a9-a64f-cd0e0c3c861d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=71938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 24 16:42:59.274367 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.auth.core [None req-7d21defa-48be-47a9-a64f-cd0e0c3c861d None None] MFA Rules not processed for user `0f2ba2e8375b4e8c8792ee1e22b60427`. Rule list: `[]` (Enabled: `True`). {{(pid=71938) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:442}} Nov 24 16:42:59.275598 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.fernet_utils [None req-7d21defa-48be-47a9-a64f-cd0e0c3c861d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=71938) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:289}} Nov 24 16:42:59.283807 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: [pid: 71938|app: 0|req: 823/1645] 10.222.0.53 () {58 vars in 1013 bytes} [Wed Nov 24 16:42:59 2021] POST /identity/v3/auth/tokens => generated 3669 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 24 16:42:59.312210 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0daf5db6-8838-4c48-b2a3-cd625c94ebc4 None None] Authenticating user token {{(pid=71939) process_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 24 16:42:59.313634 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.fernet_utils [None req-0daf5db6-8838-4c48-b2a3-cd625c94ebc4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=71939) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:289}} Nov 24 16:42:59.411440 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0daf5db6-8838-4c48-b2a3-cd625c94ebc4 None None] Validating token access rules against request {{(pid=71939) validate_allowed_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 24 16:42:59.415114 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2553a98b-f289-4450-9394-840385485a62 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'af9e91f8d56c491d99fab4346754ce2e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3b3940d4ae1c4177ae29c02377bb4b0b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=71939) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 24 16:42:59.415769 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2553a98b-f289-4450-9394-840385485a62 service glance] REQUEST_METHOD: `GET` {{(pid=71939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 24 16:42:59.416105 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2553a98b-f289-4450-9394-840385485a62 service glance] SCRIPT_NAME: `/identity` {{(pid=71939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 24 16:42:59.416433 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2553a98b-f289-4450-9394-840385485a62 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=71939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 24 16:42:59.425855 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2553a98b-f289-4450-9394-840385485a62 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=71939) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:442}} Nov 24 16:42:59.454563 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2553a98b-f289-4450-9394-840385485a62 service glance] RBAC: Authorization granted {{(pid=71939) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 24 16:42:59.467524 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: [pid: 71939|app: 0|req: 823/1646] 10.222.0.53 () {60 vars in 1356 bytes} [Wed Nov 24 16:42:59 2021] GET /identity/v3/auth/tokens => generated 3669 bytes in 156 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 24 16:43:01.609285 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f71e56d-15f7-4925-bd8b-bfcff5337950 None None] REQUEST_METHOD: `GET` {{(pid=71938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 24 16:43:01.609814 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f71e56d-15f7-4925-bd8b-bfcff5337950 None None] SCRIPT_NAME: `/identity` {{(pid=71938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 24 16:43:01.609814 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f71e56d-15f7-4925-bd8b-bfcff5337950 None None] PATH_INFO: `/` {{(pid=71938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 24 16:43:01.611679 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: [pid: 71938|app: 0|req: 824/1647] 10.222.0.53 () {54 vars in 915 bytes} [Wed Nov 24 16:43:01 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 24 16:43:01.617782 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d757504c-5fea-4767-8226-974420b9c979 None None] REQUEST_METHOD: `POST` {{(pid=71939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 24 16:43:01.618190 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d757504c-5fea-4767-8226-974420b9c979 None None] SCRIPT_NAME: `/identity` {{(pid=71939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 24 16:43:01.618557 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d757504c-5fea-4767-8226-974420b9c979 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=71939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 24 16:43:01.654961 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.auth.core [None req-d757504c-5fea-4767-8226-974420b9c979 None None] MFA Rules not processed for user `0f2ba2e8375b4e8c8792ee1e22b60427`. Rule list: `[]` (Enabled: `True`). {{(pid=71939) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:442}} Nov 24 16:43:01.656244 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.fernet_utils [None req-d757504c-5fea-4767-8226-974420b9c979 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=71939) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:289}} Nov 24 16:43:01.664011 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: [pid: 71939|app: 0|req: 824/1648] 10.222.0.53 () {58 vars in 1013 bytes} [Wed Nov 24 16:43:01 2021] POST /identity/v3/auth/tokens => generated 3669 bytes in 47 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 24 16:43:01.689984 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dafa873-0e92-44b3-ac82-214d61e6d64b None None] REQUEST_METHOD: `POST` {{(pid=71938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 24 16:43:01.690527 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dafa873-0e92-44b3-ac82-214d61e6d64b None None] SCRIPT_NAME: `/identity` {{(pid=71938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 24 16:43:01.691309 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dafa873-0e92-44b3-ac82-214d61e6d64b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=71938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 24 16:43:01.718144 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.auth.core [None req-2dafa873-0e92-44b3-ac82-214d61e6d64b None None] MFA Rules not processed for user `0f2ba2e8375b4e8c8792ee1e22b60427`. Rule list: `[]` (Enabled: `True`). {{(pid=71938) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:442}} Nov 24 16:43:01.719367 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.fernet_utils [None req-2dafa873-0e92-44b3-ac82-214d61e6d64b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=71938) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:289}} Nov 24 16:43:01.727699 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: [pid: 71938|app: 0|req: 825/1649] 10.222.0.53 () {58 vars in 1013 bytes} [Wed Nov 24 16:43:01 2021] POST /identity/v3/auth/tokens => generated 3669 bytes in 40 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 24 16:43:01.734410 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d757504c-5fea-4767-8226-974420b9c979 None None] Authenticating user token {{(pid=71939) process_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 24 16:43:01.744353 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d757504c-5fea-4767-8226-974420b9c979 None None] Validating token access rules against request {{(pid=71939) validate_allowed_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 24 16:43:01.748967 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed0060fb-baab-4a08-be0d-8ed33cbbd4b9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f2ba2e8375b4e8c8792ee1e22b60427', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '00a5583c7b7443e98e7a1d31a0b638dc', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=71939) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 24 16:43:01.749619 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed0060fb-baab-4a08-be0d-8ed33cbbd4b9 admin admin] REQUEST_METHOD: `GET` {{(pid=71939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 24 16:43:01.749955 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed0060fb-baab-4a08-be0d-8ed33cbbd4b9 admin admin] SCRIPT_NAME: `/identity` {{(pid=71939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 24 16:43:01.750411 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed0060fb-baab-4a08-be0d-8ed33cbbd4b9 admin admin] PATH_INFO: `/v3/projects` {{(pid=71939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 24 16:43:01.751481 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed0060fb-baab-4a08-be0d-8ed33cbbd4b9 admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=71939) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:442}} Nov 24 16:43:01.787411 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed0060fb-baab-4a08-be0d-8ed33cbbd4b9 admin admin] RBAC: Authorization granted {{(pid=71939) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 24 16:43:01.805690 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: [pid: 71939|app: 0|req: 825/1650] 10.222.0.53 () {56 vars in 1099 bytes} [Wed Nov 24 16:43:01 2021] GET /identity/v3/projects => generated 2553 bytes in 72 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 24 16:43:03.438864 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbf6e238-c315-4268-8665-f7361aa1dcbf None None] REQUEST_METHOD: `GET` {{(pid=71938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 24 16:43:03.439427 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbf6e238-c315-4268-8665-f7361aa1dcbf None None] SCRIPT_NAME: `/identity` {{(pid=71938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 24 16:43:03.439542 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbf6e238-c315-4268-8665-f7361aa1dcbf None None] PATH_INFO: `/` {{(pid=71938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 24 16:43:03.441448 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: [pid: 71938|app: 0|req: 826/1651] 10.222.0.53 () {54 vars in 900 bytes} [Wed Nov 24 16:43:03 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 24 16:43:03.447303 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6c37bde-9a34-4b5a-928c-8ca498c2fab8 None None] REQUEST_METHOD: `POST` {{(pid=71939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 24 16:43:03.447654 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6c37bde-9a34-4b5a-928c-8ca498c2fab8 None None] SCRIPT_NAME: `/identity` {{(pid=71939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 24 16:43:03.447993 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6c37bde-9a34-4b5a-928c-8ca498c2fab8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=71939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 24 16:43:03.471626 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.auth.core [None req-f6c37bde-9a34-4b5a-928c-8ca498c2fab8 None None] MFA Rules not processed for user `0f2ba2e8375b4e8c8792ee1e22b60427`. Rule list: `[]` (Enabled: `True`). {{(pid=71939) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:442}} Nov 24 16:43:03.472849 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.fernet_utils [None req-f6c37bde-9a34-4b5a-928c-8ca498c2fab8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=71939) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:289}} Nov 24 16:43:03.481086 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: [pid: 71939|app: 0|req: 826/1652] 10.222.0.53 () {58 vars in 998 bytes} [Wed Nov 24 16:43:03 2021] POST /identity/v3/auth/tokens => generated 3669 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 24 16:43:03.621432 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbf6e238-c315-4268-8665-f7361aa1dcbf None None] Authenticating user token {{(pid=71938) process_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 24 16:43:03.636243 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbf6e238-c315-4268-8665-f7361aa1dcbf None None] Validating token access rules against request {{(pid=71938) validate_allowed_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 24 16:43:03.641690 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a91f3c7-6dcb-4173-af24-f029bd970877 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e196802d4d5432482b6d2eabc25f74e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3b3940d4ae1c4177ae29c02377bb4b0b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'service', 'ResellerAdmin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=71938) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 24 16:43:03.642391 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a91f3c7-6dcb-4173-af24-f029bd970877 service nova] REQUEST_METHOD: `GET` {{(pid=71938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 24 16:43:03.642736 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a91f3c7-6dcb-4173-af24-f029bd970877 service nova] SCRIPT_NAME: `/identity` {{(pid=71938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 24 16:43:03.643074 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a91f3c7-6dcb-4173-af24-f029bd970877 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=71938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 24 16:43:03.652879 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a91f3c7-6dcb-4173-af24-f029bd970877 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=71938) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:442}} Nov 24 16:43:03.682936 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a91f3c7-6dcb-4173-af24-f029bd970877 service nova] RBAC: Authorization granted {{(pid=71938) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 24 16:43:03.693525 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: [pid: 71938|app: 0|req: 827/1653] 10.222.0.53 () {60 vars in 1356 bytes} [Wed Nov 24 16:43:03 2021] GET /identity/v3/auth/tokens => generated 3669 bytes in 73 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 24 16:43:05.766428 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10439f1c-4d69-41d1-893d-345d0f0d3166 None None] REQUEST_METHOD: `GET` {{(pid=71939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 24 16:43:05.766994 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10439f1c-4d69-41d1-893d-345d0f0d3166 None None] SCRIPT_NAME: `/identity` {{(pid=71939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 24 16:43:05.767129 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10439f1c-4d69-41d1-893d-345d0f0d3166 None None] PATH_INFO: `/` {{(pid=71939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 24 16:43:05.768913 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: [pid: 71939|app: 0|req: 827/1654] 10.222.0.53 () {54 vars in 915 bytes} [Wed Nov 24 16:43:05 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 24 16:43:05.774725 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75e8a7ba-29ce-4bd0-9b2e-11307b5cdd69 None None] REQUEST_METHOD: `POST` {{(pid=71938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 24 16:43:05.775073 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75e8a7ba-29ce-4bd0-9b2e-11307b5cdd69 None None] SCRIPT_NAME: `/identity` {{(pid=71938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 24 16:43:05.775409 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75e8a7ba-29ce-4bd0-9b2e-11307b5cdd69 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=71938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 24 16:43:05.801687 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.auth.core [None req-75e8a7ba-29ce-4bd0-9b2e-11307b5cdd69 None None] MFA Rules not processed for user `0f2ba2e8375b4e8c8792ee1e22b60427`. Rule list: `[]` (Enabled: `True`). {{(pid=71938) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:442}} Nov 24 16:43:05.802970 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.fernet_utils [None req-75e8a7ba-29ce-4bd0-9b2e-11307b5cdd69 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=71938) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:289}} Nov 24 16:43:05.811143 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: [pid: 71938|app: 0|req: 828/1655] 10.222.0.53 () {58 vars in 1013 bytes} [Wed Nov 24 16:43:05 2021] POST /identity/v3/auth/tokens => generated 3669 bytes in 37 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 24 16:43:05.836657 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0d2dcd7-96ce-4ecc-86f6-bfec0db08eb9 None None] REQUEST_METHOD: `POST` {{(pid=71939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 24 16:43:05.837000 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0d2dcd7-96ce-4ecc-86f6-bfec0db08eb9 None None] SCRIPT_NAME: `/identity` {{(pid=71939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 24 16:43:05.837336 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0d2dcd7-96ce-4ecc-86f6-bfec0db08eb9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=71939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 24 16:43:05.860598 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.auth.core [None req-e0d2dcd7-96ce-4ecc-86f6-bfec0db08eb9 None None] MFA Rules not processed for user `0f2ba2e8375b4e8c8792ee1e22b60427`. Rule list: `[]` (Enabled: `True`). {{(pid=71939) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:442}} Nov 24 16:43:05.861811 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.fernet_utils [None req-e0d2dcd7-96ce-4ecc-86f6-bfec0db08eb9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=71939) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:289}} Nov 24 16:43:05.869974 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: [pid: 71939|app: 0|req: 828/1656] 10.222.0.53 () {58 vars in 1013 bytes} [Wed Nov 24 16:43:05 2021] POST /identity/v3/auth/tokens => generated 3669 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Nov 24 16:43:05.890004 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75e8a7ba-29ce-4bd0-9b2e-11307b5cdd69 None None] Authenticating user token {{(pid=71938) process_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 24 16:43:05.899973 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75e8a7ba-29ce-4bd0-9b2e-11307b5cdd69 None None] Validating token access rules against request {{(pid=71938) validate_allowed_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 24 16:43:05.903564 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3d2af03-8aa9-43cf-8b28-ac37b3ab4993 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c90f21b9cdcb413282461fa83cb6b7a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3b3940d4ae1c4177ae29c02377bb4b0b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=71938) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 24 16:43:05.904208 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3d2af03-8aa9-43cf-8b28-ac37b3ab4993 service neutron] REQUEST_METHOD: `GET` {{(pid=71938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 24 16:43:05.904542 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3d2af03-8aa9-43cf-8b28-ac37b3ab4993 service neutron] SCRIPT_NAME: `/identity` {{(pid=71938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 24 16:43:05.904871 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3d2af03-8aa9-43cf-8b28-ac37b3ab4993 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=71938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 24 16:43:05.914236 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3d2af03-8aa9-43cf-8b28-ac37b3ab4993 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=71938) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:442}} Nov 24 16:43:05.942571 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3d2af03-8aa9-43cf-8b28-ac37b3ab4993 service neutron] RBAC: Authorization granted {{(pid=71938) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 24 16:43:05.953697 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: [pid: 71938|app: 0|req: 829/1657] 10.222.0.53 () {60 vars in 1356 bytes} [Wed Nov 24 16:43:05 2021] GET /identity/v3/auth/tokens => generated 3669 bytes in 64 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 24 16:43:08.195820 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf70cfbc-c13c-4565-90dd-3365a1d8c849 None None] REQUEST_METHOD: `GET` {{(pid=71939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 24 16:43:08.196400 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf70cfbc-c13c-4565-90dd-3365a1d8c849 None None] SCRIPT_NAME: `/identity` {{(pid=71939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 24 16:43:08.196547 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf70cfbc-c13c-4565-90dd-3365a1d8c849 None None] PATH_INFO: `/` {{(pid=71939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 24 16:43:08.198386 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: [pid: 71939|app: 0|req: 829/1658] 10.222.0.53 () {54 vars in 915 bytes} [Wed Nov 24 16:43:08 2021] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 24 16:43:08.204943 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8916bd35-8857-47ec-ae57-74350ba56620 None None] REQUEST_METHOD: `POST` {{(pid=71938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 24 16:43:08.205296 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8916bd35-8857-47ec-ae57-74350ba56620 None None] SCRIPT_NAME: `/identity` {{(pid=71938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 24 16:43:08.205634 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8916bd35-8857-47ec-ae57-74350ba56620 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=71938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 24 16:43:08.229554 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.auth.core [None req-8916bd35-8857-47ec-ae57-74350ba56620 None None] MFA Rules not processed for user `0f2ba2e8375b4e8c8792ee1e22b60427`. Rule list: `[]` (Enabled: `True`). {{(pid=71938) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:442}} Nov 24 16:43:08.230816 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.fernet_utils [None req-8916bd35-8857-47ec-ae57-74350ba56620 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=71938) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:289}} Nov 24 16:43:08.238396 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: [pid: 71938|app: 0|req: 830/1659] 10.222.0.53 () {58 vars in 1013 bytes} [Wed Nov 24 16:43:08 2021] POST /identity/v3/auth/tokens => generated 3669 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 24 16:43:08.266758 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47fe9ea2-50a8-4164-ad8e-6d05b1f1ba1d None None] REQUEST_METHOD: `POST` {{(pid=71939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 24 16:43:08.267102 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47fe9ea2-50a8-4164-ad8e-6d05b1f1ba1d None None] SCRIPT_NAME: `/identity` {{(pid=71939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 24 16:43:08.267488 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47fe9ea2-50a8-4164-ad8e-6d05b1f1ba1d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=71939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 24 16:43:08.291335 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.auth.core [None req-47fe9ea2-50a8-4164-ad8e-6d05b1f1ba1d None None] MFA Rules not processed for user `0f2ba2e8375b4e8c8792ee1e22b60427`. Rule list: `[]` (Enabled: `True`). {{(pid=71939) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:442}} Nov 24 16:43:08.292579 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.fernet_utils [None req-47fe9ea2-50a8-4164-ad8e-6d05b1f1ba1d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=71939) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:289}} Nov 24 16:43:08.300905 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: [pid: 71939|app: 0|req: 830/1660] 10.222.0.53 () {58 vars in 1013 bytes} [Wed Nov 24 16:43:08 2021] POST /identity/v3/auth/tokens => generated 3669 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 24 16:43:08.322649 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8916bd35-8857-47ec-ae57-74350ba56620 None None] Authenticating user token {{(pid=71938) process_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 24 16:43:08.334950 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8916bd35-8857-47ec-ae57-74350ba56620 None None] Validating token access rules against request {{(pid=71938) validate_allowed_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 24 16:43:08.338979 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f45e45cb-c41d-43f1-9a5b-df68caca1872 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c90f21b9cdcb413282461fa83cb6b7a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3b3940d4ae1c4177ae29c02377bb4b0b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=71938) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 24 16:43:08.339648 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f45e45cb-c41d-43f1-9a5b-df68caca1872 service neutron] REQUEST_METHOD: `GET` {{(pid=71938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 24 16:43:08.340159 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f45e45cb-c41d-43f1-9a5b-df68caca1872 service neutron] SCRIPT_NAME: `/identity` {{(pid=71938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 24 16:43:08.340587 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f45e45cb-c41d-43f1-9a5b-df68caca1872 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=71938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 24 16:43:08.351155 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f45e45cb-c41d-43f1-9a5b-df68caca1872 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=71938) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:442}} Nov 24 16:43:08.381830 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f45e45cb-c41d-43f1-9a5b-df68caca1872 service neutron] RBAC: Authorization granted {{(pid=71938) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 24 16:43:08.392780 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: [pid: 71938|app: 0|req: 831/1661] 10.222.0.53 () {60 vars in 1356 bytes} [Wed Nov 24 16:43:08 2021] GET /identity/v3/auth/tokens => generated 3669 bytes in 71 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 24 16:43:10.581301 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e59d1ba9-6d55-4eaf-aef6-3d2c9f822f73 None None] REQUEST_METHOD: `GET` {{(pid=71939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 24 16:43:10.581825 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e59d1ba9-6d55-4eaf-aef6-3d2c9f822f73 None None] SCRIPT_NAME: `/identity` {{(pid=71939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 24 16:43:10.581950 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e59d1ba9-6d55-4eaf-aef6-3d2c9f822f73 None None] PATH_INFO: `/` {{(pid=71939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 24 16:43:10.583792 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: [pid: 71939|app: 0|req: 831/1662] 10.222.0.53 () {54 vars in 915 bytes} [Wed Nov 24 16:43:10 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 24 16:43:10.589582 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31a06e04-f7f9-4188-a149-9020bf1a8471 None None] REQUEST_METHOD: `POST` {{(pid=71938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 24 16:43:10.589933 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31a06e04-f7f9-4188-a149-9020bf1a8471 None None] SCRIPT_NAME: `/identity` {{(pid=71938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 24 16:43:10.590315 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31a06e04-f7f9-4188-a149-9020bf1a8471 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=71938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 24 16:43:10.614406 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.auth.core [None req-31a06e04-f7f9-4188-a149-9020bf1a8471 None None] MFA Rules not processed for user `0f2ba2e8375b4e8c8792ee1e22b60427`. Rule list: `[]` (Enabled: `True`). {{(pid=71938) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:442}} Nov 24 16:43:10.615614 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.fernet_utils [None req-31a06e04-f7f9-4188-a149-9020bf1a8471 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=71938) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:289}} Nov 24 16:43:10.626160 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: [pid: 71938|app: 0|req: 832/1663] 10.222.0.53 () {58 vars in 1013 bytes} [Wed Nov 24 16:43:10 2021] POST /identity/v3/auth/tokens => generated 3669 bytes in 38 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 24 16:43:10.653996 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a9b09b5-3202-4b54-98e4-289c3fa60b9d None None] REQUEST_METHOD: `POST` {{(pid=71939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 24 16:43:10.654422 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a9b09b5-3202-4b54-98e4-289c3fa60b9d None None] SCRIPT_NAME: `/identity` {{(pid=71939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 24 16:43:10.654758 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a9b09b5-3202-4b54-98e4-289c3fa60b9d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=71939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 24 16:43:10.678223 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.auth.core [None req-2a9b09b5-3202-4b54-98e4-289c3fa60b9d None None] MFA Rules not processed for user `0f2ba2e8375b4e8c8792ee1e22b60427`. Rule list: `[]` (Enabled: `True`). {{(pid=71939) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:442}} Nov 24 16:43:10.680072 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.fernet_utils [None req-2a9b09b5-3202-4b54-98e4-289c3fa60b9d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=71939) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:289}} Nov 24 16:43:10.687596 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: [pid: 71939|app: 0|req: 832/1664] 10.222.0.53 () {58 vars in 1013 bytes} [Wed Nov 24 16:43:10 2021] POST /identity/v3/auth/tokens => generated 3669 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 24 16:43:10.707917 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31a06e04-f7f9-4188-a149-9020bf1a8471 None None] Authenticating user token {{(pid=71938) process_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 24 16:43:10.718448 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31a06e04-f7f9-4188-a149-9020bf1a8471 None None] Validating token access rules against request {{(pid=71938) validate_allowed_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 24 16:43:10.722136 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b52e3b3-ac34-45a6-b152-c80254c92055 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c90f21b9cdcb413282461fa83cb6b7a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3b3940d4ae1c4177ae29c02377bb4b0b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=71938) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 24 16:43:10.722792 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b52e3b3-ac34-45a6-b152-c80254c92055 service neutron] REQUEST_METHOD: `GET` {{(pid=71938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 24 16:43:10.723136 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b52e3b3-ac34-45a6-b152-c80254c92055 service neutron] SCRIPT_NAME: `/identity` {{(pid=71938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 24 16:43:10.723473 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b52e3b3-ac34-45a6-b152-c80254c92055 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=71938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 24 16:43:10.733513 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b52e3b3-ac34-45a6-b152-c80254c92055 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=71938) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:442}} Nov 24 16:43:10.767939 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b52e3b3-ac34-45a6-b152-c80254c92055 service neutron] RBAC: Authorization granted {{(pid=71938) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 24 16:43:10.778691 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: [pid: 71938|app: 0|req: 833/1665] 10.222.0.53 () {60 vars in 1356 bytes} [Wed Nov 24 16:43:10 2021] GET /identity/v3/auth/tokens => generated 3669 bytes in 71 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 24 16:43:13.094641 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3df30639-e8ad-4ec4-b885-9e9c8f5f1b28 None None] REQUEST_METHOD: `GET` {{(pid=71939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 24 16:43:13.095381 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3df30639-e8ad-4ec4-b885-9e9c8f5f1b28 None None] SCRIPT_NAME: `/identity` {{(pid=71939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 24 16:43:13.095381 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3df30639-e8ad-4ec4-b885-9e9c8f5f1b28 None None] PATH_INFO: `/` {{(pid=71939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 24 16:43:13.097115 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: [pid: 71939|app: 0|req: 833/1666] 10.222.0.53 () {54 vars in 915 bytes} [Wed Nov 24 16:43:13 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 24 16:43:13.103647 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1686610e-bf1d-4fc1-a845-21927404c720 None None] REQUEST_METHOD: `POST` {{(pid=71938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 24 16:43:13.103995 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1686610e-bf1d-4fc1-a845-21927404c720 None None] SCRIPT_NAME: `/identity` {{(pid=71938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 24 16:43:13.104408 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1686610e-bf1d-4fc1-a845-21927404c720 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=71938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 24 16:43:13.128673 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.auth.core [None req-1686610e-bf1d-4fc1-a845-21927404c720 None None] MFA Rules not processed for user `0f2ba2e8375b4e8c8792ee1e22b60427`. Rule list: `[]` (Enabled: `True`). {{(pid=71938) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:442}} Nov 24 16:43:13.129894 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.fernet_utils [None req-1686610e-bf1d-4fc1-a845-21927404c720 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=71938) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:289}} Nov 24 16:43:13.137377 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: [pid: 71938|app: 0|req: 834/1667] 10.222.0.53 () {58 vars in 1013 bytes} [Wed Nov 24 16:43:13 2021] POST /identity/v3/auth/tokens => generated 3669 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 24 16:43:13.172438 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3993ac1-7982-401d-b00b-08440fad97ad None None] REQUEST_METHOD: `POST` {{(pid=71939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 24 16:43:13.172781 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3993ac1-7982-401d-b00b-08440fad97ad None None] SCRIPT_NAME: `/identity` {{(pid=71939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 24 16:43:13.173118 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3993ac1-7982-401d-b00b-08440fad97ad None None] PATH_INFO: `/v3/auth/tokens` {{(pid=71939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 24 16:43:13.196937 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.auth.core [None req-d3993ac1-7982-401d-b00b-08440fad97ad None None] MFA Rules not processed for user `0f2ba2e8375b4e8c8792ee1e22b60427`. Rule list: `[]` (Enabled: `True`). {{(pid=71939) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:442}} Nov 24 16:43:13.198204 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.fernet_utils [None req-d3993ac1-7982-401d-b00b-08440fad97ad None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=71939) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:289}} Nov 24 16:43:13.205663 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: [pid: 71939|app: 0|req: 834/1668] 10.222.0.53 () {58 vars in 1013 bytes} [Wed Nov 24 16:43:13 2021] POST /identity/v3/auth/tokens => generated 3669 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 24 16:43:13.227763 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1686610e-bf1d-4fc1-a845-21927404c720 None None] Authenticating user token {{(pid=71938) process_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 24 16:43:13.237760 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1686610e-bf1d-4fc1-a845-21927404c720 None None] Validating token access rules against request {{(pid=71938) validate_allowed_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 24 16:43:13.241506 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2822f61e-46bf-4d2a-989e-d3f1f47dd760 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c90f21b9cdcb413282461fa83cb6b7a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3b3940d4ae1c4177ae29c02377bb4b0b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=71938) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 24 16:43:13.242201 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2822f61e-46bf-4d2a-989e-d3f1f47dd760 service neutron] REQUEST_METHOD: `GET` {{(pid=71938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 24 16:43:13.242557 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2822f61e-46bf-4d2a-989e-d3f1f47dd760 service neutron] SCRIPT_NAME: `/identity` {{(pid=71938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 24 16:43:13.242889 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2822f61e-46bf-4d2a-989e-d3f1f47dd760 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=71938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 24 16:43:13.252823 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2822f61e-46bf-4d2a-989e-d3f1f47dd760 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=71938) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:442}} Nov 24 16:43:13.281349 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2822f61e-46bf-4d2a-989e-d3f1f47dd760 service neutron] RBAC: Authorization granted {{(pid=71938) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 24 16:43:13.292326 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: [pid: 71938|app: 0|req: 835/1669] 10.222.0.53 () {60 vars in 1356 bytes} [Wed Nov 24 16:43:13 2021] GET /identity/v3/auth/tokens => generated 3669 bytes in 65 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 24 16:44:31.044953 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9def0ae5-8c15-4c19-8c87-80384851a0ac None None] REQUEST_METHOD: `POST` {{(pid=71939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 24 16:44:31.045530 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9def0ae5-8c15-4c19-8c87-80384851a0ac None None] SCRIPT_NAME: `/identity` {{(pid=71939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 24 16:44:31.045662 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9def0ae5-8c15-4c19-8c87-80384851a0ac None None] PATH_INFO: `/v3/auth/tokens` {{(pid=71939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 24 16:44:31.069886 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.auth.core [None req-9def0ae5-8c15-4c19-8c87-80384851a0ac None None] MFA Rules not processed for user `0f2ba2e8375b4e8c8792ee1e22b60427`. Rule list: `[]` (Enabled: `True`). {{(pid=71939) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:442}} Nov 24 16:44:31.071151 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.fernet_utils [None req-9def0ae5-8c15-4c19-8c87-80384851a0ac None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=71939) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:289}} Nov 24 16:44:31.078997 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: [pid: 71939|app: 0|req: 835/1670] 10.222.0.53 () {58 vars in 948 bytes} [Wed Nov 24 16:44:31 2021] POST /identity/v3/auth/tokens => generated 3669 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 24 16:44:31.087902 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2396480a-4e9b-4fa0-9a03-e53cdc8e490e None None] REQUEST_METHOD: `POST` {{(pid=71938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 24 16:44:31.088253 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2396480a-4e9b-4fa0-9a03-e53cdc8e490e None None] SCRIPT_NAME: `/identity` {{(pid=71938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 24 16:44:31.088638 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2396480a-4e9b-4fa0-9a03-e53cdc8e490e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=71938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 24 16:44:31.114813 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.auth.core [None req-2396480a-4e9b-4fa0-9a03-e53cdc8e490e None None] MFA Rules not processed for user `0f2ba2e8375b4e8c8792ee1e22b60427`. Rule list: `[]` (Enabled: `True`). {{(pid=71938) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:442}} Nov 24 16:44:31.116120 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.fernet_utils [None req-2396480a-4e9b-4fa0-9a03-e53cdc8e490e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=71938) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:289}} Nov 24 16:44:31.123851 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: [pid: 71938|app: 0|req: 836/1671] 10.222.0.53 () {58 vars in 948 bytes} [Wed Nov 24 16:44:31 2021] POST /identity/v3/auth/tokens => generated 3669 bytes in 37 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 24 16:44:31.128830 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9def0ae5-8c15-4c19-8c87-80384851a0ac None None] Authenticating user token {{(pid=71939) process_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 24 16:44:31.138650 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9def0ae5-8c15-4c19-8c87-80384851a0ac None None] Validating token access rules against request {{(pid=71939) validate_allowed_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 24 16:44:31.143145 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8724ab5-3025-4ec5-9697-d16c5bc417ac admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f2ba2e8375b4e8c8792ee1e22b60427', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '00a5583c7b7443e98e7a1d31a0b638dc', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=71939) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 24 16:44:31.143803 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8724ab5-3025-4ec5-9697-d16c5bc417ac admin admin] REQUEST_METHOD: `GET` {{(pid=71939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 24 16:44:31.144139 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8724ab5-3025-4ec5-9697-d16c5bc417ac admin admin] SCRIPT_NAME: `/identity` {{(pid=71939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 24 16:44:31.144471 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8724ab5-3025-4ec5-9697-d16c5bc417ac admin admin] PATH_INFO: `/v3/domains` {{(pid=71939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 24 16:44:31.145782 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8724ab5-3025-4ec5-9697-d16c5bc417ac admin admin] RBAC: Adding query filter params (name=Default) {{(pid=71939) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:161}} Nov 24 16:44:31.146278 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8724ab5-3025-4ec5-9697-d16c5bc417ac admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=71939) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:442}} Nov 24 16:44:31.174714 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8724ab5-3025-4ec5-9697-d16c5bc417ac admin admin] RBAC: Authorization granted {{(pid=71939) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 24 16:44:31.188532 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: [pid: 71939|app: 0|req: 836/1672] 10.222.0.53 () {58 vars in 1143 bytes} [Wed Nov 24 16:44:31 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 60 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 24 16:44:31.199079 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2396480a-4e9b-4fa0-9a03-e53cdc8e490e None None] Authenticating user token {{(pid=71938) process_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 24 16:44:31.209844 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2396480a-4e9b-4fa0-9a03-e53cdc8e490e None None] Validating token access rules against request {{(pid=71938) validate_allowed_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 24 16:44:31.214759 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4f2faf7-6bdf-444e-83cb-6a18f38c9b89 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f2ba2e8375b4e8c8792ee1e22b60427', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '00a5583c7b7443e98e7a1d31a0b638dc', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=71938) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 24 16:44:31.215506 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4f2faf7-6bdf-444e-83cb-6a18f38c9b89 admin admin] REQUEST_METHOD: `POST` {{(pid=71938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 24 16:44:31.215919 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4f2faf7-6bdf-444e-83cb-6a18f38c9b89 admin admin] SCRIPT_NAME: `/identity` {{(pid=71938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 24 16:44:31.216325 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4f2faf7-6bdf-444e-83cb-6a18f38c9b89 admin admin] PATH_INFO: `/v3/projects` {{(pid=71938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 24 16:44:31.217129 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4f2faf7-6bdf-444e-83cb-6a18f38c9b89 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=71938) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:442}} Nov 24 16:44:31.247762 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4f2faf7-6bdf-444e-83cb-6a18f38c9b89 admin admin] RBAC: Authorization granted {{(pid=71938) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 24 16:44:31.293175 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: [pid: 71938|app: 0|req: 837/1673] 10.222.0.53 () {60 vars in 1143 bytes} [Wed Nov 24 16:44:31 2021] POST /identity/v3/projects => generated 379 bytes in 95 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 24 16:44:31.297781 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8724ab5-3025-4ec5-9697-d16c5bc417ac admin admin] Authenticating user token {{(pid=71939) process_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 24 16:44:31.308248 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8724ab5-3025-4ec5-9697-d16c5bc417ac admin admin] Validating token access rules against request {{(pid=71939) validate_allowed_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 24 16:44:31.376864 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dbabbe3-dc4b-4da7-82d4-1b7ab593938d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f2ba2e8375b4e8c8792ee1e22b60427', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '00a5583c7b7443e98e7a1d31a0b638dc', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=71939) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 24 16:44:31.377553 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dbabbe3-dc4b-4da7-82d4-1b7ab593938d admin admin] REQUEST_METHOD: `POST` {{(pid=71939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 24 16:44:31.377893 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dbabbe3-dc4b-4da7-82d4-1b7ab593938d admin admin] SCRIPT_NAME: `/identity` {{(pid=71939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 24 16:44:31.378260 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dbabbe3-dc4b-4da7-82d4-1b7ab593938d admin admin] PATH_INFO: `/v3/users` {{(pid=71939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 24 16:44:31.378999 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2dbabbe3-dc4b-4da7-82d4-1b7ab593938d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=71939) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:442}} Nov 24 16:44:31.408081 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2dbabbe3-dc4b-4da7-82d4-1b7ab593938d admin admin] RBAC: Authorization granted {{(pid=71939) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 24 16:44:31.430908 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: [pid: 71939|app: 0|req: 837/1674] 10.222.0.53 () {60 vars in 1134 bytes} [Wed Nov 24 16:44:31 2021] POST /identity/v3/users => generated 290 bytes in 133 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 24 16:44:31.435153 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4f2faf7-6bdf-444e-83cb-6a18f38c9b89 admin admin] Authenticating user token {{(pid=71938) process_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 24 16:44:31.446334 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4f2faf7-6bdf-444e-83cb-6a18f38c9b89 admin admin] Validating token access rules against request {{(pid=71938) validate_allowed_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 24 16:44:31.450932 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed5354ad-a29a-4da2-862b-0a5e543c932d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f2ba2e8375b4e8c8792ee1e22b60427', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '00a5583c7b7443e98e7a1d31a0b638dc', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=71938) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 24 16:44:31.451613 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed5354ad-a29a-4da2-862b-0a5e543c932d admin admin] REQUEST_METHOD: `GET` {{(pid=71938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 24 16:44:31.451950 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed5354ad-a29a-4da2-862b-0a5e543c932d admin admin] SCRIPT_NAME: `/identity` {{(pid=71938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 24 16:44:31.452282 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed5354ad-a29a-4da2-862b-0a5e543c932d admin admin] PATH_INFO: `/v3/roles` {{(pid=71938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 24 16:44:31.453066 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed5354ad-a29a-4da2-862b-0a5e543c932d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=71938) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:442}} Nov 24 16:44:31.482634 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed5354ad-a29a-4da2-862b-0a5e543c932d admin admin] RBAC: Authorization granted {{(pid=71938) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 24 16:44:31.494325 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: [pid: 71938|app: 0|req: 838/1675] 10.222.0.53 () {58 vars in 1112 bytes} [Wed Nov 24 16:44:31 2021] GET /identity/v3/roles => generated 1420 bytes in 60 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 24 16:44:31.498965 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dbabbe3-dc4b-4da7-82d4-1b7ab593938d admin admin] Authenticating user token {{(pid=71939) process_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 24 16:44:31.509185 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dbabbe3-dc4b-4da7-82d4-1b7ab593938d admin admin] Validating token access rules against request {{(pid=71939) validate_allowed_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 24 16:44:31.513789 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a1b5c9b-c9b2-4bbf-a226-885827b8253e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f2ba2e8375b4e8c8792ee1e22b60427', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '00a5583c7b7443e98e7a1d31a0b638dc', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=71939) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 24 16:44:31.514739 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a1b5c9b-c9b2-4bbf-a226-885827b8253e admin admin] REQUEST_METHOD: `PUT` {{(pid=71939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 24 16:44:31.515079 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a1b5c9b-c9b2-4bbf-a226-885827b8253e admin admin] SCRIPT_NAME: `/identity` {{(pid=71939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 24 16:44:31.515414 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a1b5c9b-c9b2-4bbf-a226-885827b8253e admin admin] PATH_INFO: `/v3/projects/e61c26a7dd364e849549a000fe97450c/users/6e14493929cc40c0b17a983144c036b3/roles/912ab5f10fa5477da74acf239f07604e` {{(pid=71939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 24 16:44:31.537751 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a1b5c9b-c9b2-4bbf-a226-885827b8253e admin admin] RBAC: Authorizing `identity:create_grant(project_id=e61c26a7dd364e849549a000fe97450c, user_id=6e14493929cc40c0b17a983144c036b3, role_id=912ab5f10fa5477da74acf239f07604e)` {{(pid=71939) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:442}} Nov 24 16:44:31.567420 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a1b5c9b-c9b2-4bbf-a226-885827b8253e admin admin] RBAC: Authorization granted {{(pid=71939) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 24 16:44:31.581726 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: [pid: 71939|app: 0|req: 838/1676] 10.222.0.53 () {60 vars in 1473 bytes} [Wed Nov 24 16:44:31 2021] PUT /identity/v3/projects/e61c26a7dd364e849549a000fe97450c/users/6e14493929cc40c0b17a983144c036b3/roles/912ab5f10fa5477da74acf239f07604e => generated 0 bytes in 83 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 24 16:44:31.595623 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94c3d81b-2b77-47bb-926a-0f292c233567 None None] REQUEST_METHOD: `POST` {{(pid=71938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 24 16:44:31.595969 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94c3d81b-2b77-47bb-926a-0f292c233567 None None] SCRIPT_NAME: `/identity` {{(pid=71938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 24 16:44:31.596303 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94c3d81b-2b77-47bb-926a-0f292c233567 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=71938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 24 16:44:31.636609 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.auth.core [None req-94c3d81b-2b77-47bb-926a-0f292c233567 None None] MFA Rules not processed for user `6e14493929cc40c0b17a983144c036b3`. Rule list: `[]` (Enabled: `True`). {{(pid=71938) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:442}} Nov 24 16:44:31.637828 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.fernet_utils [None req-94c3d81b-2b77-47bb-926a-0f292c233567 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=71938) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:289}} Nov 24 16:44:31.714967 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: [pid: 71938|app: 0|req: 839/1677] 10.222.0.53 () {58 vars in 948 bytes} [Wed Nov 24 16:44:31 2021] POST /identity/v3/auth/tokens => generated 3686 bytes in 120 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 24 16:44:31.726273 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a1b5c9b-c9b2-4bbf-a226-885827b8253e admin admin] Authenticating user token {{(pid=71939) process_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 24 16:44:31.809343 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a1b5c9b-c9b2-4bbf-a226-885827b8253e admin admin] Validating token access rules against request {{(pid=71939) validate_allowed_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 24 16:44:31.814905 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ab58752-8d26-4d73-8d4b-517c48f050ba service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e196802d4d5432482b6d2eabc25f74e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3b3940d4ae1c4177ae29c02377bb4b0b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'service', 'ResellerAdmin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=71939) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 24 16:44:31.815569 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ab58752-8d26-4d73-8d4b-517c48f050ba service nova] REQUEST_METHOD: `GET` {{(pid=71939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 24 16:44:31.815915 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ab58752-8d26-4d73-8d4b-517c48f050ba service nova] SCRIPT_NAME: `/identity` {{(pid=71939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 24 16:44:31.816250 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ab58752-8d26-4d73-8d4b-517c48f050ba service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=71939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 24 16:44:31.825444 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ab58752-8d26-4d73-8d4b-517c48f050ba service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=71939) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:442}} Nov 24 16:44:31.853883 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ab58752-8d26-4d73-8d4b-517c48f050ba service nova] RBAC: Authorization granted {{(pid=71939) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 24 16:44:31.863558 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: [pid: 71939|app: 0|req: 839/1678] 10.222.0.53 () {60 vars in 1356 bytes} [Wed Nov 24 16:44:31 2021] GET /identity/v3/auth/tokens => generated 3686 bytes in 138 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 24 16:44:31.948778 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b39ed053-2df6-4936-9877-9b61e6605387 None None] REQUEST_METHOD: `GET` {{(pid=71938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 24 16:44:31.949136 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b39ed053-2df6-4936-9877-9b61e6605387 None None] SCRIPT_NAME: `/identity` {{(pid=71938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 24 16:44:31.949516 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b39ed053-2df6-4936-9877-9b61e6605387 None None] PATH_INFO: `/` {{(pid=71938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 24 16:44:31.951351 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: [pid: 71938|app: 0|req: 840/1679] 10.222.0.53 () {52 vars in 819 bytes} [Wed Nov 24 16:44:31 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 24 16:44:31.955367 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ab58752-8d26-4d73-8d4b-517c48f050ba service nova] Authenticating user token {{(pid=71939) process_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 24 16:44:32.103935 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ab58752-8d26-4d73-8d4b-517c48f050ba service nova] Validating token access rules against request {{(pid=71939) validate_allowed_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 24 16:44:32.108475 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87771cee-6e93-47ba-be42-a3986063bb92 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f2ba2e8375b4e8c8792ee1e22b60427', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '00a5583c7b7443e98e7a1d31a0b638dc', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=71939) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 24 16:44:32.109483 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87771cee-6e93-47ba-be42-a3986063bb92 admin admin] REQUEST_METHOD: `DELETE` {{(pid=71939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 24 16:44:32.109892 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87771cee-6e93-47ba-be42-a3986063bb92 admin admin] SCRIPT_NAME: `/identity` {{(pid=71939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 24 16:44:32.110319 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87771cee-6e93-47ba-be42-a3986063bb92 admin admin] PATH_INFO: `/v3/users/6e14493929cc40c0b17a983144c036b3` {{(pid=71939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 24 16:44:32.111843 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87771cee-6e93-47ba-be42-a3986063bb92 admin admin] RBAC: Authorizing `identity:delete_user(user_id=6e14493929cc40c0b17a983144c036b3)` {{(pid=71939) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:442}} Nov 24 16:44:32.139582 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: WARNING py.warnings [None req-87771cee-6e93-47ba-be42-a3986063bb92 admin admin] /usr/local/lib/python3.6/dist-packages/oslo_policy/policy.py:1018: UserWarning: Policy identity:delete_user failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Nov 24 16:44:32.139582 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: warnings.warn(msg) Nov 24 16:44:32.139582 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: Nov 24 16:44:32.140954 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87771cee-6e93-47ba-be42-a3986063bb92 admin admin] RBAC: Authorization granted {{(pid=71939) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 24 16:44:32.203499 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.notifications [None req-87771cee-6e93-47ba-be42-a3986063bb92 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '6e14493929cc40c0b17a983144c036b3'} {{(pid=71939) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:357}} Nov 24 16:44:32.219881 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.notifications [None req-87771cee-6e93-47ba-be42-a3986063bb92 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '6e14493929cc40c0b17a983144c036b3'} {{(pid=71939) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:357}} Nov 24 16:44:32.220712 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.notifications [None req-87771cee-6e93-47ba-be42-a3986063bb92 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '6e14493929cc40c0b17a983144c036b3'} {{(pid=71939) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:357}} Nov 24 16:44:32.231697 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.notifications [None req-87771cee-6e93-47ba-be42-a3986063bb92 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '6e14493929cc40c0b17a983144c036b3'} {{(pid=71939) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:357}} Nov 24 16:44:32.239255 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.notifications [None req-87771cee-6e93-47ba-be42-a3986063bb92 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '6e14493929cc40c0b17a983144c036b3'} {{(pid=71939) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:357}} Nov 24 16:44:32.247444 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: [pid: 71939|app: 0|req: 840/1680] 10.222.0.53 () {58 vars in 1214 bytes} [Wed Nov 24 16:44:31 2021] DELETE /identity/v3/users/6e14493929cc40c0b17a983144c036b3 => generated 0 bytes in 293 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 24 16:44:32.252193 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e606d08-5f53-4716-8c72-b726f76db538 None None] REQUEST_METHOD: `POST` {{(pid=71938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 24 16:44:32.252539 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e606d08-5f53-4716-8c72-b726f76db538 None None] SCRIPT_NAME: `/identity` {{(pid=71938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 24 16:44:32.252875 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e606d08-5f53-4716-8c72-b726f76db538 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=71938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 24 16:44:32.276226 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.auth.core [None req-4e606d08-5f53-4716-8c72-b726f76db538 None None] MFA Rules not processed for user `0f2ba2e8375b4e8c8792ee1e22b60427`. Rule list: `[]` (Enabled: `True`). {{(pid=71938) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:442}} Nov 24 16:44:32.277441 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.fernet_utils [None req-4e606d08-5f53-4716-8c72-b726f76db538 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=71938) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:289}} Nov 24 16:44:32.347967 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: [pid: 71938|app: 0|req: 841/1681] 10.222.0.53 () {58 vars in 948 bytes} [Wed Nov 24 16:44:32 2021] POST /identity/v3/auth/tokens => generated 3669 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 24 16:44:32.358928 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87771cee-6e93-47ba-be42-a3986063bb92 admin admin] Authenticating user token {{(pid=71939) process_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 24 16:44:32.360327 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.fernet_utils [None req-87771cee-6e93-47ba-be42-a3986063bb92 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=71939) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:289}} Nov 24 16:44:32.426780 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87771cee-6e93-47ba-be42-a3986063bb92 admin admin] Validating token access rules against request {{(pid=71939) validate_allowed_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 24 16:44:32.430414 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2da5be40-4074-4dc1-8be7-5b3e7edfde8d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c90f21b9cdcb413282461fa83cb6b7a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3b3940d4ae1c4177ae29c02377bb4b0b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=71939) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 24 16:44:32.431076 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2da5be40-4074-4dc1-8be7-5b3e7edfde8d service neutron] REQUEST_METHOD: `GET` {{(pid=71939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 24 16:44:32.431415 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2da5be40-4074-4dc1-8be7-5b3e7edfde8d service neutron] SCRIPT_NAME: `/identity` {{(pid=71939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 24 16:44:32.431747 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2da5be40-4074-4dc1-8be7-5b3e7edfde8d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=71939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 24 16:44:32.440962 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2da5be40-4074-4dc1-8be7-5b3e7edfde8d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=71939) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:442}} Nov 24 16:44:32.469832 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2da5be40-4074-4dc1-8be7-5b3e7edfde8d service neutron] RBAC: Authorization granted {{(pid=71939) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 24 16:44:32.479657 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: [pid: 71939|app: 0|req: 841/1682] 10.222.0.53 () {60 vars in 1356 bytes} [Wed Nov 24 16:44:32 2021] GET /identity/v3/auth/tokens => generated 3669 bytes in 121 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 24 16:44:32.875596 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e606d08-5f53-4716-8c72-b726f76db538 None None] Authenticating user token {{(pid=71938) process_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 24 16:44:32.877310 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.fernet_utils [None req-4e606d08-5f53-4716-8c72-b726f76db538 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=71938) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:289}} Nov 24 16:44:32.890283 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e606d08-5f53-4716-8c72-b726f76db538 None None] Validating token access rules against request {{(pid=71938) validate_allowed_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 24 16:44:32.895652 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-782b426d-0b79-4276-a068-e7a3a7531e6d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f2ba2e8375b4e8c8792ee1e22b60427', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '00a5583c7b7443e98e7a1d31a0b638dc', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=71938) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 24 16:44:32.896645 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-782b426d-0b79-4276-a068-e7a3a7531e6d admin admin] REQUEST_METHOD: `DELETE` {{(pid=71938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 24 16:44:32.897014 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-782b426d-0b79-4276-a068-e7a3a7531e6d admin admin] SCRIPT_NAME: `/identity` {{(pid=71938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 24 16:44:32.897348 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-782b426d-0b79-4276-a068-e7a3a7531e6d admin admin] PATH_INFO: `/v3/projects/e61c26a7dd364e849549a000fe97450c` {{(pid=71938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 24 16:44:32.898629 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-782b426d-0b79-4276-a068-e7a3a7531e6d admin admin] RBAC: Authorizing `identity:delete_project(project_id=e61c26a7dd364e849549a000fe97450c)` {{(pid=71938) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:442}} Nov 24 16:44:32.926706 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: WARNING py.warnings [None req-782b426d-0b79-4276-a068-e7a3a7531e6d admin admin] /usr/local/lib/python3.6/dist-packages/oslo_policy/policy.py:1018: UserWarning: Policy identity:delete_project failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Nov 24 16:44:32.926706 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: warnings.warn(msg) Nov 24 16:44:32.926706 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: Nov 24 16:44:32.928069 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-782b426d-0b79-4276-a068-e7a3a7531e6d admin admin] RBAC: Authorization granted {{(pid=71938) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 24 16:44:32.983195 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.notifications [None req-782b426d-0b79-4276-a068-e7a3a7531e6d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e61c26a7dd364e849549a000fe97450c', 'request_id': 'req-782b426d-0b79-4276-a068-e7a3a7531e6d'} {{(pid=71938) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:357}} Nov 24 16:44:32.995821 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.notifications [None req-782b426d-0b79-4276-a068-e7a3a7531e6d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e61c26a7dd364e849549a000fe97450c', 'request_id': 'req-782b426d-0b79-4276-a068-e7a3a7531e6d'} {{(pid=71938) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:357}} Nov 24 16:44:33.001141 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.notifications [None req-782b426d-0b79-4276-a068-e7a3a7531e6d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e61c26a7dd364e849549a000fe97450c', 'request_id': 'req-782b426d-0b79-4276-a068-e7a3a7531e6d'} {{(pid=71938) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:357}} Nov 24 16:44:33.015851 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.notifications [None req-782b426d-0b79-4276-a068-e7a3a7531e6d admin admin] The token cache is being invalidate because project e61c26a7dd364e849549a000fe97450c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=71938) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Nov 24 16:44:33.016181 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.notifications [None req-782b426d-0b79-4276-a068-e7a3a7531e6d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=71938) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:357}} Nov 24 16:44:33.016942 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.notifications [None req-782b426d-0b79-4276-a068-e7a3a7531e6d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=71938) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:357}} Nov 24 16:44:33.018543 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: [pid: 71938|app: 0|req: 842/1683] 10.222.0.53 () {58 vars in 1223 bytes} [Wed Nov 24 16:44:32 2021] DELETE /identity/v3/projects/e61c26a7dd364e849549a000fe97450c => generated 0 bytes in 144 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 24 16:45:55.848308 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-019c55cb-8a4e-4225-a3e5-0c125ad8d6f5 None None] REQUEST_METHOD: `GET` {{(pid=71939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 24 16:45:55.848900 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-019c55cb-8a4e-4225-a3e5-0c125ad8d6f5 None None] SCRIPT_NAME: `/identity` {{(pid=71939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 24 16:45:55.849022 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-019c55cb-8a4e-4225-a3e5-0c125ad8d6f5 None None] PATH_INFO: `/v3` {{(pid=71939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 24 16:45:55.850344 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: [pid: 71939|app: 0|req: 842/1684] 10.222.0.21 () {54 vars in 916 bytes} [Wed Nov 24 16:45:55 2021] GET /identity/v3 => generated 255 bytes in 3 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 24 16:45:55.857092 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71b3b791-5516-45b0-8f51-ea49aa730424 None None] REQUEST_METHOD: `POST` {{(pid=71938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 24 16:45:55.857443 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71b3b791-5516-45b0-8f51-ea49aa730424 None None] SCRIPT_NAME: `/identity` {{(pid=71938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 24 16:45:55.857785 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71b3b791-5516-45b0-8f51-ea49aa730424 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=71938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 24 16:45:55.882722 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.auth.core [None req-71b3b791-5516-45b0-8f51-ea49aa730424 None None] MFA Rules not processed for user `a919320c9e2a48d7ba33453b5929d7ee`. Rule list: `[]` (Enabled: `True`). {{(pid=71938) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:442}} Nov 24 16:45:55.883955 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.fernet_utils [None req-71b3b791-5516-45b0-8f51-ea49aa730424 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=71938) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:289}} Nov 24 16:45:55.960275 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: [pid: 71938|app: 0|req: 843/1685] 10.222.0.21 () {58 vars in 1006 bytes} [Wed Nov 24 16:45:55 2021] POST /identity/v3/auth/tokens => generated 3738 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 24 16:45:56.658407 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39fbfa7c-fb2f-412d-bb1a-70f1b05f1361 None None] REQUEST_METHOD: `GET` {{(pid=71939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 24 16:45:56.658750 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39fbfa7c-fb2f-412d-bb1a-70f1b05f1361 None None] SCRIPT_NAME: `/identity` {{(pid=71939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 24 16:45:56.659083 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39fbfa7c-fb2f-412d-bb1a-70f1b05f1361 None None] PATH_INFO: `/` {{(pid=71939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 24 16:45:56.660911 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: [pid: 71939|app: 0|req: 843/1686] 127.0.0.1 () {54 vars in 890 bytes} [Wed Nov 24 16:45:56 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 24 16:45:56.666371 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b2be095-6f4a-4bcb-adc2-e70931318cbb None None] REQUEST_METHOD: `POST` {{(pid=71938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 24 16:45:56.667236 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b2be095-6f4a-4bcb-adc2-e70931318cbb None None] SCRIPT_NAME: `/identity` {{(pid=71938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 24 16:45:56.667579 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b2be095-6f4a-4bcb-adc2-e70931318cbb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=71938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 24 16:45:56.692049 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.auth.core [None req-6b2be095-6f4a-4bcb-adc2-e70931318cbb None None] MFA Rules not processed for user `0f2ba2e8375b4e8c8792ee1e22b60427`. Rule list: `[]` (Enabled: `True`). {{(pid=71938) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:442}} Nov 24 16:45:56.693288 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.fernet_utils [None req-6b2be095-6f4a-4bcb-adc2-e70931318cbb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=71938) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:289}} Nov 24 16:45:56.763700 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: [pid: 71938|app: 0|req: 844/1687] 127.0.0.1 () {58 vars in 988 bytes} [Wed Nov 24 16:45:56 2021] POST /identity/v3/auth/tokens => generated 3669 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 24 16:45:56.905556 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39fbfa7c-fb2f-412d-bb1a-70f1b05f1361 None None] Authenticating user token {{(pid=71939) process_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 24 16:45:56.907696 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.fernet_utils [None req-39fbfa7c-fb2f-412d-bb1a-70f1b05f1361 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=71939) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:289}} Nov 24 16:45:56.996533 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39fbfa7c-fb2f-412d-bb1a-70f1b05f1361 None None] Validating token access rules against request {{(pid=71939) validate_allowed_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 24 16:45:57.002011 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e338c64f-acd7-4c82-829a-de86eb3c9837 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e196802d4d5432482b6d2eabc25f74e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3b3940d4ae1c4177ae29c02377bb4b0b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'service', 'ResellerAdmin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=71939) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 24 16:45:57.002711 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e338c64f-acd7-4c82-829a-de86eb3c9837 service nova] REQUEST_METHOD: `GET` {{(pid=71939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 24 16:45:57.003052 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e338c64f-acd7-4c82-829a-de86eb3c9837 service nova] SCRIPT_NAME: `/identity` {{(pid=71939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 24 16:45:57.003384 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e338c64f-acd7-4c82-829a-de86eb3c9837 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=71939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 24 16:45:57.013125 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e338c64f-acd7-4c82-829a-de86eb3c9837 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=71939) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:442}} Nov 24 16:45:57.042170 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e338c64f-acd7-4c82-829a-de86eb3c9837 service nova] RBAC: Authorization granted {{(pid=71939) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 24 16:45:57.052883 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: [pid: 71939|app: 0|req: 844/1688] 10.222.0.53 () {60 vars in 1356 bytes} [Wed Nov 24 16:45:56 2021] GET /identity/v3/auth/tokens => generated 3669 bytes in 148 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 24 16:45:58.683440 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dedf76c-38b9-46d5-b2a2-86195761304e None None] REQUEST_METHOD: `GET` {{(pid=71938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 24 16:45:58.684000 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dedf76c-38b9-46d5-b2a2-86195761304e None None] SCRIPT_NAME: `/identity` {{(pid=71938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 24 16:45:58.684113 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dedf76c-38b9-46d5-b2a2-86195761304e None None] PATH_INFO: `/` {{(pid=71938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 24 16:45:58.685923 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: [pid: 71938|app: 0|req: 845/1689] 127.0.0.1 () {54 vars in 890 bytes} [Wed Nov 24 16:45:58 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 24 16:45:58.691230 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7892ac51-1aa1-49e1-9098-7061b55c9996 None None] REQUEST_METHOD: `POST` {{(pid=71939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 24 16:45:58.691604 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7892ac51-1aa1-49e1-9098-7061b55c9996 None None] SCRIPT_NAME: `/identity` {{(pid=71939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 24 16:45:58.691916 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7892ac51-1aa1-49e1-9098-7061b55c9996 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=71939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 24 16:45:58.716461 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.auth.core [None req-7892ac51-1aa1-49e1-9098-7061b55c9996 None None] MFA Rules not processed for user `0f2ba2e8375b4e8c8792ee1e22b60427`. Rule list: `[]` (Enabled: `True`). {{(pid=71939) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:442}} Nov 24 16:45:58.717690 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.fernet_utils [None req-7892ac51-1aa1-49e1-9098-7061b55c9996 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=71939) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:289}} Nov 24 16:45:58.725204 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: [pid: 71939|app: 0|req: 845/1690] 127.0.0.1 () {58 vars in 988 bytes} [Wed Nov 24 16:45:58 2021] POST /identity/v3/auth/tokens => generated 3669 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 24 16:45:58.862585 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dedf76c-38b9-46d5-b2a2-86195761304e None None] Authenticating user token {{(pid=71938) process_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 24 16:45:58.877266 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dedf76c-38b9-46d5-b2a2-86195761304e None None] Validating token access rules against request {{(pid=71938) validate_allowed_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 24 16:45:58.882716 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a067929-5211-4d47-98ed-7ad7870d00d2 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e196802d4d5432482b6d2eabc25f74e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3b3940d4ae1c4177ae29c02377bb4b0b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'service', 'ResellerAdmin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=71938) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 24 16:45:58.883365 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a067929-5211-4d47-98ed-7ad7870d00d2 service nova] REQUEST_METHOD: `GET` {{(pid=71938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 24 16:45:58.883706 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a067929-5211-4d47-98ed-7ad7870d00d2 service nova] SCRIPT_NAME: `/identity` {{(pid=71938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 24 16:45:58.884044 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a067929-5211-4d47-98ed-7ad7870d00d2 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=71938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 24 16:45:58.893244 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a067929-5211-4d47-98ed-7ad7870d00d2 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=71938) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:442}} Nov 24 16:45:58.922018 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a067929-5211-4d47-98ed-7ad7870d00d2 service nova] RBAC: Authorization granted {{(pid=71938) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 24 16:45:58.931990 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: [pid: 71938|app: 0|req: 846/1691] 10.222.0.53 () {60 vars in 1356 bytes} [Wed Nov 24 16:45:58 2021] GET /identity/v3/auth/tokens => generated 3669 bytes in 70 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 24 16:45:59.451127 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-979182d5-f156-462c-8aff-6ff656eed63c None None] REQUEST_METHOD: `GET` {{(pid=71939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 24 16:45:59.451474 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-979182d5-f156-462c-8aff-6ff656eed63c None None] SCRIPT_NAME: `/identity` {{(pid=71939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 24 16:45:59.451818 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-979182d5-f156-462c-8aff-6ff656eed63c None None] PATH_INFO: `/` {{(pid=71939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 24 16:45:59.453764 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: [pid: 71939|app: 0|req: 846/1692] 10.222.0.53 () {54 vars in 949 bytes} [Wed Nov 24 16:45:59 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 24 16:45:59.459774 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ae93a9b-a097-448e-9e7f-02bfc19e9589 None None] REQUEST_METHOD: `POST` {{(pid=71938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 24 16:45:59.460120 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ae93a9b-a097-448e-9e7f-02bfc19e9589 None None] SCRIPT_NAME: `/identity` {{(pid=71938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 24 16:45:59.460457 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ae93a9b-a097-448e-9e7f-02bfc19e9589 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=71938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 24 16:45:59.493198 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.auth.core [None req-0ae93a9b-a097-448e-9e7f-02bfc19e9589 None None] MFA Rules not processed for user `a919320c9e2a48d7ba33453b5929d7ee`. Rule list: `[]` (Enabled: `True`). {{(pid=71938) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:442}} Nov 24 16:45:59.495130 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.fernet_utils [None req-0ae93a9b-a097-448e-9e7f-02bfc19e9589 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=71938) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:289}} Nov 24 16:45:59.503430 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: [pid: 71938|app: 0|req: 847/1693] 10.222.0.53 () {58 vars in 1047 bytes} [Wed Nov 24 16:45:59 2021] POST /identity/v3/auth/tokens => generated 3738 bytes in 45 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 24 16:45:59.511646 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-979182d5-f156-462c-8aff-6ff656eed63c None None] Authenticating user token {{(pid=71939) process_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 24 16:45:59.525620 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-979182d5-f156-462c-8aff-6ff656eed63c None None] Validating token access rules against request {{(pid=71939) validate_allowed_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 24 16:45:59.530798 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe6f71d0-335b-4ee7-989e-18300d7f8f00 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a919320c9e2a48d7ba33453b5929d7ee', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3b3940d4ae1c4177ae29c02377bb4b0b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=71939) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 24 16:45:59.531458 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe6f71d0-335b-4ee7-989e-18300d7f8f00 service placement] REQUEST_METHOD: `GET` {{(pid=71939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 24 16:45:59.531804 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe6f71d0-335b-4ee7-989e-18300d7f8f00 service placement] SCRIPT_NAME: `/identity` {{(pid=71939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 24 16:45:59.532144 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe6f71d0-335b-4ee7-989e-18300d7f8f00 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=71939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 24 16:45:59.541882 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe6f71d0-335b-4ee7-989e-18300d7f8f00 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=71939) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:442}} Nov 24 16:45:59.570804 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe6f71d0-335b-4ee7-989e-18300d7f8f00 service placement] RBAC: Authorization granted {{(pid=71939) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 24 16:45:59.581236 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: [pid: 71939|app: 0|req: 847/1694] 10.222.0.53 () {60 vars in 1356 bytes} [Wed Nov 24 16:45:59 2021] GET /identity/v3/auth/tokens => generated 3738 bytes in 70 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 24 16:46:10.983526 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56278da7-c084-433f-8ebf-53b785c4caba None None] REQUEST_METHOD: `GET` {{(pid=71938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 24 16:46:10.984044 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56278da7-c084-433f-8ebf-53b785c4caba None None] SCRIPT_NAME: `/identity` {{(pid=71938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 24 16:46:10.984162 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56278da7-c084-433f-8ebf-53b785c4caba None None] PATH_INFO: `/` {{(pid=71938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 24 16:46:10.986103 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: [pid: 71938|app: 0|req: 848/1695] 127.0.0.1 () {54 vars in 890 bytes} [Wed Nov 24 16:46:10 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 24 16:46:10.991466 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37d61901-f6c0-4255-897b-7288fffb0a11 None None] REQUEST_METHOD: `POST` {{(pid=71939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 24 16:46:10.991819 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37d61901-f6c0-4255-897b-7288fffb0a11 None None] SCRIPT_NAME: `/identity` {{(pid=71939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 24 16:46:10.992161 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37d61901-f6c0-4255-897b-7288fffb0a11 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=71939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 24 16:46:11.017390 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.auth.core [None req-37d61901-f6c0-4255-897b-7288fffb0a11 None None] MFA Rules not processed for user `0f2ba2e8375b4e8c8792ee1e22b60427`. Rule list: `[]` (Enabled: `True`). {{(pid=71939) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:442}} Nov 24 16:46:11.018661 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.fernet_utils [None req-37d61901-f6c0-4255-897b-7288fffb0a11 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=71939) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:289}} Nov 24 16:46:11.026264 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: [pid: 71939|app: 0|req: 848/1696] 127.0.0.1 () {58 vars in 988 bytes} [Wed Nov 24 16:46:10 2021] POST /identity/v3/auth/tokens => generated 3669 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 24 16:46:11.167268 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56278da7-c084-433f-8ebf-53b785c4caba None None] Authenticating user token {{(pid=71938) process_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 24 16:46:11.183741 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56278da7-c084-433f-8ebf-53b785c4caba None None] Validating token access rules against request {{(pid=71938) validate_allowed_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 24 16:46:11.189281 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd4cc529-aa4c-49e4-afc1-471f8cebb35c service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e196802d4d5432482b6d2eabc25f74e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3b3940d4ae1c4177ae29c02377bb4b0b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'service', 'ResellerAdmin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=71938) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 24 16:46:11.189945 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd4cc529-aa4c-49e4-afc1-471f8cebb35c service nova] REQUEST_METHOD: `GET` {{(pid=71938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 24 16:46:11.190399 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd4cc529-aa4c-49e4-afc1-471f8cebb35c service nova] SCRIPT_NAME: `/identity` {{(pid=71938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 24 16:46:11.190738 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd4cc529-aa4c-49e4-afc1-471f8cebb35c service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=71938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 24 16:46:11.200682 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd4cc529-aa4c-49e4-afc1-471f8cebb35c service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=71938) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:442}} Nov 24 16:46:11.228981 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd4cc529-aa4c-49e4-afc1-471f8cebb35c service nova] RBAC: Authorization granted {{(pid=71938) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 24 16:46:11.239616 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: [pid: 71938|app: 0|req: 849/1697] 10.222.0.53 () {60 vars in 1356 bytes} [Wed Nov 24 16:46:11 2021] GET /identity/v3/auth/tokens => generated 3669 bytes in 73 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 24 16:46:12.820976 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84c7e193-8a38-4a9f-b440-8208ddee2839 None None] REQUEST_METHOD: `GET` {{(pid=71939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 24 16:46:12.821551 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84c7e193-8a38-4a9f-b440-8208ddee2839 None None] SCRIPT_NAME: `/identity` {{(pid=71939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 24 16:46:12.821684 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84c7e193-8a38-4a9f-b440-8208ddee2839 None None] PATH_INFO: `/` {{(pid=71939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 24 16:46:12.823566 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: [pid: 71939|app: 0|req: 849/1698] 127.0.0.1 () {54 vars in 890 bytes} [Wed Nov 24 16:46:12 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 24 16:46:12.828871 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe2ead51-5655-460a-9b2c-cf85693e217e None None] REQUEST_METHOD: `POST` {{(pid=71938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 24 16:46:12.829226 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe2ead51-5655-460a-9b2c-cf85693e217e None None] SCRIPT_NAME: `/identity` {{(pid=71938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 24 16:46:12.829563 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe2ead51-5655-460a-9b2c-cf85693e217e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=71938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 24 16:46:12.856764 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.auth.core [None req-fe2ead51-5655-460a-9b2c-cf85693e217e None None] MFA Rules not processed for user `0f2ba2e8375b4e8c8792ee1e22b60427`. Rule list: `[]` (Enabled: `True`). {{(pid=71938) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:442}} Nov 24 16:46:12.857993 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.fernet_utils [None req-fe2ead51-5655-460a-9b2c-cf85693e217e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=71938) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:289}} Nov 24 16:46:12.865652 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: [pid: 71938|app: 0|req: 850/1699] 127.0.0.1 () {58 vars in 988 bytes} [Wed Nov 24 16:46:12 2021] POST /identity/v3/auth/tokens => generated 3669 bytes in 38 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 24 16:46:13.007145 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84c7e193-8a38-4a9f-b440-8208ddee2839 None None] Authenticating user token {{(pid=71939) process_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 24 16:46:13.022200 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84c7e193-8a38-4a9f-b440-8208ddee2839 None None] Validating token access rules against request {{(pid=71939) validate_allowed_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 24 16:46:13.028164 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94c6173e-7a5c-412c-9100-a8c777df0e1f service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e196802d4d5432482b6d2eabc25f74e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3b3940d4ae1c4177ae29c02377bb4b0b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'service', 'ResellerAdmin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=71939) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 24 16:46:13.028808 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94c6173e-7a5c-412c-9100-a8c777df0e1f service nova] REQUEST_METHOD: `GET` {{(pid=71939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 24 16:46:13.029146 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94c6173e-7a5c-412c-9100-a8c777df0e1f service nova] SCRIPT_NAME: `/identity` {{(pid=71939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 24 16:46:13.029478 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94c6173e-7a5c-412c-9100-a8c777df0e1f service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=71939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 24 16:46:13.038185 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94c6173e-7a5c-412c-9100-a8c777df0e1f service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=71939) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:442}} Nov 24 16:46:13.067308 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94c6173e-7a5c-412c-9100-a8c777df0e1f service nova] RBAC: Authorization granted {{(pid=71939) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 24 16:46:13.077205 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: [pid: 71939|app: 0|req: 850/1700] 10.222.0.53 () {60 vars in 1356 bytes} [Wed Nov 24 16:46:13 2021] GET /identity/v3/auth/tokens => generated 3669 bytes in 71 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 24 16:46:16.999900 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b30d000-09f5-44e3-b7e0-f91350cf8609 None None] REQUEST_METHOD: `GET` {{(pid=71938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 24 16:46:17.000490 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b30d000-09f5-44e3-b7e0-f91350cf8609 None None] SCRIPT_NAME: `/identity` {{(pid=71938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 24 16:46:17.000490 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b30d000-09f5-44e3-b7e0-f91350cf8609 None None] PATH_INFO: `/` {{(pid=71938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 24 16:46:17.002472 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: [pid: 71938|app: 0|req: 851/1701] 127.0.0.1 () {54 vars in 905 bytes} [Wed Nov 24 16:46:16 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 24 16:46:17.008119 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bbc9d67-83f4-4a2b-ac36-222e4bef4d22 None None] REQUEST_METHOD: `POST` {{(pid=71939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 24 16:46:17.008468 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bbc9d67-83f4-4a2b-ac36-222e4bef4d22 None None] SCRIPT_NAME: `/identity` {{(pid=71939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 24 16:46:17.008806 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bbc9d67-83f4-4a2b-ac36-222e4bef4d22 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=71939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 24 16:46:17.035922 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.auth.core [None req-2bbc9d67-83f4-4a2b-ac36-222e4bef4d22 None None] MFA Rules not processed for user `0f2ba2e8375b4e8c8792ee1e22b60427`. Rule list: `[]` (Enabled: `True`). {{(pid=71939) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:442}} Nov 24 16:46:17.037149 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.fernet_utils [None req-2bbc9d67-83f4-4a2b-ac36-222e4bef4d22 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=71939) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:289}} Nov 24 16:46:17.045264 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: [pid: 71939|app: 0|req: 851/1702] 127.0.0.1 () {58 vars in 1003 bytes} [Wed Nov 24 16:46:17 2021] POST /identity/v3/auth/tokens => generated 3669 bytes in 38 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 24 16:46:17.070373 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49939c7b-ead8-48b7-89e0-a9c5e1b61ae4 None None] REQUEST_METHOD: `POST` {{(pid=71938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 24 16:46:17.070757 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49939c7b-ead8-48b7-89e0-a9c5e1b61ae4 None None] SCRIPT_NAME: `/identity` {{(pid=71938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 24 16:46:17.071093 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49939c7b-ead8-48b7-89e0-a9c5e1b61ae4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=71938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 24 16:46:17.098810 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.auth.core [None req-49939c7b-ead8-48b7-89e0-a9c5e1b61ae4 None None] MFA Rules not processed for user `0f2ba2e8375b4e8c8792ee1e22b60427`. Rule list: `[]` (Enabled: `True`). {{(pid=71938) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:442}} Nov 24 16:46:17.100050 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.fernet_utils [None req-49939c7b-ead8-48b7-89e0-a9c5e1b61ae4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=71938) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:289}} Nov 24 16:46:17.108388 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: [pid: 71938|app: 0|req: 852/1703] 127.0.0.1 () {58 vars in 1003 bytes} [Wed Nov 24 16:46:17 2021] POST /identity/v3/auth/tokens => generated 3669 bytes in 39 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 24 16:46:17.127481 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bbc9d67-83f4-4a2b-ac36-222e4bef4d22 None None] Authenticating user token {{(pid=71939) process_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 24 16:46:17.128916 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.fernet_utils [None req-2bbc9d67-83f4-4a2b-ac36-222e4bef4d22 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=71939) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:289}} Nov 24 16:46:17.197144 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bbc9d67-83f4-4a2b-ac36-222e4bef4d22 None None] Validating token access rules against request {{(pid=71939) validate_allowed_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 24 16:46:17.200871 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99a59260-e24d-447d-82a7-c605a3fd61a9 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c90f21b9cdcb413282461fa83cb6b7a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3b3940d4ae1c4177ae29c02377bb4b0b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=71939) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 24 16:46:17.201566 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99a59260-e24d-447d-82a7-c605a3fd61a9 service neutron] REQUEST_METHOD: `GET` {{(pid=71939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 24 16:46:17.201902 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99a59260-e24d-447d-82a7-c605a3fd61a9 service neutron] SCRIPT_NAME: `/identity` {{(pid=71939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 24 16:46:17.202260 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99a59260-e24d-447d-82a7-c605a3fd61a9 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=71939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 24 16:46:17.211925 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99a59260-e24d-447d-82a7-c605a3fd61a9 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=71939) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:442}} Nov 24 16:46:17.241293 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99a59260-e24d-447d-82a7-c605a3fd61a9 service neutron] RBAC: Authorization granted {{(pid=71939) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 24 16:46:17.251966 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: [pid: 71939|app: 0|req: 852/1704] 10.222.0.53 () {60 vars in 1356 bytes} [Wed Nov 24 16:46:17 2021] GET /identity/v3/auth/tokens => generated 3669 bytes in 125 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 24 16:46:19.325078 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-023820f2-4bba-4b6d-a569-e51dacb1100e None None] REQUEST_METHOD: `GET` {{(pid=71938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 24 16:46:19.325673 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-023820f2-4bba-4b6d-a569-e51dacb1100e None None] SCRIPT_NAME: `/identity` {{(pid=71938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 24 16:46:19.325798 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-023820f2-4bba-4b6d-a569-e51dacb1100e None None] PATH_INFO: `/` {{(pid=71938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 24 16:46:19.327610 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: [pid: 71938|app: 0|req: 853/1705] 127.0.0.1 () {54 vars in 905 bytes} [Wed Nov 24 16:46:19 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 24 16:46:19.333980 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da992f88-b604-442f-970c-f3dbd588e455 None None] REQUEST_METHOD: `POST` {{(pid=71939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 24 16:46:19.334385 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da992f88-b604-442f-970c-f3dbd588e455 None None] SCRIPT_NAME: `/identity` {{(pid=71939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 24 16:46:19.334726 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da992f88-b604-442f-970c-f3dbd588e455 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=71939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 24 16:46:19.360690 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.auth.core [None req-da992f88-b604-442f-970c-f3dbd588e455 None None] MFA Rules not processed for user `0f2ba2e8375b4e8c8792ee1e22b60427`. Rule list: `[]` (Enabled: `True`). {{(pid=71939) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:442}} Nov 24 16:46:19.361947 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.fernet_utils [None req-da992f88-b604-442f-970c-f3dbd588e455 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=71939) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:289}} Nov 24 16:46:19.370410 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: [pid: 71939|app: 0|req: 853/1706] 127.0.0.1 () {58 vars in 1003 bytes} [Wed Nov 24 16:46:19 2021] POST /identity/v3/auth/tokens => generated 3669 bytes in 37 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 24 16:46:19.395167 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5be79f3a-76a5-4be2-9e64-2a52e7743624 None None] REQUEST_METHOD: `POST` {{(pid=71938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 24 16:46:19.395548 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5be79f3a-76a5-4be2-9e64-2a52e7743624 None None] SCRIPT_NAME: `/identity` {{(pid=71938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 24 16:46:19.395887 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5be79f3a-76a5-4be2-9e64-2a52e7743624 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=71938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 24 16:46:19.421487 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.auth.core [None req-5be79f3a-76a5-4be2-9e64-2a52e7743624 None None] MFA Rules not processed for user `0f2ba2e8375b4e8c8792ee1e22b60427`. Rule list: `[]` (Enabled: `True`). {{(pid=71938) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:442}} Nov 24 16:46:19.422748 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.fernet_utils [None req-5be79f3a-76a5-4be2-9e64-2a52e7743624 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=71938) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:289}} Nov 24 16:46:19.430403 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: [pid: 71938|app: 0|req: 854/1707] 127.0.0.1 () {58 vars in 1003 bytes} [Wed Nov 24 16:46:19 2021] POST /identity/v3/auth/tokens => generated 3669 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 24 16:46:19.450872 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da992f88-b604-442f-970c-f3dbd588e455 None None] Authenticating user token {{(pid=71939) process_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 24 16:46:19.463367 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da992f88-b604-442f-970c-f3dbd588e455 None None] Validating token access rules against request {{(pid=71939) validate_allowed_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 24 16:46:19.466999 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9846baec-e47e-4f2a-80ab-9041787d32f8 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c90f21b9cdcb413282461fa83cb6b7a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3b3940d4ae1c4177ae29c02377bb4b0b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=71939) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 24 16:46:19.467650 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9846baec-e47e-4f2a-80ab-9041787d32f8 service neutron] REQUEST_METHOD: `GET` {{(pid=71939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 24 16:46:19.467986 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9846baec-e47e-4f2a-80ab-9041787d32f8 service neutron] SCRIPT_NAME: `/identity` {{(pid=71939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 24 16:46:19.468313 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9846baec-e47e-4f2a-80ab-9041787d32f8 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=71939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 24 16:46:19.477890 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9846baec-e47e-4f2a-80ab-9041787d32f8 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=71939) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:442}} Nov 24 16:46:19.506259 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9846baec-e47e-4f2a-80ab-9041787d32f8 service neutron] RBAC: Authorization granted {{(pid=71939) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 24 16:46:19.518559 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: [pid: 71939|app: 0|req: 854/1708] 10.222.0.53 () {60 vars in 1356 bytes} [Wed Nov 24 16:46:19 2021] GET /identity/v3/auth/tokens => generated 3669 bytes in 68 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 24 16:46:22.975113 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f63e3b4f-fa32-4cb0-9abc-19bdb0e35c79 None None] REQUEST_METHOD: `GET` {{(pid=71938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 24 16:46:22.975595 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f63e3b4f-fa32-4cb0-9abc-19bdb0e35c79 None None] SCRIPT_NAME: `/identity` {{(pid=71938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 24 16:46:22.975779 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f63e3b4f-fa32-4cb0-9abc-19bdb0e35c79 None None] PATH_INFO: `/` {{(pid=71938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 24 16:46:22.977624 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: [pid: 71938|app: 0|req: 855/1709] 127.0.0.1 () {54 vars in 905 bytes} [Wed Nov 24 16:46:22 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 24 16:46:22.984043 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc96a446-dc33-4097-a7a8-05c599460590 None None] REQUEST_METHOD: `POST` {{(pid=71939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 24 16:46:22.984391 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc96a446-dc33-4097-a7a8-05c599460590 None None] SCRIPT_NAME: `/identity` {{(pid=71939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 24 16:46:22.984734 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc96a446-dc33-4097-a7a8-05c599460590 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=71939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 24 16:46:23.009230 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.auth.core [None req-bc96a446-dc33-4097-a7a8-05c599460590 None None] MFA Rules not processed for user `0f2ba2e8375b4e8c8792ee1e22b60427`. Rule list: `[]` (Enabled: `True`). {{(pid=71939) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:442}} Nov 24 16:46:23.010494 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.fernet_utils [None req-bc96a446-dc33-4097-a7a8-05c599460590 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=71939) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:289}} Nov 24 16:46:23.018391 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: [pid: 71939|app: 0|req: 855/1710] 127.0.0.1 () {58 vars in 1003 bytes} [Wed Nov 24 16:46:22 2021] POST /identity/v3/auth/tokens => generated 3669 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 24 16:46:23.070325 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-270962a7-f322-49ea-b4a4-59f57672ae5e None None] REQUEST_METHOD: `POST` {{(pid=71938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 24 16:46:23.070789 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-270962a7-f322-49ea-b4a4-59f57672ae5e None None] SCRIPT_NAME: `/identity` {{(pid=71938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 24 16:46:23.071200 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-270962a7-f322-49ea-b4a4-59f57672ae5e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=71938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 24 16:46:23.095302 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.auth.core [None req-270962a7-f322-49ea-b4a4-59f57672ae5e None None] MFA Rules not processed for user `0f2ba2e8375b4e8c8792ee1e22b60427`. Rule list: `[]` (Enabled: `True`). {{(pid=71938) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:442}} Nov 24 16:46:23.096518 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.fernet_utils [None req-270962a7-f322-49ea-b4a4-59f57672ae5e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=71938) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:289}} Nov 24 16:46:23.103989 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: [pid: 71938|app: 0|req: 856/1711] 127.0.0.1 () {58 vars in 1003 bytes} [Wed Nov 24 16:46:23 2021] POST /identity/v3/auth/tokens => generated 3669 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 24 16:46:23.121629 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc96a446-dc33-4097-a7a8-05c599460590 None None] Authenticating user token {{(pid=71939) process_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 24 16:46:23.123102 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.fernet_utils [None req-bc96a446-dc33-4097-a7a8-05c599460590 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=71939) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:289}} Nov 24 16:46:23.190780 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc96a446-dc33-4097-a7a8-05c599460590 None None] Validating token access rules against request {{(pid=71939) validate_allowed_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 24 16:46:23.194762 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12cac087-84dd-4077-a8e0-a325ec38f7b1 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a12374a3093a401a97c343ff0854184d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3b3940d4ae1c4177ae29c02377bb4b0b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=71939) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 24 16:46:23.195426 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12cac087-84dd-4077-a8e0-a325ec38f7b1 service cinder] REQUEST_METHOD: `GET` {{(pid=71939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 24 16:46:23.195770 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12cac087-84dd-4077-a8e0-a325ec38f7b1 service cinder] SCRIPT_NAME: `/identity` {{(pid=71939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 24 16:46:23.196109 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12cac087-84dd-4077-a8e0-a325ec38f7b1 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=71939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 24 16:46:23.206057 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12cac087-84dd-4077-a8e0-a325ec38f7b1 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=71939) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:442}} Nov 24 16:46:23.235267 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12cac087-84dd-4077-a8e0-a325ec38f7b1 service cinder] RBAC: Authorization granted {{(pid=71939) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 24 16:46:23.247499 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: [pid: 71939|app: 0|req: 856/1712] 10.222.0.53 () {60 vars in 1356 bytes} [Wed Nov 24 16:46:23 2021] GET /identity/v3/auth/tokens => generated 3669 bytes in 126 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 24 16:46:25.272377 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56b43c28-ae75-4ec2-b10e-23c831ca7e69 None None] REQUEST_METHOD: `GET` {{(pid=71938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 24 16:46:25.272873 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56b43c28-ae75-4ec2-b10e-23c831ca7e69 None None] SCRIPT_NAME: `/identity` {{(pid=71938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 24 16:46:25.273007 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56b43c28-ae75-4ec2-b10e-23c831ca7e69 None None] PATH_INFO: `/` {{(pid=71938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 24 16:46:25.274878 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: [pid: 71938|app: 0|req: 857/1713] 127.0.0.1 () {54 vars in 905 bytes} [Wed Nov 24 16:46:25 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 24 16:46:25.281454 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfb7f1e4-dadc-4afc-8214-b59344d1ca55 None None] REQUEST_METHOD: `POST` {{(pid=71939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 24 16:46:25.281847 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfb7f1e4-dadc-4afc-8214-b59344d1ca55 None None] SCRIPT_NAME: `/identity` {{(pid=71939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 24 16:46:25.282214 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfb7f1e4-dadc-4afc-8214-b59344d1ca55 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=71939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 24 16:46:25.306791 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.auth.core [None req-bfb7f1e4-dadc-4afc-8214-b59344d1ca55 None None] MFA Rules not processed for user `0f2ba2e8375b4e8c8792ee1e22b60427`. Rule list: `[]` (Enabled: `True`). {{(pid=71939) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:442}} Nov 24 16:46:25.308609 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.fernet_utils [None req-bfb7f1e4-dadc-4afc-8214-b59344d1ca55 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=71939) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:289}} Nov 24 16:46:25.316724 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: [pid: 71939|app: 0|req: 857/1714] 127.0.0.1 () {58 vars in 1003 bytes} [Wed Nov 24 16:46:25 2021] POST /identity/v3/auth/tokens => generated 3669 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 24 16:46:25.369085 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7304c000-5b82-4170-9727-b4b302db7d31 None None] REQUEST_METHOD: `POST` {{(pid=71938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 24 16:46:25.369446 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7304c000-5b82-4170-9727-b4b302db7d31 None None] SCRIPT_NAME: `/identity` {{(pid=71938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 24 16:46:25.369776 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7304c000-5b82-4170-9727-b4b302db7d31 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=71938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 24 16:46:25.393145 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.auth.core [None req-7304c000-5b82-4170-9727-b4b302db7d31 None None] MFA Rules not processed for user `0f2ba2e8375b4e8c8792ee1e22b60427`. Rule list: `[]` (Enabled: `True`). {{(pid=71938) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:442}} Nov 24 16:46:25.394378 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.fernet_utils [None req-7304c000-5b82-4170-9727-b4b302db7d31 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=71938) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:289}} Nov 24 16:46:25.403777 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: [pid: 71938|app: 0|req: 858/1715] 127.0.0.1 () {58 vars in 1003 bytes} [Wed Nov 24 16:46:25 2021] POST /identity/v3/auth/tokens => generated 3669 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 24 16:46:25.417786 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4df85747-b630-4b53-96c0-e0516d0632c9 None None] REQUEST_METHOD: `GET` {{(pid=71939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 24 16:46:25.418181 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4df85747-b630-4b53-96c0-e0516d0632c9 None None] SCRIPT_NAME: `/identity` {{(pid=71939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 24 16:46:25.418522 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4df85747-b630-4b53-96c0-e0516d0632c9 None None] PATH_INFO: `/` {{(pid=71939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 24 16:46:25.420368 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: [pid: 71939|app: 0|req: 858/1716] 10.222.0.53 () {54 vars in 950 bytes} [Wed Nov 24 16:46:25 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 24 16:46:25.425711 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-711d345f-2e74-459a-ae37-fd393fb3cf9c None None] REQUEST_METHOD: `POST` {{(pid=71938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 24 16:46:25.426105 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-711d345f-2e74-459a-ae37-fd393fb3cf9c None None] SCRIPT_NAME: `/identity` {{(pid=71938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 24 16:46:25.426451 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-711d345f-2e74-459a-ae37-fd393fb3cf9c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=71938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 24 16:46:25.450497 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.auth.core [None req-711d345f-2e74-459a-ae37-fd393fb3cf9c None None] MFA Rules not processed for user `a12374a3093a401a97c343ff0854184d`. Rule list: `[]` (Enabled: `True`). {{(pid=71938) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:442}} Nov 24 16:46:25.451721 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.fernet_utils [None req-711d345f-2e74-459a-ae37-fd393fb3cf9c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=71938) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:289}} Nov 24 16:46:25.458313 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: [pid: 71938|app: 0|req: 859/1717] 10.222.0.53 () {58 vars in 1048 bytes} [Wed Nov 24 16:46:25 2021] POST /identity/v3/auth/tokens => generated 3550 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 24 16:46:25.467776 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4df85747-b630-4b53-96c0-e0516d0632c9 None None] Authenticating user token {{(pid=71939) process_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 24 16:46:25.481023 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4df85747-b630-4b53-96c0-e0516d0632c9 None None] Validating token access rules against request {{(pid=71939) validate_allowed_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 24 16:46:25.484375 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3afc4e3-7c7f-43b5-bc31-9ddd4ee5f1bb service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a12374a3093a401a97c343ff0854184d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3b3940d4ae1c4177ae29c02377bb4b0b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=71939) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 24 16:46:25.485022 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3afc4e3-7c7f-43b5-bc31-9ddd4ee5f1bb service cinder] REQUEST_METHOD: `GET` {{(pid=71939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 24 16:46:25.485360 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3afc4e3-7c7f-43b5-bc31-9ddd4ee5f1bb service cinder] SCRIPT_NAME: `/identity` {{(pid=71939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 24 16:46:25.485735 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3afc4e3-7c7f-43b5-bc31-9ddd4ee5f1bb service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=71939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 24 16:46:25.495083 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3afc4e3-7c7f-43b5-bc31-9ddd4ee5f1bb service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=71939) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:442}} Nov 24 16:46:25.523982 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3afc4e3-7c7f-43b5-bc31-9ddd4ee5f1bb service cinder] RBAC: Authorization granted {{(pid=71939) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 24 16:46:25.534302 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: [pid: 71939|app: 0|req: 859/1718] 10.222.0.53 () {60 vars in 1356 bytes} [Wed Nov 24 16:46:25 2021] GET /identity/v3/auth/tokens => generated 3669 bytes in 67 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 24 16:48:07.636761 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-342526d1-8355-441c-bab0-bb8019bcc2df None None] REQUEST_METHOD: `POST` {{(pid=71938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 24 16:48:07.637336 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-342526d1-8355-441c-bab0-bb8019bcc2df None None] SCRIPT_NAME: `/identity` {{(pid=71938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 24 16:48:07.637433 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-342526d1-8355-441c-bab0-bb8019bcc2df None None] PATH_INFO: `/v3/auth/tokens` {{(pid=71938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 24 16:48:07.676253 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.auth.core [None req-342526d1-8355-441c-bab0-bb8019bcc2df None None] MFA Rules not processed for user `0f2ba2e8375b4e8c8792ee1e22b60427`. Rule list: `[]` (Enabled: `True`). {{(pid=71938) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:442}} Nov 24 16:48:07.677553 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.fernet_utils [None req-342526d1-8355-441c-bab0-bb8019bcc2df None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=71938) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:289}} Nov 24 16:48:07.695016 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: [pid: 71938|app: 0|req: 860/1719] 10.222.0.53 () {58 vars in 948 bytes} [Wed Nov 24 16:48:07 2021] POST /identity/v3/auth/tokens => generated 3669 bytes in 59 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 24 16:48:07.705566 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-427c589c-019e-4857-a244-1d3c938a513e None None] REQUEST_METHOD: `POST` {{(pid=71939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 24 16:48:07.705908 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-427c589c-019e-4857-a244-1d3c938a513e None None] SCRIPT_NAME: `/identity` {{(pid=71939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 24 16:48:07.706277 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-427c589c-019e-4857-a244-1d3c938a513e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=71939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 24 16:48:07.744352 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.auth.core [None req-427c589c-019e-4857-a244-1d3c938a513e None None] MFA Rules not processed for user `0f2ba2e8375b4e8c8792ee1e22b60427`. Rule list: `[]` (Enabled: `True`). {{(pid=71939) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:442}} Nov 24 16:48:07.745637 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.fernet_utils [None req-427c589c-019e-4857-a244-1d3c938a513e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=71939) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:289}} Nov 24 16:48:07.754803 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: [pid: 71939|app: 0|req: 860/1720] 10.222.0.53 () {58 vars in 948 bytes} [Wed Nov 24 16:48:07 2021] POST /identity/v3/auth/tokens => generated 3669 bytes in 50 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 24 16:48:07.760124 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-342526d1-8355-441c-bab0-bb8019bcc2df None None] Authenticating user token {{(pid=71938) process_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 24 16:48:07.771233 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-342526d1-8355-441c-bab0-bb8019bcc2df None None] Validating token access rules against request {{(pid=71938) validate_allowed_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 24 16:48:07.779675 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-460d43ea-c7a3-414e-9a08-57ddfd979f2f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f2ba2e8375b4e8c8792ee1e22b60427', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '00a5583c7b7443e98e7a1d31a0b638dc', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=71938) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 24 16:48:07.780382 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-460d43ea-c7a3-414e-9a08-57ddfd979f2f admin admin] REQUEST_METHOD: `GET` {{(pid=71938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 24 16:48:07.780731 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-460d43ea-c7a3-414e-9a08-57ddfd979f2f admin admin] SCRIPT_NAME: `/identity` {{(pid=71938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 24 16:48:07.781072 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-460d43ea-c7a3-414e-9a08-57ddfd979f2f admin admin] PATH_INFO: `/v3/domains` {{(pid=71938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 24 16:48:07.781886 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-460d43ea-c7a3-414e-9a08-57ddfd979f2f admin admin] RBAC: Adding query filter params (name=Default) {{(pid=71938) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:161}} Nov 24 16:48:07.782297 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-460d43ea-c7a3-414e-9a08-57ddfd979f2f admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=71938) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:442}} Nov 24 16:48:07.815705 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-460d43ea-c7a3-414e-9a08-57ddfd979f2f admin admin] RBAC: Authorization granted {{(pid=71938) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 24 16:48:07.832901 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: [pid: 71938|app: 0|req: 861/1721] 10.222.0.53 () {58 vars in 1143 bytes} [Wed Nov 24 16:48:07 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 73 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 24 16:48:07.841610 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dffeb79-55da-4e67-8d78-7d1d08fbced5 None None] REQUEST_METHOD: `POST` {{(pid=71939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 24 16:48:07.841965 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dffeb79-55da-4e67-8d78-7d1d08fbced5 None None] SCRIPT_NAME: `/identity` {{(pid=71939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 24 16:48:07.842337 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dffeb79-55da-4e67-8d78-7d1d08fbced5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=71939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 24 16:48:07.857996 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-460d43ea-c7a3-414e-9a08-57ddfd979f2f admin admin] Authenticating user token {{(pid=71938) process_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 24 16:48:07.877819 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-460d43ea-c7a3-414e-9a08-57ddfd979f2f admin admin] Validating token access rules against request {{(pid=71938) validate_allowed_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 24 16:48:07.885886 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.auth.core [None req-7dffeb79-55da-4e67-8d78-7d1d08fbced5 None None] MFA Rules not processed for user `0f2ba2e8375b4e8c8792ee1e22b60427`. Rule list: `[]` (Enabled: `True`). {{(pid=71939) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:442}} Nov 24 16:48:07.887168 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.fernet_utils [None req-7dffeb79-55da-4e67-8d78-7d1d08fbced5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=71939) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:289}} Nov 24 16:48:07.892098 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23fde152-83ce-4a5f-8092-b45ff1056e06 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f2ba2e8375b4e8c8792ee1e22b60427', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '00a5583c7b7443e98e7a1d31a0b638dc', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=71938) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 24 16:48:07.893140 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23fde152-83ce-4a5f-8092-b45ff1056e06 admin admin] REQUEST_METHOD: `POST` {{(pid=71938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 24 16:48:07.893689 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23fde152-83ce-4a5f-8092-b45ff1056e06 admin admin] SCRIPT_NAME: `/identity` {{(pid=71938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 24 16:48:07.894279 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23fde152-83ce-4a5f-8092-b45ff1056e06 admin admin] PATH_INFO: `/v3/projects` {{(pid=71938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 24 16:48:07.895390 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23fde152-83ce-4a5f-8092-b45ff1056e06 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=71938) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:442}} Nov 24 16:48:07.914052 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: [pid: 71939|app: 0|req: 861/1722] 10.222.0.53 () {58 vars in 948 bytes} [Wed Nov 24 16:48:07 2021] POST /identity/v3/auth/tokens => generated 3669 bytes in 68 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 24 16:48:07.914052 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ccb4b22-5a6a-482e-8db2-317ea4322371 None None] REQUEST_METHOD: `POST` {{(pid=71939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 24 16:48:07.914052 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ccb4b22-5a6a-482e-8db2-317ea4322371 None None] SCRIPT_NAME: `/identity` {{(pid=71939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 24 16:48:07.914052 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ccb4b22-5a6a-482e-8db2-317ea4322371 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=71939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 24 16:48:07.935806 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23fde152-83ce-4a5f-8092-b45ff1056e06 admin admin] RBAC: Authorization granted {{(pid=71938) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 24 16:48:07.945079 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.auth.core [None req-8ccb4b22-5a6a-482e-8db2-317ea4322371 None None] MFA Rules not processed for user `0f2ba2e8375b4e8c8792ee1e22b60427`. Rule list: `[]` (Enabled: `True`). {{(pid=71939) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:442}} Nov 24 16:48:07.946895 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.fernet_utils [None req-8ccb4b22-5a6a-482e-8db2-317ea4322371 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=71939) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:289}} Nov 24 16:48:07.967216 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: [pid: 71939|app: 0|req: 862/1723] 10.222.0.53 () {58 vars in 948 bytes} [Wed Nov 24 16:48:07 2021] POST /identity/v3/auth/tokens => generated 3669 bytes in 59 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 24 16:48:07.968592 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1199c41a-dd2b-4911-a5b2-5684ff648f34 None None] REQUEST_METHOD: `POST` {{(pid=71939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 24 16:48:07.968949 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1199c41a-dd2b-4911-a5b2-5684ff648f34 None None] SCRIPT_NAME: `/identity` {{(pid=71939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 24 16:48:07.969290 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1199c41a-dd2b-4911-a5b2-5684ff648f34 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=71939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 24 16:48:07.985251 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: [pid: 71938|app: 0|req: 862/1724] 10.222.0.53 () {60 vars in 1143 bytes} [Wed Nov 24 16:48:07 2021] POST /identity/v3/projects => generated 375 bytes in 128 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 24 16:48:07.987097 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-188d0c2f-bf64-47b3-a62c-f5939a928975 None None] REQUEST_METHOD: `POST` {{(pid=71938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 24 16:48:07.987655 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-188d0c2f-bf64-47b3-a62c-f5939a928975 None None] SCRIPT_NAME: `/identity` {{(pid=71938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 24 16:48:07.988591 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-188d0c2f-bf64-47b3-a62c-f5939a928975 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=71938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 24 16:48:08.006068 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.auth.core [None req-1199c41a-dd2b-4911-a5b2-5684ff648f34 None None] MFA Rules not processed for user `0f2ba2e8375b4e8c8792ee1e22b60427`. Rule list: `[]` (Enabled: `True`). {{(pid=71939) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:442}} Nov 24 16:48:08.006665 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.fernet_utils [None req-1199c41a-dd2b-4911-a5b2-5684ff648f34 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=71939) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:289}} Nov 24 16:48:08.018407 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.auth.core [None req-188d0c2f-bf64-47b3-a62c-f5939a928975 None None] MFA Rules not processed for user `0f2ba2e8375b4e8c8792ee1e22b60427`. Rule list: `[]` (Enabled: `True`). {{(pid=71938) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:442}} Nov 24 16:48:08.019646 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.fernet_utils [None req-188d0c2f-bf64-47b3-a62c-f5939a928975 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=71938) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:289}} Nov 24 16:48:08.087563 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: [pid: 71939|app: 0|req: 863/1725] 10.222.0.53 () {58 vars in 948 bytes} [Wed Nov 24 16:48:07 2021] POST /identity/v3/auth/tokens => generated 3669 bytes in 120 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 24 16:48:08.088848 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7521af68-fc65-4f9e-93ea-5ad1e8ddc8d3 None None] REQUEST_METHOD: `POST` {{(pid=71939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 24 16:48:08.089204 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7521af68-fc65-4f9e-93ea-5ad1e8ddc8d3 None None] SCRIPT_NAME: `/identity` {{(pid=71939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 24 16:48:08.089541 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7521af68-fc65-4f9e-93ea-5ad1e8ddc8d3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=71939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 24 16:48:08.101569 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: [pid: 71938|app: 0|req: 863/1726] 10.222.0.53 () {58 vars in 948 bytes} [Wed Nov 24 16:48:07 2021] POST /identity/v3/auth/tokens => generated 3669 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 24 16:48:08.103968 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6782285f-6922-4152-a301-3194d134a572 None None] REQUEST_METHOD: `POST` {{(pid=71938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 24 16:48:08.104410 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6782285f-6922-4152-a301-3194d134a572 None None] SCRIPT_NAME: `/identity` {{(pid=71938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 24 16:48:08.104749 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6782285f-6922-4152-a301-3194d134a572 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=71938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 24 16:48:08.113855 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.auth.core [None req-7521af68-fc65-4f9e-93ea-5ad1e8ddc8d3 None None] MFA Rules not processed for user `0f2ba2e8375b4e8c8792ee1e22b60427`. Rule list: `[]` (Enabled: `True`). {{(pid=71939) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:442}} Nov 24 16:48:08.115272 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.fernet_utils [None req-7521af68-fc65-4f9e-93ea-5ad1e8ddc8d3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=71939) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:289}} Nov 24 16:48:08.122864 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: [pid: 71939|app: 0|req: 864/1727] 10.222.0.53 () {58 vars in 948 bytes} [Wed Nov 24 16:48:08 2021] POST /identity/v3/auth/tokens => generated 3669 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 24 16:48:08.124553 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7521af68-fc65-4f9e-93ea-5ad1e8ddc8d3 None None] Authenticating user token {{(pid=71939) process_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 24 16:48:08.131268 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.auth.core [None req-6782285f-6922-4152-a301-3194d134a572 None None] MFA Rules not processed for user `0f2ba2e8375b4e8c8792ee1e22b60427`. Rule list: `[]` (Enabled: `True`). {{(pid=71938) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:442}} Nov 24 16:48:08.132676 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.fernet_utils [None req-6782285f-6922-4152-a301-3194d134a572 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=71938) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:289}} Nov 24 16:48:08.134589 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7521af68-fc65-4f9e-93ea-5ad1e8ddc8d3 None None] Validating token access rules against request {{(pid=71939) validate_allowed_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 24 16:48:08.139230 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d53c9a2a-3564-44f6-9467-e4b6d17ffbac admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f2ba2e8375b4e8c8792ee1e22b60427', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '00a5583c7b7443e98e7a1d31a0b638dc', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=71939) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 24 16:48:08.139899 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d53c9a2a-3564-44f6-9467-e4b6d17ffbac admin admin] REQUEST_METHOD: `POST` {{(pid=71939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 24 16:48:08.140233 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d53c9a2a-3564-44f6-9467-e4b6d17ffbac admin admin] SCRIPT_NAME: `/identity` {{(pid=71939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 24 16:48:08.140561 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d53c9a2a-3564-44f6-9467-e4b6d17ffbac admin admin] PATH_INFO: `/v3/users` {{(pid=71939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 24 16:48:08.140685 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: [pid: 71938|app: 0|req: 864/1728] 10.222.0.53 () {58 vars in 948 bytes} [Wed Nov 24 16:48:08 2021] POST /identity/v3/auth/tokens => generated 3669 bytes in 38 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 24 16:48:08.141313 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d53c9a2a-3564-44f6-9467-e4b6d17ffbac admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=71939) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:442}} Nov 24 16:48:08.141845 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2b87f3e-66e1-4937-ad53-024c4bdbbb59 None None] REQUEST_METHOD: `POST` {{(pid=71938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 24 16:48:08.142226 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2b87f3e-66e1-4937-ad53-024c4bdbbb59 None None] SCRIPT_NAME: `/identity` {{(pid=71938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 24 16:48:08.142565 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2b87f3e-66e1-4937-ad53-024c4bdbbb59 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=71938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 24 16:48:08.167829 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.auth.core [None req-c2b87f3e-66e1-4937-ad53-024c4bdbbb59 None None] MFA Rules not processed for user `0f2ba2e8375b4e8c8792ee1e22b60427`. Rule list: `[]` (Enabled: `True`). {{(pid=71938) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:442}} Nov 24 16:48:08.169035 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.fernet_utils [None req-c2b87f3e-66e1-4937-ad53-024c4bdbbb59 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=71938) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:289}} Nov 24 16:48:08.171586 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d53c9a2a-3564-44f6-9467-e4b6d17ffbac admin admin] RBAC: Authorization granted {{(pid=71939) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 24 16:48:08.177263 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: [pid: 71938|app: 0|req: 865/1729] 10.222.0.53 () {58 vars in 948 bytes} [Wed Nov 24 16:48:08 2021] POST /identity/v3/auth/tokens => generated 3669 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 24 16:48:08.178669 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e84dc4b1-80ba-4d35-9b57-d963651fbb13 None None] REQUEST_METHOD: `POST` {{(pid=71938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 24 16:48:08.179017 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e84dc4b1-80ba-4d35-9b57-d963651fbb13 None None] SCRIPT_NAME: `/identity` {{(pid=71938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 24 16:48:08.179350 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e84dc4b1-80ba-4d35-9b57-d963651fbb13 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=71938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 24 16:48:08.201659 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: [pid: 71939|app: 0|req: 865/1730] 10.222.0.53 () {60 vars in 1134 bytes} [Wed Nov 24 16:48:08 2021] POST /identity/v3/users => generated 288 bytes in 78 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 24 16:48:08.203589 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a805c311-1692-4513-afc1-f1714d1c0092 None None] REQUEST_METHOD: `POST` {{(pid=71939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 24 16:48:08.203589 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a805c311-1692-4513-afc1-f1714d1c0092 None None] SCRIPT_NAME: `/identity` {{(pid=71939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 24 16:48:08.203807 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a805c311-1692-4513-afc1-f1714d1c0092 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=71939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 24 16:48:08.211055 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.auth.core [None req-e84dc4b1-80ba-4d35-9b57-d963651fbb13 None None] MFA Rules not processed for user `0f2ba2e8375b4e8c8792ee1e22b60427`. Rule list: `[]` (Enabled: `True`). {{(pid=71938) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:442}} Nov 24 16:48:08.212859 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.fernet_utils [None req-e84dc4b1-80ba-4d35-9b57-d963651fbb13 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=71938) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:289}} Nov 24 16:48:08.221285 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: [pid: 71938|app: 0|req: 866/1731] 10.222.0.53 () {58 vars in 948 bytes} [Wed Nov 24 16:48:08 2021] POST /identity/v3/auth/tokens => generated 3669 bytes in 43 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 24 16:48:08.222429 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8a6a63e-a043-491e-94e9-a86baa9ca2e5 None None] REQUEST_METHOD: `POST` {{(pid=71938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 24 16:48:08.222778 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8a6a63e-a043-491e-94e9-a86baa9ca2e5 None None] SCRIPT_NAME: `/identity` {{(pid=71938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 24 16:48:08.223113 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8a6a63e-a043-491e-94e9-a86baa9ca2e5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=71938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 24 16:48:08.229410 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.auth.core [None req-a805c311-1692-4513-afc1-f1714d1c0092 None None] MFA Rules not processed for user `0f2ba2e8375b4e8c8792ee1e22b60427`. Rule list: `[]` (Enabled: `True`). {{(pid=71939) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:442}} Nov 24 16:48:08.230676 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.fernet_utils [None req-a805c311-1692-4513-afc1-f1714d1c0092 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=71939) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:289}} Nov 24 16:48:08.239872 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: [pid: 71939|app: 0|req: 866/1732] 10.222.0.53 () {58 vars in 948 bytes} [Wed Nov 24 16:48:08 2021] POST /identity/v3/auth/tokens => generated 3669 bytes in 37 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 24 16:48:08.246782 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-095dd90b-d8b8-428a-9ef0-3aac292b8934 None None] REQUEST_METHOD: `POST` {{(pid=71939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 24 16:48:08.247360 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-095dd90b-d8b8-428a-9ef0-3aac292b8934 None None] SCRIPT_NAME: `/identity` {{(pid=71939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 24 16:48:08.247492 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.auth.core [None req-c8a6a63e-a043-491e-94e9-a86baa9ca2e5 None None] MFA Rules not processed for user `0f2ba2e8375b4e8c8792ee1e22b60427`. Rule list: `[]` (Enabled: `True`). {{(pid=71938) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:442}} Nov 24 16:48:08.247739 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-095dd90b-d8b8-428a-9ef0-3aac292b8934 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=71939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 24 16:48:08.248588 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.fernet_utils [None req-c8a6a63e-a043-491e-94e9-a86baa9ca2e5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=71938) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:289}} Nov 24 16:48:08.256414 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: [pid: 71938|app: 0|req: 867/1733] 10.222.0.53 () {58 vars in 948 bytes} [Wed Nov 24 16:48:08 2021] POST /identity/v3/auth/tokens => generated 3669 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 24 16:48:08.257257 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8a6a63e-a043-491e-94e9-a86baa9ca2e5 None None] Authenticating user token {{(pid=71938) process_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 24 16:48:08.266823 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8a6a63e-a043-491e-94e9-a86baa9ca2e5 None None] Validating token access rules against request {{(pid=71938) validate_allowed_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 24 16:48:08.271351 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42c8a6a0-cc31-4e97-8f84-936eb5992efa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f2ba2e8375b4e8c8792ee1e22b60427', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '00a5583c7b7443e98e7a1d31a0b638dc', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=71938) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 24 16:48:08.272016 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42c8a6a0-cc31-4e97-8f84-936eb5992efa admin admin] REQUEST_METHOD: `GET` {{(pid=71938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 24 16:48:08.272243 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.auth.core [None req-095dd90b-d8b8-428a-9ef0-3aac292b8934 None None] MFA Rules not processed for user `0f2ba2e8375b4e8c8792ee1e22b60427`. Rule list: `[]` (Enabled: `True`). {{(pid=71939) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:442}} Nov 24 16:48:08.272372 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42c8a6a0-cc31-4e97-8f84-936eb5992efa admin admin] SCRIPT_NAME: `/identity` {{(pid=71938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 24 16:48:08.272660 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42c8a6a0-cc31-4e97-8f84-936eb5992efa admin admin] PATH_INFO: `/v3/domains` {{(pid=71938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 24 16:48:08.273443 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42c8a6a0-cc31-4e97-8f84-936eb5992efa admin admin] RBAC: Adding query filter params (name=Default) {{(pid=71938) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:161}} Nov 24 16:48:08.273574 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.fernet_utils [None req-095dd90b-d8b8-428a-9ef0-3aac292b8934 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=71939) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:289}} Nov 24 16:48:08.274362 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42c8a6a0-cc31-4e97-8f84-936eb5992efa admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=71938) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:442}} Nov 24 16:48:08.281744 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: [pid: 71939|app: 0|req: 867/1734] 10.222.0.53 () {58 vars in 948 bytes} [Wed Nov 24 16:48:08 2021] POST /identity/v3/auth/tokens => generated 3669 bytes in 41 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 24 16:48:08.282732 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-095dd90b-d8b8-428a-9ef0-3aac292b8934 None None] Authenticating user token {{(pid=71939) process_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 24 16:48:08.293151 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-095dd90b-d8b8-428a-9ef0-3aac292b8934 None None] Validating token access rules against request {{(pid=71939) validate_allowed_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 24 16:48:08.298525 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0401bf4f-3744-4183-8ecb-29da88f82fc4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f2ba2e8375b4e8c8792ee1e22b60427', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '00a5583c7b7443e98e7a1d31a0b638dc', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=71939) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 24 16:48:08.299171 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0401bf4f-3744-4183-8ecb-29da88f82fc4 admin admin] REQUEST_METHOD: `GET` {{(pid=71939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 24 16:48:08.299505 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0401bf4f-3744-4183-8ecb-29da88f82fc4 admin admin] SCRIPT_NAME: `/identity` {{(pid=71939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 24 16:48:08.299833 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0401bf4f-3744-4183-8ecb-29da88f82fc4 admin admin] PATH_INFO: `/v3/domains` {{(pid=71939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 24 16:48:08.300605 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0401bf4f-3744-4183-8ecb-29da88f82fc4 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=71939) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:161}} Nov 24 16:48:08.300949 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0401bf4f-3744-4183-8ecb-29da88f82fc4 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=71939) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:442}} Nov 24 16:48:08.303217 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42c8a6a0-cc31-4e97-8f84-936eb5992efa admin admin] RBAC: Authorization granted {{(pid=71938) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 24 16:48:08.318386 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: [pid: 71938|app: 0|req: 868/1735] 10.222.0.53 () {58 vars in 1143 bytes} [Wed Nov 24 16:48:08 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 61 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 24 16:48:08.319527 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9cf61f4-e6af-43cd-be8f-9dd3f0828f08 None None] REQUEST_METHOD: `POST` {{(pid=71938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 24 16:48:08.319875 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9cf61f4-e6af-43cd-be8f-9dd3f0828f08 None None] SCRIPT_NAME: `/identity` {{(pid=71938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 24 16:48:08.320211 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9cf61f4-e6af-43cd-be8f-9dd3f0828f08 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=71938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 24 16:48:08.329809 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0401bf4f-3744-4183-8ecb-29da88f82fc4 admin admin] RBAC: Authorization granted {{(pid=71939) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 24 16:48:08.344803 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: [pid: 71939|app: 0|req: 868/1736] 10.222.0.53 () {58 vars in 1143 bytes} [Wed Nov 24 16:48:08 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 62 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 24 16:48:08.345628 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0401bf4f-3744-4183-8ecb-29da88f82fc4 admin admin] Authenticating user token {{(pid=71939) process_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 24 16:48:08.354797 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.auth.core [None req-f9cf61f4-e6af-43cd-be8f-9dd3f0828f08 None None] MFA Rules not processed for user `0f2ba2e8375b4e8c8792ee1e22b60427`. Rule list: `[]` (Enabled: `True`). {{(pid=71938) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:442}} Nov 24 16:48:08.355843 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0401bf4f-3744-4183-8ecb-29da88f82fc4 admin admin] Validating token access rules against request {{(pid=71939) validate_allowed_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 24 16:48:08.356229 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.fernet_utils [None req-f9cf61f4-e6af-43cd-be8f-9dd3f0828f08 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=71938) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:289}} Nov 24 16:48:08.360401 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df566b5c-8cee-4c1f-8b02-f0c50733af87 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f2ba2e8375b4e8c8792ee1e22b60427', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '00a5583c7b7443e98e7a1d31a0b638dc', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=71939) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 24 16:48:08.361060 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df566b5c-8cee-4c1f-8b02-f0c50733af87 admin admin] REQUEST_METHOD: `GET` {{(pid=71939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 24 16:48:08.361392 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df566b5c-8cee-4c1f-8b02-f0c50733af87 admin admin] SCRIPT_NAME: `/identity` {{(pid=71939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 24 16:48:08.361724 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df566b5c-8cee-4c1f-8b02-f0c50733af87 admin admin] PATH_INFO: `/v3/roles` {{(pid=71939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 24 16:48:08.362533 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df566b5c-8cee-4c1f-8b02-f0c50733af87 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=71939) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:442}} Nov 24 16:48:08.364056 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: [pid: 71938|app: 0|req: 869/1737] 10.222.0.53 () {58 vars in 948 bytes} [Wed Nov 24 16:48:08 2021] POST /identity/v3/auth/tokens => generated 3669 bytes in 45 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 24 16:48:08.365333 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb2bb47f-1dec-4fcf-bf74-9fee5dae7a50 None None] REQUEST_METHOD: `POST` {{(pid=71938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 24 16:48:08.365681 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb2bb47f-1dec-4fcf-bf74-9fee5dae7a50 None None] SCRIPT_NAME: `/identity` {{(pid=71938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 24 16:48:08.366015 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb2bb47f-1dec-4fcf-bf74-9fee5dae7a50 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=71938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 24 16:48:08.390662 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.auth.core [None req-fb2bb47f-1dec-4fcf-bf74-9fee5dae7a50 None None] MFA Rules not processed for user `0f2ba2e8375b4e8c8792ee1e22b60427`. Rule list: `[]` (Enabled: `True`). {{(pid=71938) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:442}} Nov 24 16:48:08.391539 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.fernet_utils [None req-fb2bb47f-1dec-4fcf-bf74-9fee5dae7a50 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=71938) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:289}} Nov 24 16:48:08.393188 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df566b5c-8cee-4c1f-8b02-f0c50733af87 admin admin] RBAC: Authorization granted {{(pid=71939) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 24 16:48:08.399223 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: [pid: 71938|app: 0|req: 870/1738] 10.222.0.53 () {58 vars in 948 bytes} [Wed Nov 24 16:48:08 2021] POST /identity/v3/auth/tokens => generated 3669 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 24 16:48:08.401218 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b6c8638-5bcd-42ef-91c1-5fb0da64fc8f None None] REQUEST_METHOD: `POST` {{(pid=71938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 24 16:48:08.401554 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b6c8638-5bcd-42ef-91c1-5fb0da64fc8f None None] SCRIPT_NAME: `/identity` {{(pid=71938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 24 16:48:08.401880 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b6c8638-5bcd-42ef-91c1-5fb0da64fc8f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=71938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 24 16:48:08.404812 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: [pid: 71939|app: 0|req: 869/1739] 10.222.0.53 () {58 vars in 1112 bytes} [Wed Nov 24 16:48:08 2021] GET /identity/v3/roles => generated 1420 bytes in 60 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 24 16:48:08.405680 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df566b5c-8cee-4c1f-8b02-f0c50733af87 admin admin] Authenticating user token {{(pid=71939) process_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 24 16:48:08.416156 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df566b5c-8cee-4c1f-8b02-f0c50733af87 admin admin] Validating token access rules against request {{(pid=71939) validate_allowed_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 24 16:48:08.422169 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65718a49-cb7a-4269-93a0-4a08922b931e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f2ba2e8375b4e8c8792ee1e22b60427', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '00a5583c7b7443e98e7a1d31a0b638dc', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=71939) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 24 16:48:08.422835 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65718a49-cb7a-4269-93a0-4a08922b931e admin admin] REQUEST_METHOD: `GET` {{(pid=71939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 24 16:48:08.423181 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65718a49-cb7a-4269-93a0-4a08922b931e admin admin] SCRIPT_NAME: `/identity` {{(pid=71939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 24 16:48:08.423520 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65718a49-cb7a-4269-93a0-4a08922b931e admin admin] PATH_INFO: `/v3/domains` {{(pid=71939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 24 16:48:08.424306 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65718a49-cb7a-4269-93a0-4a08922b931e admin admin] RBAC: Adding query filter params (name=Default) {{(pid=71939) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:161}} Nov 24 16:48:08.424664 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65718a49-cb7a-4269-93a0-4a08922b931e admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=71939) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:442}} Nov 24 16:48:08.425590 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.auth.core [None req-6b6c8638-5bcd-42ef-91c1-5fb0da64fc8f None None] MFA Rules not processed for user `0f2ba2e8375b4e8c8792ee1e22b60427`. Rule list: `[]` (Enabled: `True`). {{(pid=71938) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:442}} Nov 24 16:48:08.426860 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.fernet_utils [None req-6b6c8638-5bcd-42ef-91c1-5fb0da64fc8f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=71938) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:289}} Nov 24 16:48:08.435964 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: [pid: 71938|app: 0|req: 871/1740] 10.222.0.53 () {58 vars in 948 bytes} [Wed Nov 24 16:48:08 2021] POST /identity/v3/auth/tokens => generated 3669 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 24 16:48:08.436812 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b6c8638-5bcd-42ef-91c1-5fb0da64fc8f None None] Authenticating user token {{(pid=71938) process_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 24 16:48:08.447243 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b6c8638-5bcd-42ef-91c1-5fb0da64fc8f None None] Validating token access rules against request {{(pid=71938) validate_allowed_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 24 16:48:08.451785 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0aace5b-dcce-40ed-892f-8e2f6e9707db admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f2ba2e8375b4e8c8792ee1e22b60427', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '00a5583c7b7443e98e7a1d31a0b638dc', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=71938) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 24 16:48:08.452435 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0aace5b-dcce-40ed-892f-8e2f6e9707db admin admin] REQUEST_METHOD: `GET` {{(pid=71938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 24 16:48:08.452769 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0aace5b-dcce-40ed-892f-8e2f6e9707db admin admin] SCRIPT_NAME: `/identity` {{(pid=71938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 24 16:48:08.453097 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0aace5b-dcce-40ed-892f-8e2f6e9707db admin admin] PATH_INFO: `/v3/domains` {{(pid=71938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 24 16:48:08.453864 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0aace5b-dcce-40ed-892f-8e2f6e9707db admin admin] RBAC: Adding query filter params (name=Default) {{(pid=71938) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:161}} Nov 24 16:48:08.454144 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65718a49-cb7a-4269-93a0-4a08922b931e admin admin] RBAC: Authorization granted {{(pid=71939) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 24 16:48:08.454266 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0aace5b-dcce-40ed-892f-8e2f6e9707db admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=71938) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:442}} Nov 24 16:48:08.468681 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: [pid: 71939|app: 0|req: 870/1741] 10.222.0.53 () {58 vars in 1143 bytes} [Wed Nov 24 16:48:08 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 63 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 24 16:48:08.469361 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65718a49-cb7a-4269-93a0-4a08922b931e admin admin] Authenticating user token {{(pid=71939) process_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 24 16:48:08.479536 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65718a49-cb7a-4269-93a0-4a08922b931e admin admin] Validating token access rules against request {{(pid=71939) validate_allowed_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 24 16:48:08.483040 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0aace5b-dcce-40ed-892f-8e2f6e9707db admin admin] RBAC: Authorization granted {{(pid=71938) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 24 16:48:08.484213 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb293729-a4d1-4bde-a0c2-89c8ea3d8f12 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f2ba2e8375b4e8c8792ee1e22b60427', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '00a5583c7b7443e98e7a1d31a0b638dc', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=71939) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 24 16:48:08.484837 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb293729-a4d1-4bde-a0c2-89c8ea3d8f12 admin admin] REQUEST_METHOD: `POST` {{(pid=71939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 24 16:48:08.485174 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb293729-a4d1-4bde-a0c2-89c8ea3d8f12 admin admin] SCRIPT_NAME: `/identity` {{(pid=71939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 24 16:48:08.485509 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb293729-a4d1-4bde-a0c2-89c8ea3d8f12 admin admin] PATH_INFO: `/v3/projects` {{(pid=71939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 24 16:48:08.486280 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb293729-a4d1-4bde-a0c2-89c8ea3d8f12 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=71939) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:442}} Nov 24 16:48:08.497610 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: [pid: 71938|app: 0|req: 872/1742] 10.222.0.53 () {58 vars in 1143 bytes} [Wed Nov 24 16:48:08 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 61 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 24 16:48:08.498501 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0aace5b-dcce-40ed-892f-8e2f6e9707db admin admin] Authenticating user token {{(pid=71938) process_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 24 16:48:08.508047 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0aace5b-dcce-40ed-892f-8e2f6e9707db admin admin] Validating token access rules against request {{(pid=71938) validate_allowed_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 24 16:48:08.512588 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28d0663a-263d-427c-bbfe-80fba3daee74 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f2ba2e8375b4e8c8792ee1e22b60427', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '00a5583c7b7443e98e7a1d31a0b638dc', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=71938) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 24 16:48:08.513232 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28d0663a-263d-427c-bbfe-80fba3daee74 admin admin] REQUEST_METHOD: `POST` {{(pid=71938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 24 16:48:08.513566 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28d0663a-263d-427c-bbfe-80fba3daee74 admin admin] SCRIPT_NAME: `/identity` {{(pid=71938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 24 16:48:08.513896 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28d0663a-263d-427c-bbfe-80fba3daee74 admin admin] PATH_INFO: `/v3/projects` {{(pid=71938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 24 16:48:08.514652 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28d0663a-263d-427c-bbfe-80fba3daee74 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=71938) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:442}} Nov 24 16:48:08.516950 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb293729-a4d1-4bde-a0c2-89c8ea3d8f12 admin admin] RBAC: Authorization granted {{(pid=71939) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 24 16:48:08.543871 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28d0663a-263d-427c-bbfe-80fba3daee74 admin admin] RBAC: Authorization granted {{(pid=71938) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 24 16:48:08.547916 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: [pid: 71939|app: 0|req: 871/1743] 10.222.0.53 () {60 vars in 1143 bytes} [Wed Nov 24 16:48:08 2021] POST /identity/v3/projects => generated 363 bytes in 76 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 24 16:48:08.547916 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb293729-a4d1-4bde-a0c2-89c8ea3d8f12 admin admin] Authenticating user token {{(pid=71939) process_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 24 16:48:08.577097 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: [pid: 71938|app: 0|req: 873/1744] 10.222.0.53 () {60 vars in 1143 bytes} [Wed Nov 24 16:48:08 2021] POST /identity/v3/projects => generated 379 bytes in 79 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 24 16:48:08.578422 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28d0663a-263d-427c-bbfe-80fba3daee74 admin admin] Authenticating user token {{(pid=71938) process_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 24 16:48:08.621830 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb293729-a4d1-4bde-a0c2-89c8ea3d8f12 admin admin] Validating token access rules against request {{(pid=71939) validate_allowed_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 24 16:48:08.687397 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6011d02a-2006-46f1-acfc-0170a248718a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f2ba2e8375b4e8c8792ee1e22b60427', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '00a5583c7b7443e98e7a1d31a0b638dc', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=71939) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 24 16:48:08.688066 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6011d02a-2006-46f1-acfc-0170a248718a admin admin] REQUEST_METHOD: `GET` {{(pid=71939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 24 16:48:08.688402 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6011d02a-2006-46f1-acfc-0170a248718a admin admin] SCRIPT_NAME: `/identity` {{(pid=71939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 24 16:48:08.688735 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6011d02a-2006-46f1-acfc-0170a248718a admin admin] PATH_INFO: `/v3/domains` {{(pid=71939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 24 16:48:08.689524 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6011d02a-2006-46f1-acfc-0170a248718a admin admin] RBAC: Adding query filter params (name=Default) {{(pid=71939) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:161}} Nov 24 16:48:08.689879 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6011d02a-2006-46f1-acfc-0170a248718a admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=71939) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:442}} Nov 24 16:48:08.707992 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28d0663a-263d-427c-bbfe-80fba3daee74 admin admin] Validating token access rules against request {{(pid=71938) validate_allowed_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 24 16:48:08.713323 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2c33b39-23e0-43fd-9543-7e163785eed6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f2ba2e8375b4e8c8792ee1e22b60427', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '00a5583c7b7443e98e7a1d31a0b638dc', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=71938) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 24 16:48:08.714004 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2c33b39-23e0-43fd-9543-7e163785eed6 admin admin] REQUEST_METHOD: `GET` {{(pid=71938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 24 16:48:08.714373 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2c33b39-23e0-43fd-9543-7e163785eed6 admin admin] SCRIPT_NAME: `/identity` {{(pid=71938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 24 16:48:08.714705 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2c33b39-23e0-43fd-9543-7e163785eed6 admin admin] PATH_INFO: `/v3/domains` {{(pid=71938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 24 16:48:08.715489 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2c33b39-23e0-43fd-9543-7e163785eed6 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=71938) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:161}} Nov 24 16:48:08.715849 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2c33b39-23e0-43fd-9543-7e163785eed6 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=71938) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:442}} Nov 24 16:48:08.719307 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6011d02a-2006-46f1-acfc-0170a248718a admin admin] RBAC: Authorization granted {{(pid=71939) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 24 16:48:08.742521 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: [pid: 71939|app: 0|req: 872/1745] 10.222.0.53 () {58 vars in 1143 bytes} [Wed Nov 24 16:48:08 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 24 16:48:08.742521 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6011d02a-2006-46f1-acfc-0170a248718a admin admin] Authenticating user token {{(pid=71939) process_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 24 16:48:08.744428 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6011d02a-2006-46f1-acfc-0170a248718a admin admin] Validating token access rules against request {{(pid=71939) validate_allowed_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 24 16:48:08.744633 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2c33b39-23e0-43fd-9543-7e163785eed6 admin admin] RBAC: Authorization granted {{(pid=71938) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 24 16:48:08.749006 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d02feb6-2014-4e4f-ae6e-fee07e7aee20 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f2ba2e8375b4e8c8792ee1e22b60427', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '00a5583c7b7443e98e7a1d31a0b638dc', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=71939) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 24 16:48:08.749900 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d02feb6-2014-4e4f-ae6e-fee07e7aee20 admin admin] REQUEST_METHOD: `PUT` {{(pid=71939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 24 16:48:08.750288 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d02feb6-2014-4e4f-ae6e-fee07e7aee20 admin admin] SCRIPT_NAME: `/identity` {{(pid=71939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 24 16:48:08.750627 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d02feb6-2014-4e4f-ae6e-fee07e7aee20 admin admin] PATH_INFO: `/v3/projects/52d0e1385b2d46abb09243f200d3fa12/users/8ef78165cb894677b1c13ea35f891902/roles/912ab5f10fa5477da74acf239f07604e` {{(pid=71939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 24 16:48:08.759116 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: [pid: 71938|app: 0|req: 874/1746] 10.222.0.53 () {58 vars in 1143 bytes} [Wed Nov 24 16:48:08 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 24 16:48:08.760242 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2c33b39-23e0-43fd-9543-7e163785eed6 admin admin] Authenticating user token {{(pid=71938) process_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 24 16:48:08.770295 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2c33b39-23e0-43fd-9543-7e163785eed6 admin admin] Validating token access rules against request {{(pid=71938) validate_allowed_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 24 16:48:08.776243 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed59fe8f-a3fe-43fe-a21e-8224158a743f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f2ba2e8375b4e8c8792ee1e22b60427', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '00a5583c7b7443e98e7a1d31a0b638dc', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=71938) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 24 16:48:08.776912 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed59fe8f-a3fe-43fe-a21e-8224158a743f admin admin] REQUEST_METHOD: `GET` {{(pid=71938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 24 16:48:08.777254 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed59fe8f-a3fe-43fe-a21e-8224158a743f admin admin] SCRIPT_NAME: `/identity` {{(pid=71938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 24 16:48:08.777591 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed59fe8f-a3fe-43fe-a21e-8224158a743f admin admin] PATH_INFO: `/v3/domains` {{(pid=71938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 24 16:48:08.778458 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed59fe8f-a3fe-43fe-a21e-8224158a743f admin admin] RBAC: Adding query filter params (name=Default) {{(pid=71938) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:161}} Nov 24 16:48:08.778813 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed59fe8f-a3fe-43fe-a21e-8224158a743f admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=71938) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:442}} Nov 24 16:48:08.794985 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d02feb6-2014-4e4f-ae6e-fee07e7aee20 admin admin] RBAC: Authorizing `identity:create_grant(project_id=52d0e1385b2d46abb09243f200d3fa12, user_id=8ef78165cb894677b1c13ea35f891902, role_id=912ab5f10fa5477da74acf239f07604e)` {{(pid=71939) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:442}} Nov 24 16:48:08.808322 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed59fe8f-a3fe-43fe-a21e-8224158a743f admin admin] RBAC: Authorization granted {{(pid=71938) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 24 16:48:08.824160 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: [pid: 71938|app: 0|req: 875/1747] 10.222.0.53 () {58 vars in 1143 bytes} [Wed Nov 24 16:48:08 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 64 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 24 16:48:08.825136 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d02feb6-2014-4e4f-ae6e-fee07e7aee20 admin admin] RBAC: Authorization granted {{(pid=71939) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 24 16:48:08.825967 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed59fe8f-a3fe-43fe-a21e-8224158a743f admin admin] Authenticating user token {{(pid=71938) process_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 24 16:48:08.836635 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed59fe8f-a3fe-43fe-a21e-8224158a743f admin admin] Validating token access rules against request {{(pid=71938) validate_allowed_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 24 16:48:08.838377 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: [pid: 71939|app: 0|req: 873/1748] 10.222.0.53 () {60 vars in 1473 bytes} [Wed Nov 24 16:48:08 2021] PUT /identity/v3/projects/52d0e1385b2d46abb09243f200d3fa12/users/8ef78165cb894677b1c13ea35f891902/roles/912ab5f10fa5477da74acf239f07604e => generated 0 bytes in 104 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 24 16:48:08.839245 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d02feb6-2014-4e4f-ae6e-fee07e7aee20 admin admin] Authenticating user token {{(pid=71939) process_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 24 16:48:08.904530 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c58e22e-2782-4da3-b6e0-5c73a1fd5e1f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f2ba2e8375b4e8c8792ee1e22b60427', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '00a5583c7b7443e98e7a1d31a0b638dc', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=71938) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 24 16:48:08.905219 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c58e22e-2782-4da3-b6e0-5c73a1fd5e1f admin admin] REQUEST_METHOD: `POST` {{(pid=71938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 24 16:48:08.905561 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c58e22e-2782-4da3-b6e0-5c73a1fd5e1f admin admin] SCRIPT_NAME: `/identity` {{(pid=71938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 24 16:48:08.905892 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c58e22e-2782-4da3-b6e0-5c73a1fd5e1f admin admin] PATH_INFO: `/v3/projects` {{(pid=71938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 24 16:48:08.906671 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c58e22e-2782-4da3-b6e0-5c73a1fd5e1f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=71938) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:442}} Nov 24 16:48:08.911713 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d02feb6-2014-4e4f-ae6e-fee07e7aee20 admin admin] Validating token access rules against request {{(pid=71939) validate_allowed_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 24 16:48:08.917495 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aaef59dc-1e50-41c4-bef5-1642a5475b5d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f2ba2e8375b4e8c8792ee1e22b60427', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '00a5583c7b7443e98e7a1d31a0b638dc', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=71939) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 24 16:48:08.918220 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaef59dc-1e50-41c4-bef5-1642a5475b5d admin admin] REQUEST_METHOD: `POST` {{(pid=71939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 24 16:48:08.918564 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaef59dc-1e50-41c4-bef5-1642a5475b5d admin admin] SCRIPT_NAME: `/identity` {{(pid=71939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 24 16:48:08.918899 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaef59dc-1e50-41c4-bef5-1642a5475b5d admin admin] PATH_INFO: `/v3/projects` {{(pid=71939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 24 16:48:08.919639 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aaef59dc-1e50-41c4-bef5-1642a5475b5d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=71939) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:442}} Nov 24 16:48:08.936003 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c58e22e-2782-4da3-b6e0-5c73a1fd5e1f admin admin] RBAC: Authorization granted {{(pid=71938) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 24 16:48:08.948250 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aaef59dc-1e50-41c4-bef5-1642a5475b5d admin admin] RBAC: Authorization granted {{(pid=71939) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 24 16:48:08.964935 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: [pid: 71938|app: 0|req: 876/1749] 10.222.0.53 () {60 vars in 1143 bytes} [Wed Nov 24 16:48:08 2021] POST /identity/v3/projects => generated 375 bytes in 139 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 24 16:48:08.965891 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c58e22e-2782-4da3-b6e0-5c73a1fd5e1f admin admin] Authenticating user token {{(pid=71938) process_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 24 16:48:08.977420 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: [pid: 71939|app: 0|req: 874/1750] 10.222.0.53 () {60 vars in 1143 bytes} [Wed Nov 24 16:48:08 2021] POST /identity/v3/projects => generated 383 bytes in 138 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 24 16:48:08.981549 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aaef59dc-1e50-41c4-bef5-1642a5475b5d admin admin] Authenticating user token {{(pid=71939) process_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 24 16:48:09.043719 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c58e22e-2782-4da3-b6e0-5c73a1fd5e1f admin admin] Validating token access rules against request {{(pid=71938) validate_allowed_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 24 16:48:09.055636 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aaef59dc-1e50-41c4-bef5-1642a5475b5d admin admin] Validating token access rules against request {{(pid=71939) validate_allowed_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 24 16:48:09.061367 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbc3a759-ad20-4f42-8145-2930593f59b2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f2ba2e8375b4e8c8792ee1e22b60427', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '00a5583c7b7443e98e7a1d31a0b638dc', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=71939) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 24 16:48:09.062062 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbc3a759-ad20-4f42-8145-2930593f59b2 admin admin] REQUEST_METHOD: `POST` {{(pid=71939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 24 16:48:09.062564 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbc3a759-ad20-4f42-8145-2930593f59b2 admin admin] SCRIPT_NAME: `/identity` {{(pid=71939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 24 16:48:09.062902 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbc3a759-ad20-4f42-8145-2930593f59b2 admin admin] PATH_INFO: `/v3/users` {{(pid=71939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 24 16:48:09.063634 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbc3a759-ad20-4f42-8145-2930593f59b2 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=71939) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:442}} Nov 24 16:48:09.092892 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbc3a759-ad20-4f42-8145-2930593f59b2 admin admin] RBAC: Authorization granted {{(pid=71939) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 24 16:48:09.112162 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67c83e66-03e7-4d98-9340-58e2ffbb41ac admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f2ba2e8375b4e8c8792ee1e22b60427', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '00a5583c7b7443e98e7a1d31a0b638dc', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=71938) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 24 16:48:09.112893 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67c83e66-03e7-4d98-9340-58e2ffbb41ac admin admin] REQUEST_METHOD: `POST` {{(pid=71938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 24 16:48:09.113236 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67c83e66-03e7-4d98-9340-58e2ffbb41ac admin admin] SCRIPT_NAME: `/identity` {{(pid=71938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 24 16:48:09.113576 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67c83e66-03e7-4d98-9340-58e2ffbb41ac admin admin] PATH_INFO: `/v3/users` {{(pid=71938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 24 16:48:09.113906 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: [pid: 71939|app: 0|req: 875/1751] 10.222.0.53 () {60 vars in 1134 bytes} [Wed Nov 24 16:48:08 2021] POST /identity/v3/users => generated 290 bytes in 133 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 24 16:48:09.114335 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67c83e66-03e7-4d98-9340-58e2ffbb41ac admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=71938) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:442}} Nov 24 16:48:09.114814 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbc3a759-ad20-4f42-8145-2930593f59b2 admin admin] Authenticating user token {{(pid=71939) process_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 24 16:48:09.124355 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbc3a759-ad20-4f42-8145-2930593f59b2 admin admin] Validating token access rules against request {{(pid=71939) validate_allowed_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 24 16:48:09.129162 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6eb599d0-0c00-4b5b-9171-62478e63fbe3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f2ba2e8375b4e8c8792ee1e22b60427', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '00a5583c7b7443e98e7a1d31a0b638dc', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=71939) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 24 16:48:09.129825 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6eb599d0-0c00-4b5b-9171-62478e63fbe3 admin admin] REQUEST_METHOD: `POST` {{(pid=71939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 24 16:48:09.130194 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6eb599d0-0c00-4b5b-9171-62478e63fbe3 admin admin] SCRIPT_NAME: `/identity` {{(pid=71939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 24 16:48:09.130528 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6eb599d0-0c00-4b5b-9171-62478e63fbe3 admin admin] PATH_INFO: `/v3/projects` {{(pid=71939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 24 16:48:09.131254 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6eb599d0-0c00-4b5b-9171-62478e63fbe3 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=71939) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:442}} Nov 24 16:48:09.143377 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67c83e66-03e7-4d98-9340-58e2ffbb41ac admin admin] RBAC: Authorization granted {{(pid=71938) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 24 16:48:09.160554 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6eb599d0-0c00-4b5b-9171-62478e63fbe3 admin admin] RBAC: Authorization granted {{(pid=71939) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 24 16:48:09.166984 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: [pid: 71938|app: 0|req: 877/1752] 10.222.0.53 () {60 vars in 1134 bytes} [Wed Nov 24 16:48:08 2021] POST /identity/v3/users => generated 282 bytes in 197 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 24 16:48:09.166984 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67c83e66-03e7-4d98-9340-58e2ffbb41ac admin admin] Authenticating user token {{(pid=71938) process_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 24 16:48:09.184268 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67c83e66-03e7-4d98-9340-58e2ffbb41ac admin admin] Validating token access rules against request {{(pid=71938) validate_allowed_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 24 16:48:09.188999 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0f23a05-a0e5-45aa-af9e-bf475576e1c3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f2ba2e8375b4e8c8792ee1e22b60427', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '00a5583c7b7443e98e7a1d31a0b638dc', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=71938) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 24 16:48:09.189671 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0f23a05-a0e5-45aa-af9e-bf475576e1c3 admin admin] REQUEST_METHOD: `POST` {{(pid=71938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 24 16:48:09.190012 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0f23a05-a0e5-45aa-af9e-bf475576e1c3 admin admin] SCRIPT_NAME: `/identity` {{(pid=71938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 24 16:48:09.190371 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0f23a05-a0e5-45aa-af9e-bf475576e1c3 admin admin] PATH_INFO: `/v3/projects` {{(pid=71938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 24 16:48:09.191403 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0f23a05-a0e5-45aa-af9e-bf475576e1c3 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=71938) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:442}} Nov 24 16:48:09.191542 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: [pid: 71939|app: 0|req: 876/1753] 10.222.0.53 () {60 vars in 1143 bytes} [Wed Nov 24 16:48:09 2021] POST /identity/v3/projects => generated 357 bytes in 77 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 24 16:48:09.192516 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6eb599d0-0c00-4b5b-9171-62478e63fbe3 admin admin] Authenticating user token {{(pid=71939) process_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 24 16:48:09.220904 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0f23a05-a0e5-45aa-af9e-bf475576e1c3 admin admin] RBAC: Authorization granted {{(pid=71938) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 24 16:48:09.254373 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: [pid: 71938|app: 0|req: 878/1754] 10.222.0.53 () {60 vars in 1143 bytes} [Wed Nov 24 16:48:09 2021] POST /identity/v3/projects => generated 393 bytes in 88 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 24 16:48:09.254373 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e77e0c3-581e-4e25-9e0c-6b4ea961f06a None None] REQUEST_METHOD: `POST` {{(pid=71938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 24 16:48:09.254373 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e77e0c3-581e-4e25-9e0c-6b4ea961f06a None None] SCRIPT_NAME: `/identity` {{(pid=71938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 24 16:48:09.254373 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e77e0c3-581e-4e25-9e0c-6b4ea961f06a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=71938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 24 16:48:09.269219 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6eb599d0-0c00-4b5b-9171-62478e63fbe3 admin admin] Validating token access rules against request {{(pid=71939) validate_allowed_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 24 16:48:09.292509 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.auth.core [None req-5e77e0c3-581e-4e25-9e0c-6b4ea961f06a None None] MFA Rules not processed for user `8ef78165cb894677b1c13ea35f891902`. Rule list: `[]` (Enabled: `True`). {{(pid=71938) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:442}} Nov 24 16:48:09.293743 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.fernet_utils [None req-5e77e0c3-581e-4e25-9e0c-6b4ea961f06a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=71938) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:289}} Nov 24 16:48:09.337876 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b54708e7-2be6-43f5-82b9-78d56df85b05 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f2ba2e8375b4e8c8792ee1e22b60427', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '00a5583c7b7443e98e7a1d31a0b638dc', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=71939) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 24 16:48:09.338743 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b54708e7-2be6-43f5-82b9-78d56df85b05 admin admin] REQUEST_METHOD: `POST` {{(pid=71939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 24 16:48:09.339108 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b54708e7-2be6-43f5-82b9-78d56df85b05 admin admin] SCRIPT_NAME: `/identity` {{(pid=71939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 24 16:48:09.339434 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b54708e7-2be6-43f5-82b9-78d56df85b05 admin admin] PATH_INFO: `/v3/projects` {{(pid=71939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 24 16:48:09.340178 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b54708e7-2be6-43f5-82b9-78d56df85b05 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=71939) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:442}} Nov 24 16:48:09.385171 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: [pid: 71938|app: 0|req: 879/1755] 10.222.0.53 () {58 vars in 948 bytes} [Wed Nov 24 16:48:09 2021] POST /identity/v3/auth/tokens => generated 3682 bytes in 133 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 24 16:48:09.387031 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b54708e7-2be6-43f5-82b9-78d56df85b05 admin admin] RBAC: Authorization granted {{(pid=71939) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 24 16:48:09.387236 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e77e0c3-581e-4e25-9e0c-6b4ea961f06a None None] Authenticating user token {{(pid=71938) process_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 24 16:48:09.398009 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e77e0c3-581e-4e25-9e0c-6b4ea961f06a None None] Validating token access rules against request {{(pid=71938) validate_allowed_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 24 16:48:09.402608 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e92f923b-cd76-4473-9728-03ca82721c5f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f2ba2e8375b4e8c8792ee1e22b60427', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '00a5583c7b7443e98e7a1d31a0b638dc', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=71938) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 24 16:48:09.403285 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e92f923b-cd76-4473-9728-03ca82721c5f admin admin] REQUEST_METHOD: `POST` {{(pid=71938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 24 16:48:09.403625 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e92f923b-cd76-4473-9728-03ca82721c5f admin admin] SCRIPT_NAME: `/identity` {{(pid=71938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 24 16:48:09.403960 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e92f923b-cd76-4473-9728-03ca82721c5f admin admin] PATH_INFO: `/v3/users` {{(pid=71938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 24 16:48:09.404692 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e92f923b-cd76-4473-9728-03ca82721c5f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=71938) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:442}} Nov 24 16:48:09.416486 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: [pid: 71939|app: 0|req: 877/1756] 10.222.0.53 () {60 vars in 1143 bytes} [Wed Nov 24 16:48:09 2021] POST /identity/v3/projects => generated 385 bytes in 225 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 24 16:48:09.417934 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b54708e7-2be6-43f5-82b9-78d56df85b05 admin admin] Authenticating user token {{(pid=71939) process_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 24 16:48:09.434850 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e92f923b-cd76-4473-9728-03ca82721c5f admin admin] RBAC: Authorization granted {{(pid=71938) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 24 16:48:09.457788 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: [pid: 71938|app: 0|req: 880/1757] 10.222.0.53 () {60 vars in 1134 bytes} [Wed Nov 24 16:48:09 2021] POST /identity/v3/users => generated 288 bytes in 71 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 24 16:48:09.458570 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e92f923b-cd76-4473-9728-03ca82721c5f admin admin] Authenticating user token {{(pid=71938) process_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 24 16:48:09.468239 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e92f923b-cd76-4473-9728-03ca82721c5f admin admin] Validating token access rules against request {{(pid=71938) validate_allowed_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 24 16:48:09.493298 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b54708e7-2be6-43f5-82b9-78d56df85b05 admin admin] Validating token access rules against request {{(pid=71939) validate_allowed_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 24 16:48:09.497981 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa229285-795b-40da-b6d8-79d1aaee9fb5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f2ba2e8375b4e8c8792ee1e22b60427', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '00a5583c7b7443e98e7a1d31a0b638dc', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=71939) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 24 16:48:09.498699 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa229285-795b-40da-b6d8-79d1aaee9fb5 admin admin] REQUEST_METHOD: `POST` {{(pid=71939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 24 16:48:09.499044 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa229285-795b-40da-b6d8-79d1aaee9fb5 admin admin] SCRIPT_NAME: `/identity` {{(pid=71939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 24 16:48:09.499380 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa229285-795b-40da-b6d8-79d1aaee9fb5 admin admin] PATH_INFO: `/v3/users` {{(pid=71939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 24 16:48:09.500164 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa229285-795b-40da-b6d8-79d1aaee9fb5 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=71939) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:442}} Nov 24 16:48:09.528537 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa229285-795b-40da-b6d8-79d1aaee9fb5 admin admin] RBAC: Authorization granted {{(pid=71939) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 24 16:48:09.537001 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dad1970e-6d8f-44e4-96ee-6c09cda01f83 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f2ba2e8375b4e8c8792ee1e22b60427', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '00a5583c7b7443e98e7a1d31a0b638dc', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=71938) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 24 16:48:09.537841 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dad1970e-6d8f-44e4-96ee-6c09cda01f83 admin admin] REQUEST_METHOD: `GET` {{(pid=71938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 24 16:48:09.538423 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dad1970e-6d8f-44e4-96ee-6c09cda01f83 admin admin] SCRIPT_NAME: `/identity` {{(pid=71938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 24 16:48:09.538762 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dad1970e-6d8f-44e4-96ee-6c09cda01f83 admin admin] PATH_INFO: `/v3/roles` {{(pid=71938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 24 16:48:09.540212 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dad1970e-6d8f-44e4-96ee-6c09cda01f83 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=71938) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:442}} Nov 24 16:48:09.553026 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: [pid: 71939|app: 0|req: 878/1758] 10.222.0.53 () {60 vars in 1134 bytes} [Wed Nov 24 16:48:09 2021] POST /identity/v3/users => generated 292 bytes in 135 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 24 16:48:09.553924 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa229285-795b-40da-b6d8-79d1aaee9fb5 admin admin] Authenticating user token {{(pid=71939) process_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 24 16:48:09.564390 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa229285-795b-40da-b6d8-79d1aaee9fb5 admin admin] Validating token access rules against request {{(pid=71939) validate_allowed_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 24 16:48:09.569268 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40434f34-959d-44cf-b0d8-580e949c5a54 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f2ba2e8375b4e8c8792ee1e22b60427', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '00a5583c7b7443e98e7a1d31a0b638dc', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=71939) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 24 16:48:09.569928 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40434f34-959d-44cf-b0d8-580e949c5a54 admin admin] REQUEST_METHOD: `GET` {{(pid=71939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 24 16:48:09.570302 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40434f34-959d-44cf-b0d8-580e949c5a54 admin admin] SCRIPT_NAME: `/identity` {{(pid=71939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 24 16:48:09.570673 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40434f34-959d-44cf-b0d8-580e949c5a54 admin admin] PATH_INFO: `/v3/roles` {{(pid=71939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 24 16:48:09.571463 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40434f34-959d-44cf-b0d8-580e949c5a54 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=71939) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:442}} Nov 24 16:48:09.573262 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dad1970e-6d8f-44e4-96ee-6c09cda01f83 admin admin] RBAC: Authorization granted {{(pid=71938) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 24 16:48:09.584663 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: [pid: 71938|app: 0|req: 881/1759] 10.222.0.53 () {58 vars in 1112 bytes} [Wed Nov 24 16:48:09 2021] GET /identity/v3/roles => generated 1420 bytes in 126 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 24 16:48:09.585500 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dad1970e-6d8f-44e4-96ee-6c09cda01f83 admin admin] Authenticating user token {{(pid=71938) process_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 24 16:48:09.595721 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dad1970e-6d8f-44e4-96ee-6c09cda01f83 admin admin] Validating token access rules against request {{(pid=71938) validate_allowed_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 24 16:48:09.600049 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40434f34-959d-44cf-b0d8-580e949c5a54 admin admin] RBAC: Authorization granted {{(pid=71939) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 24 16:48:09.600375 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-360836ae-581b-4db1-aa2f-20f85d651a8d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f2ba2e8375b4e8c8792ee1e22b60427', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '00a5583c7b7443e98e7a1d31a0b638dc', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=71938) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 24 16:48:09.601046 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-360836ae-581b-4db1-aa2f-20f85d651a8d admin admin] REQUEST_METHOD: `POST` {{(pid=71938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 24 16:48:09.601386 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-360836ae-581b-4db1-aa2f-20f85d651a8d admin admin] SCRIPT_NAME: `/identity` {{(pid=71938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 24 16:48:09.602386 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-360836ae-581b-4db1-aa2f-20f85d651a8d admin admin] PATH_INFO: `/v3/users` {{(pid=71938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 24 16:48:09.603097 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-360836ae-581b-4db1-aa2f-20f85d651a8d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=71938) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:442}} Nov 24 16:48:09.612099 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: [pid: 71939|app: 0|req: 879/1760] 10.222.0.53 () {58 vars in 1112 bytes} [Wed Nov 24 16:48:09 2021] GET /identity/v3/roles => generated 1420 bytes in 58 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 24 16:48:09.612815 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40434f34-959d-44cf-b0d8-580e949c5a54 admin admin] Authenticating user token {{(pid=71939) process_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 24 16:48:09.624205 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40434f34-959d-44cf-b0d8-580e949c5a54 admin admin] Validating token access rules against request {{(pid=71939) validate_allowed_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 24 16:48:09.629064 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c5439a6-af1a-412b-92b3-5c346dc2508b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f2ba2e8375b4e8c8792ee1e22b60427', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '00a5583c7b7443e98e7a1d31a0b638dc', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=71939) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 24 16:48:09.629739 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c5439a6-af1a-412b-92b3-5c346dc2508b admin admin] REQUEST_METHOD: `POST` {{(pid=71939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 24 16:48:09.630108 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c5439a6-af1a-412b-92b3-5c346dc2508b admin admin] SCRIPT_NAME: `/identity` {{(pid=71939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 24 16:48:09.630446 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c5439a6-af1a-412b-92b3-5c346dc2508b admin admin] PATH_INFO: `/v3/users` {{(pid=71939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 24 16:48:09.631184 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c5439a6-af1a-412b-92b3-5c346dc2508b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=71939) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:442}} Nov 24 16:48:09.637607 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-360836ae-581b-4db1-aa2f-20f85d651a8d admin admin] RBAC: Authorization granted {{(pid=71938) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 24 16:48:09.661655 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: [pid: 71938|app: 0|req: 882/1761] 10.222.0.53 () {60 vars in 1134 bytes} [Wed Nov 24 16:48:09 2021] POST /identity/v3/users => generated 279 bytes in 73 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 24 16:48:09.661655 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-360836ae-581b-4db1-aa2f-20f85d651a8d admin admin] Authenticating user token {{(pid=71938) process_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 24 16:48:09.661952 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c5439a6-af1a-412b-92b3-5c346dc2508b admin admin] RBAC: Authorization granted {{(pid=71939) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 24 16:48:09.669795 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-360836ae-581b-4db1-aa2f-20f85d651a8d admin admin] Validating token access rules against request {{(pid=71938) validate_allowed_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 24 16:48:09.674559 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ad605fc-48be-4453-b0f4-6e70733668ca admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f2ba2e8375b4e8c8792ee1e22b60427', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '00a5583c7b7443e98e7a1d31a0b638dc', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=71938) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 24 16:48:09.675225 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ad605fc-48be-4453-b0f4-6e70733668ca admin admin] REQUEST_METHOD: `POST` {{(pid=71938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 24 16:48:09.675561 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ad605fc-48be-4453-b0f4-6e70733668ca admin admin] SCRIPT_NAME: `/identity` {{(pid=71938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 24 16:48:09.675888 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ad605fc-48be-4453-b0f4-6e70733668ca admin admin] PATH_INFO: `/v3/projects` {{(pid=71938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 24 16:48:09.676655 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ad605fc-48be-4453-b0f4-6e70733668ca admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=71938) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:442}} Nov 24 16:48:09.684570 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: [pid: 71939|app: 0|req: 880/1762] 10.222.0.53 () {60 vars in 1134 bytes} [Wed Nov 24 16:48:09 2021] POST /identity/v3/users => generated 297 bytes in 69 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 24 16:48:09.684570 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c5439a6-af1a-412b-92b3-5c346dc2508b admin admin] Authenticating user token {{(pid=71939) process_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 24 16:48:09.696938 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c5439a6-af1a-412b-92b3-5c346dc2508b admin admin] Validating token access rules against request {{(pid=71939) validate_allowed_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 24 16:48:09.703587 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1d9beab-3273-4a79-bd45-f91bec22f7d2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f2ba2e8375b4e8c8792ee1e22b60427', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '00a5583c7b7443e98e7a1d31a0b638dc', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=71939) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 24 16:48:09.704584 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1d9beab-3273-4a79-bd45-f91bec22f7d2 admin admin] REQUEST_METHOD: `POST` {{(pid=71939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 24 16:48:09.705094 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1d9beab-3273-4a79-bd45-f91bec22f7d2 admin admin] SCRIPT_NAME: `/identity` {{(pid=71939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 24 16:48:09.705594 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1d9beab-3273-4a79-bd45-f91bec22f7d2 admin admin] PATH_INFO: `/v3/users` {{(pid=71939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 24 16:48:09.706791 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1d9beab-3273-4a79-bd45-f91bec22f7d2 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=71939) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:442}} Nov 24 16:48:09.706928 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ad605fc-48be-4453-b0f4-6e70733668ca admin admin] RBAC: Authorization granted {{(pid=71938) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 24 16:48:09.743298 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: [pid: 71938|app: 0|req: 883/1763] 10.222.0.53 () {60 vars in 1143 bytes} [Wed Nov 24 16:48:09 2021] POST /identity/v3/projects => generated 377 bytes in 81 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 24 16:48:09.743298 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ad605fc-48be-4453-b0f4-6e70733668ca admin admin] Authenticating user token {{(pid=71938) process_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 24 16:48:09.743662 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1d9beab-3273-4a79-bd45-f91bec22f7d2 admin admin] RBAC: Authorization granted {{(pid=71939) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 24 16:48:09.764608 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: [pid: 71939|app: 0|req: 881/1764] 10.222.0.53 () {60 vars in 1134 bytes} [Wed Nov 24 16:48:09 2021] POST /identity/v3/users => generated 293 bytes in 83 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 24 16:48:09.766375 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1d9beab-3273-4a79-bd45-f91bec22f7d2 admin admin] Authenticating user token {{(pid=71939) process_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 24 16:48:09.776927 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1d9beab-3273-4a79-bd45-f91bec22f7d2 admin admin] Validating token access rules against request {{(pid=71939) validate_allowed_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 24 16:48:09.817317 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ad605fc-48be-4453-b0f4-6e70733668ca admin admin] Validating token access rules against request {{(pid=71938) validate_allowed_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 24 16:48:09.822199 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0446b4e0-0fb8-41bd-bb82-79b53689b9af admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f2ba2e8375b4e8c8792ee1e22b60427', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '00a5583c7b7443e98e7a1d31a0b638dc', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=71938) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 24 16:48:09.823040 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0446b4e0-0fb8-41bd-bb82-79b53689b9af admin admin] REQUEST_METHOD: `GET` {{(pid=71938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 24 16:48:09.823376 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0446b4e0-0fb8-41bd-bb82-79b53689b9af admin admin] SCRIPT_NAME: `/identity` {{(pid=71938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 24 16:48:09.823704 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0446b4e0-0fb8-41bd-bb82-79b53689b9af admin admin] PATH_INFO: `/v3/roles` {{(pid=71938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 24 16:48:09.824491 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0446b4e0-0fb8-41bd-bb82-79b53689b9af admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=71938) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:442}} Nov 24 16:48:09.843884 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-797a3374-fd35-408c-841f-836e5e0595ad admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f2ba2e8375b4e8c8792ee1e22b60427', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '00a5583c7b7443e98e7a1d31a0b638dc', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=71939) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 24 16:48:09.844573 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-797a3374-fd35-408c-841f-836e5e0595ad admin admin] REQUEST_METHOD: `GET` {{(pid=71939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 24 16:48:09.844918 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-797a3374-fd35-408c-841f-836e5e0595ad admin admin] SCRIPT_NAME: `/identity` {{(pid=71939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 24 16:48:09.845256 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-797a3374-fd35-408c-841f-836e5e0595ad admin admin] PATH_INFO: `/v3/roles` {{(pid=71939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 24 16:48:09.846078 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-797a3374-fd35-408c-841f-836e5e0595ad admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=71939) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:442}} Nov 24 16:48:09.853750 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0446b4e0-0fb8-41bd-bb82-79b53689b9af admin admin] RBAC: Authorization granted {{(pid=71938) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 24 16:48:09.865035 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: [pid: 71938|app: 0|req: 884/1765] 10.222.0.53 () {58 vars in 1112 bytes} [Wed Nov 24 16:48:09 2021] GET /identity/v3/roles => generated 1420 bytes in 124 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 24 16:48:09.865958 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0446b4e0-0fb8-41bd-bb82-79b53689b9af admin admin] Authenticating user token {{(pid=71938) process_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 24 16:48:09.875720 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0446b4e0-0fb8-41bd-bb82-79b53689b9af admin admin] Validating token access rules against request {{(pid=71938) validate_allowed_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 24 16:48:09.875974 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-797a3374-fd35-408c-841f-836e5e0595ad admin admin] RBAC: Authorization granted {{(pid=71939) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 24 16:48:09.880690 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e41b7db8-cf42-4382-bf04-d44fb5cfdbe9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f2ba2e8375b4e8c8792ee1e22b60427', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '00a5583c7b7443e98e7a1d31a0b638dc', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=71938) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 24 16:48:09.881615 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e41b7db8-cf42-4382-bf04-d44fb5cfdbe9 admin admin] REQUEST_METHOD: `PUT` {{(pid=71938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 24 16:48:09.881955 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e41b7db8-cf42-4382-bf04-d44fb5cfdbe9 admin admin] SCRIPT_NAME: `/identity` {{(pid=71938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 24 16:48:09.882327 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e41b7db8-cf42-4382-bf04-d44fb5cfdbe9 admin admin] PATH_INFO: `/v3/projects/e1293be0c07d47dc908154cfb3164097/users/03d1d0f348814a6c972dbb75c3b32797/roles/912ab5f10fa5477da74acf239f07604e` {{(pid=71938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 24 16:48:09.893773 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: [pid: 71939|app: 0|req: 882/1766] 10.222.0.53 () {58 vars in 1112 bytes} [Wed Nov 24 16:48:09 2021] GET /identity/v3/roles => generated 1420 bytes in 123 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 24 16:48:09.893773 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-797a3374-fd35-408c-841f-836e5e0595ad admin admin] Authenticating user token {{(pid=71939) process_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 24 16:48:09.900894 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-797a3374-fd35-408c-841f-836e5e0595ad admin admin] Validating token access rules against request {{(pid=71939) validate_allowed_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 24 16:48:09.905995 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a4589ae-f08e-4453-b2b7-5dbc1b8573d5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f2ba2e8375b4e8c8792ee1e22b60427', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '00a5583c7b7443e98e7a1d31a0b638dc', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=71939) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 24 16:48:09.906943 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a4589ae-f08e-4453-b2b7-5dbc1b8573d5 admin admin] REQUEST_METHOD: `PUT` {{(pid=71939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 24 16:48:09.907261 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a4589ae-f08e-4453-b2b7-5dbc1b8573d5 admin admin] SCRIPT_NAME: `/identity` {{(pid=71939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 24 16:48:09.907592 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a4589ae-f08e-4453-b2b7-5dbc1b8573d5 admin admin] PATH_INFO: `/v3/projects/bf67d4c04c9c4ff6b866e23cc3c387a6/users/45fe98404f0d4176803527dd2b5f8a46/roles/912ab5f10fa5477da74acf239f07604e` {{(pid=71939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 24 16:48:09.910264 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e41b7db8-cf42-4382-bf04-d44fb5cfdbe9 admin admin] RBAC: Authorizing `identity:create_grant(project_id=e1293be0c07d47dc908154cfb3164097, user_id=03d1d0f348814a6c972dbb75c3b32797, role_id=912ab5f10fa5477da74acf239f07604e)` {{(pid=71938) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:442}} Nov 24 16:48:09.929098 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a4589ae-f08e-4453-b2b7-5dbc1b8573d5 admin admin] RBAC: Authorizing `identity:create_grant(project_id=bf67d4c04c9c4ff6b866e23cc3c387a6, user_id=45fe98404f0d4176803527dd2b5f8a46, role_id=912ab5f10fa5477da74acf239f07604e)` {{(pid=71939) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:442}} Nov 24 16:48:09.944847 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e41b7db8-cf42-4382-bf04-d44fb5cfdbe9 admin admin] RBAC: Authorization granted {{(pid=71938) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 24 16:48:09.958303 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: [pid: 71938|app: 0|req: 885/1767] 10.222.0.53 () {60 vars in 1473 bytes} [Wed Nov 24 16:48:09 2021] PUT /identity/v3/projects/e1293be0c07d47dc908154cfb3164097/users/03d1d0f348814a6c972dbb75c3b32797/roles/912ab5f10fa5477da74acf239f07604e => generated 0 bytes in 93 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 24 16:48:09.959189 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e41b7db8-cf42-4382-bf04-d44fb5cfdbe9 admin admin] Authenticating user token {{(pid=71938) process_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 24 16:48:09.965372 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a4589ae-f08e-4453-b2b7-5dbc1b8573d5 admin admin] RBAC: Authorization granted {{(pid=71939) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 24 16:48:09.978451 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: [pid: 71939|app: 0|req: 883/1768] 10.222.0.53 () {60 vars in 1473 bytes} [Wed Nov 24 16:48:09 2021] PUT /identity/v3/projects/bf67d4c04c9c4ff6b866e23cc3c387a6/users/45fe98404f0d4176803527dd2b5f8a46/roles/912ab5f10fa5477da74acf239f07604e => generated 0 bytes in 89 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 24 16:48:09.979528 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a4589ae-f08e-4453-b2b7-5dbc1b8573d5 admin admin] Authenticating user token {{(pid=71939) process_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 24 16:48:10.034397 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e41b7db8-cf42-4382-bf04-d44fb5cfdbe9 admin admin] Validating token access rules against request {{(pid=71938) validate_allowed_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 24 16:48:10.052422 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a4589ae-f08e-4453-b2b7-5dbc1b8573d5 admin admin] Validating token access rules against request {{(pid=71939) validate_allowed_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 24 16:48:10.057611 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83bdbcf5-d156-45f3-af78-c4a0d378770c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f2ba2e8375b4e8c8792ee1e22b60427', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '00a5583c7b7443e98e7a1d31a0b638dc', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=71939) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 24 16:48:10.058320 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83bdbcf5-d156-45f3-af78-c4a0d378770c admin admin] REQUEST_METHOD: `GET` {{(pid=71939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 24 16:48:10.058658 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83bdbcf5-d156-45f3-af78-c4a0d378770c admin admin] SCRIPT_NAME: `/identity` {{(pid=71939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 24 16:48:10.058992 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83bdbcf5-d156-45f3-af78-c4a0d378770c admin admin] PATH_INFO: `/v3/roles` {{(pid=71939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 24 16:48:10.059776 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83bdbcf5-d156-45f3-af78-c4a0d378770c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=71939) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:442}} Nov 24 16:48:10.089383 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83bdbcf5-d156-45f3-af78-c4a0d378770c admin admin] RBAC: Authorization granted {{(pid=71939) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 24 16:48:10.100814 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: [pid: 71939|app: 0|req: 884/1769] 10.222.0.53 () {58 vars in 1112 bytes} [Wed Nov 24 16:48:09 2021] GET /identity/v3/roles => generated 1420 bytes in 122 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 24 16:48:10.101656 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83bdbcf5-d156-45f3-af78-c4a0d378770c admin admin] Authenticating user token {{(pid=71939) process_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 24 16:48:10.103335 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab195741-e5cd-4404-b8fa-c642e9557ae1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f2ba2e8375b4e8c8792ee1e22b60427', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '00a5583c7b7443e98e7a1d31a0b638dc', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=71938) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 24 16:48:10.104026 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab195741-e5cd-4404-b8fa-c642e9557ae1 admin admin] REQUEST_METHOD: `GET` {{(pid=71938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 24 16:48:10.104365 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab195741-e5cd-4404-b8fa-c642e9557ae1 admin admin] SCRIPT_NAME: `/identity` {{(pid=71938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 24 16:48:10.104776 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab195741-e5cd-4404-b8fa-c642e9557ae1 admin admin] PATH_INFO: `/v3/roles` {{(pid=71938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 24 16:48:10.105459 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab195741-e5cd-4404-b8fa-c642e9557ae1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=71938) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:442}} Nov 24 16:48:10.112197 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83bdbcf5-d156-45f3-af78-c4a0d378770c admin admin] Validating token access rules against request {{(pid=71939) validate_allowed_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 24 16:48:10.116706 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b21c0eaa-464a-49ff-a18f-3fc24fa3e516 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f2ba2e8375b4e8c8792ee1e22b60427', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '00a5583c7b7443e98e7a1d31a0b638dc', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=71939) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 24 16:48:10.117407 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b21c0eaa-464a-49ff-a18f-3fc24fa3e516 admin admin] REQUEST_METHOD: `POST` {{(pid=71939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 24 16:48:10.118341 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b21c0eaa-464a-49ff-a18f-3fc24fa3e516 admin admin] SCRIPT_NAME: `/identity` {{(pid=71939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 24 16:48:10.118672 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b21c0eaa-464a-49ff-a18f-3fc24fa3e516 admin admin] PATH_INFO: `/v3/users` {{(pid=71939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 24 16:48:10.119389 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b21c0eaa-464a-49ff-a18f-3fc24fa3e516 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=71939) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:442}} Nov 24 16:48:10.135227 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab195741-e5cd-4404-b8fa-c642e9557ae1 admin admin] RBAC: Authorization granted {{(pid=71938) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 24 16:48:10.149858 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: [pid: 71938|app: 0|req: 886/1770] 10.222.0.53 () {58 vars in 1112 bytes} [Wed Nov 24 16:48:09 2021] GET /identity/v3/roles => generated 1420 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 24 16:48:10.149858 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab195741-e5cd-4404-b8fa-c642e9557ae1 admin admin] Authenticating user token {{(pid=71938) process_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 24 16:48:10.150176 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b21c0eaa-464a-49ff-a18f-3fc24fa3e516 admin admin] RBAC: Authorization granted {{(pid=71939) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 24 16:48:10.157367 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab195741-e5cd-4404-b8fa-c642e9557ae1 admin admin] Validating token access rules against request {{(pid=71938) validate_allowed_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 24 16:48:10.162522 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b51650c-6999-48b9-8214-2cafa5ff2534 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f2ba2e8375b4e8c8792ee1e22b60427', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '00a5583c7b7443e98e7a1d31a0b638dc', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=71938) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 24 16:48:10.163207 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b51650c-6999-48b9-8214-2cafa5ff2534 admin admin] REQUEST_METHOD: `GET` {{(pid=71938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 24 16:48:10.163675 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b51650c-6999-48b9-8214-2cafa5ff2534 admin admin] SCRIPT_NAME: `/identity` {{(pid=71938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 24 16:48:10.164016 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b51650c-6999-48b9-8214-2cafa5ff2534 admin admin] PATH_INFO: `/v3/roles` {{(pid=71938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 24 16:48:10.165359 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b51650c-6999-48b9-8214-2cafa5ff2534 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=71938) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:442}} Nov 24 16:48:10.168463 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: [pid: 71939|app: 0|req: 885/1771] 10.222.0.53 () {60 vars in 1134 bytes} [Wed Nov 24 16:48:10 2021] POST /identity/v3/users => generated 295 bytes in 67 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 24 16:48:10.169350 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b21c0eaa-464a-49ff-a18f-3fc24fa3e516 admin admin] Authenticating user token {{(pid=71939) process_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 24 16:48:10.179754 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b21c0eaa-464a-49ff-a18f-3fc24fa3e516 admin admin] Validating token access rules against request {{(pid=71939) validate_allowed_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 24 16:48:10.185147 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e966a76d-f65a-435c-bb92-2b5cdf6178f9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f2ba2e8375b4e8c8792ee1e22b60427', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '00a5583c7b7443e98e7a1d31a0b638dc', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=71939) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 24 16:48:10.186087 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e966a76d-f65a-435c-bb92-2b5cdf6178f9 admin admin] REQUEST_METHOD: `PUT` {{(pid=71939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 24 16:48:10.186443 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e966a76d-f65a-435c-bb92-2b5cdf6178f9 admin admin] SCRIPT_NAME: `/identity` {{(pid=71939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 24 16:48:10.186773 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e966a76d-f65a-435c-bb92-2b5cdf6178f9 admin admin] PATH_INFO: `/v3/projects/2e1db92b17144247b41c70a2ad4c19eb/users/b3526b1ee2664fb9a004a17eedce9868/roles/912ab5f10fa5477da74acf239f07604e` {{(pid=71939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 24 16:48:10.196176 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b51650c-6999-48b9-8214-2cafa5ff2534 admin admin] RBAC: Authorization granted {{(pid=71938) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 24 16:48:10.208401 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: [pid: 71938|app: 0|req: 887/1772] 10.222.0.53 () {58 vars in 1112 bytes} [Wed Nov 24 16:48:10 2021] GET /identity/v3/roles => generated 1420 bytes in 61 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 24 16:48:10.209385 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b51650c-6999-48b9-8214-2cafa5ff2534 admin admin] Authenticating user token {{(pid=71938) process_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 24 16:48:10.213118 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e966a76d-f65a-435c-bb92-2b5cdf6178f9 admin admin] RBAC: Authorizing `identity:create_grant(project_id=2e1db92b17144247b41c70a2ad4c19eb, user_id=b3526b1ee2664fb9a004a17eedce9868, role_id=912ab5f10fa5477da74acf239f07604e)` {{(pid=71939) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:442}} Nov 24 16:48:10.222053 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b51650c-6999-48b9-8214-2cafa5ff2534 admin admin] Validating token access rules against request {{(pid=71938) validate_allowed_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 24 16:48:10.227475 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4819833a-2083-4051-b4b5-f627f5e304f1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f2ba2e8375b4e8c8792ee1e22b60427', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '00a5583c7b7443e98e7a1d31a0b638dc', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=71938) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 24 16:48:10.228383 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4819833a-2083-4051-b4b5-f627f5e304f1 admin admin] REQUEST_METHOD: `PUT` {{(pid=71938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 24 16:48:10.229055 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4819833a-2083-4051-b4b5-f627f5e304f1 admin admin] SCRIPT_NAME: `/identity` {{(pid=71938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 24 16:48:10.229055 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4819833a-2083-4051-b4b5-f627f5e304f1 admin admin] PATH_INFO: `/v3/projects/ed8eac02328b436389d90948d7115488/users/34d2bfdcf76b4d5bb3f013dcd99f817f/roles/912ab5f10fa5477da74acf239f07604e` {{(pid=71938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 24 16:48:10.245327 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e966a76d-f65a-435c-bb92-2b5cdf6178f9 admin admin] RBAC: Authorization granted {{(pid=71939) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 24 16:48:10.251255 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4819833a-2083-4051-b4b5-f627f5e304f1 admin admin] RBAC: Authorizing `identity:create_grant(project_id=ed8eac02328b436389d90948d7115488, user_id=34d2bfdcf76b4d5bb3f013dcd99f817f, role_id=912ab5f10fa5477da74acf239f07604e)` {{(pid=71938) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:442}} Nov 24 16:48:10.258087 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: [pid: 71939|app: 0|req: 886/1773] 10.222.0.53 () {60 vars in 1473 bytes} [Wed Nov 24 16:48:10 2021] PUT /identity/v3/projects/2e1db92b17144247b41c70a2ad4c19eb/users/b3526b1ee2664fb9a004a17eedce9868/roles/912ab5f10fa5477da74acf239f07604e => generated 0 bytes in 89 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 24 16:48:10.259512 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-673b1110-8c08-4280-8bfb-77ff5f4ddf46 None None] REQUEST_METHOD: `POST` {{(pid=71939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 24 16:48:10.259867 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-673b1110-8c08-4280-8bfb-77ff5f4ddf46 None None] SCRIPT_NAME: `/identity` {{(pid=71939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 24 16:48:10.260180 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-673b1110-8c08-4280-8bfb-77ff5f4ddf46 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=71939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 24 16:48:10.281493 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4819833a-2083-4051-b4b5-f627f5e304f1 admin admin] RBAC: Authorization granted {{(pid=71938) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 24 16:48:10.284655 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.auth.core [None req-673b1110-8c08-4280-8bfb-77ff5f4ddf46 None None] MFA Rules not processed for user `0f2ba2e8375b4e8c8792ee1e22b60427`. Rule list: `[]` (Enabled: `True`). {{(pid=71939) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:442}} Nov 24 16:48:10.285845 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.fernet_utils [None req-673b1110-8c08-4280-8bfb-77ff5f4ddf46 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=71939) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:289}} Nov 24 16:48:10.294711 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: [pid: 71938|app: 0|req: 888/1774] 10.222.0.53 () {60 vars in 1473 bytes} [Wed Nov 24 16:48:10 2021] PUT /identity/v3/projects/ed8eac02328b436389d90948d7115488/users/34d2bfdcf76b4d5bb3f013dcd99f817f/roles/912ab5f10fa5477da74acf239f07604e => generated 0 bytes in 86 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 24 16:48:10.296309 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f24b8710-3c31-469d-9e2e-5eb68c29dad9 None None] REQUEST_METHOD: `POST` {{(pid=71938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 24 16:48:10.296720 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f24b8710-3c31-469d-9e2e-5eb68c29dad9 None None] SCRIPT_NAME: `/identity` {{(pid=71938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 24 16:48:10.297058 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f24b8710-3c31-469d-9e2e-5eb68c29dad9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=71938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 24 16:48:10.338823 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.auth.core [None req-f24b8710-3c31-469d-9e2e-5eb68c29dad9 None None] MFA Rules not processed for user `45fe98404f0d4176803527dd2b5f8a46`. Rule list: `[]` (Enabled: `True`). {{(pid=71938) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:442}} Nov 24 16:48:10.340055 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.fernet_utils [None req-f24b8710-3c31-469d-9e2e-5eb68c29dad9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=71938) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:289}} Nov 24 16:48:10.358347 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: [pid: 71939|app: 0|req: 887/1775] 10.222.0.53 () {58 vars in 948 bytes} [Wed Nov 24 16:48:10 2021] POST /identity/v3/auth/tokens => generated 3669 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 24 16:48:10.362622 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-673b1110-8c08-4280-8bfb-77ff5f4ddf46 None None] Authenticating user token {{(pid=71939) process_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 24 16:48:10.372924 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-673b1110-8c08-4280-8bfb-77ff5f4ddf46 None None] Validating token access rules against request {{(pid=71939) validate_allowed_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 24 16:48:10.377766 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55de1af9-73e4-4873-baa1-6bfcb58fea02 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f2ba2e8375b4e8c8792ee1e22b60427', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '00a5583c7b7443e98e7a1d31a0b638dc', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=71939) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 24 16:48:10.378695 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55de1af9-73e4-4873-baa1-6bfcb58fea02 admin admin] REQUEST_METHOD: `PUT` {{(pid=71939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 24 16:48:10.379024 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55de1af9-73e4-4873-baa1-6bfcb58fea02 admin admin] SCRIPT_NAME: `/identity` {{(pid=71939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 24 16:48:10.379360 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55de1af9-73e4-4873-baa1-6bfcb58fea02 admin admin] PATH_INFO: `/v3/projects/7b770c1ee1024ee4807e284a94960fd0/users/1e837ea3812449029236efda9a2d6448/roles/912ab5f10fa5477da74acf239f07604e` {{(pid=71939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 24 16:48:10.400722 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55de1af9-73e4-4873-baa1-6bfcb58fea02 admin admin] RBAC: Authorizing `identity:create_grant(project_id=7b770c1ee1024ee4807e284a94960fd0, user_id=1e837ea3812449029236efda9a2d6448, role_id=912ab5f10fa5477da74acf239f07604e)` {{(pid=71939) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:442}} Nov 24 16:48:10.418385 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: [pid: 71938|app: 0|req: 889/1776] 10.222.0.53 () {58 vars in 948 bytes} [Wed Nov 24 16:48:10 2021] POST /identity/v3/auth/tokens => generated 3670 bytes in 123 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 24 16:48:10.419267 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f24b8710-3c31-469d-9e2e-5eb68c29dad9 None None] Authenticating user token {{(pid=71938) process_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 24 16:48:10.429430 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f24b8710-3c31-469d-9e2e-5eb68c29dad9 None None] Validating token access rules against request {{(pid=71938) validate_allowed_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 24 16:48:10.430929 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55de1af9-73e4-4873-baa1-6bfcb58fea02 admin admin] RBAC: Authorization granted {{(pid=71939) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 24 16:48:10.434923 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81d429bc-516d-4ad8-9da3-2e16f478614e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f2ba2e8375b4e8c8792ee1e22b60427', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '00a5583c7b7443e98e7a1d31a0b638dc', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=71938) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 24 16:48:10.435821 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81d429bc-516d-4ad8-9da3-2e16f478614e admin admin] REQUEST_METHOD: `PUT` {{(pid=71938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 24 16:48:10.436149 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81d429bc-516d-4ad8-9da3-2e16f478614e admin admin] SCRIPT_NAME: `/identity` {{(pid=71938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 24 16:48:10.436525 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81d429bc-516d-4ad8-9da3-2e16f478614e admin admin] PATH_INFO: `/v3/projects/5f233f0fcba8420e927440d4f8a1df4a/users/d359ab80375b47d6bffe721f23a9de94/roles/912ab5f10fa5477da74acf239f07604e` {{(pid=71938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 24 16:48:10.443876 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: [pid: 71939|app: 0|req: 888/1777] 10.222.0.53 () {60 vars in 1473 bytes} [Wed Nov 24 16:48:10 2021] PUT /identity/v3/projects/7b770c1ee1024ee4807e284a94960fd0/users/1e837ea3812449029236efda9a2d6448/roles/912ab5f10fa5477da74acf239f07604e => generated 0 bytes in 85 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 24 16:48:10.444782 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55de1af9-73e4-4873-baa1-6bfcb58fea02 admin admin] Authenticating user token {{(pid=71939) process_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 24 16:48:10.458669 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81d429bc-516d-4ad8-9da3-2e16f478614e admin admin] RBAC: Authorizing `identity:create_grant(project_id=5f233f0fcba8420e927440d4f8a1df4a, user_id=d359ab80375b47d6bffe721f23a9de94, role_id=912ab5f10fa5477da74acf239f07604e)` {{(pid=71938) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:442}} Nov 24 16:48:10.489837 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81d429bc-516d-4ad8-9da3-2e16f478614e admin admin] RBAC: Authorization granted {{(pid=71938) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 24 16:48:10.502872 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: [pid: 71938|app: 0|req: 890/1778] 10.222.0.53 () {60 vars in 1473 bytes} [Wed Nov 24 16:48:10 2021] PUT /identity/v3/projects/5f233f0fcba8420e927440d4f8a1df4a/users/d359ab80375b47d6bffe721f23a9de94/roles/912ab5f10fa5477da74acf239f07604e => generated 0 bytes in 84 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 24 16:48:10.504553 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81d429bc-516d-4ad8-9da3-2e16f478614e admin admin] Authenticating user token {{(pid=71938) process_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 24 16:48:10.520155 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55de1af9-73e4-4873-baa1-6bfcb58fea02 admin admin] Validating token access rules against request {{(pid=71939) validate_allowed_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 24 16:48:10.579775 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81d429bc-516d-4ad8-9da3-2e16f478614e admin admin] Validating token access rules against request {{(pid=71938) validate_allowed_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 24 16:48:10.586882 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83f2ad05-9cf7-47bc-a1a0-68b76416d322 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f2ba2e8375b4e8c8792ee1e22b60427', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '00a5583c7b7443e98e7a1d31a0b638dc', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=71938) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 24 16:48:10.587817 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83f2ad05-9cf7-47bc-a1a0-68b76416d322 admin admin] REQUEST_METHOD: `PUT` {{(pid=71938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 24 16:48:10.588147 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83f2ad05-9cf7-47bc-a1a0-68b76416d322 admin admin] SCRIPT_NAME: `/identity` {{(pid=71938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 24 16:48:10.588483 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83f2ad05-9cf7-47bc-a1a0-68b76416d322 admin admin] PATH_INFO: `/v3/projects/5bc4b64f600d48fe89469791c11343df/users/5e2f5fe0a70c48dfa7bfaff9973b6e62/roles/912ab5f10fa5477da74acf239f07604e` {{(pid=71938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 24 16:48:10.590340 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc7756b7-0faa-4a8f-8ffe-eeb0214d2482 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f2ba2e8375b4e8c8792ee1e22b60427', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '00a5583c7b7443e98e7a1d31a0b638dc', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=71939) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 24 16:48:10.591027 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc7756b7-0faa-4a8f-8ffe-eeb0214d2482 admin admin] REQUEST_METHOD: `GET` {{(pid=71939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 24 16:48:10.591401 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc7756b7-0faa-4a8f-8ffe-eeb0214d2482 admin admin] SCRIPT_NAME: `/identity` {{(pid=71939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 24 16:48:10.591738 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc7756b7-0faa-4a8f-8ffe-eeb0214d2482 admin admin] PATH_INFO: `/v3/roles` {{(pid=71939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 24 16:48:10.592537 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc7756b7-0faa-4a8f-8ffe-eeb0214d2482 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=71939) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:442}} Nov 24 16:48:10.609654 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83f2ad05-9cf7-47bc-a1a0-68b76416d322 admin admin] RBAC: Authorizing `identity:create_grant(project_id=5bc4b64f600d48fe89469791c11343df, user_id=5e2f5fe0a70c48dfa7bfaff9973b6e62, role_id=912ab5f10fa5477da74acf239f07604e)` {{(pid=71938) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:442}} Nov 24 16:48:10.621156 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc7756b7-0faa-4a8f-8ffe-eeb0214d2482 admin admin] RBAC: Authorization granted {{(pid=71939) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 24 16:48:10.632478 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: [pid: 71939|app: 0|req: 889/1779] 10.222.0.53 () {58 vars in 1112 bytes} [Wed Nov 24 16:48:10 2021] GET /identity/v3/roles => generated 1420 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 24 16:48:10.635246 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b49e6037-5838-4bcd-a1ec-c7921bd36548 None None] REQUEST_METHOD: `POST` {{(pid=71939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 24 16:48:10.635603 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b49e6037-5838-4bcd-a1ec-c7921bd36548 None None] SCRIPT_NAME: `/identity` {{(pid=71939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 24 16:48:10.635937 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b49e6037-5838-4bcd-a1ec-c7921bd36548 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=71939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 24 16:48:10.640748 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83f2ad05-9cf7-47bc-a1a0-68b76416d322 admin admin] RBAC: Authorization granted {{(pid=71938) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 24 16:48:10.653361 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: [pid: 71938|app: 0|req: 891/1780] 10.222.0.53 () {60 vars in 1473 bytes} [Wed Nov 24 16:48:10 2021] PUT /identity/v3/projects/5bc4b64f600d48fe89469791c11343df/users/5e2f5fe0a70c48dfa7bfaff9973b6e62/roles/912ab5f10fa5477da74acf239f07604e => generated 0 bytes in 150 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 24 16:48:10.657671 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-022762cf-0f8f-43ed-b5cb-9f64b76039f9 None None] REQUEST_METHOD: `POST` {{(pid=71938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 24 16:48:10.657671 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-022762cf-0f8f-43ed-b5cb-9f64b76039f9 None None] SCRIPT_NAME: `/identity` {{(pid=71938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 24 16:48:10.657671 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-022762cf-0f8f-43ed-b5cb-9f64b76039f9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=71938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 24 16:48:10.665944 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.auth.core [None req-b49e6037-5838-4bcd-a1ec-c7921bd36548 None None] MFA Rules not processed for user `0f2ba2e8375b4e8c8792ee1e22b60427`. Rule list: `[]` (Enabled: `True`). {{(pid=71939) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:442}} Nov 24 16:48:10.667334 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.fernet_utils [None req-b49e6037-5838-4bcd-a1ec-c7921bd36548 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=71939) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:289}} Nov 24 16:48:10.694845 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.auth.core [None req-022762cf-0f8f-43ed-b5cb-9f64b76039f9 None None] MFA Rules not processed for user `34d2bfdcf76b4d5bb3f013dcd99f817f`. Rule list: `[]` (Enabled: `True`). {{(pid=71938) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:442}} Nov 24 16:48:10.696627 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.fernet_utils [None req-022762cf-0f8f-43ed-b5cb-9f64b76039f9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=71938) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:289}} Nov 24 16:48:10.737993 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: [pid: 71939|app: 0|req: 890/1781] 10.222.0.53 () {58 vars in 948 bytes} [Wed Nov 24 16:48:10 2021] POST /identity/v3/auth/tokens => generated 3669 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 24 16:48:10.739557 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b49e6037-5838-4bcd-a1ec-c7921bd36548 None None] Authenticating user token {{(pid=71939) process_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 24 16:48:10.740874 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.fernet_utils [None req-b49e6037-5838-4bcd-a1ec-c7921bd36548 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=71939) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:289}} Nov 24 16:48:10.784203 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: [pid: 71938|app: 0|req: 892/1782] 10.222.0.53 () {58 vars in 948 bytes} [Wed Nov 24 16:48:10 2021] POST /identity/v3/auth/tokens => generated 3690 bytes in 130 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 24 16:48:10.785114 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-022762cf-0f8f-43ed-b5cb-9f64b76039f9 None None] Authenticating user token {{(pid=71938) process_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 24 16:48:10.801066 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-022762cf-0f8f-43ed-b5cb-9f64b76039f9 None None] Validating token access rules against request {{(pid=71938) validate_allowed_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 24 16:48:10.806425 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ad273f3-e421-4664-ba05-3c8abb81aa19 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f2ba2e8375b4e8c8792ee1e22b60427', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '00a5583c7b7443e98e7a1d31a0b638dc', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=71938) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 24 16:48:10.807098 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ad273f3-e421-4664-ba05-3c8abb81aa19 admin admin] REQUEST_METHOD: `POST` {{(pid=71938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 24 16:48:10.807446 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ad273f3-e421-4664-ba05-3c8abb81aa19 admin admin] SCRIPT_NAME: `/identity` {{(pid=71938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 24 16:48:10.807785 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ad273f3-e421-4664-ba05-3c8abb81aa19 admin admin] PATH_INFO: `/v3/projects` {{(pid=71938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 24 16:48:10.808532 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ad273f3-e421-4664-ba05-3c8abb81aa19 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=71938) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:442}} Nov 24 16:48:10.812114 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b49e6037-5838-4bcd-a1ec-c7921bd36548 None None] Validating token access rules against request {{(pid=71939) validate_allowed_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 24 16:48:10.815918 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d8f05ca-c5b0-46de-99ed-3a5ee59b5343 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c90f21b9cdcb413282461fa83cb6b7a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3b3940d4ae1c4177ae29c02377bb4b0b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=71939) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 24 16:48:10.816582 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d8f05ca-c5b0-46de-99ed-3a5ee59b5343 service neutron] REQUEST_METHOD: `GET` {{(pid=71939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 24 16:48:10.816920 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d8f05ca-c5b0-46de-99ed-3a5ee59b5343 service neutron] SCRIPT_NAME: `/identity` {{(pid=71939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 24 16:48:10.817506 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d8f05ca-c5b0-46de-99ed-3a5ee59b5343 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=71939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 24 16:48:10.827143 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d8f05ca-c5b0-46de-99ed-3a5ee59b5343 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=71939) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:442}} Nov 24 16:48:10.838143 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ad273f3-e421-4664-ba05-3c8abb81aa19 admin admin] RBAC: Authorization granted {{(pid=71938) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 24 16:48:10.855584 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d8f05ca-c5b0-46de-99ed-3a5ee59b5343 service neutron] RBAC: Authorization granted {{(pid=71939) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 24 16:48:10.866116 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: [pid: 71939|app: 0|req: 891/1783] 10.222.0.53 () {60 vars in 1356 bytes} [Wed Nov 24 16:48:10 2021] GET /identity/v3/auth/tokens => generated 3669 bytes in 127 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 24 16:48:10.870382 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: [pid: 71938|app: 0|req: 893/1784] 10.222.0.53 () {60 vars in 1143 bytes} [Wed Nov 24 16:48:10 2021] POST /identity/v3/projects => generated 363 bytes in 82 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 24 16:48:10.870555 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fa3c292-3250-43cf-982a-6bc618ce1a66 None None] REQUEST_METHOD: `POST` {{(pid=71939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 24 16:48:10.870555 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fa3c292-3250-43cf-982a-6bc618ce1a66 None None] SCRIPT_NAME: `/identity` {{(pid=71939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 24 16:48:10.870555 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fa3c292-3250-43cf-982a-6bc618ce1a66 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=71939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 24 16:48:10.870798 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2fe4e7a-aa34-486d-a4f5-b064880215fe None None] REQUEST_METHOD: `POST` {{(pid=71938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 24 16:48:10.870798 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2fe4e7a-aa34-486d-a4f5-b064880215fe None None] SCRIPT_NAME: `/identity` {{(pid=71938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 24 16:48:10.870798 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2fe4e7a-aa34-486d-a4f5-b064880215fe None None] PATH_INFO: `/v3/auth/tokens` {{(pid=71938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 24 16:48:10.894062 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.auth.core [None req-9fa3c292-3250-43cf-982a-6bc618ce1a66 None None] MFA Rules not processed for user `0f2ba2e8375b4e8c8792ee1e22b60427`. Rule list: `[]` (Enabled: `True`). {{(pid=71939) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:442}} Nov 24 16:48:10.895325 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.fernet_utils [None req-9fa3c292-3250-43cf-982a-6bc618ce1a66 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=71939) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:289}} Nov 24 16:48:10.912080 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.auth.core [None req-d2fe4e7a-aa34-486d-a4f5-b064880215fe None None] MFA Rules not processed for user `d359ab80375b47d6bffe721f23a9de94`. Rule list: `[]` (Enabled: `True`). {{(pid=71938) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:442}} Nov 24 16:48:10.913642 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.fernet_utils [None req-d2fe4e7a-aa34-486d-a4f5-b064880215fe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=71938) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:289}} Nov 24 16:48:10.978440 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: [pid: 71939|app: 0|req: 892/1785] 10.222.0.53 () {58 vars in 948 bytes} [Wed Nov 24 16:48:10 2021] POST /identity/v3/auth/tokens => generated 3669 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 24 16:48:10.979706 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fa3c292-3250-43cf-982a-6bc618ce1a66 None None] Authenticating user token {{(pid=71939) process_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 24 16:48:10.990780 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fa3c292-3250-43cf-982a-6bc618ce1a66 None None] Validating token access rules against request {{(pid=71939) validate_allowed_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 24 16:48:10.995548 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54c8d7cc-2b9b-4bd2-bfc0-474e2fd9b34d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f2ba2e8375b4e8c8792ee1e22b60427', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '00a5583c7b7443e98e7a1d31a0b638dc', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=71939) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 24 16:48:10.996457 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54c8d7cc-2b9b-4bd2-bfc0-474e2fd9b34d admin admin] REQUEST_METHOD: `PUT` {{(pid=71939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 24 16:48:10.996798 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54c8d7cc-2b9b-4bd2-bfc0-474e2fd9b34d admin admin] SCRIPT_NAME: `/identity` {{(pid=71939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 24 16:48:10.997128 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54c8d7cc-2b9b-4bd2-bfc0-474e2fd9b34d admin admin] PATH_INFO: `/v3/projects/5a5f651da88c4759abbc0a4ed4870465/users/5c5e1f31cc864503a91b55a050874198/roles/5611724e350b41e19921b5961a342582` {{(pid=71939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 24 16:48:11.005939 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: [pid: 71938|app: 0|req: 894/1786] 10.222.0.53 () {58 vars in 948 bytes} [Wed Nov 24 16:48:10 2021] POST /identity/v3/auth/tokens => generated 3664 bytes in 135 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 24 16:48:11.005939 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ecb829b-15a3-4c20-8771-74f1f1ad221e None None] REQUEST_METHOD: `POST` {{(pid=71938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 24 16:48:11.005939 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ecb829b-15a3-4c20-8771-74f1f1ad221e None None] SCRIPT_NAME: `/identity` {{(pid=71938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 24 16:48:11.005939 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ecb829b-15a3-4c20-8771-74f1f1ad221e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=71938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 24 16:48:11.021756 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54c8d7cc-2b9b-4bd2-bfc0-474e2fd9b34d admin admin] RBAC: Authorizing `identity:create_grant(project_id=5a5f651da88c4759abbc0a4ed4870465, user_id=5c5e1f31cc864503a91b55a050874198, role_id=5611724e350b41e19921b5961a342582)` {{(pid=71939) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:442}} Nov 24 16:48:11.042961 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.auth.core [None req-2ecb829b-15a3-4c20-8771-74f1f1ad221e None None] MFA Rules not processed for user `0f2ba2e8375b4e8c8792ee1e22b60427`. Rule list: `[]` (Enabled: `True`). {{(pid=71938) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:442}} Nov 24 16:48:11.044286 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.fernet_utils [None req-2ecb829b-15a3-4c20-8771-74f1f1ad221e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=71938) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:289}} Nov 24 16:48:11.054608 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54c8d7cc-2b9b-4bd2-bfc0-474e2fd9b34d admin admin] RBAC: Authorization granted {{(pid=71939) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 24 16:48:11.058586 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: [pid: 71938|app: 0|req: 895/1787] 10.222.0.53 () {58 vars in 948 bytes} [Wed Nov 24 16:48:11 2021] POST /identity/v3/auth/tokens => generated 3669 bytes in 55 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 24 16:48:11.060527 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ecb829b-15a3-4c20-8771-74f1f1ad221e None None] Authenticating user token {{(pid=71938) process_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 24 16:48:11.073042 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: [pid: 71939|app: 0|req: 893/1788] 10.222.0.53 () {60 vars in 1473 bytes} [Wed Nov 24 16:48:10 2021] PUT /identity/v3/projects/5a5f651da88c4759abbc0a4ed4870465/users/5c5e1f31cc864503a91b55a050874198/roles/5611724e350b41e19921b5961a342582 => generated 0 bytes in 90 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 24 16:48:11.073042 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76eea5f7-0765-423e-8ed9-bc67208a9ca1 None None] REQUEST_METHOD: `GET` {{(pid=71939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 24 16:48:11.073042 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76eea5f7-0765-423e-8ed9-bc67208a9ca1 None None] SCRIPT_NAME: `/identity` {{(pid=71939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 24 16:48:11.073042 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76eea5f7-0765-423e-8ed9-bc67208a9ca1 None None] PATH_INFO: `/` {{(pid=71939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 24 16:48:11.074462 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: [pid: 71939|app: 0|req: 894/1789] 10.222.0.53 () {54 vars in 943 bytes} [Wed Nov 24 16:48:11 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 24 16:48:11.075251 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76eea5f7-0765-423e-8ed9-bc67208a9ca1 None None] Authenticating user token {{(pid=71939) process_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 24 16:48:11.150265 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ecb829b-15a3-4c20-8771-74f1f1ad221e None None] Validating token access rules against request {{(pid=71938) validate_allowed_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 24 16:48:11.160416 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76eea5f7-0765-423e-8ed9-bc67208a9ca1 None None] Validating token access rules against request {{(pid=71939) validate_allowed_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 24 16:48:11.165189 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e71df6ae-4146-4e86-aa78-89821561ab3f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f2ba2e8375b4e8c8792ee1e22b60427', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '00a5583c7b7443e98e7a1d31a0b638dc', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=71939) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 24 16:48:11.165873 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e71df6ae-4146-4e86-aa78-89821561ab3f admin admin] REQUEST_METHOD: `POST` {{(pid=71939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 24 16:48:11.166248 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e71df6ae-4146-4e86-aa78-89821561ab3f admin admin] SCRIPT_NAME: `/identity` {{(pid=71939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 24 16:48:11.166584 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e71df6ae-4146-4e86-aa78-89821561ab3f admin admin] PATH_INFO: `/v3/users` {{(pid=71939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 24 16:48:11.167329 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e71df6ae-4146-4e86-aa78-89821561ab3f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=71939) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:442}} Nov 24 16:48:11.197855 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e71df6ae-4146-4e86-aa78-89821561ab3f admin admin] RBAC: Authorization granted {{(pid=71939) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 24 16:48:11.225415 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: [pid: 71939|app: 0|req: 895/1790] 10.222.0.53 () {60 vars in 1134 bytes} [Wed Nov 24 16:48:11 2021] POST /identity/v3/users => generated 288 bytes in 150 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 24 16:48:11.226372 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e71df6ae-4146-4e86-aa78-89821561ab3f admin admin] Authenticating user token {{(pid=71939) process_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 24 16:48:11.254463 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61430962-e75a-46b8-8ece-4ddfbd20fba3 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c90f21b9cdcb413282461fa83cb6b7a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3b3940d4ae1c4177ae29c02377bb4b0b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=71938) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 24 16:48:11.255253 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61430962-e75a-46b8-8ece-4ddfbd20fba3 service neutron] REQUEST_METHOD: `GET` {{(pid=71938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 24 16:48:11.255475 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61430962-e75a-46b8-8ece-4ddfbd20fba3 service neutron] SCRIPT_NAME: `/identity` {{(pid=71938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 24 16:48:11.255806 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61430962-e75a-46b8-8ece-4ddfbd20fba3 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=71938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 24 16:48:11.268633 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61430962-e75a-46b8-8ece-4ddfbd20fba3 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=71938) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:442}} Nov 24 16:48:11.299139 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61430962-e75a-46b8-8ece-4ddfbd20fba3 service neutron] RBAC: Authorization granted {{(pid=71938) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 24 16:48:11.308509 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e71df6ae-4146-4e86-aa78-89821561ab3f admin admin] Validating token access rules against request {{(pid=71939) validate_allowed_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 24 16:48:11.310884 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: [pid: 71938|app: 0|req: 896/1791] 10.222.0.53 () {60 vars in 1356 bytes} [Wed Nov 24 16:48:11 2021] GET /identity/v3/auth/tokens => generated 3669 bytes in 252 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 24 16:48:11.311732 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61430962-e75a-46b8-8ece-4ddfbd20fba3 service neutron] Authenticating user token {{(pid=71938) process_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 24 16:48:11.313394 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d505c92-facf-4ed2-94ca-fd083de29e1e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c90f21b9cdcb413282461fa83cb6b7a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3b3940d4ae1c4177ae29c02377bb4b0b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=71939) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 24 16:48:11.314431 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d505c92-facf-4ed2-94ca-fd083de29e1e service neutron] REQUEST_METHOD: `GET` {{(pid=71939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 24 16:48:11.314860 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d505c92-facf-4ed2-94ca-fd083de29e1e service neutron] SCRIPT_NAME: `/identity` {{(pid=71939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 24 16:48:11.315283 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d505c92-facf-4ed2-94ca-fd083de29e1e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=71939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 24 16:48:11.322092 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61430962-e75a-46b8-8ece-4ddfbd20fba3 service neutron] Validating token access rules against request {{(pid=71938) validate_allowed_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 24 16:48:11.326499 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d505c92-facf-4ed2-94ca-fd083de29e1e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=71939) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:442}} Nov 24 16:48:11.327308 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70d457c0-a04a-4911-9c3b-cede1365ed71 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f2ba2e8375b4e8c8792ee1e22b60427', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '00a5583c7b7443e98e7a1d31a0b638dc', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=71938) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 24 16:48:11.328475 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70d457c0-a04a-4911-9c3b-cede1365ed71 admin admin] REQUEST_METHOD: `POST` {{(pid=71938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 24 16:48:11.328816 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70d457c0-a04a-4911-9c3b-cede1365ed71 admin admin] SCRIPT_NAME: `/identity` {{(pid=71938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 24 16:48:11.329212 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70d457c0-a04a-4911-9c3b-cede1365ed71 admin admin] PATH_INFO: `/v3/projects` {{(pid=71938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 24 16:48:11.330005 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70d457c0-a04a-4911-9c3b-cede1365ed71 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=71938) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:442}} Nov 24 16:48:11.359547 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d505c92-facf-4ed2-94ca-fd083de29e1e service neutron] RBAC: Authorization granted {{(pid=71939) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 24 16:48:11.362396 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70d457c0-a04a-4911-9c3b-cede1365ed71 admin admin] RBAC: Authorization granted {{(pid=71938) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 24 16:48:11.370407 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: [pid: 71939|app: 0|req: 896/1792] 10.222.0.53 () {60 vars in 1356 bytes} [Wed Nov 24 16:48:11 2021] GET /identity/v3/auth/tokens => generated 3669 bytes in 144 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 24 16:48:11.371093 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d505c92-facf-4ed2-94ca-fd083de29e1e service neutron] Authenticating user token {{(pid=71939) process_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 24 16:48:11.382859 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d505c92-facf-4ed2-94ca-fd083de29e1e service neutron] Validating token access rules against request {{(pid=71939) validate_allowed_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 24 16:48:11.389256 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29b70fb3-800d-4048-88d4-b15b440d1c77 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c90f21b9cdcb413282461fa83cb6b7a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3b3940d4ae1c4177ae29c02377bb4b0b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=71939) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 24 16:48:11.390254 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29b70fb3-800d-4048-88d4-b15b440d1c77 service neutron] REQUEST_METHOD: `GET` {{(pid=71939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 24 16:48:11.390588 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29b70fb3-800d-4048-88d4-b15b440d1c77 service neutron] SCRIPT_NAME: `/identity` {{(pid=71939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 24 16:48:11.390906 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29b70fb3-800d-4048-88d4-b15b440d1c77 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=71939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 24 16:48:11.404888 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: [pid: 71938|app: 0|req: 897/1793] 10.222.0.53 () {60 vars in 1143 bytes} [Wed Nov 24 16:48:11 2021] POST /identity/v3/projects => generated 357 bytes in 93 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 24 16:48:11.406070 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70d457c0-a04a-4911-9c3b-cede1365ed71 admin admin] Authenticating user token {{(pid=71938) process_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 24 16:48:11.413640 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29b70fb3-800d-4048-88d4-b15b440d1c77 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=71939) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:442}} Nov 24 16:48:11.448103 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29b70fb3-800d-4048-88d4-b15b440d1c77 service neutron] RBAC: Authorization granted {{(pid=71939) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 24 16:48:11.459751 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: [pid: 71939|app: 0|req: 897/1794] 10.222.0.53 () {60 vars in 1356 bytes} [Wed Nov 24 16:48:11 2021] GET /identity/v3/auth/tokens => generated 3669 bytes in 89 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 24 16:48:11.461001 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58df4a6d-e2f7-4ca2-b5ef-862695c2c76f None None] REQUEST_METHOD: `POST` {{(pid=71939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 24 16:48:11.461391 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58df4a6d-e2f7-4ca2-b5ef-862695c2c76f None None] SCRIPT_NAME: `/identity` {{(pid=71939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 24 16:48:11.461708 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58df4a6d-e2f7-4ca2-b5ef-862695c2c76f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=71939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 24 16:48:11.489422 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.auth.core [None req-58df4a6d-e2f7-4ca2-b5ef-862695c2c76f None None] MFA Rules not processed for user `3e196802d4d5432482b6d2eabc25f74e`. Rule list: `[]` (Enabled: `True`). {{(pid=71939) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:442}} Nov 24 16:48:11.491370 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.fernet_utils [None req-58df4a6d-e2f7-4ca2-b5ef-862695c2c76f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=71939) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:289}} Nov 24 16:48:11.515726 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70d457c0-a04a-4911-9c3b-cede1365ed71 admin admin] Validating token access rules against request {{(pid=71938) validate_allowed_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 24 16:48:11.521004 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4651af26-8952-46f9-9971-f6dadb22c569 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f2ba2e8375b4e8c8792ee1e22b60427', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '00a5583c7b7443e98e7a1d31a0b638dc', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=71938) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 24 16:48:11.522156 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4651af26-8952-46f9-9971-f6dadb22c569 admin admin] REQUEST_METHOD: `GET` {{(pid=71938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 24 16:48:11.522941 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4651af26-8952-46f9-9971-f6dadb22c569 admin admin] SCRIPT_NAME: `/identity` {{(pid=71938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 24 16:48:11.523357 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4651af26-8952-46f9-9971-f6dadb22c569 admin admin] PATH_INFO: `/v3/roles` {{(pid=71938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 24 16:48:11.525440 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4651af26-8952-46f9-9971-f6dadb22c569 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=71938) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:442}} Nov 24 16:48:11.565229 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4651af26-8952-46f9-9971-f6dadb22c569 admin admin] RBAC: Authorization granted {{(pid=71938) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 24 16:48:11.583894 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: [pid: 71938|app: 0|req: 898/1795] 10.222.0.53 () {58 vars in 1112 bytes} [Wed Nov 24 16:48:11 2021] GET /identity/v3/roles => generated 1420 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 24 16:48:11.583894 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4651af26-8952-46f9-9971-f6dadb22c569 admin admin] Authenticating user token {{(pid=71938) process_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 24 16:48:11.586560 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: [pid: 71939|app: 0|req: 898/1796] 10.222.0.53 () {58 vars in 1041 bytes} [Wed Nov 24 16:48:11 2021] POST /identity/v3/auth/tokens => generated 3802 bytes in 126 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 24 16:48:11.587465 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58df4a6d-e2f7-4ca2-b5ef-862695c2c76f None None] Authenticating user token {{(pid=71939) process_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 24 16:48:11.607549 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4651af26-8952-46f9-9971-f6dadb22c569 admin admin] Validating token access rules against request {{(pid=71938) validate_allowed_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 24 16:48:11.607935 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58df4a6d-e2f7-4ca2-b5ef-862695c2c76f None None] Validating token access rules against request {{(pid=71939) validate_allowed_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 24 16:48:11.612482 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa34f31f-a9e1-43f4-9258-1de478c0bb48 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f2ba2e8375b4e8c8792ee1e22b60427', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '00a5583c7b7443e98e7a1d31a0b638dc', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=71938) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 24 16:48:11.613167 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa34f31f-a9e1-43f4-9258-1de478c0bb48 admin admin] REQUEST_METHOD: `GET` {{(pid=71938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 24 16:48:11.613506 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa34f31f-a9e1-43f4-9258-1de478c0bb48 admin admin] SCRIPT_NAME: `/identity` {{(pid=71938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 24 16:48:11.613839 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa34f31f-a9e1-43f4-9258-1de478c0bb48 admin admin] PATH_INFO: `/v3/roles` {{(pid=71938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 24 16:48:11.614668 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa34f31f-a9e1-43f4-9258-1de478c0bb48 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=71938) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:442}} Nov 24 16:48:11.615918 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e41d1fa6-f4a8-4c17-9217-7ce77dc26f87 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f2ba2e8375b4e8c8792ee1e22b60427', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '00a5583c7b7443e98e7a1d31a0b638dc', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=71939) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 24 16:48:11.617046 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e41d1fa6-f4a8-4c17-9217-7ce77dc26f87 admin admin] REQUEST_METHOD: `POST` {{(pid=71939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 24 16:48:11.618448 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e41d1fa6-f4a8-4c17-9217-7ce77dc26f87 admin admin] SCRIPT_NAME: `/identity` {{(pid=71939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 24 16:48:11.619254 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e41d1fa6-f4a8-4c17-9217-7ce77dc26f87 admin admin] PATH_INFO: `/v3/users` {{(pid=71939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 24 16:48:11.620201 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e41d1fa6-f4a8-4c17-9217-7ce77dc26f87 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=71939) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:442}} Nov 24 16:48:11.644494 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa34f31f-a9e1-43f4-9258-1de478c0bb48 admin admin] RBAC: Authorization granted {{(pid=71938) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 24 16:48:11.655314 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e41d1fa6-f4a8-4c17-9217-7ce77dc26f87 admin admin] RBAC: Authorization granted {{(pid=71939) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 24 16:48:11.659871 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: [pid: 71938|app: 0|req: 899/1797] 10.222.0.53 () {58 vars in 1112 bytes} [Wed Nov 24 16:48:11 2021] GET /identity/v3/roles => generated 1420 bytes in 75 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 24 16:48:11.659871 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa34f31f-a9e1-43f4-9258-1de478c0bb48 admin admin] Authenticating user token {{(pid=71938) process_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 24 16:48:11.680626 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa34f31f-a9e1-43f4-9258-1de478c0bb48 admin admin] Validating token access rules against request {{(pid=71938) validate_allowed_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 24 16:48:11.687095 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: [pid: 71939|app: 0|req: 899/1798] 10.222.0.53 () {60 vars in 1134 bytes} [Wed Nov 24 16:48:11 2021] POST /identity/v3/users => generated 285 bytes in 100 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 24 16:48:11.690765 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3701b92b-05db-467e-b49a-a3c1fde262b0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f2ba2e8375b4e8c8792ee1e22b60427', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '00a5583c7b7443e98e7a1d31a0b638dc', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=71938) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 24 16:48:11.691391 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e41d1fa6-f4a8-4c17-9217-7ce77dc26f87 admin admin] Authenticating user token {{(pid=71939) process_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 24 16:48:11.692858 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3701b92b-05db-467e-b49a-a3c1fde262b0 admin admin] REQUEST_METHOD: `PUT` {{(pid=71938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 24 16:48:11.693196 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3701b92b-05db-467e-b49a-a3c1fde262b0 admin admin] SCRIPT_NAME: `/identity` {{(pid=71938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 24 16:48:11.693534 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3701b92b-05db-467e-b49a-a3c1fde262b0 admin admin] PATH_INFO: `/v3/projects/5a5f651da88c4759abbc0a4ed4870465/users/5c5e1f31cc864503a91b55a050874198/roles/5611724e350b41e19921b5961a342582` {{(pid=71938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 24 16:48:11.701873 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3701b92b-05db-467e-b49a-a3c1fde262b0 admin admin] RBAC: Authorizing `identity:create_grant(project_id=5a5f651da88c4759abbc0a4ed4870465, user_id=5c5e1f31cc864503a91b55a050874198, role_id=5611724e350b41e19921b5961a342582)` {{(pid=71938) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:442}} Nov 24 16:48:11.704913 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e41d1fa6-f4a8-4c17-9217-7ce77dc26f87 admin admin] Validating token access rules against request {{(pid=71939) validate_allowed_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 24 16:48:11.711351 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3c470f0-db25-426c-9d2a-a82c660cf5a4 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e196802d4d5432482b6d2eabc25f74e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3b3940d4ae1c4177ae29c02377bb4b0b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'service', 'ResellerAdmin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=71939) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 24 16:48:11.712429 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3c470f0-db25-426c-9d2a-a82c660cf5a4 service nova] REQUEST_METHOD: `GET` {{(pid=71939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 24 16:48:11.712843 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3c470f0-db25-426c-9d2a-a82c660cf5a4 service nova] SCRIPT_NAME: `/identity` {{(pid=71939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 24 16:48:11.713246 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3c470f0-db25-426c-9d2a-a82c660cf5a4 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=71939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 24 16:48:11.760354 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3701b92b-05db-467e-b49a-a3c1fde262b0 admin admin] RBAC: Authorization granted {{(pid=71938) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 24 16:48:11.776734 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: [pid: 71938|app: 0|req: 900/1799] 10.222.0.53 () {60 vars in 1473 bytes} [Wed Nov 24 16:48:11 2021] PUT /identity/v3/projects/5a5f651da88c4759abbc0a4ed4870465/users/5c5e1f31cc864503a91b55a050874198/roles/5611724e350b41e19921b5961a342582 => generated 0 bytes in 119 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 24 16:48:11.777386 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3701b92b-05db-467e-b49a-a3c1fde262b0 admin admin] Authenticating user token {{(pid=71938) process_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 24 16:48:11.802628 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3c470f0-db25-426c-9d2a-a82c660cf5a4 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=71939) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:442}} Nov 24 16:48:11.845052 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3c470f0-db25-426c-9d2a-a82c660cf5a4 service nova] RBAC: Authorization granted {{(pid=71939) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 24 16:48:11.860537 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: [pid: 71939|app: 0|req: 900/1800] 10.222.0.53 () {60 vars in 1356 bytes} [Wed Nov 24 16:48:11 2021] GET /identity/v3/auth/tokens => generated 3690 bytes in 170 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 24 16:48:11.862437 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3c470f0-db25-426c-9d2a-a82c660cf5a4 service nova] Authenticating user token {{(pid=71939) process_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 24 16:48:11.875992 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3c470f0-db25-426c-9d2a-a82c660cf5a4 service nova] Validating token access rules against request {{(pid=71939) validate_allowed_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 24 16:48:11.881289 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3701b92b-05db-467e-b49a-a3c1fde262b0 admin admin] Validating token access rules against request {{(pid=71938) validate_allowed_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 24 16:48:11.883591 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-487c9f9e-791e-4227-9d23-faf1c1fa588a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f2ba2e8375b4e8c8792ee1e22b60427', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '00a5583c7b7443e98e7a1d31a0b638dc', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=71939) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 24 16:48:11.884487 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-487c9f9e-791e-4227-9d23-faf1c1fa588a admin admin] REQUEST_METHOD: `GET` {{(pid=71939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 24 16:48:11.885424 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-487c9f9e-791e-4227-9d23-faf1c1fa588a admin admin] SCRIPT_NAME: `/identity` {{(pid=71939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 24 16:48:11.885897 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-487c9f9e-791e-4227-9d23-faf1c1fa588a admin admin] PATH_INFO: `/v3/roles` {{(pid=71939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 24 16:48:11.886873 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-487c9f9e-791e-4227-9d23-faf1c1fa588a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=71939) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:442}} Nov 24 16:48:11.888016 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbadc300-cc29-408e-89df-aa80c3a8cd81 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f2ba2e8375b4e8c8792ee1e22b60427', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '00a5583c7b7443e98e7a1d31a0b638dc', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=71938) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 24 16:48:11.889049 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbadc300-cc29-408e-89df-aa80c3a8cd81 admin admin] REQUEST_METHOD: `PUT` {{(pid=71938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 24 16:48:11.889510 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbadc300-cc29-408e-89df-aa80c3a8cd81 admin admin] SCRIPT_NAME: `/identity` {{(pid=71938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 24 16:48:11.889955 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbadc300-cc29-408e-89df-aa80c3a8cd81 admin admin] PATH_INFO: `/v3/projects/4c34c7ac33d54fc28f39edf828f2f0fc/users/0ea826d0ce944b51891b4e6937ca27de/roles/5611724e350b41e19921b5961a342582` {{(pid=71938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 24 16:48:11.916225 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbadc300-cc29-408e-89df-aa80c3a8cd81 admin admin] RBAC: Authorizing `identity:create_grant(project_id=4c34c7ac33d54fc28f39edf828f2f0fc, user_id=0ea826d0ce944b51891b4e6937ca27de, role_id=5611724e350b41e19921b5961a342582)` {{(pid=71938) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:442}} Nov 24 16:48:11.922421 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-487c9f9e-791e-4227-9d23-faf1c1fa588a admin admin] RBAC: Authorization granted {{(pid=71939) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 24 16:48:11.941646 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: [pid: 71939|app: 0|req: 901/1801] 10.222.0.53 () {58 vars in 1112 bytes} [Wed Nov 24 16:48:11 2021] GET /identity/v3/roles => generated 1420 bytes in 80 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 24 16:48:11.947535 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-487c9f9e-791e-4227-9d23-faf1c1fa588a admin admin] Authenticating user token {{(pid=71939) process_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 24 16:48:11.953982 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbadc300-cc29-408e-89df-aa80c3a8cd81 admin admin] RBAC: Authorization granted {{(pid=71938) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 24 16:48:11.959893 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-487c9f9e-791e-4227-9d23-faf1c1fa588a admin admin] Validating token access rules against request {{(pid=71939) validate_allowed_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 24 16:48:11.965285 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99484898-bcdf-4968-818d-cdfae74c1cb0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f2ba2e8375b4e8c8792ee1e22b60427', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '00a5583c7b7443e98e7a1d31a0b638dc', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=71939) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 24 16:48:11.966249 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99484898-bcdf-4968-818d-cdfae74c1cb0 admin admin] REQUEST_METHOD: `GET` {{(pid=71939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 24 16:48:11.966797 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99484898-bcdf-4968-818d-cdfae74c1cb0 admin admin] SCRIPT_NAME: `/identity` {{(pid=71939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 24 16:48:11.967310 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99484898-bcdf-4968-818d-cdfae74c1cb0 admin admin] PATH_INFO: `/v3/roles` {{(pid=71939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 24 16:48:11.968321 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99484898-bcdf-4968-818d-cdfae74c1cb0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=71939) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:442}} Nov 24 16:48:11.971547 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: [pid: 71938|app: 0|req: 901/1802] 10.222.0.53 () {60 vars in 1473 bytes} [Wed Nov 24 16:48:11 2021] PUT /identity/v3/projects/4c34c7ac33d54fc28f39edf828f2f0fc/users/0ea826d0ce944b51891b4e6937ca27de/roles/5611724e350b41e19921b5961a342582 => generated 0 bytes in 195 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 24 16:48:11.972525 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbadc300-cc29-408e-89df-aa80c3a8cd81 admin admin] Authenticating user token {{(pid=71938) process_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 24 16:48:11.997870 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99484898-bcdf-4968-818d-cdfae74c1cb0 admin admin] RBAC: Authorization granted {{(pid=71939) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 24 16:48:12.011280 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: [pid: 71939|app: 0|req: 902/1803] 10.222.0.53 () {58 vars in 1112 bytes} [Wed Nov 24 16:48:11 2021] GET /identity/v3/roles => generated 1420 bytes in 64 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 24 16:48:12.012508 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99484898-bcdf-4968-818d-cdfae74c1cb0 admin admin] Authenticating user token {{(pid=71939) process_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 24 16:48:12.024524 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99484898-bcdf-4968-818d-cdfae74c1cb0 admin admin] Validating token access rules against request {{(pid=71939) validate_allowed_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 24 16:48:12.063763 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbadc300-cc29-408e-89df-aa80c3a8cd81 admin admin] Validating token access rules against request {{(pid=71938) validate_allowed_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 24 16:48:12.071383 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d90c69e-d48f-439a-af9d-79b427256fab admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f2ba2e8375b4e8c8792ee1e22b60427', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '00a5583c7b7443e98e7a1d31a0b638dc', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=71938) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 24 16:48:12.071383 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d90c69e-d48f-439a-af9d-79b427256fab admin admin] REQUEST_METHOD: `PUT` {{(pid=71938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 24 16:48:12.071383 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d90c69e-d48f-439a-af9d-79b427256fab admin admin] SCRIPT_NAME: `/identity` {{(pid=71938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 24 16:48:12.071914 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d90c69e-d48f-439a-af9d-79b427256fab admin admin] PATH_INFO: `/v3/projects/7579cc0603984b5dabecafd4aec09470/users/8ef6c687f466463aae55da55f35c952d/roles/5611724e350b41e19921b5961a342582` {{(pid=71938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 24 16:48:12.100058 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d90c69e-d48f-439a-af9d-79b427256fab admin admin] RBAC: Authorizing `identity:create_grant(project_id=7579cc0603984b5dabecafd4aec09470, user_id=8ef6c687f466463aae55da55f35c952d, role_id=5611724e350b41e19921b5961a342582)` {{(pid=71938) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:442}} Nov 24 16:48:12.116786 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfaf415c-b746-4d6e-b94b-1f1feb34c417 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f2ba2e8375b4e8c8792ee1e22b60427', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '00a5583c7b7443e98e7a1d31a0b638dc', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=71939) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 24 16:48:12.117569 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfaf415c-b746-4d6e-b94b-1f1feb34c417 admin admin] REQUEST_METHOD: `GET` {{(pid=71939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 24 16:48:12.117992 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfaf415c-b746-4d6e-b94b-1f1feb34c417 admin admin] SCRIPT_NAME: `/identity` {{(pid=71939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 24 16:48:12.118437 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfaf415c-b746-4d6e-b94b-1f1feb34c417 admin admin] PATH_INFO: `/v3/roles` {{(pid=71939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 24 16:48:12.119316 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfaf415c-b746-4d6e-b94b-1f1feb34c417 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=71939) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:442}} Nov 24 16:48:12.134684 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d90c69e-d48f-439a-af9d-79b427256fab admin admin] RBAC: Authorization granted {{(pid=71938) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 24 16:48:12.156644 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfaf415c-b746-4d6e-b94b-1f1feb34c417 admin admin] RBAC: Authorization granted {{(pid=71939) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 24 16:48:12.159270 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: [pid: 71938|app: 0|req: 902/1804] 10.222.0.53 () {60 vars in 1473 bytes} [Wed Nov 24 16:48:11 2021] PUT /identity/v3/projects/7579cc0603984b5dabecafd4aec09470/users/8ef6c687f466463aae55da55f35c952d/roles/5611724e350b41e19921b5961a342582 => generated 0 bytes in 187 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 24 16:48:12.163906 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d90c69e-d48f-439a-af9d-79b427256fab admin admin] Authenticating user token {{(pid=71938) process_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 24 16:48:12.187974 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: [pid: 71939|app: 0|req: 903/1805] 10.222.0.53 () {58 vars in 1112 bytes} [Wed Nov 24 16:48:12 2021] GET /identity/v3/roles => generated 1420 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 24 16:48:12.189233 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfaf415c-b746-4d6e-b94b-1f1feb34c417 admin admin] Authenticating user token {{(pid=71939) process_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 24 16:48:12.203592 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfaf415c-b746-4d6e-b94b-1f1feb34c417 admin admin] Validating token access rules against request {{(pid=71939) validate_allowed_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 24 16:48:12.302749 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d8a1c36-7b56-400d-b48b-947c169b666d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f2ba2e8375b4e8c8792ee1e22b60427', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '00a5583c7b7443e98e7a1d31a0b638dc', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=71939) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 24 16:48:12.304183 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d8a1c36-7b56-400d-b48b-947c169b666d admin admin] REQUEST_METHOD: `GET` {{(pid=71939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 24 16:48:12.304720 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d8a1c36-7b56-400d-b48b-947c169b666d admin admin] SCRIPT_NAME: `/identity` {{(pid=71939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 24 16:48:12.305920 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d8a1c36-7b56-400d-b48b-947c169b666d admin admin] PATH_INFO: `/v3/roles` {{(pid=71939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 24 16:48:12.306846 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d8a1c36-7b56-400d-b48b-947c169b666d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=71939) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:442}} Nov 24 16:48:12.324452 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d90c69e-d48f-439a-af9d-79b427256fab admin admin] Validating token access rules against request {{(pid=71938) validate_allowed_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 24 16:48:12.337809 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2115e5f1-df8b-4882-84bd-a04c5df2c30c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f2ba2e8375b4e8c8792ee1e22b60427', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '00a5583c7b7443e98e7a1d31a0b638dc', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=71938) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 24 16:48:12.338955 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2115e5f1-df8b-4882-84bd-a04c5df2c30c admin admin] REQUEST_METHOD: `PUT` {{(pid=71938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 24 16:48:12.339386 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2115e5f1-df8b-4882-84bd-a04c5df2c30c admin admin] SCRIPT_NAME: `/identity` {{(pid=71938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 24 16:48:12.339893 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2115e5f1-df8b-4882-84bd-a04c5df2c30c admin admin] PATH_INFO: `/v3/projects/5a5f651da88c4759abbc0a4ed4870465/users/5c5e1f31cc864503a91b55a050874198/roles/912ab5f10fa5477da74acf239f07604e` {{(pid=71938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 24 16:48:12.343784 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2115e5f1-df8b-4882-84bd-a04c5df2c30c admin admin] RBAC: Authorizing `identity:create_grant(project_id=5a5f651da88c4759abbc0a4ed4870465, user_id=5c5e1f31cc864503a91b55a050874198, role_id=912ab5f10fa5477da74acf239f07604e)` {{(pid=71938) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:442}} Nov 24 16:48:12.344033 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d8a1c36-7b56-400d-b48b-947c169b666d admin admin] RBAC: Authorization granted {{(pid=71939) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 24 16:48:12.365182 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: [pid: 71939|app: 0|req: 904/1806] 10.222.0.53 () {58 vars in 1112 bytes} [Wed Nov 24 16:48:12 2021] GET /identity/v3/roles => generated 1420 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 24 16:48:12.366309 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d8a1c36-7b56-400d-b48b-947c169b666d admin admin] Authenticating user token {{(pid=71939) process_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 24 16:48:12.396095 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d8a1c36-7b56-400d-b48b-947c169b666d admin admin] Validating token access rules against request {{(pid=71939) validate_allowed_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 24 16:48:12.410992 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a61a0be2-d7d4-49ea-a597-acfee0f374b8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f2ba2e8375b4e8c8792ee1e22b60427', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '00a5583c7b7443e98e7a1d31a0b638dc', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=71939) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 24 16:48:12.412392 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a61a0be2-d7d4-49ea-a597-acfee0f374b8 admin admin] REQUEST_METHOD: `PUT` {{(pid=71939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 24 16:48:12.412819 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a61a0be2-d7d4-49ea-a597-acfee0f374b8 admin admin] SCRIPT_NAME: `/identity` {{(pid=71939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 24 16:48:12.413367 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a61a0be2-d7d4-49ea-a597-acfee0f374b8 admin admin] PATH_INFO: `/v3/projects/4c34c7ac33d54fc28f39edf828f2f0fc/users/0ea826d0ce944b51891b4e6937ca27de/roles/5611724e350b41e19921b5961a342582` {{(pid=71939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 24 16:48:12.421838 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a61a0be2-d7d4-49ea-a597-acfee0f374b8 admin admin] RBAC: Authorizing `identity:create_grant(project_id=4c34c7ac33d54fc28f39edf828f2f0fc, user_id=0ea826d0ce944b51891b4e6937ca27de, role_id=5611724e350b41e19921b5961a342582)` {{(pid=71939) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:442}} Nov 24 16:48:12.435372 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2115e5f1-df8b-4882-84bd-a04c5df2c30c admin admin] RBAC: Authorization granted {{(pid=71938) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 24 16:48:12.479261 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: [pid: 71938|app: 0|req: 903/1807] 10.222.0.53 () {60 vars in 1473 bytes} [Wed Nov 24 16:48:12 2021] PUT /identity/v3/projects/5a5f651da88c4759abbc0a4ed4870465/users/5c5e1f31cc864503a91b55a050874198/roles/912ab5f10fa5477da74acf239f07604e => generated 0 bytes in 300 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 24 16:48:12.480896 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dfa8c44-8d2f-43e3-b569-4f60f32277a3 None None] REQUEST_METHOD: `POST` {{(pid=71938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 24 16:48:12.481250 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dfa8c44-8d2f-43e3-b569-4f60f32277a3 None None] SCRIPT_NAME: `/identity` {{(pid=71938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 24 16:48:12.482056 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dfa8c44-8d2f-43e3-b569-4f60f32277a3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=71938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 24 16:48:12.509650 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a61a0be2-d7d4-49ea-a597-acfee0f374b8 admin admin] RBAC: Authorization granted {{(pid=71939) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 24 16:48:12.529312 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.auth.core [None req-0dfa8c44-8d2f-43e3-b569-4f60f32277a3 None None] MFA Rules not processed for user `03d1d0f348814a6c972dbb75c3b32797`. Rule list: `[]` (Enabled: `True`). {{(pid=71938) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:442}} Nov 24 16:48:12.530605 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.fernet_utils [None req-0dfa8c44-8d2f-43e3-b569-4f60f32277a3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=71938) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:289}} Nov 24 16:48:12.536771 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: [pid: 71939|app: 0|req: 905/1808] 10.222.0.53 () {60 vars in 1473 bytes} [Wed Nov 24 16:48:12 2021] PUT /identity/v3/projects/4c34c7ac33d54fc28f39edf828f2f0fc/users/0ea826d0ce944b51891b4e6937ca27de/roles/5611724e350b41e19921b5961a342582 => generated 0 bytes in 171 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 24 16:48:12.537767 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a61a0be2-d7d4-49ea-a597-acfee0f374b8 admin admin] Authenticating user token {{(pid=71939) process_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 24 16:48:12.668667 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: [pid: 71938|app: 0|req: 904/1809] 10.222.0.53 () {58 vars in 948 bytes} [Wed Nov 24 16:48:12 2021] POST /identity/v3/auth/tokens => generated 3686 bytes in 186 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 24 16:48:12.668667 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dfa8c44-8d2f-43e3-b569-4f60f32277a3 None None] Authenticating user token {{(pid=71938) process_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 24 16:48:12.723355 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a61a0be2-d7d4-49ea-a597-acfee0f374b8 admin admin] Validating token access rules against request {{(pid=71939) validate_allowed_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 24 16:48:12.738777 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b157400b-fce1-484a-820a-e64881ad3abf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f2ba2e8375b4e8c8792ee1e22b60427', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '00a5583c7b7443e98e7a1d31a0b638dc', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=71939) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 24 16:48:12.740187 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b157400b-fce1-484a-820a-e64881ad3abf admin admin] REQUEST_METHOD: `PUT` {{(pid=71939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 24 16:48:12.740947 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b157400b-fce1-484a-820a-e64881ad3abf admin admin] SCRIPT_NAME: `/identity` {{(pid=71939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 24 16:48:12.741636 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b157400b-fce1-484a-820a-e64881ad3abf admin admin] PATH_INFO: `/v3/projects/7579cc0603984b5dabecafd4aec09470/users/8ef6c687f466463aae55da55f35c952d/roles/5611724e350b41e19921b5961a342582` {{(pid=71939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 24 16:48:12.745836 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b157400b-fce1-484a-820a-e64881ad3abf admin admin] RBAC: Authorizing `identity:create_grant(project_id=7579cc0603984b5dabecafd4aec09470, user_id=8ef6c687f466463aae55da55f35c952d, role_id=5611724e350b41e19921b5961a342582)` {{(pid=71939) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:442}} Nov 24 16:48:12.781676 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b157400b-fce1-484a-820a-e64881ad3abf admin admin] RBAC: Authorization granted {{(pid=71939) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 24 16:48:12.802569 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: [pid: 71939|app: 0|req: 906/1810] 10.222.0.53 () {60 vars in 1473 bytes} [Wed Nov 24 16:48:12 2021] PUT /identity/v3/projects/7579cc0603984b5dabecafd4aec09470/users/8ef6c687f466463aae55da55f35c952d/roles/5611724e350b41e19921b5961a342582 => generated 0 bytes in 265 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 24 16:48:12.809805 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8213cdd5-9fcf-4ce8-8c56-4c6804954eb3 None None] REQUEST_METHOD: `POST` {{(pid=71939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 24 16:48:12.812250 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8213cdd5-9fcf-4ce8-8c56-4c6804954eb3 None None] SCRIPT_NAME: `/identity` {{(pid=71939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 24 16:48:12.812842 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8213cdd5-9fcf-4ce8-8c56-4c6804954eb3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=71939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 24 16:48:12.850900 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dfa8c44-8d2f-43e3-b569-4f60f32277a3 None None] Validating token access rules against request {{(pid=71938) validate_allowed_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 24 16:48:12.909960 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.auth.core [None req-8213cdd5-9fcf-4ce8-8c56-4c6804954eb3 None None] MFA Rules not processed for user `5c5e1f31cc864503a91b55a050874198`. Rule list: `[]` (Enabled: `True`). {{(pid=71939) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:442}} Nov 24 16:48:12.911280 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.fernet_utils [None req-8213cdd5-9fcf-4ce8-8c56-4c6804954eb3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=71939) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:289}} Nov 24 16:48:12.931749 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4340dcfd-809e-440c-b68e-796ed4f838a9 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a12374a3093a401a97c343ff0854184d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3b3940d4ae1c4177ae29c02377bb4b0b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=71938) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 24 16:48:12.932879 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4340dcfd-809e-440c-b68e-796ed4f838a9 service cinder] REQUEST_METHOD: `GET` {{(pid=71938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 24 16:48:12.933658 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4340dcfd-809e-440c-b68e-796ed4f838a9 service cinder] SCRIPT_NAME: `/identity` {{(pid=71938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 24 16:48:12.934272 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4340dcfd-809e-440c-b68e-796ed4f838a9 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=71938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 24 16:48:13.047814 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4340dcfd-809e-440c-b68e-796ed4f838a9 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=71938) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:442}} Nov 24 16:48:13.088887 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: [pid: 71939|app: 0|req: 907/1811] 10.222.0.53 () {58 vars in 948 bytes} [Wed Nov 24 16:48:12 2021] POST /identity/v3/auth/tokens => generated 3751 bytes in 280 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 24 16:48:13.089761 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8213cdd5-9fcf-4ce8-8c56-4c6804954eb3 None None] Authenticating user token {{(pid=71939) process_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 24 16:48:13.101164 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4340dcfd-809e-440c-b68e-796ed4f838a9 service cinder] RBAC: Authorization granted {{(pid=71938) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 24 16:48:13.120879 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: [pid: 71938|app: 0|req: 905/1812] 10.222.0.53 () {60 vars in 1356 bytes} [Wed Nov 24 16:48:12 2021] GET /identity/v3/auth/tokens => generated 3802 bytes in 454 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 24 16:48:13.122598 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec770c77-9ec6-468f-bc93-63fd5c6e05d7 None None] REQUEST_METHOD: `POST` {{(pid=71938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 24 16:48:13.123146 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec770c77-9ec6-468f-bc93-63fd5c6e05d7 None None] SCRIPT_NAME: `/identity` {{(pid=71938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 24 16:48:13.123489 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec770c77-9ec6-468f-bc93-63fd5c6e05d7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=71938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 24 16:48:13.183021 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.auth.core [None req-ec770c77-9ec6-468f-bc93-63fd5c6e05d7 None None] MFA Rules not processed for user `03d1d0f348814a6c972dbb75c3b32797`. Rule list: `[]` (Enabled: `True`). {{(pid=71938) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:442}} Nov 24 16:48:13.187315 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.fernet_utils [None req-ec770c77-9ec6-468f-bc93-63fd5c6e05d7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=71938) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:289}} Nov 24 16:48:13.208387 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8213cdd5-9fcf-4ce8-8c56-4c6804954eb3 None None] Validating token access rules against request {{(pid=71939) validate_allowed_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 24 16:48:13.222716 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-758bfc72-9b9a-4331-8717-e63401749036 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f2ba2e8375b4e8c8792ee1e22b60427', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '00a5583c7b7443e98e7a1d31a0b638dc', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=71939) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 24 16:48:13.223493 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-758bfc72-9b9a-4331-8717-e63401749036 admin admin] REQUEST_METHOD: `GET` {{(pid=71939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 24 16:48:13.223736 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-758bfc72-9b9a-4331-8717-e63401749036 admin admin] SCRIPT_NAME: `/identity` {{(pid=71939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 24 16:48:13.224329 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-758bfc72-9b9a-4331-8717-e63401749036 admin admin] PATH_INFO: `/v3/roles` {{(pid=71939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 24 16:48:13.226054 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-758bfc72-9b9a-4331-8717-e63401749036 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=71939) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:442}} Nov 24 16:48:13.284550 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-758bfc72-9b9a-4331-8717-e63401749036 admin admin] RBAC: Authorization granted {{(pid=71939) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 24 16:48:13.311375 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: [pid: 71939|app: 0|req: 908/1813] 10.222.0.53 () {58 vars in 1112 bytes} [Wed Nov 24 16:48:13 2021] GET /identity/v3/roles => generated 1420 bytes in 222 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 24 16:48:13.315619 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-758bfc72-9b9a-4331-8717-e63401749036 admin admin] Authenticating user token {{(pid=71939) process_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 24 16:48:13.337388 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-758bfc72-9b9a-4331-8717-e63401749036 admin admin] Validating token access rules against request {{(pid=71939) validate_allowed_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 24 16:48:13.347310 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afbb1f2c-b5bd-4afd-969d-9053b5135f35 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f2ba2e8375b4e8c8792ee1e22b60427', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '00a5583c7b7443e98e7a1d31a0b638dc', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=71939) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 24 16:48:13.348000 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afbb1f2c-b5bd-4afd-969d-9053b5135f35 admin admin] REQUEST_METHOD: `GET` {{(pid=71939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 24 16:48:13.349456 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afbb1f2c-b5bd-4afd-969d-9053b5135f35 admin admin] SCRIPT_NAME: `/identity` {{(pid=71939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 24 16:48:13.349793 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afbb1f2c-b5bd-4afd-969d-9053b5135f35 admin admin] PATH_INFO: `/v3/roles` {{(pid=71939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 24 16:48:13.350629 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afbb1f2c-b5bd-4afd-969d-9053b5135f35 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=71939) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:442}} Nov 24 16:48:13.360047 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: [pid: 71938|app: 0|req: 906/1814] 10.222.0.53 () {58 vars in 948 bytes} [Wed Nov 24 16:48:13 2021] POST /identity/v3/auth/tokens => generated 3686 bytes in 239 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 24 16:48:13.360047 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec770c77-9ec6-468f-bc93-63fd5c6e05d7 None None] Authenticating user token {{(pid=71938) process_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 24 16:48:13.386824 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec770c77-9ec6-468f-bc93-63fd5c6e05d7 None None] Validating token access rules against request {{(pid=71938) validate_allowed_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 24 16:48:13.391328 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3571f017-f56a-4bbc-aa9b-6bc001766d85 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a12374a3093a401a97c343ff0854184d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3b3940d4ae1c4177ae29c02377bb4b0b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=71938) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 24 16:48:13.391997 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3571f017-f56a-4bbc-aa9b-6bc001766d85 service cinder] REQUEST_METHOD: `GET` {{(pid=71938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 24 16:48:13.392335 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3571f017-f56a-4bbc-aa9b-6bc001766d85 service cinder] SCRIPT_NAME: `/identity` {{(pid=71938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 24 16:48:13.392666 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3571f017-f56a-4bbc-aa9b-6bc001766d85 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=71938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 24 16:48:13.412344 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afbb1f2c-b5bd-4afd-969d-9053b5135f35 admin admin] RBAC: Authorization granted {{(pid=71939) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 24 16:48:13.449661 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: [pid: 71939|app: 0|req: 909/1815] 10.222.0.53 () {58 vars in 1112 bytes} [Wed Nov 24 16:48:13 2021] GET /identity/v3/roles => generated 1420 bytes in 131 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 24 16:48:13.450378 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afbb1f2c-b5bd-4afd-969d-9053b5135f35 admin admin] Authenticating user token {{(pid=71939) process_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 24 16:48:13.509918 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afbb1f2c-b5bd-4afd-969d-9053b5135f35 admin admin] Validating token access rules against request {{(pid=71939) validate_allowed_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 24 16:48:13.521868 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82f03a40-3d5d-476b-8daa-699080c07a5f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f2ba2e8375b4e8c8792ee1e22b60427', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '00a5583c7b7443e98e7a1d31a0b638dc', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=71939) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 24 16:48:13.522968 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82f03a40-3d5d-476b-8daa-699080c07a5f admin admin] REQUEST_METHOD: `PUT` {{(pid=71939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 24 16:48:13.523411 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82f03a40-3d5d-476b-8daa-699080c07a5f admin admin] SCRIPT_NAME: `/identity` {{(pid=71939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 24 16:48:13.524489 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82f03a40-3d5d-476b-8daa-699080c07a5f admin admin] PATH_INFO: `/v3/projects/4c34c7ac33d54fc28f39edf828f2f0fc/users/0ea826d0ce944b51891b4e6937ca27de/roles/912ab5f10fa5477da74acf239f07604e` {{(pid=71939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 24 16:48:13.528908 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82f03a40-3d5d-476b-8daa-699080c07a5f admin admin] RBAC: Authorizing `identity:create_grant(project_id=4c34c7ac33d54fc28f39edf828f2f0fc, user_id=0ea826d0ce944b51891b4e6937ca27de, role_id=912ab5f10fa5477da74acf239f07604e)` {{(pid=71939) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:442}} Nov 24 16:48:13.562675 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3571f017-f56a-4bbc-aa9b-6bc001766d85 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=71938) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:442}} Nov 24 16:48:13.599315 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82f03a40-3d5d-476b-8daa-699080c07a5f admin admin] RBAC: Authorization granted {{(pid=71939) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 24 16:48:13.615569 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3571f017-f56a-4bbc-aa9b-6bc001766d85 service cinder] RBAC: Authorization granted {{(pid=71938) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 24 16:48:13.618611 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: [pid: 71939|app: 0|req: 910/1816] 10.222.0.53 () {60 vars in 1473 bytes} [Wed Nov 24 16:48:13 2021] PUT /identity/v3/projects/4c34c7ac33d54fc28f39edf828f2f0fc/users/0ea826d0ce944b51891b4e6937ca27de/roles/912ab5f10fa5477da74acf239f07604e => generated 0 bytes in 171 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 24 16:48:13.620105 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca628c5b-2634-4c61-b01e-c3e8222215ff None None] REQUEST_METHOD: `GET` {{(pid=71939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 24 16:48:13.624380 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca628c5b-2634-4c61-b01e-c3e8222215ff None None] SCRIPT_NAME: `/identity` {{(pid=71939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 24 16:48:13.624898 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca628c5b-2634-4c61-b01e-c3e8222215ff None None] PATH_INFO: `/` {{(pid=71939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 24 16:48:13.626917 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: [pid: 71939|app: 0|req: 911/1817] 10.222.0.53 () {54 vars in 943 bytes} [Wed Nov 24 16:48:13 2021] GET /identity => generated 270 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 24 16:48:13.629660 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca628c5b-2634-4c61-b01e-c3e8222215ff None None] Authenticating user token {{(pid=71939) process_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 24 16:48:13.636517 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: [pid: 71938|app: 0|req: 907/1818] 10.222.0.53 () {60 vars in 1356 bytes} [Wed Nov 24 16:48:13 2021] GET /identity/v3/auth/tokens => generated 3682 bytes in 276 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 24 16:48:13.655117 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6be2f11-58a9-4197-8fc3-f916e80c7611 None None] REQUEST_METHOD: `POST` {{(pid=71938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 24 16:48:13.660005 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6be2f11-58a9-4197-8fc3-f916e80c7611 None None] SCRIPT_NAME: `/identity` {{(pid=71938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 24 16:48:13.662713 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6be2f11-58a9-4197-8fc3-f916e80c7611 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=71938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 24 16:48:13.767122 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.auth.core [None req-a6be2f11-58a9-4197-8fc3-f916e80c7611 None None] MFA Rules not processed for user `0ea826d0ce944b51891b4e6937ca27de`. Rule list: `[]` (Enabled: `True`). {{(pid=71938) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:442}} Nov 24 16:48:13.770475 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.fernet_utils [None req-a6be2f11-58a9-4197-8fc3-f916e80c7611 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=71938) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:289}} Nov 24 16:48:13.809352 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca628c5b-2634-4c61-b01e-c3e8222215ff None None] Validating token access rules against request {{(pid=71939) validate_allowed_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 24 16:48:13.824037 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d419051-5185-4cf2-91f8-c0531ee5dd69 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f2ba2e8375b4e8c8792ee1e22b60427', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '00a5583c7b7443e98e7a1d31a0b638dc', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=71939) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 24 16:48:13.825479 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d419051-5185-4cf2-91f8-c0531ee5dd69 admin admin] REQUEST_METHOD: `PUT` {{(pid=71939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 24 16:48:13.826087 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d419051-5185-4cf2-91f8-c0531ee5dd69 admin admin] SCRIPT_NAME: `/identity` {{(pid=71939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 24 16:48:13.826651 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d419051-5185-4cf2-91f8-c0531ee5dd69 admin admin] PATH_INFO: `/v3/projects/7579cc0603984b5dabecafd4aec09470/users/8ef6c687f466463aae55da55f35c952d/roles/912ab5f10fa5477da74acf239f07604e` {{(pid=71939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 24 16:48:13.833223 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d419051-5185-4cf2-91f8-c0531ee5dd69 admin admin] RBAC: Authorizing `identity:create_grant(project_id=7579cc0603984b5dabecafd4aec09470, user_id=8ef6c687f466463aae55da55f35c952d, role_id=912ab5f10fa5477da74acf239f07604e)` {{(pid=71939) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:442}} Nov 24 16:48:13.884696 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d419051-5185-4cf2-91f8-c0531ee5dd69 admin admin] RBAC: Authorization granted {{(pid=71939) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 24 16:48:13.895876 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: [pid: 71938|app: 0|req: 908/1819] 10.222.0.53 () {58 vars in 948 bytes} [Wed Nov 24 16:48:13 2021] POST /identity/v3/auth/tokens => generated 3737 bytes in 245 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 24 16:48:13.897333 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4710575-8ca5-41ce-b7c2-6b6355f06360 None None] REQUEST_METHOD: `POST` {{(pid=71938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 24 16:48:13.897682 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4710575-8ca5-41ce-b7c2-6b6355f06360 None None] SCRIPT_NAME: `/identity` {{(pid=71938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 24 16:48:13.898017 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4710575-8ca5-41ce-b7c2-6b6355f06360 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=71938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 24 16:48:13.926675 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.auth.core [None req-a4710575-8ca5-41ce-b7c2-6b6355f06360 None None] MFA Rules not processed for user `3e196802d4d5432482b6d2eabc25f74e`. Rule list: `[]` (Enabled: `True`). {{(pid=71938) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:442}} Nov 24 16:48:13.927983 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.fernet_utils [None req-a4710575-8ca5-41ce-b7c2-6b6355f06360 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=71938) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:289}} Nov 24 16:48:13.935129 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: [pid: 71939|app: 0|req: 912/1820] 10.222.0.53 () {60 vars in 1473 bytes} [Wed Nov 24 16:48:13 2021] PUT /identity/v3/projects/7579cc0603984b5dabecafd4aec09470/users/8ef6c687f466463aae55da55f35c952d/roles/912ab5f10fa5477da74acf239f07604e => generated 0 bytes in 307 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 24 16:48:13.950643 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0257673-0dce-47a7-8a5d-ce9912f3baea None None] REQUEST_METHOD: `POST` {{(pid=71939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 24 16:48:13.950997 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0257673-0dce-47a7-8a5d-ce9912f3baea None None] SCRIPT_NAME: `/identity` {{(pid=71939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 24 16:48:13.951338 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0257673-0dce-47a7-8a5d-ce9912f3baea None None] PATH_INFO: `/v3/auth/tokens` {{(pid=71939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 24 16:48:14.001129 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.auth.core [None req-f0257673-0dce-47a7-8a5d-ce9912f3baea None None] MFA Rules not processed for user `8ef6c687f466463aae55da55f35c952d`. Rule list: `[]` (Enabled: `True`). {{(pid=71939) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:442}} Nov 24 16:48:14.002775 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.fernet_utils [None req-f0257673-0dce-47a7-8a5d-ce9912f3baea None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=71939) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:289}} Nov 24 16:48:14.126449 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: [pid: 71938|app: 0|req: 909/1821] 10.222.0.53 () {58 vars in 1041 bytes} [Wed Nov 24 16:48:13 2021] POST /identity/v3/auth/tokens => generated 3802 bytes in 230 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 24 16:48:14.138647 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4710575-8ca5-41ce-b7c2-6b6355f06360 None None] Authenticating user token {{(pid=71938) process_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 24 16:48:14.156665 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4710575-8ca5-41ce-b7c2-6b6355f06360 None None] Validating token access rules against request {{(pid=71938) validate_allowed_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 24 16:48:14.167522 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2656c5b8-4c35-4e1b-9cdf-bea9c2122c80 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e196802d4d5432482b6d2eabc25f74e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3b3940d4ae1c4177ae29c02377bb4b0b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'service', 'ResellerAdmin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=71938) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 24 16:48:14.168573 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2656c5b8-4c35-4e1b-9cdf-bea9c2122c80 service nova] REQUEST_METHOD: `GET` {{(pid=71938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 24 16:48:14.169116 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2656c5b8-4c35-4e1b-9cdf-bea9c2122c80 service nova] SCRIPT_NAME: `/identity` {{(pid=71938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 24 16:48:14.169650 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2656c5b8-4c35-4e1b-9cdf-bea9c2122c80 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=71938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 24 16:48:14.198844 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: [pid: 71939|app: 0|req: 913/1822] 10.222.0.53 () {58 vars in 948 bytes} [Wed Nov 24 16:48:13 2021] POST /identity/v3/auth/tokens => generated 3731 bytes in 249 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 24 16:48:14.332557 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0257673-0dce-47a7-8a5d-ce9912f3baea None None] Authenticating user token {{(pid=71939) process_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 24 16:48:14.384868 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2656c5b8-4c35-4e1b-9cdf-bea9c2122c80 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=71938) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:442}} Nov 24 16:48:14.430060 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2656c5b8-4c35-4e1b-9cdf-bea9c2122c80 service nova] RBAC: Authorization granted {{(pid=71938) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 24 16:48:14.468566 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: [pid: 71938|app: 0|req: 910/1823] 10.222.0.53 () {60 vars in 1356 bytes} [Wed Nov 24 16:48:14 2021] GET /identity/v3/auth/tokens => generated 3686 bytes in 330 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 24 16:48:14.505180 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0257673-0dce-47a7-8a5d-ce9912f3baea None None] Validating token access rules against request {{(pid=71939) validate_allowed_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 24 16:48:14.516887 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67fdfc02-08a1-47d8-88f0-f43810831b1c service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a12374a3093a401a97c343ff0854184d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3b3940d4ae1c4177ae29c02377bb4b0b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=71939) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 24 16:48:14.517572 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67fdfc02-08a1-47d8-88f0-f43810831b1c service cinder] REQUEST_METHOD: `GET` {{(pid=71939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 24 16:48:14.518111 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67fdfc02-08a1-47d8-88f0-f43810831b1c service cinder] SCRIPT_NAME: `/identity` {{(pid=71939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 24 16:48:14.518600 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67fdfc02-08a1-47d8-88f0-f43810831b1c service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=71939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 24 16:48:14.702924 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67fdfc02-08a1-47d8-88f0-f43810831b1c service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=71939) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:442}} Nov 24 16:48:14.770232 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67fdfc02-08a1-47d8-88f0-f43810831b1c service cinder] RBAC: Authorization granted {{(pid=71939) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 24 16:48:14.806255 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2656c5b8-4c35-4e1b-9cdf-bea9c2122c80 service nova] Authenticating user token {{(pid=71938) process_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 24 16:48:14.807173 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: [pid: 71939|app: 0|req: 914/1824] 10.222.0.53 () {60 vars in 1356 bytes} [Wed Nov 24 16:48:14 2021] GET /identity/v3/auth/tokens => generated 3737 bytes in 475 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 24 16:48:14.833493 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2656c5b8-4c35-4e1b-9cdf-bea9c2122c80 service nova] Validating token access rules against request {{(pid=71938) validate_allowed_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 24 16:48:14.851141 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-620198b6-1cf9-463f-8b3c-3252027f4248 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a12374a3093a401a97c343ff0854184d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3b3940d4ae1c4177ae29c02377bb4b0b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=71938) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 24 16:48:14.852448 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-620198b6-1cf9-463f-8b3c-3252027f4248 service cinder] REQUEST_METHOD: `GET` {{(pid=71938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 24 16:48:14.852798 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-620198b6-1cf9-463f-8b3c-3252027f4248 service cinder] SCRIPT_NAME: `/identity` {{(pid=71938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 24 16:48:14.853132 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-620198b6-1cf9-463f-8b3c-3252027f4248 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=71938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 24 16:48:14.886097 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-620198b6-1cf9-463f-8b3c-3252027f4248 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=71938) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:442}} Nov 24 16:48:14.958050 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-620198b6-1cf9-463f-8b3c-3252027f4248 service cinder] RBAC: Authorization granted {{(pid=71938) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 24 16:48:14.974149 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ab2d060-abe3-4630-9cf0-0c8ee661edbc None None] REQUEST_METHOD: `GET` {{(pid=71939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 24 16:48:14.975358 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ab2d060-abe3-4630-9cf0-0c8ee661edbc None None] SCRIPT_NAME: `/identity` {{(pid=71939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 24 16:48:14.975951 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ab2d060-abe3-4630-9cf0-0c8ee661edbc None None] PATH_INFO: `/` {{(pid=71939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 24 16:48:14.978317 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: [pid: 71939|app: 0|req: 915/1825] 10.222.0.53 () {54 vars in 945 bytes} [Wed Nov 24 16:48:14 2021] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Nov 24 16:48:14.981798 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: [pid: 71938|app: 0|req: 911/1826] 10.222.0.53 () {60 vars in 1356 bytes} [Wed Nov 24 16:48:14 2021] GET /identity/v3/auth/tokens => generated 3731 bytes in 176 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 24 16:48:14.985944 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4858cb18-4b6a-4e43-b0e7-bc9434868f25 None None] REQUEST_METHOD: `POST` {{(pid=71939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 24 16:48:14.986742 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4858cb18-4b6a-4e43-b0e7-bc9434868f25 None None] SCRIPT_NAME: `/identity` {{(pid=71939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 24 16:48:14.987552 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4858cb18-4b6a-4e43-b0e7-bc9434868f25 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=71939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 24 16:48:15.056571 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.auth.core [None req-4858cb18-4b6a-4e43-b0e7-bc9434868f25 None None] MFA Rules not processed for user `af9e91f8d56c491d99fab4346754ce2e`. Rule list: `[]` (Enabled: `True`). {{(pid=71939) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:442}} Nov 24 16:48:15.057830 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.fernet_utils [None req-4858cb18-4b6a-4e43-b0e7-bc9434868f25 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=71939) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:289}} Nov 24 16:48:15.199863 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: [pid: 71939|app: 0|req: 916/1827] 10.222.0.53 () {58 vars in 1043 bytes} [Wed Nov 24 16:48:14 2021] POST /identity/v3/auth/tokens => generated 3550 bytes in 215 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 24 16:48:15.209669 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-620198b6-1cf9-463f-8b3c-3252027f4248 service cinder] Authenticating user token {{(pid=71938) process_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 24 16:48:15.225137 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-620198b6-1cf9-463f-8b3c-3252027f4248 service cinder] Validating token access rules against request {{(pid=71938) validate_allowed_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 24 16:48:15.237493 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39934d1d-0863-4cd8-ae40-8c9b664c33af service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'af9e91f8d56c491d99fab4346754ce2e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3b3940d4ae1c4177ae29c02377bb4b0b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=71938) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 24 16:48:15.239824 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39934d1d-0863-4cd8-ae40-8c9b664c33af service glance] REQUEST_METHOD: `GET` {{(pid=71938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 24 16:48:15.240400 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39934d1d-0863-4cd8-ae40-8c9b664c33af service glance] SCRIPT_NAME: `/identity` {{(pid=71938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 24 16:48:15.241276 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39934d1d-0863-4cd8-ae40-8c9b664c33af service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=71938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 24 16:48:15.274262 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39934d1d-0863-4cd8-ae40-8c9b664c33af service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=71938) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:442}} Nov 24 16:48:15.339934 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39934d1d-0863-4cd8-ae40-8c9b664c33af service glance] RBAC: Authorization granted {{(pid=71938) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 24 16:48:15.368927 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4858cb18-4b6a-4e43-b0e7-bc9434868f25 None None] Authenticating user token {{(pid=71939) process_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 24 16:48:15.380315 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: [pid: 71938|app: 0|req: 912/1828] 10.222.0.53 () {60 vars in 1356 bytes} [Wed Nov 24 16:48:15 2021] GET /identity/v3/auth/tokens => generated 3802 bytes in 171 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 24 16:48:15.381934 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4858cb18-4b6a-4e43-b0e7-bc9434868f25 None None] Validating token access rules against request {{(pid=71939) validate_allowed_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 24 16:48:15.391278 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29f25fa3-5481-4c7f-a4d5-357663afcd2d service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a12374a3093a401a97c343ff0854184d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3b3940d4ae1c4177ae29c02377bb4b0b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=71939) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 24 16:48:15.391955 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29f25fa3-5481-4c7f-a4d5-357663afcd2d service cinder] REQUEST_METHOD: `GET` {{(pid=71939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 24 16:48:15.392523 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29f25fa3-5481-4c7f-a4d5-357663afcd2d service cinder] SCRIPT_NAME: `/identity` {{(pid=71939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 24 16:48:15.392865 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29f25fa3-5481-4c7f-a4d5-357663afcd2d service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=71939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 24 16:48:15.550895 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29f25fa3-5481-4c7f-a4d5-357663afcd2d service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=71939) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:442}} Nov 24 16:48:15.580939 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29f25fa3-5481-4c7f-a4d5-357663afcd2d service cinder] RBAC: Authorization granted {{(pid=71939) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 24 16:48:15.594581 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: [pid: 71939|app: 0|req: 917/1829] 10.222.0.53 () {60 vars in 1356 bytes} [Wed Nov 24 16:48:15 2021] GET /identity/v3/auth/tokens => generated 3664 bytes in 227 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Nov 24 16:48:15.792913 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39934d1d-0863-4cd8-ae40-8c9b664c33af service glance] Authenticating user token {{(pid=71938) process_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 24 16:48:15.977946 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39934d1d-0863-4cd8-ae40-8c9b664c33af service glance] Validating token access rules against request {{(pid=71938) validate_allowed_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 24 16:48:15.990823 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4df346c-2db6-4753-94ae-3372f56714f4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f2ba2e8375b4e8c8792ee1e22b60427', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '00a5583c7b7443e98e7a1d31a0b638dc', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=71938) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 24 16:48:15.993034 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4df346c-2db6-4753-94ae-3372f56714f4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=71938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 24 16:48:15.995068 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4df346c-2db6-4753-94ae-3372f56714f4 admin admin] SCRIPT_NAME: `/identity` {{(pid=71938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 24 16:48:15.996164 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4df346c-2db6-4753-94ae-3372f56714f4 admin admin] PATH_INFO: `/v3/users/45fe98404f0d4176803527dd2b5f8a46` {{(pid=71938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 24 16:48:15.999399 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4df346c-2db6-4753-94ae-3372f56714f4 admin admin] RBAC: Authorizing `identity:delete_user(user_id=45fe98404f0d4176803527dd2b5f8a46)` {{(pid=71938) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:442}} Nov 24 16:48:16.077861 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: WARNING py.warnings [None req-d4df346c-2db6-4753-94ae-3372f56714f4 admin admin] /usr/local/lib/python3.6/dist-packages/oslo_policy/policy.py:1018: UserWarning: Policy identity:delete_user failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Nov 24 16:48:16.077861 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: warnings.warn(msg) Nov 24 16:48:16.077861 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: Nov 24 16:48:16.080418 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4df346c-2db6-4753-94ae-3372f56714f4 admin admin] RBAC: Authorization granted {{(pid=71938) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 24 16:48:16.173143 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.notifications [None req-d4df346c-2db6-4753-94ae-3372f56714f4 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '45fe98404f0d4176803527dd2b5f8a46'} {{(pid=71938) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:357}} Nov 24 16:48:16.181127 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-345d6e50-43db-4454-b207-f4ee4a68409e None None] REQUEST_METHOD: `GET` {{(pid=71939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 24 16:48:16.181564 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-345d6e50-43db-4454-b207-f4ee4a68409e None None] SCRIPT_NAME: `/identity` {{(pid=71939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 24 16:48:16.182280 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-345d6e50-43db-4454-b207-f4ee4a68409e None None] PATH_INFO: `/` {{(pid=71939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 24 16:48:16.184945 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: [pid: 71939|app: 0|req: 918/1830] 10.222.0.53 () {54 vars in 901 bytes} [Wed Nov 24 16:48:16 2021] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 24 16:48:16.197224 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1585780-0fdb-45c3-9138-77905b6c5d6b None None] REQUEST_METHOD: `POST` {{(pid=71939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 24 16:48:16.197670 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1585780-0fdb-45c3-9138-77905b6c5d6b None None] SCRIPT_NAME: `/identity` {{(pid=71939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 24 16:48:16.198144 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1585780-0fdb-45c3-9138-77905b6c5d6b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=71939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 24 16:48:16.210595 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.notifications [None req-d4df346c-2db6-4753-94ae-3372f56714f4 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '45fe98404f0d4176803527dd2b5f8a46'} {{(pid=71938) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:357}} Nov 24 16:48:16.215681 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.notifications [None req-d4df346c-2db6-4753-94ae-3372f56714f4 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '45fe98404f0d4176803527dd2b5f8a46'} {{(pid=71938) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:357}} Nov 24 16:48:16.253040 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.notifications [None req-d4df346c-2db6-4753-94ae-3372f56714f4 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '45fe98404f0d4176803527dd2b5f8a46'} {{(pid=71938) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:357}} Nov 24 16:48:16.263172 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.auth.core [None req-b1585780-0fdb-45c3-9138-77905b6c5d6b None None] MFA Rules not processed for user `c90f21b9cdcb413282461fa83cb6b7a5`. Rule list: `[]` (Enabled: `True`). {{(pid=71939) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:442}} Nov 24 16:48:16.268396 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.fernet_utils [None req-b1585780-0fdb-45c3-9138-77905b6c5d6b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=71939) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:289}} Nov 24 16:48:16.276411 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.notifications [None req-d4df346c-2db6-4753-94ae-3372f56714f4 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '45fe98404f0d4176803527dd2b5f8a46'} {{(pid=71938) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:357}} Nov 24 16:48:16.291681 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: [pid: 71938|app: 0|req: 913/1831] 10.222.0.53 () {58 vars in 1214 bytes} [Wed Nov 24 16:48:15 2021] DELETE /identity/v3/users/45fe98404f0d4176803527dd2b5f8a46 => generated 0 bytes in 500 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 24 16:48:16.297600 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecaf3e8b-9b74-4b9a-87ca-0b482536b456 None None] REQUEST_METHOD: `POST` {{(pid=71938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 24 16:48:16.297959 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecaf3e8b-9b74-4b9a-87ca-0b482536b456 None None] SCRIPT_NAME: `/identity` {{(pid=71938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 24 16:48:16.298328 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecaf3e8b-9b74-4b9a-87ca-0b482536b456 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=71938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 24 16:48:16.380045 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.auth.core [None req-ecaf3e8b-9b74-4b9a-87ca-0b482536b456 None None] MFA Rules not processed for user `0f2ba2e8375b4e8c8792ee1e22b60427`. Rule list: `[]` (Enabled: `True`). {{(pid=71938) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:442}} Nov 24 16:48:16.390175 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.fernet_utils [None req-ecaf3e8b-9b74-4b9a-87ca-0b482536b456 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=71938) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:289}} Nov 24 16:48:16.491548 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: [pid: 71939|app: 0|req: 919/1832] 10.222.0.53 () {58 vars in 999 bytes} [Wed Nov 24 16:48:16 2021] POST /identity/v3/auth/tokens => generated 3551 bytes in 296 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Nov 24 16:48:16.510856 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1585780-0fdb-45c3-9138-77905b6c5d6b None None] Authenticating user token {{(pid=71939) process_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 24 16:48:16.512717 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.fernet_utils [None req-b1585780-0fdb-45c3-9138-77905b6c5d6b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=71939) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:289}} Nov 24 16:48:16.527460 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1585780-0fdb-45c3-9138-77905b6c5d6b None None] Validating token access rules against request {{(pid=71939) validate_allowed_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 24 16:48:16.588490 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: [pid: 71938|app: 0|req: 914/1833] 10.222.0.53 () {58 vars in 948 bytes} [Wed Nov 24 16:48:16 2021] POST /identity/v3/auth/tokens => generated 3669 bytes in 292 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 24 16:48:16.660062 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-850908bf-40f8-49bc-bbd2-cf30193aa6d6 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c90f21b9cdcb413282461fa83cb6b7a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3b3940d4ae1c4177ae29c02377bb4b0b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=71939) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 24 16:48:16.660916 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-850908bf-40f8-49bc-bbd2-cf30193aa6d6 service neutron] REQUEST_METHOD: `GET` {{(pid=71939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 24 16:48:16.661196 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-850908bf-40f8-49bc-bbd2-cf30193aa6d6 service neutron] SCRIPT_NAME: `/identity` {{(pid=71939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 24 16:48:16.661638 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-850908bf-40f8-49bc-bbd2-cf30193aa6d6 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=71939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 24 16:48:16.673310 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-850908bf-40f8-49bc-bbd2-cf30193aa6d6 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=71939) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:442}} Nov 24 16:48:16.705566 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecaf3e8b-9b74-4b9a-87ca-0b482536b456 None None] Authenticating user token {{(pid=71938) process_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 24 16:48:16.720789 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecaf3e8b-9b74-4b9a-87ca-0b482536b456 None None] Validating token access rules against request {{(pid=71938) validate_allowed_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 24 16:48:16.721028 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-850908bf-40f8-49bc-bbd2-cf30193aa6d6 service neutron] RBAC: Authorization granted {{(pid=71939) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 24 16:48:16.729135 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84140f77-b1d4-4149-918e-438562ecf36f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c90f21b9cdcb413282461fa83cb6b7a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3b3940d4ae1c4177ae29c02377bb4b0b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=71938) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 24 16:48:16.731066 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84140f77-b1d4-4149-918e-438562ecf36f service neutron] REQUEST_METHOD: `GET` {{(pid=71938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 24 16:48:16.731842 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84140f77-b1d4-4149-918e-438562ecf36f service neutron] SCRIPT_NAME: `/identity` {{(pid=71938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 24 16:48:16.733083 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84140f77-b1d4-4149-918e-438562ecf36f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=71938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 24 16:48:16.747168 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: [pid: 71939|app: 0|req: 920/1834] 10.222.0.53 () {60 vars in 1356 bytes} [Wed Nov 24 16:48:16 2021] GET /identity/v3/auth/tokens => generated 3551 bytes in 237 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 24 16:48:16.763170 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84140f77-b1d4-4149-918e-438562ecf36f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=71938) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:442}} Nov 24 16:48:16.835645 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84140f77-b1d4-4149-918e-438562ecf36f service neutron] RBAC: Authorization granted {{(pid=71938) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 24 16:48:16.862786 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: [pid: 71938|app: 0|req: 915/1835] 10.222.0.53 () {60 vars in 1356 bytes} [Wed Nov 24 16:48:16 2021] GET /identity/v3/auth/tokens => generated 3669 bytes in 158 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 24 16:48:17.778556 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26d5405d-63fa-48b6-a4aa-f876ff81d088 None None] REQUEST_METHOD: `GET` {{(pid=71939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 24 16:48:17.779555 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26d5405d-63fa-48b6-a4aa-f876ff81d088 None None] SCRIPT_NAME: `/identity` {{(pid=71939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 24 16:48:17.780043 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26d5405d-63fa-48b6-a4aa-f876ff81d088 None None] PATH_INFO: `/` {{(pid=71939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 24 16:48:17.782664 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: [pid: 71939|app: 0|req: 921/1836] 10.222.0.53 () {54 vars in 949 bytes} [Wed Nov 24 16:48:17 2021] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 24 16:48:17.801648 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-138618ab-39b7-43f7-9be6-ffd0dc70a71c None None] REQUEST_METHOD: `POST` {{(pid=71938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 24 16:48:17.803919 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-138618ab-39b7-43f7-9be6-ffd0dc70a71c None None] SCRIPT_NAME: `/identity` {{(pid=71938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 24 16:48:17.803919 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-138618ab-39b7-43f7-9be6-ffd0dc70a71c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=71938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 24 16:48:17.855271 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.auth.core [None req-138618ab-39b7-43f7-9be6-ffd0dc70a71c None None] MFA Rules not processed for user `a919320c9e2a48d7ba33453b5929d7ee`. Rule list: `[]` (Enabled: `True`). {{(pid=71938) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:442}} Nov 24 16:48:17.856560 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.fernet_utils [None req-138618ab-39b7-43f7-9be6-ffd0dc70a71c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=71938) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:289}} Nov 24 16:48:18.041284 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26d5405d-63fa-48b6-a4aa-f876ff81d088 None None] Authenticating user token {{(pid=71939) process_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 24 16:48:18.041676 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: [pid: 71938|app: 0|req: 916/1837] 10.222.0.53 () {58 vars in 1047 bytes} [Wed Nov 24 16:48:17 2021] POST /identity/v3/auth/tokens => generated 3738 bytes in 239 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Nov 24 16:48:18.062737 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26d5405d-63fa-48b6-a4aa-f876ff81d088 None None] Validating token access rules against request {{(pid=71939) validate_allowed_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 24 16:48:18.071469 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f8de242-5600-45ac-a613-71cf5a7afe58 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a919320c9e2a48d7ba33453b5929d7ee', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3b3940d4ae1c4177ae29c02377bb4b0b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=71939) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 24 16:48:18.072415 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f8de242-5600-45ac-a613-71cf5a7afe58 service placement] REQUEST_METHOD: `GET` {{(pid=71939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 24 16:48:18.072949 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f8de242-5600-45ac-a613-71cf5a7afe58 service placement] SCRIPT_NAME: `/identity` {{(pid=71939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 24 16:48:18.073440 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f8de242-5600-45ac-a613-71cf5a7afe58 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=71939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 24 16:48:18.075585 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.fernet_utils [None req-7f8de242-5600-45ac-a613-71cf5a7afe58 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=71939) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:289}} Nov 24 16:48:18.099972 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f8de242-5600-45ac-a613-71cf5a7afe58 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=71939) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:442}} Nov 24 16:48:18.134427 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f8de242-5600-45ac-a613-71cf5a7afe58 service placement] RBAC: Authorization granted {{(pid=71939) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 24 16:48:18.155478 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: [pid: 71939|app: 0|req: 922/1838] 10.222.0.53 () {60 vars in 1356 bytes} [Wed Nov 24 16:48:18 2021] GET /identity/v3/auth/tokens => generated 3738 bytes in 115 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 24 16:48:18.490957 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-138618ab-39b7-43f7-9be6-ffd0dc70a71c None None] Authenticating user token {{(pid=71938) process_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 24 16:48:18.492474 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.fernet_utils [None req-138618ab-39b7-43f7-9be6-ffd0dc70a71c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=71938) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:289}} Nov 24 16:48:18.511538 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-138618ab-39b7-43f7-9be6-ffd0dc70a71c None None] Validating token access rules against request {{(pid=71938) validate_allowed_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 24 16:48:18.526929 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8407d3c3-fbb0-4a49-8625-c7e208e569f3 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a919320c9e2a48d7ba33453b5929d7ee', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3b3940d4ae1c4177ae29c02377bb4b0b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=71938) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 24 16:48:18.528115 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8407d3c3-fbb0-4a49-8625-c7e208e569f3 service placement] REQUEST_METHOD: `GET` {{(pid=71938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 24 16:48:18.529197 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8407d3c3-fbb0-4a49-8625-c7e208e569f3 service placement] SCRIPT_NAME: `/identity` {{(pid=71938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 24 16:48:18.530188 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8407d3c3-fbb0-4a49-8625-c7e208e569f3 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=71938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 24 16:48:18.535119 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.fernet_utils [None req-8407d3c3-fbb0-4a49-8625-c7e208e569f3 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=71938) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:289}} Nov 24 16:48:18.577831 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8407d3c3-fbb0-4a49-8625-c7e208e569f3 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=71938) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:442}} Nov 24 16:48:18.647396 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8407d3c3-fbb0-4a49-8625-c7e208e569f3 service placement] RBAC: Authorization granted {{(pid=71938) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 24 16:48:18.659078 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f8de242-5600-45ac-a613-71cf5a7afe58 service placement] Authenticating user token {{(pid=71939) process_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 24 16:48:18.660553 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.fernet_utils [None req-7f8de242-5600-45ac-a613-71cf5a7afe58 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=71939) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:289}} Nov 24 16:48:18.690692 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f8de242-5600-45ac-a613-71cf5a7afe58 service placement] Validating token access rules against request {{(pid=71939) validate_allowed_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 24 16:48:18.695199 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: [pid: 71938|app: 0|req: 917/1839] 10.222.0.53 () {60 vars in 1356 bytes} [Wed Nov 24 16:48:18 2021] GET /identity/v3/auth/tokens => generated 3738 bytes in 205 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 24 16:48:18.727460 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40676d6a-0f25-43b4-bc50-a3027145cca4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f2ba2e8375b4e8c8792ee1e22b60427', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '00a5583c7b7443e98e7a1d31a0b638dc', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=71939) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 24 16:48:18.728378 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40676d6a-0f25-43b4-bc50-a3027145cca4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=71939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 24 16:48:18.728722 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40676d6a-0f25-43b4-bc50-a3027145cca4 admin admin] SCRIPT_NAME: `/identity` {{(pid=71939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 24 16:48:18.729708 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40676d6a-0f25-43b4-bc50-a3027145cca4 admin admin] PATH_INFO: `/v3/projects/bf67d4c04c9c4ff6b866e23cc3c387a6` {{(pid=71939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 24 16:48:18.731599 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40676d6a-0f25-43b4-bc50-a3027145cca4 admin admin] RBAC: Authorizing `identity:delete_project(project_id=bf67d4c04c9c4ff6b866e23cc3c387a6)` {{(pid=71939) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:442}} Nov 24 16:48:18.833470 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: WARNING py.warnings [None req-40676d6a-0f25-43b4-bc50-a3027145cca4 admin admin] /usr/local/lib/python3.6/dist-packages/oslo_policy/policy.py:1018: UserWarning: Policy identity:delete_project failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Nov 24 16:48:18.833470 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: warnings.warn(msg) Nov 24 16:48:18.833470 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: Nov 24 16:48:18.834913 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40676d6a-0f25-43b4-bc50-a3027145cca4 admin admin] RBAC: Authorization granted {{(pid=71939) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 24 16:48:19.124939 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.notifications [None req-40676d6a-0f25-43b4-bc50-a3027145cca4 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'bf67d4c04c9c4ff6b866e23cc3c387a6', 'request_id': 'req-40676d6a-0f25-43b4-bc50-a3027145cca4'} {{(pid=71939) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:357}} Nov 24 16:48:19.170763 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.notifications [None req-40676d6a-0f25-43b4-bc50-a3027145cca4 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'bf67d4c04c9c4ff6b866e23cc3c387a6', 'request_id': 'req-40676d6a-0f25-43b4-bc50-a3027145cca4'} {{(pid=71939) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:357}} Nov 24 16:48:19.193676 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.notifications [None req-40676d6a-0f25-43b4-bc50-a3027145cca4 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'bf67d4c04c9c4ff6b866e23cc3c387a6', 'request_id': 'req-40676d6a-0f25-43b4-bc50-a3027145cca4'} {{(pid=71939) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:357}} Nov 24 16:48:19.225846 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.notifications [None req-40676d6a-0f25-43b4-bc50-a3027145cca4 admin admin] The token cache is being invalidate because project bf67d4c04c9c4ff6b866e23cc3c387a6 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=71939) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Nov 24 16:48:19.226374 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.notifications [None req-40676d6a-0f25-43b4-bc50-a3027145cca4 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=71939) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:357}} Nov 24 16:48:19.228567 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.notifications [None req-40676d6a-0f25-43b4-bc50-a3027145cca4 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=71939) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:357}} Nov 24 16:48:19.232376 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: [pid: 71939|app: 0|req: 923/1840] 10.222.0.53 () {58 vars in 1223 bytes} [Wed Nov 24 16:48:18 2021] DELETE /identity/v3/projects/bf67d4c04c9c4ff6b866e23cc3c387a6 => generated 0 bytes in 574 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 24 16:48:19.237257 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8407d3c3-fbb0-4a49-8625-c7e208e569f3 service placement] Authenticating user token {{(pid=71938) process_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 24 16:48:19.264138 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8407d3c3-fbb0-4a49-8625-c7e208e569f3 service placement] Validating token access rules against request {{(pid=71938) validate_allowed_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 24 16:48:19.628641 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b17aabda-a96a-40dd-8996-96ff45921a1d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f2ba2e8375b4e8c8792ee1e22b60427', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '00a5583c7b7443e98e7a1d31a0b638dc', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=71938) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 24 16:48:19.629998 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b17aabda-a96a-40dd-8996-96ff45921a1d admin admin] REQUEST_METHOD: `DELETE` {{(pid=71938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 24 16:48:19.630586 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b17aabda-a96a-40dd-8996-96ff45921a1d admin admin] SCRIPT_NAME: `/identity` {{(pid=71938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 24 16:48:19.631130 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b17aabda-a96a-40dd-8996-96ff45921a1d admin admin] PATH_INFO: `/v3/users/0ea826d0ce944b51891b4e6937ca27de` {{(pid=71938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 24 16:48:19.634482 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b17aabda-a96a-40dd-8996-96ff45921a1d admin admin] RBAC: Authorizing `identity:delete_user(user_id=0ea826d0ce944b51891b4e6937ca27de)` {{(pid=71938) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:442}} Nov 24 16:48:19.708661 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b17aabda-a96a-40dd-8996-96ff45921a1d admin admin] RBAC: Authorization granted {{(pid=71938) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 24 16:48:19.864754 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.notifications [None req-b17aabda-a96a-40dd-8996-96ff45921a1d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '0ea826d0ce944b51891b4e6937ca27de'} {{(pid=71938) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:357}} Nov 24 16:48:19.926746 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.notifications [None req-b17aabda-a96a-40dd-8996-96ff45921a1d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '0ea826d0ce944b51891b4e6937ca27de'} {{(pid=71938) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:357}} Nov 24 16:48:19.927545 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.notifications [None req-b17aabda-a96a-40dd-8996-96ff45921a1d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '0ea826d0ce944b51891b4e6937ca27de'} {{(pid=71938) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:357}} Nov 24 16:48:19.981562 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.notifications [None req-b17aabda-a96a-40dd-8996-96ff45921a1d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '0ea826d0ce944b51891b4e6937ca27de'} {{(pid=71938) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:357}} Nov 24 16:48:19.991704 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.notifications [None req-b17aabda-a96a-40dd-8996-96ff45921a1d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '0ea826d0ce944b51891b4e6937ca27de'} {{(pid=71938) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:357}} Nov 24 16:48:20.032683 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: [pid: 71938|app: 0|req: 918/1841] 10.222.0.53 () {58 vars in 1214 bytes} [Wed Nov 24 16:48:19 2021] DELETE /identity/v3/users/0ea826d0ce944b51891b4e6937ca27de => generated 0 bytes in 796 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 24 16:48:22.397951 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40676d6a-0f25-43b4-bc50-a3027145cca4 admin admin] Authenticating user token {{(pid=71939) process_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 24 16:48:22.401950 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.fernet_utils [None req-40676d6a-0f25-43b4-bc50-a3027145cca4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=71939) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:289}} Nov 24 16:48:22.422627 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40676d6a-0f25-43b4-bc50-a3027145cca4 admin admin] Validating token access rules against request {{(pid=71939) validate_allowed_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 24 16:48:22.626106 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c072cc6d-bc92-493b-a64e-acb2e15f4433 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f2ba2e8375b4e8c8792ee1e22b60427', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '00a5583c7b7443e98e7a1d31a0b638dc', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=71939) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 24 16:48:22.627381 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c072cc6d-bc92-493b-a64e-acb2e15f4433 admin admin] REQUEST_METHOD: `DELETE` {{(pid=71939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 24 16:48:22.628103 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c072cc6d-bc92-493b-a64e-acb2e15f4433 admin admin] SCRIPT_NAME: `/identity` {{(pid=71939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 24 16:48:22.628760 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c072cc6d-bc92-493b-a64e-acb2e15f4433 admin admin] PATH_INFO: `/v3/projects/4c34c7ac33d54fc28f39edf828f2f0fc` {{(pid=71939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 24 16:48:22.633699 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c072cc6d-bc92-493b-a64e-acb2e15f4433 admin admin] RBAC: Authorizing `identity:delete_project(project_id=4c34c7ac33d54fc28f39edf828f2f0fc)` {{(pid=71939) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:442}} Nov 24 16:48:22.687179 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b17aabda-a96a-40dd-8996-96ff45921a1d admin admin] Authenticating user token {{(pid=71938) process_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 24 16:48:22.689529 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.fernet_utils [None req-b17aabda-a96a-40dd-8996-96ff45921a1d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=71938) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:289}} Nov 24 16:48:22.710130 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c072cc6d-bc92-493b-a64e-acb2e15f4433 admin admin] RBAC: Authorization granted {{(pid=71939) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 24 16:48:22.839649 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.notifications [None req-c072cc6d-bc92-493b-a64e-acb2e15f4433 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '4c34c7ac33d54fc28f39edf828f2f0fc', 'request_id': 'req-c072cc6d-bc92-493b-a64e-acb2e15f4433'} {{(pid=71939) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:357}} Nov 24 16:48:22.853964 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b17aabda-a96a-40dd-8996-96ff45921a1d admin admin] Validating token access rules against request {{(pid=71938) validate_allowed_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 24 16:48:22.865358 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.notifications [None req-c072cc6d-bc92-493b-a64e-acb2e15f4433 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '4c34c7ac33d54fc28f39edf828f2f0fc', 'request_id': 'req-c072cc6d-bc92-493b-a64e-acb2e15f4433'} {{(pid=71939) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:357}} Nov 24 16:48:22.880849 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.notifications [None req-c072cc6d-bc92-493b-a64e-acb2e15f4433 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '4c34c7ac33d54fc28f39edf828f2f0fc', 'request_id': 'req-c072cc6d-bc92-493b-a64e-acb2e15f4433'} {{(pid=71939) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:357}} Nov 24 16:48:22.905872 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.notifications [None req-c072cc6d-bc92-493b-a64e-acb2e15f4433 admin admin] The token cache is being invalidate because project 4c34c7ac33d54fc28f39edf828f2f0fc was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=71939) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Nov 24 16:48:22.906243 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.notifications [None req-c072cc6d-bc92-493b-a64e-acb2e15f4433 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=71939) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:357}} Nov 24 16:48:22.914960 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.notifications [None req-c072cc6d-bc92-493b-a64e-acb2e15f4433 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=71939) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:357}} Nov 24 16:48:22.916869 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: [pid: 71939|app: 0|req: 924/1842] 10.222.0.53 () {58 vars in 1223 bytes} [Wed Nov 24 16:48:22 2021] DELETE /identity/v3/projects/4c34c7ac33d54fc28f39edf828f2f0fc => generated 0 bytes in 520 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 24 16:48:22.922874 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c84a602-de2c-42ad-ac51-a50c275deeb4 None None] REQUEST_METHOD: `POST` {{(pid=71939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 24 16:48:22.923222 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c84a602-de2c-42ad-ac51-a50c275deeb4 None None] SCRIPT_NAME: `/identity` {{(pid=71939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 24 16:48:22.923563 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c84a602-de2c-42ad-ac51-a50c275deeb4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=71939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 24 16:48:22.951005 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fa07106-88c0-4c32-b0b1-cffc351d27aa service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a12374a3093a401a97c343ff0854184d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3b3940d4ae1c4177ae29c02377bb4b0b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=71938) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 24 16:48:22.951726 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fa07106-88c0-4c32-b0b1-cffc351d27aa service cinder] REQUEST_METHOD: `GET` {{(pid=71938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 24 16:48:22.952325 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fa07106-88c0-4c32-b0b1-cffc351d27aa service cinder] SCRIPT_NAME: `/identity` {{(pid=71938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 24 16:48:22.953282 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fa07106-88c0-4c32-b0b1-cffc351d27aa service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=71938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 24 16:48:22.955551 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.fernet_utils [None req-3fa07106-88c0-4c32-b0b1-cffc351d27aa service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=71938) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:289}} Nov 24 16:48:22.989188 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.auth.core [None req-6c84a602-de2c-42ad-ac51-a50c275deeb4 None None] MFA Rules not processed for user `0f2ba2e8375b4e8c8792ee1e22b60427`. Rule list: `[]` (Enabled: `True`). {{(pid=71939) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:442}} Nov 24 16:48:22.990406 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.fernet_utils [None req-6c84a602-de2c-42ad-ac51-a50c275deeb4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=71939) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:289}} Nov 24 16:48:23.147937 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fa07106-88c0-4c32-b0b1-cffc351d27aa service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=71938) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:442}} Nov 24 16:48:23.167081 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: [pid: 71939|app: 0|req: 925/1843] 10.222.0.53 () {58 vars in 948 bytes} [Wed Nov 24 16:48:22 2021] POST /identity/v3/auth/tokens => generated 3669 bytes in 242 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Nov 24 16:48:23.172843 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9870813-01c9-4946-bdea-43c4e673e154 None None] REQUEST_METHOD: `POST` {{(pid=71939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 24 16:48:23.173195 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9870813-01c9-4946-bdea-43c4e673e154 None None] SCRIPT_NAME: `/identity` {{(pid=71939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 24 16:48:23.173542 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9870813-01c9-4946-bdea-43c4e673e154 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=71939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 24 16:48:23.267269 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.auth.core [None req-b9870813-01c9-4946-bdea-43c4e673e154 None None] MFA Rules not processed for user `0f2ba2e8375b4e8c8792ee1e22b60427`. Rule list: `[]` (Enabled: `True`). {{(pid=71939) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:442}} Nov 24 16:48:23.268542 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.fernet_utils [None req-b9870813-01c9-4946-bdea-43c4e673e154 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=71939) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:289}} Nov 24 16:48:23.295716 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: [pid: 71939|app: 0|req: 926/1844] 10.222.0.53 () {58 vars in 948 bytes} [Wed Nov 24 16:48:23 2021] POST /identity/v3/auth/tokens => generated 3669 bytes in 124 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Nov 24 16:48:23.301503 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9870813-01c9-4946-bdea-43c4e673e154 None None] Authenticating user token {{(pid=71939) process_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 24 16:48:23.329685 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9870813-01c9-4946-bdea-43c4e673e154 None None] Validating token access rules against request {{(pid=71939) validate_allowed_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 24 16:48:23.342257 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fa07106-88c0-4c32-b0b1-cffc351d27aa service cinder] RBAC: Authorization granted {{(pid=71938) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 24 16:48:23.346872 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc54fdc0-8b6a-4aba-a125-63ca96848653 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f2ba2e8375b4e8c8792ee1e22b60427', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '00a5583c7b7443e98e7a1d31a0b638dc', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=71939) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 24 16:48:23.347504 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc54fdc0-8b6a-4aba-a125-63ca96848653 admin admin] REQUEST_METHOD: `GET` {{(pid=71939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 24 16:48:23.347847 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc54fdc0-8b6a-4aba-a125-63ca96848653 admin admin] SCRIPT_NAME: `/identity` {{(pid=71939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 24 16:48:23.348184 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc54fdc0-8b6a-4aba-a125-63ca96848653 admin admin] PATH_INFO: `/v3/domains` {{(pid=71939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 24 16:48:23.349008 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc54fdc0-8b6a-4aba-a125-63ca96848653 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=71939) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:161}} Nov 24 16:48:23.349334 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc54fdc0-8b6a-4aba-a125-63ca96848653 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=71939) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:442}} Nov 24 16:48:23.402632 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: [pid: 71938|app: 0|req: 919/1845] 10.222.0.53 () {60 vars in 1356 bytes} [Wed Nov 24 16:48:22 2021] GET /identity/v3/auth/tokens => generated 3751 bytes in 717 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Nov 24 16:48:23.458509 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc54fdc0-8b6a-4aba-a125-63ca96848653 admin admin] RBAC: Authorization granted {{(pid=71939) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 24 16:48:23.488928 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: [pid: 71939|app: 0|req: 927/1846] 10.222.0.53 () {58 vars in 1143 bytes} [Wed Nov 24 16:48:23 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Nov 24 16:48:23.494380 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fa07106-88c0-4c32-b0b1-cffc351d27aa service cinder] Authenticating user token {{(pid=71938) process_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 24 16:48:23.519647 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fa07106-88c0-4c32-b0b1-cffc351d27aa service cinder] Validating token access rules against request {{(pid=71938) validate_allowed_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 24 16:48:23.534984 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-340d18f7-576b-407c-bf5d-c4e8047bf447 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f2ba2e8375b4e8c8792ee1e22b60427', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '00a5583c7b7443e98e7a1d31a0b638dc', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=71938) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 24 16:48:23.537482 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-340d18f7-576b-407c-bf5d-c4e8047bf447 admin admin] REQUEST_METHOD: `POST` {{(pid=71938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 24 16:48:23.537837 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-340d18f7-576b-407c-bf5d-c4e8047bf447 admin admin] SCRIPT_NAME: `/identity` {{(pid=71938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 24 16:48:23.538262 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-340d18f7-576b-407c-bf5d-c4e8047bf447 admin admin] PATH_INFO: `/v3/projects` {{(pid=71938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 24 16:48:23.544639 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-340d18f7-576b-407c-bf5d-c4e8047bf447 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=71938) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:442}} Nov 24 16:48:23.646005 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-340d18f7-576b-407c-bf5d-c4e8047bf447 admin admin] RBAC: Authorization granted {{(pid=71938) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 24 16:48:23.716997 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: [pid: 71938|app: 0|req: 920/1847] 10.222.0.53 () {60 vars in 1143 bytes} [Wed Nov 24 16:48:23 2021] POST /identity/v3/projects => generated 365 bytes in 223 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 24 16:48:23.717744 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc54fdc0-8b6a-4aba-a125-63ca96848653 admin admin] Authenticating user token {{(pid=71939) process_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 24 16:48:23.738089 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc54fdc0-8b6a-4aba-a125-63ca96848653 admin admin] Validating token access rules against request {{(pid=71939) validate_allowed_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 24 16:48:23.951821 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5816f568-4c88-4f34-9b6e-daed2ec423ec admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f2ba2e8375b4e8c8792ee1e22b60427', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '00a5583c7b7443e98e7a1d31a0b638dc', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=71939) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 24 16:48:23.952525 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5816f568-4c88-4f34-9b6e-daed2ec423ec admin admin] REQUEST_METHOD: `POST` {{(pid=71939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 24 16:48:23.952873 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5816f568-4c88-4f34-9b6e-daed2ec423ec admin admin] SCRIPT_NAME: `/identity` {{(pid=71939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 24 16:48:23.953216 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5816f568-4c88-4f34-9b6e-daed2ec423ec admin admin] PATH_INFO: `/v3/users` {{(pid=71939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 24 16:48:23.953972 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5816f568-4c88-4f34-9b6e-daed2ec423ec admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=71939) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:442}} Nov 24 16:48:24.037657 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5816f568-4c88-4f34-9b6e-daed2ec423ec admin admin] RBAC: Authorization granted {{(pid=71939) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 24 16:48:24.045845 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45e85250-0671-4b57-8922-559a3be5f3db None None] REQUEST_METHOD: `POST` {{(pid=71938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 24 16:48:24.046418 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45e85250-0671-4b57-8922-559a3be5f3db None None] SCRIPT_NAME: `/identity` {{(pid=71938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 24 16:48:24.047115 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45e85250-0671-4b57-8922-559a3be5f3db None None] PATH_INFO: `/v3/auth/tokens` {{(pid=71938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 24 16:48:24.140704 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: [pid: 71939|app: 0|req: 928/1848] 10.222.0.53 () {60 vars in 1134 bytes} [Wed Nov 24 16:48:23 2021] POST /identity/v3/users => generated 283 bytes in 423 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 24 16:48:24.141745 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5816f568-4c88-4f34-9b6e-daed2ec423ec admin admin] Authenticating user token {{(pid=71939) process_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 24 16:48:24.197605 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5816f568-4c88-4f34-9b6e-daed2ec423ec admin admin] Validating token access rules against request {{(pid=71939) validate_allowed_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 24 16:48:24.223611 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1efe4962-186b-48b9-ae64-171139d85bf0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f2ba2e8375b4e8c8792ee1e22b60427', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '00a5583c7b7443e98e7a1d31a0b638dc', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=71939) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 24 16:48:24.226321 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1efe4962-186b-48b9-ae64-171139d85bf0 admin admin] REQUEST_METHOD: `GET` {{(pid=71939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 24 16:48:24.230369 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1efe4962-186b-48b9-ae64-171139d85bf0 admin admin] SCRIPT_NAME: `/identity` {{(pid=71939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 24 16:48:24.233423 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1efe4962-186b-48b9-ae64-171139d85bf0 admin admin] PATH_INFO: `/v3/roles` {{(pid=71939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 24 16:48:24.235319 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1efe4962-186b-48b9-ae64-171139d85bf0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=71939) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:442}} Nov 24 16:48:24.349680 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1efe4962-186b-48b9-ae64-171139d85bf0 admin admin] RBAC: Authorization granted {{(pid=71939) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 24 16:48:24.367945 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: [pid: 71939|app: 0|req: 929/1849] 10.222.0.53 () {58 vars in 1112 bytes} [Wed Nov 24 16:48:24 2021] GET /identity/v3/roles => generated 1420 bytes in 227 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 24 16:48:24.372854 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1efe4962-186b-48b9-ae64-171139d85bf0 admin admin] Authenticating user token {{(pid=71939) process_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 24 16:48:24.422070 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1efe4962-186b-48b9-ae64-171139d85bf0 admin admin] Validating token access rules against request {{(pid=71939) validate_allowed_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 24 16:48:24.433404 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.auth.core [None req-45e85250-0671-4b57-8922-559a3be5f3db None None] MFA Rules not processed for user `f8a135ac0e4744a98258dc7f6c12e741`. Rule list: `[]` (Enabled: `True`). {{(pid=71938) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:442}} Nov 24 16:48:24.437447 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.fernet_utils [None req-45e85250-0671-4b57-8922-559a3be5f3db None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=71938) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:289}} Nov 24 16:48:24.443347 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe5e6cd7-0d30-4744-95ca-77f80d9ac0f4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f2ba2e8375b4e8c8792ee1e22b60427', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '00a5583c7b7443e98e7a1d31a0b638dc', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=71939) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 24 16:48:24.445116 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe5e6cd7-0d30-4744-95ca-77f80d9ac0f4 admin admin] REQUEST_METHOD: `PUT` {{(pid=71939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 24 16:48:24.450720 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe5e6cd7-0d30-4744-95ca-77f80d9ac0f4 admin admin] SCRIPT_NAME: `/identity` {{(pid=71939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 24 16:48:24.451187 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe5e6cd7-0d30-4744-95ca-77f80d9ac0f4 admin admin] PATH_INFO: `/v3/projects/527c37cdc53f4bfba924ebcfc5efc82a/users/e7b6d6e008a248719ca4cd8595277f78/roles/912ab5f10fa5477da74acf239f07604e` {{(pid=71939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 24 16:48:24.505698 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe5e6cd7-0d30-4744-95ca-77f80d9ac0f4 admin admin] RBAC: Authorizing `identity:create_grant(project_id=527c37cdc53f4bfba924ebcfc5efc82a, user_id=e7b6d6e008a248719ca4cd8595277f78, role_id=912ab5f10fa5477da74acf239f07604e)` {{(pid=71939) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:442}} Nov 24 16:48:24.566168 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe5e6cd7-0d30-4744-95ca-77f80d9ac0f4 admin admin] RBAC: Authorization granted {{(pid=71939) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 24 16:48:24.594401 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: [pid: 71939|app: 0|req: 930/1850] 10.222.0.53 () {60 vars in 1473 bytes} [Wed Nov 24 16:48:24 2021] PUT /identity/v3/projects/527c37cdc53f4bfba924ebcfc5efc82a/users/e7b6d6e008a248719ca4cd8595277f78/roles/912ab5f10fa5477da74acf239f07604e => generated 0 bytes in 222 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 24 16:48:24.608112 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59d66230-d8a7-4b8b-aca0-41ea1d2d218f None None] REQUEST_METHOD: `POST` {{(pid=71939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 24 16:48:24.608661 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59d66230-d8a7-4b8b-aca0-41ea1d2d218f None None] SCRIPT_NAME: `/identity` {{(pid=71939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 24 16:48:24.609329 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59d66230-d8a7-4b8b-aca0-41ea1d2d218f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=71939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 24 16:48:24.688494 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: [pid: 71938|app: 0|req: 921/1851] 10.222.0.53 () {58 vars in 999 bytes} [Wed Nov 24 16:48:24 2021] POST /identity/v3/auth/tokens => generated 3625 bytes in 645 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Nov 24 16:48:24.780544 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.auth.core [None req-59d66230-d8a7-4b8b-aca0-41ea1d2d218f None None] MFA Rules not processed for user `e7b6d6e008a248719ca4cd8595277f78`. Rule list: `[]` (Enabled: `True`). {{(pid=71939) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:442}} Nov 24 16:48:24.792110 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.fernet_utils [None req-59d66230-d8a7-4b8b-aca0-41ea1d2d218f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=71939) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:289}} Nov 24 16:48:24.967746 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45e85250-0671-4b57-8922-559a3be5f3db None None] Authenticating user token {{(pid=71938) process_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 24 16:48:24.969908 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.fernet_utils [None req-45e85250-0671-4b57-8922-559a3be5f3db None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=71938) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:289}} Nov 24 16:48:25.061691 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: [pid: 71939|app: 0|req: 931/1852] 10.222.0.53 () {58 vars in 948 bytes} [Wed Nov 24 16:48:24 2021] POST /identity/v3/auth/tokens => generated 3672 bytes in 452 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Nov 24 16:48:25.063441 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59d66230-d8a7-4b8b-aca0-41ea1d2d218f None None] Authenticating user token {{(pid=71939) process_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 24 16:48:25.308696 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59d66230-d8a7-4b8b-aca0-41ea1d2d218f None None] Validating token access rules against request {{(pid=71939) validate_allowed_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 24 16:48:25.322076 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d992827-98a9-4294-b906-af5ad52f3692 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f2ba2e8375b4e8c8792ee1e22b60427', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '00a5583c7b7443e98e7a1d31a0b638dc', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=71939) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 24 16:48:25.322784 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d992827-98a9-4294-b906-af5ad52f3692 admin admin] REQUEST_METHOD: `POST` {{(pid=71939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 24 16:48:25.323129 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d992827-98a9-4294-b906-af5ad52f3692 admin admin] SCRIPT_NAME: `/identity` {{(pid=71939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 24 16:48:25.323465 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d992827-98a9-4294-b906-af5ad52f3692 admin admin] PATH_INFO: `/v3/projects` {{(pid=71939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 24 16:48:25.324235 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d992827-98a9-4294-b906-af5ad52f3692 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=71939) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:442}} Nov 24 16:48:25.389386 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45e85250-0671-4b57-8922-559a3be5f3db None None] Validating token access rules against request {{(pid=71938) validate_allowed_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 24 16:48:25.429250 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d992827-98a9-4294-b906-af5ad52f3692 admin admin] RBAC: Authorization granted {{(pid=71939) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 24 16:48:25.500488 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: [pid: 71939|app: 0|req: 932/1853] 10.222.0.53 () {60 vars in 1143 bytes} [Wed Nov 24 16:48:25 2021] POST /identity/v3/projects => generated 363 bytes in 438 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 24 16:48:25.505723 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d992827-98a9-4294-b906-af5ad52f3692 admin admin] Authenticating user token {{(pid=71939) process_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 24 16:48:25.509707 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.fernet_utils [None req-1d992827-98a9-4294-b906-af5ad52f3692 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=71939) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:289}} Nov 24 16:48:25.615077 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d992827-98a9-4294-b906-af5ad52f3692 admin admin] Validating token access rules against request {{(pid=71939) validate_allowed_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 24 16:48:25.620480 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-839bf24a-c473-4453-a5e5-590a3a0f9d69 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f2ba2e8375b4e8c8792ee1e22b60427', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '00a5583c7b7443e98e7a1d31a0b638dc', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=71939) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 24 16:48:25.621504 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-839bf24a-c473-4453-a5e5-590a3a0f9d69 admin admin] REQUEST_METHOD: `DELETE` {{(pid=71939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 24 16:48:25.621851 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-839bf24a-c473-4453-a5e5-590a3a0f9d69 admin admin] SCRIPT_NAME: `/identity` {{(pid=71939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 24 16:48:25.622239 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-839bf24a-c473-4453-a5e5-590a3a0f9d69 admin admin] PATH_INFO: `/v3/users/34d2bfdcf76b4d5bb3f013dcd99f817f` {{(pid=71939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 24 16:48:25.623663 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-839bf24a-c473-4453-a5e5-590a3a0f9d69 admin admin] RBAC: Authorizing `identity:delete_user(user_id=34d2bfdcf76b4d5bb3f013dcd99f817f)` {{(pid=71939) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:442}} Nov 24 16:48:25.658538 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-839bf24a-c473-4453-a5e5-590a3a0f9d69 admin admin] RBAC: Authorization granted {{(pid=71939) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 24 16:48:25.673013 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2396cc77-4c72-47cd-ba3a-3f8228d86e6f service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a4cec9543ba4b7da4ecb1e6e8681302', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3b3940d4ae1c4177ae29c02377bb4b0b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=71938) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 24 16:48:25.673884 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2396cc77-4c72-47cd-ba3a-3f8228d86e6f service swift] REQUEST_METHOD: `GET` {{(pid=71938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 24 16:48:25.674377 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2396cc77-4c72-47cd-ba3a-3f8228d86e6f service swift] SCRIPT_NAME: `/identity` {{(pid=71938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 24 16:48:25.674826 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2396cc77-4c72-47cd-ba3a-3f8228d86e6f service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=71938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 24 16:48:25.749973 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.notifications [None req-839bf24a-c473-4453-a5e5-590a3a0f9d69 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '34d2bfdcf76b4d5bb3f013dcd99f817f'} {{(pid=71939) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:357}} Nov 24 16:48:25.781742 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.notifications [None req-839bf24a-c473-4453-a5e5-590a3a0f9d69 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '34d2bfdcf76b4d5bb3f013dcd99f817f'} {{(pid=71939) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:357}} Nov 24 16:48:25.782709 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.notifications [None req-839bf24a-c473-4453-a5e5-590a3a0f9d69 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '34d2bfdcf76b4d5bb3f013dcd99f817f'} {{(pid=71939) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:357}} Nov 24 16:48:25.793277 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.notifications [None req-839bf24a-c473-4453-a5e5-590a3a0f9d69 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '34d2bfdcf76b4d5bb3f013dcd99f817f'} {{(pid=71939) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:357}} Nov 24 16:48:25.802159 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.notifications [None req-839bf24a-c473-4453-a5e5-590a3a0f9d69 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '34d2bfdcf76b4d5bb3f013dcd99f817f'} {{(pid=71939) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:357}} Nov 24 16:48:25.813147 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: [pid: 71939|app: 0|req: 933/1854] 10.222.0.53 () {58 vars in 1214 bytes} [Wed Nov 24 16:48:25 2021] DELETE /identity/v3/users/34d2bfdcf76b4d5bb3f013dcd99f817f => generated 0 bytes in 311 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Nov 24 16:48:25.814376 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-839bf24a-c473-4453-a5e5-590a3a0f9d69 admin admin] Authenticating user token {{(pid=71939) process_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 24 16:48:25.816696 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.fernet_utils [None req-839bf24a-c473-4453-a5e5-590a3a0f9d69 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=71939) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:289}} Nov 24 16:48:25.839398 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2396cc77-4c72-47cd-ba3a-3f8228d86e6f service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=71938) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:442}} Nov 24 16:48:25.894208 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2396cc77-4c72-47cd-ba3a-3f8228d86e6f service swift] RBAC: Authorization granted {{(pid=71938) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 24 16:48:25.925529 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-839bf24a-c473-4453-a5e5-590a3a0f9d69 admin admin] Validating token access rules against request {{(pid=71939) validate_allowed_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 24 16:48:25.931047 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcaa9391-bd60-4c11-80c1-a68f6d02825e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f2ba2e8375b4e8c8792ee1e22b60427', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '00a5583c7b7443e98e7a1d31a0b638dc', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=71939) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 24 16:48:25.931897 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcaa9391-bd60-4c11-80c1-a68f6d02825e admin admin] REQUEST_METHOD: `POST` {{(pid=71939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 24 16:48:25.932246 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcaa9391-bd60-4c11-80c1-a68f6d02825e admin admin] SCRIPT_NAME: `/identity` {{(pid=71939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 24 16:48:25.932584 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcaa9391-bd60-4c11-80c1-a68f6d02825e admin admin] PATH_INFO: `/v3/users` {{(pid=71939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 24 16:48:25.933482 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcaa9391-bd60-4c11-80c1-a68f6d02825e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=71939) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:442}} Nov 24 16:48:25.943537 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: [pid: 71938|app: 0|req: 922/1855] 10.222.0.53 () {60 vars in 1375 bytes} [Wed Nov 24 16:48:24 2021] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 976 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Nov 24 16:48:25.945923 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eeef8efa-0dc4-4a84-a50f-c32d40ada37b None None] REQUEST_METHOD: `POST` {{(pid=71938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 24 16:48:25.959375 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eeef8efa-0dc4-4a84-a50f-c32d40ada37b None None] SCRIPT_NAME: `/identity` {{(pid=71938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 24 16:48:25.963443 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eeef8efa-0dc4-4a84-a50f-c32d40ada37b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=71938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 24 16:48:25.970164 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcaa9391-bd60-4c11-80c1-a68f6d02825e admin admin] RBAC: Authorization granted {{(pid=71939) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 24 16:48:25.997045 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: [pid: 71939|app: 0|req: 934/1856] 10.222.0.53 () {60 vars in 1134 bytes} [Wed Nov 24 16:48:25 2021] POST /identity/v3/users => generated 288 bytes in 183 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 24 16:48:25.998102 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcaa9391-bd60-4c11-80c1-a68f6d02825e admin admin] Authenticating user token {{(pid=71939) process_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 24 16:48:26.011504 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcaa9391-bd60-4c11-80c1-a68f6d02825e admin admin] Validating token access rules against request {{(pid=71939) validate_allowed_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 24 16:48:26.019155 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d091fb08-6e70-4dd8-9c9f-c7082ce94265 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f2ba2e8375b4e8c8792ee1e22b60427', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '00a5583c7b7443e98e7a1d31a0b638dc', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=71939) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 24 16:48:26.019856 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d091fb08-6e70-4dd8-9c9f-c7082ce94265 admin admin] REQUEST_METHOD: `GET` {{(pid=71939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 24 16:48:26.020215 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d091fb08-6e70-4dd8-9c9f-c7082ce94265 admin admin] SCRIPT_NAME: `/identity` {{(pid=71939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 24 16:48:26.020904 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d091fb08-6e70-4dd8-9c9f-c7082ce94265 admin admin] PATH_INFO: `/v3/roles` {{(pid=71939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 24 16:48:26.022061 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d091fb08-6e70-4dd8-9c9f-c7082ce94265 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=71939) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:442}} Nov 24 16:48:26.057797 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.auth.core [None req-eeef8efa-0dc4-4a84-a50f-c32d40ada37b None None] MFA Rules not processed for user `0f2ba2e8375b4e8c8792ee1e22b60427`. Rule list: `[]` (Enabled: `True`). {{(pid=71938) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:442}} Nov 24 16:48:26.058126 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d091fb08-6e70-4dd8-9c9f-c7082ce94265 admin admin] RBAC: Authorization granted {{(pid=71939) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 24 16:48:26.065100 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.fernet_utils [None req-eeef8efa-0dc4-4a84-a50f-c32d40ada37b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=71938) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:289}} Nov 24 16:48:26.077087 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: [pid: 71939|app: 0|req: 935/1857] 10.222.0.53 () {58 vars in 1112 bytes} [Wed Nov 24 16:48:25 2021] GET /identity/v3/roles => generated 1420 bytes in 79 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 24 16:48:26.083569 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d091fb08-6e70-4dd8-9c9f-c7082ce94265 admin admin] Authenticating user token {{(pid=71939) process_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 24 16:48:26.089528 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: [pid: 71938|app: 0|req: 923/1858] 10.222.0.53 () {58 vars in 948 bytes} [Wed Nov 24 16:48:25 2021] POST /identity/v3/auth/tokens => generated 3669 bytes in 145 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 24 16:48:26.107491 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d091fb08-6e70-4dd8-9c9f-c7082ce94265 admin admin] Validating token access rules against request {{(pid=71939) validate_allowed_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 24 16:48:26.123666 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-935e300c-2caf-4ef0-b972-9dd4f9faef34 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f2ba2e8375b4e8c8792ee1e22b60427', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '00a5583c7b7443e98e7a1d31a0b638dc', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=71939) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 24 16:48:26.125342 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-935e300c-2caf-4ef0-b972-9dd4f9faef34 admin admin] REQUEST_METHOD: `PUT` {{(pid=71939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 24 16:48:26.125695 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-935e300c-2caf-4ef0-b972-9dd4f9faef34 admin admin] SCRIPT_NAME: `/identity` {{(pid=71939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 24 16:48:26.126085 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-935e300c-2caf-4ef0-b972-9dd4f9faef34 admin admin] PATH_INFO: `/v3/projects/790523f1583543318dfff071b27f439f/users/c0d45844e0fd48c29ba8d25fb8368c5e/roles/5611724e350b41e19921b5961a342582` {{(pid=71939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 24 16:48:26.157352 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eeef8efa-0dc4-4a84-a50f-c32d40ada37b None None] Authenticating user token {{(pid=71938) process_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 24 16:48:26.159358 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.fernet_utils [None req-eeef8efa-0dc4-4a84-a50f-c32d40ada37b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=71938) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:289}} Nov 24 16:48:26.194056 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-935e300c-2caf-4ef0-b972-9dd4f9faef34 admin admin] RBAC: Authorizing `identity:create_grant(project_id=790523f1583543318dfff071b27f439f, user_id=c0d45844e0fd48c29ba8d25fb8368c5e, role_id=5611724e350b41e19921b5961a342582)` {{(pid=71939) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:442}} Nov 24 16:48:26.309872 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-935e300c-2caf-4ef0-b972-9dd4f9faef34 admin admin] RBAC: Authorization granted {{(pid=71939) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 24 16:48:26.343613 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: [pid: 71939|app: 0|req: 936/1859] 10.222.0.53 () {60 vars in 1473 bytes} [Wed Nov 24 16:48:26 2021] PUT /identity/v3/projects/790523f1583543318dfff071b27f439f/users/c0d45844e0fd48c29ba8d25fb8368c5e/roles/5611724e350b41e19921b5961a342582 => generated 0 bytes in 261 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 24 16:48:26.350913 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81d31b2f-f874-4c60-8f24-c5ee07b34f8f None None] REQUEST_METHOD: `POST` {{(pid=71939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 24 16:48:26.352214 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81d31b2f-f874-4c60-8f24-c5ee07b34f8f None None] SCRIPT_NAME: `/identity` {{(pid=71939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 24 16:48:26.352709 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81d31b2f-f874-4c60-8f24-c5ee07b34f8f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=71939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 24 16:48:26.415561 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.auth.core [None req-81d31b2f-f874-4c60-8f24-c5ee07b34f8f None None] MFA Rules not processed for user `1e837ea3812449029236efda9a2d6448`. Rule list: `[]` (Enabled: `True`). {{(pid=71939) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:442}} Nov 24 16:48:26.417485 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.fernet_utils [None req-81d31b2f-f874-4c60-8f24-c5ee07b34f8f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=71939) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:289}} Nov 24 16:48:26.434432 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eeef8efa-0dc4-4a84-a50f-c32d40ada37b None None] Validating token access rules against request {{(pid=71938) validate_allowed_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 24 16:48:26.552463 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: [pid: 71939|app: 0|req: 937/1860] 10.222.0.53 () {58 vars in 948 bytes} [Wed Nov 24 16:48:26 2021] POST /identity/v3/auth/tokens => generated 3700 bytes in 204 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 24 16:48:26.553513 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81d31b2f-f874-4c60-8f24-c5ee07b34f8f None None] Authenticating user token {{(pid=71939) process_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 24 16:48:26.723783 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe68ea52-6815-483b-851b-610c04636ce6 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c90f21b9cdcb413282461fa83cb6b7a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3b3940d4ae1c4177ae29c02377bb4b0b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=71938) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 24 16:48:26.727643 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe68ea52-6815-483b-851b-610c04636ce6 service neutron] REQUEST_METHOD: `GET` {{(pid=71938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 24 16:48:26.729862 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe68ea52-6815-483b-851b-610c04636ce6 service neutron] SCRIPT_NAME: `/identity` {{(pid=71938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 24 16:48:26.731011 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe68ea52-6815-483b-851b-610c04636ce6 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=71938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 24 16:48:26.755450 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81d31b2f-f874-4c60-8f24-c5ee07b34f8f None None] Validating token access rules against request {{(pid=71939) validate_allowed_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 24 16:48:26.763895 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4c4c9ae-62ee-494b-bc3d-8ca4f147366d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f2ba2e8375b4e8c8792ee1e22b60427', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '00a5583c7b7443e98e7a1d31a0b638dc', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=71939) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 24 16:48:26.764602 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4c4c9ae-62ee-494b-bc3d-8ca4f147366d admin admin] REQUEST_METHOD: `GET` {{(pid=71939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 24 16:48:26.765023 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4c4c9ae-62ee-494b-bc3d-8ca4f147366d admin admin] SCRIPT_NAME: `/identity` {{(pid=71939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 24 16:48:26.765322 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4c4c9ae-62ee-494b-bc3d-8ca4f147366d admin admin] PATH_INFO: `/v3/roles` {{(pid=71939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 24 16:48:26.766133 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4c4c9ae-62ee-494b-bc3d-8ca4f147366d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=71939) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:442}} Nov 24 16:48:26.767888 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe68ea52-6815-483b-851b-610c04636ce6 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=71938) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:442}} Nov 24 16:48:26.836483 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4c4c9ae-62ee-494b-bc3d-8ca4f147366d admin admin] RBAC: Authorization granted {{(pid=71939) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 24 16:48:26.871157 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: [pid: 71939|app: 0|req: 938/1861] 10.222.0.53 () {58 vars in 1112 bytes} [Wed Nov 24 16:48:26 2021] GET /identity/v3/roles => generated 1420 bytes in 316 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 24 16:48:26.871157 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30f8b9bd-1ba1-4d48-b586-0659fad83a9d None None] REQUEST_METHOD: `POST` {{(pid=71939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 24 16:48:26.871395 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30f8b9bd-1ba1-4d48-b586-0659fad83a9d None None] SCRIPT_NAME: `/identity` {{(pid=71939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 24 16:48:26.871945 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30f8b9bd-1ba1-4d48-b586-0659fad83a9d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=71939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 24 16:48:26.880360 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe68ea52-6815-483b-851b-610c04636ce6 service neutron] RBAC: Authorization granted {{(pid=71938) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 24 16:48:26.909750 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: [pid: 71938|app: 0|req: 924/1862] 10.222.0.53 () {60 vars in 1356 bytes} [Wed Nov 24 16:48:26 2021] GET /identity/v3/auth/tokens => generated 3669 bytes in 753 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 24 16:48:26.911920 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe68ea52-6815-483b-851b-610c04636ce6 service neutron] Authenticating user token {{(pid=71938) process_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 24 16:48:26.931401 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.auth.core [None req-30f8b9bd-1ba1-4d48-b586-0659fad83a9d None None] MFA Rules not processed for user `1e837ea3812449029236efda9a2d6448`. Rule list: `[]` (Enabled: `True`). {{(pid=71939) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:442}} Nov 24 16:48:26.932733 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.fernet_utils [None req-30f8b9bd-1ba1-4d48-b586-0659fad83a9d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=71939) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:289}} Nov 24 16:48:26.933965 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe68ea52-6815-483b-851b-610c04636ce6 service neutron] Validating token access rules against request {{(pid=71938) validate_allowed_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 24 16:48:26.941526 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59bfab14-f742-4804-81bf-a17f3b4c2eab admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f2ba2e8375b4e8c8792ee1e22b60427', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '00a5583c7b7443e98e7a1d31a0b638dc', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=71938) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 24 16:48:26.943059 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59bfab14-f742-4804-81bf-a17f3b4c2eab admin admin] REQUEST_METHOD: `PUT` {{(pid=71938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 24 16:48:26.954108 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: [pid: 71939|app: 0|req: 939/1863] 10.222.0.53 () {58 vars in 948 bytes} [Wed Nov 24 16:48:26 2021] POST /identity/v3/auth/tokens => generated 3700 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 24 16:48:26.959500 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59bfab14-f742-4804-81bf-a17f3b4c2eab admin admin] SCRIPT_NAME: `/identity` {{(pid=71938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 24 16:48:26.960073 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59bfab14-f742-4804-81bf-a17f3b4c2eab admin admin] PATH_INFO: `/v3/projects/790523f1583543318dfff071b27f439f/users/c0d45844e0fd48c29ba8d25fb8368c5e/roles/5611724e350b41e19921b5961a342582` {{(pid=71938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 24 16:48:26.972337 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30f8b9bd-1ba1-4d48-b586-0659fad83a9d None None] Authenticating user token {{(pid=71939) process_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 24 16:48:26.972337 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.fernet_utils [None req-30f8b9bd-1ba1-4d48-b586-0659fad83a9d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=71939) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:289}} Nov 24 16:48:26.979235 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59bfab14-f742-4804-81bf-a17f3b4c2eab admin admin] RBAC: Authorizing `identity:create_grant(project_id=790523f1583543318dfff071b27f439f, user_id=c0d45844e0fd48c29ba8d25fb8368c5e, role_id=5611724e350b41e19921b5961a342582)` {{(pid=71938) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:442}} Nov 24 16:48:27.104821 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59bfab14-f742-4804-81bf-a17f3b4c2eab admin admin] RBAC: Authorization granted {{(pid=71938) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 24 16:48:27.122130 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: [pid: 71938|app: 0|req: 925/1864] 10.222.0.53 () {60 vars in 1473 bytes} [Wed Nov 24 16:48:26 2021] PUT /identity/v3/projects/790523f1583543318dfff071b27f439f/users/c0d45844e0fd48c29ba8d25fb8368c5e/roles/5611724e350b41e19921b5961a342582 => generated 0 bytes in 211 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 24 16:48:27.128765 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59bfab14-f742-4804-81bf-a17f3b4c2eab admin admin] Authenticating user token {{(pid=71938) process_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 24 16:48:27.227769 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30f8b9bd-1ba1-4d48-b586-0659fad83a9d None None] Validating token access rules against request {{(pid=71939) validate_allowed_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 24 16:48:27.311767 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59bfab14-f742-4804-81bf-a17f3b4c2eab admin admin] Validating token access rules against request {{(pid=71938) validate_allowed_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 24 16:48:27.318674 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2ffca2b-d592-490d-aabe-e4346078d710 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f2ba2e8375b4e8c8792ee1e22b60427', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '00a5583c7b7443e98e7a1d31a0b638dc', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=71938) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 24 16:48:27.319605 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2ffca2b-d592-490d-aabe-e4346078d710 admin admin] REQUEST_METHOD: `GET` {{(pid=71938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 24 16:48:27.320834 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2ffca2b-d592-490d-aabe-e4346078d710 admin admin] SCRIPT_NAME: `/identity` {{(pid=71938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 24 16:48:27.321227 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2ffca2b-d592-490d-aabe-e4346078d710 admin admin] PATH_INFO: `/v3/roles` {{(pid=71938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 24 16:48:27.322059 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2ffca2b-d592-490d-aabe-e4346078d710 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=71938) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:442}} Nov 24 16:48:27.377183 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2ffca2b-d592-490d-aabe-e4346078d710 admin admin] RBAC: Authorization granted {{(pid=71938) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 24 16:48:27.410441 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be93a803-79e3-4d70-b39f-c575d7a704ac service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e196802d4d5432482b6d2eabc25f74e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3b3940d4ae1c4177ae29c02377bb4b0b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'service', 'ResellerAdmin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=71939) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 24 16:48:27.411130 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be93a803-79e3-4d70-b39f-c575d7a704ac service nova] REQUEST_METHOD: `GET` {{(pid=71939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 24 16:48:27.411477 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be93a803-79e3-4d70-b39f-c575d7a704ac service nova] SCRIPT_NAME: `/identity` {{(pid=71939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 24 16:48:27.411813 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be93a803-79e3-4d70-b39f-c575d7a704ac service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=71939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 24 16:48:27.431593 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: [pid: 71938|app: 0|req: 926/1865] 10.222.0.53 () {58 vars in 1112 bytes} [Wed Nov 24 16:48:27 2021] GET /identity/v3/roles => generated 1420 bytes in 304 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 24 16:48:27.433249 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2ffca2b-d592-490d-aabe-e4346078d710 admin admin] Authenticating user token {{(pid=71938) process_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 24 16:48:27.450756 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2ffca2b-d592-490d-aabe-e4346078d710 admin admin] Validating token access rules against request {{(pid=71938) validate_allowed_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 24 16:48:27.457989 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e82f403-f9bb-4f15-86b9-2703bda0e127 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f2ba2e8375b4e8c8792ee1e22b60427', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '00a5583c7b7443e98e7a1d31a0b638dc', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=71938) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 24 16:48:27.462758 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e82f403-f9bb-4f15-86b9-2703bda0e127 admin admin] REQUEST_METHOD: `PUT` {{(pid=71938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 24 16:48:27.463112 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e82f403-f9bb-4f15-86b9-2703bda0e127 admin admin] SCRIPT_NAME: `/identity` {{(pid=71938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 24 16:48:27.463456 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e82f403-f9bb-4f15-86b9-2703bda0e127 admin admin] PATH_INFO: `/v3/projects/790523f1583543318dfff071b27f439f/users/c0d45844e0fd48c29ba8d25fb8368c5e/roles/912ab5f10fa5477da74acf239f07604e` {{(pid=71938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 24 16:48:27.466797 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e82f403-f9bb-4f15-86b9-2703bda0e127 admin admin] RBAC: Authorizing `identity:create_grant(project_id=790523f1583543318dfff071b27f439f, user_id=c0d45844e0fd48c29ba8d25fb8368c5e, role_id=912ab5f10fa5477da74acf239f07604e)` {{(pid=71938) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:442}} Nov 24 16:48:27.498734 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be93a803-79e3-4d70-b39f-c575d7a704ac service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=71939) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:442}} Nov 24 16:48:27.512303 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e82f403-f9bb-4f15-86b9-2703bda0e127 admin admin] RBAC: Authorization granted {{(pid=71938) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 24 16:48:27.529573 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be93a803-79e3-4d70-b39f-c575d7a704ac service nova] RBAC: Authorization granted {{(pid=71939) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 24 16:48:27.540756 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: [pid: 71938|app: 0|req: 927/1866] 10.222.0.53 () {60 vars in 1473 bytes} [Wed Nov 24 16:48:27 2021] PUT /identity/v3/projects/790523f1583543318dfff071b27f439f/users/c0d45844e0fd48c29ba8d25fb8368c5e/roles/912ab5f10fa5477da74acf239f07604e => generated 0 bytes in 109 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 24 16:48:27.541970 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: [pid: 71939|app: 0|req: 940/1867] 10.222.0.53 () {60 vars in 1356 bytes} [Wed Nov 24 16:48:26 2021] GET /identity/v3/auth/tokens => generated 3700 bytes in 576 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 24 16:48:27.552597 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73afb36f-2622-47f9-a3f7-d32662ae8100 None None] REQUEST_METHOD: `POST` {{(pid=71938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 24 16:48:27.552947 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73afb36f-2622-47f9-a3f7-d32662ae8100 None None] SCRIPT_NAME: `/identity` {{(pid=71938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 24 16:48:27.553289 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73afb36f-2622-47f9-a3f7-d32662ae8100 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=71938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 24 16:48:27.634172 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.auth.core [None req-73afb36f-2622-47f9-a3f7-d32662ae8100 None None] MFA Rules not processed for user `c0d45844e0fd48c29ba8d25fb8368c5e`. Rule list: `[]` (Enabled: `True`). {{(pid=71938) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:442}} Nov 24 16:48:27.639199 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.fernet_utils [None req-73afb36f-2622-47f9-a3f7-d32662ae8100 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=71938) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:289}} Nov 24 16:48:27.771586 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: [pid: 71938|app: 0|req: 928/1868] 10.222.0.53 () {58 vars in 948 bytes} [Wed Nov 24 16:48:27 2021] POST /identity/v3/auth/tokens => generated 3737 bytes in 220 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 24 16:48:27.792173 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be93a803-79e3-4d70-b39f-c575d7a704ac service nova] Authenticating user token {{(pid=71939) process_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 24 16:48:27.793815 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.fernet_utils [None req-be93a803-79e3-4d70-b39f-c575d7a704ac service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=71939) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:289}} Nov 24 16:48:27.971109 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be93a803-79e3-4d70-b39f-c575d7a704ac service nova] Validating token access rules against request {{(pid=71939) validate_allowed_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 24 16:48:28.165202 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a7717b0-193b-4e61-9255-c623aec67e92 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a12374a3093a401a97c343ff0854184d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3b3940d4ae1c4177ae29c02377bb4b0b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=71939) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 24 16:48:28.166624 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a7717b0-193b-4e61-9255-c623aec67e92 service cinder] REQUEST_METHOD: `GET` {{(pid=71939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 24 16:48:28.167076 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a7717b0-193b-4e61-9255-c623aec67e92 service cinder] SCRIPT_NAME: `/identity` {{(pid=71939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 24 16:48:28.167422 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a7717b0-193b-4e61-9255-c623aec67e92 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=71939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 24 16:48:28.203171 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a7717b0-193b-4e61-9255-c623aec67e92 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=71939) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:442}} Nov 24 16:48:28.293704 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a7717b0-193b-4e61-9255-c623aec67e92 service cinder] RBAC: Authorization granted {{(pid=71939) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 24 16:48:28.315778 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: [pid: 71939|app: 0|req: 941/1869] 10.222.0.53 () {60 vars in 1356 bytes} [Wed Nov 24 16:48:27 2021] GET /identity/v3/auth/tokens => generated 3737 bytes in 524 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 24 16:48:28.699833 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-921dd1df-3fc6-4dcd-acea-2499f5b39077 None None] REQUEST_METHOD: `POST` {{(pid=71938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 24 16:48:28.700260 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-921dd1df-3fc6-4dcd-acea-2499f5b39077 None None] SCRIPT_NAME: `/identity` {{(pid=71938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 24 16:48:28.700468 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-921dd1df-3fc6-4dcd-acea-2499f5b39077 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=71938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 24 16:48:28.731851 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a7717b0-193b-4e61-9255-c623aec67e92 service cinder] Authenticating user token {{(pid=71939) process_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 24 16:48:28.733524 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.fernet_utils [None req-2a7717b0-193b-4e61-9255-c623aec67e92 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=71939) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:289}} Nov 24 16:48:28.785438 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.auth.core [None req-921dd1df-3fc6-4dcd-acea-2499f5b39077 None None] MFA Rules not processed for user `c90f21b9cdcb413282461fa83cb6b7a5`. Rule list: `[]` (Enabled: `True`). {{(pid=71938) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:442}} Nov 24 16:48:28.787026 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.fernet_utils [None req-921dd1df-3fc6-4dcd-acea-2499f5b39077 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=71938) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:289}} Nov 24 16:48:29.033041 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a7717b0-193b-4e61-9255-c623aec67e92 service cinder] Validating token access rules against request {{(pid=71939) validate_allowed_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 24 16:48:29.036868 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: [pid: 71938|app: 0|req: 929/1870] 10.222.0.21 () {58 vars in 1006 bytes} [Wed Nov 24 16:48:28 2021] POST /identity/v3/auth/tokens => generated 3551 bytes in 338 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 24 16:48:29.037887 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-921dd1df-3fc6-4dcd-acea-2499f5b39077 None None] Authenticating user token {{(pid=71938) process_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 24 16:48:29.055929 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e697d30-ad81-4493-abcd-78f3ba8b35a5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f2ba2e8375b4e8c8792ee1e22b60427', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '00a5583c7b7443e98e7a1d31a0b638dc', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=71939) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 24 16:48:29.057081 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e697d30-ad81-4493-abcd-78f3ba8b35a5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=71939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 24 16:48:29.057541 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e697d30-ad81-4493-abcd-78f3ba8b35a5 admin admin] SCRIPT_NAME: `/identity` {{(pid=71939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 24 16:48:29.057997 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e697d30-ad81-4493-abcd-78f3ba8b35a5 admin admin] PATH_INFO: `/v3/projects/ed8eac02328b436389d90948d7115488` {{(pid=71939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 24 16:48:29.064023 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e697d30-ad81-4493-abcd-78f3ba8b35a5 admin admin] RBAC: Authorizing `identity:delete_project(project_id=ed8eac02328b436389d90948d7115488)` {{(pid=71939) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:442}} Nov 24 16:48:29.074497 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-921dd1df-3fc6-4dcd-acea-2499f5b39077 None None] Validating token access rules against request {{(pid=71938) validate_allowed_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 24 16:48:29.083750 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b06b1ccb-348c-455d-8c70-4b9ef74288ee service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a12374a3093a401a97c343ff0854184d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3b3940d4ae1c4177ae29c02377bb4b0b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=71938) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 24 16:48:29.084433 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b06b1ccb-348c-455d-8c70-4b9ef74288ee service cinder] REQUEST_METHOD: `GET` {{(pid=71938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 24 16:48:29.084771 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b06b1ccb-348c-455d-8c70-4b9ef74288ee service cinder] SCRIPT_NAME: `/identity` {{(pid=71938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 24 16:48:29.085100 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b06b1ccb-348c-455d-8c70-4b9ef74288ee service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=71938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 24 16:48:29.117256 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.fernet_utils [None req-b06b1ccb-348c-455d-8c70-4b9ef74288ee service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=71938) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:289}} Nov 24 16:48:29.149774 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e697d30-ad81-4493-abcd-78f3ba8b35a5 admin admin] RBAC: Authorization granted {{(pid=71939) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 24 16:48:29.346857 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b06b1ccb-348c-455d-8c70-4b9ef74288ee service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=71938) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:442}} Nov 24 16:48:29.355783 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.notifications [None req-2e697d30-ad81-4493-abcd-78f3ba8b35a5 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ed8eac02328b436389d90948d7115488', 'request_id': 'req-2e697d30-ad81-4493-abcd-78f3ba8b35a5'} {{(pid=71939) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:357}} Nov 24 16:48:29.403142 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.notifications [None req-2e697d30-ad81-4493-abcd-78f3ba8b35a5 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ed8eac02328b436389d90948d7115488', 'request_id': 'req-2e697d30-ad81-4493-abcd-78f3ba8b35a5'} {{(pid=71939) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:357}} Nov 24 16:48:29.418695 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.notifications [None req-2e697d30-ad81-4493-abcd-78f3ba8b35a5 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ed8eac02328b436389d90948d7115488', 'request_id': 'req-2e697d30-ad81-4493-abcd-78f3ba8b35a5'} {{(pid=71939) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:357}} Nov 24 16:48:29.449134 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.notifications [None req-2e697d30-ad81-4493-abcd-78f3ba8b35a5 admin admin] The token cache is being invalidate because project ed8eac02328b436389d90948d7115488 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=71939) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Nov 24 16:48:29.455613 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.notifications [None req-2e697d30-ad81-4493-abcd-78f3ba8b35a5 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=71939) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:357}} Nov 24 16:48:29.458286 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.notifications [None req-2e697d30-ad81-4493-abcd-78f3ba8b35a5 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=71939) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:357}} Nov 24 16:48:29.466172 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: [pid: 71939|app: 0|req: 942/1871] 10.222.0.53 () {58 vars in 1223 bytes} [Wed Nov 24 16:48:28 2021] DELETE /identity/v3/projects/ed8eac02328b436389d90948d7115488 => generated 0 bytes in 735 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 24 16:48:29.469494 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6ba1df6-0076-476a-a680-7ffae2dd7201 None None] REQUEST_METHOD: `GET` {{(pid=71939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 24 16:48:29.473515 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6ba1df6-0076-476a-a680-7ffae2dd7201 None None] SCRIPT_NAME: `/identity` {{(pid=71939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 24 16:48:29.478667 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6ba1df6-0076-476a-a680-7ffae2dd7201 None None] PATH_INFO: `/` {{(pid=71939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 24 16:48:29.482096 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b06b1ccb-348c-455d-8c70-4b9ef74288ee service cinder] RBAC: Authorization granted {{(pid=71938) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 24 16:48:29.483753 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: [pid: 71939|app: 0|req: 943/1872] 10.222.0.53 () {54 vars in 901 bytes} [Wed Nov 24 16:48:29 2021] GET /identity => generated 270 bytes in 15 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 24 16:48:29.489541 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6ba1df6-0076-476a-a680-7ffae2dd7201 None None] Authenticating user token {{(pid=71939) process_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 24 16:48:29.499644 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.fernet_utils [None req-a6ba1df6-0076-476a-a680-7ffae2dd7201 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=71939) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:289}} Nov 24 16:48:29.536884 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: [pid: 71938|app: 0|req: 930/1873] 10.222.0.53 () {60 vars in 1356 bytes} [Wed Nov 24 16:48:29 2021] GET /identity/v3/auth/tokens => generated 3672 bytes in 499 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 24 16:48:29.538263 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13c05473-bc38-464e-a07a-7ca6392716dc None None] REQUEST_METHOD: `POST` {{(pid=71938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 24 16:48:29.538609 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13c05473-bc38-464e-a07a-7ca6392716dc None None] SCRIPT_NAME: `/identity` {{(pid=71938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 24 16:48:29.543694 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13c05473-bc38-464e-a07a-7ca6392716dc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=71938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 24 16:48:29.619482 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.auth.core [None req-13c05473-bc38-464e-a07a-7ca6392716dc None None] MFA Rules not processed for user `0f2ba2e8375b4e8c8792ee1e22b60427`. Rule list: `[]` (Enabled: `True`). {{(pid=71938) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:442}} Nov 24 16:48:29.626169 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.fernet_utils [None req-13c05473-bc38-464e-a07a-7ca6392716dc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=71938) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:289}} Nov 24 16:48:29.783882 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: [pid: 71938|app: 0|req: 931/1874] 10.222.0.53 () {58 vars in 948 bytes} [Wed Nov 24 16:48:29 2021] POST /identity/v3/auth/tokens => generated 3669 bytes in 246 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 24 16:48:29.790209 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6ba1df6-0076-476a-a680-7ffae2dd7201 None None] Validating token access rules against request {{(pid=71939) validate_allowed_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 24 16:48:29.793201 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb336ac2-ad08-45d8-b3bc-03c1bc6fbf3b None None] REQUEST_METHOD: `POST` {{(pid=71938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 24 16:48:29.793634 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb336ac2-ad08-45d8-b3bc-03c1bc6fbf3b None None] SCRIPT_NAME: `/identity` {{(pid=71938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 24 16:48:29.793985 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb336ac2-ad08-45d8-b3bc-03c1bc6fbf3b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=71938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 24 16:48:29.805221 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d7e0eef-e45f-404b-8852-0b9b52284f48 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c90f21b9cdcb413282461fa83cb6b7a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3b3940d4ae1c4177ae29c02377bb4b0b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=71939) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 24 16:48:29.806307 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d7e0eef-e45f-404b-8852-0b9b52284f48 service neutron] REQUEST_METHOD: `GET` {{(pid=71939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 24 16:48:29.806851 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d7e0eef-e45f-404b-8852-0b9b52284f48 service neutron] SCRIPT_NAME: `/identity` {{(pid=71939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 24 16:48:29.807696 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d7e0eef-e45f-404b-8852-0b9b52284f48 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=71939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 24 16:48:29.812117 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.fernet_utils [None req-7d7e0eef-e45f-404b-8852-0b9b52284f48 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=71939) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:289}} Nov 24 16:48:29.856397 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d7e0eef-e45f-404b-8852-0b9b52284f48 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=71939) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:442}} Nov 24 16:48:29.869669 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.auth.core [None req-fb336ac2-ad08-45d8-b3bc-03c1bc6fbf3b None None] MFA Rules not processed for user `c90f21b9cdcb413282461fa83cb6b7a5`. Rule list: `[]` (Enabled: `True`). {{(pid=71938) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:442}} Nov 24 16:48:29.875012 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.fernet_utils [None req-fb336ac2-ad08-45d8-b3bc-03c1bc6fbf3b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=71938) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:289}} Nov 24 16:48:29.890651 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: [pid: 71938|app: 0|req: 932/1875] 10.222.0.53 () {58 vars in 999 bytes} [Wed Nov 24 16:48:29 2021] POST /identity/v3/auth/tokens => generated 3551 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 24 16:48:29.891814 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29dfe48a-740f-404d-a1a9-217c97b93691 None None] REQUEST_METHOD: `POST` {{(pid=71938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 24 16:48:29.894867 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29dfe48a-740f-404d-a1a9-217c97b93691 None None] SCRIPT_NAME: `/identity` {{(pid=71938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 24 16:48:29.895220 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29dfe48a-740f-404d-a1a9-217c97b93691 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=71938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 24 16:48:29.949330 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.auth.core [None req-29dfe48a-740f-404d-a1a9-217c97b93691 None None] MFA Rules not processed for user `0f2ba2e8375b4e8c8792ee1e22b60427`. Rule list: `[]` (Enabled: `True`). {{(pid=71938) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:442}} Nov 24 16:48:29.950826 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.fernet_utils [None req-29dfe48a-740f-404d-a1a9-217c97b93691 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=71938) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:289}} Nov 24 16:48:29.965395 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d7e0eef-e45f-404b-8852-0b9b52284f48 service neutron] RBAC: Authorization granted {{(pid=71939) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 24 16:48:29.978958 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: [pid: 71938|app: 0|req: 933/1876] 10.222.0.53 () {58 vars in 948 bytes} [Wed Nov 24 16:48:29 2021] POST /identity/v3/auth/tokens => generated 3669 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 24 16:48:29.982910 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29dfe48a-740f-404d-a1a9-217c97b93691 None None] Authenticating user token {{(pid=71938) process_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 24 16:48:30.005855 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29dfe48a-740f-404d-a1a9-217c97b93691 None None] Validating token access rules against request {{(pid=71938) validate_allowed_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 24 16:48:30.010443 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: [pid: 71939|app: 0|req: 944/1877] 10.222.0.53 () {60 vars in 1356 bytes} [Wed Nov 24 16:48:29 2021] GET /identity/v3/auth/tokens => generated 3551 bytes in 526 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 24 16:48:30.020132 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66357cad-fdcd-49c1-95b7-f18ba98c6af8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f2ba2e8375b4e8c8792ee1e22b60427', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '00a5583c7b7443e98e7a1d31a0b638dc', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=71938) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 24 16:48:30.020833 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66357cad-fdcd-49c1-95b7-f18ba98c6af8 admin admin] REQUEST_METHOD: `GET` {{(pid=71938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 24 16:48:30.023823 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66357cad-fdcd-49c1-95b7-f18ba98c6af8 admin admin] SCRIPT_NAME: `/identity` {{(pid=71938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 24 16:48:30.024177 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66357cad-fdcd-49c1-95b7-f18ba98c6af8 admin admin] PATH_INFO: `/v3/domains` {{(pid=71938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 24 16:48:30.025002 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66357cad-fdcd-49c1-95b7-f18ba98c6af8 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=71938) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:161}} Nov 24 16:48:30.025368 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66357cad-fdcd-49c1-95b7-f18ba98c6af8 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=71938) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:442}} Nov 24 16:48:30.095813 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66357cad-fdcd-49c1-95b7-f18ba98c6af8 admin admin] RBAC: Authorization granted {{(pid=71938) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 24 16:48:30.154381 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d7e0eef-e45f-404b-8852-0b9b52284f48 service neutron] Authenticating user token {{(pid=71939) process_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 24 16:48:30.157436 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: [pid: 71938|app: 0|req: 934/1878] 10.222.0.53 () {58 vars in 1143 bytes} [Wed Nov 24 16:48:29 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 24 16:48:30.187057 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d7e0eef-e45f-404b-8852-0b9b52284f48 service neutron] Validating token access rules against request {{(pid=71939) validate_allowed_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 24 16:48:30.207532 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23479095-8a85-4d25-99cd-b89639df0dda admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f2ba2e8375b4e8c8792ee1e22b60427', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '00a5583c7b7443e98e7a1d31a0b638dc', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=71939) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 24 16:48:30.208436 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23479095-8a85-4d25-99cd-b89639df0dda admin admin] REQUEST_METHOD: `POST` {{(pid=71939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 24 16:48:30.208928 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23479095-8a85-4d25-99cd-b89639df0dda admin admin] SCRIPT_NAME: `/identity` {{(pid=71939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 24 16:48:30.209432 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23479095-8a85-4d25-99cd-b89639df0dda admin admin] PATH_INFO: `/v3/projects` {{(pid=71939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 24 16:48:30.210367 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23479095-8a85-4d25-99cd-b89639df0dda admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=71939) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:442}} Nov 24 16:48:30.316343 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23479095-8a85-4d25-99cd-b89639df0dda admin admin] RBAC: Authorization granted {{(pid=71939) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 24 16:48:30.359975 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66357cad-fdcd-49c1-95b7-f18ba98c6af8 admin admin] Authenticating user token {{(pid=71938) process_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 24 16:48:30.373162 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66357cad-fdcd-49c1-95b7-f18ba98c6af8 admin admin] Validating token access rules against request {{(pid=71938) validate_allowed_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 24 16:48:30.390609 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e08c9f3-d8fb-4aee-8230-f65457e1c637 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c90f21b9cdcb413282461fa83cb6b7a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3b3940d4ae1c4177ae29c02377bb4b0b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=71938) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 24 16:48:30.392932 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e08c9f3-d8fb-4aee-8230-f65457e1c637 service neutron] REQUEST_METHOD: `GET` {{(pid=71938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 24 16:48:30.393283 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e08c9f3-d8fb-4aee-8230-f65457e1c637 service neutron] SCRIPT_NAME: `/identity` {{(pid=71938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 24 16:48:30.393624 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e08c9f3-d8fb-4aee-8230-f65457e1c637 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=71938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 24 16:48:30.412277 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: [pid: 71939|app: 0|req: 945/1879] 10.222.0.53 () {60 vars in 1143 bytes} [Wed Nov 24 16:48:30 2021] POST /identity/v3/projects => generated 365 bytes in 258 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 24 16:48:30.416799 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23479095-8a85-4d25-99cd-b89639df0dda admin admin] Authenticating user token {{(pid=71939) process_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 24 16:48:30.429394 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e08c9f3-d8fb-4aee-8230-f65457e1c637 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=71938) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:442}} Nov 24 16:48:30.536624 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e08c9f3-d8fb-4aee-8230-f65457e1c637 service neutron] RBAC: Authorization granted {{(pid=71938) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 24 16:48:30.579136 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: [pid: 71938|app: 0|req: 935/1880] 10.222.0.53 () {60 vars in 1356 bytes} [Wed Nov 24 16:48:30 2021] GET /identity/v3/auth/tokens => generated 3551 bytes in 220 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 24 16:48:30.621954 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23479095-8a85-4d25-99cd-b89639df0dda admin admin] Validating token access rules against request {{(pid=71939) validate_allowed_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 24 16:48:30.643289 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f5aa1e0-12ac-4b31-807f-2c108f88eb09 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f2ba2e8375b4e8c8792ee1e22b60427', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '00a5583c7b7443e98e7a1d31a0b638dc', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=71939) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 24 16:48:30.644003 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f5aa1e0-12ac-4b31-807f-2c108f88eb09 admin admin] REQUEST_METHOD: `POST` {{(pid=71939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 24 16:48:30.644373 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f5aa1e0-12ac-4b31-807f-2c108f88eb09 admin admin] SCRIPT_NAME: `/identity` {{(pid=71939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 24 16:48:30.644780 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f5aa1e0-12ac-4b31-807f-2c108f88eb09 admin admin] PATH_INFO: `/v3/users` {{(pid=71939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 24 16:48:30.645666 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f5aa1e0-12ac-4b31-807f-2c108f88eb09 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=71939) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:442}} Nov 24 16:48:30.681281 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f5aa1e0-12ac-4b31-807f-2c108f88eb09 admin admin] RBAC: Authorization granted {{(pid=71939) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 24 16:48:30.733730 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: [pid: 71939|app: 0|req: 946/1881] 10.222.0.53 () {60 vars in 1134 bytes} [Wed Nov 24 16:48:30 2021] POST /identity/v3/users => generated 283 bytes in 317 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 24 16:48:30.737966 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e08c9f3-d8fb-4aee-8230-f65457e1c637 service neutron] Authenticating user token {{(pid=71938) process_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 24 16:48:30.772713 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e08c9f3-d8fb-4aee-8230-f65457e1c637 service neutron] Validating token access rules against request {{(pid=71938) validate_allowed_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 24 16:48:30.784634 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c3f261b-d7bb-4267-8fac-233ae5e0f856 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f2ba2e8375b4e8c8792ee1e22b60427', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '00a5583c7b7443e98e7a1d31a0b638dc', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=71938) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 24 16:48:30.789460 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c3f261b-d7bb-4267-8fac-233ae5e0f856 admin admin] REQUEST_METHOD: `GET` {{(pid=71938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 24 16:48:30.790694 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c3f261b-d7bb-4267-8fac-233ae5e0f856 admin admin] SCRIPT_NAME: `/identity` {{(pid=71938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 24 16:48:30.791847 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c3f261b-d7bb-4267-8fac-233ae5e0f856 admin admin] PATH_INFO: `/v3/roles` {{(pid=71938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 24 16:48:30.793452 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c3f261b-d7bb-4267-8fac-233ae5e0f856 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=71938) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:442}} Nov 24 16:48:30.880560 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c3f261b-d7bb-4267-8fac-233ae5e0f856 admin admin] RBAC: Authorization granted {{(pid=71938) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 24 16:48:30.914854 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: [pid: 71938|app: 0|req: 936/1882] 10.222.0.53 () {58 vars in 1112 bytes} [Wed Nov 24 16:48:30 2021] GET /identity/v3/roles => generated 1420 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 24 16:48:30.919422 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f5aa1e0-12ac-4b31-807f-2c108f88eb09 admin admin] Authenticating user token {{(pid=71939) process_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 24 16:48:30.939209 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f5aa1e0-12ac-4b31-807f-2c108f88eb09 admin admin] Validating token access rules against request {{(pid=71939) validate_allowed_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 24 16:48:30.966367 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19de26ca-8115-4ee3-a894-6986c0b343a8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f2ba2e8375b4e8c8792ee1e22b60427', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '00a5583c7b7443e98e7a1d31a0b638dc', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=71939) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 24 16:48:30.967561 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19de26ca-8115-4ee3-a894-6986c0b343a8 admin admin] REQUEST_METHOD: `PUT` {{(pid=71939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 24 16:48:30.968015 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19de26ca-8115-4ee3-a894-6986c0b343a8 admin admin] SCRIPT_NAME: `/identity` {{(pid=71939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 24 16:48:30.968692 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19de26ca-8115-4ee3-a894-6986c0b343a8 admin admin] PATH_INFO: `/v3/projects/27ee41b6e9e04cf8a39f6dd5bc920ffd/users/086ef1bfab074910b0a218c54431fefd/roles/912ab5f10fa5477da74acf239f07604e` {{(pid=71939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 24 16:48:31.289053 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19de26ca-8115-4ee3-a894-6986c0b343a8 admin admin] RBAC: Authorizing `identity:create_grant(project_id=27ee41b6e9e04cf8a39f6dd5bc920ffd, user_id=086ef1bfab074910b0a218c54431fefd, role_id=912ab5f10fa5477da74acf239f07604e)` {{(pid=71939) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:442}} Nov 24 16:48:31.369602 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19de26ca-8115-4ee3-a894-6986c0b343a8 admin admin] RBAC: Authorization granted {{(pid=71939) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 24 16:48:31.399500 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: [pid: 71939|app: 0|req: 947/1883] 10.222.0.53 () {60 vars in 1473 bytes} [Wed Nov 24 16:48:30 2021] PUT /identity/v3/projects/27ee41b6e9e04cf8a39f6dd5bc920ffd/users/086ef1bfab074910b0a218c54431fefd/roles/912ab5f10fa5477da74acf239f07604e => generated 0 bytes in 481 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 24 16:48:31.412034 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc50b73f-635f-433b-9760-b02f9c753020 None None] REQUEST_METHOD: `POST` {{(pid=71938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 24 16:48:31.412404 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc50b73f-635f-433b-9760-b02f9c753020 None None] SCRIPT_NAME: `/identity` {{(pid=71938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 24 16:48:31.412720 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc50b73f-635f-433b-9760-b02f9c753020 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=71938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 24 16:48:31.517183 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.auth.core [None req-dc50b73f-635f-433b-9760-b02f9c753020 None None] MFA Rules not processed for user `086ef1bfab074910b0a218c54431fefd`. Rule list: `[]` (Enabled: `True`). {{(pid=71938) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:442}} Nov 24 16:48:31.518633 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.fernet_utils [None req-dc50b73f-635f-433b-9760-b02f9c753020 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=71938) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:289}} Nov 24 16:48:31.850946 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: [pid: 71938|app: 0|req: 937/1884] 10.222.0.53 () {58 vars in 948 bytes} [Wed Nov 24 16:48:31 2021] POST /identity/v3/auth/tokens => generated 3672 bytes in 440 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 24 16:48:31.890951 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19de26ca-8115-4ee3-a894-6986c0b343a8 admin admin] Authenticating user token {{(pid=71939) process_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 24 16:48:31.894012 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.fernet_utils [None req-19de26ca-8115-4ee3-a894-6986c0b343a8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=71939) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:289}} Nov 24 16:48:32.155499 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19de26ca-8115-4ee3-a894-6986c0b343a8 admin admin] Validating token access rules against request {{(pid=71939) validate_allowed_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 24 16:48:32.178832 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a28753c-bed1-45f2-94c2-7a2ba3ef103c service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a12374a3093a401a97c343ff0854184d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3b3940d4ae1c4177ae29c02377bb4b0b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=71939) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 24 16:48:32.180403 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a28753c-bed1-45f2-94c2-7a2ba3ef103c service cinder] REQUEST_METHOD: `GET` {{(pid=71939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 24 16:48:32.180812 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a28753c-bed1-45f2-94c2-7a2ba3ef103c service cinder] SCRIPT_NAME: `/identity` {{(pid=71939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 24 16:48:32.181151 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a28753c-bed1-45f2-94c2-7a2ba3ef103c service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=71939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 24 16:48:32.208702 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a28753c-bed1-45f2-94c2-7a2ba3ef103c service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=71939) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:442}} Nov 24 16:48:32.316571 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a28753c-bed1-45f2-94c2-7a2ba3ef103c service cinder] RBAC: Authorization granted {{(pid=71939) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 24 16:48:32.422461 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: [pid: 71939|app: 0|req: 948/1885] 10.222.0.53 () {60 vars in 1356 bytes} [Wed Nov 24 16:48:31 2021] GET /identity/v3/auth/tokens => generated 3672 bytes in 532 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 24 16:48:33.380244 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b55ad2ec-d2ec-4ffc-aef7-6c2bd41fd3f8 None None] REQUEST_METHOD: `POST` {{(pid=71938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 24 16:48:33.381285 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b55ad2ec-d2ec-4ffc-aef7-6c2bd41fd3f8 None None] SCRIPT_NAME: `/identity` {{(pid=71938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 24 16:48:33.382571 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b55ad2ec-d2ec-4ffc-aef7-6c2bd41fd3f8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=71938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 24 16:48:33.484244 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.auth.core [None req-b55ad2ec-d2ec-4ffc-aef7-6c2bd41fd3f8 None None] MFA Rules not processed for user `b3526b1ee2664fb9a004a17eedce9868`. Rule list: `[]` (Enabled: `True`). {{(pid=71938) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:442}} Nov 24 16:48:33.485979 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.fernet_utils [None req-b55ad2ec-d2ec-4ffc-aef7-6c2bd41fd3f8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=71938) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:289}} Nov 24 16:48:33.850058 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: [pid: 71938|app: 0|req: 938/1886] 10.222.0.53 () {58 vars in 948 bytes} [Wed Nov 24 16:48:33 2021] POST /identity/v3/auth/tokens => generated 3682 bytes in 471 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 24 16:48:34.334366 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a42e4132-cf74-4a9b-aabe-ecdecbf93ee3 None None] REQUEST_METHOD: `POST` {{(pid=71939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 24 16:48:34.334934 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a42e4132-cf74-4a9b-aabe-ecdecbf93ee3 None None] SCRIPT_NAME: `/identity` {{(pid=71939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 24 16:48:34.335415 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a42e4132-cf74-4a9b-aabe-ecdecbf93ee3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=71939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 24 16:48:34.391629 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b55ad2ec-d2ec-4ffc-aef7-6c2bd41fd3f8 None None] Authenticating user token {{(pid=71938) process_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 24 16:48:34.394681 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.fernet_utils [None req-b55ad2ec-d2ec-4ffc-aef7-6c2bd41fd3f8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=71938) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:289}} Nov 24 16:48:34.508606 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.auth.core [None req-a42e4132-cf74-4a9b-aabe-ecdecbf93ee3 None None] MFA Rules not processed for user `5e2f5fe0a70c48dfa7bfaff9973b6e62`. Rule list: `[]` (Enabled: `True`). {{(pid=71939) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:442}} Nov 24 16:48:34.514216 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.fernet_utils [None req-a42e4132-cf74-4a9b-aabe-ecdecbf93ee3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=71939) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:289}} Nov 24 16:48:34.650603 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b55ad2ec-d2ec-4ffc-aef7-6c2bd41fd3f8 None None] Validating token access rules against request {{(pid=71938) validate_allowed_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 24 16:48:34.674810 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d089532-f49d-4903-b44a-f12e05beff59 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e196802d4d5432482b6d2eabc25f74e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3b3940d4ae1c4177ae29c02377bb4b0b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'service', 'ResellerAdmin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=71938) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 24 16:48:34.675501 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d089532-f49d-4903-b44a-f12e05beff59 service nova] REQUEST_METHOD: `GET` {{(pid=71938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 24 16:48:34.675844 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d089532-f49d-4903-b44a-f12e05beff59 service nova] SCRIPT_NAME: `/identity` {{(pid=71938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 24 16:48:34.676178 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d089532-f49d-4903-b44a-f12e05beff59 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=71938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 24 16:48:34.707660 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d089532-f49d-4903-b44a-f12e05beff59 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=71938) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:442}} Nov 24 16:48:34.766011 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: [pid: 71939|app: 0|req: 949/1887] 10.222.0.53 () {58 vars in 948 bytes} [Wed Nov 24 16:48:34 2021] POST /identity/v3/auth/tokens => generated 3692 bytes in 433 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 24 16:48:34.777833 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16570297-097d-4cff-bd72-825c279c0c45 None None] REQUEST_METHOD: `POST` {{(pid=71939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 24 16:48:34.778446 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16570297-097d-4cff-bd72-825c279c0c45 None None] SCRIPT_NAME: `/identity` {{(pid=71939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 24 16:48:34.778959 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16570297-097d-4cff-bd72-825c279c0c45 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=71939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 24 16:48:34.779266 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d089532-f49d-4903-b44a-f12e05beff59 service nova] RBAC: Authorization granted {{(pid=71938) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 24 16:48:34.795387 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: [pid: 71938|app: 0|req: 939/1888] 10.222.0.53 () {60 vars in 1356 bytes} [Wed Nov 24 16:48:34 2021] GET /identity/v3/auth/tokens => generated 3682 bytes in 405 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 24 16:48:34.874703 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.auth.core [None req-16570297-097d-4cff-bd72-825c279c0c45 None None] MFA Rules not processed for user `1e837ea3812449029236efda9a2d6448`. Rule list: `[]` (Enabled: `True`). {{(pid=71939) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:442}} Nov 24 16:48:34.875856 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.fernet_utils [None req-16570297-097d-4cff-bd72-825c279c0c45 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=71939) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:289}} Nov 24 16:48:35.067939 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: [pid: 71939|app: 0|req: 950/1889] 10.222.0.53 () {58 vars in 948 bytes} [Wed Nov 24 16:48:34 2021] POST /identity/v3/auth/tokens => generated 3700 bytes in 297 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 24 16:48:35.369285 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d089532-f49d-4903-b44a-f12e05beff59 service nova] Authenticating user token {{(pid=71938) process_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 24 16:48:35.403592 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d089532-f49d-4903-b44a-f12e05beff59 service nova] Validating token access rules against request {{(pid=71938) validate_allowed_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 24 16:48:35.431443 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed0e3493-5ec8-44eb-bff8-19649e015e30 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e196802d4d5432482b6d2eabc25f74e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3b3940d4ae1c4177ae29c02377bb4b0b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'service', 'ResellerAdmin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=71938) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 24 16:48:35.432177 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed0e3493-5ec8-44eb-bff8-19649e015e30 service nova] REQUEST_METHOD: `GET` {{(pid=71938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 24 16:48:35.432524 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed0e3493-5ec8-44eb-bff8-19649e015e30 service nova] SCRIPT_NAME: `/identity` {{(pid=71938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 24 16:48:35.432872 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed0e3493-5ec8-44eb-bff8-19649e015e30 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=71938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 24 16:48:35.478143 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed0e3493-5ec8-44eb-bff8-19649e015e30 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=71938) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:442}} Nov 24 16:48:35.605367 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed0e3493-5ec8-44eb-bff8-19649e015e30 service nova] RBAC: Authorization granted {{(pid=71938) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 24 16:48:35.653282 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: [pid: 71938|app: 0|req: 940/1890] 10.222.0.53 () {60 vars in 1356 bytes} [Wed Nov 24 16:48:35 2021] GET /identity/v3/auth/tokens => generated 3692 bytes in 285 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 24 16:48:35.915500 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d1f1009-adeb-4ce9-b68a-98feb97b7f77 None None] REQUEST_METHOD: `GET` {{(pid=71939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 24 16:48:35.915500 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d1f1009-adeb-4ce9-b68a-98feb97b7f77 None None] SCRIPT_NAME: `/identity` {{(pid=71939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 24 16:48:35.915500 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d1f1009-adeb-4ce9-b68a-98feb97b7f77 None None] PATH_INFO: `/` {{(pid=71939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 24 16:48:35.915843 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: [pid: 71939|app: 0|req: 951/1891] 10.222.0.53 () {54 vars in 910 bytes} [Wed Nov 24 16:48:35 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 24 16:48:35.928237 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7520655e-be61-414d-ab20-964bdf437e38 None None] REQUEST_METHOD: `POST` {{(pid=71938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 24 16:48:35.928713 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7520655e-be61-414d-ab20-964bdf437e38 None None] SCRIPT_NAME: `/identity` {{(pid=71938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 24 16:48:35.929065 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7520655e-be61-414d-ab20-964bdf437e38 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=71938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 24 16:48:36.025317 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.auth.core [None req-7520655e-be61-414d-ab20-964bdf437e38 None None] MFA Rules not processed for user `3e196802d4d5432482b6d2eabc25f74e`. Rule list: `[]` (Enabled: `True`). {{(pid=71938) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:442}} Nov 24 16:48:36.026819 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.fernet_utils [None req-7520655e-be61-414d-ab20-964bdf437e38 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=71938) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:289}} Nov 24 16:48:36.069071 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: [pid: 71938|app: 0|req: 941/1892] 10.222.0.53 () {58 vars in 1008 bytes} [Wed Nov 24 16:48:35 2021] POST /identity/v3/auth/tokens => generated 3802 bytes in 143 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 24 16:48:36.984824 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d1f1009-adeb-4ce9-b68a-98feb97b7f77 None None] Authenticating user token {{(pid=71939) process_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 24 16:48:37.023696 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d1f1009-adeb-4ce9-b68a-98feb97b7f77 None None] Validating token access rules against request {{(pid=71939) validate_allowed_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 24 16:48:37.057149 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c65af51d-d6bb-4cbb-87ee-8883bd95d170 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e196802d4d5432482b6d2eabc25f74e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3b3940d4ae1c4177ae29c02377bb4b0b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'service', 'ResellerAdmin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=71939) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 24 16:48:37.059472 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c65af51d-d6bb-4cbb-87ee-8883bd95d170 service nova] REQUEST_METHOD: `GET` {{(pid=71939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 24 16:48:37.062795 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c65af51d-d6bb-4cbb-87ee-8883bd95d170 service nova] SCRIPT_NAME: `/identity` {{(pid=71939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 24 16:48:37.063425 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c65af51d-d6bb-4cbb-87ee-8883bd95d170 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=71939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 24 16:48:37.097395 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c65af51d-d6bb-4cbb-87ee-8883bd95d170 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=71939) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:442}} Nov 24 16:48:37.227034 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c65af51d-d6bb-4cbb-87ee-8883bd95d170 service nova] RBAC: Authorization granted {{(pid=71939) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 24 16:48:37.275966 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: [pid: 71939|app: 0|req: 952/1893] 10.222.0.53 () {60 vars in 1356 bytes} [Wed Nov 24 16:48:36 2021] GET /identity/v3/auth/tokens => generated 3802 bytes in 292 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 24 16:48:44.579408 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-192cc796-a3d8-461f-9854-2100ebadbbd4 None None] REQUEST_METHOD: `POST` {{(pid=71938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 24 16:48:44.579916 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-192cc796-a3d8-461f-9854-2100ebadbbd4 None None] SCRIPT_NAME: `/identity` {{(pid=71938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 24 16:48:44.580115 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-192cc796-a3d8-461f-9854-2100ebadbbd4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=71938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 24 16:48:44.604687 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.auth.core [None req-192cc796-a3d8-461f-9854-2100ebadbbd4 None None] MFA Rules not processed for user `b3526b1ee2664fb9a004a17eedce9868`. Rule list: `[]` (Enabled: `True`). {{(pid=71938) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:442}} Nov 24 16:48:44.605839 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.fernet_utils [None req-192cc796-a3d8-461f-9854-2100ebadbbd4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=71938) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:289}} Nov 24 16:48:44.618546 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: [pid: 71938|app: 0|req: 942/1894] 10.222.0.53 () {58 vars in 948 bytes} [Wed Nov 24 16:48:44 2021] POST /identity/v3/auth/tokens => generated 3682 bytes in 40 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 24 16:48:45.806708 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02d93b9e-ef17-48be-a846-15f4597e8e85 None None] REQUEST_METHOD: `POST` {{(pid=71939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 24 16:48:45.808328 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02d93b9e-ef17-48be-a846-15f4597e8e85 None None] SCRIPT_NAME: `/identity` {{(pid=71939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 24 16:48:45.808847 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02d93b9e-ef17-48be-a846-15f4597e8e85 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=71939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 24 16:48:45.851320 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.auth.core [None req-02d93b9e-ef17-48be-a846-15f4597e8e85 None None] MFA Rules not processed for user `5e2f5fe0a70c48dfa7bfaff9973b6e62`. Rule list: `[]` (Enabled: `True`). {{(pid=71939) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:442}} Nov 24 16:48:45.856410 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.fernet_utils [None req-02d93b9e-ef17-48be-a846-15f4597e8e85 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=71939) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:289}} Nov 24 16:48:45.879965 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: [pid: 71939|app: 0|req: 953/1895] 10.222.0.53 () {58 vars in 948 bytes} [Wed Nov 24 16:48:45 2021] POST /identity/v3/auth/tokens => generated 3692 bytes in 74 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 24 16:48:47.268034 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3783b3a0-82ea-4795-8e8b-6726968e380f None None] REQUEST_METHOD: `GET` {{(pid=71938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 24 16:48:47.268977 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3783b3a0-82ea-4795-8e8b-6726968e380f None None] SCRIPT_NAME: `/identity` {{(pid=71938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 24 16:48:47.269466 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3783b3a0-82ea-4795-8e8b-6726968e380f None None] PATH_INFO: `/` {{(pid=71938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 24 16:48:47.271936 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: [pid: 71938|app: 0|req: 943/1896] 10.222.0.53 () {54 vars in 910 bytes} [Wed Nov 24 16:48:47 2021] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 24 16:48:47.394701 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3a8ef45-ed82-41f8-b41f-31e4318ccc8b None None] REQUEST_METHOD: `POST` {{(pid=71939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 24 16:48:47.398726 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3a8ef45-ed82-41f8-b41f-31e4318ccc8b None None] SCRIPT_NAME: `/identity` {{(pid=71939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 24 16:48:47.399263 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3a8ef45-ed82-41f8-b41f-31e4318ccc8b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=71939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 24 16:48:47.435876 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.auth.core [None req-c3a8ef45-ed82-41f8-b41f-31e4318ccc8b None None] MFA Rules not processed for user `3e196802d4d5432482b6d2eabc25f74e`. Rule list: `[]` (Enabled: `True`). {{(pid=71939) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:442}} Nov 24 16:48:47.437510 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.fernet_utils [None req-c3a8ef45-ed82-41f8-b41f-31e4318ccc8b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=71939) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:289}} Nov 24 16:48:47.450620 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: [pid: 71939|app: 0|req: 954/1897] 10.222.0.53 () {58 vars in 1008 bytes} [Wed Nov 24 16:48:47 2021] POST /identity/v3/auth/tokens => generated 3802 bytes in 57 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 24 16:48:47.874091 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3783b3a0-82ea-4795-8e8b-6726968e380f None None] Authenticating user token {{(pid=71938) process_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 24 16:48:47.875995 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.fernet_utils [None req-3783b3a0-82ea-4795-8e8b-6726968e380f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=71938) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:289}} Nov 24 16:48:48.102855 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3783b3a0-82ea-4795-8e8b-6726968e380f None None] Validating token access rules against request {{(pid=71938) validate_allowed_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 24 16:48:48.115544 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf85449d-3e14-4d5c-9344-a0f03bd1177a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f2ba2e8375b4e8c8792ee1e22b60427', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '00a5583c7b7443e98e7a1d31a0b638dc', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=71938) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 24 16:48:48.117718 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf85449d-3e14-4d5c-9344-a0f03bd1177a admin admin] REQUEST_METHOD: `DELETE` {{(pid=71938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 24 16:48:48.118296 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf85449d-3e14-4d5c-9344-a0f03bd1177a admin admin] SCRIPT_NAME: `/identity` {{(pid=71938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 24 16:48:48.118786 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf85449d-3e14-4d5c-9344-a0f03bd1177a admin admin] PATH_INFO: `/v3/users/d359ab80375b47d6bffe721f23a9de94` {{(pid=71938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 24 16:48:48.121637 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf85449d-3e14-4d5c-9344-a0f03bd1177a admin admin] RBAC: Authorizing `identity:delete_user(user_id=d359ab80375b47d6bffe721f23a9de94)` {{(pid=71938) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:442}} Nov 24 16:48:48.166369 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf85449d-3e14-4d5c-9344-a0f03bd1177a admin admin] RBAC: Authorization granted {{(pid=71938) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 24 16:48:48.244645 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.notifications [None req-cf85449d-3e14-4d5c-9344-a0f03bd1177a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd359ab80375b47d6bffe721f23a9de94'} {{(pid=71938) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:357}} Nov 24 16:48:48.260038 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.notifications [None req-cf85449d-3e14-4d5c-9344-a0f03bd1177a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd359ab80375b47d6bffe721f23a9de94'} {{(pid=71938) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:357}} Nov 24 16:48:48.261167 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.notifications [None req-cf85449d-3e14-4d5c-9344-a0f03bd1177a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd359ab80375b47d6bffe721f23a9de94'} {{(pid=71938) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:357}} Nov 24 16:48:48.270044 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.notifications [None req-cf85449d-3e14-4d5c-9344-a0f03bd1177a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd359ab80375b47d6bffe721f23a9de94'} {{(pid=71938) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:357}} Nov 24 16:48:48.277050 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.notifications [None req-cf85449d-3e14-4d5c-9344-a0f03bd1177a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd359ab80375b47d6bffe721f23a9de94'} {{(pid=71938) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:357}} Nov 24 16:48:48.283689 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: [pid: 71938|app: 0|req: 944/1898] 10.222.0.53 () {58 vars in 1214 bytes} [Wed Nov 24 16:48:47 2021] DELETE /identity/v3/users/d359ab80375b47d6bffe721f23a9de94 => generated 0 bytes in 411 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 24 16:48:48.288929 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de7b3750-c7d1-4a5b-a73a-b3c428d31905 None None] REQUEST_METHOD: `POST` {{(pid=71939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 24 16:48:48.289464 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de7b3750-c7d1-4a5b-a73a-b3c428d31905 None None] SCRIPT_NAME: `/identity` {{(pid=71939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 24 16:48:48.289944 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de7b3750-c7d1-4a5b-a73a-b3c428d31905 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=71939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 24 16:48:48.322392 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.auth.core [None req-de7b3750-c7d1-4a5b-a73a-b3c428d31905 None None] MFA Rules not processed for user `0f2ba2e8375b4e8c8792ee1e22b60427`. Rule list: `[]` (Enabled: `True`). {{(pid=71939) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:442}} Nov 24 16:48:48.323902 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.fernet_utils [None req-de7b3750-c7d1-4a5b-a73a-b3c428d31905 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=71939) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:289}} Nov 24 16:48:48.408964 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: [pid: 71939|app: 0|req: 955/1899] 10.222.0.53 () {58 vars in 948 bytes} [Wed Nov 24 16:48:48 2021] POST /identity/v3/auth/tokens => generated 3669 bytes in 121 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 24 16:48:48.421018 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf85449d-3e14-4d5c-9344-a0f03bd1177a admin admin] Authenticating user token {{(pid=71938) process_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 24 16:48:48.422634 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.fernet_utils [None req-cf85449d-3e14-4d5c-9344-a0f03bd1177a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=71938) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:289}} Nov 24 16:48:48.549716 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf85449d-3e14-4d5c-9344-a0f03bd1177a admin admin] Validating token access rules against request {{(pid=71938) validate_allowed_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 24 16:48:48.574315 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cc377ad-543d-40df-a6a8-421404a9d212 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c90f21b9cdcb413282461fa83cb6b7a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3b3940d4ae1c4177ae29c02377bb4b0b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=71938) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 24 16:48:48.575223 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cc377ad-543d-40df-a6a8-421404a9d212 service neutron] REQUEST_METHOD: `GET` {{(pid=71938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 24 16:48:48.575711 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cc377ad-543d-40df-a6a8-421404a9d212 service neutron] SCRIPT_NAME: `/identity` {{(pid=71938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 24 16:48:48.576190 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cc377ad-543d-40df-a6a8-421404a9d212 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=71938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 24 16:48:48.600554 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cc377ad-543d-40df-a6a8-421404a9d212 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=71938) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:442}} Nov 24 16:48:48.644934 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cc377ad-543d-40df-a6a8-421404a9d212 service neutron] RBAC: Authorization granted {{(pid=71938) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 24 16:48:48.661062 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: [pid: 71938|app: 0|req: 945/1900] 10.222.0.53 () {60 vars in 1356 bytes} [Wed Nov 24 16:48:48 2021] GET /identity/v3/auth/tokens => generated 3669 bytes in 241 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 24 16:48:48.759371 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de7b3750-c7d1-4a5b-a73a-b3c428d31905 None None] Authenticating user token {{(pid=71939) process_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 24 16:48:48.760849 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.fernet_utils [None req-de7b3750-c7d1-4a5b-a73a-b3c428d31905 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=71939) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:289}} Nov 24 16:48:48.871849 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de7b3750-c7d1-4a5b-a73a-b3c428d31905 None None] Validating token access rules against request {{(pid=71939) validate_allowed_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 24 16:48:48.880592 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c30b686-3bd3-4e6a-8603-1e51338727cc service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e196802d4d5432482b6d2eabc25f74e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3b3940d4ae1c4177ae29c02377bb4b0b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'service', 'ResellerAdmin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=71939) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 24 16:48:48.881970 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c30b686-3bd3-4e6a-8603-1e51338727cc service nova] REQUEST_METHOD: `GET` {{(pid=71939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 24 16:48:48.883228 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c30b686-3bd3-4e6a-8603-1e51338727cc service nova] SCRIPT_NAME: `/identity` {{(pid=71939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 24 16:48:48.883760 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c30b686-3bd3-4e6a-8603-1e51338727cc service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=71939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 24 16:48:48.887118 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.fernet_utils [None req-7c30b686-3bd3-4e6a-8603-1e51338727cc service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=71939) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:289}} Nov 24 16:48:48.904691 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c30b686-3bd3-4e6a-8603-1e51338727cc service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=71939) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:442}} Nov 24 16:48:48.944151 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c30b686-3bd3-4e6a-8603-1e51338727cc service nova] RBAC: Authorization granted {{(pid=71939) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 24 16:48:48.958390 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: [pid: 71939|app: 0|req: 956/1901] 10.222.0.53 () {60 vars in 1356 bytes} [Wed Nov 24 16:48:48 2021] GET /identity/v3/auth/tokens => generated 3802 bytes in 199 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 24 16:48:49.573641 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cc377ad-543d-40df-a6a8-421404a9d212 service neutron] Authenticating user token {{(pid=71938) process_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 24 16:48:49.578648 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.fernet_utils [None req-6cc377ad-543d-40df-a6a8-421404a9d212 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=71938) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:289}} Nov 24 16:48:49.598879 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cc377ad-543d-40df-a6a8-421404a9d212 service neutron] Validating token access rules against request {{(pid=71938) validate_allowed_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 24 16:48:49.631866 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4e54337-6c8e-44fa-9b71-fe882f9d0e1a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f2ba2e8375b4e8c8792ee1e22b60427', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '00a5583c7b7443e98e7a1d31a0b638dc', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=71938) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 24 16:48:49.632875 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4e54337-6c8e-44fa-9b71-fe882f9d0e1a admin admin] REQUEST_METHOD: `DELETE` {{(pid=71938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 24 16:48:49.633210 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4e54337-6c8e-44fa-9b71-fe882f9d0e1a admin admin] SCRIPT_NAME: `/identity` {{(pid=71938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 24 16:48:49.633549 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4e54337-6c8e-44fa-9b71-fe882f9d0e1a admin admin] PATH_INFO: `/v3/projects/5f233f0fcba8420e927440d4f8a1df4a` {{(pid=71938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 24 16:48:49.634831 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4e54337-6c8e-44fa-9b71-fe882f9d0e1a admin admin] RBAC: Authorizing `identity:delete_project(project_id=5f233f0fcba8420e927440d4f8a1df4a)` {{(pid=71938) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:442}} Nov 24 16:48:49.718544 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4e54337-6c8e-44fa-9b71-fe882f9d0e1a admin admin] RBAC: Authorization granted {{(pid=71938) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 24 16:48:49.814917 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.notifications [None req-e4e54337-6c8e-44fa-9b71-fe882f9d0e1a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '5f233f0fcba8420e927440d4f8a1df4a', 'request_id': 'req-e4e54337-6c8e-44fa-9b71-fe882f9d0e1a'} {{(pid=71938) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:357}} Nov 24 16:48:49.828659 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.notifications [None req-e4e54337-6c8e-44fa-9b71-fe882f9d0e1a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '5f233f0fcba8420e927440d4f8a1df4a', 'request_id': 'req-e4e54337-6c8e-44fa-9b71-fe882f9d0e1a'} {{(pid=71938) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:357}} Nov 24 16:48:49.835248 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.notifications [None req-e4e54337-6c8e-44fa-9b71-fe882f9d0e1a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '5f233f0fcba8420e927440d4f8a1df4a', 'request_id': 'req-e4e54337-6c8e-44fa-9b71-fe882f9d0e1a'} {{(pid=71938) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:357}} Nov 24 16:48:49.857487 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.notifications [None req-e4e54337-6c8e-44fa-9b71-fe882f9d0e1a admin admin] The token cache is being invalidate because project 5f233f0fcba8420e927440d4f8a1df4a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=71938) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Nov 24 16:48:49.857734 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.notifications [None req-e4e54337-6c8e-44fa-9b71-fe882f9d0e1a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=71938) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:357}} Nov 24 16:48:49.858632 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.notifications [None req-e4e54337-6c8e-44fa-9b71-fe882f9d0e1a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=71938) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:357}} Nov 24 16:48:49.860490 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: [pid: 71938|app: 0|req: 946/1902] 10.222.0.53 () {58 vars in 1223 bytes} [Wed Nov 24 16:48:49 2021] DELETE /identity/v3/projects/5f233f0fcba8420e927440d4f8a1df4a => generated 0 bytes in 287 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 24 16:48:49.864451 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c30b686-3bd3-4e6a-8603-1e51338727cc service nova] Authenticating user token {{(pid=71939) process_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 24 16:48:49.879270 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c30b686-3bd3-4e6a-8603-1e51338727cc service nova] Validating token access rules against request {{(pid=71939) validate_allowed_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 24 16:48:49.957122 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d4a97ed-0db2-46d1-88ae-933b69776c2d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f2ba2e8375b4e8c8792ee1e22b60427', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '00a5583c7b7443e98e7a1d31a0b638dc', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=71939) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 24 16:48:49.958200 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d4a97ed-0db2-46d1-88ae-933b69776c2d admin admin] REQUEST_METHOD: `DELETE` {{(pid=71939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 24 16:48:49.958706 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d4a97ed-0db2-46d1-88ae-933b69776c2d admin admin] SCRIPT_NAME: `/identity` {{(pid=71939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 24 16:48:49.959187 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d4a97ed-0db2-46d1-88ae-933b69776c2d admin admin] PATH_INFO: `/v3/users/8ef6c687f466463aae55da55f35c952d` {{(pid=71939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 24 16:48:49.961179 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d4a97ed-0db2-46d1-88ae-933b69776c2d admin admin] RBAC: Authorizing `identity:delete_user(user_id=8ef6c687f466463aae55da55f35c952d)` {{(pid=71939) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:442}} Nov 24 16:48:49.993158 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d4a97ed-0db2-46d1-88ae-933b69776c2d admin admin] RBAC: Authorization granted {{(pid=71939) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 24 16:48:50.063396 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.notifications [None req-2d4a97ed-0db2-46d1-88ae-933b69776c2d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '8ef6c687f466463aae55da55f35c952d'} {{(pid=71939) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:357}} Nov 24 16:48:50.079597 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.notifications [None req-2d4a97ed-0db2-46d1-88ae-933b69776c2d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '8ef6c687f466463aae55da55f35c952d'} {{(pid=71939) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:357}} Nov 24 16:48:50.080664 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.notifications [None req-2d4a97ed-0db2-46d1-88ae-933b69776c2d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '8ef6c687f466463aae55da55f35c952d'} {{(pid=71939) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:357}} Nov 24 16:48:50.090653 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.notifications [None req-2d4a97ed-0db2-46d1-88ae-933b69776c2d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '8ef6c687f466463aae55da55f35c952d'} {{(pid=71939) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:357}} Nov 24 16:48:50.099195 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.notifications [None req-2d4a97ed-0db2-46d1-88ae-933b69776c2d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '8ef6c687f466463aae55da55f35c952d'} {{(pid=71939) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:357}} Nov 24 16:48:50.106629 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: [pid: 71939|app: 0|req: 957/1903] 10.222.0.53 () {58 vars in 1214 bytes} [Wed Nov 24 16:48:49 2021] DELETE /identity/v3/users/8ef6c687f466463aae55da55f35c952d => generated 0 bytes in 243 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 24 16:48:50.609147 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4e54337-6c8e-44fa-9b71-fe882f9d0e1a admin admin] Authenticating user token {{(pid=71938) process_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 24 16:48:50.611059 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.fernet_utils [None req-e4e54337-6c8e-44fa-9b71-fe882f9d0e1a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=71938) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:289}} Nov 24 16:48:50.626143 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4e54337-6c8e-44fa-9b71-fe882f9d0e1a admin admin] Validating token access rules against request {{(pid=71938) validate_allowed_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 24 16:48:50.699847 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26dd337d-88f7-48c6-9733-6c5f9a941693 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f2ba2e8375b4e8c8792ee1e22b60427', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '00a5583c7b7443e98e7a1d31a0b638dc', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=71938) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 24 16:48:50.701138 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26dd337d-88f7-48c6-9733-6c5f9a941693 admin admin] REQUEST_METHOD: `DELETE` {{(pid=71938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 24 16:48:50.701475 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26dd337d-88f7-48c6-9733-6c5f9a941693 admin admin] SCRIPT_NAME: `/identity` {{(pid=71938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 24 16:48:50.701817 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26dd337d-88f7-48c6-9733-6c5f9a941693 admin admin] PATH_INFO: `/v3/projects/7579cc0603984b5dabecafd4aec09470` {{(pid=71938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 24 16:48:50.703139 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26dd337d-88f7-48c6-9733-6c5f9a941693 admin admin] RBAC: Authorizing `identity:delete_project(project_id=7579cc0603984b5dabecafd4aec09470)` {{(pid=71938) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:442}} Nov 24 16:48:50.736011 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26dd337d-88f7-48c6-9733-6c5f9a941693 admin admin] RBAC: Authorization granted {{(pid=71938) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 24 16:48:50.792318 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.notifications [None req-26dd337d-88f7-48c6-9733-6c5f9a941693 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '7579cc0603984b5dabecafd4aec09470', 'request_id': 'req-26dd337d-88f7-48c6-9733-6c5f9a941693'} {{(pid=71938) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:357}} Nov 24 16:48:50.807038 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.notifications [None req-26dd337d-88f7-48c6-9733-6c5f9a941693 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '7579cc0603984b5dabecafd4aec09470', 'request_id': 'req-26dd337d-88f7-48c6-9733-6c5f9a941693'} {{(pid=71938) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:357}} Nov 24 16:48:50.815397 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.notifications [None req-26dd337d-88f7-48c6-9733-6c5f9a941693 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '7579cc0603984b5dabecafd4aec09470', 'request_id': 'req-26dd337d-88f7-48c6-9733-6c5f9a941693'} {{(pid=71938) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:357}} Nov 24 16:48:50.831181 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.notifications [None req-26dd337d-88f7-48c6-9733-6c5f9a941693 admin admin] The token cache is being invalidate because project 7579cc0603984b5dabecafd4aec09470 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=71938) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Nov 24 16:48:50.831731 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.notifications [None req-26dd337d-88f7-48c6-9733-6c5f9a941693 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=71938) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:357}} Nov 24 16:48:50.832584 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.notifications [None req-26dd337d-88f7-48c6-9733-6c5f9a941693 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=71938) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:357}} Nov 24 16:48:50.834626 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: [pid: 71938|app: 0|req: 947/1904] 10.222.0.53 () {58 vars in 1223 bytes} [Wed Nov 24 16:48:50 2021] DELETE /identity/v3/projects/7579cc0603984b5dabecafd4aec09470 => generated 0 bytes in 226 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 24 16:48:50.840796 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac3f6da6-5b51-49d9-8d52-f861372fa441 None None] REQUEST_METHOD: `POST` {{(pid=71939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 24 16:48:50.841149 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac3f6da6-5b51-49d9-8d52-f861372fa441 None None] SCRIPT_NAME: `/identity` {{(pid=71939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 24 16:48:50.841513 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac3f6da6-5b51-49d9-8d52-f861372fa441 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=71939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 24 16:48:50.870294 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.auth.core [None req-ac3f6da6-5b51-49d9-8d52-f861372fa441 None None] MFA Rules not processed for user `0f2ba2e8375b4e8c8792ee1e22b60427`. Rule list: `[]` (Enabled: `True`). {{(pid=71939) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:442}} Nov 24 16:48:50.872153 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.fernet_utils [None req-ac3f6da6-5b51-49d9-8d52-f861372fa441 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=71939) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:289}} Nov 24 16:48:50.958976 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: [pid: 71939|app: 0|req: 958/1905] 10.222.0.53 () {58 vars in 948 bytes} [Wed Nov 24 16:48:50 2021] POST /identity/v3/auth/tokens => generated 3669 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Nov 24 16:48:50.963161 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4d0ab82-2ac0-49ed-beec-40cdb56ed002 None None] REQUEST_METHOD: `POST` {{(pid=71938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 24 16:48:50.963512 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4d0ab82-2ac0-49ed-beec-40cdb56ed002 None None] SCRIPT_NAME: `/identity` {{(pid=71938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 24 16:48:50.963846 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4d0ab82-2ac0-49ed-beec-40cdb56ed002 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=71938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 24 16:48:50.988311 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.auth.core [None req-e4d0ab82-2ac0-49ed-beec-40cdb56ed002 None None] MFA Rules not processed for user `0f2ba2e8375b4e8c8792ee1e22b60427`. Rule list: `[]` (Enabled: `True`). {{(pid=71938) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:442}} Nov 24 16:48:50.989539 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.fernet_utils [None req-e4d0ab82-2ac0-49ed-beec-40cdb56ed002 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=71938) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:289}} Nov 24 16:48:50.997030 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: [pid: 71938|app: 0|req: 948/1906] 10.222.0.53 () {58 vars in 948 bytes} [Wed Nov 24 16:48:50 2021] POST /identity/v3/auth/tokens => generated 3669 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 24 16:48:51.001747 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac3f6da6-5b51-49d9-8d52-f861372fa441 None None] Authenticating user token {{(pid=71939) process_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 24 16:48:51.011941 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac3f6da6-5b51-49d9-8d52-f861372fa441 None None] Validating token access rules against request {{(pid=71939) validate_allowed_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 24 16:48:51.016506 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a1a5ebf-8d1f-4406-a4b7-6b2ad9115fc8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f2ba2e8375b4e8c8792ee1e22b60427', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '00a5583c7b7443e98e7a1d31a0b638dc', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=71939) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 24 16:48:51.017175 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a1a5ebf-8d1f-4406-a4b7-6b2ad9115fc8 admin admin] REQUEST_METHOD: `GET` {{(pid=71939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 24 16:48:51.017524 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a1a5ebf-8d1f-4406-a4b7-6b2ad9115fc8 admin admin] SCRIPT_NAME: `/identity` {{(pid=71939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 24 16:48:51.017863 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a1a5ebf-8d1f-4406-a4b7-6b2ad9115fc8 admin admin] PATH_INFO: `/v3/domains` {{(pid=71939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 24 16:48:51.018695 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a1a5ebf-8d1f-4406-a4b7-6b2ad9115fc8 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=71939) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:161}} Nov 24 16:48:51.019051 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a1a5ebf-8d1f-4406-a4b7-6b2ad9115fc8 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=71939) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:442}} Nov 24 16:48:51.048147 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a1a5ebf-8d1f-4406-a4b7-6b2ad9115fc8 admin admin] RBAC: Authorization granted {{(pid=71939) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 24 16:48:51.064186 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: [pid: 71939|app: 0|req: 959/1907] 10.222.0.53 () {58 vars in 1143 bytes} [Wed Nov 24 16:48:51 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 63 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 24 16:48:51.069141 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4d0ab82-2ac0-49ed-beec-40cdb56ed002 None None] Authenticating user token {{(pid=71938) process_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 24 16:48:51.081509 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4d0ab82-2ac0-49ed-beec-40cdb56ed002 None None] Validating token access rules against request {{(pid=71938) validate_allowed_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 24 16:48:51.084701 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f44b7863-1850-47fc-91f7-65e403e8b953 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f2ba2e8375b4e8c8792ee1e22b60427', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '00a5583c7b7443e98e7a1d31a0b638dc', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=71938) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 24 16:48:51.085374 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f44b7863-1850-47fc-91f7-65e403e8b953 admin admin] REQUEST_METHOD: `POST` {{(pid=71938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 24 16:48:51.085715 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f44b7863-1850-47fc-91f7-65e403e8b953 admin admin] SCRIPT_NAME: `/identity` {{(pid=71938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 24 16:48:51.086207 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f44b7863-1850-47fc-91f7-65e403e8b953 admin admin] PATH_INFO: `/v3/projects` {{(pid=71938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 24 16:48:51.086846 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f44b7863-1850-47fc-91f7-65e403e8b953 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=71938) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:442}} Nov 24 16:48:51.115715 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f44b7863-1850-47fc-91f7-65e403e8b953 admin admin] RBAC: Authorization granted {{(pid=71938) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 24 16:48:51.145929 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: [pid: 71938|app: 0|req: 949/1908] 10.222.0.53 () {60 vars in 1143 bytes} [Wed Nov 24 16:48:51 2021] POST /identity/v3/projects => generated 387 bytes in 77 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 24 16:48:51.163031 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a1a5ebf-8d1f-4406-a4b7-6b2ad9115fc8 admin admin] Authenticating user token {{(pid=71939) process_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 24 16:48:51.177397 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a1a5ebf-8d1f-4406-a4b7-6b2ad9115fc8 admin admin] Validating token access rules against request {{(pid=71939) validate_allowed_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 24 16:48:51.267426 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f1048bd-92b8-4197-a527-2579ccddf5aa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f2ba2e8375b4e8c8792ee1e22b60427', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '00a5583c7b7443e98e7a1d31a0b638dc', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=71939) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 24 16:48:51.268458 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f1048bd-92b8-4197-a527-2579ccddf5aa admin admin] REQUEST_METHOD: `POST` {{(pid=71939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 24 16:48:51.268458 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f1048bd-92b8-4197-a527-2579ccddf5aa admin admin] SCRIPT_NAME: `/identity` {{(pid=71939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 24 16:48:51.268730 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f1048bd-92b8-4197-a527-2579ccddf5aa admin admin] PATH_INFO: `/v3/users` {{(pid=71939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 24 16:48:51.269556 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f1048bd-92b8-4197-a527-2579ccddf5aa admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=71939) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:442}} Nov 24 16:48:51.299720 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f1048bd-92b8-4197-a527-2579ccddf5aa admin admin] RBAC: Authorization granted {{(pid=71939) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 24 16:48:51.325334 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: [pid: 71939|app: 0|req: 960/1909] 10.222.0.53 () {60 vars in 1134 bytes} [Wed Nov 24 16:48:51 2021] POST /identity/v3/users => generated 294 bytes in 175 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 24 16:48:51.329346 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f44b7863-1850-47fc-91f7-65e403e8b953 admin admin] Authenticating user token {{(pid=71938) process_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 24 16:48:51.340238 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f44b7863-1850-47fc-91f7-65e403e8b953 admin admin] Validating token access rules against request {{(pid=71938) validate_allowed_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 24 16:48:51.345068 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6795a726-b2fe-4f29-b535-fffc31e69ac6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f2ba2e8375b4e8c8792ee1e22b60427', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '00a5583c7b7443e98e7a1d31a0b638dc', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=71938) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 24 16:48:51.345756 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6795a726-b2fe-4f29-b535-fffc31e69ac6 admin admin] REQUEST_METHOD: `GET` {{(pid=71938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 24 16:48:51.346129 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6795a726-b2fe-4f29-b535-fffc31e69ac6 admin admin] SCRIPT_NAME: `/identity` {{(pid=71938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 24 16:48:51.346469 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6795a726-b2fe-4f29-b535-fffc31e69ac6 admin admin] PATH_INFO: `/v3/roles` {{(pid=71938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 24 16:48:51.347260 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6795a726-b2fe-4f29-b535-fffc31e69ac6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=71938) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:442}} Nov 24 16:48:51.376936 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6795a726-b2fe-4f29-b535-fffc31e69ac6 admin admin] RBAC: Authorization granted {{(pid=71938) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 24 16:48:51.389073 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: [pid: 71938|app: 0|req: 950/1910] 10.222.0.53 () {58 vars in 1112 bytes} [Wed Nov 24 16:48:51 2021] GET /identity/v3/roles => generated 1420 bytes in 60 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 24 16:48:51.393587 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f1048bd-92b8-4197-a527-2579ccddf5aa admin admin] Authenticating user token {{(pid=71939) process_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 24 16:48:51.404709 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f1048bd-92b8-4197-a527-2579ccddf5aa admin admin] Validating token access rules against request {{(pid=71939) validate_allowed_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 24 16:48:51.409536 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd04818f-ce8b-4a46-ac34-1163d0362bbe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f2ba2e8375b4e8c8792ee1e22b60427', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '00a5583c7b7443e98e7a1d31a0b638dc', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=71939) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 24 16:48:51.410477 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd04818f-ce8b-4a46-ac34-1163d0362bbe admin admin] REQUEST_METHOD: `PUT` {{(pid=71939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 24 16:48:51.410819 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd04818f-ce8b-4a46-ac34-1163d0362bbe admin admin] SCRIPT_NAME: `/identity` {{(pid=71939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 24 16:48:51.411159 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd04818f-ce8b-4a46-ac34-1163d0362bbe admin admin] PATH_INFO: `/v3/projects/db6c0dd61897450794600d019180825c/users/ab19a841aa034974ada439299e8443e2/roles/912ab5f10fa5477da74acf239f07604e` {{(pid=71939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 24 16:48:51.432659 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd04818f-ce8b-4a46-ac34-1163d0362bbe admin admin] RBAC: Authorizing `identity:create_grant(project_id=db6c0dd61897450794600d019180825c, user_id=ab19a841aa034974ada439299e8443e2, role_id=912ab5f10fa5477da74acf239f07604e)` {{(pid=71939) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:442}} Nov 24 16:48:51.463266 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd04818f-ce8b-4a46-ac34-1163d0362bbe admin admin] RBAC: Authorization granted {{(pid=71939) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 24 16:48:51.475559 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: [pid: 71939|app: 0|req: 961/1911] 10.222.0.53 () {60 vars in 1473 bytes} [Wed Nov 24 16:48:51 2021] PUT /identity/v3/projects/db6c0dd61897450794600d019180825c/users/ab19a841aa034974ada439299e8443e2/roles/912ab5f10fa5477da74acf239f07604e => generated 0 bytes in 82 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 24 16:48:51.487411 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7dc484f-2055-47c0-89dc-efcca7ec8b51 None None] REQUEST_METHOD: `POST` {{(pid=71938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 24 16:48:51.487689 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7dc484f-2055-47c0-89dc-efcca7ec8b51 None None] SCRIPT_NAME: `/identity` {{(pid=71938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 24 16:48:51.488026 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7dc484f-2055-47c0-89dc-efcca7ec8b51 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=71938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 24 16:48:51.537796 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.auth.core [None req-d7dc484f-2055-47c0-89dc-efcca7ec8b51 None None] MFA Rules not processed for user `ab19a841aa034974ada439299e8443e2`. Rule list: `[]` (Enabled: `True`). {{(pid=71938) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:442}} Nov 24 16:48:51.539125 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.fernet_utils [None req-d7dc484f-2055-47c0-89dc-efcca7ec8b51 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=71938) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:289}} Nov 24 16:48:51.619789 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: [pid: 71938|app: 0|req: 951/1912] 10.222.0.53 () {58 vars in 948 bytes} [Wed Nov 24 16:48:51 2021] POST /identity/v3/auth/tokens => generated 3694 bytes in 134 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 24 16:48:51.624869 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd04818f-ce8b-4a46-ac34-1163d0362bbe admin admin] Authenticating user token {{(pid=71939) process_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 24 16:48:51.739593 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd04818f-ce8b-4a46-ac34-1163d0362bbe admin admin] Validating token access rules against request {{(pid=71939) validate_allowed_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 24 16:48:51.746949 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aaefc077-3db9-46eb-b1d7-c9176582dd0d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f2ba2e8375b4e8c8792ee1e22b60427', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '00a5583c7b7443e98e7a1d31a0b638dc', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=71939) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 24 16:48:51.747910 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaefc077-3db9-46eb-b1d7-c9176582dd0d admin admin] REQUEST_METHOD: `POST` {{(pid=71939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 24 16:48:51.748469 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaefc077-3db9-46eb-b1d7-c9176582dd0d admin admin] SCRIPT_NAME: `/identity` {{(pid=71939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 24 16:48:51.748974 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaefc077-3db9-46eb-b1d7-c9176582dd0d admin admin] PATH_INFO: `/v3/projects` {{(pid=71939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 24 16:48:51.750661 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aaefc077-3db9-46eb-b1d7-c9176582dd0d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=71939) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:442}} Nov 24 16:48:51.784875 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aaefc077-3db9-46eb-b1d7-c9176582dd0d admin admin] RBAC: Authorization granted {{(pid=71939) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 24 16:48:51.827325 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: [pid: 71939|app: 0|req: 962/1913] 10.222.0.53 () {60 vars in 1143 bytes} [Wed Nov 24 16:48:51 2021] POST /identity/v3/projects => generated 383 bytes in 200 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 24 16:48:51.828594 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7dc484f-2055-47c0-89dc-efcca7ec8b51 None None] Authenticating user token {{(pid=71938) process_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 24 16:48:51.842145 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7dc484f-2055-47c0-89dc-efcca7ec8b51 None None] Validating token access rules against request {{(pid=71938) validate_allowed_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 24 16:48:51.930922 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a106222-f577-4005-a1d5-a75c5c36fc58 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f2ba2e8375b4e8c8792ee1e22b60427', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '00a5583c7b7443e98e7a1d31a0b638dc', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=71938) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 24 16:48:51.931828 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a106222-f577-4005-a1d5-a75c5c36fc58 admin admin] REQUEST_METHOD: `POST` {{(pid=71938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 24 16:48:51.932336 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a106222-f577-4005-a1d5-a75c5c36fc58 admin admin] SCRIPT_NAME: `/identity` {{(pid=71938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 24 16:48:51.932811 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a106222-f577-4005-a1d5-a75c5c36fc58 admin admin] PATH_INFO: `/v3/users` {{(pid=71938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 24 16:48:51.933669 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a106222-f577-4005-a1d5-a75c5c36fc58 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=71938) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:442}} Nov 24 16:48:52.014256 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a106222-f577-4005-a1d5-a75c5c36fc58 admin admin] RBAC: Authorization granted {{(pid=71938) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 24 16:48:52.094128 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: [pid: 71938|app: 0|req: 952/1914] 10.222.0.53 () {60 vars in 1134 bytes} [Wed Nov 24 16:48:51 2021] POST /identity/v3/users => generated 298 bytes in 266 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 24 16:48:52.098959 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aaefc077-3db9-46eb-b1d7-c9176582dd0d admin admin] Authenticating user token {{(pid=71939) process_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 24 16:48:52.140180 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aaefc077-3db9-46eb-b1d7-c9176582dd0d admin admin] Validating token access rules against request {{(pid=71939) validate_allowed_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 24 16:48:52.176164 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88cbcbb1-0a60-4d0c-834f-1f750f8d9a04 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f2ba2e8375b4e8c8792ee1e22b60427', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '00a5583c7b7443e98e7a1d31a0b638dc', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=71939) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 24 16:48:52.177183 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88cbcbb1-0a60-4d0c-834f-1f750f8d9a04 admin admin] REQUEST_METHOD: `GET` {{(pid=71939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 24 16:48:52.177183 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88cbcbb1-0a60-4d0c-834f-1f750f8d9a04 admin admin] SCRIPT_NAME: `/identity` {{(pid=71939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 24 16:48:52.181671 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88cbcbb1-0a60-4d0c-834f-1f750f8d9a04 admin admin] PATH_INFO: `/v3/roles` {{(pid=71939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 24 16:48:52.183547 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88cbcbb1-0a60-4d0c-834f-1f750f8d9a04 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=71939) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:442}} Nov 24 16:48:52.251260 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88cbcbb1-0a60-4d0c-834f-1f750f8d9a04 admin admin] RBAC: Authorization granted {{(pid=71939) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 24 16:48:52.280738 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: [pid: 71939|app: 0|req: 963/1915] 10.222.0.53 () {58 vars in 1112 bytes} [Wed Nov 24 16:48:52 2021] GET /identity/v3/roles => generated 1420 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 24 16:48:52.285950 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a106222-f577-4005-a1d5-a75c5c36fc58 admin admin] Authenticating user token {{(pid=71938) process_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 24 16:48:52.297853 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a106222-f577-4005-a1d5-a75c5c36fc58 admin admin] Validating token access rules against request {{(pid=71938) validate_allowed_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 24 16:48:52.303557 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68b49b3b-cbf2-4965-b581-a79db8bae8a8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f2ba2e8375b4e8c8792ee1e22b60427', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '00a5583c7b7443e98e7a1d31a0b638dc', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=71938) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 24 16:48:52.305383 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68b49b3b-cbf2-4965-b581-a79db8bae8a8 admin admin] REQUEST_METHOD: `PUT` {{(pid=71938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 24 16:48:52.305925 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68b49b3b-cbf2-4965-b581-a79db8bae8a8 admin admin] SCRIPT_NAME: `/identity` {{(pid=71938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 24 16:48:52.306486 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68b49b3b-cbf2-4965-b581-a79db8bae8a8 admin admin] PATH_INFO: `/v3/projects/28de210abd2e42eab64d674fd6222ba3/users/36d03b54bc7e44dab364eb50844a6d38/roles/5611724e350b41e19921b5961a342582` {{(pid=71938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 24 16:48:52.332123 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68b49b3b-cbf2-4965-b581-a79db8bae8a8 admin admin] RBAC: Authorizing `identity:create_grant(project_id=28de210abd2e42eab64d674fd6222ba3, user_id=36d03b54bc7e44dab364eb50844a6d38, role_id=5611724e350b41e19921b5961a342582)` {{(pid=71938) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:442}} Nov 24 16:48:52.376625 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68b49b3b-cbf2-4965-b581-a79db8bae8a8 admin admin] RBAC: Authorization granted {{(pid=71938) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 24 16:48:52.419523 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: [pid: 71938|app: 0|req: 953/1916] 10.222.0.53 () {60 vars in 1473 bytes} [Wed Nov 24 16:48:52 2021] PUT /identity/v3/projects/28de210abd2e42eab64d674fd6222ba3/users/36d03b54bc7e44dab364eb50844a6d38/roles/5611724e350b41e19921b5961a342582 => generated 0 bytes in 134 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 24 16:48:52.425105 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88cbcbb1-0a60-4d0c-834f-1f750f8d9a04 admin admin] Authenticating user token {{(pid=71939) process_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 24 16:48:52.440505 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88cbcbb1-0a60-4d0c-834f-1f750f8d9a04 admin admin] Validating token access rules against request {{(pid=71939) validate_allowed_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 24 16:48:52.544662 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d8b57e6-f6dc-4fab-a5a3-d74d064ad39a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f2ba2e8375b4e8c8792ee1e22b60427', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '00a5583c7b7443e98e7a1d31a0b638dc', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=71939) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 24 16:48:52.545692 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d8b57e6-f6dc-4fab-a5a3-d74d064ad39a admin admin] REQUEST_METHOD: `GET` {{(pid=71939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 24 16:48:52.546330 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d8b57e6-f6dc-4fab-a5a3-d74d064ad39a admin admin] SCRIPT_NAME: `/identity` {{(pid=71939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 24 16:48:52.546830 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d8b57e6-f6dc-4fab-a5a3-d74d064ad39a admin admin] PATH_INFO: `/v3/roles` {{(pid=71939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 24 16:48:52.547782 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d8b57e6-f6dc-4fab-a5a3-d74d064ad39a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=71939) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:442}} Nov 24 16:48:52.580087 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d8b57e6-f6dc-4fab-a5a3-d74d064ad39a admin admin] RBAC: Authorization granted {{(pid=71939) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 24 16:48:52.594216 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: [pid: 71939|app: 0|req: 964/1917] 10.222.0.53 () {58 vars in 1112 bytes} [Wed Nov 24 16:48:52 2021] GET /identity/v3/roles => generated 1420 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 24 16:48:52.598348 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68b49b3b-cbf2-4965-b581-a79db8bae8a8 admin admin] Authenticating user token {{(pid=71938) process_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 24 16:48:52.610812 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68b49b3b-cbf2-4965-b581-a79db8bae8a8 admin admin] Validating token access rules against request {{(pid=71938) validate_allowed_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 24 16:48:52.616066 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6424a803-c169-4029-a7ae-50b7fbc4e3f4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f2ba2e8375b4e8c8792ee1e22b60427', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '00a5583c7b7443e98e7a1d31a0b638dc', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=71938) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 24 16:48:52.619081 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6424a803-c169-4029-a7ae-50b7fbc4e3f4 admin admin] REQUEST_METHOD: `PUT` {{(pid=71938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 24 16:48:52.619081 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6424a803-c169-4029-a7ae-50b7fbc4e3f4 admin admin] SCRIPT_NAME: `/identity` {{(pid=71938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 24 16:48:52.620962 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6424a803-c169-4029-a7ae-50b7fbc4e3f4 admin admin] PATH_INFO: `/v3/projects/28de210abd2e42eab64d674fd6222ba3/users/36d03b54bc7e44dab364eb50844a6d38/roles/5611724e350b41e19921b5961a342582` {{(pid=71938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 24 16:48:52.623841 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6424a803-c169-4029-a7ae-50b7fbc4e3f4 admin admin] RBAC: Authorizing `identity:create_grant(project_id=28de210abd2e42eab64d674fd6222ba3, user_id=36d03b54bc7e44dab364eb50844a6d38, role_id=5611724e350b41e19921b5961a342582)` {{(pid=71938) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:442}} Nov 24 16:48:52.656641 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6424a803-c169-4029-a7ae-50b7fbc4e3f4 admin admin] RBAC: Authorization granted {{(pid=71938) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 24 16:48:52.669331 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: [pid: 71938|app: 0|req: 954/1918] 10.222.0.53 () {60 vars in 1473 bytes} [Wed Nov 24 16:48:52 2021] PUT /identity/v3/projects/28de210abd2e42eab64d674fd6222ba3/users/36d03b54bc7e44dab364eb50844a6d38/roles/5611724e350b41e19921b5961a342582 => generated 0 bytes in 71 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Nov 24 16:48:52.673265 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d8b57e6-f6dc-4fab-a5a3-d74d064ad39a admin admin] Authenticating user token {{(pid=71939) process_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 24 16:48:52.691108 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d8b57e6-f6dc-4fab-a5a3-d74d064ad39a admin admin] Validating token access rules against request {{(pid=71939) validate_allowed_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 24 16:48:52.859984 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d96e6d05-e2be-4609-9adb-dbaae768b8a8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f2ba2e8375b4e8c8792ee1e22b60427', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '00a5583c7b7443e98e7a1d31a0b638dc', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=71939) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 24 16:48:52.861270 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d96e6d05-e2be-4609-9adb-dbaae768b8a8 admin admin] REQUEST_METHOD: `GET` {{(pid=71939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 24 16:48:52.861826 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d96e6d05-e2be-4609-9adb-dbaae768b8a8 admin admin] SCRIPT_NAME: `/identity` {{(pid=71939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 24 16:48:52.862679 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d96e6d05-e2be-4609-9adb-dbaae768b8a8 admin admin] PATH_INFO: `/v3/roles` {{(pid=71939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 24 16:48:52.863729 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d96e6d05-e2be-4609-9adb-dbaae768b8a8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=71939) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:442}} Nov 24 16:48:52.900720 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d96e6d05-e2be-4609-9adb-dbaae768b8a8 admin admin] RBAC: Authorization granted {{(pid=71939) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 24 16:48:52.916105 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: [pid: 71939|app: 0|req: 965/1919] 10.222.0.53 () {58 vars in 1112 bytes} [Wed Nov 24 16:48:52 2021] GET /identity/v3/roles => generated 1420 bytes in 243 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 24 16:48:52.920381 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6424a803-c169-4029-a7ae-50b7fbc4e3f4 admin admin] Authenticating user token {{(pid=71938) process_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 24 16:48:52.936723 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6424a803-c169-4029-a7ae-50b7fbc4e3f4 admin admin] Validating token access rules against request {{(pid=71938) validate_allowed_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 24 16:48:52.950884 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f97be74f-b810-4602-9f28-2238e344834c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f2ba2e8375b4e8c8792ee1e22b60427', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '00a5583c7b7443e98e7a1d31a0b638dc', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=71938) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 24 16:48:52.952223 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f97be74f-b810-4602-9f28-2238e344834c admin admin] REQUEST_METHOD: `PUT` {{(pid=71938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 24 16:48:52.952569 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f97be74f-b810-4602-9f28-2238e344834c admin admin] SCRIPT_NAME: `/identity` {{(pid=71938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 24 16:48:52.952950 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f97be74f-b810-4602-9f28-2238e344834c admin admin] PATH_INFO: `/v3/projects/28de210abd2e42eab64d674fd6222ba3/users/36d03b54bc7e44dab364eb50844a6d38/roles/912ab5f10fa5477da74acf239f07604e` {{(pid=71938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 24 16:48:52.957740 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f97be74f-b810-4602-9f28-2238e344834c admin admin] RBAC: Authorizing `identity:create_grant(project_id=28de210abd2e42eab64d674fd6222ba3, user_id=36d03b54bc7e44dab364eb50844a6d38, role_id=912ab5f10fa5477da74acf239f07604e)` {{(pid=71938) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:442}} Nov 24 16:48:53.040376 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f97be74f-b810-4602-9f28-2238e344834c admin admin] RBAC: Authorization granted {{(pid=71938) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 24 16:48:53.076507 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: [pid: 71938|app: 0|req: 955/1920] 10.222.0.53 () {60 vars in 1473 bytes} [Wed Nov 24 16:48:52 2021] PUT /identity/v3/projects/28de210abd2e42eab64d674fd6222ba3/users/36d03b54bc7e44dab364eb50844a6d38/roles/912ab5f10fa5477da74acf239f07604e => generated 0 bytes in 156 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Nov 24 16:48:53.087983 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6834bbe6-ffcd-47ff-a784-6f4fef7ea87f None None] REQUEST_METHOD: `POST` {{(pid=71939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 24 16:48:53.088332 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6834bbe6-ffcd-47ff-a784-6f4fef7ea87f None None] SCRIPT_NAME: `/identity` {{(pid=71939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 24 16:48:53.088709 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6834bbe6-ffcd-47ff-a784-6f4fef7ea87f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=71939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 24 16:48:53.149406 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.auth.core [None req-6834bbe6-ffcd-47ff-a784-6f4fef7ea87f None None] MFA Rules not processed for user `36d03b54bc7e44dab364eb50844a6d38`. Rule list: `[]` (Enabled: `True`). {{(pid=71939) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:442}} Nov 24 16:48:53.150762 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.fernet_utils [None req-6834bbe6-ffcd-47ff-a784-6f4fef7ea87f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=71939) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:289}} Nov 24 16:48:53.311343 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: [pid: 71939|app: 0|req: 966/1921] 10.222.0.53 () {58 vars in 948 bytes} [Wed Nov 24 16:48:53 2021] POST /identity/v3/auth/tokens => generated 3757 bytes in 224 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 24 16:48:53.345002 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f97be74f-b810-4602-9f28-2238e344834c admin admin] Authenticating user token {{(pid=71938) process_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 24 16:48:53.346984 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.fernet_utils [None req-f97be74f-b810-4602-9f28-2238e344834c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=71938) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:289}} Nov 24 16:48:53.487613 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f97be74f-b810-4602-9f28-2238e344834c admin admin] Validating token access rules against request {{(pid=71938) validate_allowed_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 24 16:48:53.498642 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae688236-aef3-40ee-be6e-5791742b31d3 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a12374a3093a401a97c343ff0854184d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3b3940d4ae1c4177ae29c02377bb4b0b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=71938) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 24 16:48:53.499389 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae688236-aef3-40ee-be6e-5791742b31d3 service cinder] REQUEST_METHOD: `GET` {{(pid=71938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 24 16:48:53.499748 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae688236-aef3-40ee-be6e-5791742b31d3 service cinder] SCRIPT_NAME: `/identity` {{(pid=71938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 24 16:48:53.500050 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae688236-aef3-40ee-be6e-5791742b31d3 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=71938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 24 16:48:53.520486 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae688236-aef3-40ee-be6e-5791742b31d3 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=71938) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:442}} Nov 24 16:48:53.556442 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae688236-aef3-40ee-be6e-5791742b31d3 service cinder] RBAC: Authorization granted {{(pid=71938) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 24 16:48:53.570703 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: [pid: 71938|app: 0|req: 956/1922] 10.222.0.53 () {60 vars in 1356 bytes} [Wed Nov 24 16:48:53 2021] GET /identity/v3/auth/tokens => generated 3757 bytes in 226 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 24 16:48:53.618798 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6834bbe6-ffcd-47ff-a784-6f4fef7ea87f None None] Authenticating user token {{(pid=71939) process_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 24 16:48:53.799524 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6834bbe6-ffcd-47ff-a784-6f4fef7ea87f None None] Validating token access rules against request {{(pid=71939) validate_allowed_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 24 16:48:53.807049 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e33481b6-b986-466a-965c-4c2ead1461ed admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f2ba2e8375b4e8c8792ee1e22b60427', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '00a5583c7b7443e98e7a1d31a0b638dc', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=71939) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 24 16:48:53.807977 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e33481b6-b986-466a-965c-4c2ead1461ed admin admin] REQUEST_METHOD: `DELETE` {{(pid=71939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 24 16:48:53.811562 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e33481b6-b986-466a-965c-4c2ead1461ed admin admin] SCRIPT_NAME: `/identity` {{(pid=71939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 24 16:48:53.812020 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e33481b6-b986-466a-965c-4c2ead1461ed admin admin] PATH_INFO: `/v3/users/ab19a841aa034974ada439299e8443e2` {{(pid=71939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 24 16:48:53.823496 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e33481b6-b986-466a-965c-4c2ead1461ed admin admin] RBAC: Authorizing `identity:delete_user(user_id=ab19a841aa034974ada439299e8443e2)` {{(pid=71939) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:442}} Nov 24 16:48:53.922148 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e33481b6-b986-466a-965c-4c2ead1461ed admin admin] RBAC: Authorization granted {{(pid=71939) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 24 16:48:54.024605 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.notifications [None req-e33481b6-b986-466a-965c-4c2ead1461ed admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ab19a841aa034974ada439299e8443e2'} {{(pid=71939) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:357}} Nov 24 16:48:54.042862 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae688236-aef3-40ee-be6e-5791742b31d3 service cinder] Authenticating user token {{(pid=71938) process_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 24 16:48:54.044392 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.fernet_utils [None req-ae688236-aef3-40ee-be6e-5791742b31d3 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=71938) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:289}} Nov 24 16:48:54.050616 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.notifications [None req-e33481b6-b986-466a-965c-4c2ead1461ed admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ab19a841aa034974ada439299e8443e2'} {{(pid=71939) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:357}} Nov 24 16:48:54.055097 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.notifications [None req-e33481b6-b986-466a-965c-4c2ead1461ed admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ab19a841aa034974ada439299e8443e2'} {{(pid=71939) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:357}} Nov 24 16:48:54.070503 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae688236-aef3-40ee-be6e-5791742b31d3 service cinder] Validating token access rules against request {{(pid=71938) validate_allowed_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 24 16:48:54.075381 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.notifications [None req-e33481b6-b986-466a-965c-4c2ead1461ed admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ab19a841aa034974ada439299e8443e2'} {{(pid=71939) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:357}} Nov 24 16:48:54.081906 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49a21b1b-2eb6-4df6-b68e-ace4b86e2bdb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f2ba2e8375b4e8c8792ee1e22b60427', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '00a5583c7b7443e98e7a1d31a0b638dc', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=71938) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 24 16:48:54.083131 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49a21b1b-2eb6-4df6-b68e-ace4b86e2bdb admin admin] REQUEST_METHOD: `DELETE` {{(pid=71938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 24 16:48:54.083716 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49a21b1b-2eb6-4df6-b68e-ace4b86e2bdb admin admin] SCRIPT_NAME: `/identity` {{(pid=71938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 24 16:48:54.084336 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49a21b1b-2eb6-4df6-b68e-ace4b86e2bdb admin admin] PATH_INFO: `/v3/users/e7b6d6e008a248719ca4cd8595277f78` {{(pid=71938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 24 16:48:54.086801 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49a21b1b-2eb6-4df6-b68e-ace4b86e2bdb admin admin] RBAC: Authorizing `identity:delete_user(user_id=e7b6d6e008a248719ca4cd8595277f78)` {{(pid=71938) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:442}} Nov 24 16:48:54.086984 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.notifications [None req-e33481b6-b986-466a-965c-4c2ead1461ed admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ab19a841aa034974ada439299e8443e2'} {{(pid=71939) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:357}} Nov 24 16:48:54.094402 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: [pid: 71939|app: 0|req: 967/1923] 10.222.0.53 () {58 vars in 1214 bytes} [Wed Nov 24 16:48:53 2021] DELETE /identity/v3/users/ab19a841aa034974ada439299e8443e2 => generated 0 bytes in 476 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 24 16:48:54.098814 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc6bf8cd-6775-4786-8634-4265fefe289c None None] REQUEST_METHOD: `POST` {{(pid=71939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 24 16:48:54.099170 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc6bf8cd-6775-4786-8634-4265fefe289c None None] SCRIPT_NAME: `/identity` {{(pid=71939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 24 16:48:54.099512 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc6bf8cd-6775-4786-8634-4265fefe289c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=71939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 24 16:48:54.149109 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49a21b1b-2eb6-4df6-b68e-ace4b86e2bdb admin admin] RBAC: Authorization granted {{(pid=71938) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 24 16:48:54.163263 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.auth.core [None req-dc6bf8cd-6775-4786-8634-4265fefe289c None None] MFA Rules not processed for user `0f2ba2e8375b4e8c8792ee1e22b60427`. Rule list: `[]` (Enabled: `True`). {{(pid=71939) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:442}} Nov 24 16:48:54.164541 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.fernet_utils [None req-dc6bf8cd-6775-4786-8634-4265fefe289c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=71939) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:289}} Nov 24 16:48:54.294828 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: [pid: 71939|app: 0|req: 968/1924] 10.222.0.53 () {58 vars in 948 bytes} [Wed Nov 24 16:48:54 2021] POST /identity/v3/auth/tokens => generated 3669 bytes in 197 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Nov 24 16:48:54.344466 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.notifications [None req-49a21b1b-2eb6-4df6-b68e-ace4b86e2bdb admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e7b6d6e008a248719ca4cd8595277f78'} {{(pid=71938) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:357}} Nov 24 16:48:54.365616 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.notifications [None req-49a21b1b-2eb6-4df6-b68e-ace4b86e2bdb admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e7b6d6e008a248719ca4cd8595277f78'} {{(pid=71938) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:357}} Nov 24 16:48:54.367254 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.notifications [None req-49a21b1b-2eb6-4df6-b68e-ace4b86e2bdb admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e7b6d6e008a248719ca4cd8595277f78'} {{(pid=71938) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:357}} Nov 24 16:48:54.376333 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.notifications [None req-49a21b1b-2eb6-4df6-b68e-ace4b86e2bdb admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e7b6d6e008a248719ca4cd8595277f78'} {{(pid=71938) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:357}} Nov 24 16:48:54.383811 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc6bf8cd-6775-4786-8634-4265fefe289c None None] Authenticating user token {{(pid=71939) process_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 24 16:48:54.384358 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.notifications [None req-49a21b1b-2eb6-4df6-b68e-ace4b86e2bdb admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e7b6d6e008a248719ca4cd8595277f78'} {{(pid=71938) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:357}} Nov 24 16:48:54.385991 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.fernet_utils [None req-dc6bf8cd-6775-4786-8634-4265fefe289c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=71939) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:289}} Nov 24 16:48:54.396956 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: [pid: 71938|app: 0|req: 957/1925] 10.222.0.53 () {58 vars in 1214 bytes} [Wed Nov 24 16:48:54 2021] DELETE /identity/v3/users/e7b6d6e008a248719ca4cd8595277f78 => generated 0 bytes in 354 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 24 16:48:54.401241 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-206df23e-a4c3-4c7a-8e37-2c8015adb83e None None] REQUEST_METHOD: `POST` {{(pid=71938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 24 16:48:54.401807 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-206df23e-a4c3-4c7a-8e37-2c8015adb83e None None] SCRIPT_NAME: `/identity` {{(pid=71938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 24 16:48:54.402456 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-206df23e-a4c3-4c7a-8e37-2c8015adb83e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=71938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 24 16:48:54.442469 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.auth.core [None req-206df23e-a4c3-4c7a-8e37-2c8015adb83e None None] MFA Rules not processed for user `0f2ba2e8375b4e8c8792ee1e22b60427`. Rule list: `[]` (Enabled: `True`). {{(pid=71938) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:442}} Nov 24 16:48:54.444241 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.fernet_utils [None req-206df23e-a4c3-4c7a-8e37-2c8015adb83e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=71938) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:289}} Nov 24 16:48:54.544891 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: [pid: 71938|app: 0|req: 958/1926] 10.222.0.53 () {58 vars in 948 bytes} [Wed Nov 24 16:48:54 2021] POST /identity/v3/auth/tokens => generated 3669 bytes in 145 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 24 16:48:54.547367 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46913d2d-3db8-455e-b02f-862878cea6dc None None] REQUEST_METHOD: `GET` {{(pid=71938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 24 16:48:54.547898 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46913d2d-3db8-455e-b02f-862878cea6dc None None] SCRIPT_NAME: `/identity` {{(pid=71938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 24 16:48:54.548418 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46913d2d-3db8-455e-b02f-862878cea6dc None None] PATH_INFO: `/` {{(pid=71938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 24 16:48:54.550498 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: [pid: 71938|app: 0|req: 959/1927] 10.222.0.53 () {54 vars in 910 bytes} [Wed Nov 24 16:48:54 2021] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 24 16:48:54.562896 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc6bf8cd-6775-4786-8634-4265fefe289c None None] Validating token access rules against request {{(pid=71939) validate_allowed_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 24 16:48:54.566465 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41993c7c-f444-4a7f-aa07-9a1b30cb0eea None None] REQUEST_METHOD: `POST` {{(pid=71938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 24 16:48:54.567165 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41993c7c-f444-4a7f-aa07-9a1b30cb0eea None None] SCRIPT_NAME: `/identity` {{(pid=71938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 24 16:48:54.567600 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41993c7c-f444-4a7f-aa07-9a1b30cb0eea None None] PATH_INFO: `/v3/auth/tokens` {{(pid=71938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 24 16:48:54.614186 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.auth.core [None req-41993c7c-f444-4a7f-aa07-9a1b30cb0eea None None] MFA Rules not processed for user `3e196802d4d5432482b6d2eabc25f74e`. Rule list: `[]` (Enabled: `True`). {{(pid=71938) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:442}} Nov 24 16:48:54.615551 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.fernet_utils [None req-41993c7c-f444-4a7f-aa07-9a1b30cb0eea None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=71938) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:289}} Nov 24 16:48:54.709778 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c6c00ff-1ef4-47a0-a091-5b49b6cea7fd service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c90f21b9cdcb413282461fa83cb6b7a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3b3940d4ae1c4177ae29c02377bb4b0b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=71939) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 24 16:48:54.710538 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c6c00ff-1ef4-47a0-a091-5b49b6cea7fd service neutron] REQUEST_METHOD: `GET` {{(pid=71939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 24 16:48:54.710885 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c6c00ff-1ef4-47a0-a091-5b49b6cea7fd service neutron] SCRIPT_NAME: `/identity` {{(pid=71939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 24 16:48:54.711223 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c6c00ff-1ef4-47a0-a091-5b49b6cea7fd service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=71939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 24 16:48:54.716290 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.fernet_utils [None req-4c6c00ff-1ef4-47a0-a091-5b49b6cea7fd service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=71939) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:289}} Nov 24 16:48:54.745092 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c6c00ff-1ef4-47a0-a091-5b49b6cea7fd service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=71939) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:442}} Nov 24 16:48:54.770484 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: [pid: 71938|app: 0|req: 960/1928] 10.222.0.53 () {58 vars in 1008 bytes} [Wed Nov 24 16:48:54 2021] POST /identity/v3/auth/tokens => generated 3802 bytes in 205 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 24 16:48:54.771463 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41993c7c-f444-4a7f-aa07-9a1b30cb0eea None None] Authenticating user token {{(pid=71938) process_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 24 16:48:54.773741 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.fernet_utils [None req-41993c7c-f444-4a7f-aa07-9a1b30cb0eea None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=71938) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:289}} Nov 24 16:48:54.775007 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c6c00ff-1ef4-47a0-a091-5b49b6cea7fd service neutron] RBAC: Authorization granted {{(pid=71939) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 24 16:48:54.794069 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: [pid: 71939|app: 0|req: 969/1929] 10.222.0.53 () {60 vars in 1356 bytes} [Wed Nov 24 16:48:54 2021] GET /identity/v3/auth/tokens => generated 3669 bytes in 411 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 24 16:48:54.803098 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41993c7c-f444-4a7f-aa07-9a1b30cb0eea None None] Validating token access rules against request {{(pid=71938) validate_allowed_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 24 16:48:54.812210 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44b7b3e0-6d73-4019-8e9b-a0a719ca6ce8 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c90f21b9cdcb413282461fa83cb6b7a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3b3940d4ae1c4177ae29c02377bb4b0b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=71938) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 24 16:48:54.812899 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44b7b3e0-6d73-4019-8e9b-a0a719ca6ce8 service neutron] REQUEST_METHOD: `GET` {{(pid=71938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 24 16:48:54.813244 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44b7b3e0-6d73-4019-8e9b-a0a719ca6ce8 service neutron] SCRIPT_NAME: `/identity` {{(pid=71938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 24 16:48:54.813580 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44b7b3e0-6d73-4019-8e9b-a0a719ca6ce8 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=71938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 24 16:48:54.849122 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44b7b3e0-6d73-4019-8e9b-a0a719ca6ce8 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=71938) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:442}} Nov 24 16:48:54.886931 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44b7b3e0-6d73-4019-8e9b-a0a719ca6ce8 service neutron] RBAC: Authorization granted {{(pid=71938) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 24 16:48:54.901491 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: [pid: 71938|app: 0|req: 961/1930] 10.222.0.53 () {60 vars in 1356 bytes} [Wed Nov 24 16:48:54 2021] GET /identity/v3/auth/tokens => generated 3669 bytes in 130 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 24 16:48:54.928520 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c6c00ff-1ef4-47a0-a091-5b49b6cea7fd service neutron] Authenticating user token {{(pid=71939) process_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 24 16:48:54.931060 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.fernet_utils [None req-4c6c00ff-1ef4-47a0-a091-5b49b6cea7fd service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=71939) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:289}} Nov 24 16:48:54.949894 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c6c00ff-1ef4-47a0-a091-5b49b6cea7fd service neutron] Validating token access rules against request {{(pid=71939) validate_allowed_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 24 16:48:54.958228 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dee6092-61a3-4037-ba1e-a0e414d231d4 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e196802d4d5432482b6d2eabc25f74e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3b3940d4ae1c4177ae29c02377bb4b0b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'service', 'ResellerAdmin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=71939) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 24 16:48:54.958908 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dee6092-61a3-4037-ba1e-a0e414d231d4 service nova] REQUEST_METHOD: `GET` {{(pid=71939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 24 16:48:54.959623 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dee6092-61a3-4037-ba1e-a0e414d231d4 service nova] SCRIPT_NAME: `/identity` {{(pid=71939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 24 16:48:54.959623 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dee6092-61a3-4037-ba1e-a0e414d231d4 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=71939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 24 16:48:54.982763 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1dee6092-61a3-4037-ba1e-a0e414d231d4 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=71939) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:442}} Nov 24 16:48:55.044245 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1dee6092-61a3-4037-ba1e-a0e414d231d4 service nova] RBAC: Authorization granted {{(pid=71939) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 24 16:48:55.101419 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: [pid: 71939|app: 0|req: 970/1931] 10.222.0.53 () {60 vars in 1356 bytes} [Wed Nov 24 16:48:54 2021] GET /identity/v3/auth/tokens => generated 3802 bytes in 173 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 24 16:48:55.253486 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44b7b3e0-6d73-4019-8e9b-a0a719ca6ce8 service neutron] Authenticating user token {{(pid=71938) process_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 24 16:48:55.255836 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.fernet_utils [None req-44b7b3e0-6d73-4019-8e9b-a0a719ca6ce8 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=71938) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:289}} Nov 24 16:48:55.286417 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44b7b3e0-6d73-4019-8e9b-a0a719ca6ce8 service neutron] Validating token access rules against request {{(pid=71938) validate_allowed_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 24 16:48:55.300179 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d05cca1-a6b9-4803-8396-d6964d68c286 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f2ba2e8375b4e8c8792ee1e22b60427', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '00a5583c7b7443e98e7a1d31a0b638dc', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=71938) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 24 16:48:55.301353 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d05cca1-a6b9-4803-8396-d6964d68c286 admin admin] REQUEST_METHOD: `DELETE` {{(pid=71938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 24 16:48:55.302324 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d05cca1-a6b9-4803-8396-d6964d68c286 admin admin] SCRIPT_NAME: `/identity` {{(pid=71938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 24 16:48:55.302847 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d05cca1-a6b9-4803-8396-d6964d68c286 admin admin] PATH_INFO: `/v3/users/086ef1bfab074910b0a218c54431fefd` {{(pid=71938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 24 16:48:55.307347 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d05cca1-a6b9-4803-8396-d6964d68c286 admin admin] RBAC: Authorizing `identity:delete_user(user_id=086ef1bfab074910b0a218c54431fefd)` {{(pid=71938) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:442}} Nov 24 16:48:55.373676 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d05cca1-a6b9-4803-8396-d6964d68c286 admin admin] RBAC: Authorization granted {{(pid=71938) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 24 16:48:55.464147 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.notifications [None req-9d05cca1-a6b9-4803-8396-d6964d68c286 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '086ef1bfab074910b0a218c54431fefd'} {{(pid=71938) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:357}} Nov 24 16:48:55.508937 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.notifications [None req-9d05cca1-a6b9-4803-8396-d6964d68c286 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '086ef1bfab074910b0a218c54431fefd'} {{(pid=71938) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:357}} Nov 24 16:48:55.510960 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.notifications [None req-9d05cca1-a6b9-4803-8396-d6964d68c286 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '086ef1bfab074910b0a218c54431fefd'} {{(pid=71938) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:357}} Nov 24 16:48:55.546394 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.notifications [None req-9d05cca1-a6b9-4803-8396-d6964d68c286 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '086ef1bfab074910b0a218c54431fefd'} {{(pid=71938) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:357}} Nov 24 16:48:55.560404 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.notifications [None req-9d05cca1-a6b9-4803-8396-d6964d68c286 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '086ef1bfab074910b0a218c54431fefd'} {{(pid=71938) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:357}} Nov 24 16:48:55.583536 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: [pid: 71938|app: 0|req: 962/1932] 10.222.0.53 () {58 vars in 1214 bytes} [Wed Nov 24 16:48:55 2021] DELETE /identity/v3/users/086ef1bfab074910b0a218c54431fefd => generated 0 bytes in 332 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 24 16:48:55.588519 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-502e83be-eb54-44d3-a56d-17cb58683f1c None None] REQUEST_METHOD: `POST` {{(pid=71939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 24 16:48:55.588901 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-502e83be-eb54-44d3-a56d-17cb58683f1c None None] SCRIPT_NAME: `/identity` {{(pid=71939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 24 16:48:55.589187 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-502e83be-eb54-44d3-a56d-17cb58683f1c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=71939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 24 16:48:55.625091 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.auth.core [None req-502e83be-eb54-44d3-a56d-17cb58683f1c None None] MFA Rules not processed for user `0f2ba2e8375b4e8c8792ee1e22b60427`. Rule list: `[]` (Enabled: `True`). {{(pid=71939) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:442}} Nov 24 16:48:55.626642 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.fernet_utils [None req-502e83be-eb54-44d3-a56d-17cb58683f1c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=71939) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:289}} Nov 24 16:48:55.782694 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: [pid: 71939|app: 0|req: 971/1933] 10.222.0.53 () {58 vars in 948 bytes} [Wed Nov 24 16:48:55 2021] POST /identity/v3/auth/tokens => generated 3669 bytes in 195 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 24 16:48:55.847558 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d05cca1-a6b9-4803-8396-d6964d68c286 admin admin] Authenticating user token {{(pid=71938) process_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 24 16:48:55.849781 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.fernet_utils [None req-9d05cca1-a6b9-4803-8396-d6964d68c286 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=71938) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:289}} Nov 24 16:48:55.954371 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d05cca1-a6b9-4803-8396-d6964d68c286 admin admin] Validating token access rules against request {{(pid=71938) validate_allowed_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 24 16:48:55.959329 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0c5ee0d-9d2b-4371-a0c3-c6f5935bd9f0 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c90f21b9cdcb413282461fa83cb6b7a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3b3940d4ae1c4177ae29c02377bb4b0b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=71938) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 24 16:48:55.960738 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0c5ee0d-9d2b-4371-a0c3-c6f5935bd9f0 service neutron] REQUEST_METHOD: `GET` {{(pid=71938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 24 16:48:55.961295 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0c5ee0d-9d2b-4371-a0c3-c6f5935bd9f0 service neutron] SCRIPT_NAME: `/identity` {{(pid=71938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 24 16:48:55.961898 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0c5ee0d-9d2b-4371-a0c3-c6f5935bd9f0 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=71938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 24 16:48:55.978242 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0c5ee0d-9d2b-4371-a0c3-c6f5935bd9f0 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=71938) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:442}} Nov 24 16:48:56.018522 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0c5ee0d-9d2b-4371-a0c3-c6f5935bd9f0 service neutron] RBAC: Authorization granted {{(pid=71938) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 24 16:48:56.033198 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: [pid: 71938|app: 0|req: 963/1934] 10.222.0.53 () {60 vars in 1356 bytes} [Wed Nov 24 16:48:55 2021] GET /identity/v3/auth/tokens => generated 3669 bytes in 187 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 24 16:48:57.165551 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-502e83be-eb54-44d3-a56d-17cb58683f1c None None] Authenticating user token {{(pid=71939) process_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 24 16:48:57.167197 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.fernet_utils [None req-502e83be-eb54-44d3-a56d-17cb58683f1c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=71939) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:289}} Nov 24 16:48:57.193674 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-502e83be-eb54-44d3-a56d-17cb58683f1c None None] Validating token access rules against request {{(pid=71939) validate_allowed_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 24 16:48:57.210246 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d15f455-e798-4d2d-bb92-f91385a3ade5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f2ba2e8375b4e8c8792ee1e22b60427', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '00a5583c7b7443e98e7a1d31a0b638dc', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=71939) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 24 16:48:57.212928 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d15f455-e798-4d2d-bb92-f91385a3ade5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=71939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 24 16:48:57.213300 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d15f455-e798-4d2d-bb92-f91385a3ade5 admin admin] SCRIPT_NAME: `/identity` {{(pid=71939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 24 16:48:57.213635 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d15f455-e798-4d2d-bb92-f91385a3ade5 admin admin] PATH_INFO: `/v3/projects/db6c0dd61897450794600d019180825c` {{(pid=71939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 24 16:48:57.218499 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d15f455-e798-4d2d-bb92-f91385a3ade5 admin admin] RBAC: Authorizing `identity:delete_project(project_id=db6c0dd61897450794600d019180825c)` {{(pid=71939) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:442}} Nov 24 16:48:57.254236 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d15f455-e798-4d2d-bb92-f91385a3ade5 admin admin] RBAC: Authorization granted {{(pid=71939) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 24 16:48:57.342431 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.notifications [None req-4d15f455-e798-4d2d-bb92-f91385a3ade5 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'db6c0dd61897450794600d019180825c', 'request_id': 'req-4d15f455-e798-4d2d-bb92-f91385a3ade5'} {{(pid=71939) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:357}} Nov 24 16:48:57.359925 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.notifications [None req-4d15f455-e798-4d2d-bb92-f91385a3ade5 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'db6c0dd61897450794600d019180825c', 'request_id': 'req-4d15f455-e798-4d2d-bb92-f91385a3ade5'} {{(pid=71939) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:357}} Nov 24 16:48:57.369764 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.notifications [None req-4d15f455-e798-4d2d-bb92-f91385a3ade5 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'db6c0dd61897450794600d019180825c', 'request_id': 'req-4d15f455-e798-4d2d-bb92-f91385a3ade5'} {{(pid=71939) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:357}} Nov 24 16:48:57.403519 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.notifications [None req-4d15f455-e798-4d2d-bb92-f91385a3ade5 admin admin] The token cache is being invalidate because project db6c0dd61897450794600d019180825c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=71939) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Nov 24 16:48:57.403953 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.notifications [None req-4d15f455-e798-4d2d-bb92-f91385a3ade5 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=71939) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:357}} Nov 24 16:48:57.405066 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.notifications [None req-4d15f455-e798-4d2d-bb92-f91385a3ade5 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=71939) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:357}} Nov 24 16:48:57.410717 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: [pid: 71939|app: 0|req: 972/1935] 10.222.0.53 () {58 vars in 1223 bytes} [Wed Nov 24 16:48:57 2021] DELETE /identity/v3/projects/db6c0dd61897450794600d019180825c => generated 0 bytes in 242 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 24 16:48:57.412397 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0c5ee0d-9d2b-4371-a0c3-c6f5935bd9f0 service neutron] Authenticating user token {{(pid=71938) process_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 24 16:48:57.430720 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0c5ee0d-9d2b-4371-a0c3-c6f5935bd9f0 service neutron] Validating token access rules against request {{(pid=71938) validate_allowed_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 24 16:48:57.531453 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26161332-f988-4067-a8d5-0508b3e9add8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f2ba2e8375b4e8c8792ee1e22b60427', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '00a5583c7b7443e98e7a1d31a0b638dc', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=71938) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 24 16:48:57.532789 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26161332-f988-4067-a8d5-0508b3e9add8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=71938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 24 16:48:57.533136 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26161332-f988-4067-a8d5-0508b3e9add8 admin admin] SCRIPT_NAME: `/identity` {{(pid=71938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 24 16:48:57.533721 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26161332-f988-4067-a8d5-0508b3e9add8 admin admin] PATH_INFO: `/v3/users/36d03b54bc7e44dab364eb50844a6d38` {{(pid=71938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 24 16:48:57.535055 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26161332-f988-4067-a8d5-0508b3e9add8 admin admin] RBAC: Authorizing `identity:delete_user(user_id=36d03b54bc7e44dab364eb50844a6d38)` {{(pid=71938) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:442}} Nov 24 16:48:57.582348 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26161332-f988-4067-a8d5-0508b3e9add8 admin admin] RBAC: Authorization granted {{(pid=71938) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 24 16:48:57.671313 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.notifications [None req-26161332-f988-4067-a8d5-0508b3e9add8 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '36d03b54bc7e44dab364eb50844a6d38'} {{(pid=71938) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:357}} Nov 24 16:48:57.711402 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.notifications [None req-26161332-f988-4067-a8d5-0508b3e9add8 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '36d03b54bc7e44dab364eb50844a6d38'} {{(pid=71938) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:357}} Nov 24 16:48:57.712890 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.notifications [None req-26161332-f988-4067-a8d5-0508b3e9add8 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '36d03b54bc7e44dab364eb50844a6d38'} {{(pid=71938) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:357}} Nov 24 16:48:57.726426 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.notifications [None req-26161332-f988-4067-a8d5-0508b3e9add8 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '36d03b54bc7e44dab364eb50844a6d38'} {{(pid=71938) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:357}} Nov 24 16:48:57.735141 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.notifications [None req-26161332-f988-4067-a8d5-0508b3e9add8 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '36d03b54bc7e44dab364eb50844a6d38'} {{(pid=71938) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:357}} Nov 24 16:48:57.746360 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: [pid: 71938|app: 0|req: 964/1936] 10.222.0.53 () {58 vars in 1214 bytes} [Wed Nov 24 16:48:57 2021] DELETE /identity/v3/users/36d03b54bc7e44dab364eb50844a6d38 => generated 0 bytes in 335 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 24 16:48:58.284084 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d15f455-e798-4d2d-bb92-f91385a3ade5 admin admin] Authenticating user token {{(pid=71939) process_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 24 16:48:58.286130 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.fernet_utils [None req-4d15f455-e798-4d2d-bb92-f91385a3ade5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=71939) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:289}} Nov 24 16:48:58.304996 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d15f455-e798-4d2d-bb92-f91385a3ade5 admin admin] Validating token access rules against request {{(pid=71939) validate_allowed_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 24 16:48:58.412596 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26161332-f988-4067-a8d5-0508b3e9add8 admin admin] Authenticating user token {{(pid=71938) process_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 24 16:48:58.415339 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.fernet_utils [None req-26161332-f988-4067-a8d5-0508b3e9add8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=71938) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:289}} Nov 24 16:48:58.440729 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dadec8b2-4af0-484d-962e-5892dca6c264 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f2ba2e8375b4e8c8792ee1e22b60427', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '00a5583c7b7443e98e7a1d31a0b638dc', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=71939) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 24 16:48:58.442587 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dadec8b2-4af0-484d-962e-5892dca6c264 admin admin] REQUEST_METHOD: `DELETE` {{(pid=71939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 24 16:48:58.443007 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dadec8b2-4af0-484d-962e-5892dca6c264 admin admin] SCRIPT_NAME: `/identity` {{(pid=71939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 24 16:48:58.443348 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dadec8b2-4af0-484d-962e-5892dca6c264 admin admin] PATH_INFO: `/v3/projects/527c37cdc53f4bfba924ebcfc5efc82a` {{(pid=71939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 24 16:48:58.444830 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dadec8b2-4af0-484d-962e-5892dca6c264 admin admin] RBAC: Authorizing `identity:delete_project(project_id=527c37cdc53f4bfba924ebcfc5efc82a)` {{(pid=71939) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:442}} Nov 24 16:48:58.511020 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dadec8b2-4af0-484d-962e-5892dca6c264 admin admin] RBAC: Authorization granted {{(pid=71939) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 24 16:48:58.593384 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26161332-f988-4067-a8d5-0508b3e9add8 admin admin] Validating token access rules against request {{(pid=71938) validate_allowed_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 24 16:48:58.617563 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-358e2335-831b-48fd-82b2-81cf7193210f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f2ba2e8375b4e8c8792ee1e22b60427', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '00a5583c7b7443e98e7a1d31a0b638dc', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=71938) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 24 16:48:58.619783 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-358e2335-831b-48fd-82b2-81cf7193210f admin admin] REQUEST_METHOD: `DELETE` {{(pid=71938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 24 16:48:58.620327 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-358e2335-831b-48fd-82b2-81cf7193210f admin admin] SCRIPT_NAME: `/identity` {{(pid=71938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 24 16:48:58.620841 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-358e2335-831b-48fd-82b2-81cf7193210f admin admin] PATH_INFO: `/v3/users/8ef78165cb894677b1c13ea35f891902` {{(pid=71938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 24 16:48:58.624263 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-358e2335-831b-48fd-82b2-81cf7193210f admin admin] RBAC: Authorizing `identity:delete_user(user_id=8ef78165cb894677b1c13ea35f891902)` {{(pid=71938) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:442}} Nov 24 16:48:58.649740 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.notifications [None req-dadec8b2-4af0-484d-962e-5892dca6c264 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '527c37cdc53f4bfba924ebcfc5efc82a', 'request_id': 'req-dadec8b2-4af0-484d-962e-5892dca6c264'} {{(pid=71939) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:357}} Nov 24 16:48:58.675026 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-358e2335-831b-48fd-82b2-81cf7193210f admin admin] RBAC: Authorization granted {{(pid=71938) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 24 16:48:58.675949 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.notifications [None req-dadec8b2-4af0-484d-962e-5892dca6c264 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '527c37cdc53f4bfba924ebcfc5efc82a', 'request_id': 'req-dadec8b2-4af0-484d-962e-5892dca6c264'} {{(pid=71939) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:357}} Nov 24 16:48:58.705378 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.notifications [None req-dadec8b2-4af0-484d-962e-5892dca6c264 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '527c37cdc53f4bfba924ebcfc5efc82a', 'request_id': 'req-dadec8b2-4af0-484d-962e-5892dca6c264'} {{(pid=71939) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:357}} Nov 24 16:48:58.727944 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.notifications [None req-dadec8b2-4af0-484d-962e-5892dca6c264 admin admin] The token cache is being invalidate because project 527c37cdc53f4bfba924ebcfc5efc82a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=71939) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Nov 24 16:48:58.728642 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.notifications [None req-dadec8b2-4af0-484d-962e-5892dca6c264 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=71939) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:357}} Nov 24 16:48:58.729552 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.notifications [None req-dadec8b2-4af0-484d-962e-5892dca6c264 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=71939) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:357}} Nov 24 16:48:58.731411 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: [pid: 71939|app: 0|req: 973/1937] 10.222.0.53 () {58 vars in 1223 bytes} [Wed Nov 24 16:48:58 2021] DELETE /identity/v3/projects/527c37cdc53f4bfba924ebcfc5efc82a => generated 0 bytes in 448 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 24 16:48:58.737817 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dadec8b2-4af0-484d-962e-5892dca6c264 admin admin] Authenticating user token {{(pid=71939) process_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 24 16:48:58.743632 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.fernet_utils [None req-dadec8b2-4af0-484d-962e-5892dca6c264 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=71939) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:289}} Nov 24 16:48:58.783728 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.notifications [None req-358e2335-831b-48fd-82b2-81cf7193210f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '8ef78165cb894677b1c13ea35f891902'} {{(pid=71938) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:357}} Nov 24 16:48:58.815607 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.notifications [None req-358e2335-831b-48fd-82b2-81cf7193210f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '8ef78165cb894677b1c13ea35f891902'} {{(pid=71938) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:357}} Nov 24 16:48:58.817023 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.notifications [None req-358e2335-831b-48fd-82b2-81cf7193210f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '8ef78165cb894677b1c13ea35f891902'} {{(pid=71938) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:357}} Nov 24 16:48:58.847658 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.notifications [None req-358e2335-831b-48fd-82b2-81cf7193210f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '8ef78165cb894677b1c13ea35f891902'} {{(pid=71938) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:357}} Nov 24 16:48:58.873269 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.notifications [None req-358e2335-831b-48fd-82b2-81cf7193210f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '8ef78165cb894677b1c13ea35f891902'} {{(pid=71938) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:357}} Nov 24 16:48:58.891473 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: [pid: 71938|app: 0|req: 965/1938] 10.222.0.53 () {58 vars in 1214 bytes} [Wed Nov 24 16:48:58 2021] DELETE /identity/v3/users/8ef78165cb894677b1c13ea35f891902 => generated 0 bytes in 479 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 24 16:48:58.892426 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-358e2335-831b-48fd-82b2-81cf7193210f admin admin] Authenticating user token {{(pid=71938) process_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 24 16:48:58.898073 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.fernet_utils [None req-358e2335-831b-48fd-82b2-81cf7193210f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=71938) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:289}} Nov 24 16:48:58.967210 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dadec8b2-4af0-484d-962e-5892dca6c264 admin admin] Validating token access rules against request {{(pid=71939) validate_allowed_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 24 16:48:59.077657 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-358e2335-831b-48fd-82b2-81cf7193210f admin admin] Validating token access rules against request {{(pid=71938) validate_allowed_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 24 16:48:59.081393 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1333d554-38d1-4068-bdc8-163c709a6cf3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f2ba2e8375b4e8c8792ee1e22b60427', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '00a5583c7b7443e98e7a1d31a0b638dc', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=71939) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 24 16:48:59.082686 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1333d554-38d1-4068-bdc8-163c709a6cf3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=71939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 24 16:48:59.082824 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-574e98b0-30ec-42ea-8ddf-c28fb5e179dc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f2ba2e8375b4e8c8792ee1e22b60427', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '00a5583c7b7443e98e7a1d31a0b638dc', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=71938) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 24 16:48:59.083131 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1333d554-38d1-4068-bdc8-163c709a6cf3 admin admin] SCRIPT_NAME: `/identity` {{(pid=71939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 24 16:48:59.083310 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1333d554-38d1-4068-bdc8-163c709a6cf3 admin admin] PATH_INFO: `/v3/users/c0d45844e0fd48c29ba8d25fb8368c5e` {{(pid=71939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 24 16:48:59.084624 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1333d554-38d1-4068-bdc8-163c709a6cf3 admin admin] RBAC: Authorizing `identity:delete_user(user_id=c0d45844e0fd48c29ba8d25fb8368c5e)` {{(pid=71939) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:442}} Nov 24 16:48:59.085399 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-574e98b0-30ec-42ea-8ddf-c28fb5e179dc admin admin] REQUEST_METHOD: `DELETE` {{(pid=71938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 24 16:48:59.085921 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-574e98b0-30ec-42ea-8ddf-c28fb5e179dc admin admin] SCRIPT_NAME: `/identity` {{(pid=71938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 24 16:48:59.086472 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-574e98b0-30ec-42ea-8ddf-c28fb5e179dc admin admin] PATH_INFO: `/v3/projects/27ee41b6e9e04cf8a39f6dd5bc920ffd` {{(pid=71938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 24 16:48:59.087965 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-574e98b0-30ec-42ea-8ddf-c28fb5e179dc admin admin] RBAC: Authorizing `identity:delete_project(project_id=27ee41b6e9e04cf8a39f6dd5bc920ffd)` {{(pid=71938) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:442}} Nov 24 16:48:59.124188 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1333d554-38d1-4068-bdc8-163c709a6cf3 admin admin] RBAC: Authorization granted {{(pid=71939) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 24 16:48:59.140503 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-574e98b0-30ec-42ea-8ddf-c28fb5e179dc admin admin] RBAC: Authorization granted {{(pid=71938) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 24 16:48:59.192219 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.notifications [None req-1333d554-38d1-4068-bdc8-163c709a6cf3 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c0d45844e0fd48c29ba8d25fb8368c5e'} {{(pid=71939) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:357}} Nov 24 16:48:59.208015 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.notifications [None req-1333d554-38d1-4068-bdc8-163c709a6cf3 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c0d45844e0fd48c29ba8d25fb8368c5e'} {{(pid=71939) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:357}} Nov 24 16:48:59.208858 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.notifications [None req-1333d554-38d1-4068-bdc8-163c709a6cf3 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c0d45844e0fd48c29ba8d25fb8368c5e'} {{(pid=71939) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:357}} Nov 24 16:48:59.219602 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.notifications [None req-1333d554-38d1-4068-bdc8-163c709a6cf3 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c0d45844e0fd48c29ba8d25fb8368c5e'} {{(pid=71939) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:357}} Nov 24 16:48:59.227925 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.notifications [None req-1333d554-38d1-4068-bdc8-163c709a6cf3 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c0d45844e0fd48c29ba8d25fb8368c5e'} {{(pid=71939) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:357}} Nov 24 16:48:59.239900 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: [pid: 71939|app: 0|req: 974/1939] 10.222.0.53 () {58 vars in 1214 bytes} [Wed Nov 24 16:48:58 2021] DELETE /identity/v3/users/c0d45844e0fd48c29ba8d25fb8368c5e => generated 0 bytes in 500 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 24 16:48:59.239900 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-767e368b-6a48-42b1-a3ea-396aa0effcdc None None] REQUEST_METHOD: `POST` {{(pid=71939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 24 16:48:59.239900 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-767e368b-6a48-42b1-a3ea-396aa0effcdc None None] SCRIPT_NAME: `/identity` {{(pid=71939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 24 16:48:59.239900 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-767e368b-6a48-42b1-a3ea-396aa0effcdc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=71939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 24 16:48:59.242682 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.notifications [None req-574e98b0-30ec-42ea-8ddf-c28fb5e179dc admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '27ee41b6e9e04cf8a39f6dd5bc920ffd', 'request_id': 'req-574e98b0-30ec-42ea-8ddf-c28fb5e179dc'} {{(pid=71938) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:357}} Nov 24 16:48:59.267909 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.auth.core [None req-767e368b-6a48-42b1-a3ea-396aa0effcdc None None] MFA Rules not processed for user `0f2ba2e8375b4e8c8792ee1e22b60427`. Rule list: `[]` (Enabled: `True`). {{(pid=71939) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:442}} Nov 24 16:48:59.269368 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.fernet_utils [None req-767e368b-6a48-42b1-a3ea-396aa0effcdc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=71939) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:289}} Nov 24 16:48:59.272337 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.notifications [None req-574e98b0-30ec-42ea-8ddf-c28fb5e179dc admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '27ee41b6e9e04cf8a39f6dd5bc920ffd', 'request_id': 'req-574e98b0-30ec-42ea-8ddf-c28fb5e179dc'} {{(pid=71938) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:357}} Nov 24 16:48:59.299569 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.notifications [None req-574e98b0-30ec-42ea-8ddf-c28fb5e179dc admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '27ee41b6e9e04cf8a39f6dd5bc920ffd', 'request_id': 'req-574e98b0-30ec-42ea-8ddf-c28fb5e179dc'} {{(pid=71938) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:357}} Nov 24 16:48:59.315188 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.notifications [None req-574e98b0-30ec-42ea-8ddf-c28fb5e179dc admin admin] The token cache is being invalidate because project 27ee41b6e9e04cf8a39f6dd5bc920ffd was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=71938) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Nov 24 16:48:59.315991 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.notifications [None req-574e98b0-30ec-42ea-8ddf-c28fb5e179dc admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=71938) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:357}} Nov 24 16:48:59.317311 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.notifications [None req-574e98b0-30ec-42ea-8ddf-c28fb5e179dc admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=71938) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:357}} Nov 24 16:48:59.320087 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: [pid: 71938|app: 0|req: 966/1940] 10.222.0.53 () {58 vars in 1223 bytes} [Wed Nov 24 16:48:58 2021] DELETE /identity/v3/projects/27ee41b6e9e04cf8a39f6dd5bc920ffd => generated 0 bytes in 428 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 24 16:48:59.326335 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57636fcb-6d3e-4ef3-a927-d0c2ebf4d48c None None] REQUEST_METHOD: `POST` {{(pid=71938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 24 16:48:59.326881 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57636fcb-6d3e-4ef3-a927-d0c2ebf4d48c None None] SCRIPT_NAME: `/identity` {{(pid=71938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 24 16:48:59.327402 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57636fcb-6d3e-4ef3-a927-d0c2ebf4d48c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=71938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 24 16:48:59.360348 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.auth.core [None req-57636fcb-6d3e-4ef3-a927-d0c2ebf4d48c None None] MFA Rules not processed for user `0f2ba2e8375b4e8c8792ee1e22b60427`. Rule list: `[]` (Enabled: `True`). {{(pid=71938) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:442}} Nov 24 16:48:59.361970 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.fernet_utils [None req-57636fcb-6d3e-4ef3-a927-d0c2ebf4d48c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=71938) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:289}} Nov 24 16:48:59.369747 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: [pid: 71939|app: 0|req: 975/1941] 10.222.0.53 () {58 vars in 948 bytes} [Wed Nov 24 16:48:59 2021] POST /identity/v3/auth/tokens => generated 3669 bytes in 132 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 24 16:48:59.376928 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: [pid: 71938|app: 0|req: 967/1942] 10.222.0.53 () {58 vars in 948 bytes} [Wed Nov 24 16:48:59 2021] POST /identity/v3/auth/tokens => generated 3669 bytes in 52 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Nov 24 16:48:59.387135 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-057b3505-b944-447a-a1cc-096a59375a1f None None] REQUEST_METHOD: `POST` {{(pid=71939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 24 16:48:59.387545 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-057b3505-b944-447a-a1cc-096a59375a1f None None] SCRIPT_NAME: `/identity` {{(pid=71939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 24 16:48:59.387960 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-057b3505-b944-447a-a1cc-096a59375a1f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=71939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 24 16:48:59.413674 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.auth.core [None req-057b3505-b944-447a-a1cc-096a59375a1f None None] MFA Rules not processed for user `0f2ba2e8375b4e8c8792ee1e22b60427`. Rule list: `[]` (Enabled: `True`). {{(pid=71939) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:442}} Nov 24 16:48:59.415069 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.fernet_utils [None req-057b3505-b944-447a-a1cc-096a59375a1f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=71939) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:289}} Nov 24 16:48:59.427050 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: [pid: 71939|app: 0|req: 976/1943] 10.222.0.53 () {58 vars in 948 bytes} [Wed Nov 24 16:48:59 2021] POST /identity/v3/auth/tokens => generated 3669 bytes in 37 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 24 16:48:59.428373 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57636fcb-6d3e-4ef3-a927-d0c2ebf4d48c None None] Authenticating user token {{(pid=71938) process_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 24 16:48:59.441341 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57636fcb-6d3e-4ef3-a927-d0c2ebf4d48c None None] Validating token access rules against request {{(pid=71938) validate_allowed_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 24 16:48:59.447693 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78d29be6-e787-4d0b-aebb-3084d8d1ce02 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f2ba2e8375b4e8c8792ee1e22b60427', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '00a5583c7b7443e98e7a1d31a0b638dc', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=71938) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 24 16:48:59.448497 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78d29be6-e787-4d0b-aebb-3084d8d1ce02 admin admin] REQUEST_METHOD: `GET` {{(pid=71938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 24 16:48:59.448913 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78d29be6-e787-4d0b-aebb-3084d8d1ce02 admin admin] SCRIPT_NAME: `/identity` {{(pid=71938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 24 16:48:59.449339 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78d29be6-e787-4d0b-aebb-3084d8d1ce02 admin admin] PATH_INFO: `/v3/domains` {{(pid=71938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 24 16:48:59.450249 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78d29be6-e787-4d0b-aebb-3084d8d1ce02 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=71938) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:161}} Nov 24 16:48:59.450649 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78d29be6-e787-4d0b-aebb-3084d8d1ce02 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=71938) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:442}} Nov 24 16:48:59.485114 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78d29be6-e787-4d0b-aebb-3084d8d1ce02 admin admin] RBAC: Authorization granted {{(pid=71938) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 24 16:48:59.505267 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: [pid: 71938|app: 0|req: 968/1944] 10.222.0.53 () {58 vars in 1143 bytes} [Wed Nov 24 16:48:59 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 77 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 24 16:48:59.510430 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-057b3505-b944-447a-a1cc-096a59375a1f None None] Authenticating user token {{(pid=71939) process_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 24 16:48:59.520704 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-057b3505-b944-447a-a1cc-096a59375a1f None None] Validating token access rules against request {{(pid=71939) validate_allowed_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 24 16:48:59.526324 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c0553dd-376e-46d9-8bc1-1b3303eea2d7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f2ba2e8375b4e8c8792ee1e22b60427', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '00a5583c7b7443e98e7a1d31a0b638dc', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=71939) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 24 16:48:59.527021 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c0553dd-376e-46d9-8bc1-1b3303eea2d7 admin admin] REQUEST_METHOD: `POST` {{(pid=71939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 24 16:48:59.527360 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c0553dd-376e-46d9-8bc1-1b3303eea2d7 admin admin] SCRIPT_NAME: `/identity` {{(pid=71939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 24 16:48:59.527672 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c0553dd-376e-46d9-8bc1-1b3303eea2d7 admin admin] PATH_INFO: `/v3/projects` {{(pid=71939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 24 16:48:59.528737 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c0553dd-376e-46d9-8bc1-1b3303eea2d7 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=71939) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:442}} Nov 24 16:48:59.557197 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c0553dd-376e-46d9-8bc1-1b3303eea2d7 admin admin] RBAC: Authorization granted {{(pid=71939) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 24 16:48:59.606553 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: [pid: 71939|app: 0|req: 977/1945] 10.222.0.53 () {60 vars in 1143 bytes} [Wed Nov 24 16:48:59 2021] POST /identity/v3/projects => generated 373 bytes in 96 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 24 16:48:59.617070 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78d29be6-e787-4d0b-aebb-3084d8d1ce02 admin admin] Authenticating user token {{(pid=71938) process_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 24 16:48:59.633744 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78d29be6-e787-4d0b-aebb-3084d8d1ce02 admin admin] Validating token access rules against request {{(pid=71938) validate_allowed_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 24 16:48:59.669618 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c0553dd-376e-46d9-8bc1-1b3303eea2d7 admin admin] Authenticating user token {{(pid=71939) process_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 24 16:48:59.671642 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.fernet_utils [None req-2c0553dd-376e-46d9-8bc1-1b3303eea2d7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=71939) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:289}} Nov 24 16:48:59.801121 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1ebc937-f3ea-4817-913a-f6cb439b0909 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f2ba2e8375b4e8c8792ee1e22b60427', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '00a5583c7b7443e98e7a1d31a0b638dc', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=71938) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 24 16:48:59.801725 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1ebc937-f3ea-4817-913a-f6cb439b0909 admin admin] REQUEST_METHOD: `POST` {{(pid=71938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 24 16:48:59.802082 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1ebc937-f3ea-4817-913a-f6cb439b0909 admin admin] SCRIPT_NAME: `/identity` {{(pid=71938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 24 16:48:59.802421 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1ebc937-f3ea-4817-913a-f6cb439b0909 admin admin] PATH_INFO: `/v3/users` {{(pid=71938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 24 16:48:59.803168 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1ebc937-f3ea-4817-913a-f6cb439b0909 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=71938) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:442}} Nov 24 16:48:59.824102 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c0553dd-376e-46d9-8bc1-1b3303eea2d7 admin admin] Validating token access rules against request {{(pid=71939) validate_allowed_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 24 16:48:59.829775 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff81adbc-0105-4a55-aecf-d1a3f33b2b42 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c90f21b9cdcb413282461fa83cb6b7a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3b3940d4ae1c4177ae29c02377bb4b0b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=71939) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 24 16:48:59.830826 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff81adbc-0105-4a55-aecf-d1a3f33b2b42 service neutron] REQUEST_METHOD: `GET` {{(pid=71939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 24 16:48:59.832033 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff81adbc-0105-4a55-aecf-d1a3f33b2b42 service neutron] SCRIPT_NAME: `/identity` {{(pid=71939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 24 16:48:59.832828 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff81adbc-0105-4a55-aecf-d1a3f33b2b42 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=71939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 24 16:48:59.847085 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff81adbc-0105-4a55-aecf-d1a3f33b2b42 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=71939) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:442}} Nov 24 16:48:59.868077 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1ebc937-f3ea-4817-913a-f6cb439b0909 admin admin] RBAC: Authorization granted {{(pid=71938) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 24 16:48:59.885809 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff81adbc-0105-4a55-aecf-d1a3f33b2b42 service neutron] RBAC: Authorization granted {{(pid=71939) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 24 16:48:59.901776 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: [pid: 71939|app: 0|req: 978/1946] 10.222.0.53 () {60 vars in 1356 bytes} [Wed Nov 24 16:48:59 2021] GET /identity/v3/auth/tokens => generated 3669 bytes in 233 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Nov 24 16:48:59.912838 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: [pid: 71938|app: 0|req: 969/1947] 10.222.0.53 () {60 vars in 1134 bytes} [Wed Nov 24 16:48:59 2021] POST /identity/v3/users => generated 287 bytes in 297 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 24 16:48:59.917877 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff81adbc-0105-4a55-aecf-d1a3f33b2b42 service neutron] Authenticating user token {{(pid=71939) process_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 24 16:48:59.930968 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff81adbc-0105-4a55-aecf-d1a3f33b2b42 service neutron] Validating token access rules against request {{(pid=71939) validate_allowed_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 24 16:48:59.936708 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f1a663c-e165-4557-91ea-72fccedc176e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f2ba2e8375b4e8c8792ee1e22b60427', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '00a5583c7b7443e98e7a1d31a0b638dc', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=71939) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 24 16:48:59.937574 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f1a663c-e165-4557-91ea-72fccedc176e admin admin] REQUEST_METHOD: `GET` {{(pid=71939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 24 16:48:59.938045 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f1a663c-e165-4557-91ea-72fccedc176e admin admin] SCRIPT_NAME: `/identity` {{(pid=71939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 24 16:48:59.938495 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f1a663c-e165-4557-91ea-72fccedc176e admin admin] PATH_INFO: `/v3/roles` {{(pid=71939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 24 16:48:59.940280 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f1a663c-e165-4557-91ea-72fccedc176e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=71939) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:442}} Nov 24 16:48:59.976739 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f1a663c-e165-4557-91ea-72fccedc176e admin admin] RBAC: Authorization granted {{(pid=71939) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 24 16:48:59.991568 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: [pid: 71939|app: 0|req: 979/1948] 10.222.0.53 () {58 vars in 1112 bytes} [Wed Nov 24 16:48:59 2021] GET /identity/v3/roles => generated 1420 bytes in 74 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 24 16:48:59.995908 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1ebc937-f3ea-4817-913a-f6cb439b0909 admin admin] Authenticating user token {{(pid=71938) process_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 24 16:49:00.008260 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1ebc937-f3ea-4817-913a-f6cb439b0909 admin admin] Validating token access rules against request {{(pid=71938) validate_allowed_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 24 16:49:00.012936 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8760483d-39e6-4f27-ad55-0bc94889572c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f2ba2e8375b4e8c8792ee1e22b60427', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '00a5583c7b7443e98e7a1d31a0b638dc', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=71938) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 24 16:49:00.014234 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8760483d-39e6-4f27-ad55-0bc94889572c admin admin] REQUEST_METHOD: `PUT` {{(pid=71938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 24 16:49:00.014816 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8760483d-39e6-4f27-ad55-0bc94889572c admin admin] SCRIPT_NAME: `/identity` {{(pid=71938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 24 16:49:00.015251 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8760483d-39e6-4f27-ad55-0bc94889572c admin admin] PATH_INFO: `/v3/projects/ea299e83029c4dea8b579a4962317c83/users/5dc1251782a14dcfa683e97a589833f3/roles/912ab5f10fa5477da74acf239f07604e` {{(pid=71938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 24 16:49:00.040670 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8760483d-39e6-4f27-ad55-0bc94889572c admin admin] RBAC: Authorizing `identity:create_grant(project_id=ea299e83029c4dea8b579a4962317c83, user_id=5dc1251782a14dcfa683e97a589833f3, role_id=912ab5f10fa5477da74acf239f07604e)` {{(pid=71938) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:442}} Nov 24 16:49:00.075775 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8760483d-39e6-4f27-ad55-0bc94889572c admin admin] RBAC: Authorization granted {{(pid=71938) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 24 16:49:00.095686 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: [pid: 71938|app: 0|req: 970/1949] 10.222.0.53 () {60 vars in 1473 bytes} [Wed Nov 24 16:48:59 2021] PUT /identity/v3/projects/ea299e83029c4dea8b579a4962317c83/users/5dc1251782a14dcfa683e97a589833f3/roles/912ab5f10fa5477da74acf239f07604e => generated 0 bytes in 100 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Nov 24 16:49:00.107004 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c87084b-411e-46ba-a0c8-ad5caed6cf0c None None] REQUEST_METHOD: `POST` {{(pid=71939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 24 16:49:00.107672 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c87084b-411e-46ba-a0c8-ad5caed6cf0c None None] SCRIPT_NAME: `/identity` {{(pid=71939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 24 16:49:00.108881 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c87084b-411e-46ba-a0c8-ad5caed6cf0c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=71939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 24 16:49:00.158256 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.auth.core [None req-0c87084b-411e-46ba-a0c8-ad5caed6cf0c None None] MFA Rules not processed for user `5dc1251782a14dcfa683e97a589833f3`. Rule list: `[]` (Enabled: `True`). {{(pid=71939) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:442}} Nov 24 16:49:00.159865 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.fernet_utils [None req-0c87084b-411e-46ba-a0c8-ad5caed6cf0c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=71939) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:289}} Nov 24 16:49:00.348143 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: [pid: 71939|app: 0|req: 980/1950] 10.222.0.53 () {58 vars in 948 bytes} [Wed Nov 24 16:49:00 2021] POST /identity/v3/auth/tokens => generated 3680 bytes in 242 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 24 16:49:00.355123 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8760483d-39e6-4f27-ad55-0bc94889572c admin admin] Authenticating user token {{(pid=71938) process_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 24 16:49:00.399137 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c87084b-411e-46ba-a0c8-ad5caed6cf0c None None] Authenticating user token {{(pid=71939) process_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 24 16:49:00.400696 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.fernet_utils [None req-0c87084b-411e-46ba-a0c8-ad5caed6cf0c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=71939) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:289}} Nov 24 16:49:00.478319 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8760483d-39e6-4f27-ad55-0bc94889572c admin admin] Validating token access rules against request {{(pid=71938) validate_allowed_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 24 16:49:00.500746 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-376eeb25-b8b4-40eb-8864-acb940d9a046 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f2ba2e8375b4e8c8792ee1e22b60427', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '00a5583c7b7443e98e7a1d31a0b638dc', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=71938) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 24 16:49:00.501765 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-376eeb25-b8b4-40eb-8864-acb940d9a046 admin admin] REQUEST_METHOD: `POST` {{(pid=71938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 24 16:49:00.502421 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-376eeb25-b8b4-40eb-8864-acb940d9a046 admin admin] SCRIPT_NAME: `/identity` {{(pid=71938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 24 16:49:00.502949 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-376eeb25-b8b4-40eb-8864-acb940d9a046 admin admin] PATH_INFO: `/v3/projects` {{(pid=71938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 24 16:49:00.503906 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-376eeb25-b8b4-40eb-8864-acb940d9a046 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=71938) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:442}} Nov 24 16:49:00.510362 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c87084b-411e-46ba-a0c8-ad5caed6cf0c None None] Validating token access rules against request {{(pid=71939) validate_allowed_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 24 16:49:00.527123 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c0fc9fb-84d7-4f9e-985d-d71b8605cc0d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f2ba2e8375b4e8c8792ee1e22b60427', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '00a5583c7b7443e98e7a1d31a0b638dc', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=71939) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 24 16:49:00.527963 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c0fc9fb-84d7-4f9e-985d-d71b8605cc0d admin admin] REQUEST_METHOD: `DELETE` {{(pid=71939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 24 16:49:00.528303 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c0fc9fb-84d7-4f9e-985d-d71b8605cc0d admin admin] SCRIPT_NAME: `/identity` {{(pid=71939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 24 16:49:00.528638 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c0fc9fb-84d7-4f9e-985d-d71b8605cc0d admin admin] PATH_INFO: `/v3/projects/28de210abd2e42eab64d674fd6222ba3` {{(pid=71939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 24 16:49:00.532536 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c0fc9fb-84d7-4f9e-985d-d71b8605cc0d admin admin] RBAC: Authorizing `identity:delete_project(project_id=28de210abd2e42eab64d674fd6222ba3)` {{(pid=71939) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:442}} Nov 24 16:49:00.580843 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-376eeb25-b8b4-40eb-8864-acb940d9a046 admin admin] RBAC: Authorization granted {{(pid=71938) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 24 16:49:00.593530 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c0fc9fb-84d7-4f9e-985d-d71b8605cc0d admin admin] RBAC: Authorization granted {{(pid=71939) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 24 16:49:00.646717 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: [pid: 71938|app: 0|req: 971/1951] 10.222.0.53 () {60 vars in 1143 bytes} [Wed Nov 24 16:49:00 2021] POST /identity/v3/projects => generated 371 bytes in 292 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 24 16:49:00.659734 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-376eeb25-b8b4-40eb-8864-acb940d9a046 admin admin] Authenticating user token {{(pid=71938) process_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 24 16:49:00.682104 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.notifications [None req-8c0fc9fb-84d7-4f9e-985d-d71b8605cc0d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '28de210abd2e42eab64d674fd6222ba3', 'request_id': 'req-8c0fc9fb-84d7-4f9e-985d-d71b8605cc0d'} {{(pid=71939) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:357}} Nov 24 16:49:00.712074 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.notifications [None req-8c0fc9fb-84d7-4f9e-985d-d71b8605cc0d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '28de210abd2e42eab64d674fd6222ba3', 'request_id': 'req-8c0fc9fb-84d7-4f9e-985d-d71b8605cc0d'} {{(pid=71939) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:357}} Nov 24 16:49:00.727921 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.notifications [None req-8c0fc9fb-84d7-4f9e-985d-d71b8605cc0d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '28de210abd2e42eab64d674fd6222ba3', 'request_id': 'req-8c0fc9fb-84d7-4f9e-985d-d71b8605cc0d'} {{(pid=71939) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:357}} Nov 24 16:49:00.755577 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.notifications [None req-8c0fc9fb-84d7-4f9e-985d-d71b8605cc0d admin admin] The token cache is being invalidate because project 28de210abd2e42eab64d674fd6222ba3 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=71939) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Nov 24 16:49:00.758459 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.notifications [None req-8c0fc9fb-84d7-4f9e-985d-d71b8605cc0d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=71939) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:357}} Nov 24 16:49:00.760898 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.notifications [None req-8c0fc9fb-84d7-4f9e-985d-d71b8605cc0d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=71939) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:357}} Nov 24 16:49:00.763393 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: [pid: 71939|app: 0|req: 981/1952] 10.222.0.53 () {58 vars in 1223 bytes} [Wed Nov 24 16:49:00 2021] DELETE /identity/v3/projects/28de210abd2e42eab64d674fd6222ba3 => generated 0 bytes in 365 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 24 16:49:00.769535 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cfa0176-0430-47c7-bb63-aa0666f7c43b None None] REQUEST_METHOD: `POST` {{(pid=71939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 24 16:49:00.770290 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cfa0176-0430-47c7-bb63-aa0666f7c43b None None] SCRIPT_NAME: `/identity` {{(pid=71939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 24 16:49:00.770814 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cfa0176-0430-47c7-bb63-aa0666f7c43b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=71939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 24 16:49:00.818674 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.auth.core [None req-9cfa0176-0430-47c7-bb63-aa0666f7c43b None None] MFA Rules not processed for user `0f2ba2e8375b4e8c8792ee1e22b60427`. Rule list: `[]` (Enabled: `True`). {{(pid=71939) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:442}} Nov 24 16:49:00.820894 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.fernet_utils [None req-9cfa0176-0430-47c7-bb63-aa0666f7c43b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=71939) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:289}} Nov 24 16:49:00.911124 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-376eeb25-b8b4-40eb-8864-acb940d9a046 admin admin] Validating token access rules against request {{(pid=71938) validate_allowed_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 24 16:49:00.928201 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21180ce4-b004-4410-9889-246081ee1918 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f2ba2e8375b4e8c8792ee1e22b60427', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '00a5583c7b7443e98e7a1d31a0b638dc', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=71938) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 24 16:49:00.928935 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21180ce4-b004-4410-9889-246081ee1918 admin admin] REQUEST_METHOD: `POST` {{(pid=71938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 24 16:49:00.929272 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21180ce4-b004-4410-9889-246081ee1918 admin admin] SCRIPT_NAME: `/identity` {{(pid=71938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 24 16:49:00.930073 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21180ce4-b004-4410-9889-246081ee1918 admin admin] PATH_INFO: `/v3/users` {{(pid=71938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 24 16:49:00.930831 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21180ce4-b004-4410-9889-246081ee1918 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=71938) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:442}} Nov 24 16:49:00.951686 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: [pid: 71939|app: 0|req: 982/1953] 10.222.0.53 () {58 vars in 948 bytes} [Wed Nov 24 16:49:00 2021] POST /identity/v3/auth/tokens => generated 3669 bytes in 183 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Nov 24 16:49:00.953158 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cfa0176-0430-47c7-bb63-aa0666f7c43b None None] Authenticating user token {{(pid=71939) process_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 24 16:49:00.954693 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.fernet_utils [None req-9cfa0176-0430-47c7-bb63-aa0666f7c43b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=71939) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:289}} Nov 24 16:49:00.969552 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cfa0176-0430-47c7-bb63-aa0666f7c43b None None] Validating token access rules against request {{(pid=71939) validate_allowed_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 24 16:49:00.977577 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1a56b13-d7f4-435b-adeb-30375f30e153 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f2ba2e8375b4e8c8792ee1e22b60427', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '00a5583c7b7443e98e7a1d31a0b638dc', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=71939) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 24 16:49:00.978541 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1a56b13-d7f4-435b-adeb-30375f30e153 admin admin] REQUEST_METHOD: `DELETE` {{(pid=71939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 24 16:49:00.978884 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1a56b13-d7f4-435b-adeb-30375f30e153 admin admin] SCRIPT_NAME: `/identity` {{(pid=71939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 24 16:49:00.979219 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1a56b13-d7f4-435b-adeb-30375f30e153 admin admin] PATH_INFO: `/v3/projects/790523f1583543318dfff071b27f439f` {{(pid=71939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 24 16:49:00.980706 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1a56b13-d7f4-435b-adeb-30375f30e153 admin admin] RBAC: Authorizing `identity:delete_project(project_id=790523f1583543318dfff071b27f439f)` {{(pid=71939) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:442}} Nov 24 16:49:00.992775 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21180ce4-b004-4410-9889-246081ee1918 admin admin] RBAC: Authorization granted {{(pid=71938) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 24 16:49:01.016925 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1a56b13-d7f4-435b-adeb-30375f30e153 admin admin] RBAC: Authorization granted {{(pid=71939) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 24 16:49:01.032400 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: [pid: 71938|app: 0|req: 972/1954] 10.222.0.53 () {60 vars in 1134 bytes} [Wed Nov 24 16:49:00 2021] POST /identity/v3/users => generated 292 bytes in 373 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 24 16:49:01.034818 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a819c9a-30ef-4bf5-809a-aec25640dc87 None None] REQUEST_METHOD: `POST` {{(pid=71938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 24 16:49:01.035167 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a819c9a-30ef-4bf5-809a-aec25640dc87 None None] SCRIPT_NAME: `/identity` {{(pid=71938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 24 16:49:01.046433 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a819c9a-30ef-4bf5-809a-aec25640dc87 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=71938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 24 16:49:01.094307 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.auth.core [None req-3a819c9a-30ef-4bf5-809a-aec25640dc87 None None] MFA Rules not processed for user `0f2ba2e8375b4e8c8792ee1e22b60427`. Rule list: `[]` (Enabled: `True`). {{(pid=71938) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:442}} Nov 24 16:49:01.095491 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.fernet_utils [None req-3a819c9a-30ef-4bf5-809a-aec25640dc87 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=71938) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:289}} Nov 24 16:49:01.121747 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.notifications [None req-c1a56b13-d7f4-435b-adeb-30375f30e153 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '790523f1583543318dfff071b27f439f', 'request_id': 'req-c1a56b13-d7f4-435b-adeb-30375f30e153'} {{(pid=71939) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:357}} Nov 24 16:49:01.156497 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.notifications [None req-c1a56b13-d7f4-435b-adeb-30375f30e153 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '790523f1583543318dfff071b27f439f', 'request_id': 'req-c1a56b13-d7f4-435b-adeb-30375f30e153'} {{(pid=71939) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:357}} Nov 24 16:49:01.168804 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.notifications [None req-c1a56b13-d7f4-435b-adeb-30375f30e153 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '790523f1583543318dfff071b27f439f', 'request_id': 'req-c1a56b13-d7f4-435b-adeb-30375f30e153'} {{(pid=71939) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:357}} Nov 24 16:49:01.195307 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.notifications [None req-c1a56b13-d7f4-435b-adeb-30375f30e153 admin admin] The token cache is being invalidate because project 790523f1583543318dfff071b27f439f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=71939) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Nov 24 16:49:01.198210 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.notifications [None req-c1a56b13-d7f4-435b-adeb-30375f30e153 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=71939) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:357}} Nov 24 16:49:01.199316 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.notifications [None req-c1a56b13-d7f4-435b-adeb-30375f30e153 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=71939) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:357}} Nov 24 16:49:01.211800 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: [pid: 71939|app: 0|req: 983/1955] 10.222.0.53 () {58 vars in 1223 bytes} [Wed Nov 24 16:49:00 2021] DELETE /identity/v3/projects/790523f1583543318dfff071b27f439f => generated 0 bytes in 255 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 24 16:49:01.211800 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1a56b13-d7f4-435b-adeb-30375f30e153 admin admin] Authenticating user token {{(pid=71939) process_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 24 16:49:01.211800 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.fernet_utils [None req-c1a56b13-d7f4-435b-adeb-30375f30e153 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=71939) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:289}} Nov 24 16:49:01.259895 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: [pid: 71938|app: 0|req: 973/1956] 10.222.0.53 () {58 vars in 948 bytes} [Wed Nov 24 16:49:01 2021] POST /identity/v3/auth/tokens => generated 3669 bytes in 227 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 24 16:49:01.266145 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ed6f1ec-1d09-4be2-a3ae-8e44756a497a None None] REQUEST_METHOD: `POST` {{(pid=71938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 24 16:49:01.266712 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ed6f1ec-1d09-4be2-a3ae-8e44756a497a None None] SCRIPT_NAME: `/identity` {{(pid=71938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 24 16:49:01.267240 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ed6f1ec-1d09-4be2-a3ae-8e44756a497a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=71938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 24 16:49:01.322531 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.auth.core [None req-6ed6f1ec-1d09-4be2-a3ae-8e44756a497a None None] MFA Rules not processed for user `0f2ba2e8375b4e8c8792ee1e22b60427`. Rule list: `[]` (Enabled: `True`). {{(pid=71938) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:442}} Nov 24 16:49:01.323771 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.fernet_utils [None req-6ed6f1ec-1d09-4be2-a3ae-8e44756a497a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=71938) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:289}} Nov 24 16:49:01.339951 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: [pid: 71938|app: 0|req: 974/1957] 10.222.0.53 () {58 vars in 948 bytes} [Wed Nov 24 16:49:01 2021] POST /identity/v3/auth/tokens => generated 3669 bytes in 75 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 24 16:49:01.341013 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ed6f1ec-1d09-4be2-a3ae-8e44756a497a None None] Authenticating user token {{(pid=71938) process_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 24 16:49:01.348910 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1a56b13-d7f4-435b-adeb-30375f30e153 admin admin] Validating token access rules against request {{(pid=71939) validate_allowed_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 24 16:49:01.362702 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ed6f1ec-1d09-4be2-a3ae-8e44756a497a None None] Validating token access rules against request {{(pid=71938) validate_allowed_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 24 16:49:01.369165 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33fb9bb3-8175-4630-a567-0ac27611f057 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f2ba2e8375b4e8c8792ee1e22b60427', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '00a5583c7b7443e98e7a1d31a0b638dc', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=71939) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 24 16:49:01.369343 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83f605e9-3bce-4125-b4d3-499ca0f3d6e2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f2ba2e8375b4e8c8792ee1e22b60427', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '00a5583c7b7443e98e7a1d31a0b638dc', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=71938) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 24 16:49:01.369809 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83f605e9-3bce-4125-b4d3-499ca0f3d6e2 admin admin] REQUEST_METHOD: `GET` {{(pid=71938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 24 16:49:01.370266 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33fb9bb3-8175-4630-a567-0ac27611f057 admin admin] REQUEST_METHOD: `GET` {{(pid=71939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 24 16:49:01.370801 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33fb9bb3-8175-4630-a567-0ac27611f057 admin admin] SCRIPT_NAME: `/identity` {{(pid=71939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 24 16:49:01.371252 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33fb9bb3-8175-4630-a567-0ac27611f057 admin admin] PATH_INFO: `/v3/roles` {{(pid=71939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 24 16:49:01.372347 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33fb9bb3-8175-4630-a567-0ac27611f057 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=71939) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:442}} Nov 24 16:49:01.378163 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83f605e9-3bce-4125-b4d3-499ca0f3d6e2 admin admin] SCRIPT_NAME: `/identity` {{(pid=71938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 24 16:49:01.378580 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83f605e9-3bce-4125-b4d3-499ca0f3d6e2 admin admin] PATH_INFO: `/v3/domains` {{(pid=71938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 24 16:49:01.379531 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83f605e9-3bce-4125-b4d3-499ca0f3d6e2 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=71938) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:161}} Nov 24 16:49:01.379972 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83f605e9-3bce-4125-b4d3-499ca0f3d6e2 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=71938) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:442}} Nov 24 16:49:01.446073 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33fb9bb3-8175-4630-a567-0ac27611f057 admin admin] RBAC: Authorization granted {{(pid=71939) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 24 16:49:01.467716 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83f605e9-3bce-4125-b4d3-499ca0f3d6e2 admin admin] RBAC: Authorization granted {{(pid=71938) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 24 16:49:01.468651 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: [pid: 71939|app: 0|req: 984/1958] 10.222.0.53 () {58 vars in 1112 bytes} [Wed Nov 24 16:49:01 2021] GET /identity/v3/roles => generated 1420 bytes in 261 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 24 16:49:01.478119 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aee32b23-175d-44ad-a384-4be6fef347f6 None None] REQUEST_METHOD: `POST` {{(pid=71939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 24 16:49:01.491396 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aee32b23-175d-44ad-a384-4be6fef347f6 None None] SCRIPT_NAME: `/identity` {{(pid=71939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 24 16:49:01.491751 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aee32b23-175d-44ad-a384-4be6fef347f6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=71939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 24 16:49:01.511671 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: [pid: 71938|app: 0|req: 975/1959] 10.222.0.53 () {58 vars in 1143 bytes} [Wed Nov 24 16:49:01 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 24 16:49:01.511671 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83f605e9-3bce-4125-b4d3-499ca0f3d6e2 admin admin] Authenticating user token {{(pid=71938) process_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 24 16:49:01.531479 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83f605e9-3bce-4125-b4d3-499ca0f3d6e2 admin admin] Validating token access rules against request {{(pid=71938) validate_allowed_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 24 16:49:01.543539 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6bdd257-239f-427a-864a-1039bee51889 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f2ba2e8375b4e8c8792ee1e22b60427', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '00a5583c7b7443e98e7a1d31a0b638dc', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=71938) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 24 16:49:01.544507 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6bdd257-239f-427a-864a-1039bee51889 admin admin] REQUEST_METHOD: `PUT` {{(pid=71938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 24 16:49:01.544844 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6bdd257-239f-427a-864a-1039bee51889 admin admin] SCRIPT_NAME: `/identity` {{(pid=71938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 24 16:49:01.545173 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6bdd257-239f-427a-864a-1039bee51889 admin admin] PATH_INFO: `/v3/projects/2916edbd231148c4bf4b1104b409f0ad/users/bc6e1527223040fa8f52e4251bbe3311/roles/5611724e350b41e19921b5961a342582` {{(pid=71938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 24 16:49:01.565889 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.auth.core [None req-aee32b23-175d-44ad-a384-4be6fef347f6 None None] MFA Rules not processed for user `0f2ba2e8375b4e8c8792ee1e22b60427`. Rule list: `[]` (Enabled: `True`). {{(pid=71939) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:442}} Nov 24 16:49:01.567673 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.fernet_utils [None req-aee32b23-175d-44ad-a384-4be6fef347f6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=71939) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:289}} Nov 24 16:49:01.579766 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: [pid: 71939|app: 0|req: 985/1960] 10.222.0.53 () {58 vars in 948 bytes} [Wed Nov 24 16:49:01 2021] POST /identity/v3/auth/tokens => generated 3669 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 24 16:49:01.584048 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aee32b23-175d-44ad-a384-4be6fef347f6 None None] Authenticating user token {{(pid=71939) process_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 24 16:49:01.589943 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6bdd257-239f-427a-864a-1039bee51889 admin admin] RBAC: Authorizing `identity:create_grant(project_id=2916edbd231148c4bf4b1104b409f0ad, user_id=bc6e1527223040fa8f52e4251bbe3311, role_id=5611724e350b41e19921b5961a342582)` {{(pid=71938) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:442}} Nov 24 16:49:01.604984 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aee32b23-175d-44ad-a384-4be6fef347f6 None None] Validating token access rules against request {{(pid=71939) validate_allowed_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 24 16:49:01.617081 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-089d42b2-142d-448c-8251-ef8a2b82fda1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f2ba2e8375b4e8c8792ee1e22b60427', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '00a5583c7b7443e98e7a1d31a0b638dc', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=71939) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 24 16:49:01.618169 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-089d42b2-142d-448c-8251-ef8a2b82fda1 admin admin] REQUEST_METHOD: `POST` {{(pid=71939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 24 16:49:01.618757 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-089d42b2-142d-448c-8251-ef8a2b82fda1 admin admin] SCRIPT_NAME: `/identity` {{(pid=71939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 24 16:49:01.620306 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-089d42b2-142d-448c-8251-ef8a2b82fda1 admin admin] PATH_INFO: `/v3/projects` {{(pid=71939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 24 16:49:01.621333 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-089d42b2-142d-448c-8251-ef8a2b82fda1 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=71939) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:442}} Nov 24 16:49:01.628425 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6bdd257-239f-427a-864a-1039bee51889 admin admin] RBAC: Authorization granted {{(pid=71938) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 24 16:49:01.660128 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-089d42b2-142d-448c-8251-ef8a2b82fda1 admin admin] RBAC: Authorization granted {{(pid=71939) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 24 16:49:01.677880 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: [pid: 71938|app: 0|req: 976/1961] 10.222.0.53 () {60 vars in 1473 bytes} [Wed Nov 24 16:49:01 2021] PUT /identity/v3/projects/2916edbd231148c4bf4b1104b409f0ad/users/bc6e1527223040fa8f52e4251bbe3311/roles/5611724e350b41e19921b5961a342582 => generated 0 bytes in 169 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 24 16:49:01.679928 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6bdd257-239f-427a-864a-1039bee51889 admin admin] Authenticating user token {{(pid=71938) process_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 24 16:49:01.696392 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: [pid: 71939|app: 0|req: 986/1962] 10.222.0.53 () {60 vars in 1143 bytes} [Wed Nov 24 16:49:01 2021] POST /identity/v3/projects => generated 371 bytes in 113 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 24 16:49:01.697782 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-089d42b2-142d-448c-8251-ef8a2b82fda1 admin admin] Authenticating user token {{(pid=71939) process_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 24 16:49:01.777765 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-089d42b2-142d-448c-8251-ef8a2b82fda1 admin admin] Validating token access rules against request {{(pid=71939) validate_allowed_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 24 16:49:01.783976 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51142447-26c0-4c2a-99f7-e5ff0861fdf0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f2ba2e8375b4e8c8792ee1e22b60427', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '00a5583c7b7443e98e7a1d31a0b638dc', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=71939) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 24 16:49:01.784943 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51142447-26c0-4c2a-99f7-e5ff0861fdf0 admin admin] REQUEST_METHOD: `GET` {{(pid=71939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 24 16:49:01.785466 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51142447-26c0-4c2a-99f7-e5ff0861fdf0 admin admin] SCRIPT_NAME: `/identity` {{(pid=71939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 24 16:49:01.786268 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51142447-26c0-4c2a-99f7-e5ff0861fdf0 admin admin] PATH_INFO: `/v3/roles` {{(pid=71939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 24 16:49:01.787247 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51142447-26c0-4c2a-99f7-e5ff0861fdf0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=71939) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:442}} Nov 24 16:49:01.823525 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51142447-26c0-4c2a-99f7-e5ff0861fdf0 admin admin] RBAC: Authorization granted {{(pid=71939) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 24 16:49:01.836931 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: [pid: 71939|app: 0|req: 987/1963] 10.222.0.53 () {58 vars in 1112 bytes} [Wed Nov 24 16:49:01 2021] GET /identity/v3/roles => generated 1420 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 24 16:49:01.838357 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51142447-26c0-4c2a-99f7-e5ff0861fdf0 admin admin] Authenticating user token {{(pid=71939) process_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 24 16:49:01.851109 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51142447-26c0-4c2a-99f7-e5ff0861fdf0 admin admin] Validating token access rules against request {{(pid=71939) validate_allowed_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 24 16:49:01.856928 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d387165-431d-463f-98bf-e1bc04e0ecc6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f2ba2e8375b4e8c8792ee1e22b60427', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '00a5583c7b7443e98e7a1d31a0b638dc', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=71939) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 24 16:49:01.858336 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d387165-431d-463f-98bf-e1bc04e0ecc6 admin admin] REQUEST_METHOD: `POST` {{(pid=71939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 24 16:49:01.858976 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d387165-431d-463f-98bf-e1bc04e0ecc6 admin admin] SCRIPT_NAME: `/identity` {{(pid=71939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 24 16:49:01.859490 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d387165-431d-463f-98bf-e1bc04e0ecc6 admin admin] PATH_INFO: `/v3/users` {{(pid=71939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 24 16:49:01.860817 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6bdd257-239f-427a-864a-1039bee51889 admin admin] Validating token access rules against request {{(pid=71938) validate_allowed_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 24 16:49:01.861409 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d387165-431d-463f-98bf-e1bc04e0ecc6 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=71939) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:442}} Nov 24 16:49:01.874654 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bead0eb1-9ba6-4a37-9e90-838e5a0609a1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f2ba2e8375b4e8c8792ee1e22b60427', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '00a5583c7b7443e98e7a1d31a0b638dc', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=71938) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 24 16:49:01.875348 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bead0eb1-9ba6-4a37-9e90-838e5a0609a1 admin admin] REQUEST_METHOD: `GET` {{(pid=71938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 24 16:49:01.875697 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bead0eb1-9ba6-4a37-9e90-838e5a0609a1 admin admin] SCRIPT_NAME: `/identity` {{(pid=71938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 24 16:49:01.876034 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bead0eb1-9ba6-4a37-9e90-838e5a0609a1 admin admin] PATH_INFO: `/v3/domains` {{(pid=71938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 24 16:49:01.876839 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bead0eb1-9ba6-4a37-9e90-838e5a0609a1 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=71938) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:161}} Nov 24 16:49:01.877199 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bead0eb1-9ba6-4a37-9e90-838e5a0609a1 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=71938) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:442}} Nov 24 16:49:01.896520 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d387165-431d-463f-98bf-e1bc04e0ecc6 admin admin] RBAC: Authorization granted {{(pid=71939) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 24 16:49:01.927598 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: [pid: 71939|app: 0|req: 988/1964] 10.222.0.53 () {60 vars in 1134 bytes} [Wed Nov 24 16:49:01 2021] POST /identity/v3/users => generated 286 bytes in 89 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 24 16:49:01.928875 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d387165-431d-463f-98bf-e1bc04e0ecc6 admin admin] Authenticating user token {{(pid=71939) process_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 24 16:49:01.943419 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bead0eb1-9ba6-4a37-9e90-838e5a0609a1 admin admin] RBAC: Authorization granted {{(pid=71938) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 24 16:49:01.954118 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d387165-431d-463f-98bf-e1bc04e0ecc6 admin admin] Validating token access rules against request {{(pid=71939) validate_allowed_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 24 16:49:01.965456 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff69619e-177b-49b3-9fe3-3375c0561095 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f2ba2e8375b4e8c8792ee1e22b60427', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '00a5583c7b7443e98e7a1d31a0b638dc', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=71939) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 24 16:49:01.967430 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff69619e-177b-49b3-9fe3-3375c0561095 admin admin] REQUEST_METHOD: `PUT` {{(pid=71939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 24 16:49:01.970384 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff69619e-177b-49b3-9fe3-3375c0561095 admin admin] SCRIPT_NAME: `/identity` {{(pid=71939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 24 16:49:01.971473 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff69619e-177b-49b3-9fe3-3375c0561095 admin admin] PATH_INFO: `/v3/projects/2916edbd231148c4bf4b1104b409f0ad/users/bc6e1527223040fa8f52e4251bbe3311/roles/5611724e350b41e19921b5961a342582` {{(pid=71939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 24 16:49:01.975651 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: [pid: 71938|app: 0|req: 977/1965] 10.222.0.53 () {58 vars in 1143 bytes} [Wed Nov 24 16:49:01 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 297 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 24 16:49:01.977274 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bead0eb1-9ba6-4a37-9e90-838e5a0609a1 admin admin] Authenticating user token {{(pid=71938) process_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 24 16:49:01.978490 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff69619e-177b-49b3-9fe3-3375c0561095 admin admin] RBAC: Authorizing `identity:create_grant(project_id=2916edbd231148c4bf4b1104b409f0ad, user_id=bc6e1527223040fa8f52e4251bbe3311, role_id=5611724e350b41e19921b5961a342582)` {{(pid=71939) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:442}} Nov 24 16:49:01.998651 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bead0eb1-9ba6-4a37-9e90-838e5a0609a1 admin admin] Validating token access rules against request {{(pid=71938) validate_allowed_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 24 16:49:02.005156 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-363b4614-83ba-4ac4-a7d0-07d5dd11d515 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f2ba2e8375b4e8c8792ee1e22b60427', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '00a5583c7b7443e98e7a1d31a0b638dc', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=71938) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 24 16:49:02.006159 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-363b4614-83ba-4ac4-a7d0-07d5dd11d515 admin admin] REQUEST_METHOD: `GET` {{(pid=71938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 24 16:49:02.007440 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-363b4614-83ba-4ac4-a7d0-07d5dd11d515 admin admin] SCRIPT_NAME: `/identity` {{(pid=71938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 24 16:49:02.008143 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-363b4614-83ba-4ac4-a7d0-07d5dd11d515 admin admin] PATH_INFO: `/v3/roles` {{(pid=71938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 24 16:49:02.009335 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-363b4614-83ba-4ac4-a7d0-07d5dd11d515 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=71938) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:442}} Nov 24 16:49:02.019373 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff69619e-177b-49b3-9fe3-3375c0561095 admin admin] RBAC: Authorization granted {{(pid=71939) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 24 16:49:02.033298 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: [pid: 71939|app: 0|req: 989/1966] 10.222.0.53 () {60 vars in 1473 bytes} [Wed Nov 24 16:49:01 2021] PUT /identity/v3/projects/2916edbd231148c4bf4b1104b409f0ad/users/bc6e1527223040fa8f52e4251bbe3311/roles/5611724e350b41e19921b5961a342582 => generated 0 bytes in 105 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 24 16:49:02.034329 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff69619e-177b-49b3-9fe3-3375c0561095 admin admin] Authenticating user token {{(pid=71939) process_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 24 16:49:02.046857 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-363b4614-83ba-4ac4-a7d0-07d5dd11d515 admin admin] RBAC: Authorization granted {{(pid=71938) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 24 16:49:02.061452 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: [pid: 71938|app: 0|req: 978/1967] 10.222.0.53 () {58 vars in 1112 bytes} [Wed Nov 24 16:49:01 2021] GET /identity/v3/roles => generated 1420 bytes in 85 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 24 16:49:02.063142 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-363b4614-83ba-4ac4-a7d0-07d5dd11d515 admin admin] Authenticating user token {{(pid=71938) process_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 24 16:49:02.076352 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-363b4614-83ba-4ac4-a7d0-07d5dd11d515 admin admin] Validating token access rules against request {{(pid=71938) validate_allowed_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 24 16:49:02.137783 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff69619e-177b-49b3-9fe3-3375c0561095 admin admin] Validating token access rules against request {{(pid=71939) validate_allowed_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 24 16:49:02.144837 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06793844-05df-4f43-9c60-2bd1fdf0c371 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f2ba2e8375b4e8c8792ee1e22b60427', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '00a5583c7b7443e98e7a1d31a0b638dc', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=71939) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 24 16:49:02.145723 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06793844-05df-4f43-9c60-2bd1fdf0c371 admin admin] REQUEST_METHOD: `POST` {{(pid=71939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 24 16:49:02.146088 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06793844-05df-4f43-9c60-2bd1fdf0c371 admin admin] SCRIPT_NAME: `/identity` {{(pid=71939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 24 16:49:02.146429 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06793844-05df-4f43-9c60-2bd1fdf0c371 admin admin] PATH_INFO: `/v3/projects` {{(pid=71939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 24 16:49:02.147202 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06793844-05df-4f43-9c60-2bd1fdf0c371 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=71939) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:442}} Nov 24 16:49:02.181588 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5514debb-a55f-4ab3-ab83-656c50f33fd0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f2ba2e8375b4e8c8792ee1e22b60427', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '00a5583c7b7443e98e7a1d31a0b638dc', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=71938) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 24 16:49:02.186619 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5514debb-a55f-4ab3-ab83-656c50f33fd0 admin admin] REQUEST_METHOD: `GET` {{(pid=71938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 24 16:49:02.194250 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5514debb-a55f-4ab3-ab83-656c50f33fd0 admin admin] SCRIPT_NAME: `/identity` {{(pid=71938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 24 16:49:02.197475 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5514debb-a55f-4ab3-ab83-656c50f33fd0 admin admin] PATH_INFO: `/v3/roles` {{(pid=71938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 24 16:49:02.198376 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5514debb-a55f-4ab3-ab83-656c50f33fd0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=71938) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:442}} Nov 24 16:49:02.238226 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5514debb-a55f-4ab3-ab83-656c50f33fd0 admin admin] RBAC: Authorization granted {{(pid=71938) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 24 16:49:02.257288 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06793844-05df-4f43-9c60-2bd1fdf0c371 admin admin] RBAC: Authorization granted {{(pid=71939) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 24 16:49:02.266273 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: [pid: 71938|app: 0|req: 979/1968] 10.222.0.53 () {58 vars in 1112 bytes} [Wed Nov 24 16:49:02 2021] GET /identity/v3/roles => generated 1420 bytes in 204 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 24 16:49:02.267836 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5514debb-a55f-4ab3-ab83-656c50f33fd0 admin admin] Authenticating user token {{(pid=71938) process_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 24 16:49:02.281358 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5514debb-a55f-4ab3-ab83-656c50f33fd0 admin admin] Validating token access rules against request {{(pid=71938) validate_allowed_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 24 16:49:02.286495 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64d257f3-635f-4f29-bc45-aba9fb50dc50 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f2ba2e8375b4e8c8792ee1e22b60427', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '00a5583c7b7443e98e7a1d31a0b638dc', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=71938) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 24 16:49:02.287574 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64d257f3-635f-4f29-bc45-aba9fb50dc50 admin admin] REQUEST_METHOD: `PUT` {{(pid=71938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 24 16:49:02.287962 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64d257f3-635f-4f29-bc45-aba9fb50dc50 admin admin] SCRIPT_NAME: `/identity` {{(pid=71938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 24 16:49:02.289472 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64d257f3-635f-4f29-bc45-aba9fb50dc50 admin admin] PATH_INFO: `/v3/projects/66a4bf85a8d348da9024cbcec9ae8d8b/users/6c0736153f94443ab748da08baf8f5dc/roles/912ab5f10fa5477da74acf239f07604e` {{(pid=71938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 24 16:49:02.321035 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: [pid: 71939|app: 0|req: 990/1969] 10.222.0.53 () {60 vars in 1143 bytes} [Wed Nov 24 16:49:02 2021] POST /identity/v3/projects => generated 367 bytes in 284 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 24 16:49:02.321035 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06793844-05df-4f43-9c60-2bd1fdf0c371 admin admin] Authenticating user token {{(pid=71939) process_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 24 16:49:02.329742 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64d257f3-635f-4f29-bc45-aba9fb50dc50 admin admin] RBAC: Authorizing `identity:create_grant(project_id=66a4bf85a8d348da9024cbcec9ae8d8b, user_id=6c0736153f94443ab748da08baf8f5dc, role_id=912ab5f10fa5477da74acf239f07604e)` {{(pid=71938) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:442}} Nov 24 16:49:02.364100 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64d257f3-635f-4f29-bc45-aba9fb50dc50 admin admin] RBAC: Authorization granted {{(pid=71938) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 24 16:49:02.380527 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: [pid: 71938|app: 0|req: 980/1970] 10.222.0.53 () {60 vars in 1473 bytes} [Wed Nov 24 16:49:02 2021] PUT /identity/v3/projects/66a4bf85a8d348da9024cbcec9ae8d8b/users/6c0736153f94443ab748da08baf8f5dc/roles/912ab5f10fa5477da74acf239f07604e => generated 0 bytes in 113 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 24 16:49:02.381427 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64d257f3-635f-4f29-bc45-aba9fb50dc50 admin admin] Authenticating user token {{(pid=71938) process_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 24 16:49:02.438116 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06793844-05df-4f43-9c60-2bd1fdf0c371 admin admin] Validating token access rules against request {{(pid=71939) validate_allowed_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 24 16:49:02.532137 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64d257f3-635f-4f29-bc45-aba9fb50dc50 admin admin] Validating token access rules against request {{(pid=71938) validate_allowed_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 24 16:49:02.534950 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-596739f2-c522-47fa-8e7c-8f1dfe77a0d6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f2ba2e8375b4e8c8792ee1e22b60427', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '00a5583c7b7443e98e7a1d31a0b638dc', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=71939) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 24 16:49:02.538927 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edc0dc51-c390-422b-b905-01059a1108de admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f2ba2e8375b4e8c8792ee1e22b60427', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '00a5583c7b7443e98e7a1d31a0b638dc', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=71938) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 24 16:49:02.539902 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edc0dc51-c390-422b-b905-01059a1108de admin admin] REQUEST_METHOD: `POST` {{(pid=71938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 24 16:49:02.540430 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edc0dc51-c390-422b-b905-01059a1108de admin admin] SCRIPT_NAME: `/identity` {{(pid=71938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 24 16:49:02.540967 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edc0dc51-c390-422b-b905-01059a1108de admin admin] PATH_INFO: `/v3/users` {{(pid=71938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 24 16:49:02.541897 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edc0dc51-c390-422b-b905-01059a1108de admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=71938) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:442}} Nov 24 16:49:02.544041 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-596739f2-c522-47fa-8e7c-8f1dfe77a0d6 admin admin] REQUEST_METHOD: `PUT` {{(pid=71939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 24 16:49:02.544488 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-596739f2-c522-47fa-8e7c-8f1dfe77a0d6 admin admin] SCRIPT_NAME: `/identity` {{(pid=71939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 24 16:49:02.544841 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-596739f2-c522-47fa-8e7c-8f1dfe77a0d6 admin admin] PATH_INFO: `/v3/projects/2916edbd231148c4bf4b1104b409f0ad/users/bc6e1527223040fa8f52e4251bbe3311/roles/912ab5f10fa5477da74acf239f07604e` {{(pid=71939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 24 16:49:02.551816 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-596739f2-c522-47fa-8e7c-8f1dfe77a0d6 admin admin] RBAC: Authorizing `identity:create_grant(project_id=2916edbd231148c4bf4b1104b409f0ad, user_id=bc6e1527223040fa8f52e4251bbe3311, role_id=912ab5f10fa5477da74acf239f07604e)` {{(pid=71939) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:442}} Nov 24 16:49:02.576097 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edc0dc51-c390-422b-b905-01059a1108de admin admin] RBAC: Authorization granted {{(pid=71938) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 24 16:49:02.604803 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: [pid: 71938|app: 0|req: 981/1971] 10.222.0.53 () {60 vars in 1134 bytes} [Wed Nov 24 16:49:02 2021] POST /identity/v3/users => generated 284 bytes in 221 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 24 16:49:02.604803 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26c511ea-1b2d-4e45-99ad-6a91ee40937f None None] REQUEST_METHOD: `POST` {{(pid=71938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 24 16:49:02.604803 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26c511ea-1b2d-4e45-99ad-6a91ee40937f None None] SCRIPT_NAME: `/identity` {{(pid=71938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 24 16:49:02.604803 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26c511ea-1b2d-4e45-99ad-6a91ee40937f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=71938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 24 16:49:02.612003 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-596739f2-c522-47fa-8e7c-8f1dfe77a0d6 admin admin] RBAC: Authorization granted {{(pid=71939) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 24 16:49:02.633057 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.auth.core [None req-26c511ea-1b2d-4e45-99ad-6a91ee40937f None None] MFA Rules not processed for user `0f2ba2e8375b4e8c8792ee1e22b60427`. Rule list: `[]` (Enabled: `True`). {{(pid=71938) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:442}} Nov 24 16:49:02.634895 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.fernet_utils [None req-26c511ea-1b2d-4e45-99ad-6a91ee40937f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=71938) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:289}} Nov 24 16:49:02.641373 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: [pid: 71939|app: 0|req: 991/1972] 10.222.0.53 () {60 vars in 1473 bytes} [Wed Nov 24 16:49:02 2021] PUT /identity/v3/projects/2916edbd231148c4bf4b1104b409f0ad/users/bc6e1527223040fa8f52e4251bbe3311/roles/912ab5f10fa5477da74acf239f07604e => generated 0 bytes in 322 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 24 16:49:02.663960 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-596739f2-c522-47fa-8e7c-8f1dfe77a0d6 admin admin] Authenticating user token {{(pid=71939) process_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 24 16:49:02.675308 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.fernet_utils [None req-596739f2-c522-47fa-8e7c-8f1dfe77a0d6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=71939) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:289}} Nov 24 16:49:02.839351 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: [pid: 71938|app: 0|req: 982/1973] 10.222.0.53 () {58 vars in 948 bytes} [Wed Nov 24 16:49:02 2021] POST /identity/v3/auth/tokens => generated 3669 bytes in 237 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 24 16:49:02.844264 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26c511ea-1b2d-4e45-99ad-6a91ee40937f None None] Authenticating user token {{(pid=71938) process_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 24 16:49:02.870367 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-596739f2-c522-47fa-8e7c-8f1dfe77a0d6 admin admin] Validating token access rules against request {{(pid=71939) validate_allowed_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 24 16:49:02.875957 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-555e9fdc-6e5b-4320-bb5c-ff26e3e197ca admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f2ba2e8375b4e8c8792ee1e22b60427', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '00a5583c7b7443e98e7a1d31a0b638dc', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=71939) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 24 16:49:02.877148 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-555e9fdc-6e5b-4320-bb5c-ff26e3e197ca admin admin] REQUEST_METHOD: `DELETE` {{(pid=71939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 24 16:49:02.877685 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-555e9fdc-6e5b-4320-bb5c-ff26e3e197ca admin admin] SCRIPT_NAME: `/identity` {{(pid=71939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 24 16:49:02.878250 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-555e9fdc-6e5b-4320-bb5c-ff26e3e197ca admin admin] PATH_INFO: `/v3/projects/52d0e1385b2d46abb09243f200d3fa12` {{(pid=71939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 24 16:49:02.880075 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26c511ea-1b2d-4e45-99ad-6a91ee40937f None None] Validating token access rules against request {{(pid=71938) validate_allowed_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 24 16:49:02.880550 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-555e9fdc-6e5b-4320-bb5c-ff26e3e197ca admin admin] RBAC: Authorizing `identity:delete_project(project_id=52d0e1385b2d46abb09243f200d3fa12)` {{(pid=71939) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:442}} Nov 24 16:49:02.902264 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-175b16f5-fb7b-426e-a2d8-984e5970a3a4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f2ba2e8375b4e8c8792ee1e22b60427', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '00a5583c7b7443e98e7a1d31a0b638dc', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=71938) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 24 16:49:02.902974 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-175b16f5-fb7b-426e-a2d8-984e5970a3a4 admin admin] REQUEST_METHOD: `GET` {{(pid=71938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 24 16:49:02.903317 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-175b16f5-fb7b-426e-a2d8-984e5970a3a4 admin admin] SCRIPT_NAME: `/identity` {{(pid=71938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 24 16:49:02.903648 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-175b16f5-fb7b-426e-a2d8-984e5970a3a4 admin admin] PATH_INFO: `/v3/roles` {{(pid=71938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 24 16:49:02.909175 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-175b16f5-fb7b-426e-a2d8-984e5970a3a4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=71938) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:442}} Nov 24 16:49:02.914488 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-555e9fdc-6e5b-4320-bb5c-ff26e3e197ca admin admin] RBAC: Authorization granted {{(pid=71939) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 24 16:49:02.983273 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.notifications [None req-555e9fdc-6e5b-4320-bb5c-ff26e3e197ca admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '52d0e1385b2d46abb09243f200d3fa12', 'request_id': 'req-555e9fdc-6e5b-4320-bb5c-ff26e3e197ca'} {{(pid=71939) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:357}} Nov 24 16:49:02.983774 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-175b16f5-fb7b-426e-a2d8-984e5970a3a4 admin admin] RBAC: Authorization granted {{(pid=71938) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 24 16:49:03.000105 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.notifications [None req-555e9fdc-6e5b-4320-bb5c-ff26e3e197ca admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '52d0e1385b2d46abb09243f200d3fa12', 'request_id': 'req-555e9fdc-6e5b-4320-bb5c-ff26e3e197ca'} {{(pid=71939) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:357}} Nov 24 16:49:03.009316 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.notifications [None req-555e9fdc-6e5b-4320-bb5c-ff26e3e197ca admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '52d0e1385b2d46abb09243f200d3fa12', 'request_id': 'req-555e9fdc-6e5b-4320-bb5c-ff26e3e197ca'} {{(pid=71939) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:357}} Nov 24 16:49:03.018005 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: [pid: 71938|app: 0|req: 983/1974] 10.222.0.53 () {58 vars in 1112 bytes} [Wed Nov 24 16:49:02 2021] GET /identity/v3/roles => generated 1420 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 24 16:49:03.018411 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01fa7df7-9bac-4b96-bf23-340490ff576c None None] REQUEST_METHOD: `POST` {{(pid=71938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 24 16:49:03.018800 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01fa7df7-9bac-4b96-bf23-340490ff576c None None] SCRIPT_NAME: `/identity` {{(pid=71938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 24 16:49:03.019145 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01fa7df7-9bac-4b96-bf23-340490ff576c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=71938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 24 16:49:03.027870 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.notifications [None req-555e9fdc-6e5b-4320-bb5c-ff26e3e197ca admin admin] The token cache is being invalidate because project 52d0e1385b2d46abb09243f200d3fa12 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=71939) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Nov 24 16:49:03.028640 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.notifications [None req-555e9fdc-6e5b-4320-bb5c-ff26e3e197ca admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=71939) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:357}} Nov 24 16:49:03.030175 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.notifications [None req-555e9fdc-6e5b-4320-bb5c-ff26e3e197ca admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=71939) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:357}} Nov 24 16:49:03.032178 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: [pid: 71939|app: 0|req: 992/1975] 10.222.0.53 () {58 vars in 1223 bytes} [Wed Nov 24 16:49:02 2021] DELETE /identity/v3/projects/52d0e1385b2d46abb09243f200d3fa12 => generated 0 bytes in 391 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 24 16:49:03.033795 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-555e9fdc-6e5b-4320-bb5c-ff26e3e197ca admin admin] Authenticating user token {{(pid=71939) process_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 24 16:49:03.035654 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.fernet_utils [None req-555e9fdc-6e5b-4320-bb5c-ff26e3e197ca admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=71939) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:289}} Nov 24 16:49:03.116196 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.auth.core [None req-01fa7df7-9bac-4b96-bf23-340490ff576c None None] MFA Rules not processed for user `bc6e1527223040fa8f52e4251bbe3311`. Rule list: `[]` (Enabled: `True`). {{(pid=71938) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:442}} Nov 24 16:49:03.117752 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.fernet_utils [None req-01fa7df7-9bac-4b96-bf23-340490ff576c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=71938) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:289}} Nov 24 16:49:03.231583 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: [pid: 71938|app: 0|req: 984/1976] 10.222.0.53 () {58 vars in 948 bytes} [Wed Nov 24 16:49:03 2021] POST /identity/v3/auth/tokens => generated 3745 bytes in 216 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 24 16:49:03.233067 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01fa7df7-9bac-4b96-bf23-340490ff576c None None] Authenticating user token {{(pid=71938) process_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 24 16:49:03.251404 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.fernet_utils [None req-01fa7df7-9bac-4b96-bf23-340490ff576c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=71938) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:289}} Nov 24 16:49:03.257493 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-555e9fdc-6e5b-4320-bb5c-ff26e3e197ca admin admin] Validating token access rules against request {{(pid=71939) validate_allowed_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 24 16:49:03.261778 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64272c1a-83f5-4266-9613-89dd06374490 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c90f21b9cdcb413282461fa83cb6b7a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3b3940d4ae1c4177ae29c02377bb4b0b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=71939) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 24 16:49:03.262642 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64272c1a-83f5-4266-9613-89dd06374490 service neutron] REQUEST_METHOD: `GET` {{(pid=71939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 24 16:49:03.263094 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64272c1a-83f5-4266-9613-89dd06374490 service neutron] SCRIPT_NAME: `/identity` {{(pid=71939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 24 16:49:03.263540 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64272c1a-83f5-4266-9613-89dd06374490 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=71939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 24 16:49:03.265628 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.fernet_utils [None req-64272c1a-83f5-4266-9613-89dd06374490 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=71939) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:289}} Nov 24 16:49:03.407457 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01fa7df7-9bac-4b96-bf23-340490ff576c None None] Validating token access rules against request {{(pid=71938) validate_allowed_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 24 16:49:03.415106 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78c0b100-0c8d-44e7-8a2e-1c4a1f576228 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f2ba2e8375b4e8c8792ee1e22b60427', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '00a5583c7b7443e98e7a1d31a0b638dc', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=71938) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 24 16:49:03.416200 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78c0b100-0c8d-44e7-8a2e-1c4a1f576228 admin admin] REQUEST_METHOD: `PUT` {{(pid=71938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 24 16:49:03.416651 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78c0b100-0c8d-44e7-8a2e-1c4a1f576228 admin admin] SCRIPT_NAME: `/identity` {{(pid=71938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 24 16:49:03.417155 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78c0b100-0c8d-44e7-8a2e-1c4a1f576228 admin admin] PATH_INFO: `/v3/projects/8c9805e703a34b558d0f08f3fdb89b3e/users/48e7bef9d9de4753b5f22228eb6ed593/roles/912ab5f10fa5477da74acf239f07604e` {{(pid=71938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 24 16:49:03.432813 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64272c1a-83f5-4266-9613-89dd06374490 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=71939) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:442}} Nov 24 16:49:03.440748 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78c0b100-0c8d-44e7-8a2e-1c4a1f576228 admin admin] RBAC: Authorizing `identity:create_grant(project_id=8c9805e703a34b558d0f08f3fdb89b3e, user_id=48e7bef9d9de4753b5f22228eb6ed593, role_id=912ab5f10fa5477da74acf239f07604e)` {{(pid=71938) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:442}} Nov 24 16:49:03.468162 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64272c1a-83f5-4266-9613-89dd06374490 service neutron] RBAC: Authorization granted {{(pid=71939) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 24 16:49:03.474073 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78c0b100-0c8d-44e7-8a2e-1c4a1f576228 admin admin] RBAC: Authorization granted {{(pid=71938) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 24 16:49:03.481138 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: [pid: 71939|app: 0|req: 993/1977] 10.222.0.53 () {60 vars in 1356 bytes} [Wed Nov 24 16:49:03 2021] GET /identity/v3/auth/tokens => generated 3669 bytes in 448 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 24 16:49:03.486295 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64272c1a-83f5-4266-9613-89dd06374490 service neutron] Authenticating user token {{(pid=71939) process_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 24 16:49:03.490128 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.fernet_utils [None req-64272c1a-83f5-4266-9613-89dd06374490 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=71939) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:289}} Nov 24 16:49:03.502771 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: [pid: 71938|app: 0|req: 985/1978] 10.222.0.53 () {60 vars in 1473 bytes} [Wed Nov 24 16:49:03 2021] PUT /identity/v3/projects/8c9805e703a34b558d0f08f3fdb89b3e/users/48e7bef9d9de4753b5f22228eb6ed593/roles/912ab5f10fa5477da74acf239f07604e => generated 0 bytes in 260 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 24 16:49:03.502771 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78c0b100-0c8d-44e7-8a2e-1c4a1f576228 admin admin] Authenticating user token {{(pid=71938) process_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 24 16:49:03.504738 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.fernet_utils [None req-78c0b100-0c8d-44e7-8a2e-1c4a1f576228 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=71938) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:289}} Nov 24 16:49:03.509162 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64272c1a-83f5-4266-9613-89dd06374490 service neutron] Validating token access rules against request {{(pid=71939) validate_allowed_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 24 16:49:03.602662 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e64cc20-8bc4-48a9-bf88-a8b5d2919ddc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f2ba2e8375b4e8c8792ee1e22b60427', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '00a5583c7b7443e98e7a1d31a0b638dc', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=71939) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 24 16:49:03.603737 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e64cc20-8bc4-48a9-bf88-a8b5d2919ddc admin admin] REQUEST_METHOD: `DELETE` {{(pid=71939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 24 16:49:03.604214 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e64cc20-8bc4-48a9-bf88-a8b5d2919ddc admin admin] SCRIPT_NAME: `/identity` {{(pid=71939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 24 16:49:03.604654 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e64cc20-8bc4-48a9-bf88-a8b5d2919ddc admin admin] PATH_INFO: `/v3/users/5c5e1f31cc864503a91b55a050874198` {{(pid=71939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 24 16:49:03.607052 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e64cc20-8bc4-48a9-bf88-a8b5d2919ddc admin admin] RBAC: Authorizing `identity:delete_user(user_id=5c5e1f31cc864503a91b55a050874198)` {{(pid=71939) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:442}} Nov 24 16:49:03.667571 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78c0b100-0c8d-44e7-8a2e-1c4a1f576228 admin admin] Validating token access rules against request {{(pid=71938) validate_allowed_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 24 16:49:03.672230 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c9b02ac-26ef-4690-a6d2-c1ed1e081095 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a12374a3093a401a97c343ff0854184d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3b3940d4ae1c4177ae29c02377bb4b0b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=71938) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 24 16:49:03.673012 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c9b02ac-26ef-4690-a6d2-c1ed1e081095 service cinder] REQUEST_METHOD: `GET` {{(pid=71938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 24 16:49:03.673455 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c9b02ac-26ef-4690-a6d2-c1ed1e081095 service cinder] SCRIPT_NAME: `/identity` {{(pid=71938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 24 16:49:03.673895 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c9b02ac-26ef-4690-a6d2-c1ed1e081095 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=71938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 24 16:49:03.696675 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e64cc20-8bc4-48a9-bf88-a8b5d2919ddc admin admin] RBAC: Authorization granted {{(pid=71939) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 24 16:49:03.814339 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.notifications [None req-1e64cc20-8bc4-48a9-bf88-a8b5d2919ddc admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '5c5e1f31cc864503a91b55a050874198'} {{(pid=71939) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:357}} Nov 24 16:49:03.844903 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.notifications [None req-1e64cc20-8bc4-48a9-bf88-a8b5d2919ddc admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '5c5e1f31cc864503a91b55a050874198'} {{(pid=71939) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:357}} Nov 24 16:49:03.845865 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.notifications [None req-1e64cc20-8bc4-48a9-bf88-a8b5d2919ddc admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '5c5e1f31cc864503a91b55a050874198'} {{(pid=71939) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:357}} Nov 24 16:49:03.860810 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.notifications [None req-1e64cc20-8bc4-48a9-bf88-a8b5d2919ddc admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '5c5e1f31cc864503a91b55a050874198'} {{(pid=71939) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:357}} Nov 24 16:49:03.884409 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.notifications [None req-1e64cc20-8bc4-48a9-bf88-a8b5d2919ddc admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '5c5e1f31cc864503a91b55a050874198'} {{(pid=71939) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:357}} Nov 24 16:49:03.892920 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: [pid: 71939|app: 0|req: 994/1979] 10.222.0.53 () {58 vars in 1214 bytes} [Wed Nov 24 16:49:03 2021] DELETE /identity/v3/users/5c5e1f31cc864503a91b55a050874198 => generated 0 bytes in 411 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 24 16:49:03.894584 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eafab424-a1d7-4834-a98e-6061492a408c None None] REQUEST_METHOD: `POST` {{(pid=71939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 24 16:49:03.895121 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eafab424-a1d7-4834-a98e-6061492a408c None None] SCRIPT_NAME: `/identity` {{(pid=71939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 24 16:49:03.895643 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eafab424-a1d7-4834-a98e-6061492a408c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=71939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 24 16:49:03.896552 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c9b02ac-26ef-4690-a6d2-c1ed1e081095 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=71938) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:442}} Nov 24 16:49:03.939030 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.auth.core [None req-eafab424-a1d7-4834-a98e-6061492a408c None None] MFA Rules not processed for user `48e7bef9d9de4753b5f22228eb6ed593`. Rule list: `[]` (Enabled: `True`). {{(pid=71939) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:442}} Nov 24 16:49:03.940790 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.fernet_utils [None req-eafab424-a1d7-4834-a98e-6061492a408c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=71939) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:289}} Nov 24 16:49:03.951844 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c9b02ac-26ef-4690-a6d2-c1ed1e081095 service cinder] RBAC: Authorization granted {{(pid=71938) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 24 16:49:04.015595 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: [pid: 71938|app: 0|req: 986/1980] 10.222.0.53 () {60 vars in 1356 bytes} [Wed Nov 24 16:49:03 2021] GET /identity/v3/auth/tokens => generated 3745 bytes in 522 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 24 16:49:04.188616 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: [pid: 71939|app: 0|req: 995/1981] 10.222.0.53 () {58 vars in 948 bytes} [Wed Nov 24 16:49:03 2021] POST /identity/v3/auth/tokens => generated 3674 bytes in 295 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 24 16:49:04.194095 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c9b02ac-26ef-4690-a6d2-c1ed1e081095 service cinder] Authenticating user token {{(pid=71938) process_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 24 16:49:04.219808 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c9b02ac-26ef-4690-a6d2-c1ed1e081095 service cinder] Validating token access rules against request {{(pid=71938) validate_allowed_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 24 16:49:04.496594 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0bebc5d-ee3d-4e79-9a9d-bec1c97f0e0c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f2ba2e8375b4e8c8792ee1e22b60427', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '00a5583c7b7443e98e7a1d31a0b638dc', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=71938) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 24 16:49:04.497898 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0bebc5d-ee3d-4e79-9a9d-bec1c97f0e0c admin admin] REQUEST_METHOD: `POST` {{(pid=71938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 24 16:49:04.500450 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0bebc5d-ee3d-4e79-9a9d-bec1c97f0e0c admin admin] SCRIPT_NAME: `/identity` {{(pid=71938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 24 16:49:04.501025 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0bebc5d-ee3d-4e79-9a9d-bec1c97f0e0c admin admin] PATH_INFO: `/v3/projects` {{(pid=71938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 24 16:49:04.503317 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0bebc5d-ee3d-4e79-9a9d-bec1c97f0e0c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=71938) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:442}} Nov 24 16:49:04.627458 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0bebc5d-ee3d-4e79-9a9d-bec1c97f0e0c admin admin] RBAC: Authorization granted {{(pid=71938) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 24 16:49:04.672549 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eafab424-a1d7-4834-a98e-6061492a408c None None] Authenticating user token {{(pid=71939) process_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 24 16:49:04.674092 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.fernet_utils [None req-eafab424-a1d7-4834-a98e-6061492a408c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=71939) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:289}} Nov 24 16:49:04.706571 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eafab424-a1d7-4834-a98e-6061492a408c None None] Validating token access rules against request {{(pid=71939) validate_allowed_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 24 16:49:04.711680 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70930ed0-9db7-4736-bf48-22377ad7393a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f2ba2e8375b4e8c8792ee1e22b60427', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '00a5583c7b7443e98e7a1d31a0b638dc', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=71939) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 24 16:49:04.713098 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70930ed0-9db7-4736-bf48-22377ad7393a admin admin] REQUEST_METHOD: `DELETE` {{(pid=71939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 24 16:49:04.713628 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70930ed0-9db7-4736-bf48-22377ad7393a admin admin] SCRIPT_NAME: `/identity` {{(pid=71939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 24 16:49:04.714205 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70930ed0-9db7-4736-bf48-22377ad7393a admin admin] PATH_INFO: `/v3/users/5dc1251782a14dcfa683e97a589833f3` {{(pid=71939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 24 16:49:04.714390 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: [pid: 71938|app: 0|req: 987/1982] 10.222.0.53 () {60 vars in 1143 bytes} [Wed Nov 24 16:49:04 2021] POST /identity/v3/projects => generated 369 bytes in 521 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 24 16:49:04.715969 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70930ed0-9db7-4736-bf48-22377ad7393a admin admin] RBAC: Authorizing `identity:delete_user(user_id=5dc1251782a14dcfa683e97a589833f3)` {{(pid=71939) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:442}} Nov 24 16:49:04.718370 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0bebc5d-ee3d-4e79-9a9d-bec1c97f0e0c admin admin] Authenticating user token {{(pid=71938) process_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 24 16:49:04.720336 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.fernet_utils [None req-f0bebc5d-ee3d-4e79-9a9d-bec1c97f0e0c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=71938) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:289}} Nov 24 16:49:04.770505 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70930ed0-9db7-4736-bf48-22377ad7393a admin admin] RBAC: Authorization granted {{(pid=71939) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 24 16:49:04.821355 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0bebc5d-ee3d-4e79-9a9d-bec1c97f0e0c admin admin] Validating token access rules against request {{(pid=71938) validate_allowed_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 24 16:49:04.826949 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30043abd-e832-4989-8cb4-6d20fe4ecdc4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f2ba2e8375b4e8c8792ee1e22b60427', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '00a5583c7b7443e98e7a1d31a0b638dc', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=71938) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 24 16:49:04.828106 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30043abd-e832-4989-8cb4-6d20fe4ecdc4 admin admin] REQUEST_METHOD: `POST` {{(pid=71938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 24 16:49:04.828459 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30043abd-e832-4989-8cb4-6d20fe4ecdc4 admin admin] SCRIPT_NAME: `/identity` {{(pid=71938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 24 16:49:04.828797 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30043abd-e832-4989-8cb4-6d20fe4ecdc4 admin admin] PATH_INFO: `/v3/users` {{(pid=71938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 24 16:49:04.829902 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30043abd-e832-4989-8cb4-6d20fe4ecdc4 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=71938) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:442}} Nov 24 16:49:04.857324 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.notifications [None req-70930ed0-9db7-4736-bf48-22377ad7393a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '5dc1251782a14dcfa683e97a589833f3'} {{(pid=71939) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:357}} Nov 24 16:49:04.872426 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30043abd-e832-4989-8cb4-6d20fe4ecdc4 admin admin] RBAC: Authorization granted {{(pid=71938) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 24 16:49:04.875839 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.notifications [None req-70930ed0-9db7-4736-bf48-22377ad7393a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '5dc1251782a14dcfa683e97a589833f3'} {{(pid=71939) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:357}} Nov 24 16:49:04.876464 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.notifications [None req-70930ed0-9db7-4736-bf48-22377ad7393a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '5dc1251782a14dcfa683e97a589833f3'} {{(pid=71939) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:357}} Nov 24 16:49:04.904257 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.notifications [None req-70930ed0-9db7-4736-bf48-22377ad7393a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '5dc1251782a14dcfa683e97a589833f3'} {{(pid=71939) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:357}} Nov 24 16:49:04.909450 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: [pid: 71938|app: 0|req: 988/1983] 10.222.0.53 () {60 vars in 1134 bytes} [Wed Nov 24 16:49:04 2021] POST /identity/v3/users => generated 291 bytes in 191 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Nov 24 16:49:04.910952 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30043abd-e832-4989-8cb4-6d20fe4ecdc4 admin admin] Authenticating user token {{(pid=71938) process_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 24 16:49:04.914350 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.fernet_utils [None req-30043abd-e832-4989-8cb4-6d20fe4ecdc4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=71938) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:289}} Nov 24 16:49:04.918727 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.notifications [None req-70930ed0-9db7-4736-bf48-22377ad7393a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '5dc1251782a14dcfa683e97a589833f3'} {{(pid=71939) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:357}} Nov 24 16:49:04.927615 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30043abd-e832-4989-8cb4-6d20fe4ecdc4 admin admin] Validating token access rules against request {{(pid=71938) validate_allowed_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 24 16:49:04.928390 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: [pid: 71939|app: 0|req: 996/1984] 10.222.0.53 () {58 vars in 1214 bytes} [Wed Nov 24 16:49:04 2021] DELETE /identity/v3/users/5dc1251782a14dcfa683e97a589833f3 => generated 0 bytes in 256 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 24 16:49:04.933721 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70930ed0-9db7-4736-bf48-22377ad7393a admin admin] Authenticating user token {{(pid=71939) process_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 24 16:49:04.936525 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.fernet_utils [None req-70930ed0-9db7-4736-bf48-22377ad7393a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=71939) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:289}} Nov 24 16:49:05.016113 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b32fa959-a13c-4586-918a-149593de1479 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f2ba2e8375b4e8c8792ee1e22b60427', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '00a5583c7b7443e98e7a1d31a0b638dc', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=71938) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 24 16:49:05.017016 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b32fa959-a13c-4586-918a-149593de1479 admin admin] REQUEST_METHOD: `DELETE` {{(pid=71938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 24 16:49:05.017408 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b32fa959-a13c-4586-918a-149593de1479 admin admin] SCRIPT_NAME: `/identity` {{(pid=71938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 24 16:49:05.017676 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b32fa959-a13c-4586-918a-149593de1479 admin admin] PATH_INFO: `/v3/projects/5a5f651da88c4759abbc0a4ed4870465` {{(pid=71938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 24 16:49:05.019004 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b32fa959-a13c-4586-918a-149593de1479 admin admin] RBAC: Authorizing `identity:delete_project(project_id=5a5f651da88c4759abbc0a4ed4870465)` {{(pid=71938) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:442}} Nov 24 16:49:05.049194 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b32fa959-a13c-4586-918a-149593de1479 admin admin] RBAC: Authorization granted {{(pid=71938) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 24 16:49:05.082490 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70930ed0-9db7-4736-bf48-22377ad7393a admin admin] Validating token access rules against request {{(pid=71939) validate_allowed_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 24 16:49:05.088624 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd0d72a3-be11-4f24-99b1-358e3159acde admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f2ba2e8375b4e8c8792ee1e22b60427', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '00a5583c7b7443e98e7a1d31a0b638dc', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=71939) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 24 16:49:05.089332 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd0d72a3-be11-4f24-99b1-358e3159acde admin admin] REQUEST_METHOD: `GET` {{(pid=71939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 24 16:49:05.089822 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd0d72a3-be11-4f24-99b1-358e3159acde admin admin] SCRIPT_NAME: `/identity` {{(pid=71939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 24 16:49:05.090206 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd0d72a3-be11-4f24-99b1-358e3159acde admin admin] PATH_INFO: `/v3/roles` {{(pid=71939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 24 16:49:05.091282 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd0d72a3-be11-4f24-99b1-358e3159acde admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=71939) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:442}} Nov 24 16:49:05.109505 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.notifications [None req-b32fa959-a13c-4586-918a-149593de1479 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '5a5f651da88c4759abbc0a4ed4870465', 'request_id': 'req-b32fa959-a13c-4586-918a-149593de1479'} {{(pid=71938) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:357}} Nov 24 16:49:05.122895 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.notifications [None req-b32fa959-a13c-4586-918a-149593de1479 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '5a5f651da88c4759abbc0a4ed4870465', 'request_id': 'req-b32fa959-a13c-4586-918a-149593de1479'} {{(pid=71938) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:357}} Nov 24 16:49:05.126807 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd0d72a3-be11-4f24-99b1-358e3159acde admin admin] RBAC: Authorization granted {{(pid=71939) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 24 16:49:05.128987 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.notifications [None req-b32fa959-a13c-4586-918a-149593de1479 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '5a5f651da88c4759abbc0a4ed4870465', 'request_id': 'req-b32fa959-a13c-4586-918a-149593de1479'} {{(pid=71938) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:357}} Nov 24 16:49:05.145999 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.notifications [None req-b32fa959-a13c-4586-918a-149593de1479 admin admin] The token cache is being invalidate because project 5a5f651da88c4759abbc0a4ed4870465 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=71938) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Nov 24 16:49:05.146320 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: [pid: 71939|app: 0|req: 997/1985] 10.222.0.53 () {58 vars in 1112 bytes} [Wed Nov 24 16:49:04 2021] GET /identity/v3/roles => generated 1420 bytes in 217 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 24 16:49:05.147909 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32f17237-bec3-48ae-bbb8-2745715e732f None None] REQUEST_METHOD: `POST` {{(pid=71939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 24 16:49:05.148260 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32f17237-bec3-48ae-bbb8-2745715e732f None None] SCRIPT_NAME: `/identity` {{(pid=71939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 24 16:49:05.148596 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32f17237-bec3-48ae-bbb8-2745715e732f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=71939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 24 16:49:05.149940 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.notifications [None req-b32fa959-a13c-4586-918a-149593de1479 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=71938) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:357}} Nov 24 16:49:05.150705 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.notifications [None req-b32fa959-a13c-4586-918a-149593de1479 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=71938) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:357}} Nov 24 16:49:05.152279 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: [pid: 71938|app: 0|req: 989/1986] 10.222.0.53 () {58 vars in 1223 bytes} [Wed Nov 24 16:49:04 2021] DELETE /identity/v3/projects/5a5f651da88c4759abbc0a4ed4870465 => generated 0 bytes in 242 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 24 16:49:05.153108 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b32fa959-a13c-4586-918a-149593de1479 admin admin] Authenticating user token {{(pid=71938) process_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 24 16:49:05.154648 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.fernet_utils [None req-b32fa959-a13c-4586-918a-149593de1479 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=71938) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:289}} Nov 24 16:49:05.177242 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.auth.core [None req-32f17237-bec3-48ae-bbb8-2745715e732f None None] MFA Rules not processed for user `0f2ba2e8375b4e8c8792ee1e22b60427`. Rule list: `[]` (Enabled: `True`). {{(pid=71939) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:442}} Nov 24 16:49:05.179498 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.fernet_utils [None req-32f17237-bec3-48ae-bbb8-2745715e732f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=71939) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:289}} Nov 24 16:49:05.242302 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b32fa959-a13c-4586-918a-149593de1479 admin admin] Validating token access rules against request {{(pid=71938) validate_allowed_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 24 16:49:05.247601 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d12275c4-4ccf-4970-adc7-46ef6776fa56 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f2ba2e8375b4e8c8792ee1e22b60427', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '00a5583c7b7443e98e7a1d31a0b638dc', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=71938) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 24 16:49:05.248534 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d12275c4-4ccf-4970-adc7-46ef6776fa56 admin admin] REQUEST_METHOD: `PUT` {{(pid=71938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 24 16:49:05.249026 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d12275c4-4ccf-4970-adc7-46ef6776fa56 admin admin] SCRIPT_NAME: `/identity` {{(pid=71938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 24 16:49:05.249450 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d12275c4-4ccf-4970-adc7-46ef6776fa56 admin admin] PATH_INFO: `/v3/projects/d685cb1027654ab5a0fd06241b2da08e/users/6288c489e1d341f089004be44b835f99/roles/5611724e350b41e19921b5961a342582` {{(pid=71938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 24 16:49:05.265907 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: [pid: 71939|app: 0|req: 998/1987] 10.222.0.53 () {58 vars in 948 bytes} [Wed Nov 24 16:49:05 2021] POST /identity/v3/auth/tokens => generated 3669 bytes in 119 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 24 16:49:05.271440 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88864f60-5a58-447b-9c6e-b05608160b5b None None] REQUEST_METHOD: `POST` {{(pid=71939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 24 16:49:05.271559 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88864f60-5a58-447b-9c6e-b05608160b5b None None] SCRIPT_NAME: `/identity` {{(pid=71939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 24 16:49:05.273117 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88864f60-5a58-447b-9c6e-b05608160b5b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=71939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 24 16:49:05.284324 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d12275c4-4ccf-4970-adc7-46ef6776fa56 admin admin] RBAC: Authorizing `identity:create_grant(project_id=d685cb1027654ab5a0fd06241b2da08e, user_id=6288c489e1d341f089004be44b835f99, role_id=5611724e350b41e19921b5961a342582)` {{(pid=71938) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:442}} Nov 24 16:49:05.299167 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.auth.core [None req-88864f60-5a58-447b-9c6e-b05608160b5b None None] MFA Rules not processed for user `0f2ba2e8375b4e8c8792ee1e22b60427`. Rule list: `[]` (Enabled: `True`). {{(pid=71939) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:442}} Nov 24 16:49:05.300462 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.fernet_utils [None req-88864f60-5a58-447b-9c6e-b05608160b5b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=71939) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:289}} Nov 24 16:49:05.308323 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: [pid: 71939|app: 0|req: 999/1988] 10.222.0.53 () {58 vars in 948 bytes} [Wed Nov 24 16:49:05 2021] POST /identity/v3/auth/tokens => generated 3669 bytes in 38 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 24 16:49:05.309215 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88864f60-5a58-447b-9c6e-b05608160b5b None None] Authenticating user token {{(pid=71939) process_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 24 16:49:05.314947 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d12275c4-4ccf-4970-adc7-46ef6776fa56 admin admin] RBAC: Authorization granted {{(pid=71938) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 24 16:49:05.316997 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.fernet_utils [None req-88864f60-5a58-447b-9c6e-b05608160b5b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=71939) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:289}} Nov 24 16:49:05.330965 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: [pid: 71938|app: 0|req: 990/1989] 10.222.0.53 () {60 vars in 1473 bytes} [Wed Nov 24 16:49:05 2021] PUT /identity/v3/projects/d685cb1027654ab5a0fd06241b2da08e/users/6288c489e1d341f089004be44b835f99/roles/5611724e350b41e19921b5961a342582 => generated 0 bytes in 178 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 24 16:49:05.332354 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1b52b2b-45e9-4b9c-87ed-c8bbf114d70b None None] REQUEST_METHOD: `POST` {{(pid=71938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 24 16:49:05.332717 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1b52b2b-45e9-4b9c-87ed-c8bbf114d70b None None] SCRIPT_NAME: `/identity` {{(pid=71938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 24 16:49:05.333169 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1b52b2b-45e9-4b9c-87ed-c8bbf114d70b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=71938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 24 16:49:05.361839 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.auth.core [None req-f1b52b2b-45e9-4b9c-87ed-c8bbf114d70b None None] MFA Rules not processed for user `0f2ba2e8375b4e8c8792ee1e22b60427`. Rule list: `[]` (Enabled: `True`). {{(pid=71938) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:442}} Nov 24 16:49:05.363613 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.fernet_utils [None req-f1b52b2b-45e9-4b9c-87ed-c8bbf114d70b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=71938) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:289}} Nov 24 16:49:05.392766 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88864f60-5a58-447b-9c6e-b05608160b5b None None] Validating token access rules against request {{(pid=71939) validate_allowed_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 24 16:49:05.443623 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: [pid: 71938|app: 0|req: 991/1990] 10.222.0.53 () {58 vars in 948 bytes} [Wed Nov 24 16:49:05 2021] POST /identity/v3/auth/tokens => generated 3669 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 24 16:49:05.448761 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1b52b2b-45e9-4b9c-87ed-c8bbf114d70b None None] Authenticating user token {{(pid=71938) process_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 24 16:49:05.459581 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1b52b2b-45e9-4b9c-87ed-c8bbf114d70b None None] Validating token access rules against request {{(pid=71938) validate_allowed_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 24 16:49:05.462601 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-310cc96c-8d12-42f2-a706-e8b76a390d0d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c90f21b9cdcb413282461fa83cb6b7a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3b3940d4ae1c4177ae29c02377bb4b0b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=71939) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 24 16:49:05.463393 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-310cc96c-8d12-42f2-a706-e8b76a390d0d service neutron] REQUEST_METHOD: `GET` {{(pid=71939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 24 16:49:05.463598 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-310cc96c-8d12-42f2-a706-e8b76a390d0d service neutron] SCRIPT_NAME: `/identity` {{(pid=71939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 24 16:49:05.463937 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-310cc96c-8d12-42f2-a706-e8b76a390d0d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=71939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 24 16:49:05.474076 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70794a60-63c0-44fd-8de1-22bffe1419e7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f2ba2e8375b4e8c8792ee1e22b60427', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '00a5583c7b7443e98e7a1d31a0b638dc', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=71938) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 24 16:49:05.475171 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70794a60-63c0-44fd-8de1-22bffe1419e7 admin admin] REQUEST_METHOD: `GET` {{(pid=71938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 24 16:49:05.475744 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70794a60-63c0-44fd-8de1-22bffe1419e7 admin admin] SCRIPT_NAME: `/identity` {{(pid=71938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 24 16:49:05.476277 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70794a60-63c0-44fd-8de1-22bffe1419e7 admin admin] PATH_INFO: `/v3/roles` {{(pid=71938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 24 16:49:05.478147 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70794a60-63c0-44fd-8de1-22bffe1419e7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=71938) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:442}} Nov 24 16:49:05.489362 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-310cc96c-8d12-42f2-a706-e8b76a390d0d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=71939) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:442}} Nov 24 16:49:05.511438 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70794a60-63c0-44fd-8de1-22bffe1419e7 admin admin] RBAC: Authorization granted {{(pid=71938) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 24 16:49:05.523261 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-310cc96c-8d12-42f2-a706-e8b76a390d0d service neutron] RBAC: Authorization granted {{(pid=71939) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 24 16:49:05.525328 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: [pid: 71938|app: 0|req: 992/1991] 10.222.0.53 () {58 vars in 1112 bytes} [Wed Nov 24 16:49:05 2021] GET /identity/v3/roles => generated 1420 bytes in 77 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 24 16:49:05.526554 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70794a60-63c0-44fd-8de1-22bffe1419e7 admin admin] Authenticating user token {{(pid=71938) process_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 24 16:49:05.539125 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70794a60-63c0-44fd-8de1-22bffe1419e7 admin admin] Validating token access rules against request {{(pid=71938) validate_allowed_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 24 16:49:05.540071 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: [pid: 71939|app: 0|req: 1000/1992] 10.222.0.53 () {60 vars in 1356 bytes} [Wed Nov 24 16:49:05 2021] GET /identity/v3/auth/tokens => generated 3669 bytes in 231 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 24 16:49:05.541390 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d61ce6e2-c682-4507-8d4f-e58c91854f7c None None] REQUEST_METHOD: `POST` {{(pid=71939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 24 16:49:05.542187 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d61ce6e2-c682-4507-8d4f-e58c91854f7c None None] SCRIPT_NAME: `/identity` {{(pid=71939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 24 16:49:05.542543 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d61ce6e2-c682-4507-8d4f-e58c91854f7c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=71939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 24 16:49:05.562391 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dff56f7-9bfd-4417-83b7-26d50a5fd3c8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f2ba2e8375b4e8c8792ee1e22b60427', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '00a5583c7b7443e98e7a1d31a0b638dc', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=71938) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 24 16:49:05.563221 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dff56f7-9bfd-4417-83b7-26d50a5fd3c8 admin admin] REQUEST_METHOD: `GET` {{(pid=71938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 24 16:49:05.563664 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dff56f7-9bfd-4417-83b7-26d50a5fd3c8 admin admin] SCRIPT_NAME: `/identity` {{(pid=71938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 24 16:49:05.564103 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dff56f7-9bfd-4417-83b7-26d50a5fd3c8 admin admin] PATH_INFO: `/v3/domains` {{(pid=71938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 24 16:49:05.565154 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9dff56f7-9bfd-4417-83b7-26d50a5fd3c8 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=71938) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:161}} Nov 24 16:49:05.565616 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9dff56f7-9bfd-4417-83b7-26d50a5fd3c8 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=71938) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:442}} Nov 24 16:49:05.594289 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.auth.core [None req-d61ce6e2-c682-4507-8d4f-e58c91854f7c None None] MFA Rules not processed for user `6c0736153f94443ab748da08baf8f5dc`. Rule list: `[]` (Enabled: `True`). {{(pid=71939) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:442}} Nov 24 16:49:05.596097 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.fernet_utils [None req-d61ce6e2-c682-4507-8d4f-e58c91854f7c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=71939) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:289}} Nov 24 16:49:05.617534 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9dff56f7-9bfd-4417-83b7-26d50a5fd3c8 admin admin] RBAC: Authorization granted {{(pid=71938) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 24 16:49:05.645458 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: [pid: 71938|app: 0|req: 993/1993] 10.222.0.53 () {58 vars in 1143 bytes} [Wed Nov 24 16:49:05 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 119 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 24 16:49:05.646525 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dff56f7-9bfd-4417-83b7-26d50a5fd3c8 admin admin] Authenticating user token {{(pid=71938) process_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 24 16:49:05.661786 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dff56f7-9bfd-4417-83b7-26d50a5fd3c8 admin admin] Validating token access rules against request {{(pid=71938) validate_allowed_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 24 16:49:05.668968 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c85422d6-a256-4cac-ac45-37afacaf1297 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f2ba2e8375b4e8c8792ee1e22b60427', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '00a5583c7b7443e98e7a1d31a0b638dc', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=71938) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 24 16:49:05.670068 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c85422d6-a256-4cac-ac45-37afacaf1297 admin admin] REQUEST_METHOD: `PUT` {{(pid=71938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 24 16:49:05.670794 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c85422d6-a256-4cac-ac45-37afacaf1297 admin admin] SCRIPT_NAME: `/identity` {{(pid=71938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 24 16:49:05.671007 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c85422d6-a256-4cac-ac45-37afacaf1297 admin admin] PATH_INFO: `/v3/projects/d685cb1027654ab5a0fd06241b2da08e/users/6288c489e1d341f089004be44b835f99/roles/5611724e350b41e19921b5961a342582` {{(pid=71938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 24 16:49:05.673349 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c85422d6-a256-4cac-ac45-37afacaf1297 admin admin] RBAC: Authorizing `identity:create_grant(project_id=d685cb1027654ab5a0fd06241b2da08e, user_id=6288c489e1d341f089004be44b835f99, role_id=5611724e350b41e19921b5961a342582)` {{(pid=71938) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:442}} Nov 24 16:49:05.697139 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: [pid: 71939|app: 0|req: 1001/1994] 10.222.0.53 () {58 vars in 948 bytes} [Wed Nov 24 16:49:05 2021] POST /identity/v3/auth/tokens => generated 3678 bytes in 156 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 24 16:49:05.698354 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d61ce6e2-c682-4507-8d4f-e58c91854f7c None None] Authenticating user token {{(pid=71939) process_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 24 16:49:05.711148 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c85422d6-a256-4cac-ac45-37afacaf1297 admin admin] RBAC: Authorization granted {{(pid=71938) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 24 16:49:05.714419 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d61ce6e2-c682-4507-8d4f-e58c91854f7c None None] Validating token access rules against request {{(pid=71939) validate_allowed_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 24 16:49:05.719955 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cad9705-5a3a-40e9-bdc6-216eda351893 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f2ba2e8375b4e8c8792ee1e22b60427', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '00a5583c7b7443e98e7a1d31a0b638dc', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=71939) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 24 16:49:05.721606 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cad9705-5a3a-40e9-bdc6-216eda351893 admin admin] REQUEST_METHOD: `POST` {{(pid=71939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 24 16:49:05.722228 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cad9705-5a3a-40e9-bdc6-216eda351893 admin admin] SCRIPT_NAME: `/identity` {{(pid=71939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 24 16:49:05.722644 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cad9705-5a3a-40e9-bdc6-216eda351893 admin admin] PATH_INFO: `/v3/projects` {{(pid=71939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 24 16:49:05.723476 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cad9705-5a3a-40e9-bdc6-216eda351893 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=71939) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:442}} Nov 24 16:49:05.727082 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: [pid: 71938|app: 0|req: 994/1995] 10.222.0.53 () {60 vars in 1473 bytes} [Wed Nov 24 16:49:05 2021] PUT /identity/v3/projects/d685cb1027654ab5a0fd06241b2da08e/users/6288c489e1d341f089004be44b835f99/roles/5611724e350b41e19921b5961a342582 => generated 0 bytes in 77 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 24 16:49:05.728121 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c85422d6-a256-4cac-ac45-37afacaf1297 admin admin] Authenticating user token {{(pid=71938) process_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 24 16:49:05.730008 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.fernet_utils [None req-c85422d6-a256-4cac-ac45-37afacaf1297 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=71938) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:289}} Nov 24 16:49:05.760454 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cad9705-5a3a-40e9-bdc6-216eda351893 admin admin] RBAC: Authorization granted {{(pid=71939) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 24 16:49:05.803363 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: [pid: 71939|app: 0|req: 1002/1996] 10.222.0.53 () {60 vars in 1143 bytes} [Wed Nov 24 16:49:05 2021] POST /identity/v3/projects => generated 399 bytes in 102 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 24 16:49:05.803363 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cad9705-5a3a-40e9-bdc6-216eda351893 admin admin] Authenticating user token {{(pid=71939) process_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 24 16:49:05.893778 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cad9705-5a3a-40e9-bdc6-216eda351893 admin admin] Validating token access rules against request {{(pid=71939) validate_allowed_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 24 16:49:05.900960 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7997386-fa1a-4711-a1cd-d29ed70f7891 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f2ba2e8375b4e8c8792ee1e22b60427', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '00a5583c7b7443e98e7a1d31a0b638dc', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=71939) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 24 16:49:05.901818 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7997386-fa1a-4711-a1cd-d29ed70f7891 admin admin] REQUEST_METHOD: `GET` {{(pid=71939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 24 16:49:05.902257 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7997386-fa1a-4711-a1cd-d29ed70f7891 admin admin] SCRIPT_NAME: `/identity` {{(pid=71939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 24 16:49:05.902669 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7997386-fa1a-4711-a1cd-d29ed70f7891 admin admin] PATH_INFO: `/v3/roles` {{(pid=71939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 24 16:49:05.903548 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7997386-fa1a-4711-a1cd-d29ed70f7891 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=71939) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:442}} Nov 24 16:49:05.937552 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7997386-fa1a-4711-a1cd-d29ed70f7891 admin admin] RBAC: Authorization granted {{(pid=71939) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 24 16:49:05.948079 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c85422d6-a256-4cac-ac45-37afacaf1297 admin admin] Validating token access rules against request {{(pid=71938) validate_allowed_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 24 16:49:05.953325 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: [pid: 71939|app: 0|req: 1003/1997] 10.222.0.53 () {58 vars in 1112 bytes} [Wed Nov 24 16:49:05 2021] GET /identity/v3/roles => generated 1420 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 24 16:49:05.953325 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7997386-fa1a-4711-a1cd-d29ed70f7891 admin admin] Authenticating user token {{(pid=71939) process_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 24 16:49:05.960237 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15062503-08e6-441d-9089-74218967fea9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f2ba2e8375b4e8c8792ee1e22b60427', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '00a5583c7b7443e98e7a1d31a0b638dc', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=71938) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 24 16:49:05.961266 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15062503-08e6-441d-9089-74218967fea9 admin admin] REQUEST_METHOD: `POST` {{(pid=71938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 24 16:49:05.961922 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15062503-08e6-441d-9089-74218967fea9 admin admin] SCRIPT_NAME: `/identity` {{(pid=71938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 24 16:49:05.962462 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15062503-08e6-441d-9089-74218967fea9 admin admin] PATH_INFO: `/v3/projects` {{(pid=71938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 24 16:49:05.962570 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7997386-fa1a-4711-a1cd-d29ed70f7891 admin admin] Validating token access rules against request {{(pid=71939) validate_allowed_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 24 16:49:05.964328 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15062503-08e6-441d-9089-74218967fea9 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=71938) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:442}} Nov 24 16:49:05.967727 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-708cc5f5-a34c-4b4e-8707-f9d15ee479ec admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f2ba2e8375b4e8c8792ee1e22b60427', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '00a5583c7b7443e98e7a1d31a0b638dc', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=71939) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 24 16:49:05.969061 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-708cc5f5-a34c-4b4e-8707-f9d15ee479ec admin admin] REQUEST_METHOD: `POST` {{(pid=71939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 24 16:49:05.969602 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-708cc5f5-a34c-4b4e-8707-f9d15ee479ec admin admin] SCRIPT_NAME: `/identity` {{(pid=71939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 24 16:49:05.970155 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-708cc5f5-a34c-4b4e-8707-f9d15ee479ec admin admin] PATH_INFO: `/v3/users` {{(pid=71939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 24 16:49:05.971118 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-708cc5f5-a34c-4b4e-8707-f9d15ee479ec admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=71939) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:442}} Nov 24 16:49:06.006665 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15062503-08e6-441d-9089-74218967fea9 admin admin] RBAC: Authorization granted {{(pid=71938) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 24 16:49:06.029179 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-708cc5f5-a34c-4b4e-8707-f9d15ee479ec admin admin] RBAC: Authorization granted {{(pid=71939) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 24 16:49:06.048328 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: [pid: 71938|app: 0|req: 995/1998] 10.222.0.53 () {60 vars in 1143 bytes} [Wed Nov 24 16:49:05 2021] POST /identity/v3/projects => generated 371 bytes in 321 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 24 16:49:06.051027 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15062503-08e6-441d-9089-74218967fea9 admin admin] Authenticating user token {{(pid=71938) process_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 24 16:49:06.061269 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: [pid: 71939|app: 0|req: 1004/1999] 10.222.0.53 () {60 vars in 1134 bytes} [Wed Nov 24 16:49:05 2021] POST /identity/v3/users => generated 300 bytes in 110 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 24 16:49:06.062675 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-708cc5f5-a34c-4b4e-8707-f9d15ee479ec admin admin] Authenticating user token {{(pid=71939) process_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 24 16:49:06.065065 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.fernet_utils [None req-708cc5f5-a34c-4b4e-8707-f9d15ee479ec admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=71939) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:289}} Nov 24 16:49:06.079807 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-708cc5f5-a34c-4b4e-8707-f9d15ee479ec admin admin] Validating token access rules against request {{(pid=71939) validate_allowed_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 24 16:49:06.142702 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15062503-08e6-441d-9089-74218967fea9 admin admin] Validating token access rules against request {{(pid=71938) validate_allowed_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 24 16:49:06.149284 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99c4897a-75f7-4221-968e-bd9c154fc2d5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f2ba2e8375b4e8c8792ee1e22b60427', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '00a5583c7b7443e98e7a1d31a0b638dc', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=71938) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 24 16:49:06.150644 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99c4897a-75f7-4221-968e-bd9c154fc2d5 admin admin] REQUEST_METHOD: `PUT` {{(pid=71938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 24 16:49:06.151154 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99c4897a-75f7-4221-968e-bd9c154fc2d5 admin admin] SCRIPT_NAME: `/identity` {{(pid=71938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 24 16:49:06.151672 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99c4897a-75f7-4221-968e-bd9c154fc2d5 admin admin] PATH_INFO: `/v3/projects/d685cb1027654ab5a0fd06241b2da08e/users/6288c489e1d341f089004be44b835f99/roles/912ab5f10fa5477da74acf239f07604e` {{(pid=71938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 24 16:49:06.153919 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99c4897a-75f7-4221-968e-bd9c154fc2d5 admin admin] RBAC: Authorizing `identity:create_grant(project_id=d685cb1027654ab5a0fd06241b2da08e, user_id=6288c489e1d341f089004be44b835f99, role_id=912ab5f10fa5477da74acf239f07604e)` {{(pid=71938) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:442}} Nov 24 16:49:06.189248 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99c4897a-75f7-4221-968e-bd9c154fc2d5 admin admin] RBAC: Authorization granted {{(pid=71938) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 24 16:49:06.195560 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6ada2c7-b5be-4ba4-9fb6-c86a6199e1c8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f2ba2e8375b4e8c8792ee1e22b60427', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '00a5583c7b7443e98e7a1d31a0b638dc', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=71939) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 24 16:49:06.196606 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6ada2c7-b5be-4ba4-9fb6-c86a6199e1c8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=71939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 24 16:49:06.197241 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6ada2c7-b5be-4ba4-9fb6-c86a6199e1c8 admin admin] SCRIPT_NAME: `/identity` {{(pid=71939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 24 16:49:06.197581 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6ada2c7-b5be-4ba4-9fb6-c86a6199e1c8 admin admin] PATH_INFO: `/v3/projects/ea299e83029c4dea8b579a4962317c83` {{(pid=71939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 24 16:49:06.199012 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6ada2c7-b5be-4ba4-9fb6-c86a6199e1c8 admin admin] RBAC: Authorizing `identity:delete_project(project_id=ea299e83029c4dea8b579a4962317c83)` {{(pid=71939) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:442}} Nov 24 16:49:06.205146 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: [pid: 71938|app: 0|req: 996/2000] 10.222.0.53 () {60 vars in 1473 bytes} [Wed Nov 24 16:49:06 2021] PUT /identity/v3/projects/d685cb1027654ab5a0fd06241b2da08e/users/6288c489e1d341f089004be44b835f99/roles/912ab5f10fa5477da74acf239f07604e => generated 0 bytes in 155 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 24 16:49:06.216223 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99c4897a-75f7-4221-968e-bd9c154fc2d5 admin admin] Authenticating user token {{(pid=71938) process_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 24 16:49:06.262641 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6ada2c7-b5be-4ba4-9fb6-c86a6199e1c8 admin admin] RBAC: Authorization granted {{(pid=71939) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 24 16:49:06.302682 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99c4897a-75f7-4221-968e-bd9c154fc2d5 admin admin] Validating token access rules against request {{(pid=71938) validate_allowed_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 24 16:49:06.317484 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15823f61-6c44-4c6a-9385-7e0c052dccfe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f2ba2e8375b4e8c8792ee1e22b60427', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '00a5583c7b7443e98e7a1d31a0b638dc', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=71938) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 24 16:49:06.321947 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15823f61-6c44-4c6a-9385-7e0c052dccfe admin admin] REQUEST_METHOD: `POST` {{(pid=71938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 24 16:49:06.322441 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15823f61-6c44-4c6a-9385-7e0c052dccfe admin admin] SCRIPT_NAME: `/identity` {{(pid=71938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 24 16:49:06.322795 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15823f61-6c44-4c6a-9385-7e0c052dccfe admin admin] PATH_INFO: `/v3/users` {{(pid=71938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 24 16:49:06.323579 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15823f61-6c44-4c6a-9385-7e0c052dccfe admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=71938) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:442}} Nov 24 16:49:06.326253 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.notifications [None req-e6ada2c7-b5be-4ba4-9fb6-c86a6199e1c8 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ea299e83029c4dea8b579a4962317c83', 'request_id': 'req-e6ada2c7-b5be-4ba4-9fb6-c86a6199e1c8'} {{(pid=71939) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:357}} Nov 24 16:49:06.347122 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.notifications [None req-e6ada2c7-b5be-4ba4-9fb6-c86a6199e1c8 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ea299e83029c4dea8b579a4962317c83', 'request_id': 'req-e6ada2c7-b5be-4ba4-9fb6-c86a6199e1c8'} {{(pid=71939) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:357}} Nov 24 16:49:06.363413 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15823f61-6c44-4c6a-9385-7e0c052dccfe admin admin] RBAC: Authorization granted {{(pid=71938) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 24 16:49:06.364303 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.notifications [None req-e6ada2c7-b5be-4ba4-9fb6-c86a6199e1c8 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ea299e83029c4dea8b579a4962317c83', 'request_id': 'req-e6ada2c7-b5be-4ba4-9fb6-c86a6199e1c8'} {{(pid=71939) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:357}} Nov 24 16:49:06.384691 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.notifications [None req-e6ada2c7-b5be-4ba4-9fb6-c86a6199e1c8 admin admin] The token cache is being invalidate because project ea299e83029c4dea8b579a4962317c83 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=71939) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Nov 24 16:49:06.385230 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.notifications [None req-e6ada2c7-b5be-4ba4-9fb6-c86a6199e1c8 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=71939) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:357}} Nov 24 16:49:06.386205 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.notifications [None req-e6ada2c7-b5be-4ba4-9fb6-c86a6199e1c8 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=71939) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:357}} Nov 24 16:49:06.387817 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: [pid: 71939|app: 0|req: 1005/2001] 10.222.0.53 () {58 vars in 1223 bytes} [Wed Nov 24 16:49:06 2021] DELETE /identity/v3/projects/ea299e83029c4dea8b579a4962317c83 => generated 0 bytes in 326 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 24 16:49:06.391567 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6ada2c7-b5be-4ba4-9fb6-c86a6199e1c8 admin admin] Authenticating user token {{(pid=71939) process_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 24 16:49:06.391567 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.fernet_utils [None req-e6ada2c7-b5be-4ba4-9fb6-c86a6199e1c8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=71939) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:289}} Nov 24 16:49:06.399550 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: [pid: 71938|app: 0|req: 997/2002] 10.222.0.53 () {60 vars in 1134 bytes} [Wed Nov 24 16:49:06 2021] POST /identity/v3/users => generated 292 bytes in 181 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 24 16:49:06.399550 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-674537b7-09b0-4d02-8f50-0d556491bfdb None None] REQUEST_METHOD: `POST` {{(pid=71938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 24 16:49:06.399550 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-674537b7-09b0-4d02-8f50-0d556491bfdb None None] SCRIPT_NAME: `/identity` {{(pid=71938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 24 16:49:06.399550 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-674537b7-09b0-4d02-8f50-0d556491bfdb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=71938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 24 16:49:06.448758 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.auth.core [None req-674537b7-09b0-4d02-8f50-0d556491bfdb None None] MFA Rules not processed for user `6288c489e1d341f089004be44b835f99`. Rule list: `[]` (Enabled: `True`). {{(pid=71938) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:442}} Nov 24 16:49:06.450128 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.fernet_utils [None req-674537b7-09b0-4d02-8f50-0d556491bfdb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=71938) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:289}} Nov 24 16:49:06.540572 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6ada2c7-b5be-4ba4-9fb6-c86a6199e1c8 admin admin] Validating token access rules against request {{(pid=71939) validate_allowed_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 24 16:49:06.546119 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-898d5ba9-c789-4e5f-b639-43d221662a0d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f2ba2e8375b4e8c8792ee1e22b60427', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '00a5583c7b7443e98e7a1d31a0b638dc', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=71939) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 24 16:49:06.546820 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-898d5ba9-c789-4e5f-b639-43d221662a0d admin admin] REQUEST_METHOD: `GET` {{(pid=71939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 24 16:49:06.547163 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-898d5ba9-c789-4e5f-b639-43d221662a0d admin admin] SCRIPT_NAME: `/identity` {{(pid=71939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 24 16:49:06.547496 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-898d5ba9-c789-4e5f-b639-43d221662a0d admin admin] PATH_INFO: `/v3/roles` {{(pid=71939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 24 16:49:06.548294 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-898d5ba9-c789-4e5f-b639-43d221662a0d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=71939) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:442}} Nov 24 16:49:06.568631 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: [pid: 71938|app: 0|req: 998/2003] 10.222.0.53 () {58 vars in 948 bytes} [Wed Nov 24 16:49:06 2021] POST /identity/v3/auth/tokens => generated 3743 bytes in 171 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 24 16:49:06.569879 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-674537b7-09b0-4d02-8f50-0d556491bfdb None None] Authenticating user token {{(pid=71938) process_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 24 16:49:06.579733 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.fernet_utils [None req-674537b7-09b0-4d02-8f50-0d556491bfdb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=71938) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:289}} Nov 24 16:49:06.589119 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-898d5ba9-c789-4e5f-b639-43d221662a0d admin admin] RBAC: Authorization granted {{(pid=71939) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 24 16:49:06.596194 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-674537b7-09b0-4d02-8f50-0d556491bfdb None None] Validating token access rules against request {{(pid=71938) validate_allowed_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 24 16:49:06.602735 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62e4ee92-f27b-480d-bce0-7a917e7e9727 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f2ba2e8375b4e8c8792ee1e22b60427', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '00a5583c7b7443e98e7a1d31a0b638dc', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=71938) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 24 16:49:06.603845 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62e4ee92-f27b-480d-bce0-7a917e7e9727 admin admin] REQUEST_METHOD: `DELETE` {{(pid=71938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 24 16:49:06.604465 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62e4ee92-f27b-480d-bce0-7a917e7e9727 admin admin] SCRIPT_NAME: `/identity` {{(pid=71938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 24 16:49:06.604947 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62e4ee92-f27b-480d-bce0-7a917e7e9727 admin admin] PATH_INFO: `/v3/users/bc6e1527223040fa8f52e4251bbe3311` {{(pid=71938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 24 16:49:06.620870 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62e4ee92-f27b-480d-bce0-7a917e7e9727 admin admin] RBAC: Authorizing `identity:delete_user(user_id=bc6e1527223040fa8f52e4251bbe3311)` {{(pid=71938) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:442}} Nov 24 16:49:06.633332 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: [pid: 71939|app: 0|req: 1006/2004] 10.222.0.53 () {58 vars in 1112 bytes} [Wed Nov 24 16:49:06 2021] GET /identity/v3/roles => generated 1420 bytes in 241 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 24 16:49:06.633332 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-898d5ba9-c789-4e5f-b639-43d221662a0d admin admin] Authenticating user token {{(pid=71939) process_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 24 16:49:06.639211 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.fernet_utils [None req-898d5ba9-c789-4e5f-b639-43d221662a0d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=71939) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:289}} Nov 24 16:49:06.669616 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-898d5ba9-c789-4e5f-b639-43d221662a0d admin admin] Validating token access rules against request {{(pid=71939) validate_allowed_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 24 16:49:06.676600 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-183afa7e-c8ea-4de0-9154-472c709de494 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f2ba2e8375b4e8c8792ee1e22b60427', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '00a5583c7b7443e98e7a1d31a0b638dc', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=71939) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 24 16:49:06.677521 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-183afa7e-c8ea-4de0-9154-472c709de494 admin admin] REQUEST_METHOD: `GET` {{(pid=71939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 24 16:49:06.678091 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-183afa7e-c8ea-4de0-9154-472c709de494 admin admin] SCRIPT_NAME: `/identity` {{(pid=71939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 24 16:49:06.679164 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-183afa7e-c8ea-4de0-9154-472c709de494 admin admin] PATH_INFO: `/v3/roles` {{(pid=71939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 24 16:49:06.680179 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-183afa7e-c8ea-4de0-9154-472c709de494 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=71939) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:442}} Nov 24 16:49:06.696387 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62e4ee92-f27b-480d-bce0-7a917e7e9727 admin admin] RBAC: Authorization granted {{(pid=71938) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 24 16:49:06.723797 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-183afa7e-c8ea-4de0-9154-472c709de494 admin admin] RBAC: Authorization granted {{(pid=71939) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 24 16:49:06.737919 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: [pid: 71939|app: 0|req: 1007/2005] 10.222.0.53 () {58 vars in 1112 bytes} [Wed Nov 24 16:49:06 2021] GET /identity/v3/roles => generated 1420 bytes in 108 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 24 16:49:06.739176 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-183afa7e-c8ea-4de0-9154-472c709de494 admin admin] Authenticating user token {{(pid=71939) process_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 24 16:49:06.741379 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.fernet_utils [None req-183afa7e-c8ea-4de0-9154-472c709de494 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=71939) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:289}} Nov 24 16:49:06.792662 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.notifications [None req-62e4ee92-f27b-480d-bce0-7a917e7e9727 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'bc6e1527223040fa8f52e4251bbe3311'} {{(pid=71938) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:357}} Nov 24 16:49:06.823082 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.notifications [None req-62e4ee92-f27b-480d-bce0-7a917e7e9727 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'bc6e1527223040fa8f52e4251bbe3311'} {{(pid=71938) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:357}} Nov 24 16:49:06.825106 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.notifications [None req-62e4ee92-f27b-480d-bce0-7a917e7e9727 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'bc6e1527223040fa8f52e4251bbe3311'} {{(pid=71938) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:357}} Nov 24 16:49:06.840034 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-183afa7e-c8ea-4de0-9154-472c709de494 admin admin] Validating token access rules against request {{(pid=71939) validate_allowed_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 24 16:49:06.845290 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13aa16ba-0277-4846-be7c-97299373bf40 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a12374a3093a401a97c343ff0854184d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3b3940d4ae1c4177ae29c02377bb4b0b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=71939) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 24 16:49:06.846436 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13aa16ba-0277-4846-be7c-97299373bf40 service cinder] REQUEST_METHOD: `GET` {{(pid=71939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 24 16:49:06.847093 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13aa16ba-0277-4846-be7c-97299373bf40 service cinder] SCRIPT_NAME: `/identity` {{(pid=71939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 24 16:49:06.847574 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13aa16ba-0277-4846-be7c-97299373bf40 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=71939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 24 16:49:06.861007 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13aa16ba-0277-4846-be7c-97299373bf40 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=71939) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:442}} Nov 24 16:49:06.875094 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.notifications [None req-62e4ee92-f27b-480d-bce0-7a917e7e9727 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'bc6e1527223040fa8f52e4251bbe3311'} {{(pid=71938) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:357}} Nov 24 16:49:06.896733 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13aa16ba-0277-4846-be7c-97299373bf40 service cinder] RBAC: Authorization granted {{(pid=71939) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 24 16:49:06.903404 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.notifications [None req-62e4ee92-f27b-480d-bce0-7a917e7e9727 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'bc6e1527223040fa8f52e4251bbe3311'} {{(pid=71938) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:357}} Nov 24 16:49:06.910865 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: [pid: 71938|app: 0|req: 999/2006] 10.222.0.53 () {58 vars in 1214 bytes} [Wed Nov 24 16:49:06 2021] DELETE /identity/v3/users/bc6e1527223040fa8f52e4251bbe3311 => generated 0 bytes in 341 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 24 16:49:06.915833 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62e4ee92-f27b-480d-bce0-7a917e7e9727 admin admin] Authenticating user token {{(pid=71938) process_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 24 16:49:06.916284 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: [pid: 71939|app: 0|req: 1008/2007] 10.222.0.53 () {60 vars in 1356 bytes} [Wed Nov 24 16:49:06 2021] GET /identity/v3/auth/tokens => generated 3743 bytes in 178 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 24 16:49:06.917815 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.fernet_utils [None req-62e4ee92-f27b-480d-bce0-7a917e7e9727 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=71938) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:289}} Nov 24 16:49:06.929246 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13aa16ba-0277-4846-be7c-97299373bf40 service cinder] Authenticating user token {{(pid=71939) process_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 24 16:49:06.955938 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13aa16ba-0277-4846-be7c-97299373bf40 service cinder] Validating token access rules against request {{(pid=71939) validate_allowed_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 24 16:49:07.062504 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62e4ee92-f27b-480d-bce0-7a917e7e9727 admin admin] Validating token access rules against request {{(pid=71938) validate_allowed_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 24 16:49:07.072125 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08cc6d0a-a609-4cac-912b-e95c1159ea0f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f2ba2e8375b4e8c8792ee1e22b60427', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '00a5583c7b7443e98e7a1d31a0b638dc', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=71938) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 24 16:49:07.073061 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08cc6d0a-a609-4cac-912b-e95c1159ea0f admin admin] REQUEST_METHOD: `PUT` {{(pid=71938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 24 16:49:07.073458 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08cc6d0a-a609-4cac-912b-e95c1159ea0f admin admin] SCRIPT_NAME: `/identity` {{(pid=71938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 24 16:49:07.073738 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08cc6d0a-a609-4cac-912b-e95c1159ea0f admin admin] PATH_INFO: `/v3/projects/0a11e2fb85854c56843fb0126e24ab90/users/1157f7f8ac7b40cab91dcda9ff6db500/roles/912ab5f10fa5477da74acf239f07604e` {{(pid=71938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 24 16:49:07.117064 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-358220ec-e7d2-471a-b159-3db705831f30 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f2ba2e8375b4e8c8792ee1e22b60427', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '00a5583c7b7443e98e7a1d31a0b638dc', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=71939) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 24 16:49:07.117977 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-358220ec-e7d2-471a-b159-3db705831f30 admin admin] REQUEST_METHOD: `PUT` {{(pid=71939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 24 16:49:07.118354 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-358220ec-e7d2-471a-b159-3db705831f30 admin admin] SCRIPT_NAME: `/identity` {{(pid=71939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 24 16:49:07.118694 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-358220ec-e7d2-471a-b159-3db705831f30 admin admin] PATH_INFO: `/v3/projects/1eba30a7ac2a454faacc84f7fefc6ba6/users/68fe2ddf4baf41788b31957a623776a9/roles/5611724e350b41e19921b5961a342582` {{(pid=71939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 24 16:49:07.138901 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08cc6d0a-a609-4cac-912b-e95c1159ea0f admin admin] RBAC: Authorizing `identity:create_grant(project_id=0a11e2fb85854c56843fb0126e24ab90, user_id=1157f7f8ac7b40cab91dcda9ff6db500, role_id=912ab5f10fa5477da74acf239f07604e)` {{(pid=71938) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:442}} Nov 24 16:49:07.158069 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-358220ec-e7d2-471a-b159-3db705831f30 admin admin] RBAC: Authorizing `identity:create_grant(project_id=1eba30a7ac2a454faacc84f7fefc6ba6, user_id=68fe2ddf4baf41788b31957a623776a9, role_id=5611724e350b41e19921b5961a342582)` {{(pid=71939) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:442}} Nov 24 16:49:07.222740 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-358220ec-e7d2-471a-b159-3db705831f30 admin admin] RBAC: Authorization granted {{(pid=71939) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 24 16:49:07.225892 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08cc6d0a-a609-4cac-912b-e95c1159ea0f admin admin] RBAC: Authorization granted {{(pid=71938) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 24 16:49:07.252144 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: [pid: 71938|app: 0|req: 1000/2008] 10.222.0.53 () {60 vars in 1473 bytes} [Wed Nov 24 16:49:06 2021] PUT /identity/v3/projects/0a11e2fb85854c56843fb0126e24ab90/users/1157f7f8ac7b40cab91dcda9ff6db500/roles/912ab5f10fa5477da74acf239f07604e => generated 0 bytes in 337 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 24 16:49:07.264987 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8916f6c0-2220-495f-a4f4-3b0812c0060a None None] REQUEST_METHOD: `POST` {{(pid=71938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 24 16:49:07.265597 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8916f6c0-2220-495f-a4f4-3b0812c0060a None None] SCRIPT_NAME: `/identity` {{(pid=71938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 24 16:49:07.265705 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8916f6c0-2220-495f-a4f4-3b0812c0060a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=71938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 24 16:49:07.270407 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: [pid: 71939|app: 0|req: 1009/2009] 10.222.0.53 () {60 vars in 1473 bytes} [Wed Nov 24 16:49:06 2021] PUT /identity/v3/projects/1eba30a7ac2a454faacc84f7fefc6ba6/users/68fe2ddf4baf41788b31957a623776a9/roles/5611724e350b41e19921b5961a342582 => generated 0 bytes in 342 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 24 16:49:07.275044 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-358220ec-e7d2-471a-b159-3db705831f30 admin admin] Authenticating user token {{(pid=71939) process_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 24 16:49:07.283223 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.fernet_utils [None req-358220ec-e7d2-471a-b159-3db705831f30 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=71939) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:289}} Nov 24 16:49:07.340387 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.auth.core [None req-8916f6c0-2220-495f-a4f4-3b0812c0060a None None] MFA Rules not processed for user `1157f7f8ac7b40cab91dcda9ff6db500`. Rule list: `[]` (Enabled: `True`). {{(pid=71938) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:442}} Nov 24 16:49:07.341657 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.fernet_utils [None req-8916f6c0-2220-495f-a4f4-3b0812c0060a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=71938) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:289}} Nov 24 16:49:07.404797 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-358220ec-e7d2-471a-b159-3db705831f30 admin admin] Validating token access rules against request {{(pid=71939) validate_allowed_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 24 16:49:07.410222 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa564d18-16b3-4927-a3c2-9c3b753d7e2b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f2ba2e8375b4e8c8792ee1e22b60427', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '00a5583c7b7443e98e7a1d31a0b638dc', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=71939) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 24 16:49:07.411286 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa564d18-16b3-4927-a3c2-9c3b753d7e2b admin admin] REQUEST_METHOD: `GET` {{(pid=71939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 24 16:49:07.411947 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa564d18-16b3-4927-a3c2-9c3b753d7e2b admin admin] SCRIPT_NAME: `/identity` {{(pid=71939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 24 16:49:07.412386 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa564d18-16b3-4927-a3c2-9c3b753d7e2b admin admin] PATH_INFO: `/v3/roles` {{(pid=71939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 24 16:49:07.413440 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa564d18-16b3-4927-a3c2-9c3b753d7e2b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=71939) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:442}} Nov 24 16:49:07.466002 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa564d18-16b3-4927-a3c2-9c3b753d7e2b admin admin] RBAC: Authorization granted {{(pid=71939) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 24 16:49:07.479601 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: [pid: 71939|app: 0|req: 1010/2010] 10.222.0.53 () {58 vars in 1112 bytes} [Wed Nov 24 16:49:07 2021] GET /identity/v3/roles => generated 1420 bytes in 205 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 24 16:49:07.484281 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa564d18-16b3-4927-a3c2-9c3b753d7e2b admin admin] Authenticating user token {{(pid=71939) process_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 24 16:49:07.495455 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa564d18-16b3-4927-a3c2-9c3b753d7e2b admin admin] Validating token access rules against request {{(pid=71939) validate_allowed_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 24 16:49:07.500690 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42e11189-5023-411f-87cf-9992e74c9fc5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f2ba2e8375b4e8c8792ee1e22b60427', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '00a5583c7b7443e98e7a1d31a0b638dc', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=71939) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 24 16:49:07.501623 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42e11189-5023-411f-87cf-9992e74c9fc5 admin admin] REQUEST_METHOD: `PUT` {{(pid=71939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 24 16:49:07.501966 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42e11189-5023-411f-87cf-9992e74c9fc5 admin admin] SCRIPT_NAME: `/identity` {{(pid=71939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 24 16:49:07.502974 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42e11189-5023-411f-87cf-9992e74c9fc5 admin admin] PATH_INFO: `/v3/projects/1eba30a7ac2a454faacc84f7fefc6ba6/users/68fe2ddf4baf41788b31957a623776a9/roles/5611724e350b41e19921b5961a342582` {{(pid=71939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 24 16:49:07.509340 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42e11189-5023-411f-87cf-9992e74c9fc5 admin admin] RBAC: Authorizing `identity:create_grant(project_id=1eba30a7ac2a454faacc84f7fefc6ba6, user_id=68fe2ddf4baf41788b31957a623776a9, role_id=5611724e350b41e19921b5961a342582)` {{(pid=71939) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:442}} Nov 24 16:49:07.511455 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: [pid: 71938|app: 0|req: 1001/2011] 10.222.0.53 () {58 vars in 948 bytes} [Wed Nov 24 16:49:07 2021] POST /identity/v3/auth/tokens => generated 3706 bytes in 248 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Nov 24 16:49:07.516082 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8916f6c0-2220-495f-a4f4-3b0812c0060a None None] Authenticating user token {{(pid=71938) process_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 24 16:49:07.518824 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.fernet_utils [None req-8916f6c0-2220-495f-a4f4-3b0812c0060a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=71938) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:289}} Nov 24 16:49:07.547504 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42e11189-5023-411f-87cf-9992e74c9fc5 admin admin] RBAC: Authorization granted {{(pid=71939) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 24 16:49:07.574426 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: [pid: 71939|app: 0|req: 1011/2012] 10.222.0.53 () {60 vars in 1473 bytes} [Wed Nov 24 16:49:07 2021] PUT /identity/v3/projects/1eba30a7ac2a454faacc84f7fefc6ba6/users/68fe2ddf4baf41788b31957a623776a9/roles/5611724e350b41e19921b5961a342582 => generated 0 bytes in 91 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 24 16:49:07.578425 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8916f6c0-2220-495f-a4f4-3b0812c0060a None None] Validating token access rules against request {{(pid=71938) validate_allowed_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 24 16:49:07.578874 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42e11189-5023-411f-87cf-9992e74c9fc5 admin admin] Authenticating user token {{(pid=71939) process_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 24 16:49:07.664584 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-713299d1-0682-4f67-ac9e-bf57f2886449 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f2ba2e8375b4e8c8792ee1e22b60427', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '00a5583c7b7443e98e7a1d31a0b638dc', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=71938) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 24 16:49:07.668244 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-713299d1-0682-4f67-ac9e-bf57f2886449 admin admin] REQUEST_METHOD: `DELETE` {{(pid=71938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 24 16:49:07.668244 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-713299d1-0682-4f67-ac9e-bf57f2886449 admin admin] SCRIPT_NAME: `/identity` {{(pid=71938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 24 16:49:07.668244 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-713299d1-0682-4f67-ac9e-bf57f2886449 admin admin] PATH_INFO: `/v3/projects/2916edbd231148c4bf4b1104b409f0ad` {{(pid=71938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 24 16:49:07.668244 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-713299d1-0682-4f67-ac9e-bf57f2886449 admin admin] RBAC: Authorizing `identity:delete_project(project_id=2916edbd231148c4bf4b1104b409f0ad)` {{(pid=71938) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:442}} Nov 24 16:49:07.699330 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-713299d1-0682-4f67-ac9e-bf57f2886449 admin admin] RBAC: Authorization granted {{(pid=71938) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 24 16:49:07.705514 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42e11189-5023-411f-87cf-9992e74c9fc5 admin admin] Validating token access rules against request {{(pid=71939) validate_allowed_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 24 16:49:07.712192 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dd476bc-06f9-4fb7-8606-5750999c0651 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f2ba2e8375b4e8c8792ee1e22b60427', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '00a5583c7b7443e98e7a1d31a0b638dc', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=71939) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 24 16:49:07.712970 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dd476bc-06f9-4fb7-8606-5750999c0651 admin admin] REQUEST_METHOD: `POST` {{(pid=71939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 24 16:49:07.713393 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dd476bc-06f9-4fb7-8606-5750999c0651 admin admin] SCRIPT_NAME: `/identity` {{(pid=71939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 24 16:49:07.713812 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dd476bc-06f9-4fb7-8606-5750999c0651 admin admin] PATH_INFO: `/v3/projects` {{(pid=71939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 24 16:49:07.714771 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9dd476bc-06f9-4fb7-8606-5750999c0651 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=71939) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:442}} Nov 24 16:49:07.751736 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9dd476bc-06f9-4fb7-8606-5750999c0651 admin admin] RBAC: Authorization granted {{(pid=71939) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 24 16:49:07.774271 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.notifications [None req-713299d1-0682-4f67-ac9e-bf57f2886449 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '2916edbd231148c4bf4b1104b409f0ad', 'request_id': 'req-713299d1-0682-4f67-ac9e-bf57f2886449'} {{(pid=71938) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:357}} Nov 24 16:49:07.783339 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: [pid: 71939|app: 0|req: 1012/2013] 10.222.0.53 () {60 vars in 1143 bytes} [Wed Nov 24 16:49:07 2021] POST /identity/v3/projects => generated 399 bytes in 208 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 24 16:49:07.784548 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dd476bc-06f9-4fb7-8606-5750999c0651 admin admin] Authenticating user token {{(pid=71939) process_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 24 16:49:07.794203 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.notifications [None req-713299d1-0682-4f67-ac9e-bf57f2886449 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '2916edbd231148c4bf4b1104b409f0ad', 'request_id': 'req-713299d1-0682-4f67-ac9e-bf57f2886449'} {{(pid=71938) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:357}} Nov 24 16:49:07.803345 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.notifications [None req-713299d1-0682-4f67-ac9e-bf57f2886449 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '2916edbd231148c4bf4b1104b409f0ad', 'request_id': 'req-713299d1-0682-4f67-ac9e-bf57f2886449'} {{(pid=71938) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:357}} Nov 24 16:49:07.818845 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.notifications [None req-713299d1-0682-4f67-ac9e-bf57f2886449 admin admin] The token cache is being invalidate because project 2916edbd231148c4bf4b1104b409f0ad was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=71938) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Nov 24 16:49:07.819293 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.notifications [None req-713299d1-0682-4f67-ac9e-bf57f2886449 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=71938) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:357}} Nov 24 16:49:07.820060 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.notifications [None req-713299d1-0682-4f67-ac9e-bf57f2886449 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=71938) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:357}} Nov 24 16:49:07.821949 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: [pid: 71938|app: 0|req: 1002/2014] 10.222.0.53 () {58 vars in 1223 bytes} [Wed Nov 24 16:49:07 2021] DELETE /identity/v3/projects/2916edbd231148c4bf4b1104b409f0ad => generated 0 bytes in 310 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 24 16:49:07.823026 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-713299d1-0682-4f67-ac9e-bf57f2886449 admin admin] Authenticating user token {{(pid=71938) process_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 24 16:49:07.831076 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.fernet_utils [None req-713299d1-0682-4f67-ac9e-bf57f2886449 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=71938) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:289}} Nov 24 16:49:07.906403 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dd476bc-06f9-4fb7-8606-5750999c0651 admin admin] Validating token access rules against request {{(pid=71939) validate_allowed_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 24 16:49:07.919915 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dadbc70a-5588-446d-9342-a244b528d2b0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f2ba2e8375b4e8c8792ee1e22b60427', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '00a5583c7b7443e98e7a1d31a0b638dc', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=71939) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 24 16:49:07.921802 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dadbc70a-5588-446d-9342-a244b528d2b0 admin admin] REQUEST_METHOD: `GET` {{(pid=71939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 24 16:49:07.924003 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dadbc70a-5588-446d-9342-a244b528d2b0 admin admin] SCRIPT_NAME: `/identity` {{(pid=71939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 24 16:49:07.924668 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dadbc70a-5588-446d-9342-a244b528d2b0 admin admin] PATH_INFO: `/v3/roles` {{(pid=71939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 24 16:49:07.925694 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dadbc70a-5588-446d-9342-a244b528d2b0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=71939) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:442}} Nov 24 16:49:07.938351 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-713299d1-0682-4f67-ac9e-bf57f2886449 admin admin] Validating token access rules against request {{(pid=71938) validate_allowed_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 24 16:49:07.943416 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a225bb70-8ebf-4845-985c-248aeb96bd8e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f2ba2e8375b4e8c8792ee1e22b60427', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '00a5583c7b7443e98e7a1d31a0b638dc', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=71938) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 24 16:49:07.944797 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a225bb70-8ebf-4845-985c-248aeb96bd8e admin admin] REQUEST_METHOD: `POST` {{(pid=71938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 24 16:49:07.945147 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a225bb70-8ebf-4845-985c-248aeb96bd8e admin admin] SCRIPT_NAME: `/identity` {{(pid=71938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 24 16:49:07.945628 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a225bb70-8ebf-4845-985c-248aeb96bd8e admin admin] PATH_INFO: `/v3/users` {{(pid=71938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 24 16:49:07.946239 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a225bb70-8ebf-4845-985c-248aeb96bd8e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=71938) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:442}} Nov 24 16:49:07.965747 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dadbc70a-5588-446d-9342-a244b528d2b0 admin admin] RBAC: Authorization granted {{(pid=71939) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 24 16:49:07.983289 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: [pid: 71939|app: 0|req: 1013/2015] 10.222.0.53 () {58 vars in 1112 bytes} [Wed Nov 24 16:49:07 2021] GET /identity/v3/roles => generated 1420 bytes in 199 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 24 16:49:07.983449 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a225bb70-8ebf-4845-985c-248aeb96bd8e admin admin] RBAC: Authorization granted {{(pid=71938) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 24 16:49:07.985254 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f83ebbb-2b41-4367-a893-004a171af5fd None None] REQUEST_METHOD: `POST` {{(pid=71939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 24 16:49:07.985780 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f83ebbb-2b41-4367-a893-004a171af5fd None None] SCRIPT_NAME: `/identity` {{(pid=71939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 24 16:49:07.989501 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f83ebbb-2b41-4367-a893-004a171af5fd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=71939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 24 16:49:08.024138 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: [pid: 71938|app: 0|req: 1003/2016] 10.222.0.53 () {60 vars in 1134 bytes} [Wed Nov 24 16:49:07 2021] POST /identity/v3/users => generated 306 bytes in 202 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 24 16:49:08.028451 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a225bb70-8ebf-4845-985c-248aeb96bd8e admin admin] Authenticating user token {{(pid=71938) process_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 24 16:49:08.032589 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.fernet_utils [None req-a225bb70-8ebf-4845-985c-248aeb96bd8e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=71938) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:289}} Nov 24 16:49:08.036146 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.auth.core [None req-0f83ebbb-2b41-4367-a893-004a171af5fd None None] MFA Rules not processed for user `0f2ba2e8375b4e8c8792ee1e22b60427`. Rule list: `[]` (Enabled: `True`). {{(pid=71939) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:442}} Nov 24 16:49:08.037380 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.fernet_utils [None req-0f83ebbb-2b41-4367-a893-004a171af5fd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=71939) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:289}} Nov 24 16:49:08.048777 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: [pid: 71939|app: 0|req: 1014/2017] 10.222.0.53 () {58 vars in 948 bytes} [Wed Nov 24 16:49:07 2021] POST /identity/v3/auth/tokens => generated 3669 bytes in 65 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 24 16:49:08.049612 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f83ebbb-2b41-4367-a893-004a171af5fd None None] Authenticating user token {{(pid=71939) process_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 24 16:49:08.062177 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f83ebbb-2b41-4367-a893-004a171af5fd None None] Validating token access rules against request {{(pid=71939) validate_allowed_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 24 16:49:08.064379 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a225bb70-8ebf-4845-985c-248aeb96bd8e admin admin] Validating token access rules against request {{(pid=71938) validate_allowed_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 24 16:49:08.067390 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d302ab7f-b53d-468b-884c-65d4a8f90548 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f2ba2e8375b4e8c8792ee1e22b60427', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '00a5583c7b7443e98e7a1d31a0b638dc', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=71939) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 24 16:49:08.068099 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d302ab7f-b53d-468b-884c-65d4a8f90548 admin admin] REQUEST_METHOD: `GET` {{(pid=71939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 24 16:49:08.068447 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d302ab7f-b53d-468b-884c-65d4a8f90548 admin admin] SCRIPT_NAME: `/identity` {{(pid=71939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 24 16:49:08.069633 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d302ab7f-b53d-468b-884c-65d4a8f90548 admin admin] PATH_INFO: `/v3/roles` {{(pid=71939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 24 16:49:08.070485 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d302ab7f-b53d-468b-884c-65d4a8f90548 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=71939) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:442}} Nov 24 16:49:08.077988 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e97bcb67-2149-49d6-aa01-bd3494a314d3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f2ba2e8375b4e8c8792ee1e22b60427', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '00a5583c7b7443e98e7a1d31a0b638dc', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=71938) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 24 16:49:08.078986 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e97bcb67-2149-49d6-aa01-bd3494a314d3 admin admin] REQUEST_METHOD: `PUT` {{(pid=71938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 24 16:49:08.079331 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e97bcb67-2149-49d6-aa01-bd3494a314d3 admin admin] SCRIPT_NAME: `/identity` {{(pid=71938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 24 16:49:08.079666 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e97bcb67-2149-49d6-aa01-bd3494a314d3 admin admin] PATH_INFO: `/v3/projects/1eba30a7ac2a454faacc84f7fefc6ba6/users/68fe2ddf4baf41788b31957a623776a9/roles/912ab5f10fa5477da74acf239f07604e` {{(pid=71938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 24 16:49:08.087132 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e97bcb67-2149-49d6-aa01-bd3494a314d3 admin admin] RBAC: Authorizing `identity:create_grant(project_id=1eba30a7ac2a454faacc84f7fefc6ba6, user_id=68fe2ddf4baf41788b31957a623776a9, role_id=912ab5f10fa5477da74acf239f07604e)` {{(pid=71938) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:442}} Nov 24 16:49:08.105596 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d302ab7f-b53d-468b-884c-65d4a8f90548 admin admin] RBAC: Authorization granted {{(pid=71939) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 24 16:49:08.119907 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: [pid: 71939|app: 0|req: 1015/2018] 10.222.0.53 () {58 vars in 1112 bytes} [Wed Nov 24 16:49:08 2021] GET /identity/v3/roles => generated 1420 bytes in 71 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 24 16:49:08.124786 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b0b8e61-68f5-4fcb-b8dc-5b73f69e1034 None None] REQUEST_METHOD: `POST` {{(pid=71939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 24 16:49:08.125194 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b0b8e61-68f5-4fcb-b8dc-5b73f69e1034 None None] SCRIPT_NAME: `/identity` {{(pid=71939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 24 16:49:08.125537 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b0b8e61-68f5-4fcb-b8dc-5b73f69e1034 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=71939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 24 16:49:08.158600 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.auth.core [None req-0b0b8e61-68f5-4fcb-b8dc-5b73f69e1034 None None] MFA Rules not processed for user `0f2ba2e8375b4e8c8792ee1e22b60427`. Rule list: `[]` (Enabled: `True`). {{(pid=71939) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:442}} Nov 24 16:49:08.159867 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.fernet_utils [None req-0b0b8e61-68f5-4fcb-b8dc-5b73f69e1034 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=71939) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:289}} Nov 24 16:49:08.166259 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e97bcb67-2149-49d6-aa01-bd3494a314d3 admin admin] RBAC: Authorization granted {{(pid=71938) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 24 16:49:08.168084 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: [pid: 71939|app: 0|req: 1016/2019] 10.222.0.53 () {58 vars in 948 bytes} [Wed Nov 24 16:49:08 2021] POST /identity/v3/auth/tokens => generated 3669 bytes in 44 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 24 16:49:08.170049 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b0b8e61-68f5-4fcb-b8dc-5b73f69e1034 None None] Authenticating user token {{(pid=71939) process_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 24 16:49:08.199854 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b0b8e61-68f5-4fcb-b8dc-5b73f69e1034 None None] Validating token access rules against request {{(pid=71939) validate_allowed_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 24 16:49:08.210134 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: [pid: 71938|app: 0|req: 1004/2020] 10.222.0.53 () {60 vars in 1473 bytes} [Wed Nov 24 16:49:08 2021] PUT /identity/v3/projects/1eba30a7ac2a454faacc84f7fefc6ba6/users/68fe2ddf4baf41788b31957a623776a9/roles/912ab5f10fa5477da74acf239f07604e => generated 0 bytes in 182 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 24 16:49:08.210134 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e97bcb67-2149-49d6-aa01-bd3494a314d3 admin admin] Authenticating user token {{(pid=71938) process_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 24 16:49:08.383243 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da0bd46e-0e96-42ea-9b10-8202112ef330 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f2ba2e8375b4e8c8792ee1e22b60427', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '00a5583c7b7443e98e7a1d31a0b638dc', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=71939) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 24 16:49:08.384202 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da0bd46e-0e96-42ea-9b10-8202112ef330 admin admin] REQUEST_METHOD: `PUT` {{(pid=71939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 24 16:49:08.385534 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da0bd46e-0e96-42ea-9b10-8202112ef330 admin admin] SCRIPT_NAME: `/identity` {{(pid=71939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 24 16:49:08.385887 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da0bd46e-0e96-42ea-9b10-8202112ef330 admin admin] PATH_INFO: `/v3/projects/9d0c1252519241bd9fccbee40102a850/users/f30156b4b33b4577b612974de424bdaf/roles/5611724e350b41e19921b5961a342582` {{(pid=71939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 24 16:49:08.409327 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e97bcb67-2149-49d6-aa01-bd3494a314d3 admin admin] Validating token access rules against request {{(pid=71938) validate_allowed_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 24 16:49:08.413992 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b99f337-e259-4c0c-96af-a9cb24eb418c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f2ba2e8375b4e8c8792ee1e22b60427', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '00a5583c7b7443e98e7a1d31a0b638dc', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=71938) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 24 16:49:08.414717 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b99f337-e259-4c0c-96af-a9cb24eb418c admin admin] REQUEST_METHOD: `GET` {{(pid=71938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 24 16:49:08.415059 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b99f337-e259-4c0c-96af-a9cb24eb418c admin admin] SCRIPT_NAME: `/identity` {{(pid=71938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 24 16:49:08.415587 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b99f337-e259-4c0c-96af-a9cb24eb418c admin admin] PATH_INFO: `/v3/domains` {{(pid=71938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 24 16:49:08.416395 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b99f337-e259-4c0c-96af-a9cb24eb418c admin admin] RBAC: Adding query filter params (name=Default) {{(pid=71938) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:161}} Nov 24 16:49:08.416754 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b99f337-e259-4c0c-96af-a9cb24eb418c admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=71938) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:442}} Nov 24 16:49:08.449892 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b99f337-e259-4c0c-96af-a9cb24eb418c admin admin] RBAC: Authorization granted {{(pid=71938) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 24 16:49:08.451431 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da0bd46e-0e96-42ea-9b10-8202112ef330 admin admin] RBAC: Authorizing `identity:create_grant(project_id=9d0c1252519241bd9fccbee40102a850, user_id=f30156b4b33b4577b612974de424bdaf, role_id=5611724e350b41e19921b5961a342582)` {{(pid=71939) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:442}} Nov 24 16:49:08.465480 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: [pid: 71938|app: 0|req: 1005/2021] 10.222.0.53 () {58 vars in 1143 bytes} [Wed Nov 24 16:49:08 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 258 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 24 16:49:08.470338 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b99f337-e259-4c0c-96af-a9cb24eb418c admin admin] Authenticating user token {{(pid=71938) process_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 24 16:49:08.482654 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b99f337-e259-4c0c-96af-a9cb24eb418c admin admin] Validating token access rules against request {{(pid=71938) validate_allowed_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 24 16:49:08.488163 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf21ad1a-1424-4ff4-9521-f0479cf7ded7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f2ba2e8375b4e8c8792ee1e22b60427', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '00a5583c7b7443e98e7a1d31a0b638dc', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=71938) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 24 16:49:08.488853 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf21ad1a-1424-4ff4-9521-f0479cf7ded7 admin admin] REQUEST_METHOD: `POST` {{(pid=71938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 24 16:49:08.489197 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf21ad1a-1424-4ff4-9521-f0479cf7ded7 admin admin] SCRIPT_NAME: `/identity` {{(pid=71938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 24 16:49:08.489537 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf21ad1a-1424-4ff4-9521-f0479cf7ded7 admin admin] PATH_INFO: `/v3/projects` {{(pid=71938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 24 16:49:08.490959 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf21ad1a-1424-4ff4-9521-f0479cf7ded7 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=71938) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:442}} Nov 24 16:49:08.535265 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf21ad1a-1424-4ff4-9521-f0479cf7ded7 admin admin] RBAC: Authorization granted {{(pid=71938) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 24 16:49:08.543504 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da0bd46e-0e96-42ea-9b10-8202112ef330 admin admin] RBAC: Authorization granted {{(pid=71939) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 24 16:49:08.578090 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: [pid: 71938|app: 0|req: 1006/2022] 10.222.0.53 () {60 vars in 1143 bytes} [Wed Nov 24 16:49:08 2021] POST /identity/v3/projects => generated 385 bytes in 106 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Nov 24 16:49:08.581115 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf21ad1a-1424-4ff4-9521-f0479cf7ded7 admin admin] Authenticating user token {{(pid=71938) process_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 24 16:49:08.587229 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: [pid: 71939|app: 0|req: 1017/2023] 10.222.0.53 () {60 vars in 1473 bytes} [Wed Nov 24 16:49:08 2021] PUT /identity/v3/projects/9d0c1252519241bd9fccbee40102a850/users/f30156b4b33b4577b612974de424bdaf/roles/5611724e350b41e19921b5961a342582 => generated 0 bytes in 419 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 24 16:49:08.591369 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da0bd46e-0e96-42ea-9b10-8202112ef330 admin admin] Authenticating user token {{(pid=71939) process_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 24 16:49:08.719030 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf21ad1a-1424-4ff4-9521-f0479cf7ded7 admin admin] Validating token access rules against request {{(pid=71938) validate_allowed_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 24 16:49:08.733084 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8abed1b2-72ef-4b81-bf8e-a1875ff01460 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f2ba2e8375b4e8c8792ee1e22b60427', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '00a5583c7b7443e98e7a1d31a0b638dc', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=71938) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 24 16:49:08.733886 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8abed1b2-72ef-4b81-bf8e-a1875ff01460 admin admin] REQUEST_METHOD: `POST` {{(pid=71938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 24 16:49:08.734267 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8abed1b2-72ef-4b81-bf8e-a1875ff01460 admin admin] SCRIPT_NAME: `/identity` {{(pid=71938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 24 16:49:08.734606 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8abed1b2-72ef-4b81-bf8e-a1875ff01460 admin admin] PATH_INFO: `/v3/users` {{(pid=71938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 24 16:49:08.735433 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8abed1b2-72ef-4b81-bf8e-a1875ff01460 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=71938) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:442}} Nov 24 16:49:08.802339 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da0bd46e-0e96-42ea-9b10-8202112ef330 admin admin] Validating token access rules against request {{(pid=71939) validate_allowed_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 24 16:49:08.814226 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e214ccd3-8ea0-4249-b4c0-16489d5cb4be admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f2ba2e8375b4e8c8792ee1e22b60427', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '00a5583c7b7443e98e7a1d31a0b638dc', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=71939) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 24 16:49:08.814401 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8abed1b2-72ef-4b81-bf8e-a1875ff01460 admin admin] RBAC: Authorization granted {{(pid=71938) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 24 16:49:08.815267 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e214ccd3-8ea0-4249-b4c0-16489d5cb4be admin admin] REQUEST_METHOD: `GET` {{(pid=71939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 24 16:49:08.816146 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e214ccd3-8ea0-4249-b4c0-16489d5cb4be admin admin] SCRIPT_NAME: `/identity` {{(pid=71939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 24 16:49:08.817023 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e214ccd3-8ea0-4249-b4c0-16489d5cb4be admin admin] PATH_INFO: `/v3/roles` {{(pid=71939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 24 16:49:08.818642 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e214ccd3-8ea0-4249-b4c0-16489d5cb4be admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=71939) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:442}} Nov 24 16:49:08.860879 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e214ccd3-8ea0-4249-b4c0-16489d5cb4be admin admin] RBAC: Authorization granted {{(pid=71939) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 24 16:49:08.869867 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: [pid: 71938|app: 0|req: 1007/2024] 10.222.0.53 () {60 vars in 1134 bytes} [Wed Nov 24 16:49:08 2021] POST /identity/v3/users => generated 293 bytes in 289 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 24 16:49:08.874107 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8abed1b2-72ef-4b81-bf8e-a1875ff01460 admin admin] Authenticating user token {{(pid=71938) process_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 24 16:49:08.879324 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: [pid: 71939|app: 0|req: 1018/2025] 10.222.0.53 () {58 vars in 1112 bytes} [Wed Nov 24 16:49:08 2021] GET /identity/v3/roles => generated 1420 bytes in 288 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Nov 24 16:49:08.880288 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e214ccd3-8ea0-4249-b4c0-16489d5cb4be admin admin] Authenticating user token {{(pid=71939) process_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 24 16:49:08.888454 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8abed1b2-72ef-4b81-bf8e-a1875ff01460 admin admin] Validating token access rules against request {{(pid=71938) validate_allowed_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 24 16:49:08.891906 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e214ccd3-8ea0-4249-b4c0-16489d5cb4be admin admin] Validating token access rules against request {{(pid=71939) validate_allowed_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 24 16:49:08.894590 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6c674c2-3dc8-4249-8da7-0de33a92747e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f2ba2e8375b4e8c8792ee1e22b60427', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '00a5583c7b7443e98e7a1d31a0b638dc', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=71938) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 24 16:49:08.895323 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6c674c2-3dc8-4249-8da7-0de33a92747e admin admin] REQUEST_METHOD: `GET` {{(pid=71938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 24 16:49:08.895600 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6c674c2-3dc8-4249-8da7-0de33a92747e admin admin] SCRIPT_NAME: `/identity` {{(pid=71938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 24 16:49:08.896470 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6c674c2-3dc8-4249-8da7-0de33a92747e admin admin] PATH_INFO: `/v3/roles` {{(pid=71938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 24 16:49:08.897916 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6c674c2-3dc8-4249-8da7-0de33a92747e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=71938) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:442}} Nov 24 16:49:08.906002 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62129df5-c631-486d-a7d2-d00f3b71d7a5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f2ba2e8375b4e8c8792ee1e22b60427', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '00a5583c7b7443e98e7a1d31a0b638dc', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=71939) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 24 16:49:08.906979 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62129df5-c631-486d-a7d2-d00f3b71d7a5 admin admin] REQUEST_METHOD: `PUT` {{(pid=71939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 24 16:49:08.907323 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62129df5-c631-486d-a7d2-d00f3b71d7a5 admin admin] SCRIPT_NAME: `/identity` {{(pid=71939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 24 16:49:08.907655 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62129df5-c631-486d-a7d2-d00f3b71d7a5 admin admin] PATH_INFO: `/v3/projects/9d0c1252519241bd9fccbee40102a850/users/f30156b4b33b4577b612974de424bdaf/roles/5611724e350b41e19921b5961a342582` {{(pid=71939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 24 16:49:08.915006 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62129df5-c631-486d-a7d2-d00f3b71d7a5 admin admin] RBAC: Authorizing `identity:create_grant(project_id=9d0c1252519241bd9fccbee40102a850, user_id=f30156b4b33b4577b612974de424bdaf, role_id=5611724e350b41e19921b5961a342582)` {{(pid=71939) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:442}} Nov 24 16:49:08.965598 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6c674c2-3dc8-4249-8da7-0de33a92747e admin admin] RBAC: Authorization granted {{(pid=71938) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 24 16:49:08.972105 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62129df5-c631-486d-a7d2-d00f3b71d7a5 admin admin] RBAC: Authorization granted {{(pid=71939) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 24 16:49:08.986091 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: [pid: 71939|app: 0|req: 1019/2026] 10.222.0.53 () {60 vars in 1473 bytes} [Wed Nov 24 16:49:08 2021] PUT /identity/v3/projects/9d0c1252519241bd9fccbee40102a850/users/f30156b4b33b4577b612974de424bdaf/roles/5611724e350b41e19921b5961a342582 => generated 0 bytes in 106 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 24 16:49:08.993952 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62129df5-c631-486d-a7d2-d00f3b71d7a5 admin admin] Authenticating user token {{(pid=71939) process_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 24 16:49:09.014905 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: [pid: 71938|app: 0|req: 1008/2027] 10.222.0.53 () {58 vars in 1112 bytes} [Wed Nov 24 16:49:08 2021] GET /identity/v3/roles => generated 1420 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Nov 24 16:49:09.017566 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6c674c2-3dc8-4249-8da7-0de33a92747e admin admin] Authenticating user token {{(pid=71938) process_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 24 16:49:09.039300 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6c674c2-3dc8-4249-8da7-0de33a92747e admin admin] Validating token access rules against request {{(pid=71938) validate_allowed_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 24 16:49:09.139099 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62129df5-c631-486d-a7d2-d00f3b71d7a5 admin admin] Validating token access rules against request {{(pid=71939) validate_allowed_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 24 16:49:09.145629 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed245f93-ef5f-4e48-84d7-45aa579164e4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f2ba2e8375b4e8c8792ee1e22b60427', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '00a5583c7b7443e98e7a1d31a0b638dc', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=71939) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 24 16:49:09.146810 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed245f93-ef5f-4e48-84d7-45aa579164e4 admin admin] REQUEST_METHOD: `GET` {{(pid=71939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 24 16:49:09.147507 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed245f93-ef5f-4e48-84d7-45aa579164e4 admin admin] SCRIPT_NAME: `/identity` {{(pid=71939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 24 16:49:09.148157 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed245f93-ef5f-4e48-84d7-45aa579164e4 admin admin] PATH_INFO: `/v3/roles` {{(pid=71939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 24 16:49:09.149176 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed245f93-ef5f-4e48-84d7-45aa579164e4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=71939) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:442}} Nov 24 16:49:09.196738 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42d422ec-8e60-466a-91da-7f8bd551d0c5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f2ba2e8375b4e8c8792ee1e22b60427', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '00a5583c7b7443e98e7a1d31a0b638dc', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=71938) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 24 16:49:09.198390 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42d422ec-8e60-466a-91da-7f8bd551d0c5 admin admin] REQUEST_METHOD: `PUT` {{(pid=71938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 24 16:49:09.198934 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42d422ec-8e60-466a-91da-7f8bd551d0c5 admin admin] SCRIPT_NAME: `/identity` {{(pid=71938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 24 16:49:09.199713 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42d422ec-8e60-466a-91da-7f8bd551d0c5 admin admin] PATH_INFO: `/v3/projects/f5baa4045d9547bbb161df92ae83869d/users/caab579973344780b65daa583d656808/roles/912ab5f10fa5477da74acf239f07604e` {{(pid=71938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 24 16:49:09.231648 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed245f93-ef5f-4e48-84d7-45aa579164e4 admin admin] RBAC: Authorization granted {{(pid=71939) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 24 16:49:09.251071 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42d422ec-8e60-466a-91da-7f8bd551d0c5 admin admin] RBAC: Authorizing `identity:create_grant(project_id=f5baa4045d9547bbb161df92ae83869d, user_id=caab579973344780b65daa583d656808, role_id=912ab5f10fa5477da74acf239f07604e)` {{(pid=71938) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:442}} Nov 24 16:49:09.257096 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: [pid: 71939|app: 0|req: 1020/2028] 10.222.0.53 () {58 vars in 1112 bytes} [Wed Nov 24 16:49:08 2021] GET /identity/v3/roles => generated 1420 bytes in 265 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 24 16:49:09.258102 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed245f93-ef5f-4e48-84d7-45aa579164e4 admin admin] Authenticating user token {{(pid=71939) process_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 24 16:49:09.280816 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed245f93-ef5f-4e48-84d7-45aa579164e4 admin admin] Validating token access rules against request {{(pid=71939) validate_allowed_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 24 16:49:09.294048 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46a98b48-c938-4842-9649-db1ad0a4ce4b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f2ba2e8375b4e8c8792ee1e22b60427', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '00a5583c7b7443e98e7a1d31a0b638dc', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=71939) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 24 16:49:09.294999 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46a98b48-c938-4842-9649-db1ad0a4ce4b admin admin] REQUEST_METHOD: `PUT` {{(pid=71939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 24 16:49:09.295343 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46a98b48-c938-4842-9649-db1ad0a4ce4b admin admin] SCRIPT_NAME: `/identity` {{(pid=71939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 24 16:49:09.296121 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46a98b48-c938-4842-9649-db1ad0a4ce4b admin admin] PATH_INFO: `/v3/projects/9d0c1252519241bd9fccbee40102a850/users/f30156b4b33b4577b612974de424bdaf/roles/912ab5f10fa5477da74acf239f07604e` {{(pid=71939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 24 16:49:09.307686 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46a98b48-c938-4842-9649-db1ad0a4ce4b admin admin] RBAC: Authorizing `identity:create_grant(project_id=9d0c1252519241bd9fccbee40102a850, user_id=f30156b4b33b4577b612974de424bdaf, role_id=912ab5f10fa5477da74acf239f07604e)` {{(pid=71939) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:442}} Nov 24 16:49:09.339130 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42d422ec-8e60-466a-91da-7f8bd551d0c5 admin admin] RBAC: Authorization granted {{(pid=71938) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 24 16:49:09.358719 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46a98b48-c938-4842-9649-db1ad0a4ce4b admin admin] RBAC: Authorization granted {{(pid=71939) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 24 16:49:09.377162 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: [pid: 71938|app: 0|req: 1009/2029] 10.222.0.53 () {60 vars in 1473 bytes} [Wed Nov 24 16:49:09 2021] PUT /identity/v3/projects/f5baa4045d9547bbb161df92ae83869d/users/caab579973344780b65daa583d656808/roles/912ab5f10fa5477da74acf239f07604e => generated 0 bytes in 362 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 24 16:49:09.392280 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: [pid: 71939|app: 0|req: 1021/2030] 10.222.0.53 () {60 vars in 1473 bytes} [Wed Nov 24 16:49:09 2021] PUT /identity/v3/projects/9d0c1252519241bd9fccbee40102a850/users/f30156b4b33b4577b612974de424bdaf/roles/912ab5f10fa5477da74acf239f07604e => generated 0 bytes in 134 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 24 16:49:09.394213 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3420d0f8-53de-49d6-b6e0-4a6167348290 None None] REQUEST_METHOD: `POST` {{(pid=71938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 24 16:49:09.394635 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3420d0f8-53de-49d6-b6e0-4a6167348290 None None] SCRIPT_NAME: `/identity` {{(pid=71938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 24 16:49:09.394981 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3420d0f8-53de-49d6-b6e0-4a6167348290 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=71938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 24 16:49:09.408550 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2fdf6bf-8ffa-4604-8a9c-b369e974b169 None None] REQUEST_METHOD: `POST` {{(pid=71939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 24 16:49:09.408903 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2fdf6bf-8ffa-4604-8a9c-b369e974b169 None None] SCRIPT_NAME: `/identity` {{(pid=71939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 24 16:49:09.409380 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2fdf6bf-8ffa-4604-8a9c-b369e974b169 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=71939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 24 16:49:09.484644 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.auth.core [None req-3420d0f8-53de-49d6-b6e0-4a6167348290 None None] MFA Rules not processed for user `caab579973344780b65daa583d656808`. Rule list: `[]` (Enabled: `True`). {{(pid=71938) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:442}} Nov 24 16:49:09.487155 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.fernet_utils [None req-3420d0f8-53de-49d6-b6e0-4a6167348290 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=71938) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:289}} Nov 24 16:49:09.492628 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.auth.core [None req-b2fdf6bf-8ffa-4604-8a9c-b369e974b169 None None] MFA Rules not processed for user `f30156b4b33b4577b612974de424bdaf`. Rule list: `[]` (Enabled: `True`). {{(pid=71939) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:442}} Nov 24 16:49:09.494062 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.fernet_utils [None req-b2fdf6bf-8ffa-4604-8a9c-b369e974b169 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=71939) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:289}} Nov 24 16:49:09.598669 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: [pid: 71939|app: 0|req: 1022/2031] 10.222.0.53 () {58 vars in 948 bytes} [Wed Nov 24 16:49:09 2021] POST /identity/v3/auth/tokens => generated 3773 bytes in 192 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 24 16:49:09.612352 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2fdf6bf-8ffa-4604-8a9c-b369e974b169 None None] Authenticating user token {{(pid=71939) process_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 24 16:49:09.614463 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.fernet_utils [None req-b2fdf6bf-8ffa-4604-8a9c-b369e974b169 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=71939) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:289}} Nov 24 16:49:09.669643 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: [pid: 71938|app: 0|req: 1010/2032] 10.222.0.53 () {58 vars in 948 bytes} [Wed Nov 24 16:49:09 2021] POST /identity/v3/auth/tokens => generated 3692 bytes in 277 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 24 16:49:09.670940 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3420d0f8-53de-49d6-b6e0-4a6167348290 None None] Authenticating user token {{(pid=71938) process_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 24 16:49:09.695324 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2fdf6bf-8ffa-4604-8a9c-b369e974b169 None None] Validating token access rules against request {{(pid=71939) validate_allowed_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 24 16:49:09.700000 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99bd8e05-2480-4643-bad2-192265cf2293 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a12374a3093a401a97c343ff0854184d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3b3940d4ae1c4177ae29c02377bb4b0b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=71939) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 24 16:49:09.701005 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99bd8e05-2480-4643-bad2-192265cf2293 service cinder] REQUEST_METHOD: `GET` {{(pid=71939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 24 16:49:09.701434 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99bd8e05-2480-4643-bad2-192265cf2293 service cinder] SCRIPT_NAME: `/identity` {{(pid=71939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 24 16:49:09.701820 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99bd8e05-2480-4643-bad2-192265cf2293 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=71939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 24 16:49:09.716151 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99bd8e05-2480-4643-bad2-192265cf2293 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=71939) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:442}} Nov 24 16:49:09.748679 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99bd8e05-2480-4643-bad2-192265cf2293 service cinder] RBAC: Authorization granted {{(pid=71939) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 24 16:49:09.765561 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3420d0f8-53de-49d6-b6e0-4a6167348290 None None] Validating token access rules against request {{(pid=71938) validate_allowed_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 24 16:49:09.775548 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-179f5843-7978-4888-9bd0-6681d6deb0e7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f2ba2e8375b4e8c8792ee1e22b60427', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '00a5583c7b7443e98e7a1d31a0b638dc', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=71938) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 24 16:49:09.776229 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: [pid: 71939|app: 0|req: 1023/2033] 10.222.0.53 () {60 vars in 1356 bytes} [Wed Nov 24 16:49:09 2021] GET /identity/v3/auth/tokens => generated 3773 bytes in 165 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 24 16:49:09.777276 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-179f5843-7978-4888-9bd0-6681d6deb0e7 admin admin] REQUEST_METHOD: `POST` {{(pid=71938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 24 16:49:09.778054 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-179f5843-7978-4888-9bd0-6681d6deb0e7 admin admin] SCRIPT_NAME: `/identity` {{(pid=71938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 24 16:49:09.778588 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-179f5843-7978-4888-9bd0-6681d6deb0e7 admin admin] PATH_INFO: `/v3/projects` {{(pid=71938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 24 16:49:09.779765 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-179f5843-7978-4888-9bd0-6681d6deb0e7 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=71938) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:442}} Nov 24 16:49:09.820219 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-179f5843-7978-4888-9bd0-6681d6deb0e7 admin admin] RBAC: Authorization granted {{(pid=71938) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 24 16:49:09.856118 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: [pid: 71938|app: 0|req: 1011/2034] 10.222.0.53 () {60 vars in 1143 bytes} [Wed Nov 24 16:49:09 2021] POST /identity/v3/projects => generated 387 bytes in 186 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 24 16:49:09.860636 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99bd8e05-2480-4643-bad2-192265cf2293 service cinder] Authenticating user token {{(pid=71939) process_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 24 16:49:09.876060 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99bd8e05-2480-4643-bad2-192265cf2293 service cinder] Validating token access rules against request {{(pid=71939) validate_allowed_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 24 16:49:09.892718 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-179f5843-7978-4888-9bd0-6681d6deb0e7 admin admin] Authenticating user token {{(pid=71938) process_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 24 16:49:09.964563 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f12a8814-2542-4bad-bfc5-03802b699382 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f2ba2e8375b4e8c8792ee1e22b60427', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '00a5583c7b7443e98e7a1d31a0b638dc', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=71939) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 24 16:49:09.965256 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f12a8814-2542-4bad-bfc5-03802b699382 admin admin] REQUEST_METHOD: `POST` {{(pid=71939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 24 16:49:09.965638 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f12a8814-2542-4bad-bfc5-03802b699382 admin admin] SCRIPT_NAME: `/identity` {{(pid=71939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 24 16:49:09.965950 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f12a8814-2542-4bad-bfc5-03802b699382 admin admin] PATH_INFO: `/v3/users` {{(pid=71939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 24 16:49:09.967063 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f12a8814-2542-4bad-bfc5-03802b699382 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=71939) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:442}} Nov 24 16:49:09.979791 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-179f5843-7978-4888-9bd0-6681d6deb0e7 admin admin] Validating token access rules against request {{(pid=71938) validate_allowed_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 24 16:49:09.984016 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6a30981-6a58-468c-a835-0fa52bca5707 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a12374a3093a401a97c343ff0854184d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3b3940d4ae1c4177ae29c02377bb4b0b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=71938) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 24 16:49:09.984646 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6a30981-6a58-468c-a835-0fa52bca5707 service cinder] REQUEST_METHOD: `GET` {{(pid=71938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 24 16:49:09.985062 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6a30981-6a58-468c-a835-0fa52bca5707 service cinder] SCRIPT_NAME: `/identity` {{(pid=71938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 24 16:49:09.985324 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6a30981-6a58-468c-a835-0fa52bca5707 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=71938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 24 16:49:09.987249 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.fernet_utils [None req-b6a30981-6a58-468c-a835-0fa52bca5707 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=71938) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:289}} Nov 24 16:49:09.996712 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f12a8814-2542-4bad-bfc5-03802b699382 admin admin] RBAC: Authorization granted {{(pid=71939) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 24 16:49:10.018509 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: [pid: 71939|app: 0|req: 1024/2035] 10.222.0.53 () {60 vars in 1134 bytes} [Wed Nov 24 16:49:09 2021] POST /identity/v3/users => generated 300 bytes in 158 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 24 16:49:10.022721 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f12a8814-2542-4bad-bfc5-03802b699382 admin admin] Authenticating user token {{(pid=71939) process_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 24 16:49:10.024462 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.fernet_utils [None req-f12a8814-2542-4bad-bfc5-03802b699382 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=71939) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:289}} Nov 24 16:49:10.036394 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f12a8814-2542-4bad-bfc5-03802b699382 admin admin] Validating token access rules against request {{(pid=71939) validate_allowed_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 24 16:49:10.042346 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e0cac23-b98e-4a80-9461-f070f6a89631 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f2ba2e8375b4e8c8792ee1e22b60427', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '00a5583c7b7443e98e7a1d31a0b638dc', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=71939) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 24 16:49:10.043263 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e0cac23-b98e-4a80-9461-f070f6a89631 admin admin] REQUEST_METHOD: `DELETE` {{(pid=71939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 24 16:49:10.043608 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e0cac23-b98e-4a80-9461-f070f6a89631 admin admin] SCRIPT_NAME: `/identity` {{(pid=71939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 24 16:49:10.043943 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e0cac23-b98e-4a80-9461-f070f6a89631 admin admin] PATH_INFO: `/v3/users/48e7bef9d9de4753b5f22228eb6ed593` {{(pid=71939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 24 16:49:10.045192 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e0cac23-b98e-4a80-9461-f070f6a89631 admin admin] RBAC: Authorizing `identity:delete_user(user_id=48e7bef9d9de4753b5f22228eb6ed593)` {{(pid=71939) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:442}} Nov 24 16:49:10.067156 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6a30981-6a58-468c-a835-0fa52bca5707 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=71938) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:442}} Nov 24 16:49:10.075633 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e0cac23-b98e-4a80-9461-f070f6a89631 admin admin] RBAC: Authorization granted {{(pid=71939) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 24 16:49:10.095746 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6a30981-6a58-468c-a835-0fa52bca5707 service cinder] RBAC: Authorization granted {{(pid=71938) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 24 16:49:10.118392 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: [pid: 71938|app: 0|req: 1012/2036] 10.222.0.53 () {60 vars in 1356 bytes} [Wed Nov 24 16:49:09 2021] GET /identity/v3/auth/tokens => generated 3706 bytes in 223 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 24 16:49:10.119778 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6a30981-6a58-468c-a835-0fa52bca5707 service cinder] Authenticating user token {{(pid=71938) process_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 24 16:49:10.134964 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6a30981-6a58-468c-a835-0fa52bca5707 service cinder] Validating token access rules against request {{(pid=71938) validate_allowed_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 24 16:49:10.140077 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.notifications [None req-3e0cac23-b98e-4a80-9461-f070f6a89631 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '48e7bef9d9de4753b5f22228eb6ed593'} {{(pid=71939) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:357}} Nov 24 16:49:10.144845 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09bde620-d013-48a8-9565-85dc9bda596e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f2ba2e8375b4e8c8792ee1e22b60427', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '00a5583c7b7443e98e7a1d31a0b638dc', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=71938) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 24 16:49:10.146173 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09bde620-d013-48a8-9565-85dc9bda596e admin admin] REQUEST_METHOD: `GET` {{(pid=71938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 24 16:49:10.146705 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09bde620-d013-48a8-9565-85dc9bda596e admin admin] SCRIPT_NAME: `/identity` {{(pid=71938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 24 16:49:10.147799 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09bde620-d013-48a8-9565-85dc9bda596e admin admin] PATH_INFO: `/v3/roles` {{(pid=71938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 24 16:49:10.150101 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09bde620-d013-48a8-9565-85dc9bda596e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=71938) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:442}} Nov 24 16:49:10.158799 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.notifications [None req-3e0cac23-b98e-4a80-9461-f070f6a89631 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '48e7bef9d9de4753b5f22228eb6ed593'} {{(pid=71939) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:357}} Nov 24 16:49:10.159672 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.notifications [None req-3e0cac23-b98e-4a80-9461-f070f6a89631 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '48e7bef9d9de4753b5f22228eb6ed593'} {{(pid=71939) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:357}} Nov 24 16:49:10.170072 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.notifications [None req-3e0cac23-b98e-4a80-9461-f070f6a89631 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '48e7bef9d9de4753b5f22228eb6ed593'} {{(pid=71939) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:357}} Nov 24 16:49:10.192334 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.notifications [None req-3e0cac23-b98e-4a80-9461-f070f6a89631 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '48e7bef9d9de4753b5f22228eb6ed593'} {{(pid=71939) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:357}} Nov 24 16:49:10.201878 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: [pid: 71939|app: 0|req: 1025/2037] 10.222.0.53 () {58 vars in 1214 bytes} [Wed Nov 24 16:49:10 2021] DELETE /identity/v3/users/48e7bef9d9de4753b5f22228eb6ed593 => generated 0 bytes in 180 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 24 16:49:10.207245 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a28ac3a-e79a-48cc-8d49-0f1a85f6c7a3 None None] REQUEST_METHOD: `POST` {{(pid=71939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 24 16:49:10.207799 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a28ac3a-e79a-48cc-8d49-0f1a85f6c7a3 None None] SCRIPT_NAME: `/identity` {{(pid=71939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 24 16:49:10.208221 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a28ac3a-e79a-48cc-8d49-0f1a85f6c7a3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=71939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 24 16:49:10.220338 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09bde620-d013-48a8-9565-85dc9bda596e admin admin] RBAC: Authorization granted {{(pid=71938) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 24 16:49:10.249221 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.auth.core [None req-4a28ac3a-e79a-48cc-8d49-0f1a85f6c7a3 None None] MFA Rules not processed for user `0f2ba2e8375b4e8c8792ee1e22b60427`. Rule list: `[]` (Enabled: `True`). {{(pid=71939) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:442}} Nov 24 16:49:10.250627 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.fernet_utils [None req-4a28ac3a-e79a-48cc-8d49-0f1a85f6c7a3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=71939) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:289}} Nov 24 16:49:10.258675 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: [pid: 71938|app: 0|req: 1013/2038] 10.222.0.53 () {58 vars in 1112 bytes} [Wed Nov 24 16:49:10 2021] GET /identity/v3/roles => generated 1420 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 24 16:49:10.259594 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09bde620-d013-48a8-9565-85dc9bda596e admin admin] Authenticating user token {{(pid=71938) process_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 24 16:49:10.262111 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.fernet_utils [None req-09bde620-d013-48a8-9565-85dc9bda596e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=71938) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:289}} Nov 24 16:49:10.277582 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09bde620-d013-48a8-9565-85dc9bda596e admin admin] Validating token access rules against request {{(pid=71938) validate_allowed_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 24 16:49:10.356544 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: [pid: 71939|app: 0|req: 1026/2039] 10.222.0.53 () {58 vars in 948 bytes} [Wed Nov 24 16:49:10 2021] POST /identity/v3/auth/tokens => generated 3669 bytes in 148 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 24 16:49:10.363629 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9185a6f7-37f4-4c71-a64f-086ba61fdc2d None None] REQUEST_METHOD: `POST` {{(pid=71939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 24 16:49:10.364092 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9185a6f7-37f4-4c71-a64f-086ba61fdc2d None None] SCRIPT_NAME: `/identity` {{(pid=71939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 24 16:49:10.364513 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9185a6f7-37f4-4c71-a64f-086ba61fdc2d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=71939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 24 16:49:10.419758 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.auth.core [None req-9185a6f7-37f4-4c71-a64f-086ba61fdc2d None None] MFA Rules not processed for user `68fe2ddf4baf41788b31957a623776a9`. Rule list: `[]` (Enabled: `True`). {{(pid=71939) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:442}} Nov 24 16:49:10.421378 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.fernet_utils [None req-9185a6f7-37f4-4c71-a64f-086ba61fdc2d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=71939) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:289}} Nov 24 16:49:10.423906 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-021e698e-095f-4353-aa90-1e98aa39d5f7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f2ba2e8375b4e8c8792ee1e22b60427', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '00a5583c7b7443e98e7a1d31a0b638dc', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=71938) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 24 16:49:10.424821 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-021e698e-095f-4353-aa90-1e98aa39d5f7 admin admin] REQUEST_METHOD: `PUT` {{(pid=71938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 24 16:49:10.425161 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-021e698e-095f-4353-aa90-1e98aa39d5f7 admin admin] SCRIPT_NAME: `/identity` {{(pid=71938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 24 16:49:10.425497 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-021e698e-095f-4353-aa90-1e98aa39d5f7 admin admin] PATH_INFO: `/v3/projects/656693ef3e9c4b5dbc4a8546ea3819ef/users/80e2c5edf25e46df9cac2775fcadb413/roles/5611724e350b41e19921b5961a342582` {{(pid=71938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 24 16:49:10.482075 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-021e698e-095f-4353-aa90-1e98aa39d5f7 admin admin] RBAC: Authorizing `identity:create_grant(project_id=656693ef3e9c4b5dbc4a8546ea3819ef, user_id=80e2c5edf25e46df9cac2775fcadb413, role_id=5611724e350b41e19921b5961a342582)` {{(pid=71938) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:442}} Nov 24 16:49:10.513959 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-021e698e-095f-4353-aa90-1e98aa39d5f7 admin admin] RBAC: Authorization granted {{(pid=71938) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 24 16:49:10.546557 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: [pid: 71938|app: 0|req: 1014/2040] 10.222.0.53 () {60 vars in 1473 bytes} [Wed Nov 24 16:49:10 2021] PUT /identity/v3/projects/656693ef3e9c4b5dbc4a8546ea3819ef/users/80e2c5edf25e46df9cac2775fcadb413/roles/5611724e350b41e19921b5961a342582 => generated 0 bytes in 287 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 24 16:49:10.547589 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-021e698e-095f-4353-aa90-1e98aa39d5f7 admin admin] Authenticating user token {{(pid=71938) process_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 24 16:49:10.555992 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.fernet_utils [None req-021e698e-095f-4353-aa90-1e98aa39d5f7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=71938) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:289}} Nov 24 16:49:10.610262 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: [pid: 71939|app: 0|req: 1027/2041] 10.222.0.53 () {58 vars in 948 bytes} [Wed Nov 24 16:49:10 2021] POST /identity/v3/auth/tokens => generated 3745 bytes in 248 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 24 16:49:10.611971 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9185a6f7-37f4-4c71-a64f-086ba61fdc2d None None] Authenticating user token {{(pid=71939) process_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 24 16:49:10.636396 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9185a6f7-37f4-4c71-a64f-086ba61fdc2d None None] Validating token access rules against request {{(pid=71939) validate_allowed_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 24 16:49:10.737247 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-021e698e-095f-4353-aa90-1e98aa39d5f7 admin admin] Validating token access rules against request {{(pid=71938) validate_allowed_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 24 16:49:10.750519 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2e95640-683e-4b31-9667-66593c8c05d5 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c90f21b9cdcb413282461fa83cb6b7a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3b3940d4ae1c4177ae29c02377bb4b0b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=71938) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 24 16:49:10.751403 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2e95640-683e-4b31-9667-66593c8c05d5 service neutron] REQUEST_METHOD: `GET` {{(pid=71938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 24 16:49:10.751748 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2e95640-683e-4b31-9667-66593c8c05d5 service neutron] SCRIPT_NAME: `/identity` {{(pid=71938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 24 16:49:10.752221 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2e95640-683e-4b31-9667-66593c8c05d5 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=71938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 24 16:49:10.816941 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48a215d5-a75d-416c-b69c-05905fc5832d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f2ba2e8375b4e8c8792ee1e22b60427', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '00a5583c7b7443e98e7a1d31a0b638dc', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=71939) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 24 16:49:10.817821 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48a215d5-a75d-416c-b69c-05905fc5832d admin admin] REQUEST_METHOD: `GET` {{(pid=71939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 24 16:49:10.818308 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48a215d5-a75d-416c-b69c-05905fc5832d admin admin] SCRIPT_NAME: `/identity` {{(pid=71939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 24 16:49:10.819824 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48a215d5-a75d-416c-b69c-05905fc5832d admin admin] PATH_INFO: `/v3/roles` {{(pid=71939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 24 16:49:10.820656 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48a215d5-a75d-416c-b69c-05905fc5832d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=71939) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:442}} Nov 24 16:49:10.876090 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48a215d5-a75d-416c-b69c-05905fc5832d admin admin] RBAC: Authorization granted {{(pid=71939) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 24 16:49:10.890672 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2e95640-683e-4b31-9667-66593c8c05d5 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=71938) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:442}} Nov 24 16:49:10.897487 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: [pid: 71939|app: 0|req: 1028/2042] 10.222.0.53 () {58 vars in 1112 bytes} [Wed Nov 24 16:49:10 2021] GET /identity/v3/roles => generated 1420 bytes in 286 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 24 16:49:10.899358 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48a215d5-a75d-416c-b69c-05905fc5832d admin admin] Authenticating user token {{(pid=71939) process_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 24 16:49:10.907423 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.fernet_utils [None req-48a215d5-a75d-416c-b69c-05905fc5832d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=71939) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:289}} Nov 24 16:49:10.925412 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2e95640-683e-4b31-9667-66593c8c05d5 service neutron] RBAC: Authorization granted {{(pid=71938) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 24 16:49:10.940729 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: [pid: 71938|app: 0|req: 1015/2043] 10.222.0.53 () {60 vars in 1356 bytes} [Wed Nov 24 16:49:10 2021] GET /identity/v3/auth/tokens => generated 3669 bytes in 393 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 24 16:49:10.941914 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2e95640-683e-4b31-9667-66593c8c05d5 service neutron] Authenticating user token {{(pid=71938) process_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 24 16:49:10.954252 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2e95640-683e-4b31-9667-66593c8c05d5 service neutron] Validating token access rules against request {{(pid=71938) validate_allowed_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 24 16:49:10.966389 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e65eab9-b237-4b65-87bc-d4093cab19f7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f2ba2e8375b4e8c8792ee1e22b60427', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '00a5583c7b7443e98e7a1d31a0b638dc', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=71938) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 24 16:49:10.967709 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e65eab9-b237-4b65-87bc-d4093cab19f7 admin admin] REQUEST_METHOD: `PUT` {{(pid=71938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 24 16:49:10.968050 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e65eab9-b237-4b65-87bc-d4093cab19f7 admin admin] SCRIPT_NAME: `/identity` {{(pid=71938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 24 16:49:10.968978 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e65eab9-b237-4b65-87bc-d4093cab19f7 admin admin] PATH_INFO: `/v3/projects/656693ef3e9c4b5dbc4a8546ea3819ef/users/80e2c5edf25e46df9cac2775fcadb413/roles/5611724e350b41e19921b5961a342582` {{(pid=71938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 24 16:49:10.972947 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e65eab9-b237-4b65-87bc-d4093cab19f7 admin admin] RBAC: Authorizing `identity:create_grant(project_id=656693ef3e9c4b5dbc4a8546ea3819ef, user_id=80e2c5edf25e46df9cac2775fcadb413, role_id=5611724e350b41e19921b5961a342582)` {{(pid=71938) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:442}} Nov 24 16:49:11.008543 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48a215d5-a75d-416c-b69c-05905fc5832d admin admin] Validating token access rules against request {{(pid=71939) validate_allowed_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 24 16:49:11.012430 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c16d049-dae3-4586-aa94-1555da81d7c5 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a12374a3093a401a97c343ff0854184d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3b3940d4ae1c4177ae29c02377bb4b0b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=71939) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 24 16:49:11.013106 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c16d049-dae3-4586-aa94-1555da81d7c5 service cinder] REQUEST_METHOD: `GET` {{(pid=71939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 24 16:49:11.013453 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c16d049-dae3-4586-aa94-1555da81d7c5 service cinder] SCRIPT_NAME: `/identity` {{(pid=71939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 24 16:49:11.013792 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c16d049-dae3-4586-aa94-1555da81d7c5 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=71939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 24 16:49:11.015798 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.fernet_utils [None req-7c16d049-dae3-4586-aa94-1555da81d7c5 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=71939) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:289}} Nov 24 16:49:11.051053 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e65eab9-b237-4b65-87bc-d4093cab19f7 admin admin] RBAC: Authorization granted {{(pid=71938) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 24 16:49:11.079855 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: [pid: 71938|app: 0|req: 1016/2044] 10.222.0.53 () {60 vars in 1473 bytes} [Wed Nov 24 16:49:10 2021] PUT /identity/v3/projects/656693ef3e9c4b5dbc4a8546ea3819ef/users/80e2c5edf25e46df9cac2775fcadb413/roles/5611724e350b41e19921b5961a342582 => generated 0 bytes in 139 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 24 16:49:11.084009 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e65eab9-b237-4b65-87bc-d4093cab19f7 admin admin] Authenticating user token {{(pid=71938) process_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 24 16:49:11.108704 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c16d049-dae3-4586-aa94-1555da81d7c5 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=71939) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:442}} Nov 24 16:49:11.157921 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c16d049-dae3-4586-aa94-1555da81d7c5 service cinder] RBAC: Authorization granted {{(pid=71939) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 24 16:49:11.209588 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: [pid: 71939|app: 0|req: 1029/2045] 10.222.0.53 () {60 vars in 1356 bytes} [Wed Nov 24 16:49:10 2021] GET /identity/v3/auth/tokens => generated 3678 bytes in 311 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 24 16:49:11.273460 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e65eab9-b237-4b65-87bc-d4093cab19f7 admin admin] Validating token access rules against request {{(pid=71938) validate_allowed_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 24 16:49:11.278792 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-932d6786-1464-4a68-a6da-aa647de005b8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f2ba2e8375b4e8c8792ee1e22b60427', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '00a5583c7b7443e98e7a1d31a0b638dc', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=71938) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 24 16:49:11.279522 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-932d6786-1464-4a68-a6da-aa647de005b8 admin admin] REQUEST_METHOD: `GET` {{(pid=71938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 24 16:49:11.279942 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-932d6786-1464-4a68-a6da-aa647de005b8 admin admin] SCRIPT_NAME: `/identity` {{(pid=71938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 24 16:49:11.280373 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-932d6786-1464-4a68-a6da-aa647de005b8 admin admin] PATH_INFO: `/v3/roles` {{(pid=71938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 24 16:49:11.281381 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-932d6786-1464-4a68-a6da-aa647de005b8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=71938) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:442}} Nov 24 16:49:11.313451 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-932d6786-1464-4a68-a6da-aa647de005b8 admin admin] RBAC: Authorization granted {{(pid=71938) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 24 16:49:11.326502 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: [pid: 71938|app: 0|req: 1017/2046] 10.222.0.53 () {58 vars in 1112 bytes} [Wed Nov 24 16:49:11 2021] GET /identity/v3/roles => generated 1420 bytes in 243 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 24 16:49:11.330825 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c16d049-dae3-4586-aa94-1555da81d7c5 service cinder] Authenticating user token {{(pid=71939) process_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 24 16:49:11.346484 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c16d049-dae3-4586-aa94-1555da81d7c5 service cinder] Validating token access rules against request {{(pid=71939) validate_allowed_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 24 16:49:11.354910 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d614010-f6b7-4a05-9e96-2edf9e50319c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f2ba2e8375b4e8c8792ee1e22b60427', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '00a5583c7b7443e98e7a1d31a0b638dc', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=71939) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 24 16:49:11.356482 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d614010-f6b7-4a05-9e96-2edf9e50319c admin admin] REQUEST_METHOD: `PUT` {{(pid=71939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 24 16:49:11.357011 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d614010-f6b7-4a05-9e96-2edf9e50319c admin admin] SCRIPT_NAME: `/identity` {{(pid=71939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 24 16:49:11.357537 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d614010-f6b7-4a05-9e96-2edf9e50319c admin admin] PATH_INFO: `/v3/projects/656693ef3e9c4b5dbc4a8546ea3819ef/users/80e2c5edf25e46df9cac2775fcadb413/roles/912ab5f10fa5477da74acf239f07604e` {{(pid=71939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 24 16:49:11.359978 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d614010-f6b7-4a05-9e96-2edf9e50319c admin admin] RBAC: Authorizing `identity:create_grant(project_id=656693ef3e9c4b5dbc4a8546ea3819ef, user_id=80e2c5edf25e46df9cac2775fcadb413, role_id=912ab5f10fa5477da74acf239f07604e)` {{(pid=71939) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:442}} Nov 24 16:49:11.399177 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d614010-f6b7-4a05-9e96-2edf9e50319c admin admin] RBAC: Authorization granted {{(pid=71939) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 24 16:49:11.427927 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: [pid: 71939|app: 0|req: 1030/2047] 10.222.0.53 () {60 vars in 1473 bytes} [Wed Nov 24 16:49:11 2021] PUT /identity/v3/projects/656693ef3e9c4b5dbc4a8546ea3819ef/users/80e2c5edf25e46df9cac2775fcadb413/roles/912ab5f10fa5477da74acf239f07604e => generated 0 bytes in 98 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 24 16:49:11.440865 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10809c93-fa46-45f5-8014-f900fa6b0a95 None None] REQUEST_METHOD: `POST` {{(pid=71938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 24 16:49:11.441220 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10809c93-fa46-45f5-8014-f900fa6b0a95 None None] SCRIPT_NAME: `/identity` {{(pid=71938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 24 16:49:11.441827 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10809c93-fa46-45f5-8014-f900fa6b0a95 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=71938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 24 16:49:11.499992 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.auth.core [None req-10809c93-fa46-45f5-8014-f900fa6b0a95 None None] MFA Rules not processed for user `80e2c5edf25e46df9cac2775fcadb413`. Rule list: `[]` (Enabled: `True`). {{(pid=71938) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:442}} Nov 24 16:49:11.502350 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.fernet_utils [None req-10809c93-fa46-45f5-8014-f900fa6b0a95 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=71938) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:289}} Nov 24 16:49:11.632315 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: [pid: 71938|app: 0|req: 1018/2048] 10.222.0.53 () {58 vars in 948 bytes} [Wed Nov 24 16:49:11 2021] POST /identity/v3/auth/tokens => generated 3761 bytes in 193 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 24 16:49:11.717557 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d614010-f6b7-4a05-9e96-2edf9e50319c admin admin] Authenticating user token {{(pid=71939) process_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 24 16:49:11.720049 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.fernet_utils [None req-0d614010-f6b7-4a05-9e96-2edf9e50319c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=71939) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:289}} Nov 24 16:49:11.811817 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d614010-f6b7-4a05-9e96-2edf9e50319c admin admin] Validating token access rules against request {{(pid=71939) validate_allowed_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 24 16:49:11.817147 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-081d61b8-b988-4532-8960-356a9d0efa2b service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a12374a3093a401a97c343ff0854184d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3b3940d4ae1c4177ae29c02377bb4b0b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=71939) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 24 16:49:11.817946 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-081d61b8-b988-4532-8960-356a9d0efa2b service cinder] REQUEST_METHOD: `GET` {{(pid=71939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 24 16:49:11.831017 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-081d61b8-b988-4532-8960-356a9d0efa2b service cinder] SCRIPT_NAME: `/identity` {{(pid=71939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 24 16:49:11.831638 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-081d61b8-b988-4532-8960-356a9d0efa2b service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=71939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 24 16:49:11.856147 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-081d61b8-b988-4532-8960-356a9d0efa2b service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=71939) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:442}} Nov 24 16:49:11.925211 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-081d61b8-b988-4532-8960-356a9d0efa2b service cinder] RBAC: Authorization granted {{(pid=71939) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 24 16:49:11.937550 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: [pid: 71939|app: 0|req: 1031/2049] 10.222.0.53 () {60 vars in 1356 bytes} [Wed Nov 24 16:49:11 2021] GET /identity/v3/auth/tokens => generated 3761 bytes in 221 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 24 16:49:12.056361 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10809c93-fa46-45f5-8014-f900fa6b0a95 None None] Authenticating user token {{(pid=71938) process_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 24 16:49:12.124119 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-081d61b8-b988-4532-8960-356a9d0efa2b service cinder] Authenticating user token {{(pid=71939) process_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 24 16:49:12.126126 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.fernet_utils [None req-081d61b8-b988-4532-8960-356a9d0efa2b service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=71939) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:289}} Nov 24 16:49:12.204068 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10809c93-fa46-45f5-8014-f900fa6b0a95 None None] Validating token access rules against request {{(pid=71938) validate_allowed_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 24 16:49:12.219984 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a373b47b-47cd-4918-a4fd-74bfe660f98c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f2ba2e8375b4e8c8792ee1e22b60427', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '00a5583c7b7443e98e7a1d31a0b638dc', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=71938) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 24 16:49:12.221161 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a373b47b-47cd-4918-a4fd-74bfe660f98c admin admin] REQUEST_METHOD: `DELETE` {{(pid=71938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 24 16:49:12.221692 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a373b47b-47cd-4918-a4fd-74bfe660f98c admin admin] SCRIPT_NAME: `/identity` {{(pid=71938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 24 16:49:12.222271 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a373b47b-47cd-4918-a4fd-74bfe660f98c admin admin] PATH_INFO: `/v3/users/caab579973344780b65daa583d656808` {{(pid=71938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 24 16:49:12.227167 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a373b47b-47cd-4918-a4fd-74bfe660f98c admin admin] RBAC: Authorizing `identity:delete_user(user_id=caab579973344780b65daa583d656808)` {{(pid=71938) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:442}} Nov 24 16:49:12.271592 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a373b47b-47cd-4918-a4fd-74bfe660f98c admin admin] RBAC: Authorization granted {{(pid=71938) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 24 16:49:12.273922 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-081d61b8-b988-4532-8960-356a9d0efa2b service cinder] Validating token access rules against request {{(pid=71939) validate_allowed_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 24 16:49:12.279560 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77077c61-c16b-4546-988a-44bdbb85d8c1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f2ba2e8375b4e8c8792ee1e22b60427', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '00a5583c7b7443e98e7a1d31a0b638dc', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=71939) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 24 16:49:12.280642 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77077c61-c16b-4546-988a-44bdbb85d8c1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=71939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 24 16:49:12.281272 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77077c61-c16b-4546-988a-44bdbb85d8c1 admin admin] SCRIPT_NAME: `/identity` {{(pid=71939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 24 16:49:12.281272 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77077c61-c16b-4546-988a-44bdbb85d8c1 admin admin] PATH_INFO: `/v3/projects/8c9805e703a34b558d0f08f3fdb89b3e` {{(pid=71939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 24 16:49:12.282567 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77077c61-c16b-4546-988a-44bdbb85d8c1 admin admin] RBAC: Authorizing `identity:delete_project(project_id=8c9805e703a34b558d0f08f3fdb89b3e)` {{(pid=71939) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:442}} Nov 24 16:49:12.313354 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77077c61-c16b-4546-988a-44bdbb85d8c1 admin admin] RBAC: Authorization granted {{(pid=71939) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 24 16:49:12.342206 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.notifications [None req-a373b47b-47cd-4918-a4fd-74bfe660f98c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'caab579973344780b65daa583d656808'} {{(pid=71938) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:357}} Nov 24 16:49:12.358597 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.notifications [None req-a373b47b-47cd-4918-a4fd-74bfe660f98c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'caab579973344780b65daa583d656808'} {{(pid=71938) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:357}} Nov 24 16:49:12.359421 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.notifications [None req-a373b47b-47cd-4918-a4fd-74bfe660f98c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'caab579973344780b65daa583d656808'} {{(pid=71938) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:357}} Nov 24 16:49:12.370193 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.notifications [None req-a373b47b-47cd-4918-a4fd-74bfe660f98c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'caab579973344780b65daa583d656808'} {{(pid=71938) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:357}} Nov 24 16:49:12.378216 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.notifications [None req-a373b47b-47cd-4918-a4fd-74bfe660f98c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'caab579973344780b65daa583d656808'} {{(pid=71938) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:357}} Nov 24 16:49:12.379245 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.notifications [None req-77077c61-c16b-4546-988a-44bdbb85d8c1 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '8c9805e703a34b558d0f08f3fdb89b3e', 'request_id': 'req-77077c61-c16b-4546-988a-44bdbb85d8c1'} {{(pid=71939) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:357}} Nov 24 16:49:12.387988 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: [pid: 71938|app: 0|req: 1019/2050] 10.222.0.53 () {58 vars in 1214 bytes} [Wed Nov 24 16:49:12 2021] DELETE /identity/v3/users/caab579973344780b65daa583d656808 => generated 0 bytes in 332 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 24 16:49:12.393612 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b087904d-0296-49e0-aab6-9de1ef4924d4 None None] REQUEST_METHOD: `POST` {{(pid=71938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 24 16:49:12.393970 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b087904d-0296-49e0-aab6-9de1ef4924d4 None None] SCRIPT_NAME: `/identity` {{(pid=71938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 24 16:49:12.394342 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b087904d-0296-49e0-aab6-9de1ef4924d4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=71938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 24 16:49:12.424139 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.auth.core [None req-b087904d-0296-49e0-aab6-9de1ef4924d4 None None] MFA Rules not processed for user `0f2ba2e8375b4e8c8792ee1e22b60427`. Rule list: `[]` (Enabled: `True`). {{(pid=71938) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:442}} Nov 24 16:49:12.425459 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.fernet_utils [None req-b087904d-0296-49e0-aab6-9de1ef4924d4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=71938) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:289}} Nov 24 16:49:12.476133 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.notifications [None req-77077c61-c16b-4546-988a-44bdbb85d8c1 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '8c9805e703a34b558d0f08f3fdb89b3e', 'request_id': 'req-77077c61-c16b-4546-988a-44bdbb85d8c1'} {{(pid=71939) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:357}} Nov 24 16:49:12.483492 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.notifications [None req-77077c61-c16b-4546-988a-44bdbb85d8c1 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '8c9805e703a34b558d0f08f3fdb89b3e', 'request_id': 'req-77077c61-c16b-4546-988a-44bdbb85d8c1'} {{(pid=71939) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:357}} Nov 24 16:49:12.495511 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.notifications [None req-77077c61-c16b-4546-988a-44bdbb85d8c1 admin admin] The token cache is being invalidate because project 8c9805e703a34b558d0f08f3fdb89b3e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=71939) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Nov 24 16:49:12.495875 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.notifications [None req-77077c61-c16b-4546-988a-44bdbb85d8c1 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=71939) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:357}} Nov 24 16:49:12.496477 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.notifications [None req-77077c61-c16b-4546-988a-44bdbb85d8c1 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=71939) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:357}} Nov 24 16:49:12.498310 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: [pid: 71939|app: 0|req: 1032/2051] 10.222.0.53 () {58 vars in 1223 bytes} [Wed Nov 24 16:49:12 2021] DELETE /identity/v3/projects/8c9805e703a34b558d0f08f3fdb89b3e => generated 0 bytes in 376 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Nov 24 16:49:12.502232 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77077c61-c16b-4546-988a-44bdbb85d8c1 admin admin] Authenticating user token {{(pid=71939) process_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 24 16:49:12.503623 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.fernet_utils [None req-77077c61-c16b-4546-988a-44bdbb85d8c1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=71939) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:289}} Nov 24 16:49:12.505121 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: [pid: 71938|app: 0|req: 1020/2052] 10.222.0.53 () {58 vars in 948 bytes} [Wed Nov 24 16:49:12 2021] POST /identity/v3/auth/tokens => generated 3669 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Nov 24 16:49:12.517347 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b087904d-0296-49e0-aab6-9de1ef4924d4 None None] Authenticating user token {{(pid=71938) process_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 24 16:49:12.519032 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.fernet_utils [None req-b087904d-0296-49e0-aab6-9de1ef4924d4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=71938) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:289}} Nov 24 16:49:12.593619 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77077c61-c16b-4546-988a-44bdbb85d8c1 admin admin] Validating token access rules against request {{(pid=71939) validate_allowed_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 24 16:49:12.593827 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b087904d-0296-49e0-aab6-9de1ef4924d4 None None] Validating token access rules against request {{(pid=71938) validate_allowed_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 24 16:49:12.596859 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5ff0700-bd97-4f19-8d62-afcb8e758be0 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c90f21b9cdcb413282461fa83cb6b7a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3b3940d4ae1c4177ae29c02377bb4b0b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=71938) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 24 16:49:12.597527 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5ff0700-bd97-4f19-8d62-afcb8e758be0 service neutron] REQUEST_METHOD: `GET` {{(pid=71938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 24 16:49:12.597865 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5ff0700-bd97-4f19-8d62-afcb8e758be0 service neutron] SCRIPT_NAME: `/identity` {{(pid=71938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 24 16:49:12.597979 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32ce88bb-f640-40fa-b8f2-0815191c5b16 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f2ba2e8375b4e8c8792ee1e22b60427', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '00a5583c7b7443e98e7a1d31a0b638dc', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=71939) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 24 16:49:12.598224 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5ff0700-bd97-4f19-8d62-afcb8e758be0 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=71938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 24 16:49:12.599026 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32ce88bb-f640-40fa-b8f2-0815191c5b16 admin admin] REQUEST_METHOD: `DELETE` {{(pid=71939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 24 16:49:12.599369 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32ce88bb-f640-40fa-b8f2-0815191c5b16 admin admin] SCRIPT_NAME: `/identity` {{(pid=71939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 24 16:49:12.599706 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32ce88bb-f640-40fa-b8f2-0815191c5b16 admin admin] PATH_INFO: `/v3/users/6288c489e1d341f089004be44b835f99` {{(pid=71939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 24 16:49:12.601284 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32ce88bb-f640-40fa-b8f2-0815191c5b16 admin admin] RBAC: Authorizing `identity:delete_user(user_id=6288c489e1d341f089004be44b835f99)` {{(pid=71939) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:442}} Nov 24 16:49:12.613871 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5ff0700-bd97-4f19-8d62-afcb8e758be0 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=71938) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:442}} Nov 24 16:49:12.633357 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32ce88bb-f640-40fa-b8f2-0815191c5b16 admin admin] RBAC: Authorization granted {{(pid=71939) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 24 16:49:12.644500 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5ff0700-bd97-4f19-8d62-afcb8e758be0 service neutron] RBAC: Authorization granted {{(pid=71938) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 24 16:49:12.655920 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: [pid: 71938|app: 0|req: 1021/2053] 10.222.0.53 () {60 vars in 1356 bytes} [Wed Nov 24 16:49:12 2021] GET /identity/v3/auth/tokens => generated 3669 bytes in 139 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Nov 24 16:49:12.687165 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.notifications [None req-32ce88bb-f640-40fa-b8f2-0815191c5b16 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '6288c489e1d341f089004be44b835f99'} {{(pid=71939) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:357}} Nov 24 16:49:12.703627 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.notifications [None req-32ce88bb-f640-40fa-b8f2-0815191c5b16 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '6288c489e1d341f089004be44b835f99'} {{(pid=71939) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:357}} Nov 24 16:49:12.704379 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.notifications [None req-32ce88bb-f640-40fa-b8f2-0815191c5b16 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '6288c489e1d341f089004be44b835f99'} {{(pid=71939) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:357}} Nov 24 16:49:12.714404 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.notifications [None req-32ce88bb-f640-40fa-b8f2-0815191c5b16 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '6288c489e1d341f089004be44b835f99'} {{(pid=71939) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:357}} Nov 24 16:49:12.723354 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.notifications [None req-32ce88bb-f640-40fa-b8f2-0815191c5b16 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '6288c489e1d341f089004be44b835f99'} {{(pid=71939) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:357}} Nov 24 16:49:12.733390 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: [pid: 71939|app: 0|req: 1033/2054] 10.222.0.53 () {58 vars in 1214 bytes} [Wed Nov 24 16:49:12 2021] DELETE /identity/v3/users/6288c489e1d341f089004be44b835f99 => generated 0 bytes in 232 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Nov 24 16:49:13.240223 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5ff0700-bd97-4f19-8d62-afcb8e758be0 service neutron] Authenticating user token {{(pid=71938) process_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 24 16:49:13.242384 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.fernet_utils [None req-f5ff0700-bd97-4f19-8d62-afcb8e758be0 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=71938) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:289}} Nov 24 16:49:13.367726 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5ff0700-bd97-4f19-8d62-afcb8e758be0 service neutron] Validating token access rules against request {{(pid=71938) validate_allowed_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 24 16:49:13.417679 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32ce88bb-f640-40fa-b8f2-0815191c5b16 admin admin] Authenticating user token {{(pid=71939) process_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 24 16:49:13.421023 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.fernet_utils [None req-32ce88bb-f640-40fa-b8f2-0815191c5b16 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=71939) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:289}} Nov 24 16:49:13.498974 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f9b8cdb-b7db-4367-bfd7-87203046aba8 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a12374a3093a401a97c343ff0854184d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3b3940d4ae1c4177ae29c02377bb4b0b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=71938) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 24 16:49:13.499935 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f9b8cdb-b7db-4367-bfd7-87203046aba8 service cinder] REQUEST_METHOD: `GET` {{(pid=71938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 24 16:49:13.501038 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f9b8cdb-b7db-4367-bfd7-87203046aba8 service cinder] SCRIPT_NAME: `/identity` {{(pid=71938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 24 16:49:13.501038 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f9b8cdb-b7db-4367-bfd7-87203046aba8 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=71938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 24 16:49:13.502990 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.fernet_utils [None req-8f9b8cdb-b7db-4367-bfd7-87203046aba8 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=71938) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:289}} Nov 24 16:49:13.549593 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32ce88bb-f640-40fa-b8f2-0815191c5b16 admin admin] Validating token access rules against request {{(pid=71939) validate_allowed_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 24 16:49:13.556696 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ffc8970-3921-44a7-8d2a-1469d6b418e4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f2ba2e8375b4e8c8792ee1e22b60427', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '00a5583c7b7443e98e7a1d31a0b638dc', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=71939) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 24 16:49:13.558044 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ffc8970-3921-44a7-8d2a-1469d6b418e4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=71939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 24 16:49:13.558530 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ffc8970-3921-44a7-8d2a-1469d6b418e4 admin admin] SCRIPT_NAME: `/identity` {{(pid=71939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 24 16:49:13.559015 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ffc8970-3921-44a7-8d2a-1469d6b418e4 admin admin] PATH_INFO: `/v3/projects/d685cb1027654ab5a0fd06241b2da08e` {{(pid=71939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 24 16:49:13.561492 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ffc8970-3921-44a7-8d2a-1469d6b418e4 admin admin] RBAC: Authorizing `identity:delete_project(project_id=d685cb1027654ab5a0fd06241b2da08e)` {{(pid=71939) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:442}} Nov 24 16:49:13.602665 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ffc8970-3921-44a7-8d2a-1469d6b418e4 admin admin] RBAC: Authorization granted {{(pid=71939) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 24 16:49:13.607090 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f9b8cdb-b7db-4367-bfd7-87203046aba8 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=71938) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:442}} Nov 24 16:49:13.644443 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f9b8cdb-b7db-4367-bfd7-87203046aba8 service cinder] RBAC: Authorization granted {{(pid=71938) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 24 16:49:13.657180 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: [pid: 71938|app: 0|req: 1022/2055] 10.222.0.53 () {60 vars in 1356 bytes} [Wed Nov 24 16:49:13 2021] GET /identity/v3/auth/tokens => generated 3745 bytes in 418 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 24 16:49:13.667114 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.notifications [None req-0ffc8970-3921-44a7-8d2a-1469d6b418e4 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd685cb1027654ab5a0fd06241b2da08e', 'request_id': 'req-0ffc8970-3921-44a7-8d2a-1469d6b418e4'} {{(pid=71939) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:357}} Nov 24 16:49:13.680726 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.notifications [None req-0ffc8970-3921-44a7-8d2a-1469d6b418e4 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd685cb1027654ab5a0fd06241b2da08e', 'request_id': 'req-0ffc8970-3921-44a7-8d2a-1469d6b418e4'} {{(pid=71939) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:357}} Nov 24 16:49:13.688410 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.notifications [None req-0ffc8970-3921-44a7-8d2a-1469d6b418e4 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd685cb1027654ab5a0fd06241b2da08e', 'request_id': 'req-0ffc8970-3921-44a7-8d2a-1469d6b418e4'} {{(pid=71939) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:357}} Nov 24 16:49:13.702795 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.notifications [None req-0ffc8970-3921-44a7-8d2a-1469d6b418e4 admin admin] The token cache is being invalidate because project d685cb1027654ab5a0fd06241b2da08e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=71939) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Nov 24 16:49:13.703228 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.notifications [None req-0ffc8970-3921-44a7-8d2a-1469d6b418e4 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=71939) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:357}} Nov 24 16:49:13.703917 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.notifications [None req-0ffc8970-3921-44a7-8d2a-1469d6b418e4 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=71939) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:357}} Nov 24 16:49:13.711841 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: [pid: 71939|app: 0|req: 1034/2056] 10.222.0.53 () {58 vars in 1223 bytes} [Wed Nov 24 16:49:13 2021] DELETE /identity/v3/projects/d685cb1027654ab5a0fd06241b2da08e => generated 0 bytes in 289 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 24 16:49:13.713436 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abefac93-6441-489c-8b07-9af4eb672f60 None None] REQUEST_METHOD: `POST` {{(pid=71938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 24 16:49:13.713785 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abefac93-6441-489c-8b07-9af4eb672f60 None None] SCRIPT_NAME: `/identity` {{(pid=71938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 24 16:49:13.714404 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abefac93-6441-489c-8b07-9af4eb672f60 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=71938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 24 16:49:13.739817 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.auth.core [None req-abefac93-6441-489c-8b07-9af4eb672f60 None None] MFA Rules not processed for user `0f2ba2e8375b4e8c8792ee1e22b60427`. Rule list: `[]` (Enabled: `True`). {{(pid=71938) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:442}} Nov 24 16:49:13.741116 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.fernet_utils [None req-abefac93-6441-489c-8b07-9af4eb672f60 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=71938) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:289}} Nov 24 16:49:13.831429 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: [pid: 71938|app: 0|req: 1023/2057] 10.222.0.53 () {58 vars in 948 bytes} [Wed Nov 24 16:49:13 2021] POST /identity/v3/auth/tokens => generated 3669 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 24 16:49:13.833896 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-147e16ee-b14e-4996-bd3d-415811658de4 None None] REQUEST_METHOD: `POST` {{(pid=71939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 24 16:49:13.834257 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-147e16ee-b14e-4996-bd3d-415811658de4 None None] SCRIPT_NAME: `/identity` {{(pid=71939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 24 16:49:13.834669 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-147e16ee-b14e-4996-bd3d-415811658de4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=71939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 24 16:49:13.872496 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abefac93-6441-489c-8b07-9af4eb672f60 None None] Authenticating user token {{(pid=71938) process_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 24 16:49:13.880115 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.fernet_utils [None req-abefac93-6441-489c-8b07-9af4eb672f60 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=71938) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:289}} Nov 24 16:49:13.893008 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abefac93-6441-489c-8b07-9af4eb672f60 None None] Validating token access rules against request {{(pid=71938) validate_allowed_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 24 16:49:13.897783 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80da417d-777d-445a-bda1-f78f63ec4c9f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f2ba2e8375b4e8c8792ee1e22b60427', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '00a5583c7b7443e98e7a1d31a0b638dc', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=71938) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 24 16:49:13.898742 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80da417d-777d-445a-bda1-f78f63ec4c9f admin admin] REQUEST_METHOD: `DELETE` {{(pid=71938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 24 16:49:13.899076 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80da417d-777d-445a-bda1-f78f63ec4c9f admin admin] SCRIPT_NAME: `/identity` {{(pid=71938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 24 16:49:13.899403 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80da417d-777d-445a-bda1-f78f63ec4c9f admin admin] PATH_INFO: `/v3/projects/f5baa4045d9547bbb161df92ae83869d` {{(pid=71938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 24 16:49:13.900625 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80da417d-777d-445a-bda1-f78f63ec4c9f admin admin] RBAC: Authorizing `identity:delete_project(project_id=f5baa4045d9547bbb161df92ae83869d)` {{(pid=71938) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:442}} Nov 24 16:49:13.911862 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.auth.core [None req-147e16ee-b14e-4996-bd3d-415811658de4 None None] MFA Rules not processed for user `0f2ba2e8375b4e8c8792ee1e22b60427`. Rule list: `[]` (Enabled: `True`). {{(pid=71939) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:442}} Nov 24 16:49:13.914251 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.fernet_utils [None req-147e16ee-b14e-4996-bd3d-415811658de4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=71939) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:289}} Nov 24 16:49:13.927617 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: [pid: 71939|app: 0|req: 1035/2058] 10.222.0.53 () {58 vars in 948 bytes} [Wed Nov 24 16:49:13 2021] POST /identity/v3/auth/tokens => generated 3669 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 24 16:49:13.929729 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-147e16ee-b14e-4996-bd3d-415811658de4 None None] Authenticating user token {{(pid=71939) process_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 24 16:49:13.935875 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80da417d-777d-445a-bda1-f78f63ec4c9f admin admin] RBAC: Authorization granted {{(pid=71938) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 24 16:49:13.940741 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-147e16ee-b14e-4996-bd3d-415811658de4 None None] Validating token access rules against request {{(pid=71939) validate_allowed_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 24 16:49:13.946883 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-070b4803-3e49-431f-b0c7-6ab6c63da50e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f2ba2e8375b4e8c8792ee1e22b60427', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '00a5583c7b7443e98e7a1d31a0b638dc', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=71939) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 24 16:49:13.948184 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-070b4803-3e49-431f-b0c7-6ab6c63da50e admin admin] REQUEST_METHOD: `GET` {{(pid=71939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 24 16:49:13.948717 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-070b4803-3e49-431f-b0c7-6ab6c63da50e admin admin] SCRIPT_NAME: `/identity` {{(pid=71939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 24 16:49:13.949379 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-070b4803-3e49-431f-b0c7-6ab6c63da50e admin admin] PATH_INFO: `/v3/domains` {{(pid=71939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 24 16:49:13.950423 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-070b4803-3e49-431f-b0c7-6ab6c63da50e admin admin] RBAC: Adding query filter params (name=Default) {{(pid=71939) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:161}} Nov 24 16:49:13.950984 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-070b4803-3e49-431f-b0c7-6ab6c63da50e admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=71939) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:442}} Nov 24 16:49:13.987975 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-070b4803-3e49-431f-b0c7-6ab6c63da50e admin admin] RBAC: Authorization granted {{(pid=71939) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 24 16:49:14.008386 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.notifications [None req-80da417d-777d-445a-bda1-f78f63ec4c9f admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f5baa4045d9547bbb161df92ae83869d', 'request_id': 'req-80da417d-777d-445a-bda1-f78f63ec4c9f'} {{(pid=71938) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:357}} Nov 24 16:49:14.012836 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: [pid: 71939|app: 0|req: 1036/2059] 10.222.0.53 () {58 vars in 1143 bytes} [Wed Nov 24 16:49:13 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 81 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 24 16:49:14.015445 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-070b4803-3e49-431f-b0c7-6ab6c63da50e admin admin] Authenticating user token {{(pid=71939) process_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 24 16:49:14.024543 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.notifications [None req-80da417d-777d-445a-bda1-f78f63ec4c9f admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f5baa4045d9547bbb161df92ae83869d', 'request_id': 'req-80da417d-777d-445a-bda1-f78f63ec4c9f'} {{(pid=71938) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:357}} Nov 24 16:49:14.031352 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.notifications [None req-80da417d-777d-445a-bda1-f78f63ec4c9f admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f5baa4045d9547bbb161df92ae83869d', 'request_id': 'req-80da417d-777d-445a-bda1-f78f63ec4c9f'} {{(pid=71938) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:357}} Nov 24 16:49:14.032587 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-070b4803-3e49-431f-b0c7-6ab6c63da50e admin admin] Validating token access rules against request {{(pid=71939) validate_allowed_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 24 16:49:14.047477 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.notifications [None req-80da417d-777d-445a-bda1-f78f63ec4c9f admin admin] The token cache is being invalidate because project f5baa4045d9547bbb161df92ae83869d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=71938) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Nov 24 16:49:14.048109 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.notifications [None req-80da417d-777d-445a-bda1-f78f63ec4c9f admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=71938) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:357}} Nov 24 16:49:14.048925 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.notifications [None req-80da417d-777d-445a-bda1-f78f63ec4c9f admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=71938) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:357}} Nov 24 16:49:14.051091 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: [pid: 71938|app: 0|req: 1024/2060] 10.222.0.53 () {58 vars in 1223 bytes} [Wed Nov 24 16:49:13 2021] DELETE /identity/v3/projects/f5baa4045d9547bbb161df92ae83869d => generated 0 bytes in 181 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 24 16:49:14.055603 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80da417d-777d-445a-bda1-f78f63ec4c9f admin admin] Authenticating user token {{(pid=71938) process_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 24 16:49:14.058018 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.fernet_utils [None req-80da417d-777d-445a-bda1-f78f63ec4c9f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=71938) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:289}} Nov 24 16:49:14.116699 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b102bc7a-76a1-4efa-8fc1-535c477c0239 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f2ba2e8375b4e8c8792ee1e22b60427', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '00a5583c7b7443e98e7a1d31a0b638dc', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=71939) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 24 16:49:14.118211 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b102bc7a-76a1-4efa-8fc1-535c477c0239 admin admin] REQUEST_METHOD: `POST` {{(pid=71939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 24 16:49:14.118838 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b102bc7a-76a1-4efa-8fc1-535c477c0239 admin admin] SCRIPT_NAME: `/identity` {{(pid=71939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 24 16:49:14.119256 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b102bc7a-76a1-4efa-8fc1-535c477c0239 admin admin] PATH_INFO: `/v3/projects` {{(pid=71939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 24 16:49:14.120211 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b102bc7a-76a1-4efa-8fc1-535c477c0239 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=71939) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:442}} Nov 24 16:49:14.149951 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b102bc7a-76a1-4efa-8fc1-535c477c0239 admin admin] RBAC: Authorization granted {{(pid=71939) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 24 16:49:14.174183 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80da417d-777d-445a-bda1-f78f63ec4c9f admin admin] Validating token access rules against request {{(pid=71938) validate_allowed_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 24 16:49:14.179187 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a651f077-64a9-43a4-beb3-07b67b2f6be0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f2ba2e8375b4e8c8792ee1e22b60427', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '00a5583c7b7443e98e7a1d31a0b638dc', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=71938) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 24 16:49:14.180039 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a651f077-64a9-43a4-beb3-07b67b2f6be0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=71938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 24 16:49:14.180376 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a651f077-64a9-43a4-beb3-07b67b2f6be0 admin admin] SCRIPT_NAME: `/identity` {{(pid=71938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 24 16:49:14.180703 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a651f077-64a9-43a4-beb3-07b67b2f6be0 admin admin] PATH_INFO: `/v3/users/80e2c5edf25e46df9cac2775fcadb413` {{(pid=71938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 24 16:49:14.182058 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a651f077-64a9-43a4-beb3-07b67b2f6be0 admin admin] RBAC: Authorizing `identity:delete_user(user_id=80e2c5edf25e46df9cac2775fcadb413)` {{(pid=71938) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:442}} Nov 24 16:49:14.196920 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: [pid: 71939|app: 0|req: 1037/2061] 10.222.0.53 () {60 vars in 1143 bytes} [Wed Nov 24 16:49:14 2021] POST /identity/v3/projects => generated 387 bytes in 182 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 24 16:49:14.201391 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b102bc7a-76a1-4efa-8fc1-535c477c0239 admin admin] Authenticating user token {{(pid=71939) process_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 24 16:49:14.203950 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.fernet_utils [None req-b102bc7a-76a1-4efa-8fc1-535c477c0239 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=71939) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:289}} Nov 24 16:49:14.215551 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a651f077-64a9-43a4-beb3-07b67b2f6be0 admin admin] RBAC: Authorization granted {{(pid=71938) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 24 16:49:14.276113 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.notifications [None req-a651f077-64a9-43a4-beb3-07b67b2f6be0 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '80e2c5edf25e46df9cac2775fcadb413'} {{(pid=71938) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:357}} Nov 24 16:49:14.307418 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.notifications [None req-a651f077-64a9-43a4-beb3-07b67b2f6be0 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '80e2c5edf25e46df9cac2775fcadb413'} {{(pid=71938) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:357}} Nov 24 16:49:14.307577 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b102bc7a-76a1-4efa-8fc1-535c477c0239 admin admin] Validating token access rules against request {{(pid=71939) validate_allowed_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 24 16:49:14.308255 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.notifications [None req-a651f077-64a9-43a4-beb3-07b67b2f6be0 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '80e2c5edf25e46df9cac2775fcadb413'} {{(pid=71938) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:357}} Nov 24 16:49:14.313518 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be4fd012-4a7a-4636-8862-c725dd612f98 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f2ba2e8375b4e8c8792ee1e22b60427', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '00a5583c7b7443e98e7a1d31a0b638dc', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=71939) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 24 16:49:14.314598 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be4fd012-4a7a-4636-8862-c725dd612f98 admin admin] REQUEST_METHOD: `POST` {{(pid=71939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 24 16:49:14.315263 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be4fd012-4a7a-4636-8862-c725dd612f98 admin admin] SCRIPT_NAME: `/identity` {{(pid=71939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 24 16:49:14.315606 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be4fd012-4a7a-4636-8862-c725dd612f98 admin admin] PATH_INFO: `/v3/users` {{(pid=71939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 24 16:49:14.316862 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be4fd012-4a7a-4636-8862-c725dd612f98 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=71939) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:442}} Nov 24 16:49:14.317032 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.notifications [None req-a651f077-64a9-43a4-beb3-07b67b2f6be0 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '80e2c5edf25e46df9cac2775fcadb413'} {{(pid=71938) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:357}} Nov 24 16:49:14.325280 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.notifications [None req-a651f077-64a9-43a4-beb3-07b67b2f6be0 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '80e2c5edf25e46df9cac2775fcadb413'} {{(pid=71938) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:357}} Nov 24 16:49:14.332754 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: [pid: 71938|app: 0|req: 1025/2062] 10.222.0.53 () {58 vars in 1214 bytes} [Wed Nov 24 16:49:14 2021] DELETE /identity/v3/users/80e2c5edf25e46df9cac2775fcadb413 => generated 0 bytes in 278 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 24 16:49:14.351028 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be4fd012-4a7a-4636-8862-c725dd612f98 admin admin] RBAC: Authorization granted {{(pid=71939) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 24 16:49:14.373405 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: [pid: 71939|app: 0|req: 1038/2063] 10.222.0.53 () {60 vars in 1134 bytes} [Wed Nov 24 16:49:14 2021] POST /identity/v3/users => generated 294 bytes in 173 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Nov 24 16:49:14.378524 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a651f077-64a9-43a4-beb3-07b67b2f6be0 admin admin] Authenticating user token {{(pid=71938) process_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 24 16:49:14.380145 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.fernet_utils [None req-a651f077-64a9-43a4-beb3-07b67b2f6be0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=71938) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:289}} Nov 24 16:49:14.484423 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a651f077-64a9-43a4-beb3-07b67b2f6be0 admin admin] Validating token access rules against request {{(pid=71938) validate_allowed_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 24 16:49:14.490444 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6cdcd63-0b39-4c56-b032-73cf741efd7f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f2ba2e8375b4e8c8792ee1e22b60427', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '00a5583c7b7443e98e7a1d31a0b638dc', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=71938) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 24 16:49:14.491971 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6cdcd63-0b39-4c56-b032-73cf741efd7f admin admin] REQUEST_METHOD: `GET` {{(pid=71938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 24 16:49:14.492425 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6cdcd63-0b39-4c56-b032-73cf741efd7f admin admin] SCRIPT_NAME: `/identity` {{(pid=71938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 24 16:49:14.492888 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6cdcd63-0b39-4c56-b032-73cf741efd7f admin admin] PATH_INFO: `/v3/roles` {{(pid=71938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 24 16:49:14.493807 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6cdcd63-0b39-4c56-b032-73cf741efd7f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=71938) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:442}} Nov 24 16:49:14.524575 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6cdcd63-0b39-4c56-b032-73cf741efd7f admin admin] RBAC: Authorization granted {{(pid=71938) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 24 16:49:14.546105 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: [pid: 71938|app: 0|req: 1026/2064] 10.222.0.53 () {58 vars in 1112 bytes} [Wed Nov 24 16:49:14 2021] GET /identity/v3/roles => generated 1420 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 24 16:49:14.550410 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be4fd012-4a7a-4636-8862-c725dd612f98 admin admin] Authenticating user token {{(pid=71939) process_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 24 16:49:14.593822 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be4fd012-4a7a-4636-8862-c725dd612f98 admin admin] Validating token access rules against request {{(pid=71939) validate_allowed_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 24 16:49:14.599168 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e83a4c13-b7a7-4b52-a950-c7c573d8813b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f2ba2e8375b4e8c8792ee1e22b60427', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '00a5583c7b7443e98e7a1d31a0b638dc', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=71939) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 24 16:49:14.600632 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e83a4c13-b7a7-4b52-a950-c7c573d8813b admin admin] REQUEST_METHOD: `PUT` {{(pid=71939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 24 16:49:14.601121 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e83a4c13-b7a7-4b52-a950-c7c573d8813b admin admin] SCRIPT_NAME: `/identity` {{(pid=71939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 24 16:49:14.601481 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e83a4c13-b7a7-4b52-a950-c7c573d8813b admin admin] PATH_INFO: `/v3/projects/985cd89c35a1425baa816d1ac0902c65/users/6c9b3d7e6d0f47178c70c3afca862a8f/roles/912ab5f10fa5477da74acf239f07604e` {{(pid=71939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 24 16:49:14.639951 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e83a4c13-b7a7-4b52-a950-c7c573d8813b admin admin] RBAC: Authorizing `identity:create_grant(project_id=985cd89c35a1425baa816d1ac0902c65, user_id=6c9b3d7e6d0f47178c70c3afca862a8f, role_id=912ab5f10fa5477da74acf239f07604e)` {{(pid=71939) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:442}} Nov 24 16:49:14.671068 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e83a4c13-b7a7-4b52-a950-c7c573d8813b admin admin] RBAC: Authorization granted {{(pid=71939) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 24 16:49:14.688625 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: [pid: 71939|app: 0|req: 1039/2065] 10.222.0.53 () {60 vars in 1473 bytes} [Wed Nov 24 16:49:14 2021] PUT /identity/v3/projects/985cd89c35a1425baa816d1ac0902c65/users/6c9b3d7e6d0f47178c70c3afca862a8f/roles/912ab5f10fa5477da74acf239f07604e => generated 0 bytes in 139 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 24 16:49:14.700344 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f686cf71-0bff-4d7a-b6c6-b4a5c17b97c4 None None] REQUEST_METHOD: `POST` {{(pid=71938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 24 16:49:14.700689 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f686cf71-0bff-4d7a-b6c6-b4a5c17b97c4 None None] SCRIPT_NAME: `/identity` {{(pid=71938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 24 16:49:14.701268 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f686cf71-0bff-4d7a-b6c6-b4a5c17b97c4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=71938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 24 16:49:14.781760 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.auth.core [None req-f686cf71-0bff-4d7a-b6c6-b4a5c17b97c4 None None] MFA Rules not processed for user `6c9b3d7e6d0f47178c70c3afca862a8f`. Rule list: `[]` (Enabled: `True`). {{(pid=71938) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:442}} Nov 24 16:49:14.783031 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.fernet_utils [None req-f686cf71-0bff-4d7a-b6c6-b4a5c17b97c4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=71938) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:289}} Nov 24 16:49:14.929899 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: [pid: 71938|app: 0|req: 1027/2066] 10.222.0.53 () {58 vars in 948 bytes} [Wed Nov 24 16:49:14 2021] POST /identity/v3/auth/tokens => generated 3694 bytes in 230 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 24 16:49:14.934384 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e83a4c13-b7a7-4b52-a950-c7c573d8813b admin admin] Authenticating user token {{(pid=71939) process_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 24 16:49:15.102705 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e83a4c13-b7a7-4b52-a950-c7c573d8813b admin admin] Validating token access rules against request {{(pid=71939) validate_allowed_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 24 16:49:15.109613 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-609cc561-086e-4264-aa68-41737a551183 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f2ba2e8375b4e8c8792ee1e22b60427', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '00a5583c7b7443e98e7a1d31a0b638dc', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=71939) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 24 16:49:15.110504 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-609cc561-086e-4264-aa68-41737a551183 admin admin] REQUEST_METHOD: `POST` {{(pid=71939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 24 16:49:15.110955 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-609cc561-086e-4264-aa68-41737a551183 admin admin] SCRIPT_NAME: `/identity` {{(pid=71939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 24 16:49:15.111968 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-609cc561-086e-4264-aa68-41737a551183 admin admin] PATH_INFO: `/v3/projects` {{(pid=71939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 24 16:49:15.112999 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-609cc561-086e-4264-aa68-41737a551183 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=71939) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:442}} Nov 24 16:49:15.160818 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-609cc561-086e-4264-aa68-41737a551183 admin admin] RBAC: Authorization granted {{(pid=71939) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 24 16:49:15.226406 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f686cf71-0bff-4d7a-b6c6-b4a5c17b97c4 None None] Authenticating user token {{(pid=71938) process_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 24 16:49:15.228651 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.fernet_utils [None req-f686cf71-0bff-4d7a-b6c6-b4a5c17b97c4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=71938) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:289}} Nov 24 16:49:15.230748 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: [pid: 71939|app: 0|req: 1040/2067] 10.222.0.53 () {60 vars in 1143 bytes} [Wed Nov 24 16:49:14 2021] POST /identity/v3/projects => generated 387 bytes in 297 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Nov 24 16:49:15.235534 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-609cc561-086e-4264-aa68-41737a551183 admin admin] Authenticating user token {{(pid=71939) process_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 24 16:49:15.263051 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f686cf71-0bff-4d7a-b6c6-b4a5c17b97c4 None None] Validating token access rules against request {{(pid=71938) validate_allowed_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 24 16:49:15.396404 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-609cc561-086e-4264-aa68-41737a551183 admin admin] Validating token access rules against request {{(pid=71939) validate_allowed_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 24 16:49:15.403272 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fccbbe9-1adb-421e-982f-fbebe38f7452 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f2ba2e8375b4e8c8792ee1e22b60427', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '00a5583c7b7443e98e7a1d31a0b638dc', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=71938) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 24 16:49:15.404170 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fccbbe9-1adb-421e-982f-fbebe38f7452 admin admin] REQUEST_METHOD: `DELETE` {{(pid=71938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 24 16:49:15.404507 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fccbbe9-1adb-421e-982f-fbebe38f7452 admin admin] SCRIPT_NAME: `/identity` {{(pid=71938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 24 16:49:15.404838 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fccbbe9-1adb-421e-982f-fbebe38f7452 admin admin] PATH_INFO: `/v3/projects/656693ef3e9c4b5dbc4a8546ea3819ef` {{(pid=71938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 24 16:49:15.409046 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fccbbe9-1adb-421e-982f-fbebe38f7452 admin admin] RBAC: Authorizing `identity:delete_project(project_id=656693ef3e9c4b5dbc4a8546ea3819ef)` {{(pid=71938) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:442}} Nov 24 16:49:15.411109 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-645456cc-047d-4e3b-a3ee-13a109205f1d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f2ba2e8375b4e8c8792ee1e22b60427', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '00a5583c7b7443e98e7a1d31a0b638dc', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=71939) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 24 16:49:15.412008 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-645456cc-047d-4e3b-a3ee-13a109205f1d admin admin] REQUEST_METHOD: `POST` {{(pid=71939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 24 16:49:15.413385 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-645456cc-047d-4e3b-a3ee-13a109205f1d admin admin] SCRIPT_NAME: `/identity` {{(pid=71939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 24 16:49:15.413921 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-645456cc-047d-4e3b-a3ee-13a109205f1d admin admin] PATH_INFO: `/v3/users` {{(pid=71939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 24 16:49:15.415994 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-645456cc-047d-4e3b-a3ee-13a109205f1d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=71939) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:442}} Nov 24 16:49:15.441745 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fccbbe9-1adb-421e-982f-fbebe38f7452 admin admin] RBAC: Authorization granted {{(pid=71938) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 24 16:49:15.476642 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-645456cc-047d-4e3b-a3ee-13a109205f1d admin admin] RBAC: Authorization granted {{(pid=71939) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 24 16:49:15.513974 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.notifications [None req-5fccbbe9-1adb-421e-982f-fbebe38f7452 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '656693ef3e9c4b5dbc4a8546ea3819ef', 'request_id': 'req-5fccbbe9-1adb-421e-982f-fbebe38f7452'} {{(pid=71938) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:357}} Nov 24 16:49:15.525784 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: [pid: 71939|app: 0|req: 1041/2068] 10.222.0.53 () {60 vars in 1134 bytes} [Wed Nov 24 16:49:15 2021] POST /identity/v3/users => generated 294 bytes in 290 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 24 16:49:15.528587 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.notifications [None req-5fccbbe9-1adb-421e-982f-fbebe38f7452 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '656693ef3e9c4b5dbc4a8546ea3819ef', 'request_id': 'req-5fccbbe9-1adb-421e-982f-fbebe38f7452'} {{(pid=71938) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:357}} Nov 24 16:49:15.528801 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-645456cc-047d-4e3b-a3ee-13a109205f1d admin admin] Authenticating user token {{(pid=71939) process_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 24 16:49:15.534944 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.notifications [None req-5fccbbe9-1adb-421e-982f-fbebe38f7452 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '656693ef3e9c4b5dbc4a8546ea3819ef', 'request_id': 'req-5fccbbe9-1adb-421e-982f-fbebe38f7452'} {{(pid=71938) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:357}} Nov 24 16:49:15.547416 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-645456cc-047d-4e3b-a3ee-13a109205f1d admin admin] Validating token access rules against request {{(pid=71939) validate_allowed_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 24 16:49:15.556256 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.notifications [None req-5fccbbe9-1adb-421e-982f-fbebe38f7452 admin admin] The token cache is being invalidate because project 656693ef3e9c4b5dbc4a8546ea3819ef was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=71938) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Nov 24 16:49:15.556591 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.notifications [None req-5fccbbe9-1adb-421e-982f-fbebe38f7452 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=71938) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:357}} Nov 24 16:49:15.557529 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.notifications [None req-5fccbbe9-1adb-421e-982f-fbebe38f7452 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=71938) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:357}} Nov 24 16:49:15.561529 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: [pid: 71938|app: 0|req: 1028/2069] 10.222.0.53 () {58 vars in 1223 bytes} [Wed Nov 24 16:49:15 2021] DELETE /identity/v3/projects/656693ef3e9c4b5dbc4a8546ea3819ef => generated 0 bytes in 337 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 24 16:49:15.567594 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8ae0f6d-13e8-46b2-83e0-eeeaf0962783 None None] REQUEST_METHOD: `POST` {{(pid=71938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 24 16:49:15.567932 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8ae0f6d-13e8-46b2-83e0-eeeaf0962783 None None] SCRIPT_NAME: `/identity` {{(pid=71938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 24 16:49:15.568263 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8ae0f6d-13e8-46b2-83e0-eeeaf0962783 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=71938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 24 16:49:15.618494 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.auth.core [None req-b8ae0f6d-13e8-46b2-83e0-eeeaf0962783 None None] MFA Rules not processed for user `0f2ba2e8375b4e8c8792ee1e22b60427`. Rule list: `[]` (Enabled: `True`). {{(pid=71938) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:442}} Nov 24 16:49:15.621806 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.fernet_utils [None req-b8ae0f6d-13e8-46b2-83e0-eeeaf0962783 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=71938) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:289}} Nov 24 16:49:15.703524 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbde512f-8e78-4d39-8118-6e5e7c6948b9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f2ba2e8375b4e8c8792ee1e22b60427', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '00a5583c7b7443e98e7a1d31a0b638dc', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=71939) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 24 16:49:15.704363 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbde512f-8e78-4d39-8118-6e5e7c6948b9 admin admin] REQUEST_METHOD: `GET` {{(pid=71939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 24 16:49:15.704700 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbde512f-8e78-4d39-8118-6e5e7c6948b9 admin admin] SCRIPT_NAME: `/identity` {{(pid=71939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 24 16:49:15.705032 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbde512f-8e78-4d39-8118-6e5e7c6948b9 admin admin] PATH_INFO: `/v3/roles` {{(pid=71939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 24 16:49:15.706410 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbde512f-8e78-4d39-8118-6e5e7c6948b9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=71939) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:442}} Nov 24 16:49:15.765865 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbde512f-8e78-4d39-8118-6e5e7c6948b9 admin admin] RBAC: Authorization granted {{(pid=71939) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 24 16:49:15.770437 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: [pid: 71938|app: 0|req: 1029/2070] 10.222.0.53 () {58 vars in 948 bytes} [Wed Nov 24 16:49:15 2021] POST /identity/v3/auth/tokens => generated 3669 bytes in 204 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Nov 24 16:49:15.779070 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c27507a-ae84-466e-b44b-eb3c40c12be2 None None] REQUEST_METHOD: `POST` {{(pid=71938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 24 16:49:15.779484 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c27507a-ae84-466e-b44b-eb3c40c12be2 None None] SCRIPT_NAME: `/identity` {{(pid=71938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 24 16:49:15.779828 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c27507a-ae84-466e-b44b-eb3c40c12be2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=71938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 24 16:49:15.798087 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: [pid: 71939|app: 0|req: 1042/2071] 10.222.0.53 () {58 vars in 1112 bytes} [Wed Nov 24 16:49:15 2021] GET /identity/v3/roles => generated 1420 bytes in 269 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 24 16:49:15.801846 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbde512f-8e78-4d39-8118-6e5e7c6948b9 admin admin] Authenticating user token {{(pid=71939) process_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 24 16:49:15.806182 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.fernet_utils [None req-cbde512f-8e78-4d39-8118-6e5e7c6948b9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=71939) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:289}} Nov 24 16:49:15.827682 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbde512f-8e78-4d39-8118-6e5e7c6948b9 admin admin] Validating token access rules against request {{(pid=71939) validate_allowed_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 24 16:49:15.829136 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.auth.core [None req-6c27507a-ae84-466e-b44b-eb3c40c12be2 None None] MFA Rules not processed for user `0f2ba2e8375b4e8c8792ee1e22b60427`. Rule list: `[]` (Enabled: `True`). {{(pid=71938) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:442}} Nov 24 16:49:15.830394 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.fernet_utils [None req-6c27507a-ae84-466e-b44b-eb3c40c12be2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=71938) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:289}} Nov 24 16:49:15.839903 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba8a156d-7db0-42e9-8101-83cd32f55fbd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f2ba2e8375b4e8c8792ee1e22b60427', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '00a5583c7b7443e98e7a1d31a0b638dc', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=71939) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 24 16:49:15.840825 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba8a156d-7db0-42e9-8101-83cd32f55fbd admin admin] REQUEST_METHOD: `PUT` {{(pid=71939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 24 16:49:15.841168 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba8a156d-7db0-42e9-8101-83cd32f55fbd admin admin] SCRIPT_NAME: `/identity` {{(pid=71939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 24 16:49:15.841564 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba8a156d-7db0-42e9-8101-83cd32f55fbd admin admin] PATH_INFO: `/v3/projects/a60c4bd5e50e4d65bff749c0d952ff15/users/4a1cc2b42a5540a3a7449b7dea5c563b/roles/912ab5f10fa5477da74acf239f07604e` {{(pid=71939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 24 16:49:15.847098 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: [pid: 71938|app: 0|req: 1030/2072] 10.222.0.53 () {58 vars in 948 bytes} [Wed Nov 24 16:49:15 2021] POST /identity/v3/auth/tokens => generated 3669 bytes in 69 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Nov 24 16:49:15.851762 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c27507a-ae84-466e-b44b-eb3c40c12be2 None None] Authenticating user token {{(pid=71938) process_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 24 16:49:15.869841 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c27507a-ae84-466e-b44b-eb3c40c12be2 None None] Validating token access rules against request {{(pid=71938) validate_allowed_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 24 16:49:15.882643 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7e8ca06-6b03-4ed2-bf66-1a297a7f2248 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f2ba2e8375b4e8c8792ee1e22b60427', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '00a5583c7b7443e98e7a1d31a0b638dc', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=71938) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 24 16:49:15.883485 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7e8ca06-6b03-4ed2-bf66-1a297a7f2248 admin admin] REQUEST_METHOD: `GET` {{(pid=71938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 24 16:49:15.883823 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7e8ca06-6b03-4ed2-bf66-1a297a7f2248 admin admin] SCRIPT_NAME: `/identity` {{(pid=71938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 24 16:49:15.884152 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7e8ca06-6b03-4ed2-bf66-1a297a7f2248 admin admin] PATH_INFO: `/v3/domains` {{(pid=71938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 24 16:49:15.884947 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7e8ca06-6b03-4ed2-bf66-1a297a7f2248 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=71938) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:161}} Nov 24 16:49:15.885298 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7e8ca06-6b03-4ed2-bf66-1a297a7f2248 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=71938) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:442}} Nov 24 16:49:15.890456 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba8a156d-7db0-42e9-8101-83cd32f55fbd admin admin] RBAC: Authorizing `identity:create_grant(project_id=a60c4bd5e50e4d65bff749c0d952ff15, user_id=4a1cc2b42a5540a3a7449b7dea5c563b, role_id=912ab5f10fa5477da74acf239f07604e)` {{(pid=71939) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:442}} Nov 24 16:49:15.946816 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7e8ca06-6b03-4ed2-bf66-1a297a7f2248 admin admin] RBAC: Authorization granted {{(pid=71938) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 24 16:49:15.953636 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba8a156d-7db0-42e9-8101-83cd32f55fbd admin admin] RBAC: Authorization granted {{(pid=71939) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 24 16:49:15.979234 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: [pid: 71938|app: 0|req: 1031/2073] 10.222.0.53 () {58 vars in 1143 bytes} [Wed Nov 24 16:49:15 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 128 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 24 16:49:15.982188 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: [pid: 71939|app: 0|req: 1043/2074] 10.222.0.53 () {60 vars in 1473 bytes} [Wed Nov 24 16:49:15 2021] PUT /identity/v3/projects/a60c4bd5e50e4d65bff749c0d952ff15/users/4a1cc2b42a5540a3a7449b7dea5c563b/roles/912ab5f10fa5477da74acf239f07604e => generated 0 bytes in 178 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 24 16:49:15.982435 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7e8ca06-6b03-4ed2-bf66-1a297a7f2248 admin admin] Authenticating user token {{(pid=71938) process_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 24 16:49:15.989692 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a47f01c3-08e0-4bda-bf7d-5103bc70805e None None] REQUEST_METHOD: `POST` {{(pid=71939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 24 16:49:15.995373 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a47f01c3-08e0-4bda-bf7d-5103bc70805e None None] SCRIPT_NAME: `/identity` {{(pid=71939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 24 16:49:15.995962 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a47f01c3-08e0-4bda-bf7d-5103bc70805e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=71939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 24 16:49:16.012050 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7e8ca06-6b03-4ed2-bf66-1a297a7f2248 admin admin] Validating token access rules against request {{(pid=71938) validate_allowed_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 24 16:49:16.112698 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.auth.core [None req-a47f01c3-08e0-4bda-bf7d-5103bc70805e None None] MFA Rules not processed for user `4a1cc2b42a5540a3a7449b7dea5c563b`. Rule list: `[]` (Enabled: `True`). {{(pid=71939) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:442}} Nov 24 16:49:16.114394 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.fernet_utils [None req-a47f01c3-08e0-4bda-bf7d-5103bc70805e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=71939) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:289}} Nov 24 16:49:16.209097 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-760b08ee-0157-4546-a87a-99f696c7c7a1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f2ba2e8375b4e8c8792ee1e22b60427', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '00a5583c7b7443e98e7a1d31a0b638dc', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=71938) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 24 16:49:16.210827 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-760b08ee-0157-4546-a87a-99f696c7c7a1 admin admin] REQUEST_METHOD: `POST` {{(pid=71938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 24 16:49:16.211811 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-760b08ee-0157-4546-a87a-99f696c7c7a1 admin admin] SCRIPT_NAME: `/identity` {{(pid=71938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 24 16:49:16.212392 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-760b08ee-0157-4546-a87a-99f696c7c7a1 admin admin] PATH_INFO: `/v3/projects` {{(pid=71938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 24 16:49:16.213318 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-760b08ee-0157-4546-a87a-99f696c7c7a1 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=71938) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:442}} Nov 24 16:49:16.312147 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-760b08ee-0157-4546-a87a-99f696c7c7a1 admin admin] RBAC: Authorization granted {{(pid=71938) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 24 16:49:16.357099 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: [pid: 71939|app: 0|req: 1044/2075] 10.222.0.53 () {58 vars in 948 bytes} [Wed Nov 24 16:49:15 2021] POST /identity/v3/auth/tokens => generated 3694 bytes in 368 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Nov 24 16:49:16.363779 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a47f01c3-08e0-4bda-bf7d-5103bc70805e None None] Authenticating user token {{(pid=71939) process_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 24 16:49:16.384767 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a47f01c3-08e0-4bda-bf7d-5103bc70805e None None] Validating token access rules against request {{(pid=71939) validate_allowed_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 24 16:49:16.386472 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: [pid: 71938|app: 0|req: 1032/2076] 10.222.0.53 () {60 vars in 1143 bytes} [Wed Nov 24 16:49:15 2021] POST /identity/v3/projects => generated 385 bytes in 406 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Nov 24 16:49:16.391528 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-760b08ee-0157-4546-a87a-99f696c7c7a1 admin admin] Authenticating user token {{(pid=71938) process_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 24 16:49:16.556254 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-760b08ee-0157-4546-a87a-99f696c7c7a1 admin admin] Validating token access rules against request {{(pid=71938) validate_allowed_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 24 16:49:16.572526 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41db26b6-36af-44b6-9343-51a1107b2cce admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f2ba2e8375b4e8c8792ee1e22b60427', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '00a5583c7b7443e98e7a1d31a0b638dc', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=71939) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 24 16:49:16.572951 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a74bf09-efb8-468c-aba0-56ec7f8cb4e2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f2ba2e8375b4e8c8792ee1e22b60427', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '00a5583c7b7443e98e7a1d31a0b638dc', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=71938) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 24 16:49:16.573208 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41db26b6-36af-44b6-9343-51a1107b2cce admin admin] REQUEST_METHOD: `POST` {{(pid=71939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 24 16:49:16.573766 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41db26b6-36af-44b6-9343-51a1107b2cce admin admin] SCRIPT_NAME: `/identity` {{(pid=71939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 24 16:49:16.573904 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a74bf09-efb8-468c-aba0-56ec7f8cb4e2 admin admin] REQUEST_METHOD: `POST` {{(pid=71938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 24 16:49:16.574015 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41db26b6-36af-44b6-9343-51a1107b2cce admin admin] PATH_INFO: `/v3/projects` {{(pid=71939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 24 16:49:16.574158 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a74bf09-efb8-468c-aba0-56ec7f8cb4e2 admin admin] SCRIPT_NAME: `/identity` {{(pid=71938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 24 16:49:16.574309 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a74bf09-efb8-468c-aba0-56ec7f8cb4e2 admin admin] PATH_INFO: `/v3/users` {{(pid=71938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 24 16:49:16.575054 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a74bf09-efb8-468c-aba0-56ec7f8cb4e2 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=71938) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:442}} Nov 24 16:49:16.575460 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41db26b6-36af-44b6-9343-51a1107b2cce admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=71939) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:442}} Nov 24 16:49:16.612001 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41db26b6-36af-44b6-9343-51a1107b2cce admin admin] RBAC: Authorization granted {{(pid=71939) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 24 16:49:16.630750 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a74bf09-efb8-468c-aba0-56ec7f8cb4e2 admin admin] RBAC: Authorization granted {{(pid=71938) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 24 16:49:16.666903 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: [pid: 71939|app: 0|req: 1045/2077] 10.222.0.53 () {60 vars in 1143 bytes} [Wed Nov 24 16:49:16 2021] POST /identity/v3/projects => generated 387 bytes in 304 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Nov 24 16:49:16.671407 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41db26b6-36af-44b6-9343-51a1107b2cce admin admin] Authenticating user token {{(pid=71939) process_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 24 16:49:16.688548 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: [pid: 71938|app: 0|req: 1033/2078] 10.222.0.53 () {60 vars in 1134 bytes} [Wed Nov 24 16:49:16 2021] POST /identity/v3/users => generated 293 bytes in 294 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Nov 24 16:49:16.689793 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a74bf09-efb8-468c-aba0-56ec7f8cb4e2 admin admin] Authenticating user token {{(pid=71938) process_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 24 16:49:16.708386 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a74bf09-efb8-468c-aba0-56ec7f8cb4e2 admin admin] Validating token access rules against request {{(pid=71938) validate_allowed_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 24 16:49:16.778229 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41db26b6-36af-44b6-9343-51a1107b2cce admin admin] Validating token access rules against request {{(pid=71939) validate_allowed_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 24 16:49:16.791486 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5591ff3b-c215-41ee-b359-14aa1a17486d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f2ba2e8375b4e8c8792ee1e22b60427', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '00a5583c7b7443e98e7a1d31a0b638dc', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=71939) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 24 16:49:16.792332 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5591ff3b-c215-41ee-b359-14aa1a17486d admin admin] REQUEST_METHOD: `POST` {{(pid=71939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 24 16:49:16.792784 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5591ff3b-c215-41ee-b359-14aa1a17486d admin admin] SCRIPT_NAME: `/identity` {{(pid=71939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 24 16:49:16.793229 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5591ff3b-c215-41ee-b359-14aa1a17486d admin admin] PATH_INFO: `/v3/users` {{(pid=71939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 24 16:49:16.794132 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5591ff3b-c215-41ee-b359-14aa1a17486d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=71939) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:442}} Nov 24 16:49:16.831871 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5591ff3b-c215-41ee-b359-14aa1a17486d admin admin] RBAC: Authorization granted {{(pid=71939) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 24 16:49:16.849633 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5d854b3-8272-420d-829f-405a229441af admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f2ba2e8375b4e8c8792ee1e22b60427', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '00a5583c7b7443e98e7a1d31a0b638dc', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=71938) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 24 16:49:16.851024 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5d854b3-8272-420d-829f-405a229441af admin admin] REQUEST_METHOD: `GET` {{(pid=71938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 24 16:49:16.851364 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5d854b3-8272-420d-829f-405a229441af admin admin] SCRIPT_NAME: `/identity` {{(pid=71938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 24 16:49:16.851694 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5d854b3-8272-420d-829f-405a229441af admin admin] PATH_INFO: `/v3/roles` {{(pid=71938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 24 16:49:16.852496 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5d854b3-8272-420d-829f-405a229441af admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=71938) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:442}} Nov 24 16:49:16.870466 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: [pid: 71939|app: 0|req: 1046/2079] 10.222.0.53 () {60 vars in 1134 bytes} [Wed Nov 24 16:49:16 2021] POST /identity/v3/users => generated 300 bytes in 200 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 24 16:49:16.875216 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5591ff3b-c215-41ee-b359-14aa1a17486d admin admin] Authenticating user token {{(pid=71939) process_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 24 16:49:16.880866 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.fernet_utils [None req-5591ff3b-c215-41ee-b359-14aa1a17486d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=71939) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:289}} Nov 24 16:49:16.884999 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5d854b3-8272-420d-829f-405a229441af admin admin] RBAC: Authorization granted {{(pid=71938) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 24 16:49:16.896020 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5591ff3b-c215-41ee-b359-14aa1a17486d admin admin] Validating token access rules against request {{(pid=71939) validate_allowed_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 24 16:49:16.902282 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a10f81ef-e99f-403b-929f-109978cc7636 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f2ba2e8375b4e8c8792ee1e22b60427', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '00a5583c7b7443e98e7a1d31a0b638dc', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=71939) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 24 16:49:16.903521 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a10f81ef-e99f-403b-929f-109978cc7636 admin admin] REQUEST_METHOD: `DELETE` {{(pid=71939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 24 16:49:16.904392 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a10f81ef-e99f-403b-929f-109978cc7636 admin admin] SCRIPT_NAME: `/identity` {{(pid=71939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 24 16:49:16.904925 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a10f81ef-e99f-403b-929f-109978cc7636 admin admin] PATH_INFO: `/v3/users/1157f7f8ac7b40cab91dcda9ff6db500` {{(pid=71939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 24 16:49:16.906639 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a10f81ef-e99f-403b-929f-109978cc7636 admin admin] RBAC: Authorizing `identity:delete_user(user_id=1157f7f8ac7b40cab91dcda9ff6db500)` {{(pid=71939) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:442}} Nov 24 16:49:16.922125 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: [pid: 71938|app: 0|req: 1034/2080] 10.222.0.53 () {58 vars in 1112 bytes} [Wed Nov 24 16:49:16 2021] GET /identity/v3/roles => generated 1420 bytes in 233 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Nov 24 16:49:16.923087 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5d854b3-8272-420d-829f-405a229441af admin admin] Authenticating user token {{(pid=71938) process_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 24 16:49:16.942437 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a10f81ef-e99f-403b-929f-109978cc7636 admin admin] RBAC: Authorization granted {{(pid=71939) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 24 16:49:16.944831 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5d854b3-8272-420d-829f-405a229441af admin admin] Validating token access rules against request {{(pid=71938) validate_allowed_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 24 16:49:16.950464 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e29db17-8059-4c69-b941-74ce47c265eb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f2ba2e8375b4e8c8792ee1e22b60427', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '00a5583c7b7443e98e7a1d31a0b638dc', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=71938) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 24 16:49:16.951233 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e29db17-8059-4c69-b941-74ce47c265eb admin admin] REQUEST_METHOD: `GET` {{(pid=71938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 24 16:49:16.951574 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e29db17-8059-4c69-b941-74ce47c265eb admin admin] SCRIPT_NAME: `/identity` {{(pid=71938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 24 16:49:16.951909 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e29db17-8059-4c69-b941-74ce47c265eb admin admin] PATH_INFO: `/v3/roles` {{(pid=71938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 24 16:49:16.952713 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e29db17-8059-4c69-b941-74ce47c265eb admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=71938) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:442}} Nov 24 16:49:16.992630 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e29db17-8059-4c69-b941-74ce47c265eb admin admin] RBAC: Authorization granted {{(pid=71938) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 24 16:49:17.000530 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.notifications [None req-a10f81ef-e99f-403b-929f-109978cc7636 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '1157f7f8ac7b40cab91dcda9ff6db500'} {{(pid=71939) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:357}} Nov 24 16:49:17.005129 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: [pid: 71938|app: 0|req: 1035/2081] 10.222.0.53 () {58 vars in 1112 bytes} [Wed Nov 24 16:49:16 2021] GET /identity/v3/roles => generated 1420 bytes in 82 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 24 16:49:17.006054 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e29db17-8059-4c69-b941-74ce47c265eb admin admin] Authenticating user token {{(pid=71938) process_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 24 16:49:17.018398 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.notifications [None req-a10f81ef-e99f-403b-929f-109978cc7636 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '1157f7f8ac7b40cab91dcda9ff6db500'} {{(pid=71939) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:357}} Nov 24 16:49:17.018609 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e29db17-8059-4c69-b941-74ce47c265eb admin admin] Validating token access rules against request {{(pid=71938) validate_allowed_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 24 16:49:17.020016 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.notifications [None req-a10f81ef-e99f-403b-929f-109978cc7636 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '1157f7f8ac7b40cab91dcda9ff6db500'} {{(pid=71939) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:357}} Nov 24 16:49:17.026055 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cadac3b5-85a0-4448-aec0-eea911293751 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f2ba2e8375b4e8c8792ee1e22b60427', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '00a5583c7b7443e98e7a1d31a0b638dc', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=71938) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 24 16:49:17.027002 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cadac3b5-85a0-4448-aec0-eea911293751 admin admin] REQUEST_METHOD: `PUT` {{(pid=71938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 24 16:49:17.027347 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cadac3b5-85a0-4448-aec0-eea911293751 admin admin] SCRIPT_NAME: `/identity` {{(pid=71938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 24 16:49:17.027847 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cadac3b5-85a0-4448-aec0-eea911293751 admin admin] PATH_INFO: `/v3/projects/8902ffaa087a4ba780143dd8e0ce9bc5/users/4b696f6e2ebc468a830ce385ce0c6ebd/roles/912ab5f10fa5477da74acf239f07604e` {{(pid=71938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 24 16:49:17.033522 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.notifications [None req-a10f81ef-e99f-403b-929f-109978cc7636 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '1157f7f8ac7b40cab91dcda9ff6db500'} {{(pid=71939) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:357}} Nov 24 16:49:17.042008 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.notifications [None req-a10f81ef-e99f-403b-929f-109978cc7636 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '1157f7f8ac7b40cab91dcda9ff6db500'} {{(pid=71939) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:357}} Nov 24 16:49:17.056461 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cadac3b5-85a0-4448-aec0-eea911293751 admin admin] RBAC: Authorizing `identity:create_grant(project_id=8902ffaa087a4ba780143dd8e0ce9bc5, user_id=4b696f6e2ebc468a830ce385ce0c6ebd, role_id=912ab5f10fa5477da74acf239f07604e)` {{(pid=71938) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:442}} Nov 24 16:49:17.065994 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: [pid: 71939|app: 0|req: 1047/2082] 10.222.0.53 () {58 vars in 1214 bytes} [Wed Nov 24 16:49:16 2021] DELETE /identity/v3/users/1157f7f8ac7b40cab91dcda9ff6db500 => generated 0 bytes in 191 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 24 16:49:17.067446 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a10f81ef-e99f-403b-929f-109978cc7636 admin admin] Authenticating user token {{(pid=71939) process_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 24 16:49:17.071314 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.fernet_utils [None req-a10f81ef-e99f-403b-929f-109978cc7636 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=71939) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:289}} Nov 24 16:49:17.089971 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cadac3b5-85a0-4448-aec0-eea911293751 admin admin] RBAC: Authorization granted {{(pid=71938) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 24 16:49:17.112403 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: [pid: 71938|app: 0|req: 1036/2083] 10.222.0.53 () {60 vars in 1473 bytes} [Wed Nov 24 16:49:17 2021] PUT /identity/v3/projects/8902ffaa087a4ba780143dd8e0ce9bc5/users/4b696f6e2ebc468a830ce385ce0c6ebd/roles/912ab5f10fa5477da74acf239f07604e => generated 0 bytes in 107 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 24 16:49:17.122236 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba0a83d3-b4c8-49c7-bbcc-0f81415fe80c None None] REQUEST_METHOD: `POST` {{(pid=71938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 24 16:49:17.122236 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba0a83d3-b4c8-49c7-bbcc-0f81415fe80c None None] SCRIPT_NAME: `/identity` {{(pid=71938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 24 16:49:17.122236 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba0a83d3-b4c8-49c7-bbcc-0f81415fe80c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=71938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 24 16:49:17.145881 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.auth.core [None req-ba0a83d3-b4c8-49c7-bbcc-0f81415fe80c None None] MFA Rules not processed for user `0f2ba2e8375b4e8c8792ee1e22b60427`. Rule list: `[]` (Enabled: `True`). {{(pid=71938) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:442}} Nov 24 16:49:17.147905 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.fernet_utils [None req-ba0a83d3-b4c8-49c7-bbcc-0f81415fe80c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=71938) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:289}} Nov 24 16:49:17.169957 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a10f81ef-e99f-403b-929f-109978cc7636 admin admin] Validating token access rules against request {{(pid=71939) validate_allowed_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 24 16:49:17.250703 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: [pid: 71938|app: 0|req: 1037/2084] 10.222.0.53 () {58 vars in 948 bytes} [Wed Nov 24 16:49:17 2021] POST /identity/v3/auth/tokens => generated 3669 bytes in 135 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 24 16:49:17.250703 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bc6897d-996d-45ea-991e-e73f1aea7a52 None None] REQUEST_METHOD: `POST` {{(pid=71938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 24 16:49:17.250703 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bc6897d-996d-45ea-991e-e73f1aea7a52 None None] SCRIPT_NAME: `/identity` {{(pid=71938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 24 16:49:17.250703 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bc6897d-996d-45ea-991e-e73f1aea7a52 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=71938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 24 16:49:17.294619 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.auth.core [None req-4bc6897d-996d-45ea-991e-e73f1aea7a52 None None] MFA Rules not processed for user `4b696f6e2ebc468a830ce385ce0c6ebd`. Rule list: `[]` (Enabled: `True`). {{(pid=71938) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:442}} Nov 24 16:49:17.295916 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.fernet_utils [None req-4bc6897d-996d-45ea-991e-e73f1aea7a52 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=71938) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:289}} Nov 24 16:49:17.302041 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be1036bc-80b8-4d00-8dca-2cf048c7c8d7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f2ba2e8375b4e8c8792ee1e22b60427', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '00a5583c7b7443e98e7a1d31a0b638dc', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=71939) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 24 16:49:17.302621 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be1036bc-80b8-4d00-8dca-2cf048c7c8d7 admin admin] REQUEST_METHOD: `PUT` {{(pid=71939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 24 16:49:17.302972 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be1036bc-80b8-4d00-8dca-2cf048c7c8d7 admin admin] SCRIPT_NAME: `/identity` {{(pid=71939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 24 16:49:17.303861 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be1036bc-80b8-4d00-8dca-2cf048c7c8d7 admin admin] PATH_INFO: `/v3/projects/f9df4d0ea5424265b3b02484ccf07b8d/users/637368a02bab4c9db0b00e497634157c/roles/5611724e350b41e19921b5961a342582` {{(pid=71939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 24 16:49:17.329567 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be1036bc-80b8-4d00-8dca-2cf048c7c8d7 admin admin] RBAC: Authorizing `identity:create_grant(project_id=f9df4d0ea5424265b3b02484ccf07b8d, user_id=637368a02bab4c9db0b00e497634157c, role_id=5611724e350b41e19921b5961a342582)` {{(pid=71939) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:442}} Nov 24 16:49:17.370011 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be1036bc-80b8-4d00-8dca-2cf048c7c8d7 admin admin] RBAC: Authorization granted {{(pid=71939) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 24 16:49:17.390305 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: [pid: 71939|app: 0|req: 1048/2085] 10.222.0.53 () {60 vars in 1473 bytes} [Wed Nov 24 16:49:17 2021] PUT /identity/v3/projects/f9df4d0ea5424265b3b02484ccf07b8d/users/637368a02bab4c9db0b00e497634157c/roles/5611724e350b41e19921b5961a342582 => generated 0 bytes in 323 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 24 16:49:17.391243 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be1036bc-80b8-4d00-8dca-2cf048c7c8d7 admin admin] Authenticating user token {{(pid=71939) process_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 24 16:49:17.394122 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.fernet_utils [None req-be1036bc-80b8-4d00-8dca-2cf048c7c8d7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=71939) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:289}} Nov 24 16:49:17.417776 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: [pid: 71938|app: 0|req: 1038/2086] 10.222.0.53 () {58 vars in 948 bytes} [Wed Nov 24 16:49:17 2021] POST /identity/v3/auth/tokens => generated 3692 bytes in 169 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 24 16:49:17.418705 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bc6897d-996d-45ea-991e-e73f1aea7a52 None None] Authenticating user token {{(pid=71938) process_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 24 16:49:17.433368 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bc6897d-996d-45ea-991e-e73f1aea7a52 None None] Validating token access rules against request {{(pid=71938) validate_allowed_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 24 16:49:17.488890 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be1036bc-80b8-4d00-8dca-2cf048c7c8d7 admin admin] Validating token access rules against request {{(pid=71939) validate_allowed_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 24 16:49:17.494410 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50185683-4bc1-46a9-8e98-4a0dac799f72 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c90f21b9cdcb413282461fa83cb6b7a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3b3940d4ae1c4177ae29c02377bb4b0b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=71939) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 24 16:49:17.495237 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50185683-4bc1-46a9-8e98-4a0dac799f72 service neutron] REQUEST_METHOD: `GET` {{(pid=71939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 24 16:49:17.495594 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50185683-4bc1-46a9-8e98-4a0dac799f72 service neutron] SCRIPT_NAME: `/identity` {{(pid=71939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 24 16:49:17.495918 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50185683-4bc1-46a9-8e98-4a0dac799f72 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=71939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 24 16:49:17.517043 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7eaa603-0e36-48c4-ba28-f036a3b00bc1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f2ba2e8375b4e8c8792ee1e22b60427', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '00a5583c7b7443e98e7a1d31a0b638dc', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=71938) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 24 16:49:17.518061 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7eaa603-0e36-48c4-ba28-f036a3b00bc1 admin admin] REQUEST_METHOD: `GET` {{(pid=71938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 24 16:49:17.518521 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7eaa603-0e36-48c4-ba28-f036a3b00bc1 admin admin] SCRIPT_NAME: `/identity` {{(pid=71938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 24 16:49:17.518862 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7eaa603-0e36-48c4-ba28-f036a3b00bc1 admin admin] PATH_INFO: `/v3/roles` {{(pid=71938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 24 16:49:17.519659 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7eaa603-0e36-48c4-ba28-f036a3b00bc1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=71938) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:442}} Nov 24 16:49:17.552269 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7eaa603-0e36-48c4-ba28-f036a3b00bc1 admin admin] RBAC: Authorization granted {{(pid=71938) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 24 16:49:17.583774 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: [pid: 71938|app: 0|req: 1039/2087] 10.222.0.53 () {58 vars in 1112 bytes} [Wed Nov 24 16:49:17 2021] GET /identity/v3/roles => generated 1420 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 24 16:49:17.584555 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7eaa603-0e36-48c4-ba28-f036a3b00bc1 admin admin] Authenticating user token {{(pid=71938) process_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 24 16:49:17.590392 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.fernet_utils [None req-f7eaa603-0e36-48c4-ba28-f036a3b00bc1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=71938) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:289}} Nov 24 16:49:17.602573 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50185683-4bc1-46a9-8e98-4a0dac799f72 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=71939) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:442}} Nov 24 16:49:17.612946 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7eaa603-0e36-48c4-ba28-f036a3b00bc1 admin admin] Validating token access rules against request {{(pid=71938) validate_allowed_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 24 16:49:17.626690 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4afce71-15ce-4d41-a05d-192e28829e78 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f2ba2e8375b4e8c8792ee1e22b60427', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '00a5583c7b7443e98e7a1d31a0b638dc', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=71938) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 24 16:49:17.627384 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4afce71-15ce-4d41-a05d-192e28829e78 admin admin] REQUEST_METHOD: `POST` {{(pid=71938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 24 16:49:17.627721 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4afce71-15ce-4d41-a05d-192e28829e78 admin admin] SCRIPT_NAME: `/identity` {{(pid=71938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 24 16:49:17.628151 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4afce71-15ce-4d41-a05d-192e28829e78 admin admin] PATH_INFO: `/v3/projects` {{(pid=71938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 24 16:49:17.628764 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4afce71-15ce-4d41-a05d-192e28829e78 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=71938) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:442}} Nov 24 16:49:17.639231 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50185683-4bc1-46a9-8e98-4a0dac799f72 service neutron] RBAC: Authorization granted {{(pid=71939) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 24 16:49:17.652249 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: [pid: 71939|app: 0|req: 1049/2088] 10.222.0.53 () {60 vars in 1356 bytes} [Wed Nov 24 16:49:17 2021] GET /identity/v3/auth/tokens => generated 3669 bytes in 261 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 24 16:49:17.674682 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50185683-4bc1-46a9-8e98-4a0dac799f72 service neutron] Authenticating user token {{(pid=71939) process_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 24 16:49:17.697948 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4afce71-15ce-4d41-a05d-192e28829e78 admin admin] RBAC: Authorization granted {{(pid=71938) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 24 16:49:17.712859 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50185683-4bc1-46a9-8e98-4a0dac799f72 service neutron] Validating token access rules against request {{(pid=71939) validate_allowed_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 24 16:49:17.730254 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0fbb5f8-19af-4cf2-96fb-8a97fa9caab4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f2ba2e8375b4e8c8792ee1e22b60427', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '00a5583c7b7443e98e7a1d31a0b638dc', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=71939) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 24 16:49:17.732025 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0fbb5f8-19af-4cf2-96fb-8a97fa9caab4 admin admin] REQUEST_METHOD: `PUT` {{(pid=71939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 24 16:49:17.734515 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0fbb5f8-19af-4cf2-96fb-8a97fa9caab4 admin admin] SCRIPT_NAME: `/identity` {{(pid=71939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 24 16:49:17.734870 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0fbb5f8-19af-4cf2-96fb-8a97fa9caab4 admin admin] PATH_INFO: `/v3/projects/f9df4d0ea5424265b3b02484ccf07b8d/users/637368a02bab4c9db0b00e497634157c/roles/5611724e350b41e19921b5961a342582` {{(pid=71939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 24 16:49:17.739987 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0fbb5f8-19af-4cf2-96fb-8a97fa9caab4 admin admin] RBAC: Authorizing `identity:create_grant(project_id=f9df4d0ea5424265b3b02484ccf07b8d, user_id=637368a02bab4c9db0b00e497634157c, role_id=5611724e350b41e19921b5961a342582)` {{(pid=71939) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:442}} Nov 24 16:49:17.750894 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: [pid: 71938|app: 0|req: 1040/2089] 10.222.0.53 () {60 vars in 1143 bytes} [Wed Nov 24 16:49:17 2021] POST /identity/v3/projects => generated 385 bytes in 164 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 24 16:49:17.752762 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4afce71-15ce-4d41-a05d-192e28829e78 admin admin] Authenticating user token {{(pid=71938) process_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 24 16:49:17.842247 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0fbb5f8-19af-4cf2-96fb-8a97fa9caab4 admin admin] RBAC: Authorization granted {{(pid=71939) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 24 16:49:17.876790 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: [pid: 71939|app: 0|req: 1050/2090] 10.222.0.53 () {60 vars in 1473 bytes} [Wed Nov 24 16:49:17 2021] PUT /identity/v3/projects/f9df4d0ea5424265b3b02484ccf07b8d/users/637368a02bab4c9db0b00e497634157c/roles/5611724e350b41e19921b5961a342582 => generated 0 bytes in 210 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 24 16:49:17.880914 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0fbb5f8-19af-4cf2-96fb-8a97fa9caab4 admin admin] Authenticating user token {{(pid=71939) process_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 24 16:49:17.951801 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4afce71-15ce-4d41-a05d-192e28829e78 admin admin] Validating token access rules against request {{(pid=71938) validate_allowed_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 24 16:49:18.019733 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0fbb5f8-19af-4cf2-96fb-8a97fa9caab4 admin admin] Validating token access rules against request {{(pid=71939) validate_allowed_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 24 16:49:18.028089 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc6cdab2-2937-4d89-8ed2-a7b46fc25f48 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f2ba2e8375b4e8c8792ee1e22b60427', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '00a5583c7b7443e98e7a1d31a0b638dc', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=71939) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 24 16:49:18.028949 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc6cdab2-2937-4d89-8ed2-a7b46fc25f48 admin admin] REQUEST_METHOD: `GET` {{(pid=71939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 24 16:49:18.029461 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc6cdab2-2937-4d89-8ed2-a7b46fc25f48 admin admin] SCRIPT_NAME: `/identity` {{(pid=71939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 24 16:49:18.029804 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc6cdab2-2937-4d89-8ed2-a7b46fc25f48 admin admin] PATH_INFO: `/v3/roles` {{(pid=71939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 24 16:49:18.030948 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc6cdab2-2937-4d89-8ed2-a7b46fc25f48 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=71939) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:442}} Nov 24 16:49:18.061684 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-397d5539-02f3-4e1a-8759-0e5a25bb00a1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f2ba2e8375b4e8c8792ee1e22b60427', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '00a5583c7b7443e98e7a1d31a0b638dc', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=71938) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 24 16:49:18.062529 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-397d5539-02f3-4e1a-8759-0e5a25bb00a1 admin admin] REQUEST_METHOD: `POST` {{(pid=71938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 24 16:49:18.062947 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-397d5539-02f3-4e1a-8759-0e5a25bb00a1 admin admin] SCRIPT_NAME: `/identity` {{(pid=71938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 24 16:49:18.063360 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-397d5539-02f3-4e1a-8759-0e5a25bb00a1 admin admin] PATH_INFO: `/v3/users` {{(pid=71938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 24 16:49:18.064674 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-397d5539-02f3-4e1a-8759-0e5a25bb00a1 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=71938) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:442}} Nov 24 16:49:18.066926 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc6cdab2-2937-4d89-8ed2-a7b46fc25f48 admin admin] RBAC: Authorization granted {{(pid=71939) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 24 16:49:18.086792 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: [pid: 71939|app: 0|req: 1051/2091] 10.222.0.53 () {58 vars in 1112 bytes} [Wed Nov 24 16:49:17 2021] GET /identity/v3/roles => generated 1420 bytes in 206 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 24 16:49:18.087989 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc6cdab2-2937-4d89-8ed2-a7b46fc25f48 admin admin] Authenticating user token {{(pid=71939) process_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 24 16:49:18.112402 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc6cdab2-2937-4d89-8ed2-a7b46fc25f48 admin admin] Validating token access rules against request {{(pid=71939) validate_allowed_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 24 16:49:18.118434 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c9d989b-f8e0-45aa-98ff-62871b2a7738 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f2ba2e8375b4e8c8792ee1e22b60427', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '00a5583c7b7443e98e7a1d31a0b638dc', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=71939) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 24 16:49:18.119736 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c9d989b-f8e0-45aa-98ff-62871b2a7738 admin admin] REQUEST_METHOD: `PUT` {{(pid=71939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 24 16:49:18.120194 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c9d989b-f8e0-45aa-98ff-62871b2a7738 admin admin] SCRIPT_NAME: `/identity` {{(pid=71939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 24 16:49:18.120640 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c9d989b-f8e0-45aa-98ff-62871b2a7738 admin admin] PATH_INFO: `/v3/projects/f9df4d0ea5424265b3b02484ccf07b8d/users/637368a02bab4c9db0b00e497634157c/roles/912ab5f10fa5477da74acf239f07604e` {{(pid=71939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 24 16:49:18.125338 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c9d989b-f8e0-45aa-98ff-62871b2a7738 admin admin] RBAC: Authorizing `identity:create_grant(project_id=f9df4d0ea5424265b3b02484ccf07b8d, user_id=637368a02bab4c9db0b00e497634157c, role_id=912ab5f10fa5477da74acf239f07604e)` {{(pid=71939) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:442}} Nov 24 16:49:18.152809 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-397d5539-02f3-4e1a-8759-0e5a25bb00a1 admin admin] RBAC: Authorization granted {{(pid=71938) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 24 16:49:18.176349 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c9d989b-f8e0-45aa-98ff-62871b2a7738 admin admin] RBAC: Authorization granted {{(pid=71939) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 24 16:49:18.208252 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: [pid: 71938|app: 0|req: 1041/2092] 10.222.0.53 () {60 vars in 1134 bytes} [Wed Nov 24 16:49:17 2021] POST /identity/v3/users => generated 299 bytes in 453 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 24 16:49:18.209663 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-397d5539-02f3-4e1a-8759-0e5a25bb00a1 admin admin] Authenticating user token {{(pid=71938) process_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 24 16:49:18.212089 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: [pid: 71939|app: 0|req: 1052/2093] 10.222.0.53 () {60 vars in 1473 bytes} [Wed Nov 24 16:49:18 2021] PUT /identity/v3/projects/f9df4d0ea5424265b3b02484ccf07b8d/users/637368a02bab4c9db0b00e497634157c/roles/912ab5f10fa5477da74acf239f07604e => generated 0 bytes in 125 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 24 16:49:18.230219 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-397d5539-02f3-4e1a-8759-0e5a25bb00a1 admin admin] Validating token access rules against request {{(pid=71938) validate_allowed_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 24 16:49:18.232164 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3009b0f9-c51b-4169-8c32-372735f4dbbb None None] REQUEST_METHOD: `POST` {{(pid=71939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 24 16:49:18.234153 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3009b0f9-c51b-4169-8c32-372735f4dbbb None None] SCRIPT_NAME: `/identity` {{(pid=71939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 24 16:49:18.234613 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3009b0f9-c51b-4169-8c32-372735f4dbbb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=71939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 24 16:49:18.349390 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.auth.core [None req-3009b0f9-c51b-4169-8c32-372735f4dbbb None None] MFA Rules not processed for user `637368a02bab4c9db0b00e497634157c`. Rule list: `[]` (Enabled: `True`). {{(pid=71939) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:442}} Nov 24 16:49:18.354427 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.fernet_utils [None req-3009b0f9-c51b-4169-8c32-372735f4dbbb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=71939) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:289}} Nov 24 16:49:18.400335 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-977e8435-0193-429d-9396-aa665a0bc233 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f2ba2e8375b4e8c8792ee1e22b60427', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '00a5583c7b7443e98e7a1d31a0b638dc', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=71938) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 24 16:49:18.401601 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-977e8435-0193-429d-9396-aa665a0bc233 admin admin] REQUEST_METHOD: `GET` {{(pid=71938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 24 16:49:18.401968 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-977e8435-0193-429d-9396-aa665a0bc233 admin admin] SCRIPT_NAME: `/identity` {{(pid=71938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 24 16:49:18.402329 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-977e8435-0193-429d-9396-aa665a0bc233 admin admin] PATH_INFO: `/v3/roles` {{(pid=71938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 24 16:49:18.404860 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-977e8435-0193-429d-9396-aa665a0bc233 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=71938) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:442}} Nov 24 16:49:18.479919 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-977e8435-0193-429d-9396-aa665a0bc233 admin admin] RBAC: Authorization granted {{(pid=71938) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 24 16:49:18.507093 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: [pid: 71938|app: 0|req: 1042/2094] 10.222.0.53 () {58 vars in 1112 bytes} [Wed Nov 24 16:49:18 2021] GET /identity/v3/roles => generated 1420 bytes in 298 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Nov 24 16:49:18.508432 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-977e8435-0193-429d-9396-aa665a0bc233 admin admin] Authenticating user token {{(pid=71938) process_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 24 16:49:18.511923 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.fernet_utils [None req-977e8435-0193-429d-9396-aa665a0bc233 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=71938) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:289}} Nov 24 16:49:18.528051 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-977e8435-0193-429d-9396-aa665a0bc233 admin admin] Validating token access rules against request {{(pid=71938) validate_allowed_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 24 16:49:18.534214 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83f1d1b7-d395-4eb9-9c6e-714d91acb06a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f2ba2e8375b4e8c8792ee1e22b60427', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '00a5583c7b7443e98e7a1d31a0b638dc', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=71938) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 24 16:49:18.535353 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83f1d1b7-d395-4eb9-9c6e-714d91acb06a admin admin] REQUEST_METHOD: `DELETE` {{(pid=71938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 24 16:49:18.535946 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83f1d1b7-d395-4eb9-9c6e-714d91acb06a admin admin] SCRIPT_NAME: `/identity` {{(pid=71938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 24 16:49:18.536994 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83f1d1b7-d395-4eb9-9c6e-714d91acb06a admin admin] PATH_INFO: `/v3/projects/0a11e2fb85854c56843fb0126e24ab90` {{(pid=71938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 24 16:49:18.538541 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83f1d1b7-d395-4eb9-9c6e-714d91acb06a admin admin] RBAC: Authorizing `identity:delete_project(project_id=0a11e2fb85854c56843fb0126e24ab90)` {{(pid=71938) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:442}} Nov 24 16:49:18.564338 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: [pid: 71939|app: 0|req: 1053/2095] 10.222.0.53 () {58 vars in 948 bytes} [Wed Nov 24 16:49:18 2021] POST /identity/v3/auth/tokens => generated 3761 bytes in 333 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 24 16:49:18.565363 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3009b0f9-c51b-4169-8c32-372735f4dbbb None None] Authenticating user token {{(pid=71939) process_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 24 16:49:18.587381 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3009b0f9-c51b-4169-8c32-372735f4dbbb None None] Validating token access rules against request {{(pid=71939) validate_allowed_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 24 16:49:18.600228 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83f1d1b7-d395-4eb9-9c6e-714d91acb06a admin admin] RBAC: Authorization granted {{(pid=71938) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 24 16:49:18.603077 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cd19ece-5494-4e2a-b2e1-50677db169aa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f2ba2e8375b4e8c8792ee1e22b60427', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '00a5583c7b7443e98e7a1d31a0b638dc', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=71939) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 24 16:49:18.604382 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cd19ece-5494-4e2a-b2e1-50677db169aa admin admin] REQUEST_METHOD: `PUT` {{(pid=71939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 24 16:49:18.604382 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cd19ece-5494-4e2a-b2e1-50677db169aa admin admin] SCRIPT_NAME: `/identity` {{(pid=71939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 24 16:49:18.604713 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cd19ece-5494-4e2a-b2e1-50677db169aa admin admin] PATH_INFO: `/v3/projects/a8705c93bf8d49be90d8795aedf67c4e/users/30fab8267bac4cd68cf79628e9f75445/roles/5611724e350b41e19921b5961a342582` {{(pid=71939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 24 16:49:18.627617 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cd19ece-5494-4e2a-b2e1-50677db169aa admin admin] RBAC: Authorizing `identity:create_grant(project_id=a8705c93bf8d49be90d8795aedf67c4e, user_id=30fab8267bac4cd68cf79628e9f75445, role_id=5611724e350b41e19921b5961a342582)` {{(pid=71939) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:442}} Nov 24 16:49:18.668842 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cd19ece-5494-4e2a-b2e1-50677db169aa admin admin] RBAC: Authorization granted {{(pid=71939) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 24 16:49:18.688772 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.notifications [None req-83f1d1b7-d395-4eb9-9c6e-714d91acb06a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '0a11e2fb85854c56843fb0126e24ab90', 'request_id': 'req-83f1d1b7-d395-4eb9-9c6e-714d91acb06a'} {{(pid=71938) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:357}} Nov 24 16:49:18.690563 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: [pid: 71939|app: 0|req: 1054/2096] 10.222.0.53 () {60 vars in 1473 bytes} [Wed Nov 24 16:49:18 2021] PUT /identity/v3/projects/a8705c93bf8d49be90d8795aedf67c4e/users/30fab8267bac4cd68cf79628e9f75445/roles/5611724e350b41e19921b5961a342582 => generated 0 bytes in 122 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 24 16:49:18.691833 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cd19ece-5494-4e2a-b2e1-50677db169aa admin admin] Authenticating user token {{(pid=71939) process_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 24 16:49:18.694779 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.fernet_utils [None req-1cd19ece-5494-4e2a-b2e1-50677db169aa admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=71939) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:289}} Nov 24 16:49:18.717290 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.notifications [None req-83f1d1b7-d395-4eb9-9c6e-714d91acb06a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '0a11e2fb85854c56843fb0126e24ab90', 'request_id': 'req-83f1d1b7-d395-4eb9-9c6e-714d91acb06a'} {{(pid=71938) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:357}} Nov 24 16:49:18.730481 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.notifications [None req-83f1d1b7-d395-4eb9-9c6e-714d91acb06a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '0a11e2fb85854c56843fb0126e24ab90', 'request_id': 'req-83f1d1b7-d395-4eb9-9c6e-714d91acb06a'} {{(pid=71938) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:357}} Nov 24 16:49:18.750680 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.notifications [None req-83f1d1b7-d395-4eb9-9c6e-714d91acb06a admin admin] The token cache is being invalidate because project 0a11e2fb85854c56843fb0126e24ab90 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=71938) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Nov 24 16:49:18.751030 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.notifications [None req-83f1d1b7-d395-4eb9-9c6e-714d91acb06a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=71938) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:357}} Nov 24 16:49:18.753913 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.notifications [None req-83f1d1b7-d395-4eb9-9c6e-714d91acb06a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=71938) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:357}} Nov 24 16:49:18.755780 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: [pid: 71938|app: 0|req: 1043/2097] 10.222.0.53 () {58 vars in 1223 bytes} [Wed Nov 24 16:49:18 2021] DELETE /identity/v3/projects/0a11e2fb85854c56843fb0126e24ab90 => generated 0 bytes in 248 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 24 16:49:18.756987 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83f1d1b7-d395-4eb9-9c6e-714d91acb06a admin admin] Authenticating user token {{(pid=71938) process_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 24 16:49:18.770987 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.fernet_utils [None req-83f1d1b7-d395-4eb9-9c6e-714d91acb06a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=71938) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:289}} Nov 24 16:49:18.792445 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cd19ece-5494-4e2a-b2e1-50677db169aa admin admin] Validating token access rules against request {{(pid=71939) validate_allowed_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 24 16:49:18.802183 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c3655b0-86b8-43cc-aefa-bf2e7874ccea service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a12374a3093a401a97c343ff0854184d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3b3940d4ae1c4177ae29c02377bb4b0b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=71939) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 24 16:49:18.804810 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c3655b0-86b8-43cc-aefa-bf2e7874ccea service cinder] REQUEST_METHOD: `GET` {{(pid=71939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 24 16:49:18.805550 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c3655b0-86b8-43cc-aefa-bf2e7874ccea service cinder] SCRIPT_NAME: `/identity` {{(pid=71939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 24 16:49:18.806322 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c3655b0-86b8-43cc-aefa-bf2e7874ccea service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=71939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 24 16:49:18.809673 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.fernet_utils [None req-0c3655b0-86b8-43cc-aefa-bf2e7874ccea service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=71939) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:289}} Nov 24 16:49:18.907127 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83f1d1b7-d395-4eb9-9c6e-714d91acb06a admin admin] Validating token access rules against request {{(pid=71938) validate_allowed_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 24 16:49:18.925447 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c3655b0-86b8-43cc-aefa-bf2e7874ccea service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=71939) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:442}} Nov 24 16:49:18.965406 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c3655b0-86b8-43cc-aefa-bf2e7874ccea service cinder] RBAC: Authorization granted {{(pid=71939) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 24 16:49:18.987462 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-002fd97b-082f-4d38-be96-13dc0d3944ba admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f2ba2e8375b4e8c8792ee1e22b60427', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '00a5583c7b7443e98e7a1d31a0b638dc', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=71938) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 24 16:49:18.988164 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-002fd97b-082f-4d38-be96-13dc0d3944ba admin admin] REQUEST_METHOD: `GET` {{(pid=71938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 24 16:49:18.988748 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-002fd97b-082f-4d38-be96-13dc0d3944ba admin admin] SCRIPT_NAME: `/identity` {{(pid=71938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 24 16:49:18.989131 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-002fd97b-082f-4d38-be96-13dc0d3944ba admin admin] PATH_INFO: `/v3/roles` {{(pid=71938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 24 16:49:18.990097 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-002fd97b-082f-4d38-be96-13dc0d3944ba admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=71938) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:442}} Nov 24 16:49:18.991936 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: [pid: 71939|app: 0|req: 1055/2098] 10.222.0.53 () {60 vars in 1356 bytes} [Wed Nov 24 16:49:18 2021] GET /identity/v3/auth/tokens => generated 3761 bytes in 292 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 24 16:49:18.993095 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c3655b0-86b8-43cc-aefa-bf2e7874ccea service cinder] Authenticating user token {{(pid=71939) process_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 24 16:49:18.997741 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.fernet_utils [None req-0c3655b0-86b8-43cc-aefa-bf2e7874ccea service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=71939) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:289}} Nov 24 16:49:19.021059 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c3655b0-86b8-43cc-aefa-bf2e7874ccea service cinder] Validating token access rules against request {{(pid=71939) validate_allowed_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 24 16:49:19.021781 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-002fd97b-082f-4d38-be96-13dc0d3944ba admin admin] RBAC: Authorization granted {{(pid=71938) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 24 16:49:19.026805 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a6460e9-ff66-48ab-b116-500e09370524 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f2ba2e8375b4e8c8792ee1e22b60427', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '00a5583c7b7443e98e7a1d31a0b638dc', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=71939) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 24 16:49:19.027954 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a6460e9-ff66-48ab-b116-500e09370524 admin admin] REQUEST_METHOD: `DELETE` {{(pid=71939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 24 16:49:19.028293 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a6460e9-ff66-48ab-b116-500e09370524 admin admin] SCRIPT_NAME: `/identity` {{(pid=71939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 24 16:49:19.028626 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a6460e9-ff66-48ab-b116-500e09370524 admin admin] PATH_INFO: `/v3/users/f30156b4b33b4577b612974de424bdaf` {{(pid=71939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 24 16:49:19.030064 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a6460e9-ff66-48ab-b116-500e09370524 admin admin] RBAC: Authorizing `identity:delete_user(user_id=f30156b4b33b4577b612974de424bdaf)` {{(pid=71939) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:442}} Nov 24 16:49:19.036529 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: [pid: 71938|app: 0|req: 1044/2099] 10.222.0.53 () {58 vars in 1112 bytes} [Wed Nov 24 16:49:18 2021] GET /identity/v3/roles => generated 1420 bytes in 280 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 24 16:49:19.041211 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-002fd97b-082f-4d38-be96-13dc0d3944ba admin admin] Authenticating user token {{(pid=71938) process_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 24 16:49:19.055251 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-002fd97b-082f-4d38-be96-13dc0d3944ba admin admin] Validating token access rules against request {{(pid=71938) validate_allowed_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 24 16:49:19.063870 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ca2d717-e744-4a66-a539-0245350a7ef5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f2ba2e8375b4e8c8792ee1e22b60427', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '00a5583c7b7443e98e7a1d31a0b638dc', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=71938) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 24 16:49:19.064502 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a6460e9-ff66-48ab-b116-500e09370524 admin admin] RBAC: Authorization granted {{(pid=71939) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 24 16:49:19.065726 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ca2d717-e744-4a66-a539-0245350a7ef5 admin admin] REQUEST_METHOD: `PUT` {{(pid=71938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 24 16:49:19.066869 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ca2d717-e744-4a66-a539-0245350a7ef5 admin admin] SCRIPT_NAME: `/identity` {{(pid=71938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 24 16:49:19.067036 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ca2d717-e744-4a66-a539-0245350a7ef5 admin admin] PATH_INFO: `/v3/projects/a8705c93bf8d49be90d8795aedf67c4e/users/30fab8267bac4cd68cf79628e9f75445/roles/5611724e350b41e19921b5961a342582` {{(pid=71938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 24 16:49:19.070149 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ca2d717-e744-4a66-a539-0245350a7ef5 admin admin] RBAC: Authorizing `identity:create_grant(project_id=a8705c93bf8d49be90d8795aedf67c4e, user_id=30fab8267bac4cd68cf79628e9f75445, role_id=5611724e350b41e19921b5961a342582)` {{(pid=71938) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:442}} Nov 24 16:49:19.104258 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ca2d717-e744-4a66-a539-0245350a7ef5 admin admin] RBAC: Authorization granted {{(pid=71938) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 24 16:49:19.120672 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: [pid: 71938|app: 0|req: 1045/2100] 10.222.0.53 () {60 vars in 1473 bytes} [Wed Nov 24 16:49:19 2021] PUT /identity/v3/projects/a8705c93bf8d49be90d8795aedf67c4e/users/30fab8267bac4cd68cf79628e9f75445/roles/5611724e350b41e19921b5961a342582 => generated 0 bytes in 77 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Nov 24 16:49:19.121810 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ca2d717-e744-4a66-a539-0245350a7ef5 admin admin] Authenticating user token {{(pid=71938) process_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 24 16:49:19.135647 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.notifications [None req-2a6460e9-ff66-48ab-b116-500e09370524 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f30156b4b33b4577b612974de424bdaf'} {{(pid=71939) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:357}} Nov 24 16:49:19.152506 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.notifications [None req-2a6460e9-ff66-48ab-b116-500e09370524 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f30156b4b33b4577b612974de424bdaf'} {{(pid=71939) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:357}} Nov 24 16:49:19.153554 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.notifications [None req-2a6460e9-ff66-48ab-b116-500e09370524 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f30156b4b33b4577b612974de424bdaf'} {{(pid=71939) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:357}} Nov 24 16:49:19.163816 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.notifications [None req-2a6460e9-ff66-48ab-b116-500e09370524 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f30156b4b33b4577b612974de424bdaf'} {{(pid=71939) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:357}} Nov 24 16:49:19.170758 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.notifications [None req-2a6460e9-ff66-48ab-b116-500e09370524 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f30156b4b33b4577b612974de424bdaf'} {{(pid=71939) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:357}} Nov 24 16:49:19.177850 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: [pid: 71939|app: 0|req: 1056/2101] 10.222.0.53 () {58 vars in 1214 bytes} [Wed Nov 24 16:49:18 2021] DELETE /identity/v3/users/f30156b4b33b4577b612974de424bdaf => generated 0 bytes in 185 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 24 16:49:19.218617 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ca2d717-e744-4a66-a539-0245350a7ef5 admin admin] Validating token access rules against request {{(pid=71938) validate_allowed_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 24 16:49:19.305103 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d044647e-033e-4735-b268-12c9530f277d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f2ba2e8375b4e8c8792ee1e22b60427', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '00a5583c7b7443e98e7a1d31a0b638dc', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=71938) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 24 16:49:19.305992 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d044647e-033e-4735-b268-12c9530f277d admin admin] REQUEST_METHOD: `GET` {{(pid=71938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 24 16:49:19.306439 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d044647e-033e-4735-b268-12c9530f277d admin admin] SCRIPT_NAME: `/identity` {{(pid=71938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 24 16:49:19.306849 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d044647e-033e-4735-b268-12c9530f277d admin admin] PATH_INFO: `/v3/roles` {{(pid=71938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 24 16:49:19.307728 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d044647e-033e-4735-b268-12c9530f277d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=71938) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:442}} Nov 24 16:49:19.338507 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d044647e-033e-4735-b268-12c9530f277d admin admin] RBAC: Authorization granted {{(pid=71938) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 24 16:49:19.351051 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: [pid: 71938|app: 0|req: 1046/2102] 10.222.0.53 () {58 vars in 1112 bytes} [Wed Nov 24 16:49:19 2021] GET /identity/v3/roles => generated 1420 bytes in 229 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 24 16:49:19.356732 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a6460e9-ff66-48ab-b116-500e09370524 admin admin] Authenticating user token {{(pid=71939) process_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 24 16:49:19.359146 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.fernet_utils [None req-2a6460e9-ff66-48ab-b116-500e09370524 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=71939) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:289}} Nov 24 16:49:19.373590 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a6460e9-ff66-48ab-b116-500e09370524 admin admin] Validating token access rules against request {{(pid=71939) validate_allowed_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 24 16:49:19.378087 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07a0e328-9e62-4511-ab6d-4a30b639de6d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f2ba2e8375b4e8c8792ee1e22b60427', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '00a5583c7b7443e98e7a1d31a0b638dc', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=71939) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 24 16:49:19.379007 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07a0e328-9e62-4511-ab6d-4a30b639de6d admin admin] REQUEST_METHOD: `PUT` {{(pid=71939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 24 16:49:19.379343 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07a0e328-9e62-4511-ab6d-4a30b639de6d admin admin] SCRIPT_NAME: `/identity` {{(pid=71939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 24 16:49:19.379809 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07a0e328-9e62-4511-ab6d-4a30b639de6d admin admin] PATH_INFO: `/v3/projects/a8705c93bf8d49be90d8795aedf67c4e/users/30fab8267bac4cd68cf79628e9f75445/roles/912ab5f10fa5477da74acf239f07604e` {{(pid=71939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 24 16:49:19.382391 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07a0e328-9e62-4511-ab6d-4a30b639de6d admin admin] RBAC: Authorizing `identity:create_grant(project_id=a8705c93bf8d49be90d8795aedf67c4e, user_id=30fab8267bac4cd68cf79628e9f75445, role_id=912ab5f10fa5477da74acf239f07604e)` {{(pid=71939) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:442}} Nov 24 16:49:19.416161 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07a0e328-9e62-4511-ab6d-4a30b639de6d admin admin] RBAC: Authorization granted {{(pid=71939) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 24 16:49:19.436473 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: [pid: 71939|app: 0|req: 1057/2103] 10.222.0.53 () {60 vars in 1473 bytes} [Wed Nov 24 16:49:19 2021] PUT /identity/v3/projects/a8705c93bf8d49be90d8795aedf67c4e/users/30fab8267bac4cd68cf79628e9f75445/roles/912ab5f10fa5477da74acf239f07604e => generated 0 bytes in 81 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 24 16:49:19.448639 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2226667-9103-4249-9d0d-283eef716cf4 None None] REQUEST_METHOD: `POST` {{(pid=71938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 24 16:49:19.448989 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2226667-9103-4249-9d0d-283eef716cf4 None None] SCRIPT_NAME: `/identity` {{(pid=71938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 24 16:49:19.449339 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2226667-9103-4249-9d0d-283eef716cf4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=71938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 24 16:49:19.493420 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.auth.core [None req-f2226667-9103-4249-9d0d-283eef716cf4 None None] MFA Rules not processed for user `30fab8267bac4cd68cf79628e9f75445`. Rule list: `[]` (Enabled: `True`). {{(pid=71938) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:442}} Nov 24 16:49:19.494692 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.fernet_utils [None req-f2226667-9103-4249-9d0d-283eef716cf4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=71938) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:289}} Nov 24 16:49:19.623330 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: [pid: 71938|app: 0|req: 1047/2104] 10.222.0.53 () {58 vars in 948 bytes} [Wed Nov 24 16:49:19 2021] POST /identity/v3/auth/tokens => generated 3759 bytes in 176 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 24 16:49:19.636498 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07a0e328-9e62-4511-ab6d-4a30b639de6d admin admin] Authenticating user token {{(pid=71939) process_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 24 16:49:19.638433 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.fernet_utils [None req-07a0e328-9e62-4511-ab6d-4a30b639de6d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=71939) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:289}} Nov 24 16:49:19.638855 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2226667-9103-4249-9d0d-283eef716cf4 None None] Authenticating user token {{(pid=71938) process_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 24 16:49:19.640452 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.fernet_utils [None req-f2226667-9103-4249-9d0d-283eef716cf4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=71938) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:289}} Nov 24 16:49:19.727741 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07a0e328-9e62-4511-ab6d-4a30b639de6d admin admin] Validating token access rules against request {{(pid=71939) validate_allowed_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 24 16:49:19.728921 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2226667-9103-4249-9d0d-283eef716cf4 None None] Validating token access rules against request {{(pid=71938) validate_allowed_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 24 16:49:19.732458 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-976eb435-f97e-4399-92d0-db845239f6ef admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f2ba2e8375b4e8c8792ee1e22b60427', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '00a5583c7b7443e98e7a1d31a0b638dc', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=71939) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 24 16:49:19.732585 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6c9abea-d9dc-4937-93ff-b38a249ce97b service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a12374a3093a401a97c343ff0854184d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3b3940d4ae1c4177ae29c02377bb4b0b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=71938) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 24 16:49:19.733225 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6c9abea-d9dc-4937-93ff-b38a249ce97b service cinder] REQUEST_METHOD: `GET` {{(pid=71938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 24 16:49:19.733360 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-976eb435-f97e-4399-92d0-db845239f6ef admin admin] REQUEST_METHOD: `DELETE` {{(pid=71939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 24 16:49:19.733566 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6c9abea-d9dc-4937-93ff-b38a249ce97b service cinder] SCRIPT_NAME: `/identity` {{(pid=71938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 24 16:49:19.733718 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-976eb435-f97e-4399-92d0-db845239f6ef admin admin] SCRIPT_NAME: `/identity` {{(pid=71939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 24 16:49:19.733895 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6c9abea-d9dc-4937-93ff-b38a249ce97b service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=71938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 24 16:49:19.734005 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-976eb435-f97e-4399-92d0-db845239f6ef admin admin] PATH_INFO: `/v3/projects/9d0c1252519241bd9fccbee40102a850` {{(pid=71939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 24 16:49:19.735209 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-976eb435-f97e-4399-92d0-db845239f6ef admin admin] RBAC: Authorizing `identity:delete_project(project_id=9d0c1252519241bd9fccbee40102a850)` {{(pid=71939) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:442}} Nov 24 16:49:19.744557 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6c9abea-d9dc-4937-93ff-b38a249ce97b service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=71938) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:442}} Nov 24 16:49:19.764817 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-976eb435-f97e-4399-92d0-db845239f6ef admin admin] RBAC: Authorization granted {{(pid=71939) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 24 16:49:19.772560 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6c9abea-d9dc-4937-93ff-b38a249ce97b service cinder] RBAC: Authorization granted {{(pid=71938) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 24 16:49:19.783069 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: [pid: 71938|app: 0|req: 1048/2105] 10.222.0.53 () {60 vars in 1356 bytes} [Wed Nov 24 16:49:19 2021] GET /identity/v3/auth/tokens => generated 3759 bytes in 145 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Nov 24 16:49:19.784397 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6c9abea-d9dc-4937-93ff-b38a249ce97b service cinder] Authenticating user token {{(pid=71938) process_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 24 16:49:19.785750 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.fernet_utils [None req-d6c9abea-d9dc-4937-93ff-b38a249ce97b service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=71938) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:289}} Nov 24 16:49:19.797540 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6c9abea-d9dc-4937-93ff-b38a249ce97b service cinder] Validating token access rules against request {{(pid=71938) validate_allowed_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 24 16:49:19.801484 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9ec8eb5-95db-4915-a01d-042bcee6c8b8 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a12374a3093a401a97c343ff0854184d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3b3940d4ae1c4177ae29c02377bb4b0b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=71938) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 24 16:49:19.802205 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9ec8eb5-95db-4915-a01d-042bcee6c8b8 service cinder] REQUEST_METHOD: `GET` {{(pid=71938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 24 16:49:19.802551 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9ec8eb5-95db-4915-a01d-042bcee6c8b8 service cinder] SCRIPT_NAME: `/identity` {{(pid=71938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 24 16:49:19.802882 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9ec8eb5-95db-4915-a01d-042bcee6c8b8 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=71938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 24 16:49:19.805403 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.fernet_utils [None req-a9ec8eb5-95db-4915-a01d-042bcee6c8b8 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=71938) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:289}} Nov 24 16:49:19.823424 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.notifications [None req-976eb435-f97e-4399-92d0-db845239f6ef admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '9d0c1252519241bd9fccbee40102a850', 'request_id': 'req-976eb435-f97e-4399-92d0-db845239f6ef'} {{(pid=71939) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:357}} Nov 24 16:49:19.837238 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.notifications [None req-976eb435-f97e-4399-92d0-db845239f6ef admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '9d0c1252519241bd9fccbee40102a850', 'request_id': 'req-976eb435-f97e-4399-92d0-db845239f6ef'} {{(pid=71939) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:357}} Nov 24 16:49:19.844375 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.notifications [None req-976eb435-f97e-4399-92d0-db845239f6ef admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '9d0c1252519241bd9fccbee40102a850', 'request_id': 'req-976eb435-f97e-4399-92d0-db845239f6ef'} {{(pid=71939) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:357}} Nov 24 16:49:19.858523 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.notifications [None req-976eb435-f97e-4399-92d0-db845239f6ef admin admin] The token cache is being invalidate because project 9d0c1252519241bd9fccbee40102a850 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=71939) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Nov 24 16:49:19.858840 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.notifications [None req-976eb435-f97e-4399-92d0-db845239f6ef admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=71939) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:357}} Nov 24 16:49:19.859531 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.notifications [None req-976eb435-f97e-4399-92d0-db845239f6ef admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=71939) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:357}} Nov 24 16:49:19.861559 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: [pid: 71939|app: 0|req: 1058/2106] 10.222.0.53 () {58 vars in 1223 bytes} [Wed Nov 24 16:49:19 2021] DELETE /identity/v3/projects/9d0c1252519241bd9fccbee40102a850 => generated 0 bytes in 225 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 24 16:49:19.868229 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86f3eac8-688d-4c37-a0a2-69d6322ea301 None None] REQUEST_METHOD: `POST` {{(pid=71939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 24 16:49:19.868580 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86f3eac8-688d-4c37-a0a2-69d6322ea301 None None] SCRIPT_NAME: `/identity` {{(pid=71939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 24 16:49:19.868926 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86f3eac8-688d-4c37-a0a2-69d6322ea301 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=71939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 24 16:49:19.889100 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9ec8eb5-95db-4915-a01d-042bcee6c8b8 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=71938) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:442}} Nov 24 16:49:19.897400 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.auth.core [None req-86f3eac8-688d-4c37-a0a2-69d6322ea301 None None] MFA Rules not processed for user `0f2ba2e8375b4e8c8792ee1e22b60427`. Rule list: `[]` (Enabled: `True`). {{(pid=71939) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:442}} Nov 24 16:49:19.898831 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.fernet_utils [None req-86f3eac8-688d-4c37-a0a2-69d6322ea301 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=71939) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:289}} Nov 24 16:49:19.925492 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9ec8eb5-95db-4915-a01d-042bcee6c8b8 service cinder] RBAC: Authorization granted {{(pid=71938) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 24 16:49:19.937779 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: [pid: 71938|app: 0|req: 1049/2107] 10.222.0.53 () {60 vars in 1356 bytes} [Wed Nov 24 16:49:19 2021] GET /identity/v3/auth/tokens => generated 3694 bytes in 154 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 24 16:49:19.977593 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: [pid: 71939|app: 0|req: 1059/2108] 10.222.0.53 () {58 vars in 948 bytes} [Wed Nov 24 16:49:19 2021] POST /identity/v3/auth/tokens => generated 3669 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 24 16:49:19.987005 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2edf4412-d040-40d6-b1a9-3db24f572af9 None None] REQUEST_METHOD: `POST` {{(pid=71938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 24 16:49:19.987354 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2edf4412-d040-40d6-b1a9-3db24f572af9 None None] SCRIPT_NAME: `/identity` {{(pid=71938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 24 16:49:19.987904 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2edf4412-d040-40d6-b1a9-3db24f572af9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=71938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 24 16:49:20.019516 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.auth.core [None req-2edf4412-d040-40d6-b1a9-3db24f572af9 None None] MFA Rules not processed for user `0f2ba2e8375b4e8c8792ee1e22b60427`. Rule list: `[]` (Enabled: `True`). {{(pid=71938) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:442}} Nov 24 16:49:20.021215 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.fernet_utils [None req-2edf4412-d040-40d6-b1a9-3db24f572af9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=71938) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:289}} Nov 24 16:49:20.031047 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: [pid: 71938|app: 0|req: 1050/2109] 10.222.0.53 () {58 vars in 948 bytes} [Wed Nov 24 16:49:19 2021] POST /identity/v3/auth/tokens => generated 3669 bytes in 45 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 24 16:49:20.035953 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86f3eac8-688d-4c37-a0a2-69d6322ea301 None None] Authenticating user token {{(pid=71939) process_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 24 16:49:20.049655 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86f3eac8-688d-4c37-a0a2-69d6322ea301 None None] Validating token access rules against request {{(pid=71939) validate_allowed_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 24 16:49:20.055868 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de492073-5134-4e43-b51b-7e6fa4cbbe36 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f2ba2e8375b4e8c8792ee1e22b60427', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '00a5583c7b7443e98e7a1d31a0b638dc', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=71939) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 24 16:49:20.057231 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de492073-5134-4e43-b51b-7e6fa4cbbe36 admin admin] REQUEST_METHOD: `GET` {{(pid=71939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 24 16:49:20.057778 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de492073-5134-4e43-b51b-7e6fa4cbbe36 admin admin] SCRIPT_NAME: `/identity` {{(pid=71939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 24 16:49:20.058408 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de492073-5134-4e43-b51b-7e6fa4cbbe36 admin admin] PATH_INFO: `/v3/domains` {{(pid=71939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 24 16:49:20.059428 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de492073-5134-4e43-b51b-7e6fa4cbbe36 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=71939) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:161}} Nov 24 16:49:20.059978 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de492073-5134-4e43-b51b-7e6fa4cbbe36 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=71939) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:442}} Nov 24 16:49:20.099095 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de492073-5134-4e43-b51b-7e6fa4cbbe36 admin admin] RBAC: Authorization granted {{(pid=71939) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 24 16:49:20.124554 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: [pid: 71939|app: 0|req: 1060/2110] 10.222.0.53 () {58 vars in 1143 bytes} [Wed Nov 24 16:49:20 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 85 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 24 16:49:20.126391 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2edf4412-d040-40d6-b1a9-3db24f572af9 None None] Authenticating user token {{(pid=71938) process_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 24 16:49:20.137429 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2edf4412-d040-40d6-b1a9-3db24f572af9 None None] Validating token access rules against request {{(pid=71938) validate_allowed_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 24 16:49:20.143673 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf7c88bb-95d3-4ce5-b0ae-8bb6bab22705 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f2ba2e8375b4e8c8792ee1e22b60427', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '00a5583c7b7443e98e7a1d31a0b638dc', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=71938) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 24 16:49:20.144453 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf7c88bb-95d3-4ce5-b0ae-8bb6bab22705 admin admin] REQUEST_METHOD: `POST` {{(pid=71938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 24 16:49:20.144876 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf7c88bb-95d3-4ce5-b0ae-8bb6bab22705 admin admin] SCRIPT_NAME: `/identity` {{(pid=71938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 24 16:49:20.145594 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf7c88bb-95d3-4ce5-b0ae-8bb6bab22705 admin admin] PATH_INFO: `/v3/projects` {{(pid=71938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 24 16:49:20.146497 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf7c88bb-95d3-4ce5-b0ae-8bb6bab22705 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=71938) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:442}} Nov 24 16:49:20.206126 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf7c88bb-95d3-4ce5-b0ae-8bb6bab22705 admin admin] RBAC: Authorization granted {{(pid=71938) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 24 16:49:20.243299 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: [pid: 71938|app: 0|req: 1051/2111] 10.222.0.53 () {60 vars in 1143 bytes} [Wed Nov 24 16:49:20 2021] POST /identity/v3/projects => generated 381 bytes in 118 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 24 16:49:20.248087 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de492073-5134-4e43-b51b-7e6fa4cbbe36 admin admin] Authenticating user token {{(pid=71939) process_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 24 16:49:20.260862 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de492073-5134-4e43-b51b-7e6fa4cbbe36 admin admin] Validating token access rules against request {{(pid=71939) validate_allowed_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 24 16:49:20.341865 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9ddbfde-d5af-4447-aed0-1d0028f005ca admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f2ba2e8375b4e8c8792ee1e22b60427', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '00a5583c7b7443e98e7a1d31a0b638dc', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=71939) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 24 16:49:20.342765 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9ddbfde-d5af-4447-aed0-1d0028f005ca admin admin] REQUEST_METHOD: `POST` {{(pid=71939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 24 16:49:20.343198 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9ddbfde-d5af-4447-aed0-1d0028f005ca admin admin] SCRIPT_NAME: `/identity` {{(pid=71939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 24 16:49:20.343528 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9ddbfde-d5af-4447-aed0-1d0028f005ca admin admin] PATH_INFO: `/v3/users` {{(pid=71939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 24 16:49:20.344409 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9ddbfde-d5af-4447-aed0-1d0028f005ca admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=71939) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:442}} Nov 24 16:49:20.376045 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9ddbfde-d5af-4447-aed0-1d0028f005ca admin admin] RBAC: Authorization granted {{(pid=71939) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 24 16:49:20.410699 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: [pid: 71939|app: 0|req: 1061/2112] 10.222.0.53 () {60 vars in 1134 bytes} [Wed Nov 24 16:49:20 2021] POST /identity/v3/users => generated 291 bytes in 163 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 24 16:49:20.414770 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf7c88bb-95d3-4ce5-b0ae-8bb6bab22705 admin admin] Authenticating user token {{(pid=71938) process_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 24 16:49:20.425991 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf7c88bb-95d3-4ce5-b0ae-8bb6bab22705 admin admin] Validating token access rules against request {{(pid=71938) validate_allowed_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 24 16:49:20.436650 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1334477a-1e70-4e78-9fdd-cf69fee7b82f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f2ba2e8375b4e8c8792ee1e22b60427', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '00a5583c7b7443e98e7a1d31a0b638dc', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=71938) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 24 16:49:20.437364 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1334477a-1e70-4e78-9fdd-cf69fee7b82f admin admin] REQUEST_METHOD: `GET` {{(pid=71938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 24 16:49:20.437710 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1334477a-1e70-4e78-9fdd-cf69fee7b82f admin admin] SCRIPT_NAME: `/identity` {{(pid=71938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 24 16:49:20.438091 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1334477a-1e70-4e78-9fdd-cf69fee7b82f admin admin] PATH_INFO: `/v3/roles` {{(pid=71938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 24 16:49:20.438927 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1334477a-1e70-4e78-9fdd-cf69fee7b82f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=71938) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:442}} Nov 24 16:49:20.470977 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1334477a-1e70-4e78-9fdd-cf69fee7b82f admin admin] RBAC: Authorization granted {{(pid=71938) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 24 16:49:20.484155 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: [pid: 71938|app: 0|req: 1052/2113] 10.222.0.53 () {58 vars in 1112 bytes} [Wed Nov 24 16:49:20 2021] GET /identity/v3/roles => generated 1420 bytes in 70 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 24 16:49:20.488515 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9ddbfde-d5af-4447-aed0-1d0028f005ca admin admin] Authenticating user token {{(pid=71939) process_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 24 16:49:20.501112 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9ddbfde-d5af-4447-aed0-1d0028f005ca admin admin] Validating token access rules against request {{(pid=71939) validate_allowed_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 24 16:49:20.507475 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2acc3b5f-f002-4647-982f-239b135ee904 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f2ba2e8375b4e8c8792ee1e22b60427', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '00a5583c7b7443e98e7a1d31a0b638dc', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=71939) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 24 16:49:20.508503 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2acc3b5f-f002-4647-982f-239b135ee904 admin admin] REQUEST_METHOD: `PUT` {{(pid=71939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 24 16:49:20.508914 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2acc3b5f-f002-4647-982f-239b135ee904 admin admin] SCRIPT_NAME: `/identity` {{(pid=71939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 24 16:49:20.509323 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2acc3b5f-f002-4647-982f-239b135ee904 admin admin] PATH_INFO: `/v3/projects/90faa902d044446b9597eabe0837c9ae/users/aebd4c3fcd2a49b29d1f8afe37b1b7f7/roles/912ab5f10fa5477da74acf239f07604e` {{(pid=71939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 24 16:49:20.542609 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2acc3b5f-f002-4647-982f-239b135ee904 admin admin] RBAC: Authorizing `identity:create_grant(project_id=90faa902d044446b9597eabe0837c9ae, user_id=aebd4c3fcd2a49b29d1f8afe37b1b7f7, role_id=912ab5f10fa5477da74acf239f07604e)` {{(pid=71939) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:442}} Nov 24 16:49:20.582795 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2acc3b5f-f002-4647-982f-239b135ee904 admin admin] RBAC: Authorization granted {{(pid=71939) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 24 16:49:20.602402 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: [pid: 71939|app: 0|req: 1062/2114] 10.222.0.53 () {60 vars in 1473 bytes} [Wed Nov 24 16:49:20 2021] PUT /identity/v3/projects/90faa902d044446b9597eabe0837c9ae/users/aebd4c3fcd2a49b29d1f8afe37b1b7f7/roles/912ab5f10fa5477da74acf239f07604e => generated 0 bytes in 114 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 24 16:49:20.613362 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0aa007fc-ac22-4203-9890-563ee4933e7f None None] REQUEST_METHOD: `POST` {{(pid=71938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 24 16:49:20.613720 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0aa007fc-ac22-4203-9890-563ee4933e7f None None] SCRIPT_NAME: `/identity` {{(pid=71938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 24 16:49:20.614080 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0aa007fc-ac22-4203-9890-563ee4933e7f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=71938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 24 16:49:20.674679 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.auth.core [None req-0aa007fc-ac22-4203-9890-563ee4933e7f None None] MFA Rules not processed for user `aebd4c3fcd2a49b29d1f8afe37b1b7f7`. Rule list: `[]` (Enabled: `True`). {{(pid=71938) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:442}} Nov 24 16:49:20.675931 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.fernet_utils [None req-0aa007fc-ac22-4203-9890-563ee4933e7f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=71938) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:289}} Nov 24 16:49:20.768100 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: [pid: 71938|app: 0|req: 1053/2115] 10.222.0.53 () {58 vars in 948 bytes} [Wed Nov 24 16:49:20 2021] POST /identity/v3/auth/tokens => generated 3688 bytes in 156 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 24 16:49:20.773662 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2acc3b5f-f002-4647-982f-239b135ee904 admin admin] Authenticating user token {{(pid=71939) process_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 24 16:49:20.854882 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2acc3b5f-f002-4647-982f-239b135ee904 admin admin] Validating token access rules against request {{(pid=71939) validate_allowed_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 24 16:49:20.859738 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77a51fad-4943-4eb0-918b-e5ab796a25be admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f2ba2e8375b4e8c8792ee1e22b60427', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '00a5583c7b7443e98e7a1d31a0b638dc', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=71939) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 24 16:49:20.860408 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77a51fad-4943-4eb0-918b-e5ab796a25be admin admin] REQUEST_METHOD: `POST` {{(pid=71939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 24 16:49:20.860753 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77a51fad-4943-4eb0-918b-e5ab796a25be admin admin] SCRIPT_NAME: `/identity` {{(pid=71939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 24 16:49:20.861100 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77a51fad-4943-4eb0-918b-e5ab796a25be admin admin] PATH_INFO: `/v3/projects` {{(pid=71939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 24 16:49:20.861800 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77a51fad-4943-4eb0-918b-e5ab796a25be admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=71939) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:442}} Nov 24 16:49:20.891470 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77a51fad-4943-4eb0-918b-e5ab796a25be admin admin] RBAC: Authorization granted {{(pid=71939) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 24 16:49:20.917396 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: [pid: 71939|app: 0|req: 1063/2116] 10.222.0.53 () {60 vars in 1143 bytes} [Wed Nov 24 16:49:20 2021] POST /identity/v3/projects => generated 381 bytes in 144 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 24 16:49:20.922051 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0aa007fc-ac22-4203-9890-563ee4933e7f None None] Authenticating user token {{(pid=71938) process_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 24 16:49:20.933759 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0aa007fc-ac22-4203-9890-563ee4933e7f None None] Validating token access rules against request {{(pid=71938) validate_allowed_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 24 16:49:21.000806 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4f571d9-f67c-46d2-afac-6cec96438663 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f2ba2e8375b4e8c8792ee1e22b60427', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '00a5583c7b7443e98e7a1d31a0b638dc', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=71938) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 24 16:49:21.001492 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4f571d9-f67c-46d2-afac-6cec96438663 admin admin] REQUEST_METHOD: `POST` {{(pid=71938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 24 16:49:21.001828 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4f571d9-f67c-46d2-afac-6cec96438663 admin admin] SCRIPT_NAME: `/identity` {{(pid=71938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 24 16:49:21.002199 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4f571d9-f67c-46d2-afac-6cec96438663 admin admin] PATH_INFO: `/v3/users` {{(pid=71938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 24 16:49:21.002929 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4f571d9-f67c-46d2-afac-6cec96438663 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=71938) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:442}} Nov 24 16:49:21.033819 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4f571d9-f67c-46d2-afac-6cec96438663 admin admin] RBAC: Authorization granted {{(pid=71938) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 24 16:49:21.054333 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: [pid: 71938|app: 0|req: 1054/2117] 10.222.0.53 () {60 vars in 1134 bytes} [Wed Nov 24 16:49:20 2021] POST /identity/v3/users => generated 297 bytes in 133 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 24 16:49:21.058772 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77a51fad-4943-4eb0-918b-e5ab796a25be admin admin] Authenticating user token {{(pid=71939) process_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 24 16:49:21.070055 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77a51fad-4943-4eb0-918b-e5ab796a25be admin admin] Validating token access rules against request {{(pid=71939) validate_allowed_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 24 16:49:21.075175 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56f6ab8c-9562-4620-af6f-bc2b9e295514 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f2ba2e8375b4e8c8792ee1e22b60427', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '00a5583c7b7443e98e7a1d31a0b638dc', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=71939) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 24 16:49:21.075868 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56f6ab8c-9562-4620-af6f-bc2b9e295514 admin admin] REQUEST_METHOD: `GET` {{(pid=71939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 24 16:49:21.076205 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56f6ab8c-9562-4620-af6f-bc2b9e295514 admin admin] SCRIPT_NAME: `/identity` {{(pid=71939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 24 16:49:21.076538 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56f6ab8c-9562-4620-af6f-bc2b9e295514 admin admin] PATH_INFO: `/v3/roles` {{(pid=71939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 24 16:49:21.077476 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56f6ab8c-9562-4620-af6f-bc2b9e295514 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=71939) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:442}} Nov 24 16:49:21.106799 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56f6ab8c-9562-4620-af6f-bc2b9e295514 admin admin] RBAC: Authorization granted {{(pid=71939) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 24 16:49:21.119268 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: [pid: 71939|app: 0|req: 1064/2118] 10.222.0.53 () {58 vars in 1112 bytes} [Wed Nov 24 16:49:21 2021] GET /identity/v3/roles => generated 1420 bytes in 61 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 24 16:49:21.124236 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4f571d9-f67c-46d2-afac-6cec96438663 admin admin] Authenticating user token {{(pid=71938) process_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 24 16:49:21.137503 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4f571d9-f67c-46d2-afac-6cec96438663 admin admin] Validating token access rules against request {{(pid=71938) validate_allowed_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 24 16:49:21.144402 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-476136d0-adf2-469c-9106-b9fb11d318dc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f2ba2e8375b4e8c8792ee1e22b60427', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '00a5583c7b7443e98e7a1d31a0b638dc', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=71938) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 24 16:49:21.145331 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-476136d0-adf2-469c-9106-b9fb11d318dc admin admin] REQUEST_METHOD: `PUT` {{(pid=71938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 24 16:49:21.145675 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-476136d0-adf2-469c-9106-b9fb11d318dc admin admin] SCRIPT_NAME: `/identity` {{(pid=71938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 24 16:49:21.146013 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-476136d0-adf2-469c-9106-b9fb11d318dc admin admin] PATH_INFO: `/v3/projects/95a1b46d1ed844a68d9269c8727fed8b/users/f973b67157f9484d95b07a02004484b8/roles/5611724e350b41e19921b5961a342582` {{(pid=71938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 24 16:49:21.170984 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-476136d0-adf2-469c-9106-b9fb11d318dc admin admin] RBAC: Authorizing `identity:create_grant(project_id=95a1b46d1ed844a68d9269c8727fed8b, user_id=f973b67157f9484d95b07a02004484b8, role_id=5611724e350b41e19921b5961a342582)` {{(pid=71938) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:442}} Nov 24 16:49:21.203633 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-476136d0-adf2-469c-9106-b9fb11d318dc admin admin] RBAC: Authorization granted {{(pid=71938) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 24 16:49:21.222636 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: [pid: 71938|app: 0|req: 1055/2119] 10.222.0.53 () {60 vars in 1473 bytes} [Wed Nov 24 16:49:21 2021] PUT /identity/v3/projects/95a1b46d1ed844a68d9269c8727fed8b/users/f973b67157f9484d95b07a02004484b8/roles/5611724e350b41e19921b5961a342582 => generated 0 bytes in 95 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 24 16:49:21.224455 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56f6ab8c-9562-4620-af6f-bc2b9e295514 admin admin] Authenticating user token {{(pid=71939) process_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 24 16:49:21.248737 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56f6ab8c-9562-4620-af6f-bc2b9e295514 admin admin] Validating token access rules against request {{(pid=71939) validate_allowed_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 24 16:49:21.343643 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-476136d0-adf2-469c-9106-b9fb11d318dc admin admin] Authenticating user token {{(pid=71938) process_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 24 16:49:21.346267 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.fernet_utils [None req-476136d0-adf2-469c-9106-b9fb11d318dc admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=71938) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:289}} Nov 24 16:49:21.390302 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-839d44c6-c859-4408-a498-2bd0e5acfa55 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f2ba2e8375b4e8c8792ee1e22b60427', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '00a5583c7b7443e98e7a1d31a0b638dc', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=71939) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 24 16:49:21.391349 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-839d44c6-c859-4408-a498-2bd0e5acfa55 admin admin] REQUEST_METHOD: `GET` {{(pid=71939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 24 16:49:21.391912 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-839d44c6-c859-4408-a498-2bd0e5acfa55 admin admin] SCRIPT_NAME: `/identity` {{(pid=71939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 24 16:49:21.392474 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-839d44c6-c859-4408-a498-2bd0e5acfa55 admin admin] PATH_INFO: `/v3/roles` {{(pid=71939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 24 16:49:21.393852 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-839d44c6-c859-4408-a498-2bd0e5acfa55 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=71939) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:442}} Nov 24 16:49:21.452978 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-839d44c6-c859-4408-a498-2bd0e5acfa55 admin admin] RBAC: Authorization granted {{(pid=71939) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 24 16:49:21.468607 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: [pid: 71939|app: 0|req: 1065/2120] 10.222.0.53 () {58 vars in 1112 bytes} [Wed Nov 24 16:49:21 2021] GET /identity/v3/roles => generated 1420 bytes in 245 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 24 16:49:21.473247 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-839d44c6-c859-4408-a498-2bd0e5acfa55 admin admin] Authenticating user token {{(pid=71939) process_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 24 16:49:21.478309 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-476136d0-adf2-469c-9106-b9fb11d318dc admin admin] Validating token access rules against request {{(pid=71938) validate_allowed_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 24 16:49:21.483087 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c26ecb83-86be-4998-8f79-c1b6fcfb281c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f2ba2e8375b4e8c8792ee1e22b60427', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '00a5583c7b7443e98e7a1d31a0b638dc', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=71938) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 24 16:49:21.484001 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c26ecb83-86be-4998-8f79-c1b6fcfb281c admin admin] REQUEST_METHOD: `DELETE` {{(pid=71938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 24 16:49:21.484386 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c26ecb83-86be-4998-8f79-c1b6fcfb281c admin admin] SCRIPT_NAME: `/identity` {{(pid=71938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 24 16:49:21.484724 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c26ecb83-86be-4998-8f79-c1b6fcfb281c admin admin] PATH_INFO: `/v3/users/4b696f6e2ebc468a830ce385ce0c6ebd` {{(pid=71938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 24 16:49:21.486054 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c26ecb83-86be-4998-8f79-c1b6fcfb281c admin admin] RBAC: Authorizing `identity:delete_user(user_id=4b696f6e2ebc468a830ce385ce0c6ebd)` {{(pid=71938) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:442}} Nov 24 16:49:21.490399 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-839d44c6-c859-4408-a498-2bd0e5acfa55 admin admin] Validating token access rules against request {{(pid=71939) validate_allowed_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 24 16:49:21.496550 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ceb2d5ba-eb99-4a7e-82ff-74c744710698 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f2ba2e8375b4e8c8792ee1e22b60427', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '00a5583c7b7443e98e7a1d31a0b638dc', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=71939) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 24 16:49:21.497624 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ceb2d5ba-eb99-4a7e-82ff-74c744710698 admin admin] REQUEST_METHOD: `PUT` {{(pid=71939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 24 16:49:21.498162 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ceb2d5ba-eb99-4a7e-82ff-74c744710698 admin admin] SCRIPT_NAME: `/identity` {{(pid=71939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 24 16:49:21.498633 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ceb2d5ba-eb99-4a7e-82ff-74c744710698 admin admin] PATH_INFO: `/v3/projects/95a1b46d1ed844a68d9269c8727fed8b/users/f973b67157f9484d95b07a02004484b8/roles/5611724e350b41e19921b5961a342582` {{(pid=71939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 24 16:49:21.504862 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ceb2d5ba-eb99-4a7e-82ff-74c744710698 admin admin] RBAC: Authorizing `identity:create_grant(project_id=95a1b46d1ed844a68d9269c8727fed8b, user_id=f973b67157f9484d95b07a02004484b8, role_id=5611724e350b41e19921b5961a342582)` {{(pid=71939) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:442}} Nov 24 16:49:21.515269 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c26ecb83-86be-4998-8f79-c1b6fcfb281c admin admin] RBAC: Authorization granted {{(pid=71938) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 24 16:49:21.537121 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ceb2d5ba-eb99-4a7e-82ff-74c744710698 admin admin] RBAC: Authorization granted {{(pid=71939) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 24 16:49:21.552172 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: [pid: 71939|app: 0|req: 1066/2121] 10.222.0.53 () {60 vars in 1473 bytes} [Wed Nov 24 16:49:21 2021] PUT /identity/v3/projects/95a1b46d1ed844a68d9269c8727fed8b/users/f973b67157f9484d95b07a02004484b8/roles/5611724e350b41e19921b5961a342582 => generated 0 bytes in 79 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Nov 24 16:49:21.557537 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ceb2d5ba-eb99-4a7e-82ff-74c744710698 admin admin] Authenticating user token {{(pid=71939) process_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 24 16:49:21.577541 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.notifications [None req-c26ecb83-86be-4998-8f79-c1b6fcfb281c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '4b696f6e2ebc468a830ce385ce0c6ebd'} {{(pid=71938) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:357}} Nov 24 16:49:21.591296 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.notifications [None req-c26ecb83-86be-4998-8f79-c1b6fcfb281c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '4b696f6e2ebc468a830ce385ce0c6ebd'} {{(pid=71938) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:357}} Nov 24 16:49:21.592294 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.notifications [None req-c26ecb83-86be-4998-8f79-c1b6fcfb281c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '4b696f6e2ebc468a830ce385ce0c6ebd'} {{(pid=71938) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:357}} Nov 24 16:49:21.602245 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.notifications [None req-c26ecb83-86be-4998-8f79-c1b6fcfb281c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '4b696f6e2ebc468a830ce385ce0c6ebd'} {{(pid=71938) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:357}} Nov 24 16:49:21.611327 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.notifications [None req-c26ecb83-86be-4998-8f79-c1b6fcfb281c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '4b696f6e2ebc468a830ce385ce0c6ebd'} {{(pid=71938) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:357}} Nov 24 16:49:21.617966 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: [pid: 71938|app: 0|req: 1056/2122] 10.222.0.53 () {58 vars in 1214 bytes} [Wed Nov 24 16:49:21 2021] DELETE /identity/v3/users/4b696f6e2ebc468a830ce385ce0c6ebd => generated 0 bytes in 275 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 24 16:49:21.622942 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab69e439-78db-47c1-ab8e-6840bc0fe870 None None] REQUEST_METHOD: `POST` {{(pid=71938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 24 16:49:21.623842 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab69e439-78db-47c1-ab8e-6840bc0fe870 None None] SCRIPT_NAME: `/identity` {{(pid=71938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 24 16:49:21.624615 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab69e439-78db-47c1-ab8e-6840bc0fe870 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=71938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 24 16:49:21.637326 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ceb2d5ba-eb99-4a7e-82ff-74c744710698 admin admin] Validating token access rules against request {{(pid=71939) validate_allowed_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 24 16:49:21.649896 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.auth.core [None req-ab69e439-78db-47c1-ab8e-6840bc0fe870 None None] MFA Rules not processed for user `0f2ba2e8375b4e8c8792ee1e22b60427`. Rule list: `[]` (Enabled: `True`). {{(pid=71938) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:442}} Nov 24 16:49:21.651220 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.fernet_utils [None req-ab69e439-78db-47c1-ab8e-6840bc0fe870 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=71938) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:289}} Nov 24 16:49:21.720595 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdd62232-83af-475b-b341-27581ff55d48 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f2ba2e8375b4e8c8792ee1e22b60427', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '00a5583c7b7443e98e7a1d31a0b638dc', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=71939) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 24 16:49:21.721900 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdd62232-83af-475b-b341-27581ff55d48 admin admin] REQUEST_METHOD: `GET` {{(pid=71939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 24 16:49:21.722573 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdd62232-83af-475b-b341-27581ff55d48 admin admin] SCRIPT_NAME: `/identity` {{(pid=71939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 24 16:49:21.723199 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdd62232-83af-475b-b341-27581ff55d48 admin admin] PATH_INFO: `/v3/roles` {{(pid=71939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 24 16:49:21.724542 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdd62232-83af-475b-b341-27581ff55d48 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=71939) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:442}} Nov 24 16:49:21.732178 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: [pid: 71938|app: 0|req: 1057/2123] 10.222.0.53 () {58 vars in 948 bytes} [Wed Nov 24 16:49:21 2021] POST /identity/v3/auth/tokens => generated 3669 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Nov 24 16:49:21.745884 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab69e439-78db-47c1-ab8e-6840bc0fe870 None None] Authenticating user token {{(pid=71938) process_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 24 16:49:21.747360 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.fernet_utils [None req-ab69e439-78db-47c1-ab8e-6840bc0fe870 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=71938) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:289}} Nov 24 16:49:21.773810 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdd62232-83af-475b-b341-27581ff55d48 admin admin] RBAC: Authorization granted {{(pid=71939) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 24 16:49:21.794100 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: [pid: 71939|app: 0|req: 1067/2124] 10.222.0.53 () {58 vars in 1112 bytes} [Wed Nov 24 16:49:21 2021] GET /identity/v3/roles => generated 1420 bytes in 234 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 24 16:49:21.796194 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdd62232-83af-475b-b341-27581ff55d48 admin admin] Authenticating user token {{(pid=71939) process_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 24 16:49:21.799338 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.fernet_utils [None req-bdd62232-83af-475b-b341-27581ff55d48 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=71939) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:289}} Nov 24 16:49:21.815068 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdd62232-83af-475b-b341-27581ff55d48 admin admin] Validating token access rules against request {{(pid=71939) validate_allowed_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 24 16:49:21.825028 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9521acb-7b32-433b-9aa3-24036b289fee admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f2ba2e8375b4e8c8792ee1e22b60427', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '00a5583c7b7443e98e7a1d31a0b638dc', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=71939) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 24 16:49:21.826747 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9521acb-7b32-433b-9aa3-24036b289fee admin admin] REQUEST_METHOD: `PUT` {{(pid=71939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 24 16:49:21.827201 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9521acb-7b32-433b-9aa3-24036b289fee admin admin] SCRIPT_NAME: `/identity` {{(pid=71939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 24 16:49:21.827649 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9521acb-7b32-433b-9aa3-24036b289fee admin admin] PATH_INFO: `/v3/projects/95a1b46d1ed844a68d9269c8727fed8b/users/f973b67157f9484d95b07a02004484b8/roles/912ab5f10fa5477da74acf239f07604e` {{(pid=71939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 24 16:49:21.834183 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9521acb-7b32-433b-9aa3-24036b289fee admin admin] RBAC: Authorizing `identity:create_grant(project_id=95a1b46d1ed844a68d9269c8727fed8b, user_id=f973b67157f9484d95b07a02004484b8, role_id=912ab5f10fa5477da74acf239f07604e)` {{(pid=71939) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:442}} Nov 24 16:49:21.873578 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9521acb-7b32-433b-9aa3-24036b289fee admin admin] RBAC: Authorization granted {{(pid=71939) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 24 16:49:21.878479 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab69e439-78db-47c1-ab8e-6840bc0fe870 None None] Validating token access rules against request {{(pid=71938) validate_allowed_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 24 16:49:21.884967 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c5ec33d-1d1b-412e-a922-520377a04ec3 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c90f21b9cdcb413282461fa83cb6b7a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3b3940d4ae1c4177ae29c02377bb4b0b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=71938) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 24 16:49:21.886658 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c5ec33d-1d1b-412e-a922-520377a04ec3 service neutron] REQUEST_METHOD: `GET` {{(pid=71938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 24 16:49:21.887157 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c5ec33d-1d1b-412e-a922-520377a04ec3 service neutron] SCRIPT_NAME: `/identity` {{(pid=71938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 24 16:49:21.887607 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c5ec33d-1d1b-412e-a922-520377a04ec3 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=71938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 24 16:49:21.902958 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c5ec33d-1d1b-412e-a922-520377a04ec3 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=71938) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:442}} Nov 24 16:49:21.908147 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: [pid: 71939|app: 0|req: 1068/2125] 10.222.0.53 () {60 vars in 1473 bytes} [Wed Nov 24 16:49:21 2021] PUT /identity/v3/projects/95a1b46d1ed844a68d9269c8727fed8b/users/f973b67157f9484d95b07a02004484b8/roles/912ab5f10fa5477da74acf239f07604e => generated 0 bytes in 100 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Nov 24 16:49:21.909946 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-614424ea-206e-469e-8391-c016dff45ffa None None] REQUEST_METHOD: `POST` {{(pid=71939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 24 16:49:21.910625 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-614424ea-206e-469e-8391-c016dff45ffa None None] SCRIPT_NAME: `/identity` {{(pid=71939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 24 16:49:21.911072 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-614424ea-206e-469e-8391-c016dff45ffa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=71939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 24 16:49:21.940484 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c5ec33d-1d1b-412e-a922-520377a04ec3 service neutron] RBAC: Authorization granted {{(pid=71938) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 24 16:49:21.954801 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: [pid: 71938|app: 0|req: 1058/2126] 10.222.0.53 () {60 vars in 1356 bytes} [Wed Nov 24 16:49:21 2021] GET /identity/v3/auth/tokens => generated 3669 bytes in 211 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Nov 24 16:49:21.962575 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.auth.core [None req-614424ea-206e-469e-8391-c016dff45ffa None None] MFA Rules not processed for user `f973b67157f9484d95b07a02004484b8`. Rule list: `[]` (Enabled: `True`). {{(pid=71939) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:442}} Nov 24 16:49:21.963985 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.fernet_utils [None req-614424ea-206e-469e-8391-c016dff45ffa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=71939) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:289}} Nov 24 16:49:22.070925 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: [pid: 71939|app: 0|req: 1069/2127] 10.222.0.53 () {58 vars in 948 bytes} [Wed Nov 24 16:49:21 2021] POST /identity/v3/auth/tokens => generated 3755 bytes in 162 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 24 16:49:22.082471 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c5ec33d-1d1b-412e-a922-520377a04ec3 service neutron] Authenticating user token {{(pid=71938) process_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 24 16:49:22.083931 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.fernet_utils [None req-0c5ec33d-1d1b-412e-a922-520377a04ec3 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=71938) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:289}} Nov 24 16:49:22.164128 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c5ec33d-1d1b-412e-a922-520377a04ec3 service neutron] Validating token access rules against request {{(pid=71938) validate_allowed_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 24 16:49:22.249695 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-499210ce-7883-4065-a3d8-ceb09301d0fb service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a12374a3093a401a97c343ff0854184d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3b3940d4ae1c4177ae29c02377bb4b0b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=71938) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 24 16:49:22.250676 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-499210ce-7883-4065-a3d8-ceb09301d0fb service cinder] REQUEST_METHOD: `GET` {{(pid=71938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 24 16:49:22.251143 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-499210ce-7883-4065-a3d8-ceb09301d0fb service cinder] SCRIPT_NAME: `/identity` {{(pid=71938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 24 16:49:22.251591 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-499210ce-7883-4065-a3d8-ceb09301d0fb service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=71938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 24 16:49:22.263385 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-499210ce-7883-4065-a3d8-ceb09301d0fb service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=71938) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:442}} Nov 24 16:49:22.297113 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-499210ce-7883-4065-a3d8-ceb09301d0fb service cinder] RBAC: Authorization granted {{(pid=71938) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 24 16:49:22.309363 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: [pid: 71938|app: 0|req: 1059/2128] 10.222.0.53 () {60 vars in 1356 bytes} [Wed Nov 24 16:49:22 2021] GET /identity/v3/auth/tokens => generated 3755 bytes in 227 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 24 16:49:22.435835 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-499210ce-7883-4065-a3d8-ceb09301d0fb service cinder] Authenticating user token {{(pid=71938) process_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 24 16:49:22.436396 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-614424ea-206e-469e-8391-c016dff45ffa None None] Authenticating user token {{(pid=71939) process_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 24 16:49:22.437696 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.fernet_utils [None req-499210ce-7883-4065-a3d8-ceb09301d0fb service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=71938) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:289}} Nov 24 16:49:22.437938 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.fernet_utils [None req-614424ea-206e-469e-8391-c016dff45ffa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=71939) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:289}} Nov 24 16:49:22.449998 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-499210ce-7883-4065-a3d8-ceb09301d0fb service cinder] Validating token access rules against request {{(pid=71938) validate_allowed_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 24 16:49:22.454316 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9a4538e-eccf-45a3-a2b6-4dccdda0f582 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a12374a3093a401a97c343ff0854184d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3b3940d4ae1c4177ae29c02377bb4b0b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=71938) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 24 16:49:22.455360 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9a4538e-eccf-45a3-a2b6-4dccdda0f582 service cinder] REQUEST_METHOD: `GET` {{(pid=71938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 24 16:49:22.455777 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9a4538e-eccf-45a3-a2b6-4dccdda0f582 service cinder] SCRIPT_NAME: `/identity` {{(pid=71938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 24 16:49:22.456243 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9a4538e-eccf-45a3-a2b6-4dccdda0f582 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=71938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 24 16:49:22.459132 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.fernet_utils [None req-c9a4538e-eccf-45a3-a2b6-4dccdda0f582 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=71938) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:289}} Nov 24 16:49:22.541025 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-614424ea-206e-469e-8391-c016dff45ffa None None] Validating token access rules against request {{(pid=71939) validate_allowed_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 24 16:49:22.546056 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c9f78b6-daf0-4d12-846a-f6a060464d79 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f2ba2e8375b4e8c8792ee1e22b60427', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '00a5583c7b7443e98e7a1d31a0b638dc', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=71939) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 24 16:49:22.547075 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c9f78b6-daf0-4d12-846a-f6a060464d79 admin admin] REQUEST_METHOD: `DELETE` {{(pid=71939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 24 16:49:22.549868 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9a4538e-eccf-45a3-a2b6-4dccdda0f582 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=71938) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:442}} Nov 24 16:49:22.558087 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c9f78b6-daf0-4d12-846a-f6a060464d79 admin admin] SCRIPT_NAME: `/identity` {{(pid=71939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 24 16:49:22.558707 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c9f78b6-daf0-4d12-846a-f6a060464d79 admin admin] PATH_INFO: `/v3/projects/8902ffaa087a4ba780143dd8e0ce9bc5` {{(pid=71939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 24 16:49:22.562401 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c9f78b6-daf0-4d12-846a-f6a060464d79 admin admin] RBAC: Authorizing `identity:delete_project(project_id=8902ffaa087a4ba780143dd8e0ce9bc5)` {{(pid=71939) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:442}} Nov 24 16:49:22.580789 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9a4538e-eccf-45a3-a2b6-4dccdda0f582 service cinder] RBAC: Authorization granted {{(pid=71938) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 24 16:49:22.591536 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: [pid: 71938|app: 0|req: 1060/2129] 10.222.0.53 () {60 vars in 1356 bytes} [Wed Nov 24 16:49:22 2021] GET /identity/v3/auth/tokens => generated 3688 bytes in 156 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 24 16:49:22.599768 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c9f78b6-daf0-4d12-846a-f6a060464d79 admin admin] RBAC: Authorization granted {{(pid=71939) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 24 16:49:22.659943 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.notifications [None req-2c9f78b6-daf0-4d12-846a-f6a060464d79 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '8902ffaa087a4ba780143dd8e0ce9bc5', 'request_id': 'req-2c9f78b6-daf0-4d12-846a-f6a060464d79'} {{(pid=71939) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:357}} Nov 24 16:49:22.674901 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.notifications [None req-2c9f78b6-daf0-4d12-846a-f6a060464d79 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '8902ffaa087a4ba780143dd8e0ce9bc5', 'request_id': 'req-2c9f78b6-daf0-4d12-846a-f6a060464d79'} {{(pid=71939) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:357}} Nov 24 16:49:22.682829 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.notifications [None req-2c9f78b6-daf0-4d12-846a-f6a060464d79 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '8902ffaa087a4ba780143dd8e0ce9bc5', 'request_id': 'req-2c9f78b6-daf0-4d12-846a-f6a060464d79'} {{(pid=71939) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:357}} Nov 24 16:49:22.696123 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.notifications [None req-2c9f78b6-daf0-4d12-846a-f6a060464d79 admin admin] The token cache is being invalidate because project 8902ffaa087a4ba780143dd8e0ce9bc5 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=71939) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Nov 24 16:49:22.696450 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.notifications [None req-2c9f78b6-daf0-4d12-846a-f6a060464d79 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=71939) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:357}} Nov 24 16:49:22.697138 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.notifications [None req-2c9f78b6-daf0-4d12-846a-f6a060464d79 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=71939) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:357}} Nov 24 16:49:22.699089 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: [pid: 71939|app: 0|req: 1070/2130] 10.222.0.53 () {58 vars in 1223 bytes} [Wed Nov 24 16:49:22 2021] DELETE /identity/v3/projects/8902ffaa087a4ba780143dd8e0ce9bc5 => generated 0 bytes in 264 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 24 16:49:22.704208 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9a4538e-eccf-45a3-a2b6-4dccdda0f582 service cinder] Authenticating user token {{(pid=71938) process_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 24 16:49:22.719941 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9a4538e-eccf-45a3-a2b6-4dccdda0f582 service cinder] Validating token access rules against request {{(pid=71938) validate_allowed_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 24 16:49:22.797812 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57f5e925-46d3-44de-ae69-33e29cabd451 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f2ba2e8375b4e8c8792ee1e22b60427', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '00a5583c7b7443e98e7a1d31a0b638dc', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=71938) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 24 16:49:22.798937 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57f5e925-46d3-44de-ae69-33e29cabd451 admin admin] REQUEST_METHOD: `DELETE` {{(pid=71938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 24 16:49:22.799354 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57f5e925-46d3-44de-ae69-33e29cabd451 admin admin] SCRIPT_NAME: `/identity` {{(pid=71938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 24 16:49:22.799762 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57f5e925-46d3-44de-ae69-33e29cabd451 admin admin] PATH_INFO: `/v3/users/30fab8267bac4cd68cf79628e9f75445` {{(pid=71938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 24 16:49:22.801150 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57f5e925-46d3-44de-ae69-33e29cabd451 admin admin] RBAC: Authorizing `identity:delete_user(user_id=30fab8267bac4cd68cf79628e9f75445)` {{(pid=71938) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:442}} Nov 24 16:49:22.832864 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57f5e925-46d3-44de-ae69-33e29cabd451 admin admin] RBAC: Authorization granted {{(pid=71938) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 24 16:49:22.885462 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.notifications [None req-57f5e925-46d3-44de-ae69-33e29cabd451 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '30fab8267bac4cd68cf79628e9f75445'} {{(pid=71938) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:357}} Nov 24 16:49:22.898717 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.notifications [None req-57f5e925-46d3-44de-ae69-33e29cabd451 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '30fab8267bac4cd68cf79628e9f75445'} {{(pid=71938) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:357}} Nov 24 16:49:22.899465 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.notifications [None req-57f5e925-46d3-44de-ae69-33e29cabd451 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '30fab8267bac4cd68cf79628e9f75445'} {{(pid=71938) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:357}} Nov 24 16:49:22.908271 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.notifications [None req-57f5e925-46d3-44de-ae69-33e29cabd451 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '30fab8267bac4cd68cf79628e9f75445'} {{(pid=71938) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:357}} Nov 24 16:49:22.915011 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.notifications [None req-57f5e925-46d3-44de-ae69-33e29cabd451 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '30fab8267bac4cd68cf79628e9f75445'} {{(pid=71938) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:357}} Nov 24 16:49:22.921577 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: [pid: 71938|app: 0|req: 1061/2131] 10.222.0.53 () {58 vars in 1214 bytes} [Wed Nov 24 16:49:22 2021] DELETE /identity/v3/users/30fab8267bac4cd68cf79628e9f75445 => generated 0 bytes in 218 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 24 16:49:23.549997 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c9f78b6-daf0-4d12-846a-f6a060464d79 admin admin] Authenticating user token {{(pid=71939) process_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 24 16:49:23.551545 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.fernet_utils [None req-2c9f78b6-daf0-4d12-846a-f6a060464d79 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=71939) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:289}} Nov 24 16:49:23.575156 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c9f78b6-daf0-4d12-846a-f6a060464d79 admin admin] Validating token access rules against request {{(pid=71939) validate_allowed_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 24 16:49:23.657549 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-baa73fac-4665-4b69-9a01-b36b89cd32ca admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f2ba2e8375b4e8c8792ee1e22b60427', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '00a5583c7b7443e98e7a1d31a0b638dc', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=71939) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 24 16:49:23.658501 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baa73fac-4665-4b69-9a01-b36b89cd32ca admin admin] REQUEST_METHOD: `DELETE` {{(pid=71939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 24 16:49:23.658841 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baa73fac-4665-4b69-9a01-b36b89cd32ca admin admin] SCRIPT_NAME: `/identity` {{(pid=71939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 24 16:49:23.659175 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baa73fac-4665-4b69-9a01-b36b89cd32ca admin admin] PATH_INFO: `/v3/projects/a8705c93bf8d49be90d8795aedf67c4e` {{(pid=71939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 24 16:49:23.660396 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-baa73fac-4665-4b69-9a01-b36b89cd32ca admin admin] RBAC: Authorizing `identity:delete_project(project_id=a8705c93bf8d49be90d8795aedf67c4e)` {{(pid=71939) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:442}} Nov 24 16:49:23.695692 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-baa73fac-4665-4b69-9a01-b36b89cd32ca admin admin] RBAC: Authorization granted {{(pid=71939) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 24 16:49:23.752285 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.notifications [None req-baa73fac-4665-4b69-9a01-b36b89cd32ca admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a8705c93bf8d49be90d8795aedf67c4e', 'request_id': 'req-baa73fac-4665-4b69-9a01-b36b89cd32ca'} {{(pid=71939) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:357}} Nov 24 16:49:23.765129 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.notifications [None req-baa73fac-4665-4b69-9a01-b36b89cd32ca admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a8705c93bf8d49be90d8795aedf67c4e', 'request_id': 'req-baa73fac-4665-4b69-9a01-b36b89cd32ca'} {{(pid=71939) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:357}} Nov 24 16:49:23.771448 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.notifications [None req-baa73fac-4665-4b69-9a01-b36b89cd32ca admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a8705c93bf8d49be90d8795aedf67c4e', 'request_id': 'req-baa73fac-4665-4b69-9a01-b36b89cd32ca'} {{(pid=71939) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:357}} Nov 24 16:49:23.782972 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.notifications [None req-baa73fac-4665-4b69-9a01-b36b89cd32ca admin admin] The token cache is being invalidate because project a8705c93bf8d49be90d8795aedf67c4e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=71939) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Nov 24 16:49:23.783529 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.notifications [None req-baa73fac-4665-4b69-9a01-b36b89cd32ca admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=71939) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:357}} Nov 24 16:49:23.784267 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.notifications [None req-baa73fac-4665-4b69-9a01-b36b89cd32ca admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=71939) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:357}} Nov 24 16:49:23.786063 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: [pid: 71939|app: 0|req: 1071/2132] 10.222.0.53 () {58 vars in 1223 bytes} [Wed Nov 24 16:49:23 2021] DELETE /identity/v3/projects/a8705c93bf8d49be90d8795aedf67c4e => generated 0 bytes in 237 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 24 16:49:23.792370 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc8f5134-ce3c-47ce-ae10-df809bc2b98c None None] REQUEST_METHOD: `POST` {{(pid=71938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 24 16:49:23.792714 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc8f5134-ce3c-47ce-ae10-df809bc2b98c None None] SCRIPT_NAME: `/identity` {{(pid=71938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 24 16:49:23.793047 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc8f5134-ce3c-47ce-ae10-df809bc2b98c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=71938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 24 16:49:23.817671 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.auth.core [None req-fc8f5134-ce3c-47ce-ae10-df809bc2b98c None None] MFA Rules not processed for user `0f2ba2e8375b4e8c8792ee1e22b60427`. Rule list: `[]` (Enabled: `True`). {{(pid=71938) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:442}} Nov 24 16:49:23.819518 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.fernet_utils [None req-fc8f5134-ce3c-47ce-ae10-df809bc2b98c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=71938) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:289}} Nov 24 16:49:23.894290 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: [pid: 71938|app: 0|req: 1062/2133] 10.222.0.53 () {58 vars in 948 bytes} [Wed Nov 24 16:49:23 2021] POST /identity/v3/auth/tokens => generated 3669 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 24 16:49:23.904113 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0a645a8-1a7a-4549-bd1e-31433ae7844c None None] REQUEST_METHOD: `POST` {{(pid=71939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 24 16:49:23.906725 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0a645a8-1a7a-4549-bd1e-31433ae7844c None None] SCRIPT_NAME: `/identity` {{(pid=71939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 24 16:49:23.907176 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0a645a8-1a7a-4549-bd1e-31433ae7844c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=71939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 24 16:49:23.945203 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.auth.core [None req-c0a645a8-1a7a-4549-bd1e-31433ae7844c None None] MFA Rules not processed for user `0f2ba2e8375b4e8c8792ee1e22b60427`. Rule list: `[]` (Enabled: `True`). {{(pid=71939) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:442}} Nov 24 16:49:23.946581 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.fernet_utils [None req-c0a645a8-1a7a-4549-bd1e-31433ae7844c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=71939) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:289}} Nov 24 16:49:23.954428 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: [pid: 71939|app: 0|req: 1072/2134] 10.222.0.53 () {58 vars in 948 bytes} [Wed Nov 24 16:49:23 2021] POST /identity/v3/auth/tokens => generated 3669 bytes in 52 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 24 16:49:23.958976 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc8f5134-ce3c-47ce-ae10-df809bc2b98c None None] Authenticating user token {{(pid=71938) process_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 24 16:49:23.969558 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc8f5134-ce3c-47ce-ae10-df809bc2b98c None None] Validating token access rules against request {{(pid=71938) validate_allowed_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 24 16:49:23.974811 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1c81b7e-06e8-4be3-a8bd-e38dd5291f1e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f2ba2e8375b4e8c8792ee1e22b60427', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '00a5583c7b7443e98e7a1d31a0b638dc', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=71938) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 24 16:49:23.975724 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1c81b7e-06e8-4be3-a8bd-e38dd5291f1e admin admin] REQUEST_METHOD: `GET` {{(pid=71938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 24 16:49:23.976241 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1c81b7e-06e8-4be3-a8bd-e38dd5291f1e admin admin] SCRIPT_NAME: `/identity` {{(pid=71938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 24 16:49:23.976738 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1c81b7e-06e8-4be3-a8bd-e38dd5291f1e admin admin] PATH_INFO: `/v3/domains` {{(pid=71938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 24 16:49:23.977514 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1c81b7e-06e8-4be3-a8bd-e38dd5291f1e admin admin] RBAC: Adding query filter params (name=Default) {{(pid=71938) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:161}} Nov 24 16:49:23.978043 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1c81b7e-06e8-4be3-a8bd-e38dd5291f1e admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=71938) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:442}} Nov 24 16:49:24.009582 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1c81b7e-06e8-4be3-a8bd-e38dd5291f1e admin admin] RBAC: Authorization granted {{(pid=71938) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 24 16:49:24.026154 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: [pid: 71938|app: 0|req: 1063/2135] 10.222.0.53 () {58 vars in 1143 bytes} [Wed Nov 24 16:49:23 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 68 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 24 16:49:24.032235 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0a645a8-1a7a-4549-bd1e-31433ae7844c None None] Authenticating user token {{(pid=71939) process_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 24 16:49:24.042462 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0a645a8-1a7a-4549-bd1e-31433ae7844c None None] Validating token access rules against request {{(pid=71939) validate_allowed_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 24 16:49:24.047237 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b11c05a1-89c0-4161-a42f-79aef6ac3d08 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f2ba2e8375b4e8c8792ee1e22b60427', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '00a5583c7b7443e98e7a1d31a0b638dc', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=71939) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 24 16:49:24.047906 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b11c05a1-89c0-4161-a42f-79aef6ac3d08 admin admin] REQUEST_METHOD: `POST` {{(pid=71939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 24 16:49:24.048241 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b11c05a1-89c0-4161-a42f-79aef6ac3d08 admin admin] SCRIPT_NAME: `/identity` {{(pid=71939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 24 16:49:24.048570 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b11c05a1-89c0-4161-a42f-79aef6ac3d08 admin admin] PATH_INFO: `/v3/projects` {{(pid=71939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 24 16:49:24.049341 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b11c05a1-89c0-4161-a42f-79aef6ac3d08 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=71939) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:442}} Nov 24 16:49:24.079429 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b11c05a1-89c0-4161-a42f-79aef6ac3d08 admin admin] RBAC: Authorization granted {{(pid=71939) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 24 16:49:24.113745 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: [pid: 71939|app: 0|req: 1073/2136] 10.222.0.53 () {60 vars in 1143 bytes} [Wed Nov 24 16:49:24 2021] POST /identity/v3/projects => generated 381 bytes in 79 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 24 16:49:24.115065 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1c81b7e-06e8-4be3-a8bd-e38dd5291f1e admin admin] Authenticating user token {{(pid=71938) process_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 24 16:49:24.125496 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1c81b7e-06e8-4be3-a8bd-e38dd5291f1e admin admin] Validating token access rules against request {{(pid=71938) validate_allowed_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 24 16:49:24.199005 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f70512e9-3247-4a15-a81e-d32919b67277 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f2ba2e8375b4e8c8792ee1e22b60427', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '00a5583c7b7443e98e7a1d31a0b638dc', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=71938) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 24 16:49:24.199695 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f70512e9-3247-4a15-a81e-d32919b67277 admin admin] REQUEST_METHOD: `POST` {{(pid=71938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 24 16:49:24.200033 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f70512e9-3247-4a15-a81e-d32919b67277 admin admin] SCRIPT_NAME: `/identity` {{(pid=71938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 24 16:49:24.200390 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f70512e9-3247-4a15-a81e-d32919b67277 admin admin] PATH_INFO: `/v3/users` {{(pid=71938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 24 16:49:24.201077 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f70512e9-3247-4a15-a81e-d32919b67277 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=71938) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:442}} Nov 24 16:49:24.230535 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f70512e9-3247-4a15-a81e-d32919b67277 admin admin] RBAC: Authorization granted {{(pid=71938) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 24 16:49:24.257623 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: [pid: 71938|app: 0|req: 1064/2137] 10.222.0.53 () {60 vars in 1134 bytes} [Wed Nov 24 16:49:24 2021] POST /identity/v3/users => generated 291 bytes in 140 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 24 16:49:24.258707 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b11c05a1-89c0-4161-a42f-79aef6ac3d08 admin admin] Authenticating user token {{(pid=71939) process_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 24 16:49:24.270615 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b11c05a1-89c0-4161-a42f-79aef6ac3d08 admin admin] Validating token access rules against request {{(pid=71939) validate_allowed_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 24 16:49:24.275629 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0bc4fc6-f07c-478b-97a1-11b68959d661 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f2ba2e8375b4e8c8792ee1e22b60427', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '00a5583c7b7443e98e7a1d31a0b638dc', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=71939) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 24 16:49:24.276482 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0bc4fc6-f07c-478b-97a1-11b68959d661 admin admin] REQUEST_METHOD: `GET` {{(pid=71939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 24 16:49:24.277137 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0bc4fc6-f07c-478b-97a1-11b68959d661 admin admin] SCRIPT_NAME: `/identity` {{(pid=71939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 24 16:49:24.277554 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0bc4fc6-f07c-478b-97a1-11b68959d661 admin admin] PATH_INFO: `/v3/roles` {{(pid=71939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 24 16:49:24.278824 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0bc4fc6-f07c-478b-97a1-11b68959d661 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=71939) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:442}} Nov 24 16:49:24.309669 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0bc4fc6-f07c-478b-97a1-11b68959d661 admin admin] RBAC: Authorization granted {{(pid=71939) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 24 16:49:24.322901 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: [pid: 71939|app: 0|req: 1074/2138] 10.222.0.53 () {58 vars in 1112 bytes} [Wed Nov 24 16:49:24 2021] GET /identity/v3/roles => generated 1420 bytes in 65 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 24 16:49:24.327388 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f70512e9-3247-4a15-a81e-d32919b67277 admin admin] Authenticating user token {{(pid=71938) process_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 24 16:49:24.339287 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f70512e9-3247-4a15-a81e-d32919b67277 admin admin] Validating token access rules against request {{(pid=71938) validate_allowed_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 24 16:49:24.344265 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a35437be-ebfd-4682-b3f8-336352404480 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f2ba2e8375b4e8c8792ee1e22b60427', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '00a5583c7b7443e98e7a1d31a0b638dc', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=71938) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 24 16:49:24.345199 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a35437be-ebfd-4682-b3f8-336352404480 admin admin] REQUEST_METHOD: `PUT` {{(pid=71938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 24 16:49:24.345544 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a35437be-ebfd-4682-b3f8-336352404480 admin admin] SCRIPT_NAME: `/identity` {{(pid=71938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 24 16:49:24.345881 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a35437be-ebfd-4682-b3f8-336352404480 admin admin] PATH_INFO: `/v3/projects/ca7339a097aa426c8b19843f58356afb/users/767c7a43a55a41f8ab2feecbd8afc172/roles/912ab5f10fa5477da74acf239f07604e` {{(pid=71938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 24 16:49:24.369240 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a35437be-ebfd-4682-b3f8-336352404480 admin admin] RBAC: Authorizing `identity:create_grant(project_id=ca7339a097aa426c8b19843f58356afb, user_id=767c7a43a55a41f8ab2feecbd8afc172, role_id=912ab5f10fa5477da74acf239f07604e)` {{(pid=71938) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:442}} Nov 24 16:49:24.404261 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a35437be-ebfd-4682-b3f8-336352404480 admin admin] RBAC: Authorization granted {{(pid=71938) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 24 16:49:24.417580 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: [pid: 71938|app: 0|req: 1065/2139] 10.222.0.53 () {60 vars in 1473 bytes} [Wed Nov 24 16:49:24 2021] PUT /identity/v3/projects/ca7339a097aa426c8b19843f58356afb/users/767c7a43a55a41f8ab2feecbd8afc172/roles/912ab5f10fa5477da74acf239f07604e => generated 0 bytes in 91 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 24 16:49:24.428444 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bc6b2a2-4c88-4ff3-9caf-25eefe9421ab None None] REQUEST_METHOD: `POST` {{(pid=71939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 24 16:49:24.428823 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bc6b2a2-4c88-4ff3-9caf-25eefe9421ab None None] SCRIPT_NAME: `/identity` {{(pid=71939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 24 16:49:24.429139 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bc6b2a2-4c88-4ff3-9caf-25eefe9421ab None None] PATH_INFO: `/v3/auth/tokens` {{(pid=71939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 24 16:49:24.477540 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.auth.core [None req-5bc6b2a2-4c88-4ff3-9caf-25eefe9421ab None None] MFA Rules not processed for user `767c7a43a55a41f8ab2feecbd8afc172`. Rule list: `[]` (Enabled: `True`). {{(pid=71939) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:442}} Nov 24 16:49:24.478857 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.fernet_utils [None req-5bc6b2a2-4c88-4ff3-9caf-25eefe9421ab None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=71939) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:289}} Nov 24 16:49:24.561464 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: [pid: 71939|app: 0|req: 1075/2140] 10.222.0.53 () {58 vars in 948 bytes} [Wed Nov 24 16:49:24 2021] POST /identity/v3/auth/tokens => generated 3688 bytes in 134 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 24 16:49:24.566846 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a35437be-ebfd-4682-b3f8-336352404480 admin admin] Authenticating user token {{(pid=71938) process_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 24 16:49:24.648056 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a35437be-ebfd-4682-b3f8-336352404480 admin admin] Validating token access rules against request {{(pid=71938) validate_allowed_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 24 16:49:24.652743 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3231ddb3-6047-4a84-a526-125c9d52a2f0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f2ba2e8375b4e8c8792ee1e22b60427', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '00a5583c7b7443e98e7a1d31a0b638dc', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=71938) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 24 16:49:24.653453 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3231ddb3-6047-4a84-a526-125c9d52a2f0 admin admin] REQUEST_METHOD: `POST` {{(pid=71938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 24 16:49:24.653790 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3231ddb3-6047-4a84-a526-125c9d52a2f0 admin admin] SCRIPT_NAME: `/identity` {{(pid=71938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 24 16:49:24.654168 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3231ddb3-6047-4a84-a526-125c9d52a2f0 admin admin] PATH_INFO: `/v3/projects` {{(pid=71938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 24 16:49:24.654900 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3231ddb3-6047-4a84-a526-125c9d52a2f0 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=71938) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:442}} Nov 24 16:49:24.686200 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3231ddb3-6047-4a84-a526-125c9d52a2f0 admin admin] RBAC: Authorization granted {{(pid=71938) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 24 16:49:24.722276 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: [pid: 71938|app: 0|req: 1066/2141] 10.222.0.53 () {60 vars in 1143 bytes} [Wed Nov 24 16:49:24 2021] POST /identity/v3/projects => generated 379 bytes in 156 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 24 16:49:24.730778 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bc6b2a2-4c88-4ff3-9caf-25eefe9421ab None None] Authenticating user token {{(pid=71939) process_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 24 16:49:24.744561 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bc6b2a2-4c88-4ff3-9caf-25eefe9421ab None None] Validating token access rules against request {{(pid=71939) validate_allowed_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 24 16:49:24.824774 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0562102c-ab99-47cd-a7f0-de0e9349ee41 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f2ba2e8375b4e8c8792ee1e22b60427', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '00a5583c7b7443e98e7a1d31a0b638dc', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=71939) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 24 16:49:24.825476 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0562102c-ab99-47cd-a7f0-de0e9349ee41 admin admin] REQUEST_METHOD: `POST` {{(pid=71939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 24 16:49:24.825884 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0562102c-ab99-47cd-a7f0-de0e9349ee41 admin admin] SCRIPT_NAME: `/identity` {{(pid=71939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 24 16:49:24.826259 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0562102c-ab99-47cd-a7f0-de0e9349ee41 admin admin] PATH_INFO: `/v3/users` {{(pid=71939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 24 16:49:24.827077 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0562102c-ab99-47cd-a7f0-de0e9349ee41 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=71939) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:442}} Nov 24 16:49:24.855623 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0562102c-ab99-47cd-a7f0-de0e9349ee41 admin admin] RBAC: Authorization granted {{(pid=71939) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 24 16:49:24.876395 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: [pid: 71939|app: 0|req: 1076/2142] 10.222.0.53 () {60 vars in 1134 bytes} [Wed Nov 24 16:49:24 2021] POST /identity/v3/users => generated 296 bytes in 146 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 24 16:49:24.880618 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3231ddb3-6047-4a84-a526-125c9d52a2f0 admin admin] Authenticating user token {{(pid=71938) process_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 24 16:49:24.893530 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3231ddb3-6047-4a84-a526-125c9d52a2f0 admin admin] Validating token access rules against request {{(pid=71938) validate_allowed_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 24 16:49:24.898347 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bb8936a-5919-451d-ab60-f8cf93f814b4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f2ba2e8375b4e8c8792ee1e22b60427', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '00a5583c7b7443e98e7a1d31a0b638dc', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=71938) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 24 16:49:24.899202 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bb8936a-5919-451d-ab60-f8cf93f814b4 admin admin] REQUEST_METHOD: `GET` {{(pid=71938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 24 16:49:24.899640 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bb8936a-5919-451d-ab60-f8cf93f814b4 admin admin] SCRIPT_NAME: `/identity` {{(pid=71938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 24 16:49:24.900192 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bb8936a-5919-451d-ab60-f8cf93f814b4 admin admin] PATH_INFO: `/v3/roles` {{(pid=71938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 24 16:49:24.901267 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bb8936a-5919-451d-ab60-f8cf93f814b4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=71938) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:442}} Nov 24 16:49:24.930341 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bb8936a-5919-451d-ab60-f8cf93f814b4 admin admin] RBAC: Authorization granted {{(pid=71938) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 24 16:49:24.947845 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: [pid: 71938|app: 0|req: 1067/2143] 10.222.0.53 () {58 vars in 1112 bytes} [Wed Nov 24 16:49:24 2021] GET /identity/v3/roles => generated 1420 bytes in 64 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 24 16:49:24.949774 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0562102c-ab99-47cd-a7f0-de0e9349ee41 admin admin] Authenticating user token {{(pid=71939) process_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 24 16:49:24.960834 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0562102c-ab99-47cd-a7f0-de0e9349ee41 admin admin] Validating token access rules against request {{(pid=71939) validate_allowed_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 24 16:49:24.965379 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bb8936a-5919-451d-ab60-f8cf93f814b4 admin admin] Authenticating user token {{(pid=71938) process_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 24 16:49:24.965548 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d83f5d49-3677-4d50-a7fc-f42858a427e9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f2ba2e8375b4e8c8792ee1e22b60427', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '00a5583c7b7443e98e7a1d31a0b638dc', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=71939) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 24 16:49:24.966664 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d83f5d49-3677-4d50-a7fc-f42858a427e9 admin admin] REQUEST_METHOD: `PUT` {{(pid=71939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 24 16:49:24.967011 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d83f5d49-3677-4d50-a7fc-f42858a427e9 admin admin] SCRIPT_NAME: `/identity` {{(pid=71939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 24 16:49:24.967188 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.fernet_utils [None req-6bb8936a-5919-451d-ab60-f8cf93f814b4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=71938) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:289}} Nov 24 16:49:24.967353 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d83f5d49-3677-4d50-a7fc-f42858a427e9 admin admin] PATH_INFO: `/v3/projects/f75bad61be644558816b3e5d145f39f2/users/54f2c261a6514fa48b46f57a5e6cdce3/roles/5611724e350b41e19921b5961a342582` {{(pid=71939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 24 16:49:24.992061 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d83f5d49-3677-4d50-a7fc-f42858a427e9 admin admin] RBAC: Authorizing `identity:create_grant(project_id=f75bad61be644558816b3e5d145f39f2, user_id=54f2c261a6514fa48b46f57a5e6cdce3, role_id=5611724e350b41e19921b5961a342582)` {{(pid=71939) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:442}} Nov 24 16:49:25.025963 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d83f5d49-3677-4d50-a7fc-f42858a427e9 admin admin] RBAC: Authorization granted {{(pid=71939) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 24 16:49:25.039349 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: [pid: 71939|app: 0|req: 1077/2144] 10.222.0.53 () {60 vars in 1473 bytes} [Wed Nov 24 16:49:24 2021] PUT /identity/v3/projects/f75bad61be644558816b3e5d145f39f2/users/54f2c261a6514fa48b46f57a5e6cdce3/roles/5611724e350b41e19921b5961a342582 => generated 0 bytes in 90 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 24 16:49:25.043176 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d83f5d49-3677-4d50-a7fc-f42858a427e9 admin admin] Authenticating user token {{(pid=71939) process_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 24 16:49:25.051306 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bb8936a-5919-451d-ab60-f8cf93f814b4 admin admin] Validating token access rules against request {{(pid=71938) validate_allowed_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 24 16:49:25.114142 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85a8c300-5ed3-4cbe-963b-0e6d2d833a1b service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a12374a3093a401a97c343ff0854184d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3b3940d4ae1c4177ae29c02377bb4b0b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=71938) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 24 16:49:25.114910 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85a8c300-5ed3-4cbe-963b-0e6d2d833a1b service cinder] REQUEST_METHOD: `GET` {{(pid=71938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 24 16:49:25.115379 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85a8c300-5ed3-4cbe-963b-0e6d2d833a1b service cinder] SCRIPT_NAME: `/identity` {{(pid=71938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 24 16:49:25.116318 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85a8c300-5ed3-4cbe-963b-0e6d2d833a1b service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=71938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 24 16:49:25.118297 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.fernet_utils [None req-85a8c300-5ed3-4cbe-963b-0e6d2d833a1b service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=71938) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:289}} Nov 24 16:49:25.125037 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d83f5d49-3677-4d50-a7fc-f42858a427e9 admin admin] Validating token access rules against request {{(pid=71939) validate_allowed_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 24 16:49:25.129780 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc4c7e7c-6fcf-48b0-8ebe-439f45fecb8d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f2ba2e8375b4e8c8792ee1e22b60427', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '00a5583c7b7443e98e7a1d31a0b638dc', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=71939) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 24 16:49:25.130509 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc4c7e7c-6fcf-48b0-8ebe-439f45fecb8d admin admin] REQUEST_METHOD: `GET` {{(pid=71939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 24 16:49:25.130823 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc4c7e7c-6fcf-48b0-8ebe-439f45fecb8d admin admin] SCRIPT_NAME: `/identity` {{(pid=71939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 24 16:49:25.131215 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc4c7e7c-6fcf-48b0-8ebe-439f45fecb8d admin admin] PATH_INFO: `/v3/roles` {{(pid=71939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 24 16:49:25.132008 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc4c7e7c-6fcf-48b0-8ebe-439f45fecb8d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=71939) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:442}} Nov 24 16:49:25.161437 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc4c7e7c-6fcf-48b0-8ebe-439f45fecb8d admin admin] RBAC: Authorization granted {{(pid=71939) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 24 16:49:25.174065 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: [pid: 71939|app: 0|req: 1078/2145] 10.222.0.53 () {58 vars in 1112 bytes} [Wed Nov 24 16:49:25 2021] GET /identity/v3/roles => generated 1420 bytes in 131 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Nov 24 16:49:25.179310 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc4c7e7c-6fcf-48b0-8ebe-439f45fecb8d admin admin] Authenticating user token {{(pid=71939) process_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 24 16:49:25.190102 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc4c7e7c-6fcf-48b0-8ebe-439f45fecb8d admin admin] Validating token access rules against request {{(pid=71939) validate_allowed_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 24 16:49:25.196512 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd714915-1de0-4cc0-b657-67bcef0469e8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f2ba2e8375b4e8c8792ee1e22b60427', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '00a5583c7b7443e98e7a1d31a0b638dc', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=71939) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 24 16:49:25.197418 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd714915-1de0-4cc0-b657-67bcef0469e8 admin admin] REQUEST_METHOD: `PUT` {{(pid=71939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 24 16:49:25.197880 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd714915-1de0-4cc0-b657-67bcef0469e8 admin admin] SCRIPT_NAME: `/identity` {{(pid=71939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 24 16:49:25.198089 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd714915-1de0-4cc0-b657-67bcef0469e8 admin admin] PATH_INFO: `/v3/projects/f75bad61be644558816b3e5d145f39f2/users/54f2c261a6514fa48b46f57a5e6cdce3/roles/5611724e350b41e19921b5961a342582` {{(pid=71939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 24 16:49:25.200085 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd714915-1de0-4cc0-b657-67bcef0469e8 admin admin] RBAC: Authorizing `identity:create_grant(project_id=f75bad61be644558816b3e5d145f39f2, user_id=54f2c261a6514fa48b46f57a5e6cdce3, role_id=5611724e350b41e19921b5961a342582)` {{(pid=71939) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:442}} Nov 24 16:49:25.221001 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85a8c300-5ed3-4cbe-963b-0e6d2d833a1b service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=71938) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:442}} Nov 24 16:49:25.231546 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd714915-1de0-4cc0-b657-67bcef0469e8 admin admin] RBAC: Authorization granted {{(pid=71939) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 24 16:49:25.254336 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: [pid: 71939|app: 0|req: 1079/2146] 10.222.0.53 () {60 vars in 1473 bytes} [Wed Nov 24 16:49:25 2021] PUT /identity/v3/projects/f75bad61be644558816b3e5d145f39f2/users/54f2c261a6514fa48b46f57a5e6cdce3/roles/5611724e350b41e19921b5961a342582 => generated 0 bytes in 76 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Nov 24 16:49:25.259570 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd714915-1de0-4cc0-b657-67bcef0469e8 admin admin] Authenticating user token {{(pid=71939) process_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 24 16:49:25.269790 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85a8c300-5ed3-4cbe-963b-0e6d2d833a1b service cinder] RBAC: Authorization granted {{(pid=71938) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 24 16:49:25.281157 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: [pid: 71938|app: 0|req: 1068/2147] 10.222.0.53 () {60 vars in 1356 bytes} [Wed Nov 24 16:49:24 2021] GET /identity/v3/auth/tokens => generated 3694 bytes in 316 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 24 16:49:25.354308 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd714915-1de0-4cc0-b657-67bcef0469e8 admin admin] Validating token access rules against request {{(pid=71939) validate_allowed_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 24 16:49:25.360685 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7606d9a-0cee-478a-9353-3b06ac28dd12 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f2ba2e8375b4e8c8792ee1e22b60427', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '00a5583c7b7443e98e7a1d31a0b638dc', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=71939) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 24 16:49:25.360685 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7606d9a-0cee-478a-9353-3b06ac28dd12 admin admin] REQUEST_METHOD: `GET` {{(pid=71939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 24 16:49:25.360938 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7606d9a-0cee-478a-9353-3b06ac28dd12 admin admin] SCRIPT_NAME: `/identity` {{(pid=71939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 24 16:49:25.361248 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7606d9a-0cee-478a-9353-3b06ac28dd12 admin admin] PATH_INFO: `/v3/roles` {{(pid=71939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 24 16:49:25.362188 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7606d9a-0cee-478a-9353-3b06ac28dd12 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=71939) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:442}} Nov 24 16:49:25.395964 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7606d9a-0cee-478a-9353-3b06ac28dd12 admin admin] RBAC: Authorization granted {{(pid=71939) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 24 16:49:25.409799 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: [pid: 71939|app: 0|req: 1080/2148] 10.222.0.53 () {58 vars in 1112 bytes} [Wed Nov 24 16:49:25 2021] GET /identity/v3/roles => generated 1420 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 24 16:49:25.415103 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85a8c300-5ed3-4cbe-963b-0e6d2d833a1b service cinder] Authenticating user token {{(pid=71938) process_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 24 16:49:25.436844 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85a8c300-5ed3-4cbe-963b-0e6d2d833a1b service cinder] Validating token access rules against request {{(pid=71938) validate_allowed_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 24 16:49:25.442580 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-620f27f4-aad1-48ee-b6ce-fb6111fa8d6f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f2ba2e8375b4e8c8792ee1e22b60427', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '00a5583c7b7443e98e7a1d31a0b638dc', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=71938) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 24 16:49:25.444304 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-620f27f4-aad1-48ee-b6ce-fb6111fa8d6f admin admin] REQUEST_METHOD: `PUT` {{(pid=71938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 24 16:49:25.444597 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-620f27f4-aad1-48ee-b6ce-fb6111fa8d6f admin admin] SCRIPT_NAME: `/identity` {{(pid=71938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 24 16:49:25.444929 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-620f27f4-aad1-48ee-b6ce-fb6111fa8d6f admin admin] PATH_INFO: `/v3/projects/f75bad61be644558816b3e5d145f39f2/users/54f2c261a6514fa48b46f57a5e6cdce3/roles/912ab5f10fa5477da74acf239f07604e` {{(pid=71938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 24 16:49:25.449191 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-620f27f4-aad1-48ee-b6ce-fb6111fa8d6f admin admin] RBAC: Authorizing `identity:create_grant(project_id=f75bad61be644558816b3e5d145f39f2, user_id=54f2c261a6514fa48b46f57a5e6cdce3, role_id=912ab5f10fa5477da74acf239f07604e)` {{(pid=71938) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:442}} Nov 24 16:49:25.485352 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-620f27f4-aad1-48ee-b6ce-fb6111fa8d6f admin admin] RBAC: Authorization granted {{(pid=71938) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 24 16:49:25.502564 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: [pid: 71938|app: 0|req: 1069/2149] 10.222.0.53 () {60 vars in 1473 bytes} [Wed Nov 24 16:49:25 2021] PUT /identity/v3/projects/f75bad61be644558816b3e5d145f39f2/users/54f2c261a6514fa48b46f57a5e6cdce3/roles/912ab5f10fa5477da74acf239f07604e => generated 0 bytes in 88 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 24 16:49:25.513729 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-826ddce8-d1b4-4204-af24-2038a0729ca4 None None] REQUEST_METHOD: `POST` {{(pid=71939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 24 16:49:25.514258 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-826ddce8-d1b4-4204-af24-2038a0729ca4 None None] SCRIPT_NAME: `/identity` {{(pid=71939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 24 16:49:25.514692 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-826ddce8-d1b4-4204-af24-2038a0729ca4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=71939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 24 16:49:25.564831 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.auth.core [None req-826ddce8-d1b4-4204-af24-2038a0729ca4 None None] MFA Rules not processed for user `54f2c261a6514fa48b46f57a5e6cdce3`. Rule list: `[]` (Enabled: `True`). {{(pid=71939) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:442}} Nov 24 16:49:25.566009 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.fernet_utils [None req-826ddce8-d1b4-4204-af24-2038a0729ca4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=71939) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:289}} Nov 24 16:49:25.670069 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: [pid: 71939|app: 0|req: 1081/2150] 10.222.0.53 () {58 vars in 948 bytes} [Wed Nov 24 16:49:25 2021] POST /identity/v3/auth/tokens => generated 3753 bytes in 157 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 24 16:49:25.688944 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-620f27f4-aad1-48ee-b6ce-fb6111fa8d6f admin admin] Authenticating user token {{(pid=71938) process_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 24 16:49:25.690730 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.fernet_utils [None req-620f27f4-aad1-48ee-b6ce-fb6111fa8d6f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=71938) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:289}} Nov 24 16:49:25.774414 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-620f27f4-aad1-48ee-b6ce-fb6111fa8d6f admin admin] Validating token access rules against request {{(pid=71938) validate_allowed_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 24 16:49:25.784867 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-826ddce8-d1b4-4204-af24-2038a0729ca4 None None] Authenticating user token {{(pid=71939) process_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 24 16:49:25.786690 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.fernet_utils [None req-826ddce8-d1b4-4204-af24-2038a0729ca4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=71939) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:289}} Nov 24 16:49:25.789349 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7897fb44-203f-4474-b2d1-353342516d40 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f2ba2e8375b4e8c8792ee1e22b60427', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '00a5583c7b7443e98e7a1d31a0b638dc', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=71938) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 24 16:49:25.790304 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7897fb44-203f-4474-b2d1-353342516d40 admin admin] REQUEST_METHOD: `DELETE` {{(pid=71938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 24 16:49:25.790690 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7897fb44-203f-4474-b2d1-353342516d40 admin admin] SCRIPT_NAME: `/identity` {{(pid=71938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 24 16:49:25.790993 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7897fb44-203f-4474-b2d1-353342516d40 admin admin] PATH_INFO: `/v3/users/aebd4c3fcd2a49b29d1f8afe37b1b7f7` {{(pid=71938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 24 16:49:25.792185 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7897fb44-203f-4474-b2d1-353342516d40 admin admin] RBAC: Authorizing `identity:delete_user(user_id=aebd4c3fcd2a49b29d1f8afe37b1b7f7)` {{(pid=71938) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:442}} Nov 24 16:49:25.823975 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7897fb44-203f-4474-b2d1-353342516d40 admin admin] RBAC: Authorization granted {{(pid=71938) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 24 16:49:25.868088 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-826ddce8-d1b4-4204-af24-2038a0729ca4 None None] Validating token access rules against request {{(pid=71939) validate_allowed_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 24 16:49:25.872553 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-807d6a48-2f1b-47f7-814f-906a6a0e72a9 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a12374a3093a401a97c343ff0854184d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3b3940d4ae1c4177ae29c02377bb4b0b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=71939) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 24 16:49:25.873216 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-807d6a48-2f1b-47f7-814f-906a6a0e72a9 service cinder] REQUEST_METHOD: `GET` {{(pid=71939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 24 16:49:25.873554 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-807d6a48-2f1b-47f7-814f-906a6a0e72a9 service cinder] SCRIPT_NAME: `/identity` {{(pid=71939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 24 16:49:25.874187 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-807d6a48-2f1b-47f7-814f-906a6a0e72a9 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=71939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 24 16:49:25.881263 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.notifications [None req-7897fb44-203f-4474-b2d1-353342516d40 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'aebd4c3fcd2a49b29d1f8afe37b1b7f7'} {{(pid=71938) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:357}} Nov 24 16:49:25.885007 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-807d6a48-2f1b-47f7-814f-906a6a0e72a9 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=71939) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:442}} Nov 24 16:49:25.895902 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.notifications [None req-7897fb44-203f-4474-b2d1-353342516d40 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'aebd4c3fcd2a49b29d1f8afe37b1b7f7'} {{(pid=71938) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:357}} Nov 24 16:49:25.896701 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.notifications [None req-7897fb44-203f-4474-b2d1-353342516d40 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'aebd4c3fcd2a49b29d1f8afe37b1b7f7'} {{(pid=71938) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:357}} Nov 24 16:49:25.905223 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.notifications [None req-7897fb44-203f-4474-b2d1-353342516d40 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'aebd4c3fcd2a49b29d1f8afe37b1b7f7'} {{(pid=71938) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:357}} Nov 24 16:49:25.911957 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.notifications [None req-7897fb44-203f-4474-b2d1-353342516d40 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'aebd4c3fcd2a49b29d1f8afe37b1b7f7'} {{(pid=71938) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:357}} Nov 24 16:49:25.914803 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-807d6a48-2f1b-47f7-814f-906a6a0e72a9 service cinder] RBAC: Authorization granted {{(pid=71939) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 24 16:49:25.920011 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: [pid: 71938|app: 0|req: 1070/2151] 10.222.0.53 () {58 vars in 1214 bytes} [Wed Nov 24 16:49:25 2021] DELETE /identity/v3/users/aebd4c3fcd2a49b29d1f8afe37b1b7f7 => generated 0 bytes in 231 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 24 16:49:25.925370 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: [pid: 71939|app: 0|req: 1082/2152] 10.222.0.53 () {60 vars in 1356 bytes} [Wed Nov 24 16:49:25 2021] GET /identity/v3/auth/tokens => generated 3753 bytes in 141 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 24 16:49:25.926159 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81375cc0-eb26-4481-ad1e-42f5209aa999 None None] REQUEST_METHOD: `POST` {{(pid=71938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 24 16:49:25.926639 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81375cc0-eb26-4481-ad1e-42f5209aa999 None None] SCRIPT_NAME: `/identity` {{(pid=71938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 24 16:49:25.926971 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81375cc0-eb26-4481-ad1e-42f5209aa999 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=71938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 24 16:49:25.964167 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.auth.core [None req-81375cc0-eb26-4481-ad1e-42f5209aa999 None None] MFA Rules not processed for user `0f2ba2e8375b4e8c8792ee1e22b60427`. Rule list: `[]` (Enabled: `True`). {{(pid=71938) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:442}} Nov 24 16:49:25.965401 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.fernet_utils [None req-81375cc0-eb26-4481-ad1e-42f5209aa999 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=71938) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:289}} Nov 24 16:49:26.134399 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: [pid: 71938|app: 0|req: 1071/2153] 10.222.0.53 () {58 vars in 948 bytes} [Wed Nov 24 16:49:25 2021] POST /identity/v3/auth/tokens => generated 3669 bytes in 211 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Nov 24 16:49:26.146303 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-807d6a48-2f1b-47f7-814f-906a6a0e72a9 service cinder] Authenticating user token {{(pid=71939) process_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 24 16:49:26.149139 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.fernet_utils [None req-807d6a48-2f1b-47f7-814f-906a6a0e72a9 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=71939) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:289}} Nov 24 16:49:26.263481 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-807d6a48-2f1b-47f7-814f-906a6a0e72a9 service cinder] Validating token access rules against request {{(pid=71939) validate_allowed_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 24 16:49:26.334737 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51e5e429-79ec-4925-adea-3aaac9eb0809 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c90f21b9cdcb413282461fa83cb6b7a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3b3940d4ae1c4177ae29c02377bb4b0b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=71939) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 24 16:49:26.335338 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51e5e429-79ec-4925-adea-3aaac9eb0809 service neutron] REQUEST_METHOD: `GET` {{(pid=71939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 24 16:49:26.335676 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51e5e429-79ec-4925-adea-3aaac9eb0809 service neutron] SCRIPT_NAME: `/identity` {{(pid=71939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 24 16:49:26.336002 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51e5e429-79ec-4925-adea-3aaac9eb0809 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=71939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 24 16:49:26.346010 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51e5e429-79ec-4925-adea-3aaac9eb0809 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=71939) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:442}} Nov 24 16:49:26.376559 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51e5e429-79ec-4925-adea-3aaac9eb0809 service neutron] RBAC: Authorization granted {{(pid=71939) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 24 16:49:26.388436 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: [pid: 71939|app: 0|req: 1083/2154] 10.222.0.53 () {60 vars in 1356 bytes} [Wed Nov 24 16:49:26 2021] GET /identity/v3/auth/tokens => generated 3669 bytes in 243 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 24 16:49:26.717964 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81375cc0-eb26-4481-ad1e-42f5209aa999 None None] Authenticating user token {{(pid=71938) process_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 24 16:49:26.719958 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.fernet_utils [None req-81375cc0-eb26-4481-ad1e-42f5209aa999 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=71938) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:289}} Nov 24 16:49:26.732820 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81375cc0-eb26-4481-ad1e-42f5209aa999 None None] Validating token access rules against request {{(pid=71938) validate_allowed_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 24 16:49:26.738263 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-137e247a-0496-40d6-bc98-0b0ef43097e1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f2ba2e8375b4e8c8792ee1e22b60427', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '00a5583c7b7443e98e7a1d31a0b638dc', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=71938) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 24 16:49:26.739377 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-137e247a-0496-40d6-bc98-0b0ef43097e1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=71938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 24 16:49:26.739833 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-137e247a-0496-40d6-bc98-0b0ef43097e1 admin admin] SCRIPT_NAME: `/identity` {{(pid=71938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 24 16:49:26.740281 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-137e247a-0496-40d6-bc98-0b0ef43097e1 admin admin] PATH_INFO: `/v3/users/767c7a43a55a41f8ab2feecbd8afc172` {{(pid=71938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 24 16:49:26.742348 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-137e247a-0496-40d6-bc98-0b0ef43097e1 admin admin] RBAC: Authorizing `identity:delete_user(user_id=767c7a43a55a41f8ab2feecbd8afc172)` {{(pid=71938) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:442}} Nov 24 16:49:26.772591 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-137e247a-0496-40d6-bc98-0b0ef43097e1 admin admin] RBAC: Authorization granted {{(pid=71938) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 24 16:49:26.824484 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51e5e429-79ec-4925-adea-3aaac9eb0809 service neutron] Authenticating user token {{(pid=71939) process_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 24 16:49:26.826226 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.fernet_utils [None req-51e5e429-79ec-4925-adea-3aaac9eb0809 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=71939) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:289}} Nov 24 16:49:26.858130 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51e5e429-79ec-4925-adea-3aaac9eb0809 service neutron] Validating token access rules against request {{(pid=71939) validate_allowed_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 24 16:49:26.862940 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6250f183-136f-4e8b-9f2f-b84cfdfe5a51 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f2ba2e8375b4e8c8792ee1e22b60427', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '00a5583c7b7443e98e7a1d31a0b638dc', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=71939) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 24 16:49:26.864806 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6250f183-136f-4e8b-9f2f-b84cfdfe5a51 admin admin] REQUEST_METHOD: `DELETE` {{(pid=71939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 24 16:49:26.866051 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6250f183-136f-4e8b-9f2f-b84cfdfe5a51 admin admin] SCRIPT_NAME: `/identity` {{(pid=71939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 24 16:49:26.866654 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6250f183-136f-4e8b-9f2f-b84cfdfe5a51 admin admin] PATH_INFO: `/v3/projects/90faa902d044446b9597eabe0837c9ae` {{(pid=71939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 24 16:49:26.868298 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6250f183-136f-4e8b-9f2f-b84cfdfe5a51 admin admin] RBAC: Authorizing `identity:delete_project(project_id=90faa902d044446b9597eabe0837c9ae)` {{(pid=71939) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:442}} Nov 24 16:49:26.881729 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.notifications [None req-137e247a-0496-40d6-bc98-0b0ef43097e1 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '767c7a43a55a41f8ab2feecbd8afc172'} {{(pid=71938) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:357}} Nov 24 16:49:26.895729 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.notifications [None req-137e247a-0496-40d6-bc98-0b0ef43097e1 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '767c7a43a55a41f8ab2feecbd8afc172'} {{(pid=71938) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:357}} Nov 24 16:49:26.897718 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.notifications [None req-137e247a-0496-40d6-bc98-0b0ef43097e1 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '767c7a43a55a41f8ab2feecbd8afc172'} {{(pid=71938) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:357}} Nov 24 16:49:26.899030 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6250f183-136f-4e8b-9f2f-b84cfdfe5a51 admin admin] RBAC: Authorization granted {{(pid=71939) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 24 16:49:26.908000 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.notifications [None req-137e247a-0496-40d6-bc98-0b0ef43097e1 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '767c7a43a55a41f8ab2feecbd8afc172'} {{(pid=71938) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:357}} Nov 24 16:49:26.916922 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.notifications [None req-137e247a-0496-40d6-bc98-0b0ef43097e1 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '767c7a43a55a41f8ab2feecbd8afc172'} {{(pid=71938) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:357}} Nov 24 16:49:26.930158 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: [pid: 71938|app: 0|req: 1072/2155] 10.222.0.53 () {58 vars in 1214 bytes} [Wed Nov 24 16:49:26 2021] DELETE /identity/v3/users/767c7a43a55a41f8ab2feecbd8afc172 => generated 0 bytes in 209 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 24 16:49:26.932080 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0bd8f96-ad7d-481a-975a-c809574b6d31 None None] REQUEST_METHOD: `POST` {{(pid=71938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 24 16:49:26.932427 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0bd8f96-ad7d-481a-975a-c809574b6d31 None None] SCRIPT_NAME: `/identity` {{(pid=71938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 24 16:49:26.933011 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0bd8f96-ad7d-481a-975a-c809574b6d31 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=71938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 24 16:49:26.961635 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.notifications [None req-6250f183-136f-4e8b-9f2f-b84cfdfe5a51 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '90faa902d044446b9597eabe0837c9ae', 'request_id': 'req-6250f183-136f-4e8b-9f2f-b84cfdfe5a51'} {{(pid=71939) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:357}} Nov 24 16:49:26.966811 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.auth.core [None req-e0bd8f96-ad7d-481a-975a-c809574b6d31 None None] MFA Rules not processed for user `0f2ba2e8375b4e8c8792ee1e22b60427`. Rule list: `[]` (Enabled: `True`). {{(pid=71938) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:442}} Nov 24 16:49:26.968380 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.fernet_utils [None req-e0bd8f96-ad7d-481a-975a-c809574b6d31 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=71938) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:289}} Nov 24 16:49:26.971765 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.notifications [None req-6250f183-136f-4e8b-9f2f-b84cfdfe5a51 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '90faa902d044446b9597eabe0837c9ae', 'request_id': 'req-6250f183-136f-4e8b-9f2f-b84cfdfe5a51'} {{(pid=71939) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:357}} Nov 24 16:49:26.980917 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.notifications [None req-6250f183-136f-4e8b-9f2f-b84cfdfe5a51 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '90faa902d044446b9597eabe0837c9ae', 'request_id': 'req-6250f183-136f-4e8b-9f2f-b84cfdfe5a51'} {{(pid=71939) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:357}} Nov 24 16:49:26.992868 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.notifications [None req-6250f183-136f-4e8b-9f2f-b84cfdfe5a51 admin admin] The token cache is being invalidate because project 90faa902d044446b9597eabe0837c9ae was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=71939) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Nov 24 16:49:26.993336 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.notifications [None req-6250f183-136f-4e8b-9f2f-b84cfdfe5a51 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=71939) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:357}} Nov 24 16:49:26.994173 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.notifications [None req-6250f183-136f-4e8b-9f2f-b84cfdfe5a51 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=71939) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:357}} Nov 24 16:49:26.996047 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: [pid: 71939|app: 0|req: 1084/2156] 10.222.0.53 () {58 vars in 1223 bytes} [Wed Nov 24 16:49:26 2021] DELETE /identity/v3/projects/90faa902d044446b9597eabe0837c9ae => generated 0 bytes in 172 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 24 16:49:27.000465 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6250f183-136f-4e8b-9f2f-b84cfdfe5a51 admin admin] Authenticating user token {{(pid=71939) process_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 24 16:49:27.002487 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.fernet_utils [None req-6250f183-136f-4e8b-9f2f-b84cfdfe5a51 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=71939) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:289}} Nov 24 16:49:27.052017 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: [pid: 71938|app: 0|req: 1073/2157] 10.222.0.53 () {58 vars in 948 bytes} [Wed Nov 24 16:49:26 2021] POST /identity/v3/auth/tokens => generated 3669 bytes in 121 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 24 16:49:27.078940 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0bd8f96-ad7d-481a-975a-c809574b6d31 None None] Authenticating user token {{(pid=71938) process_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 24 16:49:27.080715 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.fernet_utils [None req-e0bd8f96-ad7d-481a-975a-c809574b6d31 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=71938) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:289}} Nov 24 16:49:27.089630 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6250f183-136f-4e8b-9f2f-b84cfdfe5a51 admin admin] Validating token access rules against request {{(pid=71939) validate_allowed_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 24 16:49:27.095134 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-911e8bab-c444-4709-b3bb-69150fbb9212 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f2ba2e8375b4e8c8792ee1e22b60427', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '00a5583c7b7443e98e7a1d31a0b638dc', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=71939) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 24 16:49:27.096351 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-911e8bab-c444-4709-b3bb-69150fbb9212 admin admin] REQUEST_METHOD: `DELETE` {{(pid=71939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 24 16:49:27.096878 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-911e8bab-c444-4709-b3bb-69150fbb9212 admin admin] SCRIPT_NAME: `/identity` {{(pid=71939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 24 16:49:27.097241 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-911e8bab-c444-4709-b3bb-69150fbb9212 admin admin] PATH_INFO: `/v3/users/f973b67157f9484d95b07a02004484b8` {{(pid=71939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 24 16:49:27.098636 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-911e8bab-c444-4709-b3bb-69150fbb9212 admin admin] RBAC: Authorizing `identity:delete_user(user_id=f973b67157f9484d95b07a02004484b8)` {{(pid=71939) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:442}} Nov 24 16:49:27.130581 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-911e8bab-c444-4709-b3bb-69150fbb9212 admin admin] RBAC: Authorization granted {{(pid=71939) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 24 16:49:27.206147 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0bd8f96-ad7d-481a-975a-c809574b6d31 None None] Validating token access rules against request {{(pid=71938) validate_allowed_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 24 16:49:27.210724 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f2bfe13-9866-4943-ad15-25be786af2b9 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c90f21b9cdcb413282461fa83cb6b7a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3b3940d4ae1c4177ae29c02377bb4b0b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=71938) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 24 16:49:27.211686 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f2bfe13-9866-4943-ad15-25be786af2b9 service neutron] REQUEST_METHOD: `GET` {{(pid=71938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 24 16:49:27.212138 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f2bfe13-9866-4943-ad15-25be786af2b9 service neutron] SCRIPT_NAME: `/identity` {{(pid=71938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 24 16:49:27.212582 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f2bfe13-9866-4943-ad15-25be786af2b9 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=71938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 24 16:49:27.224079 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f2bfe13-9866-4943-ad15-25be786af2b9 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=71938) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:442}} Nov 24 16:49:27.229561 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.notifications [None req-911e8bab-c444-4709-b3bb-69150fbb9212 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f973b67157f9484d95b07a02004484b8'} {{(pid=71939) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:357}} Nov 24 16:49:27.254784 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.notifications [None req-911e8bab-c444-4709-b3bb-69150fbb9212 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f973b67157f9484d95b07a02004484b8'} {{(pid=71939) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:357}} Nov 24 16:49:27.255592 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.notifications [None req-911e8bab-c444-4709-b3bb-69150fbb9212 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f973b67157f9484d95b07a02004484b8'} {{(pid=71939) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:357}} Nov 24 16:49:27.259146 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f2bfe13-9866-4943-ad15-25be786af2b9 service neutron] RBAC: Authorization granted {{(pid=71938) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 24 16:49:27.288273 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.notifications [None req-911e8bab-c444-4709-b3bb-69150fbb9212 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f973b67157f9484d95b07a02004484b8'} {{(pid=71939) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:357}} Nov 24 16:49:27.294332 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: [pid: 71938|app: 0|req: 1074/2158] 10.222.0.53 () {60 vars in 1356 bytes} [Wed Nov 24 16:49:27 2021] GET /identity/v3/auth/tokens => generated 3669 bytes in 216 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Nov 24 16:49:27.295850 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.notifications [None req-911e8bab-c444-4709-b3bb-69150fbb9212 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f973b67157f9484d95b07a02004484b8'} {{(pid=71939) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:357}} Nov 24 16:49:27.302439 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: [pid: 71939|app: 0|req: 1085/2159] 10.222.0.53 () {58 vars in 1214 bytes} [Wed Nov 24 16:49:26 2021] DELETE /identity/v3/users/f973b67157f9484d95b07a02004484b8 => generated 0 bytes in 303 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Nov 24 16:49:27.842839 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f2bfe13-9866-4943-ad15-25be786af2b9 service neutron] Authenticating user token {{(pid=71938) process_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 24 16:49:27.844360 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-911e8bab-c444-4709-b3bb-69150fbb9212 admin admin] Authenticating user token {{(pid=71939) process_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 24 16:49:27.844489 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.fernet_utils [None req-7f2bfe13-9866-4943-ad15-25be786af2b9 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=71938) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:289}} Nov 24 16:49:27.845936 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.fernet_utils [None req-911e8bab-c444-4709-b3bb-69150fbb9212 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=71939) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:289}} Nov 24 16:49:27.860844 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f2bfe13-9866-4943-ad15-25be786af2b9 service neutron] Validating token access rules against request {{(pid=71938) validate_allowed_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 24 16:49:27.927239 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-911e8bab-c444-4709-b3bb-69150fbb9212 admin admin] Validating token access rules against request {{(pid=71939) validate_allowed_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 24 16:49:27.933455 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a4527d7-55a7-4120-aa68-e7f30ca7c387 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f2ba2e8375b4e8c8792ee1e22b60427', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '00a5583c7b7443e98e7a1d31a0b638dc', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=71939) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 24 16:49:27.934326 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a4527d7-55a7-4120-aa68-e7f30ca7c387 admin admin] REQUEST_METHOD: `DELETE` {{(pid=71939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 24 16:49:27.934668 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a4527d7-55a7-4120-aa68-e7f30ca7c387 admin admin] SCRIPT_NAME: `/identity` {{(pid=71939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 24 16:49:27.934998 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a4527d7-55a7-4120-aa68-e7f30ca7c387 admin admin] PATH_INFO: `/v3/projects/95a1b46d1ed844a68d9269c8727fed8b` {{(pid=71939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 24 16:49:27.936267 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a4527d7-55a7-4120-aa68-e7f30ca7c387 admin admin] RBAC: Authorizing `identity:delete_project(project_id=95a1b46d1ed844a68d9269c8727fed8b)` {{(pid=71939) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:442}} Nov 24 16:49:27.947822 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eee48c54-06bd-4556-b4ed-923f5cccc8d5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f2ba2e8375b4e8c8792ee1e22b60427', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '00a5583c7b7443e98e7a1d31a0b638dc', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=71938) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 24 16:49:27.948856 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eee48c54-06bd-4556-b4ed-923f5cccc8d5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=71938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 24 16:49:27.949203 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eee48c54-06bd-4556-b4ed-923f5cccc8d5 admin admin] SCRIPT_NAME: `/identity` {{(pid=71938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 24 16:49:27.949538 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eee48c54-06bd-4556-b4ed-923f5cccc8d5 admin admin] PATH_INFO: `/v3/projects/ca7339a097aa426c8b19843f58356afb` {{(pid=71938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 24 16:49:27.950803 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eee48c54-06bd-4556-b4ed-923f5cccc8d5 admin admin] RBAC: Authorizing `identity:delete_project(project_id=ca7339a097aa426c8b19843f58356afb)` {{(pid=71938) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:442}} Nov 24 16:49:27.966246 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a4527d7-55a7-4120-aa68-e7f30ca7c387 admin admin] RBAC: Authorization granted {{(pid=71939) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 24 16:49:27.980336 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eee48c54-06bd-4556-b4ed-923f5cccc8d5 admin admin] RBAC: Authorization granted {{(pid=71938) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 24 16:49:28.022697 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.notifications [None req-1a4527d7-55a7-4120-aa68-e7f30ca7c387 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '95a1b46d1ed844a68d9269c8727fed8b', 'request_id': 'req-1a4527d7-55a7-4120-aa68-e7f30ca7c387'} {{(pid=71939) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:357}} Nov 24 16:49:28.035364 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.notifications [None req-1a4527d7-55a7-4120-aa68-e7f30ca7c387 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '95a1b46d1ed844a68d9269c8727fed8b', 'request_id': 'req-1a4527d7-55a7-4120-aa68-e7f30ca7c387'} {{(pid=71939) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:357}} Nov 24 16:49:28.043482 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.notifications [None req-eee48c54-06bd-4556-b4ed-923f5cccc8d5 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ca7339a097aa426c8b19843f58356afb', 'request_id': 'req-eee48c54-06bd-4556-b4ed-923f5cccc8d5'} {{(pid=71938) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:357}} Nov 24 16:49:28.044185 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.notifications [None req-1a4527d7-55a7-4120-aa68-e7f30ca7c387 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '95a1b46d1ed844a68d9269c8727fed8b', 'request_id': 'req-1a4527d7-55a7-4120-aa68-e7f30ca7c387'} {{(pid=71939) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:357}} Nov 24 16:49:28.056685 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.notifications [None req-1a4527d7-55a7-4120-aa68-e7f30ca7c387 admin admin] The token cache is being invalidate because project 95a1b46d1ed844a68d9269c8727fed8b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=71939) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Nov 24 16:49:28.057017 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.notifications [None req-1a4527d7-55a7-4120-aa68-e7f30ca7c387 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=71939) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:357}} Nov 24 16:49:28.057726 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.notifications [None req-1a4527d7-55a7-4120-aa68-e7f30ca7c387 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=71939) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:357}} Nov 24 16:49:28.059358 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.notifications [None req-eee48c54-06bd-4556-b4ed-923f5cccc8d5 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ca7339a097aa426c8b19843f58356afb', 'request_id': 'req-eee48c54-06bd-4556-b4ed-923f5cccc8d5'} {{(pid=71938) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:357}} Nov 24 16:49:28.059738 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: [pid: 71939|app: 0|req: 1086/2160] 10.222.0.53 () {58 vars in 1223 bytes} [Wed Nov 24 16:49:27 2021] DELETE /identity/v3/projects/95a1b46d1ed844a68d9269c8727fed8b => generated 0 bytes in 216 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 24 16:49:28.065973 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72722e9a-cb92-433d-8397-87e9ae217a0b None None] REQUEST_METHOD: `POST` {{(pid=71939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 24 16:49:28.066628 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72722e9a-cb92-433d-8397-87e9ae217a0b None None] SCRIPT_NAME: `/identity` {{(pid=71939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 24 16:49:28.066970 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72722e9a-cb92-433d-8397-87e9ae217a0b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=71939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 24 16:49:28.067866 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.notifications [None req-eee48c54-06bd-4556-b4ed-923f5cccc8d5 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ca7339a097aa426c8b19843f58356afb', 'request_id': 'req-eee48c54-06bd-4556-b4ed-923f5cccc8d5'} {{(pid=71938) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:357}} Nov 24 16:49:28.083987 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.notifications [None req-eee48c54-06bd-4556-b4ed-923f5cccc8d5 admin admin] The token cache is being invalidate because project ca7339a097aa426c8b19843f58356afb was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=71938) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Nov 24 16:49:28.084484 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.notifications [None req-eee48c54-06bd-4556-b4ed-923f5cccc8d5 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=71938) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:357}} Nov 24 16:49:28.085255 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.notifications [None req-eee48c54-06bd-4556-b4ed-923f5cccc8d5 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=71938) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:357}} Nov 24 16:49:28.087283 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: [pid: 71938|app: 0|req: 1075/2161] 10.222.0.53 () {58 vars in 1223 bytes} [Wed Nov 24 16:49:27 2021] DELETE /identity/v3/projects/ca7339a097aa426c8b19843f58356afb => generated 0 bytes in 247 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 24 16:49:28.091496 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eee48c54-06bd-4556-b4ed-923f5cccc8d5 admin admin] Authenticating user token {{(pid=71938) process_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 24 16:49:28.093229 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.fernet_utils [None req-eee48c54-06bd-4556-b4ed-923f5cccc8d5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=71938) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:289}} Nov 24 16:49:28.094811 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.auth.core [None req-72722e9a-cb92-433d-8397-87e9ae217a0b None None] MFA Rules not processed for user `0f2ba2e8375b4e8c8792ee1e22b60427`. Rule list: `[]` (Enabled: `True`). {{(pid=71939) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:442}} Nov 24 16:49:28.096029 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.fernet_utils [None req-72722e9a-cb92-433d-8397-87e9ae217a0b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=71939) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:289}} Nov 24 16:49:28.178775 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: [pid: 71939|app: 0|req: 1087/2162] 10.222.0.53 () {58 vars in 948 bytes} [Wed Nov 24 16:49:28 2021] POST /identity/v3/auth/tokens => generated 3669 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 24 16:49:28.179396 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72722e9a-cb92-433d-8397-87e9ae217a0b None None] Authenticating user token {{(pid=71939) process_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 24 16:49:28.180896 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.fernet_utils [None req-72722e9a-cb92-433d-8397-87e9ae217a0b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=71939) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:289}} Nov 24 16:49:28.200368 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72722e9a-cb92-433d-8397-87e9ae217a0b None None] Validating token access rules against request {{(pid=71939) validate_allowed_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 24 16:49:28.213201 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0994d24-923f-4f89-a518-777ffeeade5f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f2ba2e8375b4e8c8792ee1e22b60427', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '00a5583c7b7443e98e7a1d31a0b638dc', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=71939) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 24 16:49:28.214159 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0994d24-923f-4f89-a518-777ffeeade5f admin admin] REQUEST_METHOD: `DELETE` {{(pid=71939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 24 16:49:28.214506 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0994d24-923f-4f89-a518-777ffeeade5f admin admin] SCRIPT_NAME: `/identity` {{(pid=71939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 24 16:49:28.214842 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0994d24-923f-4f89-a518-777ffeeade5f admin admin] PATH_INFO: `/v3/users/6c9b3d7e6d0f47178c70c3afca862a8f` {{(pid=71939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 24 16:49:28.217091 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0994d24-923f-4f89-a518-777ffeeade5f admin admin] RBAC: Authorizing `identity:delete_user(user_id=6c9b3d7e6d0f47178c70c3afca862a8f)` {{(pid=71939) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:442}} Nov 24 16:49:28.218705 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eee48c54-06bd-4556-b4ed-923f5cccc8d5 admin admin] Validating token access rules against request {{(pid=71938) validate_allowed_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 24 16:49:28.231850 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b2b33ec-c46f-4061-91b2-b4dde7f997e8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f2ba2e8375b4e8c8792ee1e22b60427', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '00a5583c7b7443e98e7a1d31a0b638dc', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=71938) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 24 16:49:28.232970 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b2b33ec-c46f-4061-91b2-b4dde7f997e8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=71938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 24 16:49:28.233430 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b2b33ec-c46f-4061-91b2-b4dde7f997e8 admin admin] SCRIPT_NAME: `/identity` {{(pid=71938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 24 16:49:28.233886 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b2b33ec-c46f-4061-91b2-b4dde7f997e8 admin admin] PATH_INFO: `/v3/users/54f2c261a6514fa48b46f57a5e6cdce3` {{(pid=71938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 24 16:49:28.237638 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b2b33ec-c46f-4061-91b2-b4dde7f997e8 admin admin] RBAC: Authorizing `identity:delete_user(user_id=54f2c261a6514fa48b46f57a5e6cdce3)` {{(pid=71938) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:442}} Nov 24 16:49:28.249429 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0994d24-923f-4f89-a518-777ffeeade5f admin admin] RBAC: Authorization granted {{(pid=71939) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 24 16:49:28.298191 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b2b33ec-c46f-4061-91b2-b4dde7f997e8 admin admin] RBAC: Authorization granted {{(pid=71938) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 24 16:49:28.306117 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.notifications [None req-e0994d24-923f-4f89-a518-777ffeeade5f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '6c9b3d7e6d0f47178c70c3afca862a8f'} {{(pid=71939) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:357}} Nov 24 16:49:28.319986 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.notifications [None req-e0994d24-923f-4f89-a518-777ffeeade5f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '6c9b3d7e6d0f47178c70c3afca862a8f'} {{(pid=71939) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:357}} Nov 24 16:49:28.320749 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.notifications [None req-e0994d24-923f-4f89-a518-777ffeeade5f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '6c9b3d7e6d0f47178c70c3afca862a8f'} {{(pid=71939) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:357}} Nov 24 16:49:28.331885 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.notifications [None req-e0994d24-923f-4f89-a518-777ffeeade5f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '6c9b3d7e6d0f47178c70c3afca862a8f'} {{(pid=71939) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:357}} Nov 24 16:49:28.339018 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.notifications [None req-e0994d24-923f-4f89-a518-777ffeeade5f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '6c9b3d7e6d0f47178c70c3afca862a8f'} {{(pid=71939) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:357}} Nov 24 16:49:28.345869 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: [pid: 71939|app: 0|req: 1088/2163] 10.222.0.53 () {58 vars in 1214 bytes} [Wed Nov 24 16:49:28 2021] DELETE /identity/v3/users/6c9b3d7e6d0f47178c70c3afca862a8f => generated 0 bytes in 167 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 24 16:49:28.347345 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf9c9d97-b5ae-4a74-b668-1652c266ac1d None None] REQUEST_METHOD: `POST` {{(pid=71939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 24 16:49:28.347666 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf9c9d97-b5ae-4a74-b668-1652c266ac1d None None] SCRIPT_NAME: `/identity` {{(pid=71939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 24 16:49:28.348005 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf9c9d97-b5ae-4a74-b668-1652c266ac1d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=71939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 24 16:49:28.361490 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.notifications [None req-3b2b33ec-c46f-4061-91b2-b4dde7f997e8 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '54f2c261a6514fa48b46f57a5e6cdce3'} {{(pid=71938) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:357}} Nov 24 16:49:28.373404 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.auth.core [None req-cf9c9d97-b5ae-4a74-b668-1652c266ac1d None None] MFA Rules not processed for user `0f2ba2e8375b4e8c8792ee1e22b60427`. Rule list: `[]` (Enabled: `True`). {{(pid=71939) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:442}} Nov 24 16:49:28.374673 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.fernet_utils [None req-cf9c9d97-b5ae-4a74-b668-1652c266ac1d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=71939) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:289}} Nov 24 16:49:28.381743 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.notifications [None req-3b2b33ec-c46f-4061-91b2-b4dde7f997e8 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '54f2c261a6514fa48b46f57a5e6cdce3'} {{(pid=71938) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:357}} Nov 24 16:49:28.382812 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.notifications [None req-3b2b33ec-c46f-4061-91b2-b4dde7f997e8 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '54f2c261a6514fa48b46f57a5e6cdce3'} {{(pid=71938) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:357}} Nov 24 16:49:28.394509 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.notifications [None req-3b2b33ec-c46f-4061-91b2-b4dde7f997e8 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '54f2c261a6514fa48b46f57a5e6cdce3'} {{(pid=71938) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:357}} Nov 24 16:49:28.402484 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.notifications [None req-3b2b33ec-c46f-4061-91b2-b4dde7f997e8 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '54f2c261a6514fa48b46f57a5e6cdce3'} {{(pid=71938) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:357}} Nov 24 16:49:28.412848 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: [pid: 71938|app: 0|req: 1076/2164] 10.222.0.53 () {58 vars in 1214 bytes} [Wed Nov 24 16:49:28 2021] DELETE /identity/v3/users/54f2c261a6514fa48b46f57a5e6cdce3 => generated 0 bytes in 322 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 24 16:49:28.417844 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5192217-8d99-407b-946c-917b0c3ed185 None None] REQUEST_METHOD: `POST` {{(pid=71938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 24 16:49:28.418251 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5192217-8d99-407b-946c-917b0c3ed185 None None] SCRIPT_NAME: `/identity` {{(pid=71938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 24 16:49:28.418587 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5192217-8d99-407b-946c-917b0c3ed185 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=71938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 24 16:49:28.445660 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.auth.core [None req-a5192217-8d99-407b-946c-917b0c3ed185 None None] MFA Rules not processed for user `0f2ba2e8375b4e8c8792ee1e22b60427`. Rule list: `[]` (Enabled: `True`). {{(pid=71938) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:442}} Nov 24 16:49:28.447262 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.fernet_utils [None req-a5192217-8d99-407b-946c-917b0c3ed185 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=71938) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:289}} Nov 24 16:49:28.458930 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: [pid: 71939|app: 0|req: 1089/2165] 10.222.0.53 () {58 vars in 948 bytes} [Wed Nov 24 16:49:28 2021] POST /identity/v3/auth/tokens => generated 3669 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 24 16:49:28.465379 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf9c9d97-b5ae-4a74-b668-1652c266ac1d None None] Authenticating user token {{(pid=71939) process_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 24 16:49:28.477900 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf9c9d97-b5ae-4a74-b668-1652c266ac1d None None] Validating token access rules against request {{(pid=71939) validate_allowed_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 24 16:49:28.557267 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: [pid: 71938|app: 0|req: 1077/2166] 10.222.0.53 () {58 vars in 948 bytes} [Wed Nov 24 16:49:28 2021] POST /identity/v3/auth/tokens => generated 3669 bytes in 141 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 24 16:49:28.562003 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57d0615f-9bca-4ea7-99cf-856f9b718289 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f2ba2e8375b4e8c8792ee1e22b60427', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '00a5583c7b7443e98e7a1d31a0b638dc', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=71939) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 24 16:49:28.562711 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57d0615f-9bca-4ea7-99cf-856f9b718289 admin admin] REQUEST_METHOD: `GET` {{(pid=71939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 24 16:49:28.563189 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57d0615f-9bca-4ea7-99cf-856f9b718289 admin admin] SCRIPT_NAME: `/identity` {{(pid=71939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 24 16:49:28.563523 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57d0615f-9bca-4ea7-99cf-856f9b718289 admin admin] PATH_INFO: `/v3/domains` {{(pid=71939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 24 16:49:28.564913 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5192217-8d99-407b-946c-917b0c3ed185 None None] Authenticating user token {{(pid=71938) process_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 24 16:49:28.567292 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.fernet_utils [None req-a5192217-8d99-407b-946c-917b0c3ed185 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=71938) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:289}} Nov 24 16:49:28.574947 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57d0615f-9bca-4ea7-99cf-856f9b718289 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=71939) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:161}} Nov 24 16:49:28.575524 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57d0615f-9bca-4ea7-99cf-856f9b718289 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=71939) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:442}} Nov 24 16:49:28.615461 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57d0615f-9bca-4ea7-99cf-856f9b718289 admin admin] RBAC: Authorization granted {{(pid=71939) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 24 16:49:28.629838 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: [pid: 71939|app: 0|req: 1090/2167] 10.222.0.53 () {58 vars in 1143 bytes} [Wed Nov 24 16:49:28 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Nov 24 16:49:28.635765 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57d0615f-9bca-4ea7-99cf-856f9b718289 admin admin] Authenticating user token {{(pid=71939) process_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 24 16:49:28.646370 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57d0615f-9bca-4ea7-99cf-856f9b718289 admin admin] Validating token access rules against request {{(pid=71939) validate_allowed_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 24 16:49:28.647074 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5192217-8d99-407b-946c-917b0c3ed185 None None] Validating token access rules against request {{(pid=71938) validate_allowed_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 24 16:49:28.651273 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6efdc67-7592-47d1-b44f-ec35bd19fcb0 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c90f21b9cdcb413282461fa83cb6b7a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3b3940d4ae1c4177ae29c02377bb4b0b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=71938) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 24 16:49:28.651941 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6efdc67-7592-47d1-b44f-ec35bd19fcb0 service neutron] REQUEST_METHOD: `GET` {{(pid=71938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 24 16:49:28.652278 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6efdc67-7592-47d1-b44f-ec35bd19fcb0 service neutron] SCRIPT_NAME: `/identity` {{(pid=71938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 24 16:49:28.652607 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6efdc67-7592-47d1-b44f-ec35bd19fcb0 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=71938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 24 16:49:28.653291 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d90d20d-9cc4-4b2a-827a-5e7d7f520151 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f2ba2e8375b4e8c8792ee1e22b60427', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '00a5583c7b7443e98e7a1d31a0b638dc', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=71939) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 24 16:49:28.654223 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d90d20d-9cc4-4b2a-827a-5e7d7f520151 admin admin] REQUEST_METHOD: `POST` {{(pid=71939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 24 16:49:28.654891 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d90d20d-9cc4-4b2a-827a-5e7d7f520151 admin admin] SCRIPT_NAME: `/identity` {{(pid=71939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 24 16:49:28.655554 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d90d20d-9cc4-4b2a-827a-5e7d7f520151 admin admin] PATH_INFO: `/v3/projects` {{(pid=71939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 24 16:49:28.656667 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d90d20d-9cc4-4b2a-827a-5e7d7f520151 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=71939) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:442}} Nov 24 16:49:28.665101 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6efdc67-7592-47d1-b44f-ec35bd19fcb0 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=71938) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:442}} Nov 24 16:49:28.706930 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6efdc67-7592-47d1-b44f-ec35bd19fcb0 service neutron] RBAC: Authorization granted {{(pid=71938) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 24 16:49:28.709935 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d90d20d-9cc4-4b2a-827a-5e7d7f520151 admin admin] RBAC: Authorization granted {{(pid=71939) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 24 16:49:28.726912 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: [pid: 71938|app: 0|req: 1078/2168] 10.222.0.53 () {60 vars in 1356 bytes} [Wed Nov 24 16:49:28 2021] GET /identity/v3/auth/tokens => generated 3669 bytes in 162 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 24 16:49:28.744027 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: [pid: 71939|app: 0|req: 1091/2169] 10.222.0.53 () {60 vars in 1143 bytes} [Wed Nov 24 16:49:28 2021] POST /identity/v3/projects => generated 383 bytes in 109 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Nov 24 16:49:28.748561 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6efdc67-7592-47d1-b44f-ec35bd19fcb0 service neutron] Authenticating user token {{(pid=71938) process_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 24 16:49:28.759727 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6efdc67-7592-47d1-b44f-ec35bd19fcb0 service neutron] Validating token access rules against request {{(pid=71938) validate_allowed_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 24 16:49:28.839384 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-787421e6-64df-4789-8879-62e5850a411c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f2ba2e8375b4e8c8792ee1e22b60427', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '00a5583c7b7443e98e7a1d31a0b638dc', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=71938) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 24 16:49:28.840377 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-787421e6-64df-4789-8879-62e5850a411c admin admin] REQUEST_METHOD: `POST` {{(pid=71938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 24 16:49:28.840566 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-787421e6-64df-4789-8879-62e5850a411c admin admin] SCRIPT_NAME: `/identity` {{(pid=71938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 24 16:49:28.840869 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-787421e6-64df-4789-8879-62e5850a411c admin admin] PATH_INFO: `/v3/users` {{(pid=71938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 24 16:49:28.841897 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-787421e6-64df-4789-8879-62e5850a411c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=71938) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:442}} Nov 24 16:49:28.872661 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-787421e6-64df-4789-8879-62e5850a411c admin admin] RBAC: Authorization granted {{(pid=71938) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 24 16:49:28.903933 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: [pid: 71938|app: 0|req: 1079/2170] 10.222.0.53 () {60 vars in 1134 bytes} [Wed Nov 24 16:49:28 2021] POST /identity/v3/users => generated 292 bytes in 156 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Nov 24 16:49:28.908760 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d90d20d-9cc4-4b2a-827a-5e7d7f520151 admin admin] Authenticating user token {{(pid=71939) process_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 24 16:49:28.922663 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d90d20d-9cc4-4b2a-827a-5e7d7f520151 admin admin] Validating token access rules against request {{(pid=71939) validate_allowed_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 24 16:49:28.928887 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08e9ba06-c1c2-482a-839d-662b58301408 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f2ba2e8375b4e8c8792ee1e22b60427', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '00a5583c7b7443e98e7a1d31a0b638dc', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=71939) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 24 16:49:28.929866 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08e9ba06-c1c2-482a-839d-662b58301408 admin admin] REQUEST_METHOD: `GET` {{(pid=71939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 24 16:49:28.930396 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08e9ba06-c1c2-482a-839d-662b58301408 admin admin] SCRIPT_NAME: `/identity` {{(pid=71939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 24 16:49:28.930738 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08e9ba06-c1c2-482a-839d-662b58301408 admin admin] PATH_INFO: `/v3/roles` {{(pid=71939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 24 16:49:28.931570 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08e9ba06-c1c2-482a-839d-662b58301408 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=71939) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:442}} Nov 24 16:49:28.957943 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-787421e6-64df-4789-8879-62e5850a411c admin admin] Authenticating user token {{(pid=71938) process_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 24 16:49:28.959910 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.fernet_utils [None req-787421e6-64df-4789-8879-62e5850a411c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=71938) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:289}} Nov 24 16:49:28.980621 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-787421e6-64df-4789-8879-62e5850a411c admin admin] Validating token access rules against request {{(pid=71938) validate_allowed_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 24 16:49:28.983927 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08e9ba06-c1c2-482a-839d-662b58301408 admin admin] RBAC: Authorization granted {{(pid=71939) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 24 16:49:28.992754 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be594145-936f-4201-aa7a-53b97d5026f1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f2ba2e8375b4e8c8792ee1e22b60427', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '00a5583c7b7443e98e7a1d31a0b638dc', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=71938) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 24 16:49:28.993670 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be594145-936f-4201-aa7a-53b97d5026f1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=71938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 24 16:49:28.994011 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be594145-936f-4201-aa7a-53b97d5026f1 admin admin] SCRIPT_NAME: `/identity` {{(pid=71938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 24 16:49:28.994384 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be594145-936f-4201-aa7a-53b97d5026f1 admin admin] PATH_INFO: `/v3/projects/f75bad61be644558816b3e5d145f39f2` {{(pid=71938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 24 16:49:28.996146 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be594145-936f-4201-aa7a-53b97d5026f1 admin admin] RBAC: Authorizing `identity:delete_project(project_id=f75bad61be644558816b3e5d145f39f2)` {{(pid=71938) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:442}} Nov 24 16:49:28.998569 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: [pid: 71939|app: 0|req: 1092/2171] 10.222.0.53 () {58 vars in 1112 bytes} [Wed Nov 24 16:49:28 2021] GET /identity/v3/roles => generated 1420 bytes in 91 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 24 16:49:29.003701 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08e9ba06-c1c2-482a-839d-662b58301408 admin admin] Authenticating user token {{(pid=71939) process_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 24 16:49:29.017594 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08e9ba06-c1c2-482a-839d-662b58301408 admin admin] Validating token access rules against request {{(pid=71939) validate_allowed_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 24 16:49:29.026606 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-281394a9-38b5-4f5e-b2ab-236dd3be4261 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f2ba2e8375b4e8c8792ee1e22b60427', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '00a5583c7b7443e98e7a1d31a0b638dc', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=71939) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 24 16:49:29.027537 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-281394a9-38b5-4f5e-b2ab-236dd3be4261 admin admin] REQUEST_METHOD: `PUT` {{(pid=71939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 24 16:49:29.027876 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-281394a9-38b5-4f5e-b2ab-236dd3be4261 admin admin] SCRIPT_NAME: `/identity` {{(pid=71939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 24 16:49:29.028211 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-281394a9-38b5-4f5e-b2ab-236dd3be4261 admin admin] PATH_INFO: `/v3/projects/a34ead64635c4a65bf1cc393f4bb6757/users/6a69bc513f44453a967928902f9b23f9/roles/912ab5f10fa5477da74acf239f07604e` {{(pid=71939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 24 16:49:29.046063 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be594145-936f-4201-aa7a-53b97d5026f1 admin admin] RBAC: Authorization granted {{(pid=71938) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 24 16:49:29.062251 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-281394a9-38b5-4f5e-b2ab-236dd3be4261 admin admin] RBAC: Authorizing `identity:create_grant(project_id=a34ead64635c4a65bf1cc393f4bb6757, user_id=6a69bc513f44453a967928902f9b23f9, role_id=912ab5f10fa5477da74acf239f07604e)` {{(pid=71939) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:442}} Nov 24 16:49:29.101752 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-281394a9-38b5-4f5e-b2ab-236dd3be4261 admin admin] RBAC: Authorization granted {{(pid=71939) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 24 16:49:29.119845 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: [pid: 71939|app: 0|req: 1093/2172] 10.222.0.53 () {60 vars in 1473 bytes} [Wed Nov 24 16:49:29 2021] PUT /identity/v3/projects/a34ead64635c4a65bf1cc393f4bb6757/users/6a69bc513f44453a967928902f9b23f9/roles/912ab5f10fa5477da74acf239f07604e => generated 0 bytes in 117 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 24 16:49:29.132033 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49196c27-d4e7-46f1-a19c-57d84cd431d5 None None] REQUEST_METHOD: `POST` {{(pid=71939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 24 16:49:29.132382 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49196c27-d4e7-46f1-a19c-57d84cd431d5 None None] SCRIPT_NAME: `/identity` {{(pid=71939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 24 16:49:29.132726 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49196c27-d4e7-46f1-a19c-57d84cd431d5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=71939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 24 16:49:29.158996 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.notifications [None req-be594145-936f-4201-aa7a-53b97d5026f1 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f75bad61be644558816b3e5d145f39f2', 'request_id': 'req-be594145-936f-4201-aa7a-53b97d5026f1'} {{(pid=71938) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:357}} Nov 24 16:49:29.201723 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.notifications [None req-be594145-936f-4201-aa7a-53b97d5026f1 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f75bad61be644558816b3e5d145f39f2', 'request_id': 'req-be594145-936f-4201-aa7a-53b97d5026f1'} {{(pid=71938) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:357}} Nov 24 16:49:29.208062 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.auth.core [None req-49196c27-d4e7-46f1-a19c-57d84cd431d5 None None] MFA Rules not processed for user `6a69bc513f44453a967928902f9b23f9`. Rule list: `[]` (Enabled: `True`). {{(pid=71939) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:442}} Nov 24 16:49:29.209857 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.fernet_utils [None req-49196c27-d4e7-46f1-a19c-57d84cd431d5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=71939) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:289}} Nov 24 16:49:29.212011 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.notifications [None req-be594145-936f-4201-aa7a-53b97d5026f1 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f75bad61be644558816b3e5d145f39f2', 'request_id': 'req-be594145-936f-4201-aa7a-53b97d5026f1'} {{(pid=71938) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:357}} Nov 24 16:49:29.232896 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.notifications [None req-be594145-936f-4201-aa7a-53b97d5026f1 admin admin] The token cache is being invalidate because project f75bad61be644558816b3e5d145f39f2 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=71938) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Nov 24 16:49:29.233225 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.notifications [None req-be594145-936f-4201-aa7a-53b97d5026f1 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=71938) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:357}} Nov 24 16:49:29.241855 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.notifications [None req-be594145-936f-4201-aa7a-53b97d5026f1 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=71938) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:357}} Nov 24 16:49:29.247811 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: [pid: 71938|app: 0|req: 1080/2173] 10.222.0.53 () {58 vars in 1223 bytes} [Wed Nov 24 16:49:28 2021] DELETE /identity/v3/projects/f75bad61be644558816b3e5d145f39f2 => generated 0 bytes in 286 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 24 16:49:29.250078 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9083a396-955b-4d3b-98e8-c178d532019c None None] REQUEST_METHOD: `POST` {{(pid=71938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 24 16:49:29.250516 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9083a396-955b-4d3b-98e8-c178d532019c None None] SCRIPT_NAME: `/identity` {{(pid=71938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 24 16:49:29.251146 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9083a396-955b-4d3b-98e8-c178d532019c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=71938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 24 16:49:29.317059 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.auth.core [None req-9083a396-955b-4d3b-98e8-c178d532019c None None] MFA Rules not processed for user `0f2ba2e8375b4e8c8792ee1e22b60427`. Rule list: `[]` (Enabled: `True`). {{(pid=71938) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:442}} Nov 24 16:49:29.323102 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.fernet_utils [None req-9083a396-955b-4d3b-98e8-c178d532019c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=71938) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:289}} Nov 24 16:49:29.327630 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: [pid: 71939|app: 0|req: 1094/2174] 10.222.0.53 () {58 vars in 948 bytes} [Wed Nov 24 16:49:29 2021] POST /identity/v3/auth/tokens => generated 3690 bytes in 197 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 24 16:49:29.332795 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49196c27-d4e7-46f1-a19c-57d84cd431d5 None None] Authenticating user token {{(pid=71939) process_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 24 16:49:29.336098 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.fernet_utils [None req-49196c27-d4e7-46f1-a19c-57d84cd431d5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=71939) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:289}} Nov 24 16:49:29.432643 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: [pid: 71938|app: 0|req: 1081/2175] 10.222.0.53 () {58 vars in 948 bytes} [Wed Nov 24 16:49:29 2021] POST /identity/v3/auth/tokens => generated 3669 bytes in 182 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Nov 24 16:49:29.438060 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49196c27-d4e7-46f1-a19c-57d84cd431d5 None None] Validating token access rules against request {{(pid=71939) validate_allowed_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 24 16:49:29.439579 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b088d0fc-2a53-4068-9909-983147acd594 None None] REQUEST_METHOD: `POST` {{(pid=71938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 24 16:49:29.439928 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b088d0fc-2a53-4068-9909-983147acd594 None None] SCRIPT_NAME: `/identity` {{(pid=71938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 24 16:49:29.440266 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b088d0fc-2a53-4068-9909-983147acd594 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=71938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 24 16:49:29.457122 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c7229ce-7f0a-405a-bc24-244fe49cb8fa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f2ba2e8375b4e8c8792ee1e22b60427', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '00a5583c7b7443e98e7a1d31a0b638dc', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=71939) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 24 16:49:29.457805 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c7229ce-7f0a-405a-bc24-244fe49cb8fa admin admin] REQUEST_METHOD: `POST` {{(pid=71939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 24 16:49:29.458189 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c7229ce-7f0a-405a-bc24-244fe49cb8fa admin admin] SCRIPT_NAME: `/identity` {{(pid=71939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 24 16:49:29.458527 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c7229ce-7f0a-405a-bc24-244fe49cb8fa admin admin] PATH_INFO: `/v3/projects` {{(pid=71939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 24 16:49:29.459843 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c7229ce-7f0a-405a-bc24-244fe49cb8fa admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=71939) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:442}} Nov 24 16:49:29.487111 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.auth.core [None req-b088d0fc-2a53-4068-9909-983147acd594 None None] MFA Rules not processed for user `0f2ba2e8375b4e8c8792ee1e22b60427`. Rule list: `[]` (Enabled: `True`). {{(pid=71938) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:442}} Nov 24 16:49:29.496999 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.fernet_utils [None req-b088d0fc-2a53-4068-9909-983147acd594 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=71938) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:289}} Nov 24 16:49:29.503597 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c7229ce-7f0a-405a-bc24-244fe49cb8fa admin admin] RBAC: Authorization granted {{(pid=71939) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 24 16:49:29.511705 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: [pid: 71938|app: 0|req: 1082/2176] 10.222.0.53 () {58 vars in 948 bytes} [Wed Nov 24 16:49:29 2021] POST /identity/v3/auth/tokens => generated 3669 bytes in 73 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 24 16:49:29.516156 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b088d0fc-2a53-4068-9909-983147acd594 None None] Authenticating user token {{(pid=71938) process_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 24 16:49:29.529413 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b088d0fc-2a53-4068-9909-983147acd594 None None] Validating token access rules against request {{(pid=71938) validate_allowed_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 24 16:49:29.534801 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b60fcd8-dc6f-4af0-929a-f583bc5b0973 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f2ba2e8375b4e8c8792ee1e22b60427', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '00a5583c7b7443e98e7a1d31a0b638dc', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=71938) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 24 16:49:29.535723 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b60fcd8-dc6f-4af0-929a-f583bc5b0973 admin admin] REQUEST_METHOD: `GET` {{(pid=71938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 24 16:49:29.536224 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b60fcd8-dc6f-4af0-929a-f583bc5b0973 admin admin] SCRIPT_NAME: `/identity` {{(pid=71938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 24 16:49:29.536658 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b60fcd8-dc6f-4af0-929a-f583bc5b0973 admin admin] PATH_INFO: `/v3/domains` {{(pid=71938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 24 16:49:29.537490 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b60fcd8-dc6f-4af0-929a-f583bc5b0973 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=71938) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:161}} Nov 24 16:49:29.537849 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b60fcd8-dc6f-4af0-929a-f583bc5b0973 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=71938) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:442}} Nov 24 16:49:29.540691 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: [pid: 71939|app: 0|req: 1095/2177] 10.222.0.53 () {60 vars in 1143 bytes} [Wed Nov 24 16:49:29 2021] POST /identity/v3/projects => generated 385 bytes in 208 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 24 16:49:29.544536 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c7229ce-7f0a-405a-bc24-244fe49cb8fa admin admin] Authenticating user token {{(pid=71939) process_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 24 16:49:29.576522 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b60fcd8-dc6f-4af0-929a-f583bc5b0973 admin admin] RBAC: Authorization granted {{(pid=71938) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 24 16:49:29.619915 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: [pid: 71938|app: 0|req: 1083/2178] 10.222.0.53 () {58 vars in 1143 bytes} [Wed Nov 24 16:49:29 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 104 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Nov 24 16:49:29.620864 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b60fcd8-dc6f-4af0-929a-f583bc5b0973 admin admin] Authenticating user token {{(pid=71938) process_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 24 16:49:29.628667 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.fernet_utils [None req-4b60fcd8-dc6f-4af0-929a-f583bc5b0973 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=71938) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:289}} Nov 24 16:49:29.655246 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b60fcd8-dc6f-4af0-929a-f583bc5b0973 admin admin] Validating token access rules against request {{(pid=71938) validate_allowed_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 24 16:49:29.695243 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c7229ce-7f0a-405a-bc24-244fe49cb8fa admin admin] Validating token access rules against request {{(pid=71939) validate_allowed_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 24 16:49:29.700885 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c159ff6-5266-4cf4-af2a-e1d61c965bca admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f2ba2e8375b4e8c8792ee1e22b60427', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '00a5583c7b7443e98e7a1d31a0b638dc', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=71939) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 24 16:49:29.701841 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c159ff6-5266-4cf4-af2a-e1d61c965bca admin admin] REQUEST_METHOD: `POST` {{(pid=71939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 24 16:49:29.702212 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c159ff6-5266-4cf4-af2a-e1d61c965bca admin admin] SCRIPT_NAME: `/identity` {{(pid=71939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 24 16:49:29.702545 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c159ff6-5266-4cf4-af2a-e1d61c965bca admin admin] PATH_INFO: `/v3/users` {{(pid=71939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 24 16:49:29.703426 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c159ff6-5266-4cf4-af2a-e1d61c965bca admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=71939) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:442}} Nov 24 16:49:29.734824 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c159ff6-5266-4cf4-af2a-e1d61c965bca admin admin] RBAC: Authorization granted {{(pid=71939) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 24 16:49:29.759076 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: [pid: 71939|app: 0|req: 1096/2179] 10.222.0.53 () {60 vars in 1134 bytes} [Wed Nov 24 16:49:29 2021] POST /identity/v3/users => generated 299 bytes in 215 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 24 16:49:29.760188 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c159ff6-5266-4cf4-af2a-e1d61c965bca admin admin] Authenticating user token {{(pid=71939) process_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 24 16:49:29.762708 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29743d4b-8f72-4958-9c25-d93f0c1cbc08 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f2ba2e8375b4e8c8792ee1e22b60427', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '00a5583c7b7443e98e7a1d31a0b638dc', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=71938) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 24 16:49:29.764101 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29743d4b-8f72-4958-9c25-d93f0c1cbc08 admin admin] REQUEST_METHOD: `DELETE` {{(pid=71938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 24 16:49:29.764628 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29743d4b-8f72-4958-9c25-d93f0c1cbc08 admin admin] SCRIPT_NAME: `/identity` {{(pid=71938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 24 16:49:29.764966 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29743d4b-8f72-4958-9c25-d93f0c1cbc08 admin admin] PATH_INFO: `/v3/projects/985cd89c35a1425baa816d1ac0902c65` {{(pid=71938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 24 16:49:29.766306 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29743d4b-8f72-4958-9c25-d93f0c1cbc08 admin admin] RBAC: Authorizing `identity:delete_project(project_id=985cd89c35a1425baa816d1ac0902c65)` {{(pid=71938) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:442}} Nov 24 16:49:29.771124 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c159ff6-5266-4cf4-af2a-e1d61c965bca admin admin] Validating token access rules against request {{(pid=71939) validate_allowed_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 24 16:49:29.775964 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ded17f7d-9eca-48e8-988f-cdd473f033f6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f2ba2e8375b4e8c8792ee1e22b60427', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '00a5583c7b7443e98e7a1d31a0b638dc', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=71939) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 24 16:49:29.776634 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ded17f7d-9eca-48e8-988f-cdd473f033f6 admin admin] REQUEST_METHOD: `POST` {{(pid=71939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 24 16:49:29.776980 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ded17f7d-9eca-48e8-988f-cdd473f033f6 admin admin] SCRIPT_NAME: `/identity` {{(pid=71939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 24 16:49:29.777316 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ded17f7d-9eca-48e8-988f-cdd473f033f6 admin admin] PATH_INFO: `/v3/projects` {{(pid=71939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 24 16:49:29.778094 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ded17f7d-9eca-48e8-988f-cdd473f033f6 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=71939) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:442}} Nov 24 16:49:29.798948 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29743d4b-8f72-4958-9c25-d93f0c1cbc08 admin admin] RBAC: Authorization granted {{(pid=71938) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 24 16:49:29.808710 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ded17f7d-9eca-48e8-988f-cdd473f033f6 admin admin] RBAC: Authorization granted {{(pid=71939) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 24 16:49:29.837084 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: [pid: 71939|app: 0|req: 1097/2180] 10.222.0.53 () {60 vars in 1143 bytes} [Wed Nov 24 16:49:29 2021] POST /identity/v3/projects => generated 383 bytes in 78 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 24 16:49:29.837984 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ded17f7d-9eca-48e8-988f-cdd473f033f6 admin admin] Authenticating user token {{(pid=71939) process_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 24 16:49:29.859672 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.notifications [None req-29743d4b-8f72-4958-9c25-d93f0c1cbc08 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '985cd89c35a1425baa816d1ac0902c65', 'request_id': 'req-29743d4b-8f72-4958-9c25-d93f0c1cbc08'} {{(pid=71938) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:357}} Nov 24 16:49:29.872586 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.notifications [None req-29743d4b-8f72-4958-9c25-d93f0c1cbc08 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '985cd89c35a1425baa816d1ac0902c65', 'request_id': 'req-29743d4b-8f72-4958-9c25-d93f0c1cbc08'} {{(pid=71938) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:357}} Nov 24 16:49:29.879542 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.notifications [None req-29743d4b-8f72-4958-9c25-d93f0c1cbc08 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '985cd89c35a1425baa816d1ac0902c65', 'request_id': 'req-29743d4b-8f72-4958-9c25-d93f0c1cbc08'} {{(pid=71938) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:357}} Nov 24 16:49:29.892693 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.notifications [None req-29743d4b-8f72-4958-9c25-d93f0c1cbc08 admin admin] The token cache is being invalidate because project 985cd89c35a1425baa816d1ac0902c65 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=71938) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Nov 24 16:49:29.893020 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.notifications [None req-29743d4b-8f72-4958-9c25-d93f0c1cbc08 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=71938) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:357}} Nov 24 16:49:29.893702 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.notifications [None req-29743d4b-8f72-4958-9c25-d93f0c1cbc08 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=71938) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:357}} Nov 24 16:49:29.895597 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: [pid: 71938|app: 0|req: 1084/2181] 10.222.0.53 () {58 vars in 1223 bytes} [Wed Nov 24 16:49:29 2021] DELETE /identity/v3/projects/985cd89c35a1425baa816d1ac0902c65 => generated 0 bytes in 275 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 24 16:49:29.896147 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29743d4b-8f72-4958-9c25-d93f0c1cbc08 admin admin] Authenticating user token {{(pid=71938) process_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 24 16:49:29.898069 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.fernet_utils [None req-29743d4b-8f72-4958-9c25-d93f0c1cbc08 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=71938) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:289}} Nov 24 16:49:29.921834 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ded17f7d-9eca-48e8-988f-cdd473f033f6 admin admin] Validating token access rules against request {{(pid=71939) validate_allowed_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 24 16:49:29.978665 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29743d4b-8f72-4958-9c25-d93f0c1cbc08 admin admin] Validating token access rules against request {{(pid=71938) validate_allowed_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 24 16:49:29.984457 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23c64123-6027-45cc-a0da-29b499621474 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f2ba2e8375b4e8c8792ee1e22b60427', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '00a5583c7b7443e98e7a1d31a0b638dc', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=71938) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 24 16:49:29.985150 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23c64123-6027-45cc-a0da-29b499621474 admin admin] REQUEST_METHOD: `POST` {{(pid=71938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 24 16:49:29.985607 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23c64123-6027-45cc-a0da-29b499621474 admin admin] SCRIPT_NAME: `/identity` {{(pid=71938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 24 16:49:29.985818 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23c64123-6027-45cc-a0da-29b499621474 admin admin] PATH_INFO: `/v3/users` {{(pid=71938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 24 16:49:29.986577 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23c64123-6027-45cc-a0da-29b499621474 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=71938) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:442}} Nov 24 16:49:30.001876 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ded68a08-ec58-4e17-8994-dbe8c65eb1f6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f2ba2e8375b4e8c8792ee1e22b60427', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '00a5583c7b7443e98e7a1d31a0b638dc', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=71939) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 24 16:49:30.003040 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ded68a08-ec58-4e17-8994-dbe8c65eb1f6 admin admin] REQUEST_METHOD: `GET` {{(pid=71939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 24 16:49:30.003537 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ded68a08-ec58-4e17-8994-dbe8c65eb1f6 admin admin] SCRIPT_NAME: `/identity` {{(pid=71939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 24 16:49:30.004510 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ded68a08-ec58-4e17-8994-dbe8c65eb1f6 admin admin] PATH_INFO: `/v3/roles` {{(pid=71939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 24 16:49:30.006569 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ded68a08-ec58-4e17-8994-dbe8c65eb1f6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=71939) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:442}} Nov 24 16:49:30.017392 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23c64123-6027-45cc-a0da-29b499621474 admin admin] RBAC: Authorization granted {{(pid=71938) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 24 16:49:30.040730 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: [pid: 71938|app: 0|req: 1085/2182] 10.222.0.53 () {60 vars in 1134 bytes} [Wed Nov 24 16:49:29 2021] POST /identity/v3/users => generated 292 bytes in 142 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 24 16:49:30.040730 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23c64123-6027-45cc-a0da-29b499621474 admin admin] Authenticating user token {{(pid=71938) process_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 24 16:49:30.040958 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ded68a08-ec58-4e17-8994-dbe8c65eb1f6 admin admin] RBAC: Authorization granted {{(pid=71939) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 24 16:49:30.041033 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.fernet_utils [None req-23c64123-6027-45cc-a0da-29b499621474 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=71938) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:289}} Nov 24 16:49:30.052010 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: [pid: 71939|app: 0|req: 1098/2183] 10.222.0.53 () {58 vars in 1112 bytes} [Wed Nov 24 16:49:29 2021] GET /identity/v3/roles => generated 1420 bytes in 214 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 24 16:49:30.052183 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ded68a08-ec58-4e17-8994-dbe8c65eb1f6 admin admin] Authenticating user token {{(pid=71939) process_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 24 16:49:30.053866 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23c64123-6027-45cc-a0da-29b499621474 admin admin] Validating token access rules against request {{(pid=71938) validate_allowed_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 24 16:49:30.058451 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c867c981-3d19-4787-976d-70d8e437d2ba admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f2ba2e8375b4e8c8792ee1e22b60427', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '00a5583c7b7443e98e7a1d31a0b638dc', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=71938) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 24 16:49:30.059366 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c867c981-3d19-4787-976d-70d8e437d2ba admin admin] REQUEST_METHOD: `DELETE` {{(pid=71938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 24 16:49:30.059685 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c867c981-3d19-4787-976d-70d8e437d2ba admin admin] SCRIPT_NAME: `/identity` {{(pid=71938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 24 16:49:30.060015 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c867c981-3d19-4787-976d-70d8e437d2ba admin admin] PATH_INFO: `/v3/users/4a1cc2b42a5540a3a7449b7dea5c563b` {{(pid=71938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 24 16:49:30.061542 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c867c981-3d19-4787-976d-70d8e437d2ba admin admin] RBAC: Authorizing `identity:delete_user(user_id=4a1cc2b42a5540a3a7449b7dea5c563b)` {{(pid=71938) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:442}} Nov 24 16:49:30.064504 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ded68a08-ec58-4e17-8994-dbe8c65eb1f6 admin admin] Validating token access rules against request {{(pid=71939) validate_allowed_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 24 16:49:30.086959 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41b7fb22-bcea-4508-95a9-cfc63f2db345 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f2ba2e8375b4e8c8792ee1e22b60427', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '00a5583c7b7443e98e7a1d31a0b638dc', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=71939) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 24 16:49:30.086959 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41b7fb22-bcea-4508-95a9-cfc63f2db345 admin admin] REQUEST_METHOD: `GET` {{(pid=71939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 24 16:49:30.086959 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41b7fb22-bcea-4508-95a9-cfc63f2db345 admin admin] SCRIPT_NAME: `/identity` {{(pid=71939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 24 16:49:30.087226 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41b7fb22-bcea-4508-95a9-cfc63f2db345 admin admin] PATH_INFO: `/v3/roles` {{(pid=71939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 24 16:49:30.087853 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41b7fb22-bcea-4508-95a9-cfc63f2db345 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=71939) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:442}} Nov 24 16:49:30.093754 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c867c981-3d19-4787-976d-70d8e437d2ba admin admin] RBAC: Authorization granted {{(pid=71938) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 24 16:49:30.117121 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41b7fb22-bcea-4508-95a9-cfc63f2db345 admin admin] RBAC: Authorization granted {{(pid=71939) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 24 16:49:30.132133 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: [pid: 71939|app: 0|req: 1099/2184] 10.222.0.53 () {58 vars in 1112 bytes} [Wed Nov 24 16:49:30 2021] GET /identity/v3/roles => generated 1420 bytes in 80 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 24 16:49:30.134109 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41b7fb22-bcea-4508-95a9-cfc63f2db345 admin admin] Authenticating user token {{(pid=71939) process_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 24 16:49:30.140134 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.fernet_utils [None req-41b7fb22-bcea-4508-95a9-cfc63f2db345 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=71939) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:289}} Nov 24 16:49:30.155481 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41b7fb22-bcea-4508-95a9-cfc63f2db345 admin admin] Validating token access rules against request {{(pid=71939) validate_allowed_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 24 16:49:30.159755 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.notifications [None req-c867c981-3d19-4787-976d-70d8e437d2ba admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '4a1cc2b42a5540a3a7449b7dea5c563b'} {{(pid=71938) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:357}} Nov 24 16:49:30.160281 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2982682f-9106-40e0-af91-926d035b63c3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f2ba2e8375b4e8c8792ee1e22b60427', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '00a5583c7b7443e98e7a1d31a0b638dc', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=71939) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 24 16:49:30.161191 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2982682f-9106-40e0-af91-926d035b63c3 admin admin] REQUEST_METHOD: `PUT` {{(pid=71939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 24 16:49:30.161535 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2982682f-9106-40e0-af91-926d035b63c3 admin admin] SCRIPT_NAME: `/identity` {{(pid=71939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 24 16:49:30.161865 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2982682f-9106-40e0-af91-926d035b63c3 admin admin] PATH_INFO: `/v3/projects/22305eb6f86c47128bc0fb5167d7936f/users/211eced87664436a9331807fa3c86597/roles/5611724e350b41e19921b5961a342582` {{(pid=71939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 24 16:49:30.187128 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2982682f-9106-40e0-af91-926d035b63c3 admin admin] RBAC: Authorizing `identity:create_grant(project_id=22305eb6f86c47128bc0fb5167d7936f, user_id=211eced87664436a9331807fa3c86597, role_id=5611724e350b41e19921b5961a342582)` {{(pid=71939) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:442}} Nov 24 16:49:30.192224 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.notifications [None req-c867c981-3d19-4787-976d-70d8e437d2ba admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '4a1cc2b42a5540a3a7449b7dea5c563b'} {{(pid=71938) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:357}} Nov 24 16:49:30.192948 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.notifications [None req-c867c981-3d19-4787-976d-70d8e437d2ba admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '4a1cc2b42a5540a3a7449b7dea5c563b'} {{(pid=71938) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:357}} Nov 24 16:49:30.219170 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2982682f-9106-40e0-af91-926d035b63c3 admin admin] RBAC: Authorization granted {{(pid=71939) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 24 16:49:30.220402 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.notifications [None req-c867c981-3d19-4787-976d-70d8e437d2ba admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '4a1cc2b42a5540a3a7449b7dea5c563b'} {{(pid=71938) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:357}} Nov 24 16:49:30.230958 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.notifications [None req-c867c981-3d19-4787-976d-70d8e437d2ba admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '4a1cc2b42a5540a3a7449b7dea5c563b'} {{(pid=71938) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:357}} Nov 24 16:49:30.236220 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: [pid: 71939|app: 0|req: 1100/2185] 10.222.0.53 () {60 vars in 1473 bytes} [Wed Nov 24 16:49:30 2021] PUT /identity/v3/projects/22305eb6f86c47128bc0fb5167d7936f/users/211eced87664436a9331807fa3c86597/roles/5611724e350b41e19921b5961a342582 => generated 0 bytes in 104 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 24 16:49:30.237280 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2982682f-9106-40e0-af91-926d035b63c3 admin admin] Authenticating user token {{(pid=71939) process_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 24 16:49:30.239282 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: [pid: 71938|app: 0|req: 1086/2186] 10.222.0.53 () {58 vars in 1214 bytes} [Wed Nov 24 16:49:30 2021] DELETE /identity/v3/users/4a1cc2b42a5540a3a7449b7dea5c563b => generated 0 bytes in 201 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 24 16:49:30.239660 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.fernet_utils [None req-2982682f-9106-40e0-af91-926d035b63c3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=71939) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:289}} Nov 24 16:49:30.244151 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c867c981-3d19-4787-976d-70d8e437d2ba admin admin] Authenticating user token {{(pid=71938) process_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 24 16:49:30.247393 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.fernet_utils [None req-c867c981-3d19-4787-976d-70d8e437d2ba admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=71938) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:289}} Nov 24 16:49:30.339099 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2982682f-9106-40e0-af91-926d035b63c3 admin admin] Validating token access rules against request {{(pid=71939) validate_allowed_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 24 16:49:30.344385 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ab94751-6b48-4ebe-9876-a3dfc64a7031 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f2ba2e8375b4e8c8792ee1e22b60427', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '00a5583c7b7443e98e7a1d31a0b638dc', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=71939) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 24 16:49:30.345323 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ab94751-6b48-4ebe-9876-a3dfc64a7031 admin admin] REQUEST_METHOD: `PUT` {{(pid=71939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 24 16:49:30.345662 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ab94751-6b48-4ebe-9876-a3dfc64a7031 admin admin] SCRIPT_NAME: `/identity` {{(pid=71939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 24 16:49:30.345995 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ab94751-6b48-4ebe-9876-a3dfc64a7031 admin admin] PATH_INFO: `/v3/projects/27f6e3f342f34f6d90b56c3a61fd46ca/users/920befadbfa0468ca156b135804947b1/roles/912ab5f10fa5477da74acf239f07604e` {{(pid=71939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 24 16:49:30.351446 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c867c981-3d19-4787-976d-70d8e437d2ba admin admin] Validating token access rules against request {{(pid=71938) validate_allowed_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 24 16:49:30.356210 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1219f24c-1ce3-44fb-906b-49cdc85b8da7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f2ba2e8375b4e8c8792ee1e22b60427', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '00a5583c7b7443e98e7a1d31a0b638dc', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=71938) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 24 16:49:30.357810 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1219f24c-1ce3-44fb-906b-49cdc85b8da7 admin admin] REQUEST_METHOD: `GET` {{(pid=71938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 24 16:49:30.357968 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1219f24c-1ce3-44fb-906b-49cdc85b8da7 admin admin] SCRIPT_NAME: `/identity` {{(pid=71938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 24 16:49:30.358357 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1219f24c-1ce3-44fb-906b-49cdc85b8da7 admin admin] PATH_INFO: `/v3/roles` {{(pid=71938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 24 16:49:30.359508 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1219f24c-1ce3-44fb-906b-49cdc85b8da7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=71938) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:442}} Nov 24 16:49:30.368841 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ab94751-6b48-4ebe-9876-a3dfc64a7031 admin admin] RBAC: Authorizing `identity:create_grant(project_id=27f6e3f342f34f6d90b56c3a61fd46ca, user_id=920befadbfa0468ca156b135804947b1, role_id=912ab5f10fa5477da74acf239f07604e)` {{(pid=71939) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:442}} Nov 24 16:49:30.390272 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1219f24c-1ce3-44fb-906b-49cdc85b8da7 admin admin] RBAC: Authorization granted {{(pid=71938) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 24 16:49:30.398246 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ab94751-6b48-4ebe-9876-a3dfc64a7031 admin admin] RBAC: Authorization granted {{(pid=71939) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 24 16:49:30.406063 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: [pid: 71938|app: 0|req: 1087/2187] 10.222.0.53 () {58 vars in 1112 bytes} [Wed Nov 24 16:49:30 2021] GET /identity/v3/roles => generated 1420 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 24 16:49:30.408678 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1219f24c-1ce3-44fb-906b-49cdc85b8da7 admin admin] Authenticating user token {{(pid=71938) process_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 24 16:49:30.417296 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: [pid: 71939|app: 0|req: 1101/2188] 10.222.0.53 () {60 vars in 1473 bytes} [Wed Nov 24 16:49:30 2021] PUT /identity/v3/projects/27f6e3f342f34f6d90b56c3a61fd46ca/users/920befadbfa0468ca156b135804947b1/roles/912ab5f10fa5477da74acf239f07604e => generated 0 bytes in 180 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 24 16:49:30.422431 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1219f24c-1ce3-44fb-906b-49cdc85b8da7 admin admin] Validating token access rules against request {{(pid=71938) validate_allowed_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 24 16:49:30.429613 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34223d57-123d-4df6-a9eb-3177489b415c None None] REQUEST_METHOD: `POST` {{(pid=71939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 24 16:49:30.429769 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34223d57-123d-4df6-a9eb-3177489b415c None None] SCRIPT_NAME: `/identity` {{(pid=71939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 24 16:49:30.430269 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34223d57-123d-4df6-a9eb-3177489b415c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=71939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 24 16:49:30.472630 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.auth.core [None req-34223d57-123d-4df6-a9eb-3177489b415c None None] MFA Rules not processed for user `920befadbfa0468ca156b135804947b1`. Rule list: `[]` (Enabled: `True`). {{(pid=71939) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:442}} Nov 24 16:49:30.474245 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.fernet_utils [None req-34223d57-123d-4df6-a9eb-3177489b415c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=71939) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:289}} Nov 24 16:49:30.518074 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-757eaf50-3354-4430-bd71-34ce25c4d422 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f2ba2e8375b4e8c8792ee1e22b60427', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '00a5583c7b7443e98e7a1d31a0b638dc', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=71938) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 24 16:49:30.519013 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-757eaf50-3354-4430-bd71-34ce25c4d422 admin admin] REQUEST_METHOD: `PUT` {{(pid=71938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 24 16:49:30.519845 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-757eaf50-3354-4430-bd71-34ce25c4d422 admin admin] SCRIPT_NAME: `/identity` {{(pid=71938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 24 16:49:30.520179 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-757eaf50-3354-4430-bd71-34ce25c4d422 admin admin] PATH_INFO: `/v3/projects/22305eb6f86c47128bc0fb5167d7936f/users/211eced87664436a9331807fa3c86597/roles/5611724e350b41e19921b5961a342582` {{(pid=71938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 24 16:49:30.524654 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-757eaf50-3354-4430-bd71-34ce25c4d422 admin admin] RBAC: Authorizing `identity:create_grant(project_id=22305eb6f86c47128bc0fb5167d7936f, user_id=211eced87664436a9331807fa3c86597, role_id=5611724e350b41e19921b5961a342582)` {{(pid=71938) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:442}} Nov 24 16:49:30.562100 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-757eaf50-3354-4430-bd71-34ce25c4d422 admin admin] RBAC: Authorization granted {{(pid=71938) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 24 16:49:30.575617 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: [pid: 71938|app: 0|req: 1088/2189] 10.222.0.53 () {60 vars in 1473 bytes} [Wed Nov 24 16:49:30 2021] PUT /identity/v3/projects/22305eb6f86c47128bc0fb5167d7936f/users/211eced87664436a9331807fa3c86597/roles/5611724e350b41e19921b5961a342582 => generated 0 bytes in 168 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 24 16:49:30.579552 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-757eaf50-3354-4430-bd71-34ce25c4d422 admin admin] Authenticating user token {{(pid=71938) process_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 24 16:49:30.591184 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: [pid: 71939|app: 0|req: 1102/2190] 10.222.0.53 () {58 vars in 948 bytes} [Wed Nov 24 16:49:30 2021] POST /identity/v3/auth/tokens => generated 3690 bytes in 164 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Nov 24 16:49:30.597783 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34223d57-123d-4df6-a9eb-3177489b415c None None] Authenticating user token {{(pid=71939) process_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 24 16:49:30.613360 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34223d57-123d-4df6-a9eb-3177489b415c None None] Validating token access rules against request {{(pid=71939) validate_allowed_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 24 16:49:30.671029 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-757eaf50-3354-4430-bd71-34ce25c4d422 admin admin] Validating token access rules against request {{(pid=71938) validate_allowed_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 24 16:49:30.676881 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0ad8c1b-0b75-4271-bbe9-870c6fb63fd9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f2ba2e8375b4e8c8792ee1e22b60427', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '00a5583c7b7443e98e7a1d31a0b638dc', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=71938) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 24 16:49:30.678592 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0ad8c1b-0b75-4271-bbe9-870c6fb63fd9 admin admin] REQUEST_METHOD: `GET` {{(pid=71938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 24 16:49:30.678946 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0ad8c1b-0b75-4271-bbe9-870c6fb63fd9 admin admin] SCRIPT_NAME: `/identity` {{(pid=71938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 24 16:49:30.679621 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0ad8c1b-0b75-4271-bbe9-870c6fb63fd9 admin admin] PATH_INFO: `/v3/roles` {{(pid=71938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 24 16:49:30.680422 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0ad8c1b-0b75-4271-bbe9-870c6fb63fd9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=71938) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:442}} Nov 24 16:49:30.688759 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a99029dc-69b9-4b9d-8058-647d32866a70 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f2ba2e8375b4e8c8792ee1e22b60427', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '00a5583c7b7443e98e7a1d31a0b638dc', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=71939) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 24 16:49:30.689725 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a99029dc-69b9-4b9d-8058-647d32866a70 admin admin] REQUEST_METHOD: `POST` {{(pid=71939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 24 16:49:30.689935 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a99029dc-69b9-4b9d-8058-647d32866a70 admin admin] SCRIPT_NAME: `/identity` {{(pid=71939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 24 16:49:30.690306 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a99029dc-69b9-4b9d-8058-647d32866a70 admin admin] PATH_INFO: `/v3/projects` {{(pid=71939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 24 16:49:30.691124 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a99029dc-69b9-4b9d-8058-647d32866a70 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=71939) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:442}} Nov 24 16:49:30.710975 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0ad8c1b-0b75-4271-bbe9-870c6fb63fd9 admin admin] RBAC: Authorization granted {{(pid=71938) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 24 16:49:30.725865 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: [pid: 71938|app: 0|req: 1089/2191] 10.222.0.53 () {58 vars in 1112 bytes} [Wed Nov 24 16:49:30 2021] GET /identity/v3/roles => generated 1420 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Nov 24 16:49:30.725865 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0ad8c1b-0b75-4271-bbe9-870c6fb63fd9 admin admin] Authenticating user token {{(pid=71938) process_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 24 16:49:30.728674 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.fernet_utils [None req-b0ad8c1b-0b75-4271-bbe9-870c6fb63fd9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=71938) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:289}} Nov 24 16:49:30.728834 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a99029dc-69b9-4b9d-8058-647d32866a70 admin admin] RBAC: Authorization granted {{(pid=71939) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 24 16:49:30.744061 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0ad8c1b-0b75-4271-bbe9-870c6fb63fd9 admin admin] Validating token access rules against request {{(pid=71938) validate_allowed_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 24 16:49:30.750605 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cbc2341-a659-4f11-963c-40c7cdd9d7fb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f2ba2e8375b4e8c8792ee1e22b60427', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '00a5583c7b7443e98e7a1d31a0b638dc', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=71938) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 24 16:49:30.751658 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cbc2341-a659-4f11-963c-40c7cdd9d7fb admin admin] REQUEST_METHOD: `DELETE` {{(pid=71938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 24 16:49:30.752154 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cbc2341-a659-4f11-963c-40c7cdd9d7fb admin admin] SCRIPT_NAME: `/identity` {{(pid=71938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 24 16:49:30.752714 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cbc2341-a659-4f11-963c-40c7cdd9d7fb admin admin] PATH_INFO: `/v3/projects/a60c4bd5e50e4d65bff749c0d952ff15` {{(pid=71938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 24 16:49:30.754611 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cbc2341-a659-4f11-963c-40c7cdd9d7fb admin admin] RBAC: Authorizing `identity:delete_project(project_id=a60c4bd5e50e4d65bff749c0d952ff15)` {{(pid=71938) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:442}} Nov 24 16:49:30.762943 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: [pid: 71939|app: 0|req: 1103/2192] 10.222.0.53 () {60 vars in 1143 bytes} [Wed Nov 24 16:49:30 2021] POST /identity/v3/projects => generated 383 bytes in 166 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 24 16:49:30.763878 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a99029dc-69b9-4b9d-8058-647d32866a70 admin admin] Authenticating user token {{(pid=71939) process_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 24 16:49:30.785317 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cbc2341-a659-4f11-963c-40c7cdd9d7fb admin admin] RBAC: Authorization granted {{(pid=71938) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 24 16:49:30.848261 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.notifications [None req-1cbc2341-a659-4f11-963c-40c7cdd9d7fb admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a60c4bd5e50e4d65bff749c0d952ff15', 'request_id': 'req-1cbc2341-a659-4f11-963c-40c7cdd9d7fb'} {{(pid=71938) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:357}} Nov 24 16:49:30.851825 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a99029dc-69b9-4b9d-8058-647d32866a70 admin admin] Validating token access rules against request {{(pid=71939) validate_allowed_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 24 16:49:30.866130 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.notifications [None req-1cbc2341-a659-4f11-963c-40c7cdd9d7fb admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a60c4bd5e50e4d65bff749c0d952ff15', 'request_id': 'req-1cbc2341-a659-4f11-963c-40c7cdd9d7fb'} {{(pid=71938) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:357}} Nov 24 16:49:30.872126 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.notifications [None req-1cbc2341-a659-4f11-963c-40c7cdd9d7fb admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a60c4bd5e50e4d65bff749c0d952ff15', 'request_id': 'req-1cbc2341-a659-4f11-963c-40c7cdd9d7fb'} {{(pid=71938) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:357}} Nov 24 16:49:30.886288 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.notifications [None req-1cbc2341-a659-4f11-963c-40c7cdd9d7fb admin admin] The token cache is being invalidate because project a60c4bd5e50e4d65bff749c0d952ff15 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=71938) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Nov 24 16:49:30.886607 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.notifications [None req-1cbc2341-a659-4f11-963c-40c7cdd9d7fb admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=71938) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:357}} Nov 24 16:49:30.887403 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.notifications [None req-1cbc2341-a659-4f11-963c-40c7cdd9d7fb admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=71938) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:357}} Nov 24 16:49:30.889451 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: [pid: 71938|app: 0|req: 1090/2193] 10.222.0.53 () {58 vars in 1223 bytes} [Wed Nov 24 16:49:30 2021] DELETE /identity/v3/projects/a60c4bd5e50e4d65bff749c0d952ff15 => generated 0 bytes in 166 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 24 16:49:30.890541 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cbc2341-a659-4f11-963c-40c7cdd9d7fb admin admin] Authenticating user token {{(pid=71938) process_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 24 16:49:30.891822 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.fernet_utils [None req-1cbc2341-a659-4f11-963c-40c7cdd9d7fb admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=71938) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:289}} Nov 24 16:49:30.925930 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96b15ae5-87b4-4431-959a-52d72d720cb2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f2ba2e8375b4e8c8792ee1e22b60427', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '00a5583c7b7443e98e7a1d31a0b638dc', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=71939) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 24 16:49:30.926889 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96b15ae5-87b4-4431-959a-52d72d720cb2 admin admin] REQUEST_METHOD: `PUT` {{(pid=71939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 24 16:49:30.927234 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96b15ae5-87b4-4431-959a-52d72d720cb2 admin admin] SCRIPT_NAME: `/identity` {{(pid=71939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 24 16:49:30.928247 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96b15ae5-87b4-4431-959a-52d72d720cb2 admin admin] PATH_INFO: `/v3/projects/22305eb6f86c47128bc0fb5167d7936f/users/211eced87664436a9331807fa3c86597/roles/912ab5f10fa5477da74acf239f07604e` {{(pid=71939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 24 16:49:30.931033 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96b15ae5-87b4-4431-959a-52d72d720cb2 admin admin] RBAC: Authorizing `identity:create_grant(project_id=22305eb6f86c47128bc0fb5167d7936f, user_id=211eced87664436a9331807fa3c86597, role_id=912ab5f10fa5477da74acf239f07604e)` {{(pid=71939) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:442}} Nov 24 16:49:30.962733 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96b15ae5-87b4-4431-959a-52d72d720cb2 admin admin] RBAC: Authorization granted {{(pid=71939) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 24 16:49:30.986099 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: [pid: 71939|app: 0|req: 1104/2194] 10.222.0.53 () {60 vars in 1473 bytes} [Wed Nov 24 16:49:30 2021] PUT /identity/v3/projects/22305eb6f86c47128bc0fb5167d7936f/users/211eced87664436a9331807fa3c86597/roles/912ab5f10fa5477da74acf239f07604e => generated 0 bytes in 214 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 24 16:49:30.986099 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96b15ae5-87b4-4431-959a-52d72d720cb2 admin admin] Authenticating user token {{(pid=71939) process_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 24 16:49:30.986675 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cbc2341-a659-4f11-963c-40c7cdd9d7fb admin admin] Validating token access rules against request {{(pid=71938) validate_allowed_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 24 16:49:30.988619 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.fernet_utils [None req-96b15ae5-87b4-4431-959a-52d72d720cb2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=71939) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:289}} Nov 24 16:49:31.061479 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-894c0193-4503-43c1-b1e4-9a90eac4eb78 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f2ba2e8375b4e8c8792ee1e22b60427', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '00a5583c7b7443e98e7a1d31a0b638dc', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=71938) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 24 16:49:31.061982 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-894c0193-4503-43c1-b1e4-9a90eac4eb78 admin admin] REQUEST_METHOD: `POST` {{(pid=71938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 24 16:49:31.062353 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-894c0193-4503-43c1-b1e4-9a90eac4eb78 admin admin] SCRIPT_NAME: `/identity` {{(pid=71938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 24 16:49:31.062686 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-894c0193-4503-43c1-b1e4-9a90eac4eb78 admin admin] PATH_INFO: `/v3/users` {{(pid=71938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 24 16:49:31.063425 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-894c0193-4503-43c1-b1e4-9a90eac4eb78 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=71938) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:442}} Nov 24 16:49:31.069121 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96b15ae5-87b4-4431-959a-52d72d720cb2 admin admin] Validating token access rules against request {{(pid=71939) validate_allowed_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 24 16:49:31.073867 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a49af50b-a4ac-426f-a612-677f441a9a13 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f2ba2e8375b4e8c8792ee1e22b60427', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '00a5583c7b7443e98e7a1d31a0b638dc', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=71939) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 24 16:49:31.074791 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a49af50b-a4ac-426f-a612-677f441a9a13 admin admin] REQUEST_METHOD: `DELETE` {{(pid=71939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 24 16:49:31.075133 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a49af50b-a4ac-426f-a612-677f441a9a13 admin admin] SCRIPT_NAME: `/identity` {{(pid=71939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 24 16:49:31.075466 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a49af50b-a4ac-426f-a612-677f441a9a13 admin admin] PATH_INFO: `/v3/users/637368a02bab4c9db0b00e497634157c` {{(pid=71939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 24 16:49:31.076693 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a49af50b-a4ac-426f-a612-677f441a9a13 admin admin] RBAC: Authorizing `identity:delete_user(user_id=637368a02bab4c9db0b00e497634157c)` {{(pid=71939) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:442}} Nov 24 16:49:31.093884 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-894c0193-4503-43c1-b1e4-9a90eac4eb78 admin admin] RBAC: Authorization granted {{(pid=71938) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 24 16:49:31.105642 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a49af50b-a4ac-426f-a612-677f441a9a13 admin admin] RBAC: Authorization granted {{(pid=71939) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 24 16:49:31.116733 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: [pid: 71938|app: 0|req: 1091/2195] 10.222.0.53 () {60 vars in 1134 bytes} [Wed Nov 24 16:49:30 2021] POST /identity/v3/users => generated 298 bytes in 224 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 24 16:49:31.116733 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08395e00-447f-4feb-a494-ae38ce1ba105 None None] REQUEST_METHOD: `POST` {{(pid=71938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 24 16:49:31.116733 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08395e00-447f-4feb-a494-ae38ce1ba105 None None] SCRIPT_NAME: `/identity` {{(pid=71938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 24 16:49:31.116733 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08395e00-447f-4feb-a494-ae38ce1ba105 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=71938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 24 16:49:31.157292 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.notifications [None req-a49af50b-a4ac-426f-a612-677f441a9a13 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '637368a02bab4c9db0b00e497634157c'} {{(pid=71939) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:357}} Nov 24 16:49:31.158732 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.auth.core [None req-08395e00-447f-4feb-a494-ae38ce1ba105 None None] MFA Rules not processed for user `211eced87664436a9331807fa3c86597`. Rule list: `[]` (Enabled: `True`). {{(pid=71938) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:442}} Nov 24 16:49:31.159972 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.fernet_utils [None req-08395e00-447f-4feb-a494-ae38ce1ba105 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=71938) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:289}} Nov 24 16:49:31.170230 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.notifications [None req-a49af50b-a4ac-426f-a612-677f441a9a13 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '637368a02bab4c9db0b00e497634157c'} {{(pid=71939) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:357}} Nov 24 16:49:31.170974 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.notifications [None req-a49af50b-a4ac-426f-a612-677f441a9a13 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '637368a02bab4c9db0b00e497634157c'} {{(pid=71939) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:357}} Nov 24 16:49:31.180116 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.notifications [None req-a49af50b-a4ac-426f-a612-677f441a9a13 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '637368a02bab4c9db0b00e497634157c'} {{(pid=71939) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:357}} Nov 24 16:49:31.189575 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.notifications [None req-a49af50b-a4ac-426f-a612-677f441a9a13 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '637368a02bab4c9db0b00e497634157c'} {{(pid=71939) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:357}} Nov 24 16:49:31.197705 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: [pid: 71939|app: 0|req: 1105/2196] 10.222.0.53 () {58 vars in 1214 bytes} [Wed Nov 24 16:49:30 2021] DELETE /identity/v3/users/637368a02bab4c9db0b00e497634157c => generated 0 bytes in 220 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 24 16:49:31.198607 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a49af50b-a4ac-426f-a612-677f441a9a13 admin admin] Authenticating user token {{(pid=71939) process_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 24 16:49:31.200043 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.fernet_utils [None req-a49af50b-a4ac-426f-a612-677f441a9a13 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=71939) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:289}} Nov 24 16:49:31.279636 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: [pid: 71938|app: 0|req: 1092/2197] 10.222.0.53 () {58 vars in 948 bytes} [Wed Nov 24 16:49:31 2021] POST /identity/v3/auth/tokens => generated 3759 bytes in 165 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 24 16:49:31.289892 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08395e00-447f-4feb-a494-ae38ce1ba105 None None] Authenticating user token {{(pid=71938) process_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 24 16:49:31.294340 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a49af50b-a4ac-426f-a612-677f441a9a13 admin admin] Validating token access rules against request {{(pid=71939) validate_allowed_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 24 16:49:31.297808 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.fernet_utils [None req-08395e00-447f-4feb-a494-ae38ce1ba105 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=71938) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:289}} Nov 24 16:49:31.300215 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5a4f88e-a353-4591-add7-2802a9b70a9c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f2ba2e8375b4e8c8792ee1e22b60427', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '00a5583c7b7443e98e7a1d31a0b638dc', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=71939) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 24 16:49:31.301001 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5a4f88e-a353-4591-add7-2802a9b70a9c admin admin] REQUEST_METHOD: `GET` {{(pid=71939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 24 16:49:31.301428 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5a4f88e-a353-4591-add7-2802a9b70a9c admin admin] SCRIPT_NAME: `/identity` {{(pid=71939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 24 16:49:31.302060 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5a4f88e-a353-4591-add7-2802a9b70a9c admin admin] PATH_INFO: `/v3/roles` {{(pid=71939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 24 16:49:31.303555 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5a4f88e-a353-4591-add7-2802a9b70a9c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=71939) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:442}} Nov 24 16:49:31.335644 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5a4f88e-a353-4591-add7-2802a9b70a9c admin admin] RBAC: Authorization granted {{(pid=71939) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 24 16:49:31.348305 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: [pid: 71939|app: 0|req: 1106/2198] 10.222.0.53 () {58 vars in 1112 bytes} [Wed Nov 24 16:49:31 2021] GET /identity/v3/roles => generated 1420 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 24 16:49:31.353659 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5a4f88e-a353-4591-add7-2802a9b70a9c admin admin] Authenticating user token {{(pid=71939) process_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 24 16:49:31.365861 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5a4f88e-a353-4591-add7-2802a9b70a9c admin admin] Validating token access rules against request {{(pid=71939) validate_allowed_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 24 16:49:31.374931 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f7e8b4d-c7de-4873-bc64-5525e9f34737 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f2ba2e8375b4e8c8792ee1e22b60427', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '00a5583c7b7443e98e7a1d31a0b638dc', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=71939) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 24 16:49:31.375847 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f7e8b4d-c7de-4873-bc64-5525e9f34737 admin admin] REQUEST_METHOD: `PUT` {{(pid=71939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 24 16:49:31.376191 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f7e8b4d-c7de-4873-bc64-5525e9f34737 admin admin] SCRIPT_NAME: `/identity` {{(pid=71939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 24 16:49:31.376522 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f7e8b4d-c7de-4873-bc64-5525e9f34737 admin admin] PATH_INFO: `/v3/projects/b2771cb49b804ae9a875d7b9d524986d/users/33b29282edf14e44ab2d00bd5c9a997d/roles/5611724e350b41e19921b5961a342582` {{(pid=71939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 24 16:49:31.410048 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f7e8b4d-c7de-4873-bc64-5525e9f34737 admin admin] RBAC: Authorizing `identity:create_grant(project_id=b2771cb49b804ae9a875d7b9d524986d, user_id=33b29282edf14e44ab2d00bd5c9a997d, role_id=5611724e350b41e19921b5961a342582)` {{(pid=71939) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:442}} Nov 24 16:49:31.429032 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08395e00-447f-4feb-a494-ae38ce1ba105 None None] Validating token access rules against request {{(pid=71938) validate_allowed_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 24 16:49:31.447031 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f7e8b4d-c7de-4873-bc64-5525e9f34737 admin admin] RBAC: Authorization granted {{(pid=71939) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 24 16:49:31.466713 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: [pid: 71939|app: 0|req: 1107/2199] 10.222.0.53 () {60 vars in 1473 bytes} [Wed Nov 24 16:49:31 2021] PUT /identity/v3/projects/b2771cb49b804ae9a875d7b9d524986d/users/33b29282edf14e44ab2d00bd5c9a997d/roles/5611724e350b41e19921b5961a342582 => generated 0 bytes in 113 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 24 16:49:31.470595 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f7e8b4d-c7de-4873-bc64-5525e9f34737 admin admin] Authenticating user token {{(pid=71939) process_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 24 16:49:31.512863 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69852a01-2160-41ed-8ed6-6d176f78c4c7 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a12374a3093a401a97c343ff0854184d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3b3940d4ae1c4177ae29c02377bb4b0b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=71938) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 24 16:49:31.514466 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69852a01-2160-41ed-8ed6-6d176f78c4c7 service cinder] REQUEST_METHOD: `GET` {{(pid=71938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 24 16:49:31.515016 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69852a01-2160-41ed-8ed6-6d176f78c4c7 service cinder] SCRIPT_NAME: `/identity` {{(pid=71938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 24 16:49:31.516050 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69852a01-2160-41ed-8ed6-6d176f78c4c7 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=71938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 24 16:49:31.519431 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.fernet_utils [None req-69852a01-2160-41ed-8ed6-6d176f78c4c7 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=71938) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:289}} Nov 24 16:49:31.575493 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f7e8b4d-c7de-4873-bc64-5525e9f34737 admin admin] Validating token access rules against request {{(pid=71939) validate_allowed_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 24 16:49:31.587739 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64e762ba-57a8-4fe1-85de-38f674da7d91 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f2ba2e8375b4e8c8792ee1e22b60427', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '00a5583c7b7443e98e7a1d31a0b638dc', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=71939) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 24 16:49:31.588744 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64e762ba-57a8-4fe1-85de-38f674da7d91 admin admin] REQUEST_METHOD: `GET` {{(pid=71939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 24 16:49:31.589223 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64e762ba-57a8-4fe1-85de-38f674da7d91 admin admin] SCRIPT_NAME: `/identity` {{(pid=71939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 24 16:49:31.589560 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64e762ba-57a8-4fe1-85de-38f674da7d91 admin admin] PATH_INFO: `/v3/roles` {{(pid=71939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 24 16:49:31.590873 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64e762ba-57a8-4fe1-85de-38f674da7d91 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=71939) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:442}} Nov 24 16:49:31.606693 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69852a01-2160-41ed-8ed6-6d176f78c4c7 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=71938) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:442}} Nov 24 16:49:31.632989 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64e762ba-57a8-4fe1-85de-38f674da7d91 admin admin] RBAC: Authorization granted {{(pid=71939) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 24 16:49:31.638241 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69852a01-2160-41ed-8ed6-6d176f78c4c7 service cinder] RBAC: Authorization granted {{(pid=71938) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 24 16:49:31.650665 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: [pid: 71939|app: 0|req: 1108/2200] 10.222.0.53 () {58 vars in 1112 bytes} [Wed Nov 24 16:49:31 2021] GET /identity/v3/roles => generated 1420 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 24 16:49:31.656182 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64e762ba-57a8-4fe1-85de-38f674da7d91 admin admin] Authenticating user token {{(pid=71939) process_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 24 16:49:31.657976 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: [pid: 71938|app: 0|req: 1093/2201] 10.222.0.53 () {60 vars in 1356 bytes} [Wed Nov 24 16:49:31 2021] GET /identity/v3/auth/tokens => generated 3690 bytes in 369 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 24 16:49:31.658116 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.fernet_utils [None req-64e762ba-57a8-4fe1-85de-38f674da7d91 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=71939) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:289}} Nov 24 16:49:31.660947 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69852a01-2160-41ed-8ed6-6d176f78c4c7 service cinder] Authenticating user token {{(pid=71938) process_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 24 16:49:31.672100 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64e762ba-57a8-4fe1-85de-38f674da7d91 admin admin] Validating token access rules against request {{(pid=71939) validate_allowed_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 24 16:49:31.675419 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69852a01-2160-41ed-8ed6-6d176f78c4c7 service cinder] Validating token access rules against request {{(pid=71938) validate_allowed_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 24 16:49:31.677142 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ff31c51-96c0-42c3-a790-916032836ec7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f2ba2e8375b4e8c8792ee1e22b60427', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '00a5583c7b7443e98e7a1d31a0b638dc', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=71939) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 24 16:49:31.678979 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ff31c51-96c0-42c3-a790-916032836ec7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=71939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 24 16:49:31.679496 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ff31c51-96c0-42c3-a790-916032836ec7 admin admin] SCRIPT_NAME: `/identity` {{(pid=71939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 24 16:49:31.680171 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ff31c51-96c0-42c3-a790-916032836ec7 admin admin] PATH_INFO: `/v3/projects/f9df4d0ea5424265b3b02484ccf07b8d` {{(pid=71939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 24 16:49:31.681231 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b39989d3-f257-478b-8379-c20f62d52541 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f2ba2e8375b4e8c8792ee1e22b60427', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '00a5583c7b7443e98e7a1d31a0b638dc', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=71938) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 24 16:49:31.681811 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ff31c51-96c0-42c3-a790-916032836ec7 admin admin] RBAC: Authorizing `identity:delete_project(project_id=f9df4d0ea5424265b3b02484ccf07b8d)` {{(pid=71939) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:442}} Nov 24 16:49:31.682539 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b39989d3-f257-478b-8379-c20f62d52541 admin admin] REQUEST_METHOD: `PUT` {{(pid=71938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 24 16:49:31.682960 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b39989d3-f257-478b-8379-c20f62d52541 admin admin] SCRIPT_NAME: `/identity` {{(pid=71938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 24 16:49:31.683373 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b39989d3-f257-478b-8379-c20f62d52541 admin admin] PATH_INFO: `/v3/projects/b2771cb49b804ae9a875d7b9d524986d/users/33b29282edf14e44ab2d00bd5c9a997d/roles/5611724e350b41e19921b5961a342582` {{(pid=71938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 24 16:49:31.685646 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b39989d3-f257-478b-8379-c20f62d52541 admin admin] RBAC: Authorizing `identity:create_grant(project_id=b2771cb49b804ae9a875d7b9d524986d, user_id=33b29282edf14e44ab2d00bd5c9a997d, role_id=5611724e350b41e19921b5961a342582)` {{(pid=71938) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:442}} Nov 24 16:49:31.713871 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ff31c51-96c0-42c3-a790-916032836ec7 admin admin] RBAC: Authorization granted {{(pid=71939) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 24 16:49:31.751528 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b39989d3-f257-478b-8379-c20f62d52541 admin admin] RBAC: Authorization granted {{(pid=71938) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 24 16:49:31.779517 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: [pid: 71938|app: 0|req: 1094/2202] 10.222.0.53 () {60 vars in 1473 bytes} [Wed Nov 24 16:49:31 2021] PUT /identity/v3/projects/b2771cb49b804ae9a875d7b9d524986d/users/33b29282edf14e44ab2d00bd5c9a997d/roles/5611724e350b41e19921b5961a342582 => generated 0 bytes in 119 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 24 16:49:31.782682 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.notifications [None req-4ff31c51-96c0-42c3-a790-916032836ec7 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f9df4d0ea5424265b3b02484ccf07b8d', 'request_id': 'req-4ff31c51-96c0-42c3-a790-916032836ec7'} {{(pid=71939) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:357}} Nov 24 16:49:31.783327 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b39989d3-f257-478b-8379-c20f62d52541 admin admin] Authenticating user token {{(pid=71938) process_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 24 16:49:31.797154 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.notifications [None req-4ff31c51-96c0-42c3-a790-916032836ec7 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f9df4d0ea5424265b3b02484ccf07b8d', 'request_id': 'req-4ff31c51-96c0-42c3-a790-916032836ec7'} {{(pid=71939) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:357}} Nov 24 16:49:31.805573 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.notifications [None req-4ff31c51-96c0-42c3-a790-916032836ec7 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f9df4d0ea5424265b3b02484ccf07b8d', 'request_id': 'req-4ff31c51-96c0-42c3-a790-916032836ec7'} {{(pid=71939) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:357}} Nov 24 16:49:31.820315 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.notifications [None req-4ff31c51-96c0-42c3-a790-916032836ec7 admin admin] The token cache is being invalidate because project f9df4d0ea5424265b3b02484ccf07b8d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=71939) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Nov 24 16:49:31.820797 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.notifications [None req-4ff31c51-96c0-42c3-a790-916032836ec7 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=71939) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:357}} Nov 24 16:49:31.821603 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.notifications [None req-4ff31c51-96c0-42c3-a790-916032836ec7 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=71939) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:357}} Nov 24 16:49:31.826872 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: [pid: 71939|app: 0|req: 1109/2203] 10.222.0.53 () {58 vars in 1223 bytes} [Wed Nov 24 16:49:31 2021] DELETE /identity/v3/projects/f9df4d0ea5424265b3b02484ccf07b8d => generated 0 bytes in 172 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 24 16:49:31.831072 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bbfbf0a-dcb7-4dfc-a0d6-16825680864d None None] REQUEST_METHOD: `POST` {{(pid=71939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 24 16:49:31.831777 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bbfbf0a-dcb7-4dfc-a0d6-16825680864d None None] SCRIPT_NAME: `/identity` {{(pid=71939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 24 16:49:31.832310 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bbfbf0a-dcb7-4dfc-a0d6-16825680864d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=71939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 24 16:49:31.862757 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.auth.core [None req-4bbfbf0a-dcb7-4dfc-a0d6-16825680864d None None] MFA Rules not processed for user `0f2ba2e8375b4e8c8792ee1e22b60427`. Rule list: `[]` (Enabled: `True`). {{(pid=71939) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:442}} Nov 24 16:49:31.864166 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.fernet_utils [None req-4bbfbf0a-dcb7-4dfc-a0d6-16825680864d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=71939) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:289}} Nov 24 16:49:31.897875 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b39989d3-f257-478b-8379-c20f62d52541 admin admin] Validating token access rules against request {{(pid=71938) validate_allowed_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 24 16:49:31.903803 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b611d2a4-ff80-46d1-af76-dd9ce8d453fc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f2ba2e8375b4e8c8792ee1e22b60427', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '00a5583c7b7443e98e7a1d31a0b638dc', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=71938) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 24 16:49:31.904503 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b611d2a4-ff80-46d1-af76-dd9ce8d453fc admin admin] REQUEST_METHOD: `GET` {{(pid=71938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 24 16:49:31.904989 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b611d2a4-ff80-46d1-af76-dd9ce8d453fc admin admin] SCRIPT_NAME: `/identity` {{(pid=71938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 24 16:49:31.905326 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b611d2a4-ff80-46d1-af76-dd9ce8d453fc admin admin] PATH_INFO: `/v3/roles` {{(pid=71938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 24 16:49:31.906153 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b611d2a4-ff80-46d1-af76-dd9ce8d453fc admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=71938) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:442}} Nov 24 16:49:31.937364 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b611d2a4-ff80-46d1-af76-dd9ce8d453fc admin admin] RBAC: Authorization granted {{(pid=71938) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 24 16:49:31.952768 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: [pid: 71938|app: 0|req: 1095/2204] 10.222.0.53 () {58 vars in 1112 bytes} [Wed Nov 24 16:49:31 2021] GET /identity/v3/roles => generated 1420 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 24 16:49:31.957600 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b611d2a4-ff80-46d1-af76-dd9ce8d453fc admin admin] Authenticating user token {{(pid=71938) process_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 24 16:49:31.963202 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.fernet_utils [None req-b611d2a4-ff80-46d1-af76-dd9ce8d453fc admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=71938) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:289}} Nov 24 16:49:31.988381 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: [pid: 71939|app: 0|req: 1110/2205] 10.222.0.53 () {58 vars in 948 bytes} [Wed Nov 24 16:49:31 2021] POST /identity/v3/auth/tokens => generated 3669 bytes in 152 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Nov 24 16:49:31.991680 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73c3b8b8-fc6f-43bc-8a42-b5be57d4a0db None None] REQUEST_METHOD: `POST` {{(pid=71939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 24 16:49:31.992028 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73c3b8b8-fc6f-43bc-8a42-b5be57d4a0db None None] SCRIPT_NAME: `/identity` {{(pid=71939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 24 16:49:31.992367 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73c3b8b8-fc6f-43bc-8a42-b5be57d4a0db None None] PATH_INFO: `/v3/auth/tokens` {{(pid=71939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 24 16:49:31.994384 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b611d2a4-ff80-46d1-af76-dd9ce8d453fc admin admin] Validating token access rules against request {{(pid=71938) validate_allowed_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 24 16:49:32.002501 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b2b618d-5324-42af-9235-0ec459063068 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f2ba2e8375b4e8c8792ee1e22b60427', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '00a5583c7b7443e98e7a1d31a0b638dc', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=71938) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 24 16:49:32.003665 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b2b618d-5324-42af-9235-0ec459063068 admin admin] REQUEST_METHOD: `PUT` {{(pid=71938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 24 16:49:32.004006 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b2b618d-5324-42af-9235-0ec459063068 admin admin] SCRIPT_NAME: `/identity` {{(pid=71938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 24 16:49:32.004341 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b2b618d-5324-42af-9235-0ec459063068 admin admin] PATH_INFO: `/v3/projects/b2771cb49b804ae9a875d7b9d524986d/users/33b29282edf14e44ab2d00bd5c9a997d/roles/912ab5f10fa5477da74acf239f07604e` {{(pid=71938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 24 16:49:32.013377 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b2b618d-5324-42af-9235-0ec459063068 admin admin] RBAC: Authorizing `identity:create_grant(project_id=b2771cb49b804ae9a875d7b9d524986d, user_id=33b29282edf14e44ab2d00bd5c9a997d, role_id=912ab5f10fa5477da74acf239f07604e)` {{(pid=71938) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:442}} Nov 24 16:49:32.021036 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.auth.core [None req-73c3b8b8-fc6f-43bc-8a42-b5be57d4a0db None None] MFA Rules not processed for user `0f2ba2e8375b4e8c8792ee1e22b60427`. Rule list: `[]` (Enabled: `True`). {{(pid=71939) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:442}} Nov 24 16:49:32.022911 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.fernet_utils [None req-73c3b8b8-fc6f-43bc-8a42-b5be57d4a0db None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=71939) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:289}} Nov 24 16:49:32.031964 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: [pid: 71939|app: 0|req: 1111/2206] 10.222.0.53 () {58 vars in 948 bytes} [Wed Nov 24 16:49:31 2021] POST /identity/v3/auth/tokens => generated 3669 bytes in 42 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 24 16:49:32.036387 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73c3b8b8-fc6f-43bc-8a42-b5be57d4a0db None None] Authenticating user token {{(pid=71939) process_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 24 16:49:32.047723 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73c3b8b8-fc6f-43bc-8a42-b5be57d4a0db None None] Validating token access rules against request {{(pid=71939) validate_allowed_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 24 16:49:32.052121 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b2b618d-5324-42af-9235-0ec459063068 admin admin] RBAC: Authorization granted {{(pid=71938) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 24 16:49:32.053468 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-262c8080-587b-42a5-8fa2-060979e866f6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f2ba2e8375b4e8c8792ee1e22b60427', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '00a5583c7b7443e98e7a1d31a0b638dc', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=71939) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 24 16:49:32.054648 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-262c8080-587b-42a5-8fa2-060979e866f6 admin admin] REQUEST_METHOD: `GET` {{(pid=71939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 24 16:49:32.055189 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-262c8080-587b-42a5-8fa2-060979e866f6 admin admin] SCRIPT_NAME: `/identity` {{(pid=71939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 24 16:49:32.055901 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-262c8080-587b-42a5-8fa2-060979e866f6 admin admin] PATH_INFO: `/v3/domains` {{(pid=71939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 24 16:49:32.056903 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-262c8080-587b-42a5-8fa2-060979e866f6 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=71939) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:161}} Nov 24 16:49:32.057746 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-262c8080-587b-42a5-8fa2-060979e866f6 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=71939) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:442}} Nov 24 16:49:32.075862 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: [pid: 71938|app: 0|req: 1096/2207] 10.222.0.53 () {60 vars in 1473 bytes} [Wed Nov 24 16:49:31 2021] PUT /identity/v3/projects/b2771cb49b804ae9a875d7b9d524986d/users/33b29282edf14e44ab2d00bd5c9a997d/roles/912ab5f10fa5477da74acf239f07604e => generated 0 bytes in 118 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 24 16:49:32.086966 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7830c1ee-2b62-45c7-adf6-16315a2afff7 None None] REQUEST_METHOD: `POST` {{(pid=71938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 24 16:49:32.087603 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7830c1ee-2b62-45c7-adf6-16315a2afff7 None None] SCRIPT_NAME: `/identity` {{(pid=71938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 24 16:49:32.088262 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7830c1ee-2b62-45c7-adf6-16315a2afff7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=71938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 24 16:49:32.092603 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-262c8080-587b-42a5-8fa2-060979e866f6 admin admin] RBAC: Authorization granted {{(pid=71939) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 24 16:49:32.113064 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: [pid: 71939|app: 0|req: 1112/2208] 10.222.0.53 () {58 vars in 1143 bytes} [Wed Nov 24 16:49:32 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 77 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 24 16:49:32.117972 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-262c8080-587b-42a5-8fa2-060979e866f6 admin admin] Authenticating user token {{(pid=71939) process_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 24 16:49:32.140442 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-262c8080-587b-42a5-8fa2-060979e866f6 admin admin] Validating token access rules against request {{(pid=71939) validate_allowed_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 24 16:49:32.141704 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.auth.core [None req-7830c1ee-2b62-45c7-adf6-16315a2afff7 None None] MFA Rules not processed for user `33b29282edf14e44ab2d00bd5c9a997d`. Rule list: `[]` (Enabled: `True`). {{(pid=71938) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:442}} Nov 24 16:49:32.143677 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.fernet_utils [None req-7830c1ee-2b62-45c7-adf6-16315a2afff7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=71938) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:289}} Nov 24 16:49:32.290975 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77345f6a-db31-4eb1-9089-929dba12819b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f2ba2e8375b4e8c8792ee1e22b60427', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '00a5583c7b7443e98e7a1d31a0b638dc', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=71939) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 24 16:49:32.291678 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77345f6a-db31-4eb1-9089-929dba12819b admin admin] REQUEST_METHOD: `POST` {{(pid=71939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 24 16:49:32.292028 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77345f6a-db31-4eb1-9089-929dba12819b admin admin] SCRIPT_NAME: `/identity` {{(pid=71939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 24 16:49:32.292369 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77345f6a-db31-4eb1-9089-929dba12819b admin admin] PATH_INFO: `/v3/projects` {{(pid=71939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 24 16:49:32.293162 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: [pid: 71938|app: 0|req: 1097/2209] 10.222.0.53 () {58 vars in 948 bytes} [Wed Nov 24 16:49:32 2021] POST /identity/v3/auth/tokens => generated 3757 bytes in 207 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 24 16:49:32.297903 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77345f6a-db31-4eb1-9089-929dba12819b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=71939) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:442}} Nov 24 16:49:32.305067 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7830c1ee-2b62-45c7-adf6-16315a2afff7 None None] Authenticating user token {{(pid=71938) process_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 24 16:49:32.307677 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.fernet_utils [None req-7830c1ee-2b62-45c7-adf6-16315a2afff7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=71938) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:289}} Nov 24 16:49:32.358099 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77345f6a-db31-4eb1-9089-929dba12819b admin admin] RBAC: Authorization granted {{(pid=71939) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 24 16:49:32.411512 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7830c1ee-2b62-45c7-adf6-16315a2afff7 None None] Validating token access rules against request {{(pid=71938) validate_allowed_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 24 16:49:32.422734 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e61b517-4098-462f-bd9d-7967a373d9e5 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a12374a3093a401a97c343ff0854184d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3b3940d4ae1c4177ae29c02377bb4b0b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=71938) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 24 16:49:32.424139 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e61b517-4098-462f-bd9d-7967a373d9e5 service cinder] REQUEST_METHOD: `GET` {{(pid=71938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 24 16:49:32.424986 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e61b517-4098-462f-bd9d-7967a373d9e5 service cinder] SCRIPT_NAME: `/identity` {{(pid=71938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 24 16:49:32.425969 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e61b517-4098-462f-bd9d-7967a373d9e5 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=71938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 24 16:49:32.434227 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: [pid: 71939|app: 0|req: 1113/2210] 10.222.0.53 () {60 vars in 1143 bytes} [Wed Nov 24 16:49:32 2021] POST /identity/v3/projects => generated 391 bytes in 315 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 24 16:49:32.437607 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77345f6a-db31-4eb1-9089-929dba12819b admin admin] Authenticating user token {{(pid=71939) process_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 24 16:49:32.440290 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e61b517-4098-462f-bd9d-7967a373d9e5 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=71938) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:442}} Nov 24 16:49:32.485554 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e61b517-4098-462f-bd9d-7967a373d9e5 service cinder] RBAC: Authorization granted {{(pid=71938) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 24 16:49:32.503776 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: [pid: 71938|app: 0|req: 1098/2211] 10.222.0.53 () {60 vars in 1356 bytes} [Wed Nov 24 16:49:32 2021] GET /identity/v3/auth/tokens => generated 3757 bytes in 199 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 24 16:49:32.535715 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77345f6a-db31-4eb1-9089-929dba12819b admin admin] Validating token access rules against request {{(pid=71939) validate_allowed_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 24 16:49:32.541527 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c38b8ed-df55-4d05-a6e0-04fd527c82d5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f2ba2e8375b4e8c8792ee1e22b60427', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '00a5583c7b7443e98e7a1d31a0b638dc', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=71939) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 24 16:49:32.542170 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c38b8ed-df55-4d05-a6e0-04fd527c82d5 admin admin] REQUEST_METHOD: `POST` {{(pid=71939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 24 16:49:32.542651 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c38b8ed-df55-4d05-a6e0-04fd527c82d5 admin admin] SCRIPT_NAME: `/identity` {{(pid=71939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 24 16:49:32.543054 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c38b8ed-df55-4d05-a6e0-04fd527c82d5 admin admin] PATH_INFO: `/v3/users` {{(pid=71939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 24 16:49:32.543802 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c38b8ed-df55-4d05-a6e0-04fd527c82d5 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=71939) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:442}} Nov 24 16:49:32.579453 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c38b8ed-df55-4d05-a6e0-04fd527c82d5 admin admin] RBAC: Authorization granted {{(pid=71939) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 24 16:49:32.606078 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: [pid: 71939|app: 0|req: 1114/2212] 10.222.0.53 () {60 vars in 1134 bytes} [Wed Nov 24 16:49:32 2021] POST /identity/v3/users => generated 296 bytes in 166 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 24 16:49:32.607703 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e61b517-4098-462f-bd9d-7967a373d9e5 service cinder] Authenticating user token {{(pid=71938) process_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 24 16:49:32.618949 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e61b517-4098-462f-bd9d-7967a373d9e5 service cinder] Validating token access rules against request {{(pid=71938) validate_allowed_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 24 16:49:32.625418 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7e51ca7-4bf2-48a1-8c26-b083ff004d7a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f2ba2e8375b4e8c8792ee1e22b60427', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '00a5583c7b7443e98e7a1d31a0b638dc', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=71938) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 24 16:49:32.626492 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7e51ca7-4bf2-48a1-8c26-b083ff004d7a admin admin] REQUEST_METHOD: `GET` {{(pid=71938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 24 16:49:32.626877 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7e51ca7-4bf2-48a1-8c26-b083ff004d7a admin admin] SCRIPT_NAME: `/identity` {{(pid=71938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 24 16:49:32.627212 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7e51ca7-4bf2-48a1-8c26-b083ff004d7a admin admin] PATH_INFO: `/v3/roles` {{(pid=71938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 24 16:49:32.627997 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7e51ca7-4bf2-48a1-8c26-b083ff004d7a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=71938) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:442}} Nov 24 16:49:32.632101 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c38b8ed-df55-4d05-a6e0-04fd527c82d5 admin admin] Authenticating user token {{(pid=71939) process_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 24 16:49:32.659489 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7e51ca7-4bf2-48a1-8c26-b083ff004d7a admin admin] RBAC: Authorization granted {{(pid=71938) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 24 16:49:32.672105 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: [pid: 71938|app: 0|req: 1099/2213] 10.222.0.53 () {58 vars in 1112 bytes} [Wed Nov 24 16:49:32 2021] GET /identity/v3/roles => generated 1420 bytes in 65 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 24 16:49:32.676317 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7e51ca7-4bf2-48a1-8c26-b083ff004d7a admin admin] Authenticating user token {{(pid=71938) process_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 24 16:49:32.687095 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7e51ca7-4bf2-48a1-8c26-b083ff004d7a admin admin] Validating token access rules against request {{(pid=71938) validate_allowed_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 24 16:49:32.692320 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2d32b3b-7b37-4bd3-ad41-0ad0396c5f50 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f2ba2e8375b4e8c8792ee1e22b60427', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '00a5583c7b7443e98e7a1d31a0b638dc', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=71938) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 24 16:49:32.693075 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2d32b3b-7b37-4bd3-ad41-0ad0396c5f50 admin admin] REQUEST_METHOD: `PUT` {{(pid=71938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 24 16:49:32.693429 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2d32b3b-7b37-4bd3-ad41-0ad0396c5f50 admin admin] SCRIPT_NAME: `/identity` {{(pid=71938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 24 16:49:32.693762 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2d32b3b-7b37-4bd3-ad41-0ad0396c5f50 admin admin] PATH_INFO: `/v3/projects/c6bec5981a7541ba828ae55abd924a85/users/2a783a33a0cb4a53a6be6ad9efccb259/roles/912ab5f10fa5477da74acf239f07604e` {{(pid=71938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 24 16:49:32.706475 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c38b8ed-df55-4d05-a6e0-04fd527c82d5 admin admin] Validating token access rules against request {{(pid=71939) validate_allowed_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 24 16:49:32.710801 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d304a135-11e5-4ae0-b165-43221b7b5f3f service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a12374a3093a401a97c343ff0854184d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3b3940d4ae1c4177ae29c02377bb4b0b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=71939) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 24 16:49:32.711563 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d304a135-11e5-4ae0-b165-43221b7b5f3f service cinder] REQUEST_METHOD: `GET` {{(pid=71939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 24 16:49:32.711910 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d304a135-11e5-4ae0-b165-43221b7b5f3f service cinder] SCRIPT_NAME: `/identity` {{(pid=71939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 24 16:49:32.712216 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d304a135-11e5-4ae0-b165-43221b7b5f3f service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=71939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 24 16:49:32.714267 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.fernet_utils [None req-d304a135-11e5-4ae0-b165-43221b7b5f3f service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=71939) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:289}} Nov 24 16:49:32.716240 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2d32b3b-7b37-4bd3-ad41-0ad0396c5f50 admin admin] RBAC: Authorizing `identity:create_grant(project_id=c6bec5981a7541ba828ae55abd924a85, user_id=2a783a33a0cb4a53a6be6ad9efccb259, role_id=912ab5f10fa5477da74acf239f07604e)` {{(pid=71938) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:442}} Nov 24 16:49:32.747131 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2d32b3b-7b37-4bd3-ad41-0ad0396c5f50 admin admin] RBAC: Authorization granted {{(pid=71938) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 24 16:49:32.761407 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: [pid: 71938|app: 0|req: 1100/2214] 10.222.0.53 () {60 vars in 1473 bytes} [Wed Nov 24 16:49:32 2021] PUT /identity/v3/projects/c6bec5981a7541ba828ae55abd924a85/users/2a783a33a0cb4a53a6be6ad9efccb259/roles/912ab5f10fa5477da74acf239f07604e => generated 0 bytes in 85 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Nov 24 16:49:32.773704 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdf10b91-7a4f-488f-a3e0-aa709a6ae08b None None] REQUEST_METHOD: `POST` {{(pid=71938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 24 16:49:32.774060 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdf10b91-7a4f-488f-a3e0-aa709a6ae08b None None] SCRIPT_NAME: `/identity` {{(pid=71938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 24 16:49:32.774448 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdf10b91-7a4f-488f-a3e0-aa709a6ae08b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=71938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 24 16:49:32.795645 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d304a135-11e5-4ae0-b165-43221b7b5f3f service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=71939) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:442}} Nov 24 16:49:32.814599 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.auth.core [None req-bdf10b91-7a4f-488f-a3e0-aa709a6ae08b None None] MFA Rules not processed for user `2a783a33a0cb4a53a6be6ad9efccb259`. Rule list: `[]` (Enabled: `True`). {{(pid=71938) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:442}} Nov 24 16:49:32.815908 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.fernet_utils [None req-bdf10b91-7a4f-488f-a3e0-aa709a6ae08b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=71938) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:289}} Nov 24 16:49:32.828251 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d304a135-11e5-4ae0-b165-43221b7b5f3f service cinder] RBAC: Authorization granted {{(pid=71939) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 24 16:49:32.839687 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: [pid: 71939|app: 0|req: 1115/2215] 10.222.0.53 () {60 vars in 1356 bytes} [Wed Nov 24 16:49:32 2021] GET /identity/v3/auth/tokens => generated 3690 bytes in 208 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Nov 24 16:49:32.908853 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: [pid: 71938|app: 0|req: 1101/2216] 10.222.0.53 () {58 vars in 948 bytes} [Wed Nov 24 16:49:32 2021] POST /identity/v3/auth/tokens => generated 3698 bytes in 136 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Nov 24 16:49:32.914902 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d304a135-11e5-4ae0-b165-43221b7b5f3f service cinder] Authenticating user token {{(pid=71939) process_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 24 16:49:32.925574 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d304a135-11e5-4ae0-b165-43221b7b5f3f service cinder] Validating token access rules against request {{(pid=71939) validate_allowed_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 24 16:49:33.099077 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb566a16-0aab-4349-bb7e-6b5639f5ab56 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f2ba2e8375b4e8c8792ee1e22b60427', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '00a5583c7b7443e98e7a1d31a0b638dc', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=71939) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 24 16:49:33.100316 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb566a16-0aab-4349-bb7e-6b5639f5ab56 admin admin] REQUEST_METHOD: `POST` {{(pid=71939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 24 16:49:33.100662 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb566a16-0aab-4349-bb7e-6b5639f5ab56 admin admin] SCRIPT_NAME: `/identity` {{(pid=71939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 24 16:49:33.101005 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb566a16-0aab-4349-bb7e-6b5639f5ab56 admin admin] PATH_INFO: `/v3/projects` {{(pid=71939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 24 16:49:33.101762 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb566a16-0aab-4349-bb7e-6b5639f5ab56 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=71939) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:442}} Nov 24 16:49:33.132325 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb566a16-0aab-4349-bb7e-6b5639f5ab56 admin admin] RBAC: Authorization granted {{(pid=71939) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 24 16:49:33.184715 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: [pid: 71939|app: 0|req: 1116/2217] 10.222.0.53 () {60 vars in 1143 bytes} [Wed Nov 24 16:49:32 2021] POST /identity/v3/projects => generated 393 bytes in 269 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 24 16:49:33.186077 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdf10b91-7a4f-488f-a3e0-aa709a6ae08b None None] Authenticating user token {{(pid=71938) process_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 24 16:49:33.199947 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdf10b91-7a4f-488f-a3e0-aa709a6ae08b None None] Validating token access rules against request {{(pid=71938) validate_allowed_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 24 16:49:33.292830 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52182baa-65d9-4c18-933a-95db91b30308 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f2ba2e8375b4e8c8792ee1e22b60427', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '00a5583c7b7443e98e7a1d31a0b638dc', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=71938) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 24 16:49:33.293515 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52182baa-65d9-4c18-933a-95db91b30308 admin admin] REQUEST_METHOD: `POST` {{(pid=71938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 24 16:49:33.293973 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52182baa-65d9-4c18-933a-95db91b30308 admin admin] SCRIPT_NAME: `/identity` {{(pid=71938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 24 16:49:33.294384 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52182baa-65d9-4c18-933a-95db91b30308 admin admin] PATH_INFO: `/v3/users` {{(pid=71938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 24 16:49:33.295278 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52182baa-65d9-4c18-933a-95db91b30308 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=71938) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:442}} Nov 24 16:49:33.312174 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb566a16-0aab-4349-bb7e-6b5639f5ab56 admin admin] Authenticating user token {{(pid=71939) process_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 24 16:49:33.323660 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb566a16-0aab-4349-bb7e-6b5639f5ab56 admin admin] Validating token access rules against request {{(pid=71939) validate_allowed_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 24 16:49:33.326442 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52182baa-65d9-4c18-933a-95db91b30308 admin admin] RBAC: Authorization granted {{(pid=71938) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 24 16:49:33.329274 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-891c3f9c-3977-4ac5-8e5f-ce7ff91527ad admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f2ba2e8375b4e8c8792ee1e22b60427', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '00a5583c7b7443e98e7a1d31a0b638dc', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=71939) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 24 16:49:33.330244 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-891c3f9c-3977-4ac5-8e5f-ce7ff91527ad admin admin] REQUEST_METHOD: `DELETE` {{(pid=71939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 24 16:49:33.330589 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-891c3f9c-3977-4ac5-8e5f-ce7ff91527ad admin admin] SCRIPT_NAME: `/identity` {{(pid=71939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 24 16:49:33.330922 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-891c3f9c-3977-4ac5-8e5f-ce7ff91527ad admin admin] PATH_INFO: `/v3/users/920befadbfa0468ca156b135804947b1` {{(pid=71939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 24 16:49:33.332164 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-891c3f9c-3977-4ac5-8e5f-ce7ff91527ad admin admin] RBAC: Authorizing `identity:delete_user(user_id=920befadbfa0468ca156b135804947b1)` {{(pid=71939) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:442}} Nov 24 16:49:33.347344 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: [pid: 71938|app: 0|req: 1102/2218] 10.222.0.53 () {60 vars in 1134 bytes} [Wed Nov 24 16:49:33 2021] POST /identity/v3/users => generated 303 bytes in 162 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 24 16:49:33.353843 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52182baa-65d9-4c18-933a-95db91b30308 admin admin] Authenticating user token {{(pid=71938) process_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 24 16:49:33.364084 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52182baa-65d9-4c18-933a-95db91b30308 admin admin] Validating token access rules against request {{(pid=71938) validate_allowed_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 24 16:49:33.364779 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-891c3f9c-3977-4ac5-8e5f-ce7ff91527ad admin admin] RBAC: Authorization granted {{(pid=71939) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 24 16:49:33.369375 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6930ebd8-3fd2-4e55-9750-96b3a7080ce8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f2ba2e8375b4e8c8792ee1e22b60427', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '00a5583c7b7443e98e7a1d31a0b638dc', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=71938) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 24 16:49:33.370110 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6930ebd8-3fd2-4e55-9750-96b3a7080ce8 admin admin] REQUEST_METHOD: `GET` {{(pid=71938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 24 16:49:33.370455 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6930ebd8-3fd2-4e55-9750-96b3a7080ce8 admin admin] SCRIPT_NAME: `/identity` {{(pid=71938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 24 16:49:33.370787 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6930ebd8-3fd2-4e55-9750-96b3a7080ce8 admin admin] PATH_INFO: `/v3/roles` {{(pid=71938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 24 16:49:33.371573 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6930ebd8-3fd2-4e55-9750-96b3a7080ce8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=71938) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:442}} Nov 24 16:49:33.405219 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6930ebd8-3fd2-4e55-9750-96b3a7080ce8 admin admin] RBAC: Authorization granted {{(pid=71938) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 24 16:49:33.416958 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: [pid: 71938|app: 0|req: 1103/2219] 10.222.0.53 () {58 vars in 1112 bytes} [Wed Nov 24 16:49:33 2021] GET /identity/v3/roles => generated 1420 bytes in 65 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Nov 24 16:49:33.420468 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.notifications [None req-891c3f9c-3977-4ac5-8e5f-ce7ff91527ad admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '920befadbfa0468ca156b135804947b1'} {{(pid=71939) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:357}} Nov 24 16:49:33.421386 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6930ebd8-3fd2-4e55-9750-96b3a7080ce8 admin admin] Authenticating user token {{(pid=71938) process_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 24 16:49:33.432413 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6930ebd8-3fd2-4e55-9750-96b3a7080ce8 admin admin] Validating token access rules against request {{(pid=71938) validate_allowed_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 24 16:49:33.434945 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.notifications [None req-891c3f9c-3977-4ac5-8e5f-ce7ff91527ad admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '920befadbfa0468ca156b135804947b1'} {{(pid=71939) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:357}} Nov 24 16:49:33.435775 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.notifications [None req-891c3f9c-3977-4ac5-8e5f-ce7ff91527ad admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '920befadbfa0468ca156b135804947b1'} {{(pid=71939) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:357}} Nov 24 16:49:33.437646 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-515d0322-4c28-4470-a804-b614d6b28611 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f2ba2e8375b4e8c8792ee1e22b60427', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '00a5583c7b7443e98e7a1d31a0b638dc', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=71938) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 24 16:49:33.438567 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-515d0322-4c28-4470-a804-b614d6b28611 admin admin] REQUEST_METHOD: `PUT` {{(pid=71938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 24 16:49:33.438877 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-515d0322-4c28-4470-a804-b614d6b28611 admin admin] SCRIPT_NAME: `/identity` {{(pid=71938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 24 16:49:33.439219 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-515d0322-4c28-4470-a804-b614d6b28611 admin admin] PATH_INFO: `/v3/projects/d93fbb4457ea4f3aadd2b195c740372a/users/cbe4dd835e124b099afbcbb20a16ef73/roles/5611724e350b41e19921b5961a342582` {{(pid=71938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 24 16:49:33.445584 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.notifications [None req-891c3f9c-3977-4ac5-8e5f-ce7ff91527ad admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '920befadbfa0468ca156b135804947b1'} {{(pid=71939) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:357}} Nov 24 16:49:33.452812 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.notifications [None req-891c3f9c-3977-4ac5-8e5f-ce7ff91527ad admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '920befadbfa0468ca156b135804947b1'} {{(pid=71939) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:357}} Nov 24 16:49:33.460143 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: [pid: 71939|app: 0|req: 1117/2220] 10.222.0.53 () {58 vars in 1214 bytes} [Wed Nov 24 16:49:33 2021] DELETE /identity/v3/users/920befadbfa0468ca156b135804947b1 => generated 0 bytes in 148 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Nov 24 16:49:33.464371 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-515d0322-4c28-4470-a804-b614d6b28611 admin admin] RBAC: Authorizing `identity:create_grant(project_id=d93fbb4457ea4f3aadd2b195c740372a, user_id=cbe4dd835e124b099afbcbb20a16ef73, role_id=5611724e350b41e19921b5961a342582)` {{(pid=71938) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:442}} Nov 24 16:49:33.464758 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8367fe9e-3134-46f1-9bf2-c10ce1fd5216 None None] REQUEST_METHOD: `POST` {{(pid=71939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 24 16:49:33.465111 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8367fe9e-3134-46f1-9bf2-c10ce1fd5216 None None] SCRIPT_NAME: `/identity` {{(pid=71939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 24 16:49:33.465449 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8367fe9e-3134-46f1-9bf2-c10ce1fd5216 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=71939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 24 16:49:33.489889 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.auth.core [None req-8367fe9e-3134-46f1-9bf2-c10ce1fd5216 None None] MFA Rules not processed for user `0f2ba2e8375b4e8c8792ee1e22b60427`. Rule list: `[]` (Enabled: `True`). {{(pid=71939) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:442}} Nov 24 16:49:33.491746 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.fernet_utils [None req-8367fe9e-3134-46f1-9bf2-c10ce1fd5216 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=71939) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:289}} Nov 24 16:49:33.495598 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-515d0322-4c28-4470-a804-b614d6b28611 admin admin] RBAC: Authorization granted {{(pid=71938) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 24 16:49:33.516211 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: [pid: 71938|app: 0|req: 1104/2221] 10.222.0.53 () {60 vars in 1473 bytes} [Wed Nov 24 16:49:33 2021] PUT /identity/v3/projects/d93fbb4457ea4f3aadd2b195c740372a/users/cbe4dd835e124b099afbcbb20a16ef73/roles/5611724e350b41e19921b5961a342582 => generated 0 bytes in 93 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Nov 24 16:49:33.518462 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-515d0322-4c28-4470-a804-b614d6b28611 admin admin] Authenticating user token {{(pid=71938) process_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 24 16:49:33.520230 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.fernet_utils [None req-515d0322-4c28-4470-a804-b614d6b28611 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=71938) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:289}} Nov 24 16:49:33.604453 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-515d0322-4c28-4470-a804-b614d6b28611 admin admin] Validating token access rules against request {{(pid=71938) validate_allowed_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 24 16:49:33.610178 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46b385df-4270-4f08-9ec0-c868c37689ea admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f2ba2e8375b4e8c8792ee1e22b60427', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '00a5583c7b7443e98e7a1d31a0b638dc', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=71938) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 24 16:49:33.610878 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46b385df-4270-4f08-9ec0-c868c37689ea admin admin] REQUEST_METHOD: `GET` {{(pid=71938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 24 16:49:33.611394 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46b385df-4270-4f08-9ec0-c868c37689ea admin admin] SCRIPT_NAME: `/identity` {{(pid=71938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 24 16:49:33.611733 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46b385df-4270-4f08-9ec0-c868c37689ea admin admin] PATH_INFO: `/v3/roles` {{(pid=71938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 24 16:49:33.612532 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46b385df-4270-4f08-9ec0-c868c37689ea admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=71938) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:442}} Nov 24 16:49:33.626756 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: [pid: 71939|app: 0|req: 1118/2222] 10.222.0.53 () {58 vars in 948 bytes} [Wed Nov 24 16:49:33 2021] POST /identity/v3/auth/tokens => generated 3669 bytes in 163 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Nov 24 16:49:33.646064 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46b385df-4270-4f08-9ec0-c868c37689ea admin admin] RBAC: Authorization granted {{(pid=71938) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 24 16:49:33.683876 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: [pid: 71938|app: 0|req: 1105/2223] 10.222.0.53 () {58 vars in 1112 bytes} [Wed Nov 24 16:49:33 2021] GET /identity/v3/roles => generated 1420 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Nov 24 16:49:33.684045 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8367fe9e-3134-46f1-9bf2-c10ce1fd5216 None None] Authenticating user token {{(pid=71939) process_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 24 16:49:33.684769 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.fernet_utils [None req-8367fe9e-3134-46f1-9bf2-c10ce1fd5216 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=71939) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:289}} Nov 24 16:49:33.690761 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46b385df-4270-4f08-9ec0-c868c37689ea admin admin] Authenticating user token {{(pid=71938) process_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 24 16:49:33.713551 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46b385df-4270-4f08-9ec0-c868c37689ea admin admin] Validating token access rules against request {{(pid=71938) validate_allowed_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 24 16:49:33.726432 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90de25bf-633d-4532-b588-d85194e76b6c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f2ba2e8375b4e8c8792ee1e22b60427', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '00a5583c7b7443e98e7a1d31a0b638dc', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=71938) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 24 16:49:33.727370 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90de25bf-633d-4532-b588-d85194e76b6c admin admin] REQUEST_METHOD: `PUT` {{(pid=71938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 24 16:49:33.729868 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90de25bf-633d-4532-b588-d85194e76b6c admin admin] SCRIPT_NAME: `/identity` {{(pid=71938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 24 16:49:33.729868 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90de25bf-633d-4532-b588-d85194e76b6c admin admin] PATH_INFO: `/v3/projects/d93fbb4457ea4f3aadd2b195c740372a/users/cbe4dd835e124b099afbcbb20a16ef73/roles/5611724e350b41e19921b5961a342582` {{(pid=71938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 24 16:49:33.735381 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90de25bf-633d-4532-b588-d85194e76b6c admin admin] RBAC: Authorizing `identity:create_grant(project_id=d93fbb4457ea4f3aadd2b195c740372a, user_id=cbe4dd835e124b099afbcbb20a16ef73, role_id=5611724e350b41e19921b5961a342582)` {{(pid=71938) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:442}} Nov 24 16:49:33.793127 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90de25bf-633d-4532-b588-d85194e76b6c admin admin] RBAC: Authorization granted {{(pid=71938) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 24 16:49:33.815929 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: [pid: 71938|app: 0|req: 1106/2224] 10.222.0.53 () {60 vars in 1473 bytes} [Wed Nov 24 16:49:33 2021] PUT /identity/v3/projects/d93fbb4457ea4f3aadd2b195c740372a/users/cbe4dd835e124b099afbcbb20a16ef73/roles/5611724e350b41e19921b5961a342582 => generated 0 bytes in 130 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 24 16:49:33.817408 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90de25bf-633d-4532-b588-d85194e76b6c admin admin] Authenticating user token {{(pid=71938) process_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 24 16:49:33.820217 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.fernet_utils [None req-90de25bf-633d-4532-b588-d85194e76b6c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=71938) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:289}} Nov 24 16:49:33.823183 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8367fe9e-3134-46f1-9bf2-c10ce1fd5216 None None] Validating token access rules against request {{(pid=71939) validate_allowed_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 24 16:49:33.894702 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1746f2f-ba9d-4489-a878-5aff7add9666 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c90f21b9cdcb413282461fa83cb6b7a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3b3940d4ae1c4177ae29c02377bb4b0b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=71939) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 24 16:49:33.895363 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1746f2f-ba9d-4489-a878-5aff7add9666 service neutron] REQUEST_METHOD: `GET` {{(pid=71939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 24 16:49:33.897532 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1746f2f-ba9d-4489-a878-5aff7add9666 service neutron] SCRIPT_NAME: `/identity` {{(pid=71939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 24 16:49:33.897872 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1746f2f-ba9d-4489-a878-5aff7add9666 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=71939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 24 16:49:33.911865 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90de25bf-633d-4532-b588-d85194e76b6c admin admin] Validating token access rules against request {{(pid=71938) validate_allowed_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 24 16:49:33.917359 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-402aea9a-2ebf-494a-8b2e-20e23c07cb34 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f2ba2e8375b4e8c8792ee1e22b60427', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '00a5583c7b7443e98e7a1d31a0b638dc', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=71938) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 24 16:49:33.918297 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-402aea9a-2ebf-494a-8b2e-20e23c07cb34 admin admin] REQUEST_METHOD: `DELETE` {{(pid=71938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 24 16:49:33.918639 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-402aea9a-2ebf-494a-8b2e-20e23c07cb34 admin admin] SCRIPT_NAME: `/identity` {{(pid=71938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 24 16:49:33.918976 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-402aea9a-2ebf-494a-8b2e-20e23c07cb34 admin admin] PATH_INFO: `/v3/users/6c0736153f94443ab748da08baf8f5dc` {{(pid=71938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 24 16:49:33.920228 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-402aea9a-2ebf-494a-8b2e-20e23c07cb34 admin admin] RBAC: Authorizing `identity:delete_user(user_id=6c0736153f94443ab748da08baf8f5dc)` {{(pid=71938) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:442}} Nov 24 16:49:33.950618 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-402aea9a-2ebf-494a-8b2e-20e23c07cb34 admin admin] RBAC: Authorization granted {{(pid=71938) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 24 16:49:33.976747 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1746f2f-ba9d-4489-a878-5aff7add9666 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=71939) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:442}} Nov 24 16:49:34.002423 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.notifications [None req-402aea9a-2ebf-494a-8b2e-20e23c07cb34 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '6c0736153f94443ab748da08baf8f5dc'} {{(pid=71938) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:357}} Nov 24 16:49:34.006199 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1746f2f-ba9d-4489-a878-5aff7add9666 service neutron] RBAC: Authorization granted {{(pid=71939) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 24 16:49:34.016945 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: [pid: 71939|app: 0|req: 1119/2225] 10.222.0.53 () {60 vars in 1356 bytes} [Wed Nov 24 16:49:33 2021] GET /identity/v3/auth/tokens => generated 3669 bytes in 334 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 24 16:49:34.027641 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1746f2f-ba9d-4489-a878-5aff7add9666 service neutron] Authenticating user token {{(pid=71939) process_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 24 16:49:34.028869 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.notifications [None req-402aea9a-2ebf-494a-8b2e-20e23c07cb34 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '6c0736153f94443ab748da08baf8f5dc'} {{(pid=71938) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:357}} Nov 24 16:49:34.029966 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.notifications [None req-402aea9a-2ebf-494a-8b2e-20e23c07cb34 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '6c0736153f94443ab748da08baf8f5dc'} {{(pid=71938) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:357}} Nov 24 16:49:34.041039 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.notifications [None req-402aea9a-2ebf-494a-8b2e-20e23c07cb34 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '6c0736153f94443ab748da08baf8f5dc'} {{(pid=71938) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:357}} Nov 24 16:49:34.052359 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1746f2f-ba9d-4489-a878-5aff7add9666 service neutron] Validating token access rules against request {{(pid=71939) validate_allowed_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 24 16:49:34.052807 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.notifications [None req-402aea9a-2ebf-494a-8b2e-20e23c07cb34 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '6c0736153f94443ab748da08baf8f5dc'} {{(pid=71938) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:357}} Nov 24 16:49:34.058658 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-526c0f75-f6ac-470d-aaa2-4996f52f1f86 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f2ba2e8375b4e8c8792ee1e22b60427', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '00a5583c7b7443e98e7a1d31a0b638dc', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=71939) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 24 16:49:34.059502 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-526c0f75-f6ac-470d-aaa2-4996f52f1f86 admin admin] REQUEST_METHOD: `GET` {{(pid=71939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 24 16:49:34.060433 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-526c0f75-f6ac-470d-aaa2-4996f52f1f86 admin admin] SCRIPT_NAME: `/identity` {{(pid=71939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 24 16:49:34.060778 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-526c0f75-f6ac-470d-aaa2-4996f52f1f86 admin admin] PATH_INFO: `/v3/roles` {{(pid=71939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 24 16:49:34.061584 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-526c0f75-f6ac-470d-aaa2-4996f52f1f86 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=71939) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:442}} Nov 24 16:49:34.070768 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: [pid: 71938|app: 0|req: 1107/2226] 10.222.0.53 () {58 vars in 1214 bytes} [Wed Nov 24 16:49:33 2021] DELETE /identity/v3/users/6c0736153f94443ab748da08baf8f5dc => generated 0 bytes in 251 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 24 16:49:34.122069 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-526c0f75-f6ac-470d-aaa2-4996f52f1f86 admin admin] RBAC: Authorization granted {{(pid=71939) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 24 16:49:34.137745 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: [pid: 71939|app: 0|req: 1120/2227] 10.222.0.53 () {58 vars in 1112 bytes} [Wed Nov 24 16:49:34 2021] GET /identity/v3/roles => generated 1420 bytes in 111 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 24 16:49:34.142394 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-402aea9a-2ebf-494a-8b2e-20e23c07cb34 admin admin] Authenticating user token {{(pid=71938) process_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 24 16:49:34.144139 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.fernet_utils [None req-402aea9a-2ebf-494a-8b2e-20e23c07cb34 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=71938) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:289}} Nov 24 16:49:34.274470 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-402aea9a-2ebf-494a-8b2e-20e23c07cb34 admin admin] Validating token access rules against request {{(pid=71938) validate_allowed_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 24 16:49:34.279951 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb18ae47-2ee7-4029-ac82-35291cb7390d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f2ba2e8375b4e8c8792ee1e22b60427', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '00a5583c7b7443e98e7a1d31a0b638dc', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=71938) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 24 16:49:34.281528 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb18ae47-2ee7-4029-ac82-35291cb7390d admin admin] REQUEST_METHOD: `PUT` {{(pid=71938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 24 16:49:34.282146 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb18ae47-2ee7-4029-ac82-35291cb7390d admin admin] SCRIPT_NAME: `/identity` {{(pid=71938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 24 16:49:34.282740 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb18ae47-2ee7-4029-ac82-35291cb7390d admin admin] PATH_INFO: `/v3/projects/d93fbb4457ea4f3aadd2b195c740372a/users/cbe4dd835e124b099afbcbb20a16ef73/roles/912ab5f10fa5477da74acf239f07604e` {{(pid=71938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 24 16:49:34.285412 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb18ae47-2ee7-4029-ac82-35291cb7390d admin admin] RBAC: Authorizing `identity:create_grant(project_id=d93fbb4457ea4f3aadd2b195c740372a, user_id=cbe4dd835e124b099afbcbb20a16ef73, role_id=912ab5f10fa5477da74acf239f07604e)` {{(pid=71938) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:442}} Nov 24 16:49:34.321967 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb18ae47-2ee7-4029-ac82-35291cb7390d admin admin] RBAC: Authorization granted {{(pid=71938) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 24 16:49:34.346257 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: [pid: 71938|app: 0|req: 1108/2228] 10.222.0.53 () {60 vars in 1473 bytes} [Wed Nov 24 16:49:34 2021] PUT /identity/v3/projects/d93fbb4457ea4f3aadd2b195c740372a/users/cbe4dd835e124b099afbcbb20a16ef73/roles/912ab5f10fa5477da74acf239f07604e => generated 0 bytes in 200 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 24 16:49:34.356911 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c25b47f8-70e6-46e9-b649-0af51aa2e5d8 None None] REQUEST_METHOD: `POST` {{(pid=71939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 24 16:49:34.357444 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c25b47f8-70e6-46e9-b649-0af51aa2e5d8 None None] SCRIPT_NAME: `/identity` {{(pid=71939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 24 16:49:34.357793 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c25b47f8-70e6-46e9-b649-0af51aa2e5d8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=71939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 24 16:49:34.442822 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.auth.core [None req-c25b47f8-70e6-46e9-b649-0af51aa2e5d8 None None] MFA Rules not processed for user `cbe4dd835e124b099afbcbb20a16ef73`. Rule list: `[]` (Enabled: `True`). {{(pid=71939) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:442}} Nov 24 16:49:34.445006 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.fernet_utils [None req-c25b47f8-70e6-46e9-b649-0af51aa2e5d8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=71939) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:289}} Nov 24 16:49:34.485079 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb18ae47-2ee7-4029-ac82-35291cb7390d admin admin] Authenticating user token {{(pid=71938) process_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 24 16:49:34.487088 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.fernet_utils [None req-eb18ae47-2ee7-4029-ac82-35291cb7390d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=71938) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:289}} Nov 24 16:49:34.575786 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: [pid: 71939|app: 0|req: 1121/2229] 10.222.0.53 () {58 vars in 948 bytes} [Wed Nov 24 16:49:34 2021] POST /identity/v3/auth/tokens => generated 3767 bytes in 220 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 24 16:49:34.575997 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb18ae47-2ee7-4029-ac82-35291cb7390d admin admin] Validating token access rules against request {{(pid=71938) validate_allowed_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 24 16:49:34.576613 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c25b47f8-70e6-46e9-b649-0af51aa2e5d8 None None] Authenticating user token {{(pid=71939) process_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 24 16:49:34.577958 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.fernet_utils [None req-c25b47f8-70e6-46e9-b649-0af51aa2e5d8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=71939) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:289}} Nov 24 16:49:34.582631 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a173e84e-faa9-47cf-b099-dc1c57a69d22 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f2ba2e8375b4e8c8792ee1e22b60427', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '00a5583c7b7443e98e7a1d31a0b638dc', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=71938) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 24 16:49:34.583534 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a173e84e-faa9-47cf-b099-dc1c57a69d22 admin admin] REQUEST_METHOD: `DELETE` {{(pid=71938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 24 16:49:34.584778 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a173e84e-faa9-47cf-b099-dc1c57a69d22 admin admin] SCRIPT_NAME: `/identity` {{(pid=71938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 24 16:49:34.584778 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a173e84e-faa9-47cf-b099-dc1c57a69d22 admin admin] PATH_INFO: `/v3/projects/27f6e3f342f34f6d90b56c3a61fd46ca` {{(pid=71938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 24 16:49:34.591092 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c25b47f8-70e6-46e9-b649-0af51aa2e5d8 None None] Validating token access rules against request {{(pid=71939) validate_allowed_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 24 16:49:34.592900 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a173e84e-faa9-47cf-b099-dc1c57a69d22 admin admin] RBAC: Authorizing `identity:delete_project(project_id=27f6e3f342f34f6d90b56c3a61fd46ca)` {{(pid=71938) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:442}} Nov 24 16:49:34.596116 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7a50f51-cf21-4b77-a0d2-867440a940c7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f2ba2e8375b4e8c8792ee1e22b60427', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '00a5583c7b7443e98e7a1d31a0b638dc', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=71939) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 24 16:49:34.596989 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7a50f51-cf21-4b77-a0d2-867440a940c7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=71939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 24 16:49:34.597328 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7a50f51-cf21-4b77-a0d2-867440a940c7 admin admin] SCRIPT_NAME: `/identity` {{(pid=71939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 24 16:49:34.597660 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7a50f51-cf21-4b77-a0d2-867440a940c7 admin admin] PATH_INFO: `/v3/projects/66a4bf85a8d348da9024cbcec9ae8d8b` {{(pid=71939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 24 16:49:34.598924 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7a50f51-cf21-4b77-a0d2-867440a940c7 admin admin] RBAC: Authorizing `identity:delete_project(project_id=66a4bf85a8d348da9024cbcec9ae8d8b)` {{(pid=71939) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:442}} Nov 24 16:49:34.623793 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a173e84e-faa9-47cf-b099-dc1c57a69d22 admin admin] RBAC: Authorization granted {{(pid=71938) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 24 16:49:34.627845 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7a50f51-cf21-4b77-a0d2-867440a940c7 admin admin] RBAC: Authorization granted {{(pid=71939) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 24 16:49:34.674369 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.notifications [None req-a173e84e-faa9-47cf-b099-dc1c57a69d22 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '27f6e3f342f34f6d90b56c3a61fd46ca', 'request_id': 'req-a173e84e-faa9-47cf-b099-dc1c57a69d22'} {{(pid=71938) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:357}} Nov 24 16:49:34.679647 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.notifications [None req-d7a50f51-cf21-4b77-a0d2-867440a940c7 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '66a4bf85a8d348da9024cbcec9ae8d8b', 'request_id': 'req-d7a50f51-cf21-4b77-a0d2-867440a940c7'} {{(pid=71939) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:357}} Nov 24 16:49:34.689274 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.notifications [None req-a173e84e-faa9-47cf-b099-dc1c57a69d22 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '27f6e3f342f34f6d90b56c3a61fd46ca', 'request_id': 'req-a173e84e-faa9-47cf-b099-dc1c57a69d22'} {{(pid=71938) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:357}} Nov 24 16:49:34.692780 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.notifications [None req-d7a50f51-cf21-4b77-a0d2-867440a940c7 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '66a4bf85a8d348da9024cbcec9ae8d8b', 'request_id': 'req-d7a50f51-cf21-4b77-a0d2-867440a940c7'} {{(pid=71939) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:357}} Nov 24 16:49:34.698942 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.notifications [None req-a173e84e-faa9-47cf-b099-dc1c57a69d22 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '27f6e3f342f34f6d90b56c3a61fd46ca', 'request_id': 'req-a173e84e-faa9-47cf-b099-dc1c57a69d22'} {{(pid=71938) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:357}} Nov 24 16:49:34.700355 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.notifications [None req-d7a50f51-cf21-4b77-a0d2-867440a940c7 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '66a4bf85a8d348da9024cbcec9ae8d8b', 'request_id': 'req-d7a50f51-cf21-4b77-a0d2-867440a940c7'} {{(pid=71939) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:357}} Nov 24 16:49:34.708629 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.notifications [None req-a173e84e-faa9-47cf-b099-dc1c57a69d22 admin admin] The token cache is being invalidate because project 27f6e3f342f34f6d90b56c3a61fd46ca was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=71938) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Nov 24 16:49:34.709035 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.notifications [None req-a173e84e-faa9-47cf-b099-dc1c57a69d22 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=71938) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:357}} Nov 24 16:49:34.709786 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.notifications [None req-a173e84e-faa9-47cf-b099-dc1c57a69d22 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=71938) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:357}} Nov 24 16:49:34.711416 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: [pid: 71938|app: 0|req: 1109/2230] 10.222.0.53 () {58 vars in 1223 bytes} [Wed Nov 24 16:49:34 2021] DELETE /identity/v3/projects/27f6e3f342f34f6d90b56c3a61fd46ca => generated 0 bytes in 230 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 24 16:49:34.714658 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.notifications [None req-d7a50f51-cf21-4b77-a0d2-867440a940c7 admin admin] The token cache is being invalidate because project 66a4bf85a8d348da9024cbcec9ae8d8b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=71939) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Nov 24 16:49:34.714753 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a173e84e-faa9-47cf-b099-dc1c57a69d22 admin admin] Authenticating user token {{(pid=71938) process_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 24 16:49:34.714830 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.notifications [None req-d7a50f51-cf21-4b77-a0d2-867440a940c7 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=71939) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:357}} Nov 24 16:49:34.714830 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.notifications [None req-d7a50f51-cf21-4b77-a0d2-867440a940c7 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=71939) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:357}} Nov 24 16:49:34.714983 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.fernet_utils [None req-a173e84e-faa9-47cf-b099-dc1c57a69d22 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=71938) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:289}} Nov 24 16:49:34.715054 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: [pid: 71939|app: 0|req: 1122/2231] 10.222.0.53 () {58 vars in 1223 bytes} [Wed Nov 24 16:49:34 2021] DELETE /identity/v3/projects/66a4bf85a8d348da9024cbcec9ae8d8b => generated 0 bytes in 139 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 24 16:49:34.715832 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7a50f51-cf21-4b77-a0d2-867440a940c7 admin admin] Authenticating user token {{(pid=71939) process_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 24 16:49:34.717169 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.fernet_utils [None req-d7a50f51-cf21-4b77-a0d2-867440a940c7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=71939) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:289}} Nov 24 16:49:34.785515 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a173e84e-faa9-47cf-b099-dc1c57a69d22 admin admin] Validating token access rules against request {{(pid=71938) validate_allowed_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 24 16:49:34.793059 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7a50f51-cf21-4b77-a0d2-867440a940c7 admin admin] Validating token access rules against request {{(pid=71939) validate_allowed_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 24 16:49:34.797714 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7f1edcb-bc12-47e8-a4c5-0362df013138 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f2ba2e8375b4e8c8792ee1e22b60427', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '00a5583c7b7443e98e7a1d31a0b638dc', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=71939) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 24 16:49:34.798695 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7f1edcb-bc12-47e8-a4c5-0362df013138 admin admin] REQUEST_METHOD: `DELETE` {{(pid=71939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 24 16:49:34.799035 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7f1edcb-bc12-47e8-a4c5-0362df013138 admin admin] SCRIPT_NAME: `/identity` {{(pid=71939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 24 16:49:34.799373 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7f1edcb-bc12-47e8-a4c5-0362df013138 admin admin] PATH_INFO: `/v3/users/33b29282edf14e44ab2d00bd5c9a997d` {{(pid=71939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 24 16:49:34.800614 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7f1edcb-bc12-47e8-a4c5-0362df013138 admin admin] RBAC: Authorizing `identity:delete_user(user_id=33b29282edf14e44ab2d00bd5c9a997d)` {{(pid=71939) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:442}} Nov 24 16:49:34.830498 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7f1edcb-bc12-47e8-a4c5-0362df013138 admin admin] RBAC: Authorization granted {{(pid=71939) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 24 16:49:34.848228 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7b0d507-bf0e-47cb-8cf4-eac89f80d4de service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a12374a3093a401a97c343ff0854184d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3b3940d4ae1c4177ae29c02377bb4b0b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=71938) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 24 16:49:34.848886 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7b0d507-bf0e-47cb-8cf4-eac89f80d4de service cinder] REQUEST_METHOD: `GET` {{(pid=71938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 24 16:49:34.849206 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7b0d507-bf0e-47cb-8cf4-eac89f80d4de service cinder] SCRIPT_NAME: `/identity` {{(pid=71938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 24 16:49:34.850102 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7b0d507-bf0e-47cb-8cf4-eac89f80d4de service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=71938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 24 16:49:34.852000 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.fernet_utils [None req-a7b0d507-bf0e-47cb-8cf4-eac89f80d4de service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=71938) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:289}} Nov 24 16:49:34.896973 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.notifications [None req-f7f1edcb-bc12-47e8-a4c5-0362df013138 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '33b29282edf14e44ab2d00bd5c9a997d'} {{(pid=71939) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:357}} Nov 24 16:49:34.911298 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.notifications [None req-f7f1edcb-bc12-47e8-a4c5-0362df013138 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '33b29282edf14e44ab2d00bd5c9a997d'} {{(pid=71939) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:357}} Nov 24 16:49:34.912582 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.notifications [None req-f7f1edcb-bc12-47e8-a4c5-0362df013138 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '33b29282edf14e44ab2d00bd5c9a997d'} {{(pid=71939) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:357}} Nov 24 16:49:34.922630 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.notifications [None req-f7f1edcb-bc12-47e8-a4c5-0362df013138 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '33b29282edf14e44ab2d00bd5c9a997d'} {{(pid=71939) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:357}} Nov 24 16:49:34.933515 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.notifications [None req-f7f1edcb-bc12-47e8-a4c5-0362df013138 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '33b29282edf14e44ab2d00bd5c9a997d'} {{(pid=71939) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:357}} Nov 24 16:49:34.948031 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: [pid: 71939|app: 0|req: 1123/2232] 10.222.0.53 () {58 vars in 1214 bytes} [Wed Nov 24 16:49:34 2021] DELETE /identity/v3/users/33b29282edf14e44ab2d00bd5c9a997d => generated 0 bytes in 232 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 24 16:49:34.951264 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7b0d507-bf0e-47cb-8cf4-eac89f80d4de service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=71938) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:442}} Nov 24 16:49:34.951358 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7f1edcb-bc12-47e8-a4c5-0362df013138 admin admin] Authenticating user token {{(pid=71939) process_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 24 16:49:34.952444 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.fernet_utils [None req-f7f1edcb-bc12-47e8-a4c5-0362df013138 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=71939) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:289}} Nov 24 16:49:35.002498 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7b0d507-bf0e-47cb-8cf4-eac89f80d4de service cinder] RBAC: Authorization granted {{(pid=71938) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 24 16:49:35.015876 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: [pid: 71938|app: 0|req: 1110/2233] 10.222.0.53 () {60 vars in 1356 bytes} [Wed Nov 24 16:49:34 2021] GET /identity/v3/auth/tokens => generated 3767 bytes in 304 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 24 16:49:35.108455 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7f1edcb-bc12-47e8-a4c5-0362df013138 admin admin] Validating token access rules against request {{(pid=71939) validate_allowed_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 24 16:49:35.117510 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce0c3d84-b557-4e5a-81c1-87386cbe4272 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f2ba2e8375b4e8c8792ee1e22b60427', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '00a5583c7b7443e98e7a1d31a0b638dc', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=71939) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 24 16:49:35.119407 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce0c3d84-b557-4e5a-81c1-87386cbe4272 admin admin] REQUEST_METHOD: `DELETE` {{(pid=71939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 24 16:49:35.120295 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce0c3d84-b557-4e5a-81c1-87386cbe4272 admin admin] SCRIPT_NAME: `/identity` {{(pid=71939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 24 16:49:35.120734 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce0c3d84-b557-4e5a-81c1-87386cbe4272 admin admin] PATH_INFO: `/v3/users/68fe2ddf4baf41788b31957a623776a9` {{(pid=71939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 24 16:49:35.123268 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce0c3d84-b557-4e5a-81c1-87386cbe4272 admin admin] RBAC: Authorizing `identity:delete_user(user_id=68fe2ddf4baf41788b31957a623776a9)` {{(pid=71939) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:442}} Nov 24 16:49:35.133900 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7b0d507-bf0e-47cb-8cf4-eac89f80d4de service cinder] Authenticating user token {{(pid=71938) process_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 24 16:49:35.136363 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.fernet_utils [None req-a7b0d507-bf0e-47cb-8cf4-eac89f80d4de service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=71938) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:289}} Nov 24 16:49:35.153843 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7b0d507-bf0e-47cb-8cf4-eac89f80d4de service cinder] Validating token access rules against request {{(pid=71938) validate_allowed_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 24 16:49:35.173265 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce0c3d84-b557-4e5a-81c1-87386cbe4272 admin admin] RBAC: Authorization granted {{(pid=71939) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 24 16:49:35.267292 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c50491a2-dd6c-4da3-aaf2-cb8a31dc5971 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a12374a3093a401a97c343ff0854184d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3b3940d4ae1c4177ae29c02377bb4b0b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=71938) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 24 16:49:35.268134 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c50491a2-dd6c-4da3-aaf2-cb8a31dc5971 service cinder] REQUEST_METHOD: `GET` {{(pid=71938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 24 16:49:35.268454 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c50491a2-dd6c-4da3-aaf2-cb8a31dc5971 service cinder] SCRIPT_NAME: `/identity` {{(pid=71938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 24 16:49:35.268903 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c50491a2-dd6c-4da3-aaf2-cb8a31dc5971 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=71938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 24 16:49:35.270688 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.notifications [None req-ce0c3d84-b557-4e5a-81c1-87386cbe4272 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '68fe2ddf4baf41788b31957a623776a9'} {{(pid=71939) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:357}} Nov 24 16:49:35.272044 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.fernet_utils [None req-c50491a2-dd6c-4da3-aaf2-cb8a31dc5971 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=71938) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:289}} Nov 24 16:49:35.290495 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.notifications [None req-ce0c3d84-b557-4e5a-81c1-87386cbe4272 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '68fe2ddf4baf41788b31957a623776a9'} {{(pid=71939) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:357}} Nov 24 16:49:35.291419 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.notifications [None req-ce0c3d84-b557-4e5a-81c1-87386cbe4272 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '68fe2ddf4baf41788b31957a623776a9'} {{(pid=71939) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:357}} Nov 24 16:49:35.300585 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.notifications [None req-ce0c3d84-b557-4e5a-81c1-87386cbe4272 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '68fe2ddf4baf41788b31957a623776a9'} {{(pid=71939) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:357}} Nov 24 16:49:35.307903 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.notifications [None req-ce0c3d84-b557-4e5a-81c1-87386cbe4272 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '68fe2ddf4baf41788b31957a623776a9'} {{(pid=71939) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:357}} Nov 24 16:49:35.314763 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: [pid: 71939|app: 0|req: 1124/2234] 10.222.0.53 () {58 vars in 1214 bytes} [Wed Nov 24 16:49:34 2021] DELETE /identity/v3/users/68fe2ddf4baf41788b31957a623776a9 => generated 0 bytes in 366 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 24 16:49:35.366926 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c50491a2-dd6c-4da3-aaf2-cb8a31dc5971 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=71938) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:442}} Nov 24 16:49:35.395929 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c50491a2-dd6c-4da3-aaf2-cb8a31dc5971 service cinder] RBAC: Authorization granted {{(pid=71938) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 24 16:49:35.406163 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: [pid: 71938|app: 0|req: 1111/2235] 10.222.0.53 () {60 vars in 1356 bytes} [Wed Nov 24 16:49:35 2021] GET /identity/v3/auth/tokens => generated 3698 bytes in 273 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Nov 24 16:49:35.511545 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce0c3d84-b557-4e5a-81c1-87386cbe4272 admin admin] Authenticating user token {{(pid=71939) process_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 24 16:49:35.513077 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.fernet_utils [None req-ce0c3d84-b557-4e5a-81c1-87386cbe4272 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=71939) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:289}} Nov 24 16:49:35.613707 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c50491a2-dd6c-4da3-aaf2-cb8a31dc5971 service cinder] Authenticating user token {{(pid=71938) process_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 24 16:49:35.627912 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c50491a2-dd6c-4da3-aaf2-cb8a31dc5971 service cinder] Validating token access rules against request {{(pid=71938) validate_allowed_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 24 16:49:35.636343 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8209e907-c335-47b3-b182-3189bace47d5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f2ba2e8375b4e8c8792ee1e22b60427', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '00a5583c7b7443e98e7a1d31a0b638dc', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=71938) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 24 16:49:35.638653 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8209e907-c335-47b3-b182-3189bace47d5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=71938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 24 16:49:35.639613 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8209e907-c335-47b3-b182-3189bace47d5 admin admin] SCRIPT_NAME: `/identity` {{(pid=71938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 24 16:49:35.640368 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8209e907-c335-47b3-b182-3189bace47d5 admin admin] PATH_INFO: `/v3/projects/1eba30a7ac2a454faacc84f7fefc6ba6` {{(pid=71938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 24 16:49:35.642354 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8209e907-c335-47b3-b182-3189bace47d5 admin admin] RBAC: Authorizing `identity:delete_project(project_id=1eba30a7ac2a454faacc84f7fefc6ba6)` {{(pid=71938) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:442}} Nov 24 16:49:35.642594 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce0c3d84-b557-4e5a-81c1-87386cbe4272 admin admin] Validating token access rules against request {{(pid=71939) validate_allowed_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 24 16:49:35.648531 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b2665dc-c61d-4ca6-afc0-a039ac53ec35 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f2ba2e8375b4e8c8792ee1e22b60427', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '00a5583c7b7443e98e7a1d31a0b638dc', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=71939) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 24 16:49:35.649427 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b2665dc-c61d-4ca6-afc0-a039ac53ec35 admin admin] REQUEST_METHOD: `DELETE` {{(pid=71939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 24 16:49:35.649768 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b2665dc-c61d-4ca6-afc0-a039ac53ec35 admin admin] SCRIPT_NAME: `/identity` {{(pid=71939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 24 16:49:35.650466 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b2665dc-c61d-4ca6-afc0-a039ac53ec35 admin admin] PATH_INFO: `/v3/projects/b2771cb49b804ae9a875d7b9d524986d` {{(pid=71939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 24 16:49:35.651773 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b2665dc-c61d-4ca6-afc0-a039ac53ec35 admin admin] RBAC: Authorizing `identity:delete_project(project_id=b2771cb49b804ae9a875d7b9d524986d)` {{(pid=71939) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:442}} Nov 24 16:49:35.678805 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8209e907-c335-47b3-b182-3189bace47d5 admin admin] RBAC: Authorization granted {{(pid=71938) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 24 16:49:35.682748 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b2665dc-c61d-4ca6-afc0-a039ac53ec35 admin admin] RBAC: Authorization granted {{(pid=71939) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 24 16:49:35.750984 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.notifications [None req-1b2665dc-c61d-4ca6-afc0-a039ac53ec35 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b2771cb49b804ae9a875d7b9d524986d', 'request_id': 'req-1b2665dc-c61d-4ca6-afc0-a039ac53ec35'} {{(pid=71939) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:357}} Nov 24 16:49:35.758441 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.notifications [None req-8209e907-c335-47b3-b182-3189bace47d5 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '1eba30a7ac2a454faacc84f7fefc6ba6', 'request_id': 'req-8209e907-c335-47b3-b182-3189bace47d5'} {{(pid=71938) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:357}} Nov 24 16:49:35.768696 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.notifications [None req-1b2665dc-c61d-4ca6-afc0-a039ac53ec35 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b2771cb49b804ae9a875d7b9d524986d', 'request_id': 'req-1b2665dc-c61d-4ca6-afc0-a039ac53ec35'} {{(pid=71939) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:357}} Nov 24 16:49:35.775014 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.notifications [None req-8209e907-c335-47b3-b182-3189bace47d5 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '1eba30a7ac2a454faacc84f7fefc6ba6', 'request_id': 'req-8209e907-c335-47b3-b182-3189bace47d5'} {{(pid=71938) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:357}} Nov 24 16:49:35.779120 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.notifications [None req-1b2665dc-c61d-4ca6-afc0-a039ac53ec35 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b2771cb49b804ae9a875d7b9d524986d', 'request_id': 'req-1b2665dc-c61d-4ca6-afc0-a039ac53ec35'} {{(pid=71939) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:357}} Nov 24 16:49:35.783795 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.notifications [None req-8209e907-c335-47b3-b182-3189bace47d5 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '1eba30a7ac2a454faacc84f7fefc6ba6', 'request_id': 'req-8209e907-c335-47b3-b182-3189bace47d5'} {{(pid=71938) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:357}} Nov 24 16:49:35.795679 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.notifications [None req-1b2665dc-c61d-4ca6-afc0-a039ac53ec35 admin admin] The token cache is being invalidate because project b2771cb49b804ae9a875d7b9d524986d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=71939) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Nov 24 16:49:35.795867 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.notifications [None req-1b2665dc-c61d-4ca6-afc0-a039ac53ec35 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=71939) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:357}} Nov 24 16:49:35.796616 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.notifications [None req-1b2665dc-c61d-4ca6-afc0-a039ac53ec35 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=71939) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:357}} Nov 24 16:49:35.798743 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: [pid: 71939|app: 0|req: 1125/2236] 10.222.0.53 () {58 vars in 1223 bytes} [Wed Nov 24 16:49:35 2021] DELETE /identity/v3/projects/b2771cb49b804ae9a875d7b9d524986d => generated 0 bytes in 288 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 24 16:49:35.805081 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6246f5da-585d-45d8-91ae-a744ee00794d None None] REQUEST_METHOD: `POST` {{(pid=71939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 24 16:49:35.806931 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6246f5da-585d-45d8-91ae-a744ee00794d None None] SCRIPT_NAME: `/identity` {{(pid=71939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 24 16:49:35.807422 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6246f5da-585d-45d8-91ae-a744ee00794d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=71939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 24 16:49:35.810853 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.notifications [None req-8209e907-c335-47b3-b182-3189bace47d5 admin admin] The token cache is being invalidate because project 1eba30a7ac2a454faacc84f7fefc6ba6 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=71938) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Nov 24 16:49:35.811199 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.notifications [None req-8209e907-c335-47b3-b182-3189bace47d5 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=71938) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:357}} Nov 24 16:49:35.814349 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.notifications [None req-8209e907-c335-47b3-b182-3189bace47d5 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=71938) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:357}} Nov 24 16:49:35.816131 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: [pid: 71938|app: 0|req: 1112/2237] 10.222.0.53 () {58 vars in 1223 bytes} [Wed Nov 24 16:49:35 2021] DELETE /identity/v3/projects/1eba30a7ac2a454faacc84f7fefc6ba6 => generated 0 bytes in 203 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 24 16:49:35.835312 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.auth.core [None req-6246f5da-585d-45d8-91ae-a744ee00794d None None] MFA Rules not processed for user `0f2ba2e8375b4e8c8792ee1e22b60427`. Rule list: `[]` (Enabled: `True`). {{(pid=71939) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:442}} Nov 24 16:49:35.836254 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8cb8411-d819-49a7-bbc8-932ee750a6ae None None] REQUEST_METHOD: `POST` {{(pid=71938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 24 16:49:35.836546 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.fernet_utils [None req-6246f5da-585d-45d8-91ae-a744ee00794d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=71939) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:289}} Nov 24 16:49:35.838176 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8cb8411-d819-49a7-bbc8-932ee750a6ae None None] SCRIPT_NAME: `/identity` {{(pid=71938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 24 16:49:35.839004 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8cb8411-d819-49a7-bbc8-932ee750a6ae None None] PATH_INFO: `/v3/auth/tokens` {{(pid=71938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 24 16:49:35.886307 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.auth.core [None req-f8cb8411-d819-49a7-bbc8-932ee750a6ae None None] MFA Rules not processed for user `0f2ba2e8375b4e8c8792ee1e22b60427`. Rule list: `[]` (Enabled: `True`). {{(pid=71938) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:442}} Nov 24 16:49:35.887586 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.fernet_utils [None req-f8cb8411-d819-49a7-bbc8-932ee750a6ae None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=71938) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:289}} Nov 24 16:49:35.946168 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: [pid: 71939|app: 0|req: 1126/2238] 10.222.0.53 () {58 vars in 948 bytes} [Wed Nov 24 16:49:35 2021] POST /identity/v3/auth/tokens => generated 3669 bytes in 137 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 24 16:49:35.949943 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8cd3816-618e-4fa8-bb07-6d8d0a740371 None None] REQUEST_METHOD: `POST` {{(pid=71939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 24 16:49:35.950497 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8cd3816-618e-4fa8-bb07-6d8d0a740371 None None] SCRIPT_NAME: `/identity` {{(pid=71939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 24 16:49:35.950983 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8cd3816-618e-4fa8-bb07-6d8d0a740371 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=71939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 24 16:49:35.984918 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.auth.core [None req-d8cd3816-618e-4fa8-bb07-6d8d0a740371 None None] MFA Rules not processed for user `0f2ba2e8375b4e8c8792ee1e22b60427`. Rule list: `[]` (Enabled: `True`). {{(pid=71939) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:442}} Nov 24 16:49:35.986995 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.fernet_utils [None req-d8cd3816-618e-4fa8-bb07-6d8d0a740371 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=71939) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:289}} Nov 24 16:49:36.001650 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: [pid: 71939|app: 0|req: 1127/2239] 10.222.0.53 () {58 vars in 948 bytes} [Wed Nov 24 16:49:35 2021] POST /identity/v3/auth/tokens => generated 3669 bytes in 52 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Nov 24 16:49:36.002773 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8cd3816-618e-4fa8-bb07-6d8d0a740371 None None] Authenticating user token {{(pid=71939) process_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 24 16:49:36.016033 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8cd3816-618e-4fa8-bb07-6d8d0a740371 None None] Validating token access rules against request {{(pid=71939) validate_allowed_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 24 16:49:36.020857 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20d1a0c2-850e-4ff3-b515-5c15863e3384 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f2ba2e8375b4e8c8792ee1e22b60427', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '00a5583c7b7443e98e7a1d31a0b638dc', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=71939) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 24 16:49:36.022135 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20d1a0c2-850e-4ff3-b515-5c15863e3384 admin admin] REQUEST_METHOD: `GET` {{(pid=71939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 24 16:49:36.022477 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20d1a0c2-850e-4ff3-b515-5c15863e3384 admin admin] SCRIPT_NAME: `/identity` {{(pid=71939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 24 16:49:36.022791 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20d1a0c2-850e-4ff3-b515-5c15863e3384 admin admin] PATH_INFO: `/v3/domains` {{(pid=71939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 24 16:49:36.023215 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: [pid: 71938|app: 0|req: 1113/2240] 10.222.0.53 () {58 vars in 948 bytes} [Wed Nov 24 16:49:35 2021] POST /identity/v3/auth/tokens => generated 3669 bytes in 189 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 24 16:49:36.026860 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20d1a0c2-850e-4ff3-b515-5c15863e3384 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=71939) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:161}} Nov 24 16:49:36.027233 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20d1a0c2-850e-4ff3-b515-5c15863e3384 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=71939) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:442}} Nov 24 16:49:36.031263 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ec573fd-ba04-4940-ad83-ba1896c03a7a None None] REQUEST_METHOD: `POST` {{(pid=71938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 24 16:49:36.031610 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ec573fd-ba04-4940-ad83-ba1896c03a7a None None] SCRIPT_NAME: `/identity` {{(pid=71938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 24 16:49:36.031927 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ec573fd-ba04-4940-ad83-ba1896c03a7a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=71938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 24 16:49:36.058601 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.auth.core [None req-6ec573fd-ba04-4940-ad83-ba1896c03a7a None None] MFA Rules not processed for user `0f2ba2e8375b4e8c8792ee1e22b60427`. Rule list: `[]` (Enabled: `True`). {{(pid=71938) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:442}} Nov 24 16:49:36.058802 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20d1a0c2-850e-4ff3-b515-5c15863e3384 admin admin] RBAC: Authorization granted {{(pid=71939) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 24 16:49:36.060069 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.fernet_utils [None req-6ec573fd-ba04-4940-ad83-ba1896c03a7a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=71938) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:289}} Nov 24 16:49:36.069989 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: [pid: 71938|app: 0|req: 1114/2241] 10.222.0.53 () {58 vars in 948 bytes} [Wed Nov 24 16:49:36 2021] POST /identity/v3/auth/tokens => generated 3669 bytes in 40 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Nov 24 16:49:36.074449 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ec573fd-ba04-4940-ad83-ba1896c03a7a None None] Authenticating user token {{(pid=71938) process_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 24 16:49:36.080851 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: [pid: 71939|app: 0|req: 1128/2242] 10.222.0.53 () {58 vars in 1143 bytes} [Wed Nov 24 16:49:36 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 78 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 24 16:49:36.085464 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20d1a0c2-850e-4ff3-b515-5c15863e3384 admin admin] Authenticating user token {{(pid=71939) process_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 24 16:49:36.092073 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ec573fd-ba04-4940-ad83-ba1896c03a7a None None] Validating token access rules against request {{(pid=71938) validate_allowed_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 24 16:49:36.096584 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20d1a0c2-850e-4ff3-b515-5c15863e3384 admin admin] Validating token access rules against request {{(pid=71939) validate_allowed_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 24 16:49:36.097274 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6994786d-7654-4b3d-9e1d-85ddc68b62fb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f2ba2e8375b4e8c8792ee1e22b60427', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '00a5583c7b7443e98e7a1d31a0b638dc', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=71938) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 24 16:49:36.098171 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6994786d-7654-4b3d-9e1d-85ddc68b62fb admin admin] REQUEST_METHOD: `GET` {{(pid=71938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 24 16:49:36.098575 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6994786d-7654-4b3d-9e1d-85ddc68b62fb admin admin] SCRIPT_NAME: `/identity` {{(pid=71938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 24 16:49:36.098902 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6994786d-7654-4b3d-9e1d-85ddc68b62fb admin admin] PATH_INFO: `/v3/domains` {{(pid=71938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 24 16:49:36.100268 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6994786d-7654-4b3d-9e1d-85ddc68b62fb admin admin] RBAC: Adding query filter params (name=Default) {{(pid=71938) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:161}} Nov 24 16:49:36.100629 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6994786d-7654-4b3d-9e1d-85ddc68b62fb admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=71938) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:442}} Nov 24 16:49:36.101838 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3185402-2531-408a-ba66-3a4952a44256 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f2ba2e8375b4e8c8792ee1e22b60427', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '00a5583c7b7443e98e7a1d31a0b638dc', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=71939) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 24 16:49:36.102961 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3185402-2531-408a-ba66-3a4952a44256 admin admin] REQUEST_METHOD: `POST` {{(pid=71939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 24 16:49:36.103574 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3185402-2531-408a-ba66-3a4952a44256 admin admin] SCRIPT_NAME: `/identity` {{(pid=71939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 24 16:49:36.104053 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3185402-2531-408a-ba66-3a4952a44256 admin admin] PATH_INFO: `/v3/projects` {{(pid=71939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 24 16:49:36.105141 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3185402-2531-408a-ba66-3a4952a44256 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=71939) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:442}} Nov 24 16:49:36.137739 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3185402-2531-408a-ba66-3a4952a44256 admin admin] RBAC: Authorization granted {{(pid=71939) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 24 16:49:36.138895 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6994786d-7654-4b3d-9e1d-85ddc68b62fb admin admin] RBAC: Authorization granted {{(pid=71938) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 24 16:49:36.157927 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: [pid: 71938|app: 0|req: 1115/2243] 10.222.0.53 () {58 vars in 1143 bytes} [Wed Nov 24 16:49:36 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 84 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 24 16:49:36.162945 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6994786d-7654-4b3d-9e1d-85ddc68b62fb admin admin] Authenticating user token {{(pid=71938) process_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 24 16:49:36.180544 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6994786d-7654-4b3d-9e1d-85ddc68b62fb admin admin] Validating token access rules against request {{(pid=71938) validate_allowed_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 24 16:49:36.188308 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: [pid: 71939|app: 0|req: 1129/2244] 10.222.0.53 () {60 vars in 1143 bytes} [Wed Nov 24 16:49:36 2021] POST /identity/v3/projects => generated 361 bytes in 103 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Nov 24 16:49:36.192847 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3185402-2531-408a-ba66-3a4952a44256 admin admin] Authenticating user token {{(pid=71939) process_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 24 16:49:36.193164 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdfbae44-6efe-4948-affe-87c9315cd036 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f2ba2e8375b4e8c8792ee1e22b60427', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '00a5583c7b7443e98e7a1d31a0b638dc', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=71938) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 24 16:49:36.194677 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdfbae44-6efe-4948-affe-87c9315cd036 admin admin] REQUEST_METHOD: `POST` {{(pid=71938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 24 16:49:36.195008 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdfbae44-6efe-4948-affe-87c9315cd036 admin admin] SCRIPT_NAME: `/identity` {{(pid=71938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 24 16:49:36.195338 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdfbae44-6efe-4948-affe-87c9315cd036 admin admin] PATH_INFO: `/v3/projects` {{(pid=71938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 24 16:49:36.196201 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdfbae44-6efe-4948-affe-87c9315cd036 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=71938) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:442}} Nov 24 16:49:36.263063 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdfbae44-6efe-4948-affe-87c9315cd036 admin admin] RBAC: Authorization granted {{(pid=71938) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 24 16:49:36.297138 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: [pid: 71938|app: 0|req: 1116/2245] 10.222.0.53 () {60 vars in 1143 bytes} [Wed Nov 24 16:49:36 2021] POST /identity/v3/projects => generated 371 bytes in 135 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 24 16:49:36.301423 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdfbae44-6efe-4948-affe-87c9315cd036 admin admin] Authenticating user token {{(pid=71938) process_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 24 16:49:36.344315 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3185402-2531-408a-ba66-3a4952a44256 admin admin] Validating token access rules against request {{(pid=71939) validate_allowed_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 24 16:49:36.403569 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdfbae44-6efe-4948-affe-87c9315cd036 admin admin] Validating token access rules against request {{(pid=71938) validate_allowed_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 24 16:49:36.409125 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95686457-58f0-498f-9568-15ed0249da7a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f2ba2e8375b4e8c8792ee1e22b60427', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '00a5583c7b7443e98e7a1d31a0b638dc', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=71938) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 24 16:49:36.409493 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95686457-58f0-498f-9568-15ed0249da7a admin admin] REQUEST_METHOD: `POST` {{(pid=71938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 24 16:49:36.409910 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95686457-58f0-498f-9568-15ed0249da7a admin admin] SCRIPT_NAME: `/identity` {{(pid=71938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 24 16:49:36.410348 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95686457-58f0-498f-9568-15ed0249da7a admin admin] PATH_INFO: `/v3/users` {{(pid=71938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 24 16:49:36.411166 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95686457-58f0-498f-9568-15ed0249da7a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=71938) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:442}} Nov 24 16:49:36.443259 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95686457-58f0-498f-9568-15ed0249da7a admin admin] RBAC: Authorization granted {{(pid=71938) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 24 16:49:36.458654 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80a7825d-d47c-4520-b191-e5effe700ed0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f2ba2e8375b4e8c8792ee1e22b60427', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '00a5583c7b7443e98e7a1d31a0b638dc', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=71939) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 24 16:49:36.460575 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80a7825d-d47c-4520-b191-e5effe700ed0 admin admin] REQUEST_METHOD: `POST` {{(pid=71939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 24 16:49:36.461105 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80a7825d-d47c-4520-b191-e5effe700ed0 admin admin] SCRIPT_NAME: `/identity` {{(pid=71939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 24 16:49:36.461501 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80a7825d-d47c-4520-b191-e5effe700ed0 admin admin] PATH_INFO: `/v3/users` {{(pid=71939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 24 16:49:36.462505 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80a7825d-d47c-4520-b191-e5effe700ed0 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=71939) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:442}} Nov 24 16:49:36.475078 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: [pid: 71938|app: 0|req: 1117/2246] 10.222.0.53 () {60 vars in 1134 bytes} [Wed Nov 24 16:49:36 2021] POST /identity/v3/users => generated 286 bytes in 171 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Nov 24 16:49:36.476206 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95686457-58f0-498f-9568-15ed0249da7a admin admin] Authenticating user token {{(pid=71938) process_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 24 16:49:36.487605 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95686457-58f0-498f-9568-15ed0249da7a admin admin] Validating token access rules against request {{(pid=71938) validate_allowed_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 24 16:49:36.495254 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a71053e-5c2e-4692-8ad9-637d4b6772c6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f2ba2e8375b4e8c8792ee1e22b60427', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '00a5583c7b7443e98e7a1d31a0b638dc', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=71938) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 24 16:49:36.495580 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80a7825d-d47c-4520-b191-e5effe700ed0 admin admin] RBAC: Authorization granted {{(pid=71939) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 24 16:49:36.496765 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a71053e-5c2e-4692-8ad9-637d4b6772c6 admin admin] REQUEST_METHOD: `GET` {{(pid=71938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 24 16:49:36.497586 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a71053e-5c2e-4692-8ad9-637d4b6772c6 admin admin] SCRIPT_NAME: `/identity` {{(pid=71938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 24 16:49:36.498051 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a71053e-5c2e-4692-8ad9-637d4b6772c6 admin admin] PATH_INFO: `/v3/roles` {{(pid=71938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 24 16:49:36.499136 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a71053e-5c2e-4692-8ad9-637d4b6772c6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=71938) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:442}} Nov 24 16:49:36.523209 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: [pid: 71939|app: 0|req: 1130/2247] 10.222.0.53 () {60 vars in 1134 bytes} [Wed Nov 24 16:49:36 2021] POST /identity/v3/users => generated 281 bytes in 327 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 24 16:49:36.525971 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80a7825d-d47c-4520-b191-e5effe700ed0 admin admin] Authenticating user token {{(pid=71939) process_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 24 16:49:36.535841 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a71053e-5c2e-4692-8ad9-637d4b6772c6 admin admin] RBAC: Authorization granted {{(pid=71938) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 24 16:49:36.536512 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80a7825d-d47c-4520-b191-e5effe700ed0 admin admin] Validating token access rules against request {{(pid=71939) validate_allowed_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 24 16:49:36.543475 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c52f0a1f-435a-44bc-83b5-d2d07741cc66 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f2ba2e8375b4e8c8792ee1e22b60427', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '00a5583c7b7443e98e7a1d31a0b638dc', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=71939) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 24 16:49:36.544276 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c52f0a1f-435a-44bc-83b5-d2d07741cc66 admin admin] REQUEST_METHOD: `GET` {{(pid=71939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 24 16:49:36.544864 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c52f0a1f-435a-44bc-83b5-d2d07741cc66 admin admin] SCRIPT_NAME: `/identity` {{(pid=71939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 24 16:49:36.545203 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c52f0a1f-435a-44bc-83b5-d2d07741cc66 admin admin] PATH_INFO: `/v3/roles` {{(pid=71939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 24 16:49:36.546005 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c52f0a1f-435a-44bc-83b5-d2d07741cc66 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=71939) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:442}} Nov 24 16:49:36.548918 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: [pid: 71938|app: 0|req: 1118/2248] 10.222.0.53 () {58 vars in 1112 bytes} [Wed Nov 24 16:49:36 2021] GET /identity/v3/roles => generated 1420 bytes in 73 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 24 16:49:36.553979 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a71053e-5c2e-4692-8ad9-637d4b6772c6 admin admin] Authenticating user token {{(pid=71938) process_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 24 16:49:36.565183 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a71053e-5c2e-4692-8ad9-637d4b6772c6 admin admin] Validating token access rules against request {{(pid=71938) validate_allowed_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 24 16:49:36.571150 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29843f25-4d51-4b92-801f-4b5d63ec6bb9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f2ba2e8375b4e8c8792ee1e22b60427', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '00a5583c7b7443e98e7a1d31a0b638dc', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=71938) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 24 16:49:36.572248 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29843f25-4d51-4b92-801f-4b5d63ec6bb9 admin admin] REQUEST_METHOD: `PUT` {{(pid=71938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 24 16:49:36.572564 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29843f25-4d51-4b92-801f-4b5d63ec6bb9 admin admin] SCRIPT_NAME: `/identity` {{(pid=71938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 24 16:49:36.572904 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29843f25-4d51-4b92-801f-4b5d63ec6bb9 admin admin] PATH_INFO: `/v3/projects/3410aa1a083b49da92b42113fe7e869f/users/f344e527a4d24be3b7b12463480c4b5b/roles/912ab5f10fa5477da74acf239f07604e` {{(pid=71938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 24 16:49:36.580621 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c52f0a1f-435a-44bc-83b5-d2d07741cc66 admin admin] RBAC: Authorization granted {{(pid=71939) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 24 16:49:36.597769 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: [pid: 71939|app: 0|req: 1131/2249] 10.222.0.53 () {58 vars in 1112 bytes} [Wed Nov 24 16:49:36 2021] GET /identity/v3/roles => generated 1420 bytes in 69 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 24 16:49:36.597985 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29843f25-4d51-4b92-801f-4b5d63ec6bb9 admin admin] RBAC: Authorizing `identity:create_grant(project_id=3410aa1a083b49da92b42113fe7e869f, user_id=f344e527a4d24be3b7b12463480c4b5b, role_id=912ab5f10fa5477da74acf239f07604e)` {{(pid=71938) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:442}} Nov 24 16:49:36.599307 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c52f0a1f-435a-44bc-83b5-d2d07741cc66 admin admin] Authenticating user token {{(pid=71939) process_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 24 16:49:36.609902 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c52f0a1f-435a-44bc-83b5-d2d07741cc66 admin admin] Validating token access rules against request {{(pid=71939) validate_allowed_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 24 16:49:36.614989 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5eded2b5-676f-4fc5-8024-c787a5354e80 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f2ba2e8375b4e8c8792ee1e22b60427', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '00a5583c7b7443e98e7a1d31a0b638dc', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=71939) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 24 16:49:36.616686 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5eded2b5-676f-4fc5-8024-c787a5354e80 admin admin] REQUEST_METHOD: `PUT` {{(pid=71939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 24 16:49:36.617028 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5eded2b5-676f-4fc5-8024-c787a5354e80 admin admin] SCRIPT_NAME: `/identity` {{(pid=71939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 24 16:49:36.617380 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5eded2b5-676f-4fc5-8024-c787a5354e80 admin admin] PATH_INFO: `/v3/projects/d4417069c14948f99edd9302edcfc82e/users/496977c528d14c4291d8cde58d59c101/roles/912ab5f10fa5477da74acf239f07604e` {{(pid=71939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 24 16:49:36.628338 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29843f25-4d51-4b92-801f-4b5d63ec6bb9 admin admin] RBAC: Authorization granted {{(pid=71938) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 24 16:49:36.642523 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: [pid: 71938|app: 0|req: 1119/2250] 10.222.0.53 () {60 vars in 1473 bytes} [Wed Nov 24 16:49:36 2021] PUT /identity/v3/projects/3410aa1a083b49da92b42113fe7e869f/users/f344e527a4d24be3b7b12463480c4b5b/roles/912ab5f10fa5477da74acf239f07604e => generated 0 bytes in 89 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 24 16:49:36.648978 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5eded2b5-676f-4fc5-8024-c787a5354e80 admin admin] RBAC: Authorizing `identity:create_grant(project_id=d4417069c14948f99edd9302edcfc82e, user_id=496977c528d14c4291d8cde58d59c101, role_id=912ab5f10fa5477da74acf239f07604e)` {{(pid=71939) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:442}} Nov 24 16:49:36.653784 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-345f33e6-2d1c-4e1f-8f11-55d4aef99200 None None] REQUEST_METHOD: `POST` {{(pid=71938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 24 16:49:36.654328 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-345f33e6-2d1c-4e1f-8f11-55d4aef99200 None None] SCRIPT_NAME: `/identity` {{(pid=71938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 24 16:49:36.654851 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-345f33e6-2d1c-4e1f-8f11-55d4aef99200 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=71938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 24 16:49:36.691171 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5eded2b5-676f-4fc5-8024-c787a5354e80 admin admin] RBAC: Authorization granted {{(pid=71939) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 24 16:49:36.697778 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.auth.core [None req-345f33e6-2d1c-4e1f-8f11-55d4aef99200 None None] MFA Rules not processed for user `f344e527a4d24be3b7b12463480c4b5b`. Rule list: `[]` (Enabled: `True`). {{(pid=71938) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:442}} Nov 24 16:49:36.699344 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.fernet_utils [None req-345f33e6-2d1c-4e1f-8f11-55d4aef99200 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=71938) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:289}} Nov 24 16:49:36.706661 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: [pid: 71939|app: 0|req: 1132/2251] 10.222.0.53 () {60 vars in 1473 bytes} [Wed Nov 24 16:49:36 2021] PUT /identity/v3/projects/d4417069c14948f99edd9302edcfc82e/users/496977c528d14c4291d8cde58d59c101/roles/912ab5f10fa5477da74acf239f07604e => generated 0 bytes in 108 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Nov 24 16:49:36.724180 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ceb166d-f0ef-44ab-ba84-7af61a77d53c None None] REQUEST_METHOD: `POST` {{(pid=71939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 24 16:49:36.724565 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ceb166d-f0ef-44ab-ba84-7af61a77d53c None None] SCRIPT_NAME: `/identity` {{(pid=71939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 24 16:49:36.724904 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ceb166d-f0ef-44ab-ba84-7af61a77d53c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=71939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 24 16:49:36.770929 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.auth.core [None req-7ceb166d-f0ef-44ab-ba84-7af61a77d53c None None] MFA Rules not processed for user `496977c528d14c4291d8cde58d59c101`. Rule list: `[]` (Enabled: `True`). {{(pid=71939) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:442}} Nov 24 16:49:36.772715 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.fernet_utils [None req-7ceb166d-f0ef-44ab-ba84-7af61a77d53c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=71939) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:289}} Nov 24 16:49:36.780351 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: [pid: 71938|app: 0|req: 1120/2252] 10.222.0.53 () {58 vars in 948 bytes} [Wed Nov 24 16:49:36 2021] POST /identity/v3/auth/tokens => generated 3678 bytes in 128 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Nov 24 16:49:36.791657 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-345f33e6-2d1c-4e1f-8f11-55d4aef99200 None None] Authenticating user token {{(pid=71938) process_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 24 16:49:36.793002 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.fernet_utils [None req-345f33e6-2d1c-4e1f-8f11-55d4aef99200 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=71938) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:289}} Nov 24 16:49:36.856873 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: [pid: 71939|app: 0|req: 1133/2253] 10.222.0.53 () {58 vars in 948 bytes} [Wed Nov 24 16:49:36 2021] POST /identity/v3/auth/tokens => generated 3668 bytes in 134 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Nov 24 16:49:36.869171 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-345f33e6-2d1c-4e1f-8f11-55d4aef99200 None None] Validating token access rules against request {{(pid=71938) validate_allowed_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 24 16:49:36.874622 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62bc5a7f-2686-48e1-928e-4af23fe4b582 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a12374a3093a401a97c343ff0854184d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3b3940d4ae1c4177ae29c02377bb4b0b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=71938) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 24 16:49:36.875421 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62bc5a7f-2686-48e1-928e-4af23fe4b582 service cinder] REQUEST_METHOD: `GET` {{(pid=71938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 24 16:49:36.876039 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62bc5a7f-2686-48e1-928e-4af23fe4b582 service cinder] SCRIPT_NAME: `/identity` {{(pid=71938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 24 16:49:36.876411 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62bc5a7f-2686-48e1-928e-4af23fe4b582 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=71938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 24 16:49:36.887025 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62bc5a7f-2686-48e1-928e-4af23fe4b582 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=71938) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:442}} Nov 24 16:49:36.890497 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9aa2cd2b-27ce-4f07-9c1b-4a4e49a30c26 None None] REQUEST_METHOD: `GET` {{(pid=71939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 24 16:49:36.890856 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9aa2cd2b-27ce-4f07-9c1b-4a4e49a30c26 None None] SCRIPT_NAME: `/identity` {{(pid=71939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 24 16:49:36.891200 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9aa2cd2b-27ce-4f07-9c1b-4a4e49a30c26 None None] PATH_INFO: `/` {{(pid=71939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 24 16:49:36.893114 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: [pid: 71939|app: 0|req: 1134/2254] 10.222.0.53 () {54 vars in 950 bytes} [Wed Nov 24 16:49:36 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 24 16:49:36.898977 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88f4be42-8d4d-42c8-96a2-e32204c123af None None] REQUEST_METHOD: `POST` {{(pid=71939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 24 16:49:36.899327 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88f4be42-8d4d-42c8-96a2-e32204c123af None None] SCRIPT_NAME: `/identity` {{(pid=71939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 24 16:49:36.899671 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88f4be42-8d4d-42c8-96a2-e32204c123af None None] PATH_INFO: `/v3/auth/tokens` {{(pid=71939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 24 16:49:36.917409 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62bc5a7f-2686-48e1-928e-4af23fe4b582 service cinder] RBAC: Authorization granted {{(pid=71938) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 24 16:49:36.926437 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.auth.core [None req-88f4be42-8d4d-42c8-96a2-e32204c123af None None] MFA Rules not processed for user `a12374a3093a401a97c343ff0854184d`. Rule list: `[]` (Enabled: `True`). {{(pid=71939) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:442}} Nov 24 16:49:36.927749 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.fernet_utils [None req-88f4be42-8d4d-42c8-96a2-e32204c123af None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=71939) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:289}} Nov 24 16:49:36.927864 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: [pid: 71938|app: 0|req: 1121/2255] 10.222.0.53 () {60 vars in 1356 bytes} [Wed Nov 24 16:49:36 2021] GET /identity/v3/auth/tokens => generated 3678 bytes in 137 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 24 16:49:36.935842 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: [pid: 71939|app: 0|req: 1135/2256] 10.222.0.53 () {58 vars in 1048 bytes} [Wed Nov 24 16:49:36 2021] POST /identity/v3/auth/tokens => generated 3550 bytes in 38 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Nov 24 16:49:36.945132 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62bc5a7f-2686-48e1-928e-4af23fe4b582 service cinder] Authenticating user token {{(pid=71938) process_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 24 16:49:36.949468 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88f4be42-8d4d-42c8-96a2-e32204c123af None None] Authenticating user token {{(pid=71939) process_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 24 16:49:36.955242 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62bc5a7f-2686-48e1-928e-4af23fe4b582 service cinder] Validating token access rules against request {{(pid=71938) validate_allowed_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 24 16:49:36.959688 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0fde79f-9244-4fdd-a139-db143d1effd1 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a12374a3093a401a97c343ff0854184d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3b3940d4ae1c4177ae29c02377bb4b0b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=71938) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 24 16:49:36.960500 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0fde79f-9244-4fdd-a139-db143d1effd1 service cinder] REQUEST_METHOD: `GET` {{(pid=71938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 24 16:49:36.960832 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0fde79f-9244-4fdd-a139-db143d1effd1 service cinder] SCRIPT_NAME: `/identity` {{(pid=71938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 24 16:49:36.961273 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0fde79f-9244-4fdd-a139-db143d1effd1 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=71938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 24 16:49:36.972219 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0fde79f-9244-4fdd-a139-db143d1effd1 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=71938) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:442}} Nov 24 16:49:37.002483 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0fde79f-9244-4fdd-a139-db143d1effd1 service cinder] RBAC: Authorization granted {{(pid=71938) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 24 16:49:37.014010 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: [pid: 71938|app: 0|req: 1122/2257] 10.222.0.53 () {60 vars in 1356 bytes} [Wed Nov 24 16:49:36 2021] GET /identity/v3/auth/tokens => generated 3668 bytes in 69 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 24 16:49:37.029210 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88f4be42-8d4d-42c8-96a2-e32204c123af None None] Validating token access rules against request {{(pid=71939) validate_allowed_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 24 16:49:37.033790 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e143e50-6c5a-4ec2-bfd4-47e5606819a0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f2ba2e8375b4e8c8792ee1e22b60427', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '00a5583c7b7443e98e7a1d31a0b638dc', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=71939) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 24 16:49:37.034708 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e143e50-6c5a-4ec2-bfd4-47e5606819a0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=71939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 24 16:49:37.035048 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e143e50-6c5a-4ec2-bfd4-47e5606819a0 admin admin] SCRIPT_NAME: `/identity` {{(pid=71939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 24 16:49:37.035378 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e143e50-6c5a-4ec2-bfd4-47e5606819a0 admin admin] PATH_INFO: `/v3/users/f344e527a4d24be3b7b12463480c4b5b` {{(pid=71939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 24 16:49:37.036609 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e143e50-6c5a-4ec2-bfd4-47e5606819a0 admin admin] RBAC: Authorizing `identity:delete_user(user_id=f344e527a4d24be3b7b12463480c4b5b)` {{(pid=71939) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:442}} Nov 24 16:49:37.065316 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e143e50-6c5a-4ec2-bfd4-47e5606819a0 admin admin] RBAC: Authorization granted {{(pid=71939) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 24 16:49:37.121807 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.notifications [None req-4e143e50-6c5a-4ec2-bfd4-47e5606819a0 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f344e527a4d24be3b7b12463480c4b5b'} {{(pid=71939) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:357}} Nov 24 16:49:37.136191 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.notifications [None req-4e143e50-6c5a-4ec2-bfd4-47e5606819a0 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f344e527a4d24be3b7b12463480c4b5b'} {{(pid=71939) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:357}} Nov 24 16:49:37.136901 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.notifications [None req-4e143e50-6c5a-4ec2-bfd4-47e5606819a0 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f344e527a4d24be3b7b12463480c4b5b'} {{(pid=71939) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:357}} Nov 24 16:49:37.147391 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.notifications [None req-4e143e50-6c5a-4ec2-bfd4-47e5606819a0 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f344e527a4d24be3b7b12463480c4b5b'} {{(pid=71939) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:357}} Nov 24 16:49:37.156516 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.notifications [None req-4e143e50-6c5a-4ec2-bfd4-47e5606819a0 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f344e527a4d24be3b7b12463480c4b5b'} {{(pid=71939) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:357}} Nov 24 16:49:37.172339 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a06f3c6d-f3ea-4258-88eb-fd0c4f842e77 None None] REQUEST_METHOD: `POST` {{(pid=71938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 24 16:49:37.172719 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a06f3c6d-f3ea-4258-88eb-fd0c4f842e77 None None] SCRIPT_NAME: `/identity` {{(pid=71938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 24 16:49:37.173060 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a06f3c6d-f3ea-4258-88eb-fd0c4f842e77 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=71938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 24 16:49:37.174108 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: [pid: 71939|app: 0|req: 1136/2258] 10.222.0.53 () {58 vars in 1214 bytes} [Wed Nov 24 16:49:36 2021] DELETE /identity/v3/users/f344e527a4d24be3b7b12463480c4b5b => generated 0 bytes in 218 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 24 16:49:37.203899 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.auth.core [None req-a06f3c6d-f3ea-4258-88eb-fd0c4f842e77 None None] MFA Rules not processed for user `0f2ba2e8375b4e8c8792ee1e22b60427`. Rule list: `[]` (Enabled: `True`). {{(pid=71938) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:442}} Nov 24 16:49:37.205355 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.fernet_utils [None req-a06f3c6d-f3ea-4258-88eb-fd0c4f842e77 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=71938) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:289}} Nov 24 16:49:37.288518 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: [pid: 71938|app: 0|req: 1123/2259] 10.222.0.53 () {58 vars in 948 bytes} [Wed Nov 24 16:49:37 2021] POST /identity/v3/auth/tokens => generated 3669 bytes in 117 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 24 16:49:37.301856 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e143e50-6c5a-4ec2-bfd4-47e5606819a0 admin admin] Authenticating user token {{(pid=71939) process_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 24 16:49:37.303939 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.fernet_utils [None req-4e143e50-6c5a-4ec2-bfd4-47e5606819a0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=71939) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:289}} Nov 24 16:49:37.379535 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a06f3c6d-f3ea-4258-88eb-fd0c4f842e77 None None] Authenticating user token {{(pid=71938) process_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 24 16:49:37.381685 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.fernet_utils [None req-a06f3c6d-f3ea-4258-88eb-fd0c4f842e77 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=71938) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:289}} Nov 24 16:49:37.394582 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a06f3c6d-f3ea-4258-88eb-fd0c4f842e77 None None] Validating token access rules against request {{(pid=71938) validate_allowed_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 24 16:49:37.395240 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e143e50-6c5a-4ec2-bfd4-47e5606819a0 admin admin] Validating token access rules against request {{(pid=71939) validate_allowed_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 24 16:49:37.399060 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c7da6ea-7357-468c-94ea-94d9cfea3f65 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c90f21b9cdcb413282461fa83cb6b7a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3b3940d4ae1c4177ae29c02377bb4b0b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=71939) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 24 16:49:37.399673 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c7da6ea-7357-468c-94ea-94d9cfea3f65 service neutron] REQUEST_METHOD: `GET` {{(pid=71939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 24 16:49:37.399989 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a56e4126-da13-40d2-b316-ab912d8bd641 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f2ba2e8375b4e8c8792ee1e22b60427', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '00a5583c7b7443e98e7a1d31a0b638dc', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=71938) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 24 16:49:37.400099 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c7da6ea-7357-468c-94ea-94d9cfea3f65 service neutron] SCRIPT_NAME: `/identity` {{(pid=71939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 24 16:49:37.400482 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c7da6ea-7357-468c-94ea-94d9cfea3f65 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=71939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 24 16:49:37.401050 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a56e4126-da13-40d2-b316-ab912d8bd641 admin admin] REQUEST_METHOD: `DELETE` {{(pid=71938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 24 16:49:37.401454 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a56e4126-da13-40d2-b316-ab912d8bd641 admin admin] SCRIPT_NAME: `/identity` {{(pid=71938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 24 16:49:37.401864 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a56e4126-da13-40d2-b316-ab912d8bd641 admin admin] PATH_INFO: `/v3/users/496977c528d14c4291d8cde58d59c101` {{(pid=71938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 24 16:49:37.403287 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a56e4126-da13-40d2-b316-ab912d8bd641 admin admin] RBAC: Authorizing `identity:delete_user(user_id=496977c528d14c4291d8cde58d59c101)` {{(pid=71938) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:442}} Nov 24 16:49:37.410546 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c7da6ea-7357-468c-94ea-94d9cfea3f65 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=71939) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:442}} Nov 24 16:49:37.433501 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a56e4126-da13-40d2-b316-ab912d8bd641 admin admin] RBAC: Authorization granted {{(pid=71938) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 24 16:49:37.445882 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c7da6ea-7357-468c-94ea-94d9cfea3f65 service neutron] RBAC: Authorization granted {{(pid=71939) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 24 16:49:37.461736 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: [pid: 71939|app: 0|req: 1137/2260] 10.222.0.53 () {60 vars in 1356 bytes} [Wed Nov 24 16:49:37 2021] GET /identity/v3/auth/tokens => generated 3669 bytes in 160 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 24 16:49:37.493494 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.notifications [None req-a56e4126-da13-40d2-b316-ab912d8bd641 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '496977c528d14c4291d8cde58d59c101'} {{(pid=71938) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:357}} Nov 24 16:49:37.507347 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.notifications [None req-a56e4126-da13-40d2-b316-ab912d8bd641 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '496977c528d14c4291d8cde58d59c101'} {{(pid=71938) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:357}} Nov 24 16:49:37.508140 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.notifications [None req-a56e4126-da13-40d2-b316-ab912d8bd641 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '496977c528d14c4291d8cde58d59c101'} {{(pid=71938) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:357}} Nov 24 16:49:37.517346 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.notifications [None req-a56e4126-da13-40d2-b316-ab912d8bd641 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '496977c528d14c4291d8cde58d59c101'} {{(pid=71938) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:357}} Nov 24 16:49:37.527878 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.notifications [None req-a56e4126-da13-40d2-b316-ab912d8bd641 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '496977c528d14c4291d8cde58d59c101'} {{(pid=71938) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:357}} Nov 24 16:49:37.536543 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: [pid: 71938|app: 0|req: 1124/2261] 10.222.0.53 () {58 vars in 1214 bytes} [Wed Nov 24 16:49:37 2021] DELETE /identity/v3/users/496977c528d14c4291d8cde58d59c101 => generated 0 bytes in 157 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 24 16:49:37.543203 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1eff8f0c-fe71-453a-8f21-242a79744f5b None None] REQUEST_METHOD: `POST` {{(pid=71939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 24 16:49:37.543747 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1eff8f0c-fe71-453a-8f21-242a79744f5b None None] SCRIPT_NAME: `/identity` {{(pid=71939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 24 16:49:37.544018 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1eff8f0c-fe71-453a-8f21-242a79744f5b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=71939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 24 16:49:37.598751 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.auth.core [None req-1eff8f0c-fe71-453a-8f21-242a79744f5b None None] MFA Rules not processed for user `0f2ba2e8375b4e8c8792ee1e22b60427`. Rule list: `[]` (Enabled: `True`). {{(pid=71939) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:442}} Nov 24 16:49:37.598751 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.fernet_utils [None req-1eff8f0c-fe71-453a-8f21-242a79744f5b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=71939) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:289}} Nov 24 16:49:37.685149 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: [pid: 71939|app: 0|req: 1138/2262] 10.222.0.53 () {58 vars in 948 bytes} [Wed Nov 24 16:49:37 2021] POST /identity/v3/auth/tokens => generated 3669 bytes in 143 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 24 16:49:37.701551 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a56e4126-da13-40d2-b316-ab912d8bd641 admin admin] Authenticating user token {{(pid=71938) process_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 24 16:49:37.703239 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.fernet_utils [None req-a56e4126-da13-40d2-b316-ab912d8bd641 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=71938) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:289}} Nov 24 16:49:37.767297 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1eff8f0c-fe71-453a-8f21-242a79744f5b None None] Authenticating user token {{(pid=71939) process_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 24 16:49:37.769179 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.fernet_utils [None req-1eff8f0c-fe71-453a-8f21-242a79744f5b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=71939) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:289}} Nov 24 16:49:37.843484 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a56e4126-da13-40d2-b316-ab912d8bd641 admin admin] Validating token access rules against request {{(pid=71938) validate_allowed_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 24 16:49:37.847301 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14e3b102-c92d-4446-b53d-8f241bf716da service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c90f21b9cdcb413282461fa83cb6b7a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3b3940d4ae1c4177ae29c02377bb4b0b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=71938) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 24 16:49:37.848640 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14e3b102-c92d-4446-b53d-8f241bf716da service neutron] REQUEST_METHOD: `GET` {{(pid=71938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 24 16:49:37.848981 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14e3b102-c92d-4446-b53d-8f241bf716da service neutron] SCRIPT_NAME: `/identity` {{(pid=71938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 24 16:49:37.849319 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14e3b102-c92d-4446-b53d-8f241bf716da service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=71938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 24 16:49:37.861154 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14e3b102-c92d-4446-b53d-8f241bf716da service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=71938) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:442}} Nov 24 16:49:37.908859 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14e3b102-c92d-4446-b53d-8f241bf716da service neutron] RBAC: Authorization granted {{(pid=71938) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 24 16:49:37.930976 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1eff8f0c-fe71-453a-8f21-242a79744f5b None None] Validating token access rules against request {{(pid=71939) validate_allowed_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 24 16:49:37.940151 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29cd82ac-067f-4249-bd85-224b9784cdbc service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a12374a3093a401a97c343ff0854184d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3b3940d4ae1c4177ae29c02377bb4b0b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=71939) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 24 16:49:37.941484 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29cd82ac-067f-4249-bd85-224b9784cdbc service cinder] REQUEST_METHOD: `GET` {{(pid=71939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 24 16:49:37.941934 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29cd82ac-067f-4249-bd85-224b9784cdbc service cinder] SCRIPT_NAME: `/identity` {{(pid=71939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 24 16:49:37.942523 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29cd82ac-067f-4249-bd85-224b9784cdbc service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=71939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 24 16:49:37.944764 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: [pid: 71938|app: 0|req: 1125/2263] 10.222.0.53 () {60 vars in 1356 bytes} [Wed Nov 24 16:49:37 2021] GET /identity/v3/auth/tokens => generated 3669 bytes in 244 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 24 16:49:37.945230 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.fernet_utils [None req-29cd82ac-067f-4249-bd85-224b9784cdbc service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=71939) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:289}} Nov 24 16:49:38.042519 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14e3b102-c92d-4446-b53d-8f241bf716da service neutron] Authenticating user token {{(pid=71938) process_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 24 16:49:38.045165 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.fernet_utils [None req-14e3b102-c92d-4446-b53d-8f241bf716da service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=71938) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:289}} Nov 24 16:49:38.062250 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14e3b102-c92d-4446-b53d-8f241bf716da service neutron] Validating token access rules against request {{(pid=71938) validate_allowed_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 24 16:49:38.068266 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f5c9f21-54be-4b5f-92e9-78d3c19786df admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f2ba2e8375b4e8c8792ee1e22b60427', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '00a5583c7b7443e98e7a1d31a0b638dc', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=71938) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 24 16:49:38.069174 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f5c9f21-54be-4b5f-92e9-78d3c19786df admin admin] REQUEST_METHOD: `DELETE` {{(pid=71938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 24 16:49:38.069515 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f5c9f21-54be-4b5f-92e9-78d3c19786df admin admin] SCRIPT_NAME: `/identity` {{(pid=71938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 24 16:49:38.069851 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f5c9f21-54be-4b5f-92e9-78d3c19786df admin admin] PATH_INFO: `/v3/projects/3410aa1a083b49da92b42113fe7e869f` {{(pid=71938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 24 16:49:38.071339 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f5c9f21-54be-4b5f-92e9-78d3c19786df admin admin] RBAC: Authorizing `identity:delete_project(project_id=3410aa1a083b49da92b42113fe7e869f)` {{(pid=71938) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:442}} Nov 24 16:49:38.075315 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29cd82ac-067f-4249-bd85-224b9784cdbc service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=71939) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:442}} Nov 24 16:49:38.112000 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29cd82ac-067f-4249-bd85-224b9784cdbc service cinder] RBAC: Authorization granted {{(pid=71939) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 24 16:49:38.121698 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f5c9f21-54be-4b5f-92e9-78d3c19786df admin admin] RBAC: Authorization granted {{(pid=71938) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 24 16:49:38.124130 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: [pid: 71939|app: 0|req: 1139/2264] 10.222.0.53 () {60 vars in 1356 bytes} [Wed Nov 24 16:49:37 2021] GET /identity/v3/auth/tokens => generated 3759 bytes in 357 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 24 16:49:38.211210 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.notifications [None req-6f5c9f21-54be-4b5f-92e9-78d3c19786df admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '3410aa1a083b49da92b42113fe7e869f', 'request_id': 'req-6f5c9f21-54be-4b5f-92e9-78d3c19786df'} {{(pid=71938) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:357}} Nov 24 16:49:38.226388 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.notifications [None req-6f5c9f21-54be-4b5f-92e9-78d3c19786df admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '3410aa1a083b49da92b42113fe7e869f', 'request_id': 'req-6f5c9f21-54be-4b5f-92e9-78d3c19786df'} {{(pid=71938) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:357}} Nov 24 16:49:38.234810 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.notifications [None req-6f5c9f21-54be-4b5f-92e9-78d3c19786df admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '3410aa1a083b49da92b42113fe7e869f', 'request_id': 'req-6f5c9f21-54be-4b5f-92e9-78d3c19786df'} {{(pid=71938) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:357}} Nov 24 16:49:38.248091 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.notifications [None req-6f5c9f21-54be-4b5f-92e9-78d3c19786df admin admin] The token cache is being invalidate because project 3410aa1a083b49da92b42113fe7e869f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=71938) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Nov 24 16:49:38.248428 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.notifications [None req-6f5c9f21-54be-4b5f-92e9-78d3c19786df admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=71938) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:357}} Nov 24 16:49:38.249140 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.notifications [None req-6f5c9f21-54be-4b5f-92e9-78d3c19786df admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=71938) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:357}} Nov 24 16:49:38.250922 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: [pid: 71938|app: 0|req: 1126/2265] 10.222.0.53 () {58 vars in 1223 bytes} [Wed Nov 24 16:49:38 2021] DELETE /identity/v3/projects/3410aa1a083b49da92b42113fe7e869f => generated 0 bytes in 209 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 24 16:49:38.257208 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad8b02de-e2b3-42e6-b263-09fbb084e196 None None] REQUEST_METHOD: `POST` {{(pid=71939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 24 16:49:38.258121 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad8b02de-e2b3-42e6-b263-09fbb084e196 None None] SCRIPT_NAME: `/identity` {{(pid=71939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 24 16:49:38.258632 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad8b02de-e2b3-42e6-b263-09fbb084e196 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=71939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 24 16:49:38.286381 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.auth.core [None req-ad8b02de-e2b3-42e6-b263-09fbb084e196 None None] MFA Rules not processed for user `0f2ba2e8375b4e8c8792ee1e22b60427`. Rule list: `[]` (Enabled: `True`). {{(pid=71939) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:442}} Nov 24 16:49:38.288906 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.fernet_utils [None req-ad8b02de-e2b3-42e6-b263-09fbb084e196 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=71939) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:289}} Nov 24 16:49:38.410910 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: [pid: 71939|app: 0|req: 1140/2266] 10.222.0.53 () {58 vars in 948 bytes} [Wed Nov 24 16:49:38 2021] POST /identity/v3/auth/tokens => generated 3669 bytes in 155 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 24 16:49:38.421901 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c416f1c0-64af-4ab0-acb9-4717b8b72554 None None] REQUEST_METHOD: `POST` {{(pid=71938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 24 16:49:38.422385 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c416f1c0-64af-4ab0-acb9-4717b8b72554 None None] SCRIPT_NAME: `/identity` {{(pid=71938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 24 16:49:38.422836 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c416f1c0-64af-4ab0-acb9-4717b8b72554 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=71938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 24 16:49:38.452501 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.auth.core [None req-c416f1c0-64af-4ab0-acb9-4717b8b72554 None None] MFA Rules not processed for user `0f2ba2e8375b4e8c8792ee1e22b60427`. Rule list: `[]` (Enabled: `True`). {{(pid=71938) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:442}} Nov 24 16:49:38.453847 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.fernet_utils [None req-c416f1c0-64af-4ab0-acb9-4717b8b72554 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=71938) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:289}} Nov 24 16:49:38.467690 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad8b02de-e2b3-42e6-b263-09fbb084e196 None None] Authenticating user token {{(pid=71939) process_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 24 16:49:38.468028 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: [pid: 71938|app: 0|req: 1127/2267] 10.222.0.53 () {58 vars in 948 bytes} [Wed Nov 24 16:49:38 2021] POST /identity/v3/auth/tokens => generated 3669 bytes in 46 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 24 16:49:38.479198 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad8b02de-e2b3-42e6-b263-09fbb084e196 None None] Validating token access rules against request {{(pid=71939) validate_allowed_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 24 16:49:38.484955 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89973d91-f594-464f-bb91-a51484912073 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f2ba2e8375b4e8c8792ee1e22b60427', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '00a5583c7b7443e98e7a1d31a0b638dc', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=71939) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 24 16:49:38.485654 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89973d91-f594-464f-bb91-a51484912073 admin admin] REQUEST_METHOD: `GET` {{(pid=71939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 24 16:49:38.486018 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89973d91-f594-464f-bb91-a51484912073 admin admin] SCRIPT_NAME: `/identity` {{(pid=71939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 24 16:49:38.486411 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89973d91-f594-464f-bb91-a51484912073 admin admin] PATH_INFO: `/v3/domains` {{(pid=71939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 24 16:49:38.487215 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89973d91-f594-464f-bb91-a51484912073 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=71939) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:161}} Nov 24 16:49:38.487719 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89973d91-f594-464f-bb91-a51484912073 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=71939) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:442}} Nov 24 16:49:38.558582 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89973d91-f594-464f-bb91-a51484912073 admin admin] RBAC: Authorization granted {{(pid=71939) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 24 16:49:38.585667 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c416f1c0-64af-4ab0-acb9-4717b8b72554 None None] Authenticating user token {{(pid=71938) process_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 24 16:49:38.587352 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.fernet_utils [None req-c416f1c0-64af-4ab0-acb9-4717b8b72554 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=71938) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:289}} Nov 24 16:49:38.597749 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: [pid: 71939|app: 0|req: 1141/2268] 10.222.0.53 () {58 vars in 1143 bytes} [Wed Nov 24 16:49:38 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 131 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 24 16:49:38.604021 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c416f1c0-64af-4ab0-acb9-4717b8b72554 None None] Validating token access rules against request {{(pid=71938) validate_allowed_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 24 16:49:38.606695 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89973d91-f594-464f-bb91-a51484912073 admin admin] Authenticating user token {{(pid=71939) process_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 24 16:49:38.610893 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4f15630-f333-4521-a80b-9232e0ce87d9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f2ba2e8375b4e8c8792ee1e22b60427', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '00a5583c7b7443e98e7a1d31a0b638dc', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=71938) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 24 16:49:38.612024 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4f15630-f333-4521-a80b-9232e0ce87d9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=71938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 24 16:49:38.612554 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4f15630-f333-4521-a80b-9232e0ce87d9 admin admin] SCRIPT_NAME: `/identity` {{(pid=71938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 24 16:49:38.613083 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4f15630-f333-4521-a80b-9232e0ce87d9 admin admin] PATH_INFO: `/v3/projects/d4417069c14948f99edd9302edcfc82e` {{(pid=71938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 24 16:49:38.614529 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4f15630-f333-4521-a80b-9232e0ce87d9 admin admin] RBAC: Authorizing `identity:delete_project(project_id=d4417069c14948f99edd9302edcfc82e)` {{(pid=71938) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:442}} Nov 24 16:49:38.627944 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89973d91-f594-464f-bb91-a51484912073 admin admin] Validating token access rules against request {{(pid=71939) validate_allowed_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 24 16:49:38.635072 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ac062c4-c584-4802-a0b2-2995bc5a56e2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f2ba2e8375b4e8c8792ee1e22b60427', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '00a5583c7b7443e98e7a1d31a0b638dc', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=71939) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 24 16:49:38.635747 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ac062c4-c584-4802-a0b2-2995bc5a56e2 admin admin] REQUEST_METHOD: `POST` {{(pid=71939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 24 16:49:38.636084 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ac062c4-c584-4802-a0b2-2995bc5a56e2 admin admin] SCRIPT_NAME: `/identity` {{(pid=71939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 24 16:49:38.636419 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ac062c4-c584-4802-a0b2-2995bc5a56e2 admin admin] PATH_INFO: `/v3/projects` {{(pid=71939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 24 16:49:38.637156 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ac062c4-c584-4802-a0b2-2995bc5a56e2 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=71939) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:442}} Nov 24 16:49:38.655673 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4f15630-f333-4521-a80b-9232e0ce87d9 admin admin] RBAC: Authorization granted {{(pid=71938) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 24 16:49:38.668281 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ac062c4-c584-4802-a0b2-2995bc5a56e2 admin admin] RBAC: Authorization granted {{(pid=71939) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 24 16:49:38.717611 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: [pid: 71939|app: 0|req: 1142/2269] 10.222.0.53 () {60 vars in 1143 bytes} [Wed Nov 24 16:49:38 2021] POST /identity/v3/projects => generated 377 bytes in 114 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 24 16:49:38.721595 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ac062c4-c584-4802-a0b2-2995bc5a56e2 admin admin] Authenticating user token {{(pid=71939) process_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 24 16:49:38.727075 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.notifications [None req-f4f15630-f333-4521-a80b-9232e0ce87d9 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd4417069c14948f99edd9302edcfc82e', 'request_id': 'req-f4f15630-f333-4521-a80b-9232e0ce87d9'} {{(pid=71938) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:357}} Nov 24 16:49:38.740618 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.notifications [None req-f4f15630-f333-4521-a80b-9232e0ce87d9 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd4417069c14948f99edd9302edcfc82e', 'request_id': 'req-f4f15630-f333-4521-a80b-9232e0ce87d9'} {{(pid=71938) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:357}} Nov 24 16:49:38.747245 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.notifications [None req-f4f15630-f333-4521-a80b-9232e0ce87d9 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd4417069c14948f99edd9302edcfc82e', 'request_id': 'req-f4f15630-f333-4521-a80b-9232e0ce87d9'} {{(pid=71938) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:357}} Nov 24 16:49:38.766222 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.notifications [None req-f4f15630-f333-4521-a80b-9232e0ce87d9 admin admin] The token cache is being invalidate because project d4417069c14948f99edd9302edcfc82e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=71938) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Nov 24 16:49:38.766760 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.notifications [None req-f4f15630-f333-4521-a80b-9232e0ce87d9 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=71938) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:357}} Nov 24 16:49:38.767615 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.notifications [None req-f4f15630-f333-4521-a80b-9232e0ce87d9 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=71938) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:357}} Nov 24 16:49:38.769397 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: [pid: 71938|app: 0|req: 1128/2270] 10.222.0.53 () {58 vars in 1223 bytes} [Wed Nov 24 16:49:38 2021] DELETE /identity/v3/projects/d4417069c14948f99edd9302edcfc82e => generated 0 bytes in 185 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 24 16:49:38.776106 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a3052a4-a479-4986-9524-296c2f55b8b8 None None] REQUEST_METHOD: `POST` {{(pid=71938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 24 16:49:38.776455 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a3052a4-a479-4986-9524-296c2f55b8b8 None None] SCRIPT_NAME: `/identity` {{(pid=71938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 24 16:49:38.776797 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a3052a4-a479-4986-9524-296c2f55b8b8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=71938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 24 16:49:38.808901 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.auth.core [None req-7a3052a4-a479-4986-9524-296c2f55b8b8 None None] MFA Rules not processed for user `0f2ba2e8375b4e8c8792ee1e22b60427`. Rule list: `[]` (Enabled: `True`). {{(pid=71938) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:442}} Nov 24 16:49:38.810356 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.fernet_utils [None req-7a3052a4-a479-4986-9524-296c2f55b8b8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=71938) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:289}} Nov 24 16:49:38.822070 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ac062c4-c584-4802-a0b2-2995bc5a56e2 admin admin] Validating token access rules against request {{(pid=71939) validate_allowed_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 24 16:49:38.826941 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de3e5d02-baa2-44ba-b6a9-c27a66d5ffe2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f2ba2e8375b4e8c8792ee1e22b60427', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '00a5583c7b7443e98e7a1d31a0b638dc', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=71939) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 24 16:49:38.827631 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de3e5d02-baa2-44ba-b6a9-c27a66d5ffe2 admin admin] REQUEST_METHOD: `POST` {{(pid=71939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 24 16:49:38.827970 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de3e5d02-baa2-44ba-b6a9-c27a66d5ffe2 admin admin] SCRIPT_NAME: `/identity` {{(pid=71939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 24 16:49:38.828301 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de3e5d02-baa2-44ba-b6a9-c27a66d5ffe2 admin admin] PATH_INFO: `/v3/users` {{(pid=71939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 24 16:49:38.829336 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de3e5d02-baa2-44ba-b6a9-c27a66d5ffe2 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=71939) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:442}} Nov 24 16:49:38.859765 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de3e5d02-baa2-44ba-b6a9-c27a66d5ffe2 admin admin] RBAC: Authorization granted {{(pid=71939) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 24 16:49:38.884920 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: [pid: 71939|app: 0|req: 1143/2271] 10.222.0.53 () {60 vars in 1134 bytes} [Wed Nov 24 16:49:38 2021] POST /identity/v3/users => generated 289 bytes in 161 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Nov 24 16:49:38.886076 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de3e5d02-baa2-44ba-b6a9-c27a66d5ffe2 admin admin] Authenticating user token {{(pid=71939) process_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 24 16:49:38.887890 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.fernet_utils [None req-de3e5d02-baa2-44ba-b6a9-c27a66d5ffe2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=71939) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:289}} Nov 24 16:49:38.898667 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: [pid: 71938|app: 0|req: 1129/2272] 10.222.0.53 () {58 vars in 948 bytes} [Wed Nov 24 16:49:38 2021] POST /identity/v3/auth/tokens => generated 3669 bytes in 123 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 24 16:49:38.900595 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de3e5d02-baa2-44ba-b6a9-c27a66d5ffe2 admin admin] Validating token access rules against request {{(pid=71939) validate_allowed_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 24 16:49:38.905206 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77ab1111-eb48-47a8-a1ad-76e57fa8dbed admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f2ba2e8375b4e8c8792ee1e22b60427', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '00a5583c7b7443e98e7a1d31a0b638dc', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=71939) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 24 16:49:38.905896 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77ab1111-eb48-47a8-a1ad-76e57fa8dbed admin admin] REQUEST_METHOD: `GET` {{(pid=71939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 24 16:49:38.906278 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77ab1111-eb48-47a8-a1ad-76e57fa8dbed admin admin] SCRIPT_NAME: `/identity` {{(pid=71939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 24 16:49:38.906614 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77ab1111-eb48-47a8-a1ad-76e57fa8dbed admin admin] PATH_INFO: `/v3/roles` {{(pid=71939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 24 16:49:38.907256 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98407e21-9d70-4871-a189-7dd0388fc6ab None None] REQUEST_METHOD: `POST` {{(pid=71938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 24 16:49:38.907380 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77ab1111-eb48-47a8-a1ad-76e57fa8dbed admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=71939) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:442}} Nov 24 16:49:38.907604 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98407e21-9d70-4871-a189-7dd0388fc6ab None None] SCRIPT_NAME: `/identity` {{(pid=71938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 24 16:49:38.907941 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98407e21-9d70-4871-a189-7dd0388fc6ab None None] PATH_INFO: `/v3/auth/tokens` {{(pid=71938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 24 16:49:38.932001 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.auth.core [None req-98407e21-9d70-4871-a189-7dd0388fc6ab None None] MFA Rules not processed for user `0f2ba2e8375b4e8c8792ee1e22b60427`. Rule list: `[]` (Enabled: `True`). {{(pid=71938) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:442}} Nov 24 16:49:38.933229 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.fernet_utils [None req-98407e21-9d70-4871-a189-7dd0388fc6ab None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=71938) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:289}} Nov 24 16:49:38.936327 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77ab1111-eb48-47a8-a1ad-76e57fa8dbed admin admin] RBAC: Authorization granted {{(pid=71939) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 24 16:49:38.941116 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: [pid: 71938|app: 0|req: 1130/2273] 10.222.0.53 () {58 vars in 948 bytes} [Wed Nov 24 16:49:38 2021] POST /identity/v3/auth/tokens => generated 3669 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Nov 24 16:49:38.945588 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98407e21-9d70-4871-a189-7dd0388fc6ab None None] Authenticating user token {{(pid=71938) process_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 24 16:49:38.948314 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: [pid: 71939|app: 0|req: 1144/2274] 10.222.0.53 () {58 vars in 1112 bytes} [Wed Nov 24 16:49:38 2021] GET /identity/v3/roles => generated 1420 bytes in 63 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Nov 24 16:49:38.952669 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77ab1111-eb48-47a8-a1ad-76e57fa8dbed admin admin] Authenticating user token {{(pid=71939) process_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 24 16:49:38.955243 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98407e21-9d70-4871-a189-7dd0388fc6ab None None] Validating token access rules against request {{(pid=71938) validate_allowed_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 24 16:49:38.960773 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-207c8686-3366-4a51-8c9f-7a82e1c00804 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f2ba2e8375b4e8c8792ee1e22b60427', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '00a5583c7b7443e98e7a1d31a0b638dc', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=71938) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 24 16:49:38.961455 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-207c8686-3366-4a51-8c9f-7a82e1c00804 admin admin] REQUEST_METHOD: `GET` {{(pid=71938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 24 16:49:38.962144 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-207c8686-3366-4a51-8c9f-7a82e1c00804 admin admin] SCRIPT_NAME: `/identity` {{(pid=71938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 24 16:49:38.962439 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-207c8686-3366-4a51-8c9f-7a82e1c00804 admin admin] PATH_INFO: `/v3/domains` {{(pid=71938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 24 16:49:38.963357 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-207c8686-3366-4a51-8c9f-7a82e1c00804 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=71938) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:161}} Nov 24 16:49:38.963707 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-207c8686-3366-4a51-8c9f-7a82e1c00804 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=71938) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:442}} Nov 24 16:49:38.964354 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77ab1111-eb48-47a8-a1ad-76e57fa8dbed admin admin] Validating token access rules against request {{(pid=71939) validate_allowed_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 24 16:49:38.969426 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1caf88db-2532-4427-9792-ac5331c254d1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f2ba2e8375b4e8c8792ee1e22b60427', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '00a5583c7b7443e98e7a1d31a0b638dc', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=71939) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 24 16:49:38.970494 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1caf88db-2532-4427-9792-ac5331c254d1 admin admin] REQUEST_METHOD: `PUT` {{(pid=71939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 24 16:49:38.970831 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1caf88db-2532-4427-9792-ac5331c254d1 admin admin] SCRIPT_NAME: `/identity` {{(pid=71939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 24 16:49:38.971169 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1caf88db-2532-4427-9792-ac5331c254d1 admin admin] PATH_INFO: `/v3/projects/25c8dafba79546329272318b1fdb3776/users/d46c7e0be1f843c39dadc8b31cacaa86/roles/912ab5f10fa5477da74acf239f07604e` {{(pid=71939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 24 16:49:38.994231 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1caf88db-2532-4427-9792-ac5331c254d1 admin admin] RBAC: Authorizing `identity:create_grant(project_id=25c8dafba79546329272318b1fdb3776, user_id=d46c7e0be1f843c39dadc8b31cacaa86, role_id=912ab5f10fa5477da74acf239f07604e)` {{(pid=71939) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:442}} Nov 24 16:49:38.994514 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-207c8686-3366-4a51-8c9f-7a82e1c00804 admin admin] RBAC: Authorization granted {{(pid=71938) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 24 16:49:39.008794 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: [pid: 71938|app: 0|req: 1131/2275] 10.222.0.53 () {58 vars in 1143 bytes} [Wed Nov 24 16:49:38 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 64 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Nov 24 16:49:39.013505 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-207c8686-3366-4a51-8c9f-7a82e1c00804 admin admin] Authenticating user token {{(pid=71938) process_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 24 16:49:39.024419 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-207c8686-3366-4a51-8c9f-7a82e1c00804 admin admin] Validating token access rules against request {{(pid=71938) validate_allowed_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 24 16:49:39.024677 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1caf88db-2532-4427-9792-ac5331c254d1 admin admin] RBAC: Authorization granted {{(pid=71939) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 24 16:49:39.029811 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b64b7a89-223a-4817-9827-2c0f0337a633 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f2ba2e8375b4e8c8792ee1e22b60427', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '00a5583c7b7443e98e7a1d31a0b638dc', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=71938) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 24 16:49:39.030540 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b64b7a89-223a-4817-9827-2c0f0337a633 admin admin] REQUEST_METHOD: `POST` {{(pid=71938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 24 16:49:39.030890 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b64b7a89-223a-4817-9827-2c0f0337a633 admin admin] SCRIPT_NAME: `/identity` {{(pid=71938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 24 16:49:39.031228 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b64b7a89-223a-4817-9827-2c0f0337a633 admin admin] PATH_INFO: `/v3/projects` {{(pid=71938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 24 16:49:39.031976 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b64b7a89-223a-4817-9827-2c0f0337a633 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=71938) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:442}} Nov 24 16:49:39.038554 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: [pid: 71939|app: 0|req: 1145/2276] 10.222.0.53 () {60 vars in 1473 bytes} [Wed Nov 24 16:49:38 2021] PUT /identity/v3/projects/25c8dafba79546329272318b1fdb3776/users/d46c7e0be1f843c39dadc8b31cacaa86/roles/912ab5f10fa5477da74acf239f07604e => generated 0 bytes in 86 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Nov 24 16:49:39.049384 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e1793c4-aaee-42f7-879a-8038a9fb3e0b None None] REQUEST_METHOD: `POST` {{(pid=71939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 24 16:49:39.049748 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e1793c4-aaee-42f7-879a-8038a9fb3e0b None None] SCRIPT_NAME: `/identity` {{(pid=71939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 24 16:49:39.050089 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e1793c4-aaee-42f7-879a-8038a9fb3e0b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=71939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 24 16:49:39.062254 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b64b7a89-223a-4817-9827-2c0f0337a633 admin admin] RBAC: Authorization granted {{(pid=71938) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 24 16:49:39.091376 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.auth.core [None req-8e1793c4-aaee-42f7-879a-8038a9fb3e0b None None] MFA Rules not processed for user `d46c7e0be1f843c39dadc8b31cacaa86`. Rule list: `[]` (Enabled: `True`). {{(pid=71939) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:442}} Nov 24 16:49:39.093034 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.fernet_utils [None req-8e1793c4-aaee-42f7-879a-8038a9fb3e0b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=71939) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:289}} Nov 24 16:49:39.097907 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: [pid: 71938|app: 0|req: 1132/2277] 10.222.0.53 () {60 vars in 1143 bytes} [Wed Nov 24 16:49:39 2021] POST /identity/v3/projects => generated 373 bytes in 85 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Nov 24 16:49:39.104233 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b64b7a89-223a-4817-9827-2c0f0337a633 admin admin] Authenticating user token {{(pid=71938) process_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 24 16:49:39.192265 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: [pid: 71939|app: 0|req: 1146/2278] 10.222.0.53 () {58 vars in 948 bytes} [Wed Nov 24 16:49:39 2021] POST /identity/v3/auth/tokens => generated 3684 bytes in 144 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 24 16:49:39.201088 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e1793c4-aaee-42f7-879a-8038a9fb3e0b None None] Authenticating user token {{(pid=71939) process_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 24 16:49:39.206370 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.fernet_utils [None req-8e1793c4-aaee-42f7-879a-8038a9fb3e0b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=71939) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:289}} Nov 24 16:49:39.239529 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b64b7a89-223a-4817-9827-2c0f0337a633 admin admin] Validating token access rules against request {{(pid=71938) validate_allowed_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 24 16:49:39.248098 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c86fab1-c885-4229-bfdf-6aa2a3cb5c57 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f2ba2e8375b4e8c8792ee1e22b60427', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '00a5583c7b7443e98e7a1d31a0b638dc', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=71938) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 24 16:49:39.248934 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c86fab1-c885-4229-bfdf-6aa2a3cb5c57 admin admin] REQUEST_METHOD: `POST` {{(pid=71938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 24 16:49:39.249274 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c86fab1-c885-4229-bfdf-6aa2a3cb5c57 admin admin] SCRIPT_NAME: `/identity` {{(pid=71938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 24 16:49:39.249617 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c86fab1-c885-4229-bfdf-6aa2a3cb5c57 admin admin] PATH_INFO: `/v3/users` {{(pid=71938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 24 16:49:39.250463 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c86fab1-c885-4229-bfdf-6aa2a3cb5c57 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=71938) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:442}} Nov 24 16:49:39.281103 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c86fab1-c885-4229-bfdf-6aa2a3cb5c57 admin admin] RBAC: Authorization granted {{(pid=71938) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 24 16:49:39.313178 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: [pid: 71938|app: 0|req: 1133/2279] 10.222.0.53 () {60 vars in 1134 bytes} [Wed Nov 24 16:49:39 2021] POST /identity/v3/users => generated 287 bytes in 207 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Nov 24 16:49:39.314772 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c86fab1-c885-4229-bfdf-6aa2a3cb5c57 admin admin] Authenticating user token {{(pid=71938) process_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 24 16:49:39.326795 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c86fab1-c885-4229-bfdf-6aa2a3cb5c57 admin admin] Validating token access rules against request {{(pid=71938) validate_allowed_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 24 16:49:39.339580 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e1793c4-aaee-42f7-879a-8038a9fb3e0b None None] Validating token access rules against request {{(pid=71939) validate_allowed_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 24 16:49:39.339698 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fce7828-169e-44d3-bd08-934f3d781999 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f2ba2e8375b4e8c8792ee1e22b60427', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '00a5583c7b7443e98e7a1d31a0b638dc', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=71938) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 24 16:49:39.340197 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fce7828-169e-44d3-bd08-934f3d781999 admin admin] REQUEST_METHOD: `GET` {{(pid=71938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 24 16:49:39.340327 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fce7828-169e-44d3-bd08-934f3d781999 admin admin] SCRIPT_NAME: `/identity` {{(pid=71938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 24 16:49:39.340622 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fce7828-169e-44d3-bd08-934f3d781999 admin admin] PATH_INFO: `/v3/roles` {{(pid=71938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 24 16:49:39.341445 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fce7828-169e-44d3-bd08-934f3d781999 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=71938) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:442}} Nov 24 16:49:39.373576 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fce7828-169e-44d3-bd08-934f3d781999 admin admin] RBAC: Authorization granted {{(pid=71938) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 24 16:49:39.385482 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: [pid: 71938|app: 0|req: 1134/2280] 10.222.0.53 () {58 vars in 1112 bytes} [Wed Nov 24 16:49:39 2021] GET /identity/v3/roles => generated 1420 bytes in 72 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 24 16:49:39.390493 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fce7828-169e-44d3-bd08-934f3d781999 admin admin] Authenticating user token {{(pid=71938) process_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 24 16:49:39.401784 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-daed5df7-0f8a-4e6f-8a64-cf42c569e069 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a12374a3093a401a97c343ff0854184d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3b3940d4ae1c4177ae29c02377bb4b0b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=71939) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 24 16:49:39.401961 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fce7828-169e-44d3-bd08-934f3d781999 admin admin] Validating token access rules against request {{(pid=71938) validate_allowed_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 24 16:49:39.402529 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daed5df7-0f8a-4e6f-8a64-cf42c569e069 service cinder] REQUEST_METHOD: `GET` {{(pid=71939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 24 16:49:39.402873 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daed5df7-0f8a-4e6f-8a64-cf42c569e069 service cinder] SCRIPT_NAME: `/identity` {{(pid=71939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 24 16:49:39.403205 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daed5df7-0f8a-4e6f-8a64-cf42c569e069 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=71939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 24 16:49:39.406567 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc515fd5-e060-4d83-9f3f-a4d59aea78c0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f2ba2e8375b4e8c8792ee1e22b60427', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '00a5583c7b7443e98e7a1d31a0b638dc', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=71938) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 24 16:49:39.407480 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc515fd5-e060-4d83-9f3f-a4d59aea78c0 admin admin] REQUEST_METHOD: `PUT` {{(pid=71938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 24 16:49:39.407819 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc515fd5-e060-4d83-9f3f-a4d59aea78c0 admin admin] SCRIPT_NAME: `/identity` {{(pid=71938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 24 16:49:39.408154 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc515fd5-e060-4d83-9f3f-a4d59aea78c0 admin admin] PATH_INFO: `/v3/projects/b5aaef32c4f844289b05c9c2a6bcba3e/users/28432e1f696f440f9b411b30e33d4a80/roles/912ab5f10fa5477da74acf239f07604e` {{(pid=71938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 24 16:49:39.431262 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc515fd5-e060-4d83-9f3f-a4d59aea78c0 admin admin] RBAC: Authorizing `identity:create_grant(project_id=b5aaef32c4f844289b05c9c2a6bcba3e, user_id=28432e1f696f440f9b411b30e33d4a80, role_id=912ab5f10fa5477da74acf239f07604e)` {{(pid=71938) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:442}} Nov 24 16:49:39.462228 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc515fd5-e060-4d83-9f3f-a4d59aea78c0 admin admin] RBAC: Authorization granted {{(pid=71938) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 24 16:49:39.475101 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: [pid: 71938|app: 0|req: 1135/2281] 10.222.0.53 () {60 vars in 1473 bytes} [Wed Nov 24 16:49:39 2021] PUT /identity/v3/projects/b5aaef32c4f844289b05c9c2a6bcba3e/users/28432e1f696f440f9b411b30e33d4a80/roles/912ab5f10fa5477da74acf239f07604e => generated 0 bytes in 86 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Nov 24 16:49:39.476265 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-daed5df7-0f8a-4e6f-8a64-cf42c569e069 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=71939) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:442}} Nov 24 16:49:39.485658 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00abd531-1231-466e-8a45-42a082150eb3 None None] REQUEST_METHOD: `POST` {{(pid=71938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 24 16:49:39.486007 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00abd531-1231-466e-8a45-42a082150eb3 None None] SCRIPT_NAME: `/identity` {{(pid=71938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 24 16:49:39.486372 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00abd531-1231-466e-8a45-42a082150eb3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=71938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 24 16:49:39.504179 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-daed5df7-0f8a-4e6f-8a64-cf42c569e069 service cinder] RBAC: Authorization granted {{(pid=71939) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 24 16:49:39.517318 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: [pid: 71939|app: 0|req: 1147/2282] 10.222.0.53 () {60 vars in 1356 bytes} [Wed Nov 24 16:49:39 2021] GET /identity/v3/auth/tokens => generated 3684 bytes in 317 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 24 16:49:39.527414 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.auth.core [None req-00abd531-1231-466e-8a45-42a082150eb3 None None] MFA Rules not processed for user `28432e1f696f440f9b411b30e33d4a80`. Rule list: `[]` (Enabled: `True`). {{(pid=71938) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:442}} Nov 24 16:49:39.528656 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.fernet_utils [None req-00abd531-1231-466e-8a45-42a082150eb3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=71938) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:289}} Nov 24 16:49:39.611906 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: [pid: 71938|app: 0|req: 1136/2283] 10.222.0.53 () {58 vars in 948 bytes} [Wed Nov 24 16:49:39 2021] POST /identity/v3/auth/tokens => generated 3680 bytes in 127 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Nov 24 16:49:39.623073 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-daed5df7-0f8a-4e6f-8a64-cf42c569e069 service cinder] Authenticating user token {{(pid=71939) process_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 24 16:49:39.624617 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.fernet_utils [None req-daed5df7-0f8a-4e6f-8a64-cf42c569e069 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=71939) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:289}} Nov 24 16:49:39.636661 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-daed5df7-0f8a-4e6f-8a64-cf42c569e069 service cinder] Validating token access rules against request {{(pid=71939) validate_allowed_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 24 16:49:39.697524 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8c154c3-e711-41eb-b60c-56951875311d service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a12374a3093a401a97c343ff0854184d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3b3940d4ae1c4177ae29c02377bb4b0b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=71939) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 24 16:49:39.698339 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8c154c3-e711-41eb-b60c-56951875311d service cinder] REQUEST_METHOD: `GET` {{(pid=71939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 24 16:49:39.698752 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8c154c3-e711-41eb-b60c-56951875311d service cinder] SCRIPT_NAME: `/identity` {{(pid=71939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 24 16:49:39.699217 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8c154c3-e711-41eb-b60c-56951875311d service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=71939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 24 16:49:39.711307 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8c154c3-e711-41eb-b60c-56951875311d service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=71939) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:442}} Nov 24 16:49:39.744228 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8c154c3-e711-41eb-b60c-56951875311d service cinder] RBAC: Authorization granted {{(pid=71939) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 24 16:49:39.754813 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: [pid: 71939|app: 0|req: 1148/2284] 10.222.0.53 () {60 vars in 1356 bytes} [Wed Nov 24 16:49:39 2021] GET /identity/v3/auth/tokens => generated 3680 bytes in 132 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 24 16:49:39.783794 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00abd531-1231-466e-8a45-42a082150eb3 None None] Authenticating user token {{(pid=71938) process_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 24 16:49:39.879048 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00abd531-1231-466e-8a45-42a082150eb3 None None] Validating token access rules against request {{(pid=71938) validate_allowed_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 24 16:49:39.884960 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2202fad-8b58-4577-b576-4b3c05ffa6b4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f2ba2e8375b4e8c8792ee1e22b60427', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '00a5583c7b7443e98e7a1d31a0b638dc', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=71938) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 24 16:49:39.886254 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2202fad-8b58-4577-b576-4b3c05ffa6b4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=71938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 24 16:49:39.886760 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2202fad-8b58-4577-b576-4b3c05ffa6b4 admin admin] SCRIPT_NAME: `/identity` {{(pid=71938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 24 16:49:39.887359 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2202fad-8b58-4577-b576-4b3c05ffa6b4 admin admin] PATH_INFO: `/v3/users/28432e1f696f440f9b411b30e33d4a80` {{(pid=71938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 24 16:49:39.888859 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2202fad-8b58-4577-b576-4b3c05ffa6b4 admin admin] RBAC: Authorizing `identity:delete_user(user_id=28432e1f696f440f9b411b30e33d4a80)` {{(pid=71938) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:442}} Nov 24 16:49:39.937613 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2202fad-8b58-4577-b576-4b3c05ffa6b4 admin admin] RBAC: Authorization granted {{(pid=71938) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 24 16:49:39.997870 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.notifications [None req-c2202fad-8b58-4577-b576-4b3c05ffa6b4 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '28432e1f696f440f9b411b30e33d4a80'} {{(pid=71938) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:357}} Nov 24 16:49:40.011548 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.notifications [None req-c2202fad-8b58-4577-b576-4b3c05ffa6b4 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '28432e1f696f440f9b411b30e33d4a80'} {{(pid=71938) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:357}} Nov 24 16:49:40.012493 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.notifications [None req-c2202fad-8b58-4577-b576-4b3c05ffa6b4 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '28432e1f696f440f9b411b30e33d4a80'} {{(pid=71938) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:357}} Nov 24 16:49:40.022193 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.notifications [None req-c2202fad-8b58-4577-b576-4b3c05ffa6b4 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '28432e1f696f440f9b411b30e33d4a80'} {{(pid=71938) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:357}} Nov 24 16:49:40.029423 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.notifications [None req-c2202fad-8b58-4577-b576-4b3c05ffa6b4 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '28432e1f696f440f9b411b30e33d4a80'} {{(pid=71938) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:357}} Nov 24 16:49:40.036514 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: [pid: 71938|app: 0|req: 1137/2285] 10.222.0.53 () {58 vars in 1214 bytes} [Wed Nov 24 16:49:39 2021] DELETE /identity/v3/users/28432e1f696f440f9b411b30e33d4a80 => generated 0 bytes in 253 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 24 16:49:40.052121 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fd69214-d699-4f5d-831d-7185ae0ccd32 None None] REQUEST_METHOD: `POST` {{(pid=71939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 24 16:49:40.052516 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fd69214-d699-4f5d-831d-7185ae0ccd32 None None] SCRIPT_NAME: `/identity` {{(pid=71939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 24 16:49:40.052868 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fd69214-d699-4f5d-831d-7185ae0ccd32 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=71939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 24 16:49:40.080046 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.auth.core [None req-6fd69214-d699-4f5d-831d-7185ae0ccd32 None None] MFA Rules not processed for user `0f2ba2e8375b4e8c8792ee1e22b60427`. Rule list: `[]` (Enabled: `True`). {{(pid=71939) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:442}} Nov 24 16:49:40.081291 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.fernet_utils [None req-6fd69214-d699-4f5d-831d-7185ae0ccd32 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=71939) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:289}} Nov 24 16:49:40.121062 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2202fad-8b58-4577-b576-4b3c05ffa6b4 admin admin] Authenticating user token {{(pid=71938) process_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 24 16:49:40.123555 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.fernet_utils [None req-c2202fad-8b58-4577-b576-4b3c05ffa6b4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=71938) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:289}} Nov 24 16:49:40.173928 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: [pid: 71939|app: 0|req: 1149/2286] 10.222.0.53 () {58 vars in 948 bytes} [Wed Nov 24 16:49:40 2021] POST /identity/v3/auth/tokens => generated 3669 bytes in 134 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Nov 24 16:49:40.198862 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fd69214-d699-4f5d-831d-7185ae0ccd32 None None] Authenticating user token {{(pid=71939) process_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 24 16:49:40.202313 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.fernet_utils [None req-6fd69214-d699-4f5d-831d-7185ae0ccd32 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=71939) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:289}} Nov 24 16:49:40.225001 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2202fad-8b58-4577-b576-4b3c05ffa6b4 admin admin] Validating token access rules against request {{(pid=71938) validate_allowed_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 24 16:49:40.230835 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3cdcbee-ccde-4953-bc1f-c7fc0a83e1cb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f2ba2e8375b4e8c8792ee1e22b60427', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '00a5583c7b7443e98e7a1d31a0b638dc', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=71938) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 24 16:49:40.231753 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3cdcbee-ccde-4953-bc1f-c7fc0a83e1cb admin admin] REQUEST_METHOD: `DELETE` {{(pid=71938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 24 16:49:40.232099 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3cdcbee-ccde-4953-bc1f-c7fc0a83e1cb admin admin] SCRIPT_NAME: `/identity` {{(pid=71938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 24 16:49:40.232436 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3cdcbee-ccde-4953-bc1f-c7fc0a83e1cb admin admin] PATH_INFO: `/v3/users/2a783a33a0cb4a53a6be6ad9efccb259` {{(pid=71938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 24 16:49:40.234117 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3cdcbee-ccde-4953-bc1f-c7fc0a83e1cb admin admin] RBAC: Authorizing `identity:delete_user(user_id=2a783a33a0cb4a53a6be6ad9efccb259)` {{(pid=71938) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:442}} Nov 24 16:49:40.270491 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3cdcbee-ccde-4953-bc1f-c7fc0a83e1cb admin admin] RBAC: Authorization granted {{(pid=71938) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 24 16:49:40.286653 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fd69214-d699-4f5d-831d-7185ae0ccd32 None None] Validating token access rules against request {{(pid=71939) validate_allowed_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 24 16:49:40.291477 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ad98c84-5f0a-45a1-9cc4-adeb34b31a34 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c90f21b9cdcb413282461fa83cb6b7a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3b3940d4ae1c4177ae29c02377bb4b0b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=71939) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 24 16:49:40.292739 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ad98c84-5f0a-45a1-9cc4-adeb34b31a34 service neutron] REQUEST_METHOD: `GET` {{(pid=71939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 24 16:49:40.293888 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ad98c84-5f0a-45a1-9cc4-adeb34b31a34 service neutron] SCRIPT_NAME: `/identity` {{(pid=71939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 24 16:49:40.293888 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ad98c84-5f0a-45a1-9cc4-adeb34b31a34 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=71939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 24 16:49:40.312449 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ad98c84-5f0a-45a1-9cc4-adeb34b31a34 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=71939) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:442}} Nov 24 16:49:40.334855 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.notifications [None req-a3cdcbee-ccde-4953-bc1f-c7fc0a83e1cb admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '2a783a33a0cb4a53a6be6ad9efccb259'} {{(pid=71938) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:357}} Nov 24 16:49:40.343434 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ad98c84-5f0a-45a1-9cc4-adeb34b31a34 service neutron] RBAC: Authorization granted {{(pid=71939) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 24 16:49:40.361158 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.notifications [None req-a3cdcbee-ccde-4953-bc1f-c7fc0a83e1cb admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '2a783a33a0cb4a53a6be6ad9efccb259'} {{(pid=71938) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:357}} Nov 24 16:49:40.362294 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.notifications [None req-a3cdcbee-ccde-4953-bc1f-c7fc0a83e1cb admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '2a783a33a0cb4a53a6be6ad9efccb259'} {{(pid=71938) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:357}} Nov 24 16:49:40.370916 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: [pid: 71939|app: 0|req: 1150/2287] 10.222.0.53 () {60 vars in 1356 bytes} [Wed Nov 24 16:49:40 2021] GET /identity/v3/auth/tokens => generated 3669 bytes in 174 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 24 16:49:40.373692 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.notifications [None req-a3cdcbee-ccde-4953-bc1f-c7fc0a83e1cb admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '2a783a33a0cb4a53a6be6ad9efccb259'} {{(pid=71938) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:357}} Nov 24 16:49:40.382825 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.notifications [None req-a3cdcbee-ccde-4953-bc1f-c7fc0a83e1cb admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '2a783a33a0cb4a53a6be6ad9efccb259'} {{(pid=71938) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:357}} Nov 24 16:49:40.391262 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: [pid: 71938|app: 0|req: 1138/2288] 10.222.0.53 () {58 vars in 1214 bytes} [Wed Nov 24 16:49:40 2021] DELETE /identity/v3/users/2a783a33a0cb4a53a6be6ad9efccb259 => generated 0 bytes in 271 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 24 16:49:40.395774 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c85e36e-2d98-41f1-9919-d3bf0486fd54 None None] REQUEST_METHOD: `POST` {{(pid=71939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 24 16:49:40.396131 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c85e36e-2d98-41f1-9919-d3bf0486fd54 None None] SCRIPT_NAME: `/identity` {{(pid=71939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 24 16:49:40.397044 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c85e36e-2d98-41f1-9919-d3bf0486fd54 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=71939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 24 16:49:40.438951 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.auth.core [None req-1c85e36e-2d98-41f1-9919-d3bf0486fd54 None None] MFA Rules not processed for user `0f2ba2e8375b4e8c8792ee1e22b60427`. Rule list: `[]` (Enabled: `True`). {{(pid=71939) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:442}} Nov 24 16:49:40.441419 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.fernet_utils [None req-1c85e36e-2d98-41f1-9919-d3bf0486fd54 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=71939) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:289}} Nov 24 16:49:40.548719 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: [pid: 71939|app: 0|req: 1151/2289] 10.222.0.53 () {58 vars in 948 bytes} [Wed Nov 24 16:49:40 2021] POST /identity/v3/auth/tokens => generated 3669 bytes in 154 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 24 16:49:40.564194 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3cdcbee-ccde-4953-bc1f-c7fc0a83e1cb admin admin] Authenticating user token {{(pid=71938) process_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 24 16:49:40.566680 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.fernet_utils [None req-a3cdcbee-ccde-4953-bc1f-c7fc0a83e1cb admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=71938) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:289}} Nov 24 16:49:40.656682 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3cdcbee-ccde-4953-bc1f-c7fc0a83e1cb admin admin] Validating token access rules against request {{(pid=71938) validate_allowed_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 24 16:49:40.660878 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0b9ece8-d3aa-4095-97a0-28f48834161e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c90f21b9cdcb413282461fa83cb6b7a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3b3940d4ae1c4177ae29c02377bb4b0b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=71938) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 24 16:49:40.661553 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0b9ece8-d3aa-4095-97a0-28f48834161e service neutron] REQUEST_METHOD: `GET` {{(pid=71938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 24 16:49:40.661881 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0b9ece8-d3aa-4095-97a0-28f48834161e service neutron] SCRIPT_NAME: `/identity` {{(pid=71938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 24 16:49:40.663167 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0b9ece8-d3aa-4095-97a0-28f48834161e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=71938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 24 16:49:40.675089 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0b9ece8-d3aa-4095-97a0-28f48834161e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=71938) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:442}} Nov 24 16:49:40.709234 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0b9ece8-d3aa-4095-97a0-28f48834161e service neutron] RBAC: Authorization granted {{(pid=71938) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 24 16:49:40.721370 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: [pid: 71938|app: 0|req: 1139/2290] 10.222.0.53 () {60 vars in 1356 bytes} [Wed Nov 24 16:49:40 2021] GET /identity/v3/auth/tokens => generated 3669 bytes in 159 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 24 16:49:40.952261 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c85e36e-2d98-41f1-9919-d3bf0486fd54 None None] Authenticating user token {{(pid=71939) process_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 24 16:49:40.953836 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.fernet_utils [None req-1c85e36e-2d98-41f1-9919-d3bf0486fd54 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=71939) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:289}} Nov 24 16:49:40.968450 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c85e36e-2d98-41f1-9919-d3bf0486fd54 None None] Validating token access rules against request {{(pid=71939) validate_allowed_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 24 16:49:40.974652 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bf15c8a-80d9-4892-8bcb-fd0d7fce3890 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f2ba2e8375b4e8c8792ee1e22b60427', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '00a5583c7b7443e98e7a1d31a0b638dc', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=71939) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 24 16:49:40.975558 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bf15c8a-80d9-4892-8bcb-fd0d7fce3890 admin admin] REQUEST_METHOD: `DELETE` {{(pid=71939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 24 16:49:40.975901 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bf15c8a-80d9-4892-8bcb-fd0d7fce3890 admin admin] SCRIPT_NAME: `/identity` {{(pid=71939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 24 16:49:40.976237 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bf15c8a-80d9-4892-8bcb-fd0d7fce3890 admin admin] PATH_INFO: `/v3/projects/b5aaef32c4f844289b05c9c2a6bcba3e` {{(pid=71939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 24 16:49:40.977905 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bf15c8a-80d9-4892-8bcb-fd0d7fce3890 admin admin] RBAC: Authorizing `identity:delete_project(project_id=b5aaef32c4f844289b05c9c2a6bcba3e)` {{(pid=71939) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:442}} Nov 24 16:49:41.011448 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bf15c8a-80d9-4892-8bcb-fd0d7fce3890 admin admin] RBAC: Authorization granted {{(pid=71939) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 24 16:49:41.083834 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.notifications [None req-4bf15c8a-80d9-4892-8bcb-fd0d7fce3890 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b5aaef32c4f844289b05c9c2a6bcba3e', 'request_id': 'req-4bf15c8a-80d9-4892-8bcb-fd0d7fce3890'} {{(pid=71939) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:357}} Nov 24 16:49:41.103358 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.notifications [None req-4bf15c8a-80d9-4892-8bcb-fd0d7fce3890 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b5aaef32c4f844289b05c9c2a6bcba3e', 'request_id': 'req-4bf15c8a-80d9-4892-8bcb-fd0d7fce3890'} {{(pid=71939) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:357}} Nov 24 16:49:41.119487 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.notifications [None req-4bf15c8a-80d9-4892-8bcb-fd0d7fce3890 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b5aaef32c4f844289b05c9c2a6bcba3e', 'request_id': 'req-4bf15c8a-80d9-4892-8bcb-fd0d7fce3890'} {{(pid=71939) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:357}} Nov 24 16:49:41.134907 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.notifications [None req-4bf15c8a-80d9-4892-8bcb-fd0d7fce3890 admin admin] The token cache is being invalidate because project b5aaef32c4f844289b05c9c2a6bcba3e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=71939) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Nov 24 16:49:41.135368 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.notifications [None req-4bf15c8a-80d9-4892-8bcb-fd0d7fce3890 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=71939) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:357}} Nov 24 16:49:41.136086 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.notifications [None req-4bf15c8a-80d9-4892-8bcb-fd0d7fce3890 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=71939) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:357}} Nov 24 16:49:41.138297 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: [pid: 71939|app: 0|req: 1152/2291] 10.222.0.53 () {58 vars in 1223 bytes} [Wed Nov 24 16:49:40 2021] DELETE /identity/v3/projects/b5aaef32c4f844289b05c9c2a6bcba3e => generated 0 bytes in 187 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 24 16:49:41.165206 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0b9ece8-d3aa-4095-97a0-28f48834161e service neutron] Authenticating user token {{(pid=71938) process_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 24 16:49:41.167846 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.fernet_utils [None req-a0b9ece8-d3aa-4095-97a0-28f48834161e service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=71938) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:289}} Nov 24 16:49:41.201059 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0b9ece8-d3aa-4095-97a0-28f48834161e service neutron] Validating token access rules against request {{(pid=71938) validate_allowed_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 24 16:49:41.311815 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69793235-4825-4a6d-8a21-f223b700c8a5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f2ba2e8375b4e8c8792ee1e22b60427', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '00a5583c7b7443e98e7a1d31a0b638dc', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=71938) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 24 16:49:41.312828 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69793235-4825-4a6d-8a21-f223b700c8a5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=71938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 24 16:49:41.313245 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69793235-4825-4a6d-8a21-f223b700c8a5 admin admin] SCRIPT_NAME: `/identity` {{(pid=71938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 24 16:49:41.313807 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69793235-4825-4a6d-8a21-f223b700c8a5 admin admin] PATH_INFO: `/v3/projects/c6bec5981a7541ba828ae55abd924a85` {{(pid=71938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 24 16:49:41.315241 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69793235-4825-4a6d-8a21-f223b700c8a5 admin admin] RBAC: Authorizing `identity:delete_project(project_id=c6bec5981a7541ba828ae55abd924a85)` {{(pid=71938) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:442}} Nov 24 16:49:41.346562 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69793235-4825-4a6d-8a21-f223b700c8a5 admin admin] RBAC: Authorization granted {{(pid=71938) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 24 16:49:41.402573 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.notifications [None req-69793235-4825-4a6d-8a21-f223b700c8a5 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c6bec5981a7541ba828ae55abd924a85', 'request_id': 'req-69793235-4825-4a6d-8a21-f223b700c8a5'} {{(pid=71938) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:357}} Nov 24 16:49:41.415616 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.notifications [None req-69793235-4825-4a6d-8a21-f223b700c8a5 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c6bec5981a7541ba828ae55abd924a85', 'request_id': 'req-69793235-4825-4a6d-8a21-f223b700c8a5'} {{(pid=71938) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:357}} Nov 24 16:49:41.421044 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.notifications [None req-69793235-4825-4a6d-8a21-f223b700c8a5 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c6bec5981a7541ba828ae55abd924a85', 'request_id': 'req-69793235-4825-4a6d-8a21-f223b700c8a5'} {{(pid=71938) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:357}} Nov 24 16:49:41.436146 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.notifications [None req-69793235-4825-4a6d-8a21-f223b700c8a5 admin admin] The token cache is being invalidate because project c6bec5981a7541ba828ae55abd924a85 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=71938) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Nov 24 16:49:41.436476 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.notifications [None req-69793235-4825-4a6d-8a21-f223b700c8a5 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=71938) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:357}} Nov 24 16:49:41.437160 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.notifications [None req-69793235-4825-4a6d-8a21-f223b700c8a5 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=71938) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:357}} Nov 24 16:49:41.438753 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: [pid: 71938|app: 0|req: 1140/2292] 10.222.0.53 () {58 vars in 1223 bytes} [Wed Nov 24 16:49:41 2021] DELETE /identity/v3/projects/c6bec5981a7541ba828ae55abd924a85 => generated 0 bytes in 274 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 24 16:49:41.443891 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bf15c8a-80d9-4892-8bcb-fd0d7fce3890 admin admin] Authenticating user token {{(pid=71939) process_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 24 16:49:41.445337 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.fernet_utils [None req-4bf15c8a-80d9-4892-8bcb-fd0d7fce3890 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=71939) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:289}} Nov 24 16:49:41.458060 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bf15c8a-80d9-4892-8bcb-fd0d7fce3890 admin admin] Validating token access rules against request {{(pid=71939) validate_allowed_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 24 16:49:41.527061 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59b0b2c1-a318-4b08-80ee-550c92ede4b1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f2ba2e8375b4e8c8792ee1e22b60427', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '00a5583c7b7443e98e7a1d31a0b638dc', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=71939) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 24 16:49:41.529616 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59b0b2c1-a318-4b08-80ee-550c92ede4b1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=71939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 24 16:49:41.529616 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59b0b2c1-a318-4b08-80ee-550c92ede4b1 admin admin] SCRIPT_NAME: `/identity` {{(pid=71939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 24 16:49:41.529616 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59b0b2c1-a318-4b08-80ee-550c92ede4b1 admin admin] PATH_INFO: `/v3/users/cbe4dd835e124b099afbcbb20a16ef73` {{(pid=71939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 24 16:49:41.530523 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59b0b2c1-a318-4b08-80ee-550c92ede4b1 admin admin] RBAC: Authorizing `identity:delete_user(user_id=cbe4dd835e124b099afbcbb20a16ef73)` {{(pid=71939) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:442}} Nov 24 16:49:41.565304 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59b0b2c1-a318-4b08-80ee-550c92ede4b1 admin admin] RBAC: Authorization granted {{(pid=71939) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 24 16:49:41.625729 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.notifications [None req-59b0b2c1-a318-4b08-80ee-550c92ede4b1 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'cbe4dd835e124b099afbcbb20a16ef73'} {{(pid=71939) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:357}} Nov 24 16:49:41.647311 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.notifications [None req-59b0b2c1-a318-4b08-80ee-550c92ede4b1 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'cbe4dd835e124b099afbcbb20a16ef73'} {{(pid=71939) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:357}} Nov 24 16:49:41.648728 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.notifications [None req-59b0b2c1-a318-4b08-80ee-550c92ede4b1 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'cbe4dd835e124b099afbcbb20a16ef73'} {{(pid=71939) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:357}} Nov 24 16:49:41.657625 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.notifications [None req-59b0b2c1-a318-4b08-80ee-550c92ede4b1 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'cbe4dd835e124b099afbcbb20a16ef73'} {{(pid=71939) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:357}} Nov 24 16:49:41.664129 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.notifications [None req-59b0b2c1-a318-4b08-80ee-550c92ede4b1 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'cbe4dd835e124b099afbcbb20a16ef73'} {{(pid=71939) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:357}} Nov 24 16:49:41.674464 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: [pid: 71939|app: 0|req: 1153/2293] 10.222.0.53 () {58 vars in 1214 bytes} [Wed Nov 24 16:49:41 2021] DELETE /identity/v3/users/cbe4dd835e124b099afbcbb20a16ef73 => generated 0 bytes in 229 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 24 16:49:42.055589 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69793235-4825-4a6d-8a21-f223b700c8a5 admin admin] Authenticating user token {{(pid=71938) process_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 24 16:49:42.057075 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.fernet_utils [None req-69793235-4825-4a6d-8a21-f223b700c8a5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=71938) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:289}} Nov 24 16:49:42.071569 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69793235-4825-4a6d-8a21-f223b700c8a5 admin admin] Validating token access rules against request {{(pid=71938) validate_allowed_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 24 16:49:42.140336 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2e8053b-fecd-4aa2-b5f1-d6696bea6429 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f2ba2e8375b4e8c8792ee1e22b60427', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '00a5583c7b7443e98e7a1d31a0b638dc', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=71938) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 24 16:49:42.141232 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2e8053b-fecd-4aa2-b5f1-d6696bea6429 admin admin] REQUEST_METHOD: `DELETE` {{(pid=71938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 24 16:49:42.141582 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2e8053b-fecd-4aa2-b5f1-d6696bea6429 admin admin] SCRIPT_NAME: `/identity` {{(pid=71938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 24 16:49:42.141919 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2e8053b-fecd-4aa2-b5f1-d6696bea6429 admin admin] PATH_INFO: `/v3/projects/d93fbb4457ea4f3aadd2b195c740372a` {{(pid=71938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 24 16:49:42.143552 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2e8053b-fecd-4aa2-b5f1-d6696bea6429 admin admin] RBAC: Authorizing `identity:delete_project(project_id=d93fbb4457ea4f3aadd2b195c740372a)` {{(pid=71938) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:442}} Nov 24 16:49:42.173663 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2e8053b-fecd-4aa2-b5f1-d6696bea6429 admin admin] RBAC: Authorization granted {{(pid=71938) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 24 16:49:42.230060 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.notifications [None req-b2e8053b-fecd-4aa2-b5f1-d6696bea6429 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd93fbb4457ea4f3aadd2b195c740372a', 'request_id': 'req-b2e8053b-fecd-4aa2-b5f1-d6696bea6429'} {{(pid=71938) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:357}} Nov 24 16:49:42.243999 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.notifications [None req-b2e8053b-fecd-4aa2-b5f1-d6696bea6429 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd93fbb4457ea4f3aadd2b195c740372a', 'request_id': 'req-b2e8053b-fecd-4aa2-b5f1-d6696bea6429'} {{(pid=71938) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:357}} Nov 24 16:49:42.250198 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.notifications [None req-b2e8053b-fecd-4aa2-b5f1-d6696bea6429 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd93fbb4457ea4f3aadd2b195c740372a', 'request_id': 'req-b2e8053b-fecd-4aa2-b5f1-d6696bea6429'} {{(pid=71938) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:357}} Nov 24 16:49:42.262391 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.notifications [None req-b2e8053b-fecd-4aa2-b5f1-d6696bea6429 admin admin] The token cache is being invalidate because project d93fbb4457ea4f3aadd2b195c740372a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=71938) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Nov 24 16:49:42.262900 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.notifications [None req-b2e8053b-fecd-4aa2-b5f1-d6696bea6429 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=71938) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:357}} Nov 24 16:49:42.263579 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.notifications [None req-b2e8053b-fecd-4aa2-b5f1-d6696bea6429 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=71938) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:357}} Nov 24 16:49:42.265173 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: [pid: 71938|app: 0|req: 1141/2294] 10.222.0.53 () {58 vars in 1223 bytes} [Wed Nov 24 16:49:42 2021] DELETE /identity/v3/projects/d93fbb4457ea4f3aadd2b195c740372a => generated 0 bytes in 210 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 24 16:49:42.271750 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17656ab4-5f1d-42b1-ba18-0b9b6d90f568 None None] REQUEST_METHOD: `POST` {{(pid=71939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 24 16:49:42.272185 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17656ab4-5f1d-42b1-ba18-0b9b6d90f568 None None] SCRIPT_NAME: `/identity` {{(pid=71939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 24 16:49:42.272525 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17656ab4-5f1d-42b1-ba18-0b9b6d90f568 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=71939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 24 16:49:42.296865 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.auth.core [None req-17656ab4-5f1d-42b1-ba18-0b9b6d90f568 None None] MFA Rules not processed for user `0f2ba2e8375b4e8c8792ee1e22b60427`. Rule list: `[]` (Enabled: `True`). {{(pid=71939) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:442}} Nov 24 16:49:42.298071 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.fernet_utils [None req-17656ab4-5f1d-42b1-ba18-0b9b6d90f568 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=71939) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:289}} Nov 24 16:49:42.368055 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: [pid: 71939|app: 0|req: 1154/2295] 10.222.0.53 () {58 vars in 948 bytes} [Wed Nov 24 16:49:42 2021] POST /identity/v3/auth/tokens => generated 3669 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 24 16:49:42.377324 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-072175f3-e2dc-4b0d-81b8-9dbc8ac23235 None None] REQUEST_METHOD: `POST` {{(pid=71938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 24 16:49:42.377674 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-072175f3-e2dc-4b0d-81b8-9dbc8ac23235 None None] SCRIPT_NAME: `/identity` {{(pid=71938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 24 16:49:42.378006 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-072175f3-e2dc-4b0d-81b8-9dbc8ac23235 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=71938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 24 16:49:42.401897 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.auth.core [None req-072175f3-e2dc-4b0d-81b8-9dbc8ac23235 None None] MFA Rules not processed for user `0f2ba2e8375b4e8c8792ee1e22b60427`. Rule list: `[]` (Enabled: `True`). {{(pid=71938) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:442}} Nov 24 16:49:42.403212 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.fernet_utils [None req-072175f3-e2dc-4b0d-81b8-9dbc8ac23235 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=71938) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:289}} Nov 24 16:49:42.411013 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: [pid: 71938|app: 0|req: 1142/2296] 10.222.0.53 () {58 vars in 948 bytes} [Wed Nov 24 16:49:42 2021] POST /identity/v3/auth/tokens => generated 3669 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 24 16:49:42.416099 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17656ab4-5f1d-42b1-ba18-0b9b6d90f568 None None] Authenticating user token {{(pid=71939) process_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 24 16:49:42.428635 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17656ab4-5f1d-42b1-ba18-0b9b6d90f568 None None] Validating token access rules against request {{(pid=71939) validate_allowed_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 24 16:49:42.433187 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4e353b7-6f74-4f37-914a-1fabf40cd8dc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f2ba2e8375b4e8c8792ee1e22b60427', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '00a5583c7b7443e98e7a1d31a0b638dc', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=71939) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 24 16:49:42.433861 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4e353b7-6f74-4f37-914a-1fabf40cd8dc admin admin] REQUEST_METHOD: `GET` {{(pid=71939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 24 16:49:42.434228 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4e353b7-6f74-4f37-914a-1fabf40cd8dc admin admin] SCRIPT_NAME: `/identity` {{(pid=71939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 24 16:49:42.434559 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4e353b7-6f74-4f37-914a-1fabf40cd8dc admin admin] PATH_INFO: `/v3/domains` {{(pid=71939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 24 16:49:42.435354 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4e353b7-6f74-4f37-914a-1fabf40cd8dc admin admin] RBAC: Adding query filter params (name=Default) {{(pid=71939) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:161}} Nov 24 16:49:42.435701 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4e353b7-6f74-4f37-914a-1fabf40cd8dc admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=71939) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:442}} Nov 24 16:49:42.464882 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4e353b7-6f74-4f37-914a-1fabf40cd8dc admin admin] RBAC: Authorization granted {{(pid=71939) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 24 16:49:42.478917 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: [pid: 71939|app: 0|req: 1155/2297] 10.222.0.53 () {58 vars in 1143 bytes} [Wed Nov 24 16:49:42 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 63 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 24 16:49:42.483674 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-072175f3-e2dc-4b0d-81b8-9dbc8ac23235 None None] Authenticating user token {{(pid=71938) process_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 24 16:49:42.493267 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-072175f3-e2dc-4b0d-81b8-9dbc8ac23235 None None] Validating token access rules against request {{(pid=71938) validate_allowed_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 24 16:49:42.498003 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3008a537-e451-4aa8-90c6-39937628d942 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f2ba2e8375b4e8c8792ee1e22b60427', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '00a5583c7b7443e98e7a1d31a0b638dc', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=71938) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 24 16:49:42.498734 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3008a537-e451-4aa8-90c6-39937628d942 admin admin] REQUEST_METHOD: `POST` {{(pid=71938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 24 16:49:42.499074 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3008a537-e451-4aa8-90c6-39937628d942 admin admin] SCRIPT_NAME: `/identity` {{(pid=71938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 24 16:49:42.499405 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3008a537-e451-4aa8-90c6-39937628d942 admin admin] PATH_INFO: `/v3/projects` {{(pid=71938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 24 16:49:42.500142 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3008a537-e451-4aa8-90c6-39937628d942 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=71938) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:442}} Nov 24 16:49:42.529585 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3008a537-e451-4aa8-90c6-39937628d942 admin admin] RBAC: Authorization granted {{(pid=71938) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 24 16:49:42.559362 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: [pid: 71938|app: 0|req: 1143/2298] 10.222.0.53 () {60 vars in 1143 bytes} [Wed Nov 24 16:49:42 2021] POST /identity/v3/projects => generated 377 bytes in 75 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 24 16:49:42.563038 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4e353b7-6f74-4f37-914a-1fabf40cd8dc admin admin] Authenticating user token {{(pid=71939) process_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 24 16:49:42.576134 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4e353b7-6f74-4f37-914a-1fabf40cd8dc admin admin] Validating token access rules against request {{(pid=71939) validate_allowed_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 24 16:49:42.644245 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3fa1c58-39e4-49b6-9a30-0fee58ca84be admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f2ba2e8375b4e8c8792ee1e22b60427', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '00a5583c7b7443e98e7a1d31a0b638dc', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=71939) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 24 16:49:42.644947 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3fa1c58-39e4-49b6-9a30-0fee58ca84be admin admin] REQUEST_METHOD: `POST` {{(pid=71939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 24 16:49:42.645266 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3fa1c58-39e4-49b6-9a30-0fee58ca84be admin admin] SCRIPT_NAME: `/identity` {{(pid=71939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 24 16:49:42.645594 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3fa1c58-39e4-49b6-9a30-0fee58ca84be admin admin] PATH_INFO: `/v3/users` {{(pid=71939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 24 16:49:42.646370 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3fa1c58-39e4-49b6-9a30-0fee58ca84be admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=71939) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:442}} Nov 24 16:49:42.675009 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3fa1c58-39e4-49b6-9a30-0fee58ca84be admin admin] RBAC: Authorization granted {{(pid=71939) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 24 16:49:42.696516 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: [pid: 71939|app: 0|req: 1156/2299] 10.222.0.53 () {60 vars in 1134 bytes} [Wed Nov 24 16:49:42 2021] POST /identity/v3/users => generated 289 bytes in 134 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 24 16:49:42.701431 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3008a537-e451-4aa8-90c6-39937628d942 admin admin] Authenticating user token {{(pid=71938) process_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 24 16:49:42.712220 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3008a537-e451-4aa8-90c6-39937628d942 admin admin] Validating token access rules against request {{(pid=71938) validate_allowed_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 24 16:49:42.716869 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08ed35db-e4f5-4023-b8a0-91a2b7345af2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f2ba2e8375b4e8c8792ee1e22b60427', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '00a5583c7b7443e98e7a1d31a0b638dc', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=71938) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 24 16:49:42.717555 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08ed35db-e4f5-4023-b8a0-91a2b7345af2 admin admin] REQUEST_METHOD: `GET` {{(pid=71938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 24 16:49:42.717896 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08ed35db-e4f5-4023-b8a0-91a2b7345af2 admin admin] SCRIPT_NAME: `/identity` {{(pid=71938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 24 16:49:42.718262 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08ed35db-e4f5-4023-b8a0-91a2b7345af2 admin admin] PATH_INFO: `/v3/roles` {{(pid=71938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 24 16:49:42.719119 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08ed35db-e4f5-4023-b8a0-91a2b7345af2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=71938) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:442}} Nov 24 16:49:42.747748 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08ed35db-e4f5-4023-b8a0-91a2b7345af2 admin admin] RBAC: Authorization granted {{(pid=71938) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 24 16:49:42.760280 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: [pid: 71938|app: 0|req: 1144/2300] 10.222.0.53 () {58 vars in 1112 bytes} [Wed Nov 24 16:49:42 2021] GET /identity/v3/roles => generated 1420 bytes in 59 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 24 16:49:42.764631 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3fa1c58-39e4-49b6-9a30-0fee58ca84be admin admin] Authenticating user token {{(pid=71939) process_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 24 16:49:42.775133 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3fa1c58-39e4-49b6-9a30-0fee58ca84be admin admin] Validating token access rules against request {{(pid=71939) validate_allowed_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 24 16:49:42.779966 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d6a85bb-8994-40e9-b254-1aad47add7ba admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f2ba2e8375b4e8c8792ee1e22b60427', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '00a5583c7b7443e98e7a1d31a0b638dc', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=71939) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 24 16:49:42.780878 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d6a85bb-8994-40e9-b254-1aad47add7ba admin admin] REQUEST_METHOD: `PUT` {{(pid=71939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 24 16:49:42.781221 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d6a85bb-8994-40e9-b254-1aad47add7ba admin admin] SCRIPT_NAME: `/identity` {{(pid=71939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 24 16:49:42.781558 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d6a85bb-8994-40e9-b254-1aad47add7ba admin admin] PATH_INFO: `/v3/projects/1fb8d3d98f254680b6f43b83260e6799/users/4a4504c55b944f6c89a8e99197375321/roles/912ab5f10fa5477da74acf239f07604e` {{(pid=71939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 24 16:49:42.803647 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d6a85bb-8994-40e9-b254-1aad47add7ba admin admin] RBAC: Authorizing `identity:create_grant(project_id=1fb8d3d98f254680b6f43b83260e6799, user_id=4a4504c55b944f6c89a8e99197375321, role_id=912ab5f10fa5477da74acf239f07604e)` {{(pid=71939) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:442}} Nov 24 16:49:42.834375 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d6a85bb-8994-40e9-b254-1aad47add7ba admin admin] RBAC: Authorization granted {{(pid=71939) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 24 16:49:42.847975 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: [pid: 71939|app: 0|req: 1157/2301] 10.222.0.53 () {60 vars in 1473 bytes} [Wed Nov 24 16:49:42 2021] PUT /identity/v3/projects/1fb8d3d98f254680b6f43b83260e6799/users/4a4504c55b944f6c89a8e99197375321/roles/912ab5f10fa5477da74acf239f07604e => generated 0 bytes in 84 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 24 16:49:42.859546 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2de6d84e-8d70-44c7-852f-1c15fb879080 None None] REQUEST_METHOD: `POST` {{(pid=71938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 24 16:49:42.859897 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2de6d84e-8d70-44c7-852f-1c15fb879080 None None] SCRIPT_NAME: `/identity` {{(pid=71938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 24 16:49:42.860235 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2de6d84e-8d70-44c7-852f-1c15fb879080 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=71938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 24 16:49:42.900169 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.auth.core [None req-2de6d84e-8d70-44c7-852f-1c15fb879080 None None] MFA Rules not processed for user `4a4504c55b944f6c89a8e99197375321`. Rule list: `[]` (Enabled: `True`). {{(pid=71938) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:442}} Nov 24 16:49:42.901433 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.fernet_utils [None req-2de6d84e-8d70-44c7-852f-1c15fb879080 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=71938) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:289}} Nov 24 16:49:42.984585 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: [pid: 71938|app: 0|req: 1145/2302] 10.222.0.53 () {58 vars in 948 bytes} [Wed Nov 24 16:49:42 2021] POST /identity/v3/auth/tokens => generated 3684 bytes in 126 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 24 16:49:42.996345 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d6a85bb-8994-40e9-b254-1aad47add7ba admin admin] Authenticating user token {{(pid=71939) process_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 24 16:49:42.998175 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.fernet_utils [None req-8d6a85bb-8994-40e9-b254-1aad47add7ba admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=71939) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:289}} Nov 24 16:49:43.069615 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d6a85bb-8994-40e9-b254-1aad47add7ba admin admin] Validating token access rules against request {{(pid=71939) validate_allowed_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 24 16:49:43.073291 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74bbdf1c-7f6c-40e7-bb5b-c9abc958bf80 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'af9e91f8d56c491d99fab4346754ce2e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3b3940d4ae1c4177ae29c02377bb4b0b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=71939) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 24 16:49:43.073952 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74bbdf1c-7f6c-40e7-bb5b-c9abc958bf80 service glance] REQUEST_METHOD: `GET` {{(pid=71939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 24 16:49:43.074325 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74bbdf1c-7f6c-40e7-bb5b-c9abc958bf80 service glance] SCRIPT_NAME: `/identity` {{(pid=71939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 24 16:49:43.074658 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74bbdf1c-7f6c-40e7-bb5b-c9abc958bf80 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=71939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 24 16:49:43.083559 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74bbdf1c-7f6c-40e7-bb5b-c9abc958bf80 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=71939) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:442}} Nov 24 16:49:43.111668 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74bbdf1c-7f6c-40e7-bb5b-c9abc958bf80 service glance] RBAC: Authorization granted {{(pid=71939) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 24 16:49:43.122335 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: [pid: 71939|app: 0|req: 1158/2303] 10.222.0.53 () {60 vars in 1356 bytes} [Wed Nov 24 16:49:42 2021] GET /identity/v3/auth/tokens => generated 3684 bytes in 127 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 24 16:49:46.346449 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2de6d84e-8d70-44c7-852f-1c15fb879080 None None] Authenticating user token {{(pid=71938) process_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 24 16:49:46.348009 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.fernet_utils [None req-2de6d84e-8d70-44c7-852f-1c15fb879080 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=71938) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:289}} Nov 24 16:49:46.432797 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2de6d84e-8d70-44c7-852f-1c15fb879080 None None] Validating token access rules against request {{(pid=71938) validate_allowed_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 24 16:49:46.438646 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f7deb0b-91e3-4c08-8316-90966fffb43a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f2ba2e8375b4e8c8792ee1e22b60427', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '00a5583c7b7443e98e7a1d31a0b638dc', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=71938) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 24 16:49:46.439860 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f7deb0b-91e3-4c08-8316-90966fffb43a admin admin] REQUEST_METHOD: `DELETE` {{(pid=71938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 24 16:49:46.440233 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f7deb0b-91e3-4c08-8316-90966fffb43a admin admin] SCRIPT_NAME: `/identity` {{(pid=71938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 24 16:49:46.440571 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f7deb0b-91e3-4c08-8316-90966fffb43a admin admin] PATH_INFO: `/v3/users/6a69bc513f44453a967928902f9b23f9` {{(pid=71938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 24 16:49:46.442195 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f7deb0b-91e3-4c08-8316-90966fffb43a admin admin] RBAC: Authorizing `identity:delete_user(user_id=6a69bc513f44453a967928902f9b23f9)` {{(pid=71938) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:442}} Nov 24 16:49:46.473743 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f7deb0b-91e3-4c08-8316-90966fffb43a admin admin] RBAC: Authorization granted {{(pid=71938) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 24 16:49:46.526476 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.notifications [None req-6f7deb0b-91e3-4c08-8316-90966fffb43a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '6a69bc513f44453a967928902f9b23f9'} {{(pid=71938) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:357}} Nov 24 16:49:46.539827 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.notifications [None req-6f7deb0b-91e3-4c08-8316-90966fffb43a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '6a69bc513f44453a967928902f9b23f9'} {{(pid=71938) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:357}} Nov 24 16:49:46.540505 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.notifications [None req-6f7deb0b-91e3-4c08-8316-90966fffb43a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '6a69bc513f44453a967928902f9b23f9'} {{(pid=71938) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:357}} Nov 24 16:49:46.549265 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.notifications [None req-6f7deb0b-91e3-4c08-8316-90966fffb43a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '6a69bc513f44453a967928902f9b23f9'} {{(pid=71938) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:357}} Nov 24 16:49:46.556611 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.notifications [None req-6f7deb0b-91e3-4c08-8316-90966fffb43a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '6a69bc513f44453a967928902f9b23f9'} {{(pid=71938) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:357}} Nov 24 16:49:46.563684 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: [pid: 71938|app: 0|req: 1146/2304] 10.222.0.53 () {58 vars in 1214 bytes} [Wed Nov 24 16:49:46 2021] DELETE /identity/v3/users/6a69bc513f44453a967928902f9b23f9 => generated 0 bytes in 218 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 24 16:49:46.569422 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb5324fc-ba88-4314-8a9a-a4d6a3e90cf4 None None] REQUEST_METHOD: `POST` {{(pid=71939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 24 16:49:46.569775 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb5324fc-ba88-4314-8a9a-a4d6a3e90cf4 None None] SCRIPT_NAME: `/identity` {{(pid=71939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 24 16:49:46.570146 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb5324fc-ba88-4314-8a9a-a4d6a3e90cf4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=71939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 24 16:49:46.597219 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.auth.core [None req-fb5324fc-ba88-4314-8a9a-a4d6a3e90cf4 None None] MFA Rules not processed for user `0f2ba2e8375b4e8c8792ee1e22b60427`. Rule list: `[]` (Enabled: `True`). {{(pid=71939) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:442}} Nov 24 16:49:46.598524 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.fernet_utils [None req-fb5324fc-ba88-4314-8a9a-a4d6a3e90cf4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=71939) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:289}} Nov 24 16:49:46.680620 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: [pid: 71939|app: 0|req: 1159/2305] 10.222.0.53 () {58 vars in 948 bytes} [Wed Nov 24 16:49:46 2021] POST /identity/v3/auth/tokens => generated 3669 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 24 16:49:46.692679 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f7deb0b-91e3-4c08-8316-90966fffb43a admin admin] Authenticating user token {{(pid=71938) process_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 24 16:49:46.695012 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.fernet_utils [None req-6f7deb0b-91e3-4c08-8316-90966fffb43a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=71938) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:289}} Nov 24 16:49:46.772909 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f7deb0b-91e3-4c08-8316-90966fffb43a admin admin] Validating token access rules against request {{(pid=71938) validate_allowed_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 24 16:49:46.777032 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da5e8b1e-6ca1-4bc9-aafd-3e330d0ca881 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c90f21b9cdcb413282461fa83cb6b7a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3b3940d4ae1c4177ae29c02377bb4b0b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=71938) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 24 16:49:46.777802 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da5e8b1e-6ca1-4bc9-aafd-3e330d0ca881 service neutron] REQUEST_METHOD: `GET` {{(pid=71938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 24 16:49:46.777995 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da5e8b1e-6ca1-4bc9-aafd-3e330d0ca881 service neutron] SCRIPT_NAME: `/identity` {{(pid=71938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 24 16:49:46.778425 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da5e8b1e-6ca1-4bc9-aafd-3e330d0ca881 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=71938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 24 16:49:46.803826 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da5e8b1e-6ca1-4bc9-aafd-3e330d0ca881 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=71938) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:442}} Nov 24 16:49:46.858634 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da5e8b1e-6ca1-4bc9-aafd-3e330d0ca881 service neutron] RBAC: Authorization granted {{(pid=71938) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 24 16:49:46.870457 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: [pid: 71938|app: 0|req: 1147/2306] 10.222.0.53 () {60 vars in 1356 bytes} [Wed Nov 24 16:49:46 2021] GET /identity/v3/auth/tokens => generated 3669 bytes in 178 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 24 16:49:47.245718 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb5324fc-ba88-4314-8a9a-a4d6a3e90cf4 None None] Authenticating user token {{(pid=71939) process_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 24 16:49:47.247254 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.fernet_utils [None req-fb5324fc-ba88-4314-8a9a-a4d6a3e90cf4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=71939) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:289}} Nov 24 16:49:47.259126 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb5324fc-ba88-4314-8a9a-a4d6a3e90cf4 None None] Validating token access rules against request {{(pid=71939) validate_allowed_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 24 16:49:47.264275 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ebc1d8d-0ec2-4cee-8de5-9f42fb599076 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f2ba2e8375b4e8c8792ee1e22b60427', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '00a5583c7b7443e98e7a1d31a0b638dc', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=71939) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 24 16:49:47.265149 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ebc1d8d-0ec2-4cee-8de5-9f42fb599076 admin admin] REQUEST_METHOD: `DELETE` {{(pid=71939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 24 16:49:47.265492 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ebc1d8d-0ec2-4cee-8de5-9f42fb599076 admin admin] SCRIPT_NAME: `/identity` {{(pid=71939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 24 16:49:47.265831 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ebc1d8d-0ec2-4cee-8de5-9f42fb599076 admin admin] PATH_INFO: `/v3/projects/a34ead64635c4a65bf1cc393f4bb6757` {{(pid=71939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 24 16:49:47.267100 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ebc1d8d-0ec2-4cee-8de5-9f42fb599076 admin admin] RBAC: Authorizing `identity:delete_project(project_id=a34ead64635c4a65bf1cc393f4bb6757)` {{(pid=71939) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:442}} Nov 24 16:49:47.296362 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ebc1d8d-0ec2-4cee-8de5-9f42fb599076 admin admin] RBAC: Authorization granted {{(pid=71939) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 24 16:49:47.347984 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.notifications [None req-1ebc1d8d-0ec2-4cee-8de5-9f42fb599076 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a34ead64635c4a65bf1cc393f4bb6757', 'request_id': 'req-1ebc1d8d-0ec2-4cee-8de5-9f42fb599076'} {{(pid=71939) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:357}} Nov 24 16:49:47.360494 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.notifications [None req-1ebc1d8d-0ec2-4cee-8de5-9f42fb599076 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a34ead64635c4a65bf1cc393f4bb6757', 'request_id': 'req-1ebc1d8d-0ec2-4cee-8de5-9f42fb599076'} {{(pid=71939) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:357}} Nov 24 16:49:47.367259 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.notifications [None req-1ebc1d8d-0ec2-4cee-8de5-9f42fb599076 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a34ead64635c4a65bf1cc393f4bb6757', 'request_id': 'req-1ebc1d8d-0ec2-4cee-8de5-9f42fb599076'} {{(pid=71939) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:357}} Nov 24 16:49:47.377541 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.notifications [None req-1ebc1d8d-0ec2-4cee-8de5-9f42fb599076 admin admin] The token cache is being invalidate because project a34ead64635c4a65bf1cc393f4bb6757 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=71939) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Nov 24 16:49:47.377871 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.notifications [None req-1ebc1d8d-0ec2-4cee-8de5-9f42fb599076 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=71939) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:357}} Nov 24 16:49:47.378562 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.notifications [None req-1ebc1d8d-0ec2-4cee-8de5-9f42fb599076 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=71939) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:357}} Nov 24 16:49:47.380126 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: [pid: 71939|app: 0|req: 1160/2307] 10.222.0.53 () {58 vars in 1223 bytes} [Wed Nov 24 16:49:47 2021] DELETE /identity/v3/projects/a34ead64635c4a65bf1cc393f4bb6757 => generated 0 bytes in 135 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 24 16:49:47.385103 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da5e8b1e-6ca1-4bc9-aafd-3e330d0ca881 service neutron] Authenticating user token {{(pid=71938) process_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 24 16:49:47.395204 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da5e8b1e-6ca1-4bc9-aafd-3e330d0ca881 service neutron] Validating token access rules against request {{(pid=71938) validate_allowed_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 24 16:49:47.461701 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4da8765-171d-4b16-9fa9-f96467dfdb0e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f2ba2e8375b4e8c8792ee1e22b60427', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '00a5583c7b7443e98e7a1d31a0b638dc', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=71938) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 24 16:49:47.462639 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4da8765-171d-4b16-9fa9-f96467dfdb0e admin admin] REQUEST_METHOD: `DELETE` {{(pid=71938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 24 16:49:47.462977 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4da8765-171d-4b16-9fa9-f96467dfdb0e admin admin] SCRIPT_NAME: `/identity` {{(pid=71938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 24 16:49:47.463304 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4da8765-171d-4b16-9fa9-f96467dfdb0e admin admin] PATH_INFO: `/v3/users/211eced87664436a9331807fa3c86597` {{(pid=71938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 24 16:49:47.464540 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4da8765-171d-4b16-9fa9-f96467dfdb0e admin admin] RBAC: Authorizing `identity:delete_user(user_id=211eced87664436a9331807fa3c86597)` {{(pid=71938) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:442}} Nov 24 16:49:47.494075 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4da8765-171d-4b16-9fa9-f96467dfdb0e admin admin] RBAC: Authorization granted {{(pid=71938) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 24 16:49:47.541857 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.notifications [None req-e4da8765-171d-4b16-9fa9-f96467dfdb0e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '211eced87664436a9331807fa3c86597'} {{(pid=71938) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:357}} Nov 24 16:49:47.554629 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.notifications [None req-e4da8765-171d-4b16-9fa9-f96467dfdb0e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '211eced87664436a9331807fa3c86597'} {{(pid=71938) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:357}} Nov 24 16:49:47.555345 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.notifications [None req-e4da8765-171d-4b16-9fa9-f96467dfdb0e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '211eced87664436a9331807fa3c86597'} {{(pid=71938) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:357}} Nov 24 16:49:47.563531 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.notifications [None req-e4da8765-171d-4b16-9fa9-f96467dfdb0e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '211eced87664436a9331807fa3c86597'} {{(pid=71938) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:357}} Nov 24 16:49:47.569915 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.notifications [None req-e4da8765-171d-4b16-9fa9-f96467dfdb0e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '211eced87664436a9331807fa3c86597'} {{(pid=71938) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:357}} Nov 24 16:49:47.578159 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: [pid: 71938|app: 0|req: 1148/2308] 10.222.0.53 () {58 vars in 1214 bytes} [Wed Nov 24 16:49:47 2021] DELETE /identity/v3/users/211eced87664436a9331807fa3c86597 => generated 0 bytes in 192 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 24 16:49:47.945008 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ebc1d8d-0ec2-4cee-8de5-9f42fb599076 admin admin] Authenticating user token {{(pid=71939) process_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 24 16:49:47.946532 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.fernet_utils [None req-1ebc1d8d-0ec2-4cee-8de5-9f42fb599076 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=71939) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:289}} Nov 24 16:49:47.960415 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ebc1d8d-0ec2-4cee-8de5-9f42fb599076 admin admin] Validating token access rules against request {{(pid=71939) validate_allowed_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 24 16:49:48.029114 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e6ca38c-2a41-4cba-90c3-594fe2228be3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f2ba2e8375b4e8c8792ee1e22b60427', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '00a5583c7b7443e98e7a1d31a0b638dc', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=71939) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 24 16:49:48.030010 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e6ca38c-2a41-4cba-90c3-594fe2228be3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=71939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 24 16:49:48.030380 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e6ca38c-2a41-4cba-90c3-594fe2228be3 admin admin] SCRIPT_NAME: `/identity` {{(pid=71939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 24 16:49:48.030714 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e6ca38c-2a41-4cba-90c3-594fe2228be3 admin admin] PATH_INFO: `/v3/projects/22305eb6f86c47128bc0fb5167d7936f` {{(pid=71939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 24 16:49:48.031978 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e6ca38c-2a41-4cba-90c3-594fe2228be3 admin admin] RBAC: Authorizing `identity:delete_project(project_id=22305eb6f86c47128bc0fb5167d7936f)` {{(pid=71939) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:442}} Nov 24 16:49:48.060639 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e6ca38c-2a41-4cba-90c3-594fe2228be3 admin admin] RBAC: Authorization granted {{(pid=71939) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 24 16:49:48.112992 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.notifications [None req-8e6ca38c-2a41-4cba-90c3-594fe2228be3 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '22305eb6f86c47128bc0fb5167d7936f', 'request_id': 'req-8e6ca38c-2a41-4cba-90c3-594fe2228be3'} {{(pid=71939) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:357}} Nov 24 16:49:48.125376 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.notifications [None req-8e6ca38c-2a41-4cba-90c3-594fe2228be3 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '22305eb6f86c47128bc0fb5167d7936f', 'request_id': 'req-8e6ca38c-2a41-4cba-90c3-594fe2228be3'} {{(pid=71939) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:357}} Nov 24 16:49:48.133191 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.notifications [None req-8e6ca38c-2a41-4cba-90c3-594fe2228be3 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '22305eb6f86c47128bc0fb5167d7936f', 'request_id': 'req-8e6ca38c-2a41-4cba-90c3-594fe2228be3'} {{(pid=71939) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:357}} Nov 24 16:49:48.150732 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.notifications [None req-8e6ca38c-2a41-4cba-90c3-594fe2228be3 admin admin] The token cache is being invalidate because project 22305eb6f86c47128bc0fb5167d7936f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=71939) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Nov 24 16:49:48.151074 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.notifications [None req-8e6ca38c-2a41-4cba-90c3-594fe2228be3 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=71939) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:357}} Nov 24 16:49:48.151776 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.notifications [None req-8e6ca38c-2a41-4cba-90c3-594fe2228be3 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=71939) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:357}} Nov 24 16:49:48.153357 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: [pid: 71939|app: 0|req: 1161/2309] 10.222.0.53 () {58 vars in 1223 bytes} [Wed Nov 24 16:49:47 2021] DELETE /identity/v3/projects/22305eb6f86c47128bc0fb5167d7936f => generated 0 bytes in 209 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 24 16:49:48.160648 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2652fd3c-717e-440a-9b8d-1ebdc888a98d None None] REQUEST_METHOD: `POST` {{(pid=71938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 24 16:49:48.161000 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2652fd3c-717e-440a-9b8d-1ebdc888a98d None None] SCRIPT_NAME: `/identity` {{(pid=71938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 24 16:49:48.161339 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2652fd3c-717e-440a-9b8d-1ebdc888a98d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=71938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 24 16:49:48.189488 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.auth.core [None req-2652fd3c-717e-440a-9b8d-1ebdc888a98d None None] MFA Rules not processed for user `0f2ba2e8375b4e8c8792ee1e22b60427`. Rule list: `[]` (Enabled: `True`). {{(pid=71938) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:442}} Nov 24 16:49:48.190853 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.fernet_utils [None req-2652fd3c-717e-440a-9b8d-1ebdc888a98d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=71938) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:289}} Nov 24 16:49:48.262706 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: [pid: 71938|app: 0|req: 1149/2310] 10.222.0.53 () {58 vars in 948 bytes} [Wed Nov 24 16:49:48 2021] POST /identity/v3/auth/tokens => generated 3669 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 24 16:49:48.271946 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17a26cd0-c116-4d84-9342-833796785379 None None] REQUEST_METHOD: `POST` {{(pid=71939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 24 16:49:48.272294 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17a26cd0-c116-4d84-9342-833796785379 None None] SCRIPT_NAME: `/identity` {{(pid=71939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 24 16:49:48.272636 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17a26cd0-c116-4d84-9342-833796785379 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=71939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 24 16:49:48.296679 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.auth.core [None req-17a26cd0-c116-4d84-9342-833796785379 None None] MFA Rules not processed for user `0f2ba2e8375b4e8c8792ee1e22b60427`. Rule list: `[]` (Enabled: `True`). {{(pid=71939) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:442}} Nov 24 16:49:48.297907 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.fernet_utils [None req-17a26cd0-c116-4d84-9342-833796785379 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=71939) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:289}} Nov 24 16:49:48.305986 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: [pid: 71939|app: 0|req: 1162/2311] 10.222.0.53 () {58 vars in 948 bytes} [Wed Nov 24 16:49:48 2021] POST /identity/v3/auth/tokens => generated 3669 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 24 16:49:48.310562 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2652fd3c-717e-440a-9b8d-1ebdc888a98d None None] Authenticating user token {{(pid=71938) process_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 24 16:49:48.320834 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2652fd3c-717e-440a-9b8d-1ebdc888a98d None None] Validating token access rules against request {{(pid=71938) validate_allowed_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 24 16:49:48.325329 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5edd6098-6b1a-417c-bfd4-939b7410e957 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f2ba2e8375b4e8c8792ee1e22b60427', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '00a5583c7b7443e98e7a1d31a0b638dc', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=71938) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 24 16:49:48.325998 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5edd6098-6b1a-417c-bfd4-939b7410e957 admin admin] REQUEST_METHOD: `GET` {{(pid=71938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 24 16:49:48.326392 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5edd6098-6b1a-417c-bfd4-939b7410e957 admin admin] SCRIPT_NAME: `/identity` {{(pid=71938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 24 16:49:48.326727 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5edd6098-6b1a-417c-bfd4-939b7410e957 admin admin] PATH_INFO: `/v3/domains` {{(pid=71938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 24 16:49:48.327521 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5edd6098-6b1a-417c-bfd4-939b7410e957 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=71938) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:161}} Nov 24 16:49:48.328312 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5edd6098-6b1a-417c-bfd4-939b7410e957 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=71938) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:442}} Nov 24 16:49:48.357088 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5edd6098-6b1a-417c-bfd4-939b7410e957 admin admin] RBAC: Authorization granted {{(pid=71938) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 24 16:49:48.371789 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: [pid: 71938|app: 0|req: 1150/2312] 10.222.0.53 () {58 vars in 1143 bytes} [Wed Nov 24 16:49:48 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 62 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 24 16:49:48.376759 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17a26cd0-c116-4d84-9342-833796785379 None None] Authenticating user token {{(pid=71939) process_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 24 16:49:48.386265 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17a26cd0-c116-4d84-9342-833796785379 None None] Validating token access rules against request {{(pid=71939) validate_allowed_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 24 16:49:48.391163 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aebf5ac0-d3c9-4eaf-9286-f31849601afa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f2ba2e8375b4e8c8792ee1e22b60427', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '00a5583c7b7443e98e7a1d31a0b638dc', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=71939) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 24 16:49:48.391853 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aebf5ac0-d3c9-4eaf-9286-f31849601afa admin admin] REQUEST_METHOD: `POST` {{(pid=71939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 24 16:49:48.392205 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aebf5ac0-d3c9-4eaf-9286-f31849601afa admin admin] SCRIPT_NAME: `/identity` {{(pid=71939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 24 16:49:48.392548 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aebf5ac0-d3c9-4eaf-9286-f31849601afa admin admin] PATH_INFO: `/v3/projects` {{(pid=71939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 24 16:49:48.393292 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aebf5ac0-d3c9-4eaf-9286-f31849601afa admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=71939) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:442}} Nov 24 16:49:48.422375 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aebf5ac0-d3c9-4eaf-9286-f31849601afa admin admin] RBAC: Authorization granted {{(pid=71939) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 24 16:49:48.451148 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: [pid: 71939|app: 0|req: 1163/2313] 10.222.0.53 () {60 vars in 1143 bytes} [Wed Nov 24 16:49:48 2021] POST /identity/v3/projects => generated 385 bytes in 75 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 24 16:49:48.455639 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5edd6098-6b1a-417c-bfd4-939b7410e957 admin admin] Authenticating user token {{(pid=71938) process_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 24 16:49:48.465987 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5edd6098-6b1a-417c-bfd4-939b7410e957 admin admin] Validating token access rules against request {{(pid=71938) validate_allowed_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 24 16:49:48.611710 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e34a2cb-f116-436d-8bf3-099622d111b7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f2ba2e8375b4e8c8792ee1e22b60427', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '00a5583c7b7443e98e7a1d31a0b638dc', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=71938) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 24 16:49:48.612397 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e34a2cb-f116-436d-8bf3-099622d111b7 admin admin] REQUEST_METHOD: `POST` {{(pid=71938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 24 16:49:48.612736 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e34a2cb-f116-436d-8bf3-099622d111b7 admin admin] SCRIPT_NAME: `/identity` {{(pid=71938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 24 16:49:48.613069 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e34a2cb-f116-436d-8bf3-099622d111b7 admin admin] PATH_INFO: `/v3/users` {{(pid=71938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 24 16:49:48.614093 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e34a2cb-f116-436d-8bf3-099622d111b7 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=71938) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:442}} Nov 24 16:49:48.646525 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e34a2cb-f116-436d-8bf3-099622d111b7 admin admin] RBAC: Authorization granted {{(pid=71938) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 24 16:49:48.666168 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: [pid: 71938|app: 0|req: 1151/2314] 10.222.0.53 () {60 vars in 1134 bytes} [Wed Nov 24 16:49:48 2021] POST /identity/v3/users => generated 293 bytes in 211 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 24 16:49:48.670634 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aebf5ac0-d3c9-4eaf-9286-f31849601afa admin admin] Authenticating user token {{(pid=71939) process_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 24 16:49:48.681972 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aebf5ac0-d3c9-4eaf-9286-f31849601afa admin admin] Validating token access rules against request {{(pid=71939) validate_allowed_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 24 16:49:48.686640 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46a4f58d-e9b6-4f0f-b040-2538f59e18a6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f2ba2e8375b4e8c8792ee1e22b60427', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '00a5583c7b7443e98e7a1d31a0b638dc', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=71939) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 24 16:49:48.687319 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46a4f58d-e9b6-4f0f-b040-2538f59e18a6 admin admin] REQUEST_METHOD: `GET` {{(pid=71939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 24 16:49:48.687659 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46a4f58d-e9b6-4f0f-b040-2538f59e18a6 admin admin] SCRIPT_NAME: `/identity` {{(pid=71939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 24 16:49:48.687992 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46a4f58d-e9b6-4f0f-b040-2538f59e18a6 admin admin] PATH_INFO: `/v3/roles` {{(pid=71939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 24 16:49:48.688787 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46a4f58d-e9b6-4f0f-b040-2538f59e18a6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=71939) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:442}} Nov 24 16:49:48.717548 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46a4f58d-e9b6-4f0f-b040-2538f59e18a6 admin admin] RBAC: Authorization granted {{(pid=71939) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 24 16:49:48.728857 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: [pid: 71939|app: 0|req: 1164/2315] 10.222.0.53 () {58 vars in 1112 bytes} [Wed Nov 24 16:49:48 2021] GET /identity/v3/roles => generated 1420 bytes in 59 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 24 16:49:48.733591 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e34a2cb-f116-436d-8bf3-099622d111b7 admin admin] Authenticating user token {{(pid=71938) process_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 24 16:49:48.744456 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e34a2cb-f116-436d-8bf3-099622d111b7 admin admin] Validating token access rules against request {{(pid=71938) validate_allowed_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 24 16:49:48.749044 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-add35e10-d3d5-46be-8600-996521da564c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f2ba2e8375b4e8c8792ee1e22b60427', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '00a5583c7b7443e98e7a1d31a0b638dc', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=71938) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 24 16:49:48.749946 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-add35e10-d3d5-46be-8600-996521da564c admin admin] REQUEST_METHOD: `PUT` {{(pid=71938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 24 16:49:48.750321 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-add35e10-d3d5-46be-8600-996521da564c admin admin] SCRIPT_NAME: `/identity` {{(pid=71938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 24 16:49:48.750656 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-add35e10-d3d5-46be-8600-996521da564c admin admin] PATH_INFO: `/v3/projects/9a370068bdf94747a41b0da6c325cfe4/users/f632661e088c4dae9c1c0574fd493a74/roles/912ab5f10fa5477da74acf239f07604e` {{(pid=71938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 24 16:49:48.772618 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-add35e10-d3d5-46be-8600-996521da564c admin admin] RBAC: Authorizing `identity:create_grant(project_id=9a370068bdf94747a41b0da6c325cfe4, user_id=f632661e088c4dae9c1c0574fd493a74, role_id=912ab5f10fa5477da74acf239f07604e)` {{(pid=71938) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:442}} Nov 24 16:49:48.802018 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-add35e10-d3d5-46be-8600-996521da564c admin admin] RBAC: Authorization granted {{(pid=71938) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 24 16:49:48.815989 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: [pid: 71938|app: 0|req: 1152/2316] 10.222.0.53 () {60 vars in 1473 bytes} [Wed Nov 24 16:49:48 2021] PUT /identity/v3/projects/9a370068bdf94747a41b0da6c325cfe4/users/f632661e088c4dae9c1c0574fd493a74/roles/912ab5f10fa5477da74acf239f07604e => generated 0 bytes in 83 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 24 16:49:48.828956 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e96f42cb-b839-475b-8b5c-4518615e866a None None] REQUEST_METHOD: `POST` {{(pid=71939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 24 16:49:48.829293 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e96f42cb-b839-475b-8b5c-4518615e866a None None] SCRIPT_NAME: `/identity` {{(pid=71939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 24 16:49:48.829665 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e96f42cb-b839-475b-8b5c-4518615e866a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=71939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 24 16:49:48.870623 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.auth.core [None req-e96f42cb-b839-475b-8b5c-4518615e866a None None] MFA Rules not processed for user `f632661e088c4dae9c1c0574fd493a74`. Rule list: `[]` (Enabled: `True`). {{(pid=71939) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:442}} Nov 24 16:49:48.871901 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.fernet_utils [None req-e96f42cb-b839-475b-8b5c-4518615e866a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=71939) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:289}} Nov 24 16:49:48.950235 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: [pid: 71939|app: 0|req: 1165/2317] 10.222.0.53 () {58 vars in 948 bytes} [Wed Nov 24 16:49:48 2021] POST /identity/v3/auth/tokens => generated 3692 bytes in 122 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 24 16:49:48.961168 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-add35e10-d3d5-46be-8600-996521da564c admin admin] Authenticating user token {{(pid=71938) process_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 24 16:49:48.962980 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.fernet_utils [None req-add35e10-d3d5-46be-8600-996521da564c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=71938) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:289}} Nov 24 16:49:49.032335 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-add35e10-d3d5-46be-8600-996521da564c admin admin] Validating token access rules against request {{(pid=71938) validate_allowed_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 24 16:49:49.036221 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a9ad222-e922-4cfe-8ddb-51858c5d796d service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a12374a3093a401a97c343ff0854184d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3b3940d4ae1c4177ae29c02377bb4b0b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=71938) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 24 16:49:49.037447 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a9ad222-e922-4cfe-8ddb-51858c5d796d service cinder] REQUEST_METHOD: `GET` {{(pid=71938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 24 16:49:49.037798 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a9ad222-e922-4cfe-8ddb-51858c5d796d service cinder] SCRIPT_NAME: `/identity` {{(pid=71938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 24 16:49:49.038221 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a9ad222-e922-4cfe-8ddb-51858c5d796d service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=71938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 24 16:49:49.048205 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a9ad222-e922-4cfe-8ddb-51858c5d796d service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=71938) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:442}} Nov 24 16:49:49.077744 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a9ad222-e922-4cfe-8ddb-51858c5d796d service cinder] RBAC: Authorization granted {{(pid=71938) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 24 16:49:49.093380 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: [pid: 71938|app: 0|req: 1153/2318] 10.222.0.53 () {60 vars in 1356 bytes} [Wed Nov 24 16:49:48 2021] GET /identity/v3/auth/tokens => generated 3692 bytes in 133 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 24 16:49:59.607321 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e96f42cb-b839-475b-8b5c-4518615e866a None None] Authenticating user token {{(pid=71939) process_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 24 16:49:59.680635 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e96f42cb-b839-475b-8b5c-4518615e866a None None] Validating token access rules against request {{(pid=71939) validate_allowed_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 24 16:49:59.685232 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb729397-3cb5-46c0-b888-87a7035d0c23 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f2ba2e8375b4e8c8792ee1e22b60427', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '00a5583c7b7443e98e7a1d31a0b638dc', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=71939) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 24 16:49:59.686182 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb729397-3cb5-46c0-b888-87a7035d0c23 admin admin] REQUEST_METHOD: `DELETE` {{(pid=71939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 24 16:49:59.686529 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb729397-3cb5-46c0-b888-87a7035d0c23 admin admin] SCRIPT_NAME: `/identity` {{(pid=71939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 24 16:49:59.686865 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb729397-3cb5-46c0-b888-87a7035d0c23 admin admin] PATH_INFO: `/v3/users/f632661e088c4dae9c1c0574fd493a74` {{(pid=71939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 24 16:49:59.688108 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb729397-3cb5-46c0-b888-87a7035d0c23 admin admin] RBAC: Authorizing `identity:delete_user(user_id=f632661e088c4dae9c1c0574fd493a74)` {{(pid=71939) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:442}} Nov 24 16:49:59.717968 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb729397-3cb5-46c0-b888-87a7035d0c23 admin admin] RBAC: Authorization granted {{(pid=71939) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 24 16:49:59.768060 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.notifications [None req-fb729397-3cb5-46c0-b888-87a7035d0c23 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f632661e088c4dae9c1c0574fd493a74'} {{(pid=71939) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:357}} Nov 24 16:49:59.781608 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.notifications [None req-fb729397-3cb5-46c0-b888-87a7035d0c23 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f632661e088c4dae9c1c0574fd493a74'} {{(pid=71939) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:357}} Nov 24 16:49:59.782303 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.notifications [None req-fb729397-3cb5-46c0-b888-87a7035d0c23 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f632661e088c4dae9c1c0574fd493a74'} {{(pid=71939) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:357}} Nov 24 16:49:59.791028 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.notifications [None req-fb729397-3cb5-46c0-b888-87a7035d0c23 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f632661e088c4dae9c1c0574fd493a74'} {{(pid=71939) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:357}} Nov 24 16:49:59.797577 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.notifications [None req-fb729397-3cb5-46c0-b888-87a7035d0c23 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f632661e088c4dae9c1c0574fd493a74'} {{(pid=71939) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:357}} Nov 24 16:49:59.805048 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: [pid: 71939|app: 0|req: 1166/2319] 10.222.0.53 () {58 vars in 1214 bytes} [Wed Nov 24 16:49:59 2021] DELETE /identity/v3/users/f632661e088c4dae9c1c0574fd493a74 => generated 0 bytes in 198 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 24 16:49:59.810062 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11923c3a-2e00-4d1f-b457-b4ee7747dd0f None None] REQUEST_METHOD: `POST` {{(pid=71938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 24 16:49:59.810618 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11923c3a-2e00-4d1f-b457-b4ee7747dd0f None None] SCRIPT_NAME: `/identity` {{(pid=71938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 24 16:49:59.810997 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11923c3a-2e00-4d1f-b457-b4ee7747dd0f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=71938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 24 16:49:59.835918 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.auth.core [None req-11923c3a-2e00-4d1f-b457-b4ee7747dd0f None None] MFA Rules not processed for user `0f2ba2e8375b4e8c8792ee1e22b60427`. Rule list: `[]` (Enabled: `True`). {{(pid=71938) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:442}} Nov 24 16:49:59.837158 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.fernet_utils [None req-11923c3a-2e00-4d1f-b457-b4ee7747dd0f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=71938) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:289}} Nov 24 16:49:59.910150 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: [pid: 71938|app: 0|req: 1154/2320] 10.222.0.53 () {58 vars in 948 bytes} [Wed Nov 24 16:49:59 2021] POST /identity/v3/auth/tokens => generated 3669 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 24 16:49:59.921979 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb729397-3cb5-46c0-b888-87a7035d0c23 admin admin] Authenticating user token {{(pid=71939) process_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 24 16:49:59.923480 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.fernet_utils [None req-fb729397-3cb5-46c0-b888-87a7035d0c23 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=71939) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:289}} Nov 24 16:49:59.999890 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb729397-3cb5-46c0-b888-87a7035d0c23 admin admin] Validating token access rules against request {{(pid=71939) validate_allowed_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 24 16:50:00.004055 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c080a673-2893-47e0-9916-082b91ec6741 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c90f21b9cdcb413282461fa83cb6b7a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3b3940d4ae1c4177ae29c02377bb4b0b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=71939) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 24 16:50:00.004728 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c080a673-2893-47e0-9916-082b91ec6741 service neutron] REQUEST_METHOD: `GET` {{(pid=71939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 24 16:50:00.005967 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c080a673-2893-47e0-9916-082b91ec6741 service neutron] SCRIPT_NAME: `/identity` {{(pid=71939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 24 16:50:00.006386 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c080a673-2893-47e0-9916-082b91ec6741 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=71939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 24 16:50:00.017157 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c080a673-2893-47e0-9916-082b91ec6741 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=71939) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:442}} Nov 24 16:50:00.049459 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c080a673-2893-47e0-9916-082b91ec6741 service neutron] RBAC: Authorization granted {{(pid=71939) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 24 16:50:00.060800 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: [pid: 71939|app: 0|req: 1167/2321] 10.222.0.53 () {60 vars in 1356 bytes} [Wed Nov 24 16:49:59 2021] GET /identity/v3/auth/tokens => generated 3669 bytes in 139 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 24 16:50:00.471088 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11923c3a-2e00-4d1f-b457-b4ee7747dd0f None None] Authenticating user token {{(pid=71938) process_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 24 16:50:00.472775 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.fernet_utils [None req-11923c3a-2e00-4d1f-b457-b4ee7747dd0f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=71938) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:289}} Nov 24 16:50:00.484751 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11923c3a-2e00-4d1f-b457-b4ee7747dd0f None None] Validating token access rules against request {{(pid=71938) validate_allowed_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 24 16:50:00.490472 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0b18ec4-2ac7-4507-9e1b-743072a8f359 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f2ba2e8375b4e8c8792ee1e22b60427', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '00a5583c7b7443e98e7a1d31a0b638dc', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=71938) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 24 16:50:00.491541 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0b18ec4-2ac7-4507-9e1b-743072a8f359 admin admin] REQUEST_METHOD: `DELETE` {{(pid=71938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 24 16:50:00.491888 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0b18ec4-2ac7-4507-9e1b-743072a8f359 admin admin] SCRIPT_NAME: `/identity` {{(pid=71938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 24 16:50:00.492222 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0b18ec4-2ac7-4507-9e1b-743072a8f359 admin admin] PATH_INFO: `/v3/projects/9a370068bdf94747a41b0da6c325cfe4` {{(pid=71938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 24 16:50:00.493447 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0b18ec4-2ac7-4507-9e1b-743072a8f359 admin admin] RBAC: Authorizing `identity:delete_project(project_id=9a370068bdf94747a41b0da6c325cfe4)` {{(pid=71938) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:442}} Nov 24 16:50:00.523523 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0b18ec4-2ac7-4507-9e1b-743072a8f359 admin admin] RBAC: Authorization granted {{(pid=71938) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 24 16:50:00.587131 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.notifications [None req-f0b18ec4-2ac7-4507-9e1b-743072a8f359 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '9a370068bdf94747a41b0da6c325cfe4', 'request_id': 'req-f0b18ec4-2ac7-4507-9e1b-743072a8f359'} {{(pid=71938) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:357}} Nov 24 16:50:00.600085 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.notifications [None req-f0b18ec4-2ac7-4507-9e1b-743072a8f359 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '9a370068bdf94747a41b0da6c325cfe4', 'request_id': 'req-f0b18ec4-2ac7-4507-9e1b-743072a8f359'} {{(pid=71938) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:357}} Nov 24 16:50:00.605716 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.notifications [None req-f0b18ec4-2ac7-4507-9e1b-743072a8f359 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '9a370068bdf94747a41b0da6c325cfe4', 'request_id': 'req-f0b18ec4-2ac7-4507-9e1b-743072a8f359'} {{(pid=71938) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:357}} Nov 24 16:50:00.617954 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.notifications [None req-f0b18ec4-2ac7-4507-9e1b-743072a8f359 admin admin] The token cache is being invalidate because project 9a370068bdf94747a41b0da6c325cfe4 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=71938) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Nov 24 16:50:00.618470 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.notifications [None req-f0b18ec4-2ac7-4507-9e1b-743072a8f359 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=71938) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:357}} Nov 24 16:50:00.619129 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.notifications [None req-f0b18ec4-2ac7-4507-9e1b-743072a8f359 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=71938) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:357}} Nov 24 16:50:00.620712 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: [pid: 71938|app: 0|req: 1155/2322] 10.222.0.53 () {58 vars in 1223 bytes} [Wed Nov 24 16:50:00 2021] DELETE /identity/v3/projects/9a370068bdf94747a41b0da6c325cfe4 => generated 0 bytes in 150 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 24 16:50:00.626837 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36e78dc4-ac89-45a0-bb11-0ea1b8620715 None None] REQUEST_METHOD: `POST` {{(pid=71939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 24 16:50:00.627196 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36e78dc4-ac89-45a0-bb11-0ea1b8620715 None None] SCRIPT_NAME: `/identity` {{(pid=71939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 24 16:50:00.627537 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36e78dc4-ac89-45a0-bb11-0ea1b8620715 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=71939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 24 16:50:00.653796 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.auth.core [None req-36e78dc4-ac89-45a0-bb11-0ea1b8620715 None None] MFA Rules not processed for user `0f2ba2e8375b4e8c8792ee1e22b60427`. Rule list: `[]` (Enabled: `True`). {{(pid=71939) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:442}} Nov 24 16:50:00.655158 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.fernet_utils [None req-36e78dc4-ac89-45a0-bb11-0ea1b8620715 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=71939) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:289}} Nov 24 16:50:00.740607 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: [pid: 71939|app: 0|req: 1168/2323] 10.222.0.53 () {58 vars in 948 bytes} [Wed Nov 24 16:50:00 2021] POST /identity/v3/auth/tokens => generated 3669 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 24 16:50:00.742633 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0466a278-1f8a-40d5-8e9c-2f2d9eb236a5 None None] REQUEST_METHOD: `POST` {{(pid=71938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 24 16:50:00.743395 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0466a278-1f8a-40d5-8e9c-2f2d9eb236a5 None None] SCRIPT_NAME: `/identity` {{(pid=71938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 24 16:50:00.743743 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0466a278-1f8a-40d5-8e9c-2f2d9eb236a5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=71938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 24 16:50:00.774059 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.auth.core [None req-0466a278-1f8a-40d5-8e9c-2f2d9eb236a5 None None] MFA Rules not processed for user `0f2ba2e8375b4e8c8792ee1e22b60427`. Rule list: `[]` (Enabled: `True`). {{(pid=71938) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:442}} Nov 24 16:50:00.775370 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.fernet_utils [None req-0466a278-1f8a-40d5-8e9c-2f2d9eb236a5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=71938) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:289}} Nov 24 16:50:00.784318 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: [pid: 71938|app: 0|req: 1156/2324] 10.222.0.53 () {58 vars in 948 bytes} [Wed Nov 24 16:50:00 2021] POST /identity/v3/auth/tokens => generated 3669 bytes in 43 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 24 16:50:00.789350 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36e78dc4-ac89-45a0-bb11-0ea1b8620715 None None] Authenticating user token {{(pid=71939) process_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 24 16:50:00.800611 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36e78dc4-ac89-45a0-bb11-0ea1b8620715 None None] Validating token access rules against request {{(pid=71939) validate_allowed_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 24 16:50:00.805858 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bdc6529-8c1a-4c68-be69-16d1e4e81b44 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f2ba2e8375b4e8c8792ee1e22b60427', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '00a5583c7b7443e98e7a1d31a0b638dc', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=71939) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 24 16:50:00.806720 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bdc6529-8c1a-4c68-be69-16d1e4e81b44 admin admin] REQUEST_METHOD: `GET` {{(pid=71939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 24 16:50:00.807484 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bdc6529-8c1a-4c68-be69-16d1e4e81b44 admin admin] SCRIPT_NAME: `/identity` {{(pid=71939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 24 16:50:00.807609 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bdc6529-8c1a-4c68-be69-16d1e4e81b44 admin admin] PATH_INFO: `/v3/domains` {{(pid=71939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 24 16:50:00.808497 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bdc6529-8c1a-4c68-be69-16d1e4e81b44 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=71939) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:161}} Nov 24 16:50:00.808846 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bdc6529-8c1a-4c68-be69-16d1e4e81b44 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=71939) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:442}} Nov 24 16:50:00.838323 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bdc6529-8c1a-4c68-be69-16d1e4e81b44 admin admin] RBAC: Authorization granted {{(pid=71939) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 24 16:50:00.853770 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: [pid: 71939|app: 0|req: 1169/2325] 10.222.0.53 () {58 vars in 1143 bytes} [Wed Nov 24 16:50:00 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 65 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 24 16:50:00.859008 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0466a278-1f8a-40d5-8e9c-2f2d9eb236a5 None None] Authenticating user token {{(pid=71938) process_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 24 16:50:00.869744 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0466a278-1f8a-40d5-8e9c-2f2d9eb236a5 None None] Validating token access rules against request {{(pid=71938) validate_allowed_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 24 16:50:00.874699 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9726c21-a736-455e-a396-b2346b7c142b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f2ba2e8375b4e8c8792ee1e22b60427', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '00a5583c7b7443e98e7a1d31a0b638dc', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=71938) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 24 16:50:00.875709 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9726c21-a736-455e-a396-b2346b7c142b admin admin] REQUEST_METHOD: `POST` {{(pid=71938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 24 16:50:00.876018 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9726c21-a736-455e-a396-b2346b7c142b admin admin] SCRIPT_NAME: `/identity` {{(pid=71938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 24 16:50:00.876303 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9726c21-a736-455e-a396-b2346b7c142b admin admin] PATH_INFO: `/v3/projects` {{(pid=71938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 24 16:50:00.877234 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9726c21-a736-455e-a396-b2346b7c142b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=71938) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:442}} Nov 24 16:50:00.912940 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9726c21-a736-455e-a396-b2346b7c142b admin admin] RBAC: Authorization granted {{(pid=71938) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 24 16:50:00.945092 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: [pid: 71938|app: 0|req: 1157/2326] 10.222.0.53 () {60 vars in 1143 bytes} [Wed Nov 24 16:50:00 2021] POST /identity/v3/projects => generated 371 bytes in 86 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Nov 24 16:50:00.949307 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bdc6529-8c1a-4c68-be69-16d1e4e81b44 admin admin] Authenticating user token {{(pid=71939) process_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 24 16:50:00.962589 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bdc6529-8c1a-4c68-be69-16d1e4e81b44 admin admin] Validating token access rules against request {{(pid=71939) validate_allowed_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 24 16:50:01.048430 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2288069-d1e1-4a37-8851-7aba1461f529 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f2ba2e8375b4e8c8792ee1e22b60427', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '00a5583c7b7443e98e7a1d31a0b638dc', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=71939) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 24 16:50:01.049123 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2288069-d1e1-4a37-8851-7aba1461f529 admin admin] REQUEST_METHOD: `POST` {{(pid=71939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 24 16:50:01.049464 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2288069-d1e1-4a37-8851-7aba1461f529 admin admin] SCRIPT_NAME: `/identity` {{(pid=71939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 24 16:50:01.049802 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2288069-d1e1-4a37-8851-7aba1461f529 admin admin] PATH_INFO: `/v3/users` {{(pid=71939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 24 16:50:01.050613 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2288069-d1e1-4a37-8851-7aba1461f529 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=71939) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:442}} Nov 24 16:50:01.080644 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2288069-d1e1-4a37-8851-7aba1461f529 admin admin] RBAC: Authorization granted {{(pid=71939) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 24 16:50:01.107057 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: [pid: 71939|app: 0|req: 1170/2327] 10.222.0.53 () {60 vars in 1134 bytes} [Wed Nov 24 16:50:00 2021] POST /identity/v3/users => generated 286 bytes in 158 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 24 16:50:01.111432 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9726c21-a736-455e-a396-b2346b7c142b admin admin] Authenticating user token {{(pid=71938) process_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 24 16:50:01.123301 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9726c21-a736-455e-a396-b2346b7c142b admin admin] Validating token access rules against request {{(pid=71938) validate_allowed_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 24 16:50:01.129271 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23caba2f-e078-460b-a222-f9c4e885a503 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f2ba2e8375b4e8c8792ee1e22b60427', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '00a5583c7b7443e98e7a1d31a0b638dc', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=71938) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 24 16:50:01.130699 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23caba2f-e078-460b-a222-f9c4e885a503 admin admin] REQUEST_METHOD: `GET` {{(pid=71938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 24 16:50:01.131204 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23caba2f-e078-460b-a222-f9c4e885a503 admin admin] SCRIPT_NAME: `/identity` {{(pid=71938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 24 16:50:01.131754 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23caba2f-e078-460b-a222-f9c4e885a503 admin admin] PATH_INFO: `/v3/roles` {{(pid=71938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 24 16:50:01.132673 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23caba2f-e078-460b-a222-f9c4e885a503 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=71938) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:442}} Nov 24 16:50:01.164905 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23caba2f-e078-460b-a222-f9c4e885a503 admin admin] RBAC: Authorization granted {{(pid=71938) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 24 16:50:01.186077 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: [pid: 71938|app: 0|req: 1158/2328] 10.222.0.53 () {58 vars in 1112 bytes} [Wed Nov 24 16:50:01 2021] GET /identity/v3/roles => generated 1420 bytes in 75 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 24 16:50:01.190207 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2288069-d1e1-4a37-8851-7aba1461f529 admin admin] Authenticating user token {{(pid=71939) process_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 24 16:50:01.201745 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2288069-d1e1-4a37-8851-7aba1461f529 admin admin] Validating token access rules against request {{(pid=71939) validate_allowed_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 24 16:50:01.206118 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c67d8e6-38fc-4420-9867-3b6fd7319f3d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f2ba2e8375b4e8c8792ee1e22b60427', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '00a5583c7b7443e98e7a1d31a0b638dc', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=71939) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 24 16:50:01.207150 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c67d8e6-38fc-4420-9867-3b6fd7319f3d admin admin] REQUEST_METHOD: `PUT` {{(pid=71939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 24 16:50:01.207489 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c67d8e6-38fc-4420-9867-3b6fd7319f3d admin admin] SCRIPT_NAME: `/identity` {{(pid=71939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 24 16:50:01.207822 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c67d8e6-38fc-4420-9867-3b6fd7319f3d admin admin] PATH_INFO: `/v3/projects/3d11f89faae94503a0224f011a4cb398/users/1b0b0975ae13443988f450537e329807/roles/912ab5f10fa5477da74acf239f07604e` {{(pid=71939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 24 16:50:01.232330 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c67d8e6-38fc-4420-9867-3b6fd7319f3d admin admin] RBAC: Authorizing `identity:create_grant(project_id=3d11f89faae94503a0224f011a4cb398, user_id=1b0b0975ae13443988f450537e329807, role_id=912ab5f10fa5477da74acf239f07604e)` {{(pid=71939) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:442}} Nov 24 16:50:01.265611 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c67d8e6-38fc-4420-9867-3b6fd7319f3d admin admin] RBAC: Authorization granted {{(pid=71939) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 24 16:50:01.279420 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: [pid: 71939|app: 0|req: 1171/2329] 10.222.0.53 () {60 vars in 1473 bytes} [Wed Nov 24 16:50:01 2021] PUT /identity/v3/projects/3d11f89faae94503a0224f011a4cb398/users/1b0b0975ae13443988f450537e329807/roles/912ab5f10fa5477da74acf239f07604e => generated 0 bytes in 90 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 24 16:50:01.292134 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1583e5c-5fe1-4662-8a95-12433629a4a9 None None] REQUEST_METHOD: `POST` {{(pid=71938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 24 16:50:01.293472 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1583e5c-5fe1-4662-8a95-12433629a4a9 None None] SCRIPT_NAME: `/identity` {{(pid=71938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 24 16:50:01.293993 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1583e5c-5fe1-4662-8a95-12433629a4a9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=71938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 24 16:50:01.340781 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.auth.core [None req-d1583e5c-5fe1-4662-8a95-12433629a4a9 None None] MFA Rules not processed for user `1b0b0975ae13443988f450537e329807`. Rule list: `[]` (Enabled: `True`). {{(pid=71938) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:442}} Nov 24 16:50:01.341944 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.fernet_utils [None req-d1583e5c-5fe1-4662-8a95-12433629a4a9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=71938) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:289}} Nov 24 16:50:01.435111 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: [pid: 71938|app: 0|req: 1159/2330] 10.222.0.53 () {58 vars in 948 bytes} [Wed Nov 24 16:50:01 2021] POST /identity/v3/auth/tokens => generated 3678 bytes in 141 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 24 16:50:01.445165 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c67d8e6-38fc-4420-9867-3b6fd7319f3d admin admin] Authenticating user token {{(pid=71939) process_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 24 16:50:01.447215 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.fernet_utils [None req-4c67d8e6-38fc-4420-9867-3b6fd7319f3d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=71939) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:289}} Nov 24 16:50:01.521952 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c67d8e6-38fc-4420-9867-3b6fd7319f3d admin admin] Validating token access rules against request {{(pid=71939) validate_allowed_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 24 16:50:01.526071 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72256e1f-a87c-4206-877c-0ab9bbfaad8f service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'af9e91f8d56c491d99fab4346754ce2e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3b3940d4ae1c4177ae29c02377bb4b0b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=71939) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 24 16:50:01.526825 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72256e1f-a87c-4206-877c-0ab9bbfaad8f service glance] REQUEST_METHOD: `GET` {{(pid=71939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 24 16:50:01.527218 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72256e1f-a87c-4206-877c-0ab9bbfaad8f service glance] SCRIPT_NAME: `/identity` {{(pid=71939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 24 16:50:01.527509 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72256e1f-a87c-4206-877c-0ab9bbfaad8f service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=71939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 24 16:50:01.537662 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72256e1f-a87c-4206-877c-0ab9bbfaad8f service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=71939) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:442}} Nov 24 16:50:01.566850 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72256e1f-a87c-4206-877c-0ab9bbfaad8f service glance] RBAC: Authorization granted {{(pid=71939) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 24 16:50:01.577835 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: [pid: 71939|app: 0|req: 1172/2331] 10.222.0.53 () {60 vars in 1356 bytes} [Wed Nov 24 16:50:01 2021] GET /identity/v3/auth/tokens => generated 3678 bytes in 133 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 24 16:50:03.759585 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1583e5c-5fe1-4662-8a95-12433629a4a9 None None] Authenticating user token {{(pid=71938) process_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 24 16:50:03.761161 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.fernet_utils [None req-d1583e5c-5fe1-4662-8a95-12433629a4a9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=71938) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:289}} Nov 24 16:50:03.839549 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1583e5c-5fe1-4662-8a95-12433629a4a9 None None] Validating token access rules against request {{(pid=71938) validate_allowed_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 24 16:50:03.844132 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54aed662-a2a1-4a49-9c10-b70d872ad599 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f2ba2e8375b4e8c8792ee1e22b60427', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '00a5583c7b7443e98e7a1d31a0b638dc', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=71938) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 24 16:50:03.845038 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54aed662-a2a1-4a49-9c10-b70d872ad599 admin admin] REQUEST_METHOD: `DELETE` {{(pid=71938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 24 16:50:03.845379 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54aed662-a2a1-4a49-9c10-b70d872ad599 admin admin] SCRIPT_NAME: `/identity` {{(pid=71938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 24 16:50:03.845758 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54aed662-a2a1-4a49-9c10-b70d872ad599 admin admin] PATH_INFO: `/v3/users/d46c7e0be1f843c39dadc8b31cacaa86` {{(pid=71938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 24 16:50:03.847042 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54aed662-a2a1-4a49-9c10-b70d872ad599 admin admin] RBAC: Authorizing `identity:delete_user(user_id=d46c7e0be1f843c39dadc8b31cacaa86)` {{(pid=71938) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:442}} Nov 24 16:50:03.876095 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54aed662-a2a1-4a49-9c10-b70d872ad599 admin admin] RBAC: Authorization granted {{(pid=71938) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 24 16:50:03.925880 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.notifications [None req-54aed662-a2a1-4a49-9c10-b70d872ad599 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd46c7e0be1f843c39dadc8b31cacaa86'} {{(pid=71938) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:357}} Nov 24 16:50:03.938460 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.notifications [None req-54aed662-a2a1-4a49-9c10-b70d872ad599 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd46c7e0be1f843c39dadc8b31cacaa86'} {{(pid=71938) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:357}} Nov 24 16:50:03.939170 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.notifications [None req-54aed662-a2a1-4a49-9c10-b70d872ad599 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd46c7e0be1f843c39dadc8b31cacaa86'} {{(pid=71938) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:357}} Nov 24 16:50:03.948527 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.notifications [None req-54aed662-a2a1-4a49-9c10-b70d872ad599 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd46c7e0be1f843c39dadc8b31cacaa86'} {{(pid=71938) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:357}} Nov 24 16:50:03.955385 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.notifications [None req-54aed662-a2a1-4a49-9c10-b70d872ad599 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd46c7e0be1f843c39dadc8b31cacaa86'} {{(pid=71938) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:357}} Nov 24 16:50:03.963311 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: [pid: 71938|app: 0|req: 1160/2332] 10.222.0.53 () {58 vars in 1214 bytes} [Wed Nov 24 16:50:03 2021] DELETE /identity/v3/users/d46c7e0be1f843c39dadc8b31cacaa86 => generated 0 bytes in 204 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 24 16:50:03.968167 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-888d2801-53f5-41aa-ab1b-1d50a55d5e9a None None] REQUEST_METHOD: `POST` {{(pid=71939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 24 16:50:03.968513 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-888d2801-53f5-41aa-ab1b-1d50a55d5e9a None None] SCRIPT_NAME: `/identity` {{(pid=71939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 24 16:50:03.968850 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-888d2801-53f5-41aa-ab1b-1d50a55d5e9a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=71939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 24 16:50:03.992649 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.auth.core [None req-888d2801-53f5-41aa-ab1b-1d50a55d5e9a None None] MFA Rules not processed for user `0f2ba2e8375b4e8c8792ee1e22b60427`. Rule list: `[]` (Enabled: `True`). {{(pid=71939) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:442}} Nov 24 16:50:03.993871 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.fernet_utils [None req-888d2801-53f5-41aa-ab1b-1d50a55d5e9a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=71939) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:289}} Nov 24 16:50:04.063915 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: [pid: 71939|app: 0|req: 1173/2333] 10.222.0.53 () {58 vars in 948 bytes} [Wed Nov 24 16:50:03 2021] POST /identity/v3/auth/tokens => generated 3669 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 24 16:50:04.076170 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54aed662-a2a1-4a49-9c10-b70d872ad599 admin admin] Authenticating user token {{(pid=71938) process_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 24 16:50:04.077685 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.fernet_utils [None req-54aed662-a2a1-4a49-9c10-b70d872ad599 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=71938) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:289}} Nov 24 16:50:04.153534 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54aed662-a2a1-4a49-9c10-b70d872ad599 admin admin] Validating token access rules against request {{(pid=71938) validate_allowed_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 24 16:50:04.157236 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf56e3fa-15c0-490b-84b6-fbec386b8ee4 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c90f21b9cdcb413282461fa83cb6b7a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3b3940d4ae1c4177ae29c02377bb4b0b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=71938) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 24 16:50:04.158135 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf56e3fa-15c0-490b-84b6-fbec386b8ee4 service neutron] REQUEST_METHOD: `GET` {{(pid=71938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 24 16:50:04.158489 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf56e3fa-15c0-490b-84b6-fbec386b8ee4 service neutron] SCRIPT_NAME: `/identity` {{(pid=71938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 24 16:50:04.158827 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf56e3fa-15c0-490b-84b6-fbec386b8ee4 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=71938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 24 16:50:04.169013 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf56e3fa-15c0-490b-84b6-fbec386b8ee4 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=71938) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:442}} Nov 24 16:50:04.200574 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf56e3fa-15c0-490b-84b6-fbec386b8ee4 service neutron] RBAC: Authorization granted {{(pid=71938) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 24 16:50:04.217287 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: [pid: 71938|app: 0|req: 1161/2334] 10.222.0.53 () {60 vars in 1356 bytes} [Wed Nov 24 16:50:04 2021] GET /identity/v3/auth/tokens => generated 3669 bytes in 142 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 24 16:50:04.627085 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-888d2801-53f5-41aa-ab1b-1d50a55d5e9a None None] Authenticating user token {{(pid=71939) process_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 24 16:50:04.628643 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.fernet_utils [None req-888d2801-53f5-41aa-ab1b-1d50a55d5e9a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=71939) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:289}} Nov 24 16:50:04.641459 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-888d2801-53f5-41aa-ab1b-1d50a55d5e9a None None] Validating token access rules against request {{(pid=71939) validate_allowed_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 24 16:50:04.651256 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94036848-b1a5-44ef-a114-531c629b5673 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f2ba2e8375b4e8c8792ee1e22b60427', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '00a5583c7b7443e98e7a1d31a0b638dc', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=71939) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 24 16:50:04.652204 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94036848-b1a5-44ef-a114-531c629b5673 admin admin] REQUEST_METHOD: `DELETE` {{(pid=71939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 24 16:50:04.652554 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94036848-b1a5-44ef-a114-531c629b5673 admin admin] SCRIPT_NAME: `/identity` {{(pid=71939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 24 16:50:04.652898 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94036848-b1a5-44ef-a114-531c629b5673 admin admin] PATH_INFO: `/v3/projects/25c8dafba79546329272318b1fdb3776` {{(pid=71939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 24 16:50:04.654272 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94036848-b1a5-44ef-a114-531c629b5673 admin admin] RBAC: Authorizing `identity:delete_project(project_id=25c8dafba79546329272318b1fdb3776)` {{(pid=71939) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:442}} Nov 24 16:50:04.685248 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94036848-b1a5-44ef-a114-531c629b5673 admin admin] RBAC: Authorization granted {{(pid=71939) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 24 16:50:04.741722 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.notifications [None req-94036848-b1a5-44ef-a114-531c629b5673 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '25c8dafba79546329272318b1fdb3776', 'request_id': 'req-94036848-b1a5-44ef-a114-531c629b5673'} {{(pid=71939) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:357}} Nov 24 16:50:04.754582 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.notifications [None req-94036848-b1a5-44ef-a114-531c629b5673 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '25c8dafba79546329272318b1fdb3776', 'request_id': 'req-94036848-b1a5-44ef-a114-531c629b5673'} {{(pid=71939) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:357}} Nov 24 16:50:04.764469 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.notifications [None req-94036848-b1a5-44ef-a114-531c629b5673 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '25c8dafba79546329272318b1fdb3776', 'request_id': 'req-94036848-b1a5-44ef-a114-531c629b5673'} {{(pid=71939) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:357}} Nov 24 16:50:04.775135 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.notifications [None req-94036848-b1a5-44ef-a114-531c629b5673 admin admin] The token cache is being invalidate because project 25c8dafba79546329272318b1fdb3776 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=71939) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Nov 24 16:50:04.775466 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.notifications [None req-94036848-b1a5-44ef-a114-531c629b5673 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=71939) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:357}} Nov 24 16:50:04.776119 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.notifications [None req-94036848-b1a5-44ef-a114-531c629b5673 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=71939) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:357}} Nov 24 16:50:04.777667 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: [pid: 71939|app: 0|req: 1174/2335] 10.222.0.53 () {58 vars in 1223 bytes} [Wed Nov 24 16:50:04 2021] DELETE /identity/v3/projects/25c8dafba79546329272318b1fdb3776 => generated 0 bytes in 151 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 24 16:50:04.783882 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b0ea81d-1740-4635-a10c-66aa4356fa2d None None] REQUEST_METHOD: `POST` {{(pid=71938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 24 16:50:04.784259 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b0ea81d-1740-4635-a10c-66aa4356fa2d None None] SCRIPT_NAME: `/identity` {{(pid=71938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 24 16:50:04.784598 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b0ea81d-1740-4635-a10c-66aa4356fa2d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=71938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 24 16:50:04.812626 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.auth.core [None req-4b0ea81d-1740-4635-a10c-66aa4356fa2d None None] MFA Rules not processed for user `0f2ba2e8375b4e8c8792ee1e22b60427`. Rule list: `[]` (Enabled: `True`). {{(pid=71938) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:442}} Nov 24 16:50:04.814332 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.fernet_utils [None req-4b0ea81d-1740-4635-a10c-66aa4356fa2d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=71938) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:289}} Nov 24 16:50:04.886767 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: [pid: 71938|app: 0|req: 1162/2336] 10.222.0.53 () {58 vars in 948 bytes} [Wed Nov 24 16:50:04 2021] POST /identity/v3/auth/tokens => generated 3669 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 24 16:50:04.895517 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87db0d60-87d8-46e8-bed1-9c427d17f348 None None] REQUEST_METHOD: `POST` {{(pid=71939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 24 16:50:04.895900 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87db0d60-87d8-46e8-bed1-9c427d17f348 None None] SCRIPT_NAME: `/identity` {{(pid=71939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 24 16:50:04.896236 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87db0d60-87d8-46e8-bed1-9c427d17f348 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=71939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 24 16:50:04.920421 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.auth.core [None req-87db0d60-87d8-46e8-bed1-9c427d17f348 None None] MFA Rules not processed for user `0f2ba2e8375b4e8c8792ee1e22b60427`. Rule list: `[]` (Enabled: `True`). {{(pid=71939) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:442}} Nov 24 16:50:04.921642 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.fernet_utils [None req-87db0d60-87d8-46e8-bed1-9c427d17f348 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=71939) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:289}} Nov 24 16:50:04.930148 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: [pid: 71939|app: 0|req: 1175/2337] 10.222.0.53 () {58 vars in 948 bytes} [Wed Nov 24 16:50:04 2021] POST /identity/v3/auth/tokens => generated 3669 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 24 16:50:04.935995 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b0ea81d-1740-4635-a10c-66aa4356fa2d None None] Authenticating user token {{(pid=71938) process_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 24 16:50:04.947155 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b0ea81d-1740-4635-a10c-66aa4356fa2d None None] Validating token access rules against request {{(pid=71938) validate_allowed_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 24 16:50:04.952499 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f18ed00-40bd-42ab-b7f2-f451d1db51b9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f2ba2e8375b4e8c8792ee1e22b60427', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '00a5583c7b7443e98e7a1d31a0b638dc', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=71938) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 24 16:50:04.953173 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f18ed00-40bd-42ab-b7f2-f451d1db51b9 admin admin] REQUEST_METHOD: `GET` {{(pid=71938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 24 16:50:04.953564 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f18ed00-40bd-42ab-b7f2-f451d1db51b9 admin admin] SCRIPT_NAME: `/identity` {{(pid=71938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 24 16:50:04.953897 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f18ed00-40bd-42ab-b7f2-f451d1db51b9 admin admin] PATH_INFO: `/v3/domains` {{(pid=71938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 24 16:50:04.954739 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f18ed00-40bd-42ab-b7f2-f451d1db51b9 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=71938) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:161}} Nov 24 16:50:04.955092 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f18ed00-40bd-42ab-b7f2-f451d1db51b9 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=71938) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:442}} Nov 24 16:50:04.984107 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f18ed00-40bd-42ab-b7f2-f451d1db51b9 admin admin] RBAC: Authorization granted {{(pid=71938) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 24 16:50:04.999740 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: [pid: 71938|app: 0|req: 1163/2338] 10.222.0.53 () {58 vars in 1143 bytes} [Wed Nov 24 16:50:04 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 64 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 24 16:50:05.004205 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87db0d60-87d8-46e8-bed1-9c427d17f348 None None] Authenticating user token {{(pid=71939) process_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 24 16:50:05.014713 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87db0d60-87d8-46e8-bed1-9c427d17f348 None None] Validating token access rules against request {{(pid=71939) validate_allowed_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 24 16:50:05.019808 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c054926-2727-4502-a587-d75a61027e74 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f2ba2e8375b4e8c8792ee1e22b60427', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '00a5583c7b7443e98e7a1d31a0b638dc', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=71939) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 24 16:50:05.020483 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c054926-2727-4502-a587-d75a61027e74 admin admin] REQUEST_METHOD: `POST` {{(pid=71939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 24 16:50:05.021407 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c054926-2727-4502-a587-d75a61027e74 admin admin] SCRIPT_NAME: `/identity` {{(pid=71939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 24 16:50:05.021744 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c054926-2727-4502-a587-d75a61027e74 admin admin] PATH_INFO: `/v3/projects` {{(pid=71939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 24 16:50:05.022522 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c054926-2727-4502-a587-d75a61027e74 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=71939) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:442}} Nov 24 16:50:05.051089 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c054926-2727-4502-a587-d75a61027e74 admin admin] RBAC: Authorization granted {{(pid=71939) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 24 16:50:05.080742 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: [pid: 71939|app: 0|req: 1176/2339] 10.222.0.53 () {60 vars in 1143 bytes} [Wed Nov 24 16:50:05 2021] POST /identity/v3/projects => generated 373 bytes in 77 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 24 16:50:05.085250 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f18ed00-40bd-42ab-b7f2-f451d1db51b9 admin admin] Authenticating user token {{(pid=71938) process_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 24 16:50:05.095412 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f18ed00-40bd-42ab-b7f2-f451d1db51b9 admin admin] Validating token access rules against request {{(pid=71938) validate_allowed_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 24 16:50:05.168903 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7912c25-9610-4a20-a8eb-bb0f0ae42330 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f2ba2e8375b4e8c8792ee1e22b60427', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '00a5583c7b7443e98e7a1d31a0b638dc', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=71938) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 24 16:50:05.169593 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7912c25-9610-4a20-a8eb-bb0f0ae42330 admin admin] REQUEST_METHOD: `POST` {{(pid=71938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 24 16:50:05.169936 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7912c25-9610-4a20-a8eb-bb0f0ae42330 admin admin] SCRIPT_NAME: `/identity` {{(pid=71938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 24 16:50:05.170356 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7912c25-9610-4a20-a8eb-bb0f0ae42330 admin admin] PATH_INFO: `/v3/users` {{(pid=71938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 24 16:50:05.171100 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7912c25-9610-4a20-a8eb-bb0f0ae42330 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=71938) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:442}} Nov 24 16:50:05.201431 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7912c25-9610-4a20-a8eb-bb0f0ae42330 admin admin] RBAC: Authorization granted {{(pid=71938) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 24 16:50:05.228866 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: [pid: 71938|app: 0|req: 1164/2340] 10.222.0.53 () {60 vars in 1134 bytes} [Wed Nov 24 16:50:05 2021] POST /identity/v3/users => generated 287 bytes in 141 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 24 16:50:05.230126 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c054926-2727-4502-a587-d75a61027e74 admin admin] Authenticating user token {{(pid=71939) process_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 24 16:50:05.240982 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c054926-2727-4502-a587-d75a61027e74 admin admin] Validating token access rules against request {{(pid=71939) validate_allowed_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 24 16:50:05.245897 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc7eb0f0-ca77-485f-a84f-ccb847f54f54 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f2ba2e8375b4e8c8792ee1e22b60427', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '00a5583c7b7443e98e7a1d31a0b638dc', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=71939) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 24 16:50:05.246645 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc7eb0f0-ca77-485f-a84f-ccb847f54f54 admin admin] REQUEST_METHOD: `GET` {{(pid=71939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 24 16:50:05.246990 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc7eb0f0-ca77-485f-a84f-ccb847f54f54 admin admin] SCRIPT_NAME: `/identity` {{(pid=71939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 24 16:50:05.247547 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc7eb0f0-ca77-485f-a84f-ccb847f54f54 admin admin] PATH_INFO: `/v3/roles` {{(pid=71939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 24 16:50:05.248272 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc7eb0f0-ca77-485f-a84f-ccb847f54f54 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=71939) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:442}} Nov 24 16:50:05.276936 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc7eb0f0-ca77-485f-a84f-ccb847f54f54 admin admin] RBAC: Authorization granted {{(pid=71939) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 24 16:50:05.292243 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: [pid: 71939|app: 0|req: 1177/2341] 10.222.0.53 () {58 vars in 1112 bytes} [Wed Nov 24 16:50:05 2021] GET /identity/v3/roles => generated 1420 bytes in 63 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 24 16:50:05.297575 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7912c25-9610-4a20-a8eb-bb0f0ae42330 admin admin] Authenticating user token {{(pid=71938) process_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 24 16:50:05.309063 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7912c25-9610-4a20-a8eb-bb0f0ae42330 admin admin] Validating token access rules against request {{(pid=71938) validate_allowed_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 24 16:50:05.313776 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6596ea7d-6eb2-487d-9a54-6e5be6a6278c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f2ba2e8375b4e8c8792ee1e22b60427', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '00a5583c7b7443e98e7a1d31a0b638dc', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=71938) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 24 16:50:05.314747 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6596ea7d-6eb2-487d-9a54-6e5be6a6278c admin admin] REQUEST_METHOD: `PUT` {{(pid=71938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 24 16:50:05.315086 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6596ea7d-6eb2-487d-9a54-6e5be6a6278c admin admin] SCRIPT_NAME: `/identity` {{(pid=71938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 24 16:50:05.315416 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6596ea7d-6eb2-487d-9a54-6e5be6a6278c admin admin] PATH_INFO: `/v3/projects/ea524ffee5024139848377aa032f1623/users/742ce97f1ebc4fd2a4e1fdc06aeb0edb/roles/912ab5f10fa5477da74acf239f07604e` {{(pid=71938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 24 16:50:05.338495 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6596ea7d-6eb2-487d-9a54-6e5be6a6278c admin admin] RBAC: Authorizing `identity:create_grant(project_id=ea524ffee5024139848377aa032f1623, user_id=742ce97f1ebc4fd2a4e1fdc06aeb0edb, role_id=912ab5f10fa5477da74acf239f07604e)` {{(pid=71938) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:442}} Nov 24 16:50:05.369057 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6596ea7d-6eb2-487d-9a54-6e5be6a6278c admin admin] RBAC: Authorization granted {{(pid=71938) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 24 16:50:05.382312 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: [pid: 71938|app: 0|req: 1165/2342] 10.222.0.53 () {60 vars in 1473 bytes} [Wed Nov 24 16:50:05 2021] PUT /identity/v3/projects/ea524ffee5024139848377aa032f1623/users/742ce97f1ebc4fd2a4e1fdc06aeb0edb/roles/912ab5f10fa5477da74acf239f07604e => generated 0 bytes in 86 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 24 16:50:05.387599 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be74352d-0817-4c30-abd3-f5936a35f039 None None] REQUEST_METHOD: `POST` {{(pid=71939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 24 16:50:05.387949 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be74352d-0817-4c30-abd3-f5936a35f039 None None] SCRIPT_NAME: `/identity` {{(pid=71939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 24 16:50:05.388286 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be74352d-0817-4c30-abd3-f5936a35f039 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=71939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 24 16:50:05.414497 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.auth.core [None req-be74352d-0817-4c30-abd3-f5936a35f039 None None] MFA Rules not processed for user `0f2ba2e8375b4e8c8792ee1e22b60427`. Rule list: `[]` (Enabled: `True`). {{(pid=71939) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:442}} Nov 24 16:50:05.415730 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.fernet_utils [None req-be74352d-0817-4c30-abd3-f5936a35f039 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=71939) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:289}} Nov 24 16:50:05.490209 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: [pid: 71939|app: 0|req: 1178/2343] 10.222.0.53 () {58 vars in 948 bytes} [Wed Nov 24 16:50:05 2021] POST /identity/v3/auth/tokens => generated 3669 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 24 16:50:05.502901 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6596ea7d-6eb2-487d-9a54-6e5be6a6278c admin admin] Authenticating user token {{(pid=71938) process_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 24 16:50:05.504776 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.fernet_utils [None req-6596ea7d-6eb2-487d-9a54-6e5be6a6278c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=71938) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:289}} Nov 24 16:50:05.578455 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6596ea7d-6eb2-487d-9a54-6e5be6a6278c admin admin] Validating token access rules against request {{(pid=71938) validate_allowed_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 24 16:50:05.582184 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7fb38aa-6887-4d61-b532-45dadfc1b0b0 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c90f21b9cdcb413282461fa83cb6b7a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3b3940d4ae1c4177ae29c02377bb4b0b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=71938) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 24 16:50:05.582857 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7fb38aa-6887-4d61-b532-45dadfc1b0b0 service neutron] REQUEST_METHOD: `GET` {{(pid=71938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 24 16:50:05.583258 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7fb38aa-6887-4d61-b532-45dadfc1b0b0 service neutron] SCRIPT_NAME: `/identity` {{(pid=71938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 24 16:50:05.584102 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7fb38aa-6887-4d61-b532-45dadfc1b0b0 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=71938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 24 16:50:05.593919 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7fb38aa-6887-4d61-b532-45dadfc1b0b0 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=71938) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:442}} Nov 24 16:50:05.623167 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7fb38aa-6887-4d61-b532-45dadfc1b0b0 service neutron] RBAC: Authorization granted {{(pid=71938) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 24 16:50:05.634356 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: [pid: 71938|app: 0|req: 1166/2344] 10.222.0.53 () {60 vars in 1356 bytes} [Wed Nov 24 16:50:05 2021] GET /identity/v3/auth/tokens => generated 3669 bytes in 132 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 24 16:50:06.528235 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a974cb0-4ac5-4212-9c97-d48459a4a2f4 None None] REQUEST_METHOD: `POST` {{(pid=71939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 24 16:50:06.528772 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a974cb0-4ac5-4212-9c97-d48459a4a2f4 None None] SCRIPT_NAME: `/identity` {{(pid=71939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 24 16:50:06.528951 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a974cb0-4ac5-4212-9c97-d48459a4a2f4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=71939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 24 16:50:06.572056 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.auth.core [None req-2a974cb0-4ac5-4212-9c97-d48459a4a2f4 None None] MFA Rules not processed for user `742ce97f1ebc4fd2a4e1fdc06aeb0edb`. Rule list: `[]` (Enabled: `True`). {{(pid=71939) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:442}} Nov 24 16:50:06.573292 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.fernet_utils [None req-2a974cb0-4ac5-4212-9c97-d48459a4a2f4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=71939) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:289}} Nov 24 16:50:06.669271 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: [pid: 71939|app: 0|req: 1179/2345] 10.222.0.53 () {58 vars in 948 bytes} [Wed Nov 24 16:50:06 2021] POST /identity/v3/auth/tokens => generated 3680 bytes in 143 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 24 16:50:06.681803 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7fb38aa-6887-4d61-b532-45dadfc1b0b0 service neutron] Authenticating user token {{(pid=71938) process_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 24 16:50:06.683561 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.fernet_utils [None req-a7fb38aa-6887-4d61-b532-45dadfc1b0b0 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=71938) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:289}} Nov 24 16:50:06.762320 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7fb38aa-6887-4d61-b532-45dadfc1b0b0 service neutron] Validating token access rules against request {{(pid=71938) validate_allowed_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 24 16:50:06.768743 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54e6c80e-8931-4d8c-a160-a8bc92f9eef2 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a12374a3093a401a97c343ff0854184d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3b3940d4ae1c4177ae29c02377bb4b0b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=71938) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 24 16:50:06.769575 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54e6c80e-8931-4d8c-a160-a8bc92f9eef2 service cinder] REQUEST_METHOD: `GET` {{(pid=71938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 24 16:50:06.769918 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54e6c80e-8931-4d8c-a160-a8bc92f9eef2 service cinder] SCRIPT_NAME: `/identity` {{(pid=71938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 24 16:50:06.770292 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54e6c80e-8931-4d8c-a160-a8bc92f9eef2 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=71938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 24 16:50:06.780909 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54e6c80e-8931-4d8c-a160-a8bc92f9eef2 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=71938) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:442}} Nov 24 16:50:06.810835 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54e6c80e-8931-4d8c-a160-a8bc92f9eef2 service cinder] RBAC: Authorization granted {{(pid=71938) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 24 16:50:06.821734 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: [pid: 71938|app: 0|req: 1167/2346] 10.222.0.53 () {60 vars in 1356 bytes} [Wed Nov 24 16:50:06 2021] GET /identity/v3/auth/tokens => generated 3680 bytes in 140 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 24 16:50:08.447785 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be573c49-8258-4439-b714-c1a96b47d421 None None] REQUEST_METHOD: `POST` {{(pid=71939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 24 16:50:08.448338 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be573c49-8258-4439-b714-c1a96b47d421 None None] SCRIPT_NAME: `/identity` {{(pid=71939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 24 16:50:08.448449 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be573c49-8258-4439-b714-c1a96b47d421 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=71939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 24 16:50:08.483500 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.auth.core [None req-be573c49-8258-4439-b714-c1a96b47d421 None None] MFA Rules not processed for user `742ce97f1ebc4fd2a4e1fdc06aeb0edb`. Rule list: `[]` (Enabled: `True`). {{(pid=71939) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:442}} Nov 24 16:50:08.484754 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.fernet_utils [None req-be573c49-8258-4439-b714-c1a96b47d421 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=71939) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:289}} Nov 24 16:50:08.511452 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: [pid: 71939|app: 0|req: 1180/2347] 10.222.0.53 () {58 vars in 948 bytes} [Wed Nov 24 16:50:08 2021] POST /identity/v3/auth/tokens => generated 3680 bytes in 65 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 24 16:50:13.150003 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54e6c80e-8931-4d8c-a160-a8bc92f9eef2 service cinder] Authenticating user token {{(pid=71938) process_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 24 16:50:13.152060 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.fernet_utils [None req-54e6c80e-8931-4d8c-a160-a8bc92f9eef2 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=71938) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:289}} Nov 24 16:50:13.266666 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54e6c80e-8931-4d8c-a160-a8bc92f9eef2 service cinder] Validating token access rules against request {{(pid=71938) validate_allowed_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 24 16:50:13.273545 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6180501b-ce15-4479-89f1-cca6aa0d5baa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f2ba2e8375b4e8c8792ee1e22b60427', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '00a5583c7b7443e98e7a1d31a0b638dc', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=71938) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 24 16:50:13.274368 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6180501b-ce15-4479-89f1-cca6aa0d5baa admin admin] REQUEST_METHOD: `DELETE` {{(pid=71938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 24 16:50:13.274704 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6180501b-ce15-4479-89f1-cca6aa0d5baa admin admin] SCRIPT_NAME: `/identity` {{(pid=71938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 24 16:50:13.275032 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6180501b-ce15-4479-89f1-cca6aa0d5baa admin admin] PATH_INFO: `/v3/users/4a4504c55b944f6c89a8e99197375321` {{(pid=71938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 24 16:50:13.276444 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6180501b-ce15-4479-89f1-cca6aa0d5baa admin admin] RBAC: Authorizing `identity:delete_user(user_id=4a4504c55b944f6c89a8e99197375321)` {{(pid=71938) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:442}} Nov 24 16:50:13.307091 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6180501b-ce15-4479-89f1-cca6aa0d5baa admin admin] RBAC: Authorization granted {{(pid=71938) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 24 16:50:13.373444 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.notifications [None req-6180501b-ce15-4479-89f1-cca6aa0d5baa admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '4a4504c55b944f6c89a8e99197375321'} {{(pid=71938) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:357}} Nov 24 16:50:13.387276 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.notifications [None req-6180501b-ce15-4479-89f1-cca6aa0d5baa admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '4a4504c55b944f6c89a8e99197375321'} {{(pid=71938) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:357}} Nov 24 16:50:13.388039 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.notifications [None req-6180501b-ce15-4479-89f1-cca6aa0d5baa admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '4a4504c55b944f6c89a8e99197375321'} {{(pid=71938) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:357}} Nov 24 16:50:13.397060 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.notifications [None req-6180501b-ce15-4479-89f1-cca6aa0d5baa admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '4a4504c55b944f6c89a8e99197375321'} {{(pid=71938) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:357}} Nov 24 16:50:13.406196 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.notifications [None req-6180501b-ce15-4479-89f1-cca6aa0d5baa admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '4a4504c55b944f6c89a8e99197375321'} {{(pid=71938) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:357}} Nov 24 16:50:13.419272 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: [pid: 71938|app: 0|req: 1168/2348] 10.222.0.53 () {58 vars in 1214 bytes} [Wed Nov 24 16:50:13 2021] DELETE /identity/v3/users/4a4504c55b944f6c89a8e99197375321 => generated 0 bytes in 270 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 24 16:50:13.425422 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-763f9fc2-71f4-40ff-a600-d4198b0defca None None] REQUEST_METHOD: `POST` {{(pid=71939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 24 16:50:13.426006 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-763f9fc2-71f4-40ff-a600-d4198b0defca None None] SCRIPT_NAME: `/identity` {{(pid=71939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 24 16:50:13.426508 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-763f9fc2-71f4-40ff-a600-d4198b0defca None None] PATH_INFO: `/v3/auth/tokens` {{(pid=71939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 24 16:50:13.474920 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.auth.core [None req-763f9fc2-71f4-40ff-a600-d4198b0defca None None] MFA Rules not processed for user `0f2ba2e8375b4e8c8792ee1e22b60427`. Rule list: `[]` (Enabled: `True`). {{(pid=71939) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:442}} Nov 24 16:50:13.476205 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.fernet_utils [None req-763f9fc2-71f4-40ff-a600-d4198b0defca None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=71939) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:289}} Nov 24 16:50:13.549729 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: [pid: 71939|app: 0|req: 1181/2349] 10.222.0.53 () {58 vars in 948 bytes} [Wed Nov 24 16:50:13 2021] POST /identity/v3/auth/tokens => generated 3669 bytes in 125 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 24 16:50:13.564322 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6180501b-ce15-4479-89f1-cca6aa0d5baa admin admin] Authenticating user token {{(pid=71938) process_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 24 16:50:13.566695 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.fernet_utils [None req-6180501b-ce15-4479-89f1-cca6aa0d5baa admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=71938) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:289}} Nov 24 16:50:13.699479 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6180501b-ce15-4479-89f1-cca6aa0d5baa admin admin] Validating token access rules against request {{(pid=71938) validate_allowed_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 24 16:50:13.703474 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4895ae4-bf94-437b-811f-1526b3606c5f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c90f21b9cdcb413282461fa83cb6b7a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3b3940d4ae1c4177ae29c02377bb4b0b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=71938) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 24 16:50:13.704145 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4895ae4-bf94-437b-811f-1526b3606c5f service neutron] REQUEST_METHOD: `GET` {{(pid=71938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 24 16:50:13.704486 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4895ae4-bf94-437b-811f-1526b3606c5f service neutron] SCRIPT_NAME: `/identity` {{(pid=71938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 24 16:50:13.704819 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4895ae4-bf94-437b-811f-1526b3606c5f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=71938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 24 16:50:13.717298 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4895ae4-bf94-437b-811f-1526b3606c5f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=71938) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:442}} Nov 24 16:50:13.747453 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4895ae4-bf94-437b-811f-1526b3606c5f service neutron] RBAC: Authorization granted {{(pid=71938) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 24 16:50:13.762628 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: [pid: 71938|app: 0|req: 1169/2350] 10.222.0.53 () {60 vars in 1356 bytes} [Wed Nov 24 16:50:13 2021] GET /identity/v3/auth/tokens => generated 3669 bytes in 199 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 24 16:50:14.634153 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-763f9fc2-71f4-40ff-a600-d4198b0defca None None] Authenticating user token {{(pid=71939) process_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 24 16:50:14.635873 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.fernet_utils [None req-763f9fc2-71f4-40ff-a600-d4198b0defca None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=71939) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:289}} Nov 24 16:50:14.666902 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-763f9fc2-71f4-40ff-a600-d4198b0defca None None] Validating token access rules against request {{(pid=71939) validate_allowed_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 24 16:50:14.683342 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0d66502-b67a-44e3-b3f3-18f53eacd3e4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f2ba2e8375b4e8c8792ee1e22b60427', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '00a5583c7b7443e98e7a1d31a0b638dc', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=71939) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 24 16:50:14.684255 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0d66502-b67a-44e3-b3f3-18f53eacd3e4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=71939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 24 16:50:14.684602 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0d66502-b67a-44e3-b3f3-18f53eacd3e4 admin admin] SCRIPT_NAME: `/identity` {{(pid=71939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 24 16:50:14.685090 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0d66502-b67a-44e3-b3f3-18f53eacd3e4 admin admin] PATH_INFO: `/v3/projects/1fb8d3d98f254680b6f43b83260e6799` {{(pid=71939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 24 16:50:14.686362 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0d66502-b67a-44e3-b3f3-18f53eacd3e4 admin admin] RBAC: Authorizing `identity:delete_project(project_id=1fb8d3d98f254680b6f43b83260e6799)` {{(pid=71939) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:442}} Nov 24 16:50:14.719111 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0d66502-b67a-44e3-b3f3-18f53eacd3e4 admin admin] RBAC: Authorization granted {{(pid=71939) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 24 16:50:14.822740 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.notifications [None req-e0d66502-b67a-44e3-b3f3-18f53eacd3e4 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '1fb8d3d98f254680b6f43b83260e6799', 'request_id': 'req-e0d66502-b67a-44e3-b3f3-18f53eacd3e4'} {{(pid=71939) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:357}} Nov 24 16:50:14.841468 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.notifications [None req-e0d66502-b67a-44e3-b3f3-18f53eacd3e4 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '1fb8d3d98f254680b6f43b83260e6799', 'request_id': 'req-e0d66502-b67a-44e3-b3f3-18f53eacd3e4'} {{(pid=71939) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:357}} Nov 24 16:50:14.858721 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.notifications [None req-e0d66502-b67a-44e3-b3f3-18f53eacd3e4 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '1fb8d3d98f254680b6f43b83260e6799', 'request_id': 'req-e0d66502-b67a-44e3-b3f3-18f53eacd3e4'} {{(pid=71939) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:357}} Nov 24 16:50:14.872910 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.notifications [None req-e0d66502-b67a-44e3-b3f3-18f53eacd3e4 admin admin] The token cache is being invalidate because project 1fb8d3d98f254680b6f43b83260e6799 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=71939) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Nov 24 16:50:14.873770 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.notifications [None req-e0d66502-b67a-44e3-b3f3-18f53eacd3e4 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=71939) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:357}} Nov 24 16:50:14.874933 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.notifications [None req-e0d66502-b67a-44e3-b3f3-18f53eacd3e4 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=71939) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:357}} Nov 24 16:50:14.884991 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: [pid: 71939|app: 0|req: 1182/2351] 10.222.0.53 () {58 vars in 1223 bytes} [Wed Nov 24 16:50:14 2021] DELETE /identity/v3/projects/1fb8d3d98f254680b6f43b83260e6799 => generated 0 bytes in 244 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 24 16:50:14.886381 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-827bb117-8256-47e0-9411-ae6f810c4b50 None None] REQUEST_METHOD: `POST` {{(pid=71938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 24 16:50:14.886874 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-827bb117-8256-47e0-9411-ae6f810c4b50 None None] SCRIPT_NAME: `/identity` {{(pid=71938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 24 16:50:14.887315 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-827bb117-8256-47e0-9411-ae6f810c4b50 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=71938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 24 16:50:15.003277 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.auth.core [None req-827bb117-8256-47e0-9411-ae6f810c4b50 None None] MFA Rules not processed for user `0f2ba2e8375b4e8c8792ee1e22b60427`. Rule list: `[]` (Enabled: `True`). {{(pid=71938) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:442}} Nov 24 16:50:15.006456 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.fernet_utils [None req-827bb117-8256-47e0-9411-ae6f810c4b50 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=71938) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:289}} Nov 24 16:50:15.195978 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: [pid: 71938|app: 0|req: 1170/2352] 10.222.0.53 () {58 vars in 948 bytes} [Wed Nov 24 16:50:14 2021] POST /identity/v3/auth/tokens => generated 3669 bytes in 311 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 24 16:50:15.205136 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c05a9e92-3e42-4937-879d-ea4ab76dfbf5 None None] REQUEST_METHOD: `POST` {{(pid=71939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 24 16:50:15.205487 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c05a9e92-3e42-4937-879d-ea4ab76dfbf5 None None] SCRIPT_NAME: `/identity` {{(pid=71939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 24 16:50:15.205823 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c05a9e92-3e42-4937-879d-ea4ab76dfbf5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=71939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 24 16:50:15.242790 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.auth.core [None req-c05a9e92-3e42-4937-879d-ea4ab76dfbf5 None None] MFA Rules not processed for user `0f2ba2e8375b4e8c8792ee1e22b60427`. Rule list: `[]` (Enabled: `True`). {{(pid=71939) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:442}} Nov 24 16:50:15.244050 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.fernet_utils [None req-c05a9e92-3e42-4937-879d-ea4ab76dfbf5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=71939) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:289}} Nov 24 16:50:15.253536 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: [pid: 71939|app: 0|req: 1183/2353] 10.222.0.53 () {58 vars in 948 bytes} [Wed Nov 24 16:50:15 2021] POST /identity/v3/auth/tokens => generated 3669 bytes in 50 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 24 16:50:15.258905 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-827bb117-8256-47e0-9411-ae6f810c4b50 None None] Authenticating user token {{(pid=71938) process_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 24 16:50:15.275819 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-827bb117-8256-47e0-9411-ae6f810c4b50 None None] Validating token access rules against request {{(pid=71938) validate_allowed_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 24 16:50:15.285870 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a4600bd-c1e6-4489-9ff5-f0d6a51caef6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f2ba2e8375b4e8c8792ee1e22b60427', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '00a5583c7b7443e98e7a1d31a0b638dc', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=71938) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 24 16:50:15.287245 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a4600bd-c1e6-4489-9ff5-f0d6a51caef6 admin admin] REQUEST_METHOD: `GET` {{(pid=71938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 24 16:50:15.287680 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a4600bd-c1e6-4489-9ff5-f0d6a51caef6 admin admin] SCRIPT_NAME: `/identity` {{(pid=71938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 24 16:50:15.288108 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a4600bd-c1e6-4489-9ff5-f0d6a51caef6 admin admin] PATH_INFO: `/v3/domains` {{(pid=71938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 24 16:50:15.289012 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a4600bd-c1e6-4489-9ff5-f0d6a51caef6 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=71938) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:161}} Nov 24 16:50:15.290126 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a4600bd-c1e6-4489-9ff5-f0d6a51caef6 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=71938) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:442}} Nov 24 16:50:15.325552 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a4600bd-c1e6-4489-9ff5-f0d6a51caef6 admin admin] RBAC: Authorization granted {{(pid=71938) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 24 16:50:15.351109 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c05a9e92-3e42-4937-879d-ea4ab76dfbf5 None None] Authenticating user token {{(pid=71939) process_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 24 16:50:15.359123 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: [pid: 71938|app: 0|req: 1171/2354] 10.222.0.53 () {58 vars in 1143 bytes} [Wed Nov 24 16:50:15 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 100 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 24 16:50:15.363251 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c05a9e92-3e42-4937-879d-ea4ab76dfbf5 None None] Validating token access rules against request {{(pid=71939) validate_allowed_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 24 16:50:15.369130 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0e7e6cb-52fc-4322-a2f1-44092e64fccd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f2ba2e8375b4e8c8792ee1e22b60427', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '00a5583c7b7443e98e7a1d31a0b638dc', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=71939) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 24 16:50:15.369973 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0e7e6cb-52fc-4322-a2f1-44092e64fccd admin admin] REQUEST_METHOD: `POST` {{(pid=71939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 24 16:50:15.370434 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0e7e6cb-52fc-4322-a2f1-44092e64fccd admin admin] SCRIPT_NAME: `/identity` {{(pid=71939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 24 16:50:15.370876 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0e7e6cb-52fc-4322-a2f1-44092e64fccd admin admin] PATH_INFO: `/v3/projects` {{(pid=71939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 24 16:50:15.372460 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0e7e6cb-52fc-4322-a2f1-44092e64fccd admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=71939) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:442}} Nov 24 16:50:15.407869 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0e7e6cb-52fc-4322-a2f1-44092e64fccd admin admin] RBAC: Authorization granted {{(pid=71939) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 24 16:50:15.462426 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: [pid: 71939|app: 0|req: 1184/2355] 10.222.0.53 () {60 vars in 1143 bytes} [Wed Nov 24 16:50:15 2021] POST /identity/v3/projects => generated 383 bytes in 109 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 24 16:50:15.464047 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a4600bd-c1e6-4489-9ff5-f0d6a51caef6 admin admin] Authenticating user token {{(pid=71938) process_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 24 16:50:15.476405 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a4600bd-c1e6-4489-9ff5-f0d6a51caef6 admin admin] Validating token access rules against request {{(pid=71938) validate_allowed_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 24 16:50:15.626196 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85244bbd-ad38-471f-b64f-50732e039d98 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f2ba2e8375b4e8c8792ee1e22b60427', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '00a5583c7b7443e98e7a1d31a0b638dc', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=71938) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 24 16:50:15.627017 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85244bbd-ad38-471f-b64f-50732e039d98 admin admin] REQUEST_METHOD: `POST` {{(pid=71938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 24 16:50:15.627721 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85244bbd-ad38-471f-b64f-50732e039d98 admin admin] SCRIPT_NAME: `/identity` {{(pid=71938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 24 16:50:15.628060 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85244bbd-ad38-471f-b64f-50732e039d98 admin admin] PATH_INFO: `/v3/users` {{(pid=71938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 24 16:50:15.628811 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85244bbd-ad38-471f-b64f-50732e039d98 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=71938) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:442}} Nov 24 16:50:15.660295 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85244bbd-ad38-471f-b64f-50732e039d98 admin admin] RBAC: Authorization granted {{(pid=71938) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 24 16:50:15.691615 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: [pid: 71938|app: 0|req: 1172/2356] 10.222.0.53 () {60 vars in 1134 bytes} [Wed Nov 24 16:50:15 2021] POST /identity/v3/users => generated 292 bytes in 227 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 24 16:50:15.695911 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0e7e6cb-52fc-4322-a2f1-44092e64fccd admin admin] Authenticating user token {{(pid=71939) process_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 24 16:50:15.706607 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0e7e6cb-52fc-4322-a2f1-44092e64fccd admin admin] Validating token access rules against request {{(pid=71939) validate_allowed_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 24 16:50:15.711393 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e882e8a-0bf9-4d62-bdef-8c4ab6f0749b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f2ba2e8375b4e8c8792ee1e22b60427', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '00a5583c7b7443e98e7a1d31a0b638dc', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=71939) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 24 16:50:15.712153 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e882e8a-0bf9-4d62-bdef-8c4ab6f0749b admin admin] REQUEST_METHOD: `GET` {{(pid=71939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 24 16:50:15.712569 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e882e8a-0bf9-4d62-bdef-8c4ab6f0749b admin admin] SCRIPT_NAME: `/identity` {{(pid=71939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 24 16:50:15.712977 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e882e8a-0bf9-4d62-bdef-8c4ab6f0749b admin admin] PATH_INFO: `/v3/roles` {{(pid=71939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 24 16:50:15.713954 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e882e8a-0bf9-4d62-bdef-8c4ab6f0749b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=71939) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:442}} Nov 24 16:50:15.744104 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e882e8a-0bf9-4d62-bdef-8c4ab6f0749b admin admin] RBAC: Authorization granted {{(pid=71939) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 24 16:50:15.765275 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: [pid: 71939|app: 0|req: 1185/2357] 10.222.0.53 () {58 vars in 1112 bytes} [Wed Nov 24 16:50:15 2021] GET /identity/v3/roles => generated 1420 bytes in 67 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 24 16:50:15.768124 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85244bbd-ad38-471f-b64f-50732e039d98 admin admin] Authenticating user token {{(pid=71938) process_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 24 16:50:15.778696 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85244bbd-ad38-471f-b64f-50732e039d98 admin admin] Validating token access rules against request {{(pid=71938) validate_allowed_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 24 16:50:15.783895 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71c0a0f1-8887-4aec-8503-6e02a4faf080 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f2ba2e8375b4e8c8792ee1e22b60427', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '00a5583c7b7443e98e7a1d31a0b638dc', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=71938) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 24 16:50:15.784816 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71c0a0f1-8887-4aec-8503-6e02a4faf080 admin admin] REQUEST_METHOD: `PUT` {{(pid=71938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 24 16:50:15.785160 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71c0a0f1-8887-4aec-8503-6e02a4faf080 admin admin] SCRIPT_NAME: `/identity` {{(pid=71938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 24 16:50:15.785499 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71c0a0f1-8887-4aec-8503-6e02a4faf080 admin admin] PATH_INFO: `/v3/projects/da85f7b56be043949b7841a49547af64/users/a925d4338c854b828b7417f96e9e04e6/roles/912ab5f10fa5477da74acf239f07604e` {{(pid=71938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 24 16:50:15.807723 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71c0a0f1-8887-4aec-8503-6e02a4faf080 admin admin] RBAC: Authorizing `identity:create_grant(project_id=da85f7b56be043949b7841a49547af64, user_id=a925d4338c854b828b7417f96e9e04e6, role_id=912ab5f10fa5477da74acf239f07604e)` {{(pid=71938) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:442}} Nov 24 16:50:15.839093 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71c0a0f1-8887-4aec-8503-6e02a4faf080 admin admin] RBAC: Authorization granted {{(pid=71938) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 24 16:50:15.853620 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: [pid: 71938|app: 0|req: 1173/2358] 10.222.0.53 () {60 vars in 1473 bytes} [Wed Nov 24 16:50:15 2021] PUT /identity/v3/projects/da85f7b56be043949b7841a49547af64/users/a925d4338c854b828b7417f96e9e04e6/roles/912ab5f10fa5477da74acf239f07604e => generated 0 bytes in 86 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 24 16:50:15.862989 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-573d72b9-bdd0-4b5e-938e-375f0fcfb7d1 None None] REQUEST_METHOD: `POST` {{(pid=71939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 24 16:50:15.863341 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-573d72b9-bdd0-4b5e-938e-375f0fcfb7d1 None None] SCRIPT_NAME: `/identity` {{(pid=71939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 24 16:50:15.863681 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-573d72b9-bdd0-4b5e-938e-375f0fcfb7d1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=71939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 24 16:50:15.892788 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.auth.core [None req-573d72b9-bdd0-4b5e-938e-375f0fcfb7d1 None None] MFA Rules not processed for user `0f2ba2e8375b4e8c8792ee1e22b60427`. Rule list: `[]` (Enabled: `True`). {{(pid=71939) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:442}} Nov 24 16:50:15.894070 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.fernet_utils [None req-573d72b9-bdd0-4b5e-938e-375f0fcfb7d1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=71939) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:289}} Nov 24 16:50:15.976570 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: [pid: 71939|app: 0|req: 1186/2359] 10.222.0.53 () {58 vars in 948 bytes} [Wed Nov 24 16:50:15 2021] POST /identity/v3/auth/tokens => generated 3669 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 24 16:50:15.987861 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71c0a0f1-8887-4aec-8503-6e02a4faf080 admin admin] Authenticating user token {{(pid=71938) process_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 24 16:50:15.990296 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.fernet_utils [None req-71c0a0f1-8887-4aec-8503-6e02a4faf080 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=71938) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:289}} Nov 24 16:50:16.068732 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71c0a0f1-8887-4aec-8503-6e02a4faf080 admin admin] Validating token access rules against request {{(pid=71938) validate_allowed_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 24 16:50:16.072523 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a652011e-dcf8-4de8-91af-a75f674c0d36 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c90f21b9cdcb413282461fa83cb6b7a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3b3940d4ae1c4177ae29c02377bb4b0b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=71938) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 24 16:50:16.073170 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a652011e-dcf8-4de8-91af-a75f674c0d36 service neutron] REQUEST_METHOD: `GET` {{(pid=71938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 24 16:50:16.073518 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a652011e-dcf8-4de8-91af-a75f674c0d36 service neutron] SCRIPT_NAME: `/identity` {{(pid=71938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 24 16:50:16.073857 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a652011e-dcf8-4de8-91af-a75f674c0d36 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=71938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 24 16:50:16.085140 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a652011e-dcf8-4de8-91af-a75f674c0d36 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=71938) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:442}} Nov 24 16:50:16.115019 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a652011e-dcf8-4de8-91af-a75f674c0d36 service neutron] RBAC: Authorization granted {{(pid=71938) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 24 16:50:16.126001 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: [pid: 71938|app: 0|req: 1174/2360] 10.222.0.53 () {60 vars in 1356 bytes} [Wed Nov 24 16:50:15 2021] GET /identity/v3/auth/tokens => generated 3669 bytes in 139 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 24 16:50:23.874860 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e645097f-bfdc-4be6-a148-8992e88f0679 None None] REQUEST_METHOD: `POST` {{(pid=71939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 24 16:50:23.875377 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e645097f-bfdc-4be6-a148-8992e88f0679 None None] SCRIPT_NAME: `/identity` {{(pid=71939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 24 16:50:23.875535 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e645097f-bfdc-4be6-a148-8992e88f0679 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=71939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 24 16:50:23.917098 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.auth.core [None req-e645097f-bfdc-4be6-a148-8992e88f0679 None None] MFA Rules not processed for user `a925d4338c854b828b7417f96e9e04e6`. Rule list: `[]` (Enabled: `True`). {{(pid=71939) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:442}} Nov 24 16:50:23.918369 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.fernet_utils [None req-e645097f-bfdc-4be6-a148-8992e88f0679 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=71939) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:289}} Nov 24 16:50:23.995666 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: [pid: 71939|app: 0|req: 1187/2361] 10.222.0.53 () {58 vars in 948 bytes} [Wed Nov 24 16:50:23 2021] POST /identity/v3/auth/tokens => generated 3690 bytes in 122 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 24 16:50:24.000437 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a652011e-dcf8-4de8-91af-a75f674c0d36 service neutron] Authenticating user token {{(pid=71938) process_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 24 16:50:24.011374 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a652011e-dcf8-4de8-91af-a75f674c0d36 service neutron] Validating token access rules against request {{(pid=71938) validate_allowed_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 24 16:50:24.015934 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4bc8e52-c232-4844-a50d-544b473e1e85 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f2ba2e8375b4e8c8792ee1e22b60427', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '00a5583c7b7443e98e7a1d31a0b638dc', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=71938) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 24 16:50:24.016604 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4bc8e52-c232-4844-a50d-544b473e1e85 admin admin] REQUEST_METHOD: `POST` {{(pid=71938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 24 16:50:24.016943 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4bc8e52-c232-4844-a50d-544b473e1e85 admin admin] SCRIPT_NAME: `/identity` {{(pid=71938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 24 16:50:24.017270 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4bc8e52-c232-4844-a50d-544b473e1e85 admin admin] PATH_INFO: `/v3/projects` {{(pid=71938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 24 16:50:24.018013 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4bc8e52-c232-4844-a50d-544b473e1e85 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=71938) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:442}} Nov 24 16:50:24.048694 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4bc8e52-c232-4844-a50d-544b473e1e85 admin admin] RBAC: Authorization granted {{(pid=71938) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 24 16:50:24.083089 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: [pid: 71938|app: 0|req: 1175/2362] 10.222.0.53 () {60 vars in 1143 bytes} [Wed Nov 24 16:50:23 2021] POST /identity/v3/projects => generated 385 bytes in 83 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 24 16:50:24.087750 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e645097f-bfdc-4be6-a148-8992e88f0679 None None] Authenticating user token {{(pid=71939) process_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 24 16:50:24.098710 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e645097f-bfdc-4be6-a148-8992e88f0679 None None] Validating token access rules against request {{(pid=71939) validate_allowed_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 24 16:50:24.171301 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a65a3e2-6bca-4677-a172-34cc10bce35b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f2ba2e8375b4e8c8792ee1e22b60427', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '00a5583c7b7443e98e7a1d31a0b638dc', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=71939) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 24 16:50:24.171991 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a65a3e2-6bca-4677-a172-34cc10bce35b admin admin] REQUEST_METHOD: `POST` {{(pid=71939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 24 16:50:24.172334 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a65a3e2-6bca-4677-a172-34cc10bce35b admin admin] SCRIPT_NAME: `/identity` {{(pid=71939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 24 16:50:24.172669 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a65a3e2-6bca-4677-a172-34cc10bce35b admin admin] PATH_INFO: `/v3/users` {{(pid=71939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 24 16:50:24.173403 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a65a3e2-6bca-4677-a172-34cc10bce35b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=71939) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:442}} Nov 24 16:50:24.204629 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a65a3e2-6bca-4677-a172-34cc10bce35b admin admin] RBAC: Authorization granted {{(pid=71939) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 24 16:50:24.227935 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: [pid: 71939|app: 0|req: 1188/2363] 10.222.0.53 () {60 vars in 1134 bytes} [Wed Nov 24 16:50:24 2021] POST /identity/v3/users => generated 299 bytes in 141 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 24 16:50:24.232326 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4bc8e52-c232-4844-a50d-544b473e1e85 admin admin] Authenticating user token {{(pid=71938) process_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 24 16:50:24.243604 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4bc8e52-c232-4844-a50d-544b473e1e85 admin admin] Validating token access rules against request {{(pid=71938) validate_allowed_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 24 16:50:24.248409 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0999c25f-50c4-4fab-83ff-8b0ec120ea23 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f2ba2e8375b4e8c8792ee1e22b60427', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '00a5583c7b7443e98e7a1d31a0b638dc', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=71938) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 24 16:50:24.249088 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0999c25f-50c4-4fab-83ff-8b0ec120ea23 admin admin] REQUEST_METHOD: `GET` {{(pid=71938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 24 16:50:24.249587 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0999c25f-50c4-4fab-83ff-8b0ec120ea23 admin admin] SCRIPT_NAME: `/identity` {{(pid=71938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 24 16:50:24.249935 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0999c25f-50c4-4fab-83ff-8b0ec120ea23 admin admin] PATH_INFO: `/v3/roles` {{(pid=71938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 24 16:50:24.250776 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0999c25f-50c4-4fab-83ff-8b0ec120ea23 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=71938) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:442}} Nov 24 16:50:24.281677 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0999c25f-50c4-4fab-83ff-8b0ec120ea23 admin admin] RBAC: Authorization granted {{(pid=71938) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 24 16:50:24.293435 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: [pid: 71938|app: 0|req: 1176/2364] 10.222.0.53 () {58 vars in 1112 bytes} [Wed Nov 24 16:50:24 2021] GET /identity/v3/roles => generated 1420 bytes in 62 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Nov 24 16:50:24.297983 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a65a3e2-6bca-4677-a172-34cc10bce35b admin admin] Authenticating user token {{(pid=71939) process_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 24 16:50:24.308599 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a65a3e2-6bca-4677-a172-34cc10bce35b admin admin] Validating token access rules against request {{(pid=71939) validate_allowed_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 24 16:50:24.313238 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43aff551-afd5-4cb5-8256-32a383c16815 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f2ba2e8375b4e8c8792ee1e22b60427', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '00a5583c7b7443e98e7a1d31a0b638dc', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=71939) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 24 16:50:24.314173 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43aff551-afd5-4cb5-8256-32a383c16815 admin admin] REQUEST_METHOD: `PUT` {{(pid=71939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 24 16:50:24.314511 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43aff551-afd5-4cb5-8256-32a383c16815 admin admin] SCRIPT_NAME: `/identity` {{(pid=71939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 24 16:50:24.314839 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43aff551-afd5-4cb5-8256-32a383c16815 admin admin] PATH_INFO: `/v3/projects/1d68ea1c7ff043f2943b93be6c8d5256/users/40db23df51d64c1cbf05a8b2556a497f/roles/5611724e350b41e19921b5961a342582` {{(pid=71939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 24 16:50:24.339696 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43aff551-afd5-4cb5-8256-32a383c16815 admin admin] RBAC: Authorizing `identity:create_grant(project_id=1d68ea1c7ff043f2943b93be6c8d5256, user_id=40db23df51d64c1cbf05a8b2556a497f, role_id=5611724e350b41e19921b5961a342582)` {{(pid=71939) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:442}} Nov 24 16:50:24.369504 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43aff551-afd5-4cb5-8256-32a383c16815 admin admin] RBAC: Authorization granted {{(pid=71939) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 24 16:50:24.383288 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: [pid: 71939|app: 0|req: 1189/2365] 10.222.0.53 () {60 vars in 1473 bytes} [Wed Nov 24 16:50:24 2021] PUT /identity/v3/projects/1d68ea1c7ff043f2943b93be6c8d5256/users/40db23df51d64c1cbf05a8b2556a497f/roles/5611724e350b41e19921b5961a342582 => generated 0 bytes in 86 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 24 16:50:24.387801 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0999c25f-50c4-4fab-83ff-8b0ec120ea23 admin admin] Authenticating user token {{(pid=71938) process_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 24 16:50:24.404109 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0999c25f-50c4-4fab-83ff-8b0ec120ea23 admin admin] Validating token access rules against request {{(pid=71938) validate_allowed_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 24 16:50:24.481944 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-892f2f0e-c8f3-49ab-abf5-625bf255222b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f2ba2e8375b4e8c8792ee1e22b60427', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '00a5583c7b7443e98e7a1d31a0b638dc', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=71938) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 24 16:50:24.482667 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-892f2f0e-c8f3-49ab-abf5-625bf255222b admin admin] REQUEST_METHOD: `GET` {{(pid=71938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 24 16:50:24.483006 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-892f2f0e-c8f3-49ab-abf5-625bf255222b admin admin] SCRIPT_NAME: `/identity` {{(pid=71938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 24 16:50:24.483336 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-892f2f0e-c8f3-49ab-abf5-625bf255222b admin admin] PATH_INFO: `/v3/roles` {{(pid=71938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 24 16:50:24.484120 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-892f2f0e-c8f3-49ab-abf5-625bf255222b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=71938) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:442}} Nov 24 16:50:24.514010 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-892f2f0e-c8f3-49ab-abf5-625bf255222b admin admin] RBAC: Authorization granted {{(pid=71938) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 24 16:50:24.526480 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: [pid: 71938|app: 0|req: 1177/2366] 10.222.0.53 () {58 vars in 1112 bytes} [Wed Nov 24 16:50:24 2021] GET /identity/v3/roles => generated 1420 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 24 16:50:24.530912 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43aff551-afd5-4cb5-8256-32a383c16815 admin admin] Authenticating user token {{(pid=71939) process_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 24 16:50:24.542547 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43aff551-afd5-4cb5-8256-32a383c16815 admin admin] Validating token access rules against request {{(pid=71939) validate_allowed_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 24 16:50:24.549056 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ebbb9c6-2a8f-4b6c-93de-e7658f79213a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f2ba2e8375b4e8c8792ee1e22b60427', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '00a5583c7b7443e98e7a1d31a0b638dc', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=71939) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 24 16:50:24.549971 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ebbb9c6-2a8f-4b6c-93de-e7658f79213a admin admin] REQUEST_METHOD: `PUT` {{(pid=71939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 24 16:50:24.550339 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ebbb9c6-2a8f-4b6c-93de-e7658f79213a admin admin] SCRIPT_NAME: `/identity` {{(pid=71939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 24 16:50:24.550677 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ebbb9c6-2a8f-4b6c-93de-e7658f79213a admin admin] PATH_INFO: `/v3/projects/1d68ea1c7ff043f2943b93be6c8d5256/users/40db23df51d64c1cbf05a8b2556a497f/roles/5611724e350b41e19921b5961a342582` {{(pid=71939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 24 16:50:24.554104 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ebbb9c6-2a8f-4b6c-93de-e7658f79213a admin admin] RBAC: Authorizing `identity:create_grant(project_id=1d68ea1c7ff043f2943b93be6c8d5256, user_id=40db23df51d64c1cbf05a8b2556a497f, role_id=5611724e350b41e19921b5961a342582)` {{(pid=71939) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:442}} Nov 24 16:50:24.586778 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ebbb9c6-2a8f-4b6c-93de-e7658f79213a admin admin] RBAC: Authorization granted {{(pid=71939) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 24 16:50:24.604666 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: [pid: 71939|app: 0|req: 1190/2367] 10.222.0.53 () {60 vars in 1473 bytes} [Wed Nov 24 16:50:24 2021] PUT /identity/v3/projects/1d68ea1c7ff043f2943b93be6c8d5256/users/40db23df51d64c1cbf05a8b2556a497f/roles/5611724e350b41e19921b5961a342582 => generated 0 bytes in 71 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 24 16:50:24.605856 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-892f2f0e-c8f3-49ab-abf5-625bf255222b admin admin] Authenticating user token {{(pid=71938) process_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 24 16:50:24.628298 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-892f2f0e-c8f3-49ab-abf5-625bf255222b admin admin] Validating token access rules against request {{(pid=71938) validate_allowed_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 24 16:50:24.788837 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4de78866-eaa0-43a4-a3c0-8dab375babca admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f2ba2e8375b4e8c8792ee1e22b60427', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '00a5583c7b7443e98e7a1d31a0b638dc', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=71938) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 24 16:50:24.790246 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4de78866-eaa0-43a4-a3c0-8dab375babca admin admin] REQUEST_METHOD: `GET` {{(pid=71938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 24 16:50:24.790802 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4de78866-eaa0-43a4-a3c0-8dab375babca admin admin] SCRIPT_NAME: `/identity` {{(pid=71938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 24 16:50:24.791488 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4de78866-eaa0-43a4-a3c0-8dab375babca admin admin] PATH_INFO: `/v3/roles` {{(pid=71938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 24 16:50:24.793201 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4de78866-eaa0-43a4-a3c0-8dab375babca admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=71938) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:442}} Nov 24 16:50:24.835240 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4de78866-eaa0-43a4-a3c0-8dab375babca admin admin] RBAC: Authorization granted {{(pid=71938) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 24 16:50:24.854557 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: [pid: 71938|app: 0|req: 1178/2368] 10.222.0.53 () {58 vars in 1112 bytes} [Wed Nov 24 16:50:24 2021] GET /identity/v3/roles => generated 1420 bytes in 249 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 24 16:50:24.858687 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ebbb9c6-2a8f-4b6c-93de-e7658f79213a admin admin] Authenticating user token {{(pid=71939) process_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 24 16:50:24.876029 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ebbb9c6-2a8f-4b6c-93de-e7658f79213a admin admin] Validating token access rules against request {{(pid=71939) validate_allowed_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 24 16:50:24.883416 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-245b3731-bf39-423b-ad67-aa471f8302fa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f2ba2e8375b4e8c8792ee1e22b60427', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '00a5583c7b7443e98e7a1d31a0b638dc', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=71939) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 24 16:50:24.884521 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-245b3731-bf39-423b-ad67-aa471f8302fa admin admin] REQUEST_METHOD: `PUT` {{(pid=71939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 24 16:50:24.885009 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-245b3731-bf39-423b-ad67-aa471f8302fa admin admin] SCRIPT_NAME: `/identity` {{(pid=71939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 24 16:50:24.886322 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-245b3731-bf39-423b-ad67-aa471f8302fa admin admin] PATH_INFO: `/v3/projects/1d68ea1c7ff043f2943b93be6c8d5256/users/40db23df51d64c1cbf05a8b2556a497f/roles/912ab5f10fa5477da74acf239f07604e` {{(pid=71939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 24 16:50:24.889840 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-245b3731-bf39-423b-ad67-aa471f8302fa admin admin] RBAC: Authorizing `identity:create_grant(project_id=1d68ea1c7ff043f2943b93be6c8d5256, user_id=40db23df51d64c1cbf05a8b2556a497f, role_id=912ab5f10fa5477da74acf239f07604e)` {{(pid=71939) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:442}} Nov 24 16:50:24.958768 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-245b3731-bf39-423b-ad67-aa471f8302fa admin admin] RBAC: Authorization granted {{(pid=71939) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 24 16:50:24.983161 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: [pid: 71939|app: 0|req: 1191/2369] 10.222.0.53 () {60 vars in 1473 bytes} [Wed Nov 24 16:50:24 2021] PUT /identity/v3/projects/1d68ea1c7ff043f2943b93be6c8d5256/users/40db23df51d64c1cbf05a8b2556a497f/roles/912ab5f10fa5477da74acf239f07604e => generated 0 bytes in 125 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Nov 24 16:50:31.536695 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf83f9fb-e9e3-4fcb-99ab-5afdf0a1566b None None] REQUEST_METHOD: `POST` {{(pid=71938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 24 16:50:31.537506 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf83f9fb-e9e3-4fcb-99ab-5afdf0a1566b None None] SCRIPT_NAME: `/identity` {{(pid=71938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 24 16:50:31.537506 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf83f9fb-e9e3-4fcb-99ab-5afdf0a1566b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=71938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 24 16:50:31.589740 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.auth.core [None req-cf83f9fb-e9e3-4fcb-99ab-5afdf0a1566b None None] MFA Rules not processed for user `742ce97f1ebc4fd2a4e1fdc06aeb0edb`. Rule list: `[]` (Enabled: `True`). {{(pid=71938) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:442}} Nov 24 16:50:31.591483 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.fernet_utils [None req-cf83f9fb-e9e3-4fcb-99ab-5afdf0a1566b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=71938) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:289}} Nov 24 16:50:31.839776 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: [pid: 71938|app: 0|req: 1179/2370] 10.222.0.53 () {58 vars in 948 bytes} [Wed Nov 24 16:50:31 2021] POST /identity/v3/auth/tokens => generated 3680 bytes in 305 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 24 16:50:33.934505 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-575a2eb0-abf5-44a7-b68e-58b92eb4c9c2 None None] REQUEST_METHOD: `POST` {{(pid=71939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 24 16:50:33.934970 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-575a2eb0-abf5-44a7-b68e-58b92eb4c9c2 None None] SCRIPT_NAME: `/identity` {{(pid=71939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 24 16:50:33.935173 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-575a2eb0-abf5-44a7-b68e-58b92eb4c9c2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=71939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 24 16:50:33.996182 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.auth.core [None req-575a2eb0-abf5-44a7-b68e-58b92eb4c9c2 None None] MFA Rules not processed for user `40db23df51d64c1cbf05a8b2556a497f`. Rule list: `[]` (Enabled: `True`). {{(pid=71939) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:442}} Nov 24 16:50:33.997437 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.fernet_utils [None req-575a2eb0-abf5-44a7-b68e-58b92eb4c9c2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=71939) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:289}} Nov 24 16:50:34.112363 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: [pid: 71939|app: 0|req: 1192/2371] 10.222.0.53 () {58 vars in 948 bytes} [Wed Nov 24 16:50:33 2021] POST /identity/v3/auth/tokens => generated 3759 bytes in 179 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 24 16:50:34.128029 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf83f9fb-e9e3-4fcb-99ab-5afdf0a1566b None None] Authenticating user token {{(pid=71938) process_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 24 16:50:34.130307 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.fernet_utils [None req-cf83f9fb-e9e3-4fcb-99ab-5afdf0a1566b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=71938) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:289}} Nov 24 16:50:34.237554 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf83f9fb-e9e3-4fcb-99ab-5afdf0a1566b None None] Validating token access rules against request {{(pid=71938) validate_allowed_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 24 16:50:34.245889 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a45cfde4-6d05-4df6-91c1-03b357054607 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'af9e91f8d56c491d99fab4346754ce2e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3b3940d4ae1c4177ae29c02377bb4b0b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=71938) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 24 16:50:34.246623 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a45cfde4-6d05-4df6-91c1-03b357054607 service glance] REQUEST_METHOD: `GET` {{(pid=71938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 24 16:50:34.246966 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a45cfde4-6d05-4df6-91c1-03b357054607 service glance] SCRIPT_NAME: `/identity` {{(pid=71938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 24 16:50:34.247306 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a45cfde4-6d05-4df6-91c1-03b357054607 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=71938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 24 16:50:34.325053 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a45cfde4-6d05-4df6-91c1-03b357054607 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=71938) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:442}} Nov 24 16:50:34.357327 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a45cfde4-6d05-4df6-91c1-03b357054607 service glance] RBAC: Authorization granted {{(pid=71938) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 24 16:50:34.378169 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: [pid: 71938|app: 0|req: 1180/2372] 10.222.0.53 () {60 vars in 1356 bytes} [Wed Nov 24 16:50:34 2021] GET /identity/v3/auth/tokens => generated 3690 bytes in 243 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 24 16:50:34.512130 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-764a8085-4a6f-4e99-9dbc-e10126c1b874 None None] REQUEST_METHOD: `POST` {{(pid=71939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 24 16:50:34.512474 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-764a8085-4a6f-4e99-9dbc-e10126c1b874 None None] SCRIPT_NAME: `/identity` {{(pid=71939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 24 16:50:34.512812 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-764a8085-4a6f-4e99-9dbc-e10126c1b874 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=71939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 24 16:50:34.555221 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.auth.core [None req-764a8085-4a6f-4e99-9dbc-e10126c1b874 None None] MFA Rules not processed for user `f8a135ac0e4744a98258dc7f6c12e741`. Rule list: `[]` (Enabled: `True`). {{(pid=71939) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:442}} Nov 24 16:50:34.556699 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.fernet_utils [None req-764a8085-4a6f-4e99-9dbc-e10126c1b874 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=71939) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:289}} Nov 24 16:50:34.632802 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: [pid: 71939|app: 0|req: 1193/2373] 10.222.0.53 () {58 vars in 999 bytes} [Wed Nov 24 16:50:34 2021] POST /identity/v3/auth/tokens => generated 3625 bytes in 122 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 24 16:50:34.687298 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a45cfde4-6d05-4df6-91c1-03b357054607 service glance] Authenticating user token {{(pid=71938) process_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 24 16:50:34.688782 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.fernet_utils [None req-a45cfde4-6d05-4df6-91c1-03b357054607 service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=71938) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:289}} Nov 24 16:50:34.781017 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a45cfde4-6d05-4df6-91c1-03b357054607 service glance] Validating token access rules against request {{(pid=71938) validate_allowed_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 24 16:50:34.788980 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14f6c14d-2eea-4da7-8cc8-7b8a672faf89 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a4cec9543ba4b7da4ecb1e6e8681302', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3b3940d4ae1c4177ae29c02377bb4b0b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=71938) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 24 16:50:34.789755 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14f6c14d-2eea-4da7-8cc8-7b8a672faf89 service swift] REQUEST_METHOD: `GET` {{(pid=71938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 24 16:50:34.790208 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14f6c14d-2eea-4da7-8cc8-7b8a672faf89 service swift] SCRIPT_NAME: `/identity` {{(pid=71938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 24 16:50:34.791007 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14f6c14d-2eea-4da7-8cc8-7b8a672faf89 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=71938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 24 16:50:34.801578 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14f6c14d-2eea-4da7-8cc8-7b8a672faf89 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=71938) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:442}} Nov 24 16:50:34.833586 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14f6c14d-2eea-4da7-8cc8-7b8a672faf89 service swift] RBAC: Authorization granted {{(pid=71938) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 24 16:50:34.844100 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: [pid: 71938|app: 0|req: 1181/2374] 10.222.0.53 () {60 vars in 1375 bytes} [Wed Nov 24 16:50:34 2021] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 157 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Nov 24 16:50:36.373353 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-764a8085-4a6f-4e99-9dbc-e10126c1b874 None None] Authenticating user token {{(pid=71939) process_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 24 16:50:36.377242 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.fernet_utils [None req-764a8085-4a6f-4e99-9dbc-e10126c1b874 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=71939) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:289}} Nov 24 16:50:36.471026 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-764a8085-4a6f-4e99-9dbc-e10126c1b874 None None] Validating token access rules against request {{(pid=71939) validate_allowed_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 24 16:50:36.476860 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf4ed12e-2127-47dd-8c63-3e5fe1916bc7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f2ba2e8375b4e8c8792ee1e22b60427', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '00a5583c7b7443e98e7a1d31a0b638dc', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=71939) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 24 16:50:36.477910 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf4ed12e-2127-47dd-8c63-3e5fe1916bc7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=71939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 24 16:50:36.478393 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf4ed12e-2127-47dd-8c63-3e5fe1916bc7 admin admin] SCRIPT_NAME: `/identity` {{(pid=71939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 24 16:50:36.478837 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf4ed12e-2127-47dd-8c63-3e5fe1916bc7 admin admin] PATH_INFO: `/v3/users/1b0b0975ae13443988f450537e329807` {{(pid=71939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 24 16:50:36.480396 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf4ed12e-2127-47dd-8c63-3e5fe1916bc7 admin admin] RBAC: Authorizing `identity:delete_user(user_id=1b0b0975ae13443988f450537e329807)` {{(pid=71939) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:442}} Nov 24 16:50:36.512706 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf4ed12e-2127-47dd-8c63-3e5fe1916bc7 admin admin] RBAC: Authorization granted {{(pid=71939) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 24 16:50:36.590148 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.notifications [None req-bf4ed12e-2127-47dd-8c63-3e5fe1916bc7 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '1b0b0975ae13443988f450537e329807'} {{(pid=71939) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:357}} Nov 24 16:50:36.607159 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.notifications [None req-bf4ed12e-2127-47dd-8c63-3e5fe1916bc7 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '1b0b0975ae13443988f450537e329807'} {{(pid=71939) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:357}} Nov 24 16:50:36.608689 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.notifications [None req-bf4ed12e-2127-47dd-8c63-3e5fe1916bc7 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '1b0b0975ae13443988f450537e329807'} {{(pid=71939) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:357}} Nov 24 16:50:36.620831 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.notifications [None req-bf4ed12e-2127-47dd-8c63-3e5fe1916bc7 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '1b0b0975ae13443988f450537e329807'} {{(pid=71939) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:357}} Nov 24 16:50:36.631968 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.notifications [None req-bf4ed12e-2127-47dd-8c63-3e5fe1916bc7 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '1b0b0975ae13443988f450537e329807'} {{(pid=71939) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:357}} Nov 24 16:50:36.643417 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: [pid: 71939|app: 0|req: 1194/2375] 10.222.0.53 () {58 vars in 1214 bytes} [Wed Nov 24 16:50:36 2021] DELETE /identity/v3/users/1b0b0975ae13443988f450537e329807 => generated 0 bytes in 268 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 24 16:50:36.645523 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0213430-2fc0-47d1-b8e4-6e2961918882 None None] REQUEST_METHOD: `POST` {{(pid=71938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 24 16:50:36.645943 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0213430-2fc0-47d1-b8e4-6e2961918882 None None] SCRIPT_NAME: `/identity` {{(pid=71938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 24 16:50:36.646311 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0213430-2fc0-47d1-b8e4-6e2961918882 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=71938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 24 16:50:36.683801 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.auth.core [None req-b0213430-2fc0-47d1-b8e4-6e2961918882 None None] MFA Rules not processed for user `0f2ba2e8375b4e8c8792ee1e22b60427`. Rule list: `[]` (Enabled: `True`). {{(pid=71938) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:442}} Nov 24 16:50:36.685447 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.fernet_utils [None req-b0213430-2fc0-47d1-b8e4-6e2961918882 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=71938) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:289}} Nov 24 16:50:36.838291 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: [pid: 71938|app: 0|req: 1182/2376] 10.222.0.53 () {58 vars in 948 bytes} [Wed Nov 24 16:50:36 2021] POST /identity/v3/auth/tokens => generated 3669 bytes in 194 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 24 16:50:36.858912 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf4ed12e-2127-47dd-8c63-3e5fe1916bc7 admin admin] Authenticating user token {{(pid=71939) process_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 24 16:50:36.861156 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.fernet_utils [None req-bf4ed12e-2127-47dd-8c63-3e5fe1916bc7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=71939) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:289}} Nov 24 16:50:37.017433 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf4ed12e-2127-47dd-8c63-3e5fe1916bc7 admin admin] Validating token access rules against request {{(pid=71939) validate_allowed_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 24 16:50:37.035758 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-717e6777-985f-41c7-9ec7-d87d85ab48e7 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c90f21b9cdcb413282461fa83cb6b7a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3b3940d4ae1c4177ae29c02377bb4b0b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=71939) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 24 16:50:37.036770 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-717e6777-985f-41c7-9ec7-d87d85ab48e7 service neutron] REQUEST_METHOD: `GET` {{(pid=71939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 24 16:50:37.037114 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-717e6777-985f-41c7-9ec7-d87d85ab48e7 service neutron] SCRIPT_NAME: `/identity` {{(pid=71939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 24 16:50:37.037993 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-717e6777-985f-41c7-9ec7-d87d85ab48e7 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=71939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 24 16:50:37.062478 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-717e6777-985f-41c7-9ec7-d87d85ab48e7 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=71939) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:442}} Nov 24 16:50:37.102809 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-717e6777-985f-41c7-9ec7-d87d85ab48e7 service neutron] RBAC: Authorization granted {{(pid=71939) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 24 16:50:37.116317 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: [pid: 71939|app: 0|req: 1195/2377] 10.222.0.53 () {60 vars in 1356 bytes} [Wed Nov 24 16:50:36 2021] GET /identity/v3/auth/tokens => generated 3669 bytes in 258 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 24 16:50:38.195831 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-723af324-09c6-44e7-85dc-11dbe91557f7 None None] REQUEST_METHOD: `POST` {{(pid=71938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 24 16:50:38.196840 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-723af324-09c6-44e7-85dc-11dbe91557f7 None None] SCRIPT_NAME: `/identity` {{(pid=71938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 24 16:50:38.197380 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-723af324-09c6-44e7-85dc-11dbe91557f7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=71938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 24 16:50:38.264409 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.auth.core [None req-723af324-09c6-44e7-85dc-11dbe91557f7 None None] MFA Rules not processed for user `f8a135ac0e4744a98258dc7f6c12e741`. Rule list: `[]` (Enabled: `True`). {{(pid=71938) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:442}} Nov 24 16:50:38.269060 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.fernet_utils [None req-723af324-09c6-44e7-85dc-11dbe91557f7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=71938) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:289}} Nov 24 16:50:38.452384 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: [pid: 71938|app: 0|req: 1183/2378] 10.222.0.53 () {58 vars in 999 bytes} [Wed Nov 24 16:50:38 2021] POST /identity/v3/auth/tokens => generated 3625 bytes in 258 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 24 16:50:38.470392 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-717e6777-985f-41c7-9ec7-d87d85ab48e7 service neutron] Authenticating user token {{(pid=71939) process_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 24 16:50:38.474005 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.fernet_utils [None req-717e6777-985f-41c7-9ec7-d87d85ab48e7 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=71939) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:289}} Nov 24 16:50:38.652317 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-717e6777-985f-41c7-9ec7-d87d85ab48e7 service neutron] Validating token access rules against request {{(pid=71939) validate_allowed_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 24 16:50:38.665139 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cd737ce-0880-4bda-a6e9-bf7323273f41 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a4cec9543ba4b7da4ecb1e6e8681302', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3b3940d4ae1c4177ae29c02377bb4b0b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=71939) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 24 16:50:38.665823 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cd737ce-0880-4bda-a6e9-bf7323273f41 service swift] REQUEST_METHOD: `GET` {{(pid=71939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 24 16:50:38.666197 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cd737ce-0880-4bda-a6e9-bf7323273f41 service swift] SCRIPT_NAME: `/identity` {{(pid=71939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 24 16:50:38.666534 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cd737ce-0880-4bda-a6e9-bf7323273f41 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=71939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 24 16:50:38.691477 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cd737ce-0880-4bda-a6e9-bf7323273f41 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=71939) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:442}} Nov 24 16:50:38.749302 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cd737ce-0880-4bda-a6e9-bf7323273f41 service swift] RBAC: Authorization granted {{(pid=71939) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 24 16:50:38.775311 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: [pid: 71939|app: 0|req: 1196/2379] 10.222.0.53 () {60 vars in 1375 bytes} [Wed Nov 24 16:50:38 2021] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 305 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Nov 24 16:50:38.943323 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-723af324-09c6-44e7-85dc-11dbe91557f7 None None] Authenticating user token {{(pid=71938) process_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 24 16:50:38.945594 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.fernet_utils [None req-723af324-09c6-44e7-85dc-11dbe91557f7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=71938) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:289}} Nov 24 16:50:38.970039 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-723af324-09c6-44e7-85dc-11dbe91557f7 None None] Validating token access rules against request {{(pid=71938) validate_allowed_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 24 16:50:38.977131 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d029f9c-27a0-46cc-b80a-803cabf5106a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f2ba2e8375b4e8c8792ee1e22b60427', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '00a5583c7b7443e98e7a1d31a0b638dc', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=71938) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 24 16:50:38.978270 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d029f9c-27a0-46cc-b80a-803cabf5106a admin admin] REQUEST_METHOD: `DELETE` {{(pid=71938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 24 16:50:38.978730 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d029f9c-27a0-46cc-b80a-803cabf5106a admin admin] SCRIPT_NAME: `/identity` {{(pid=71938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 24 16:50:38.979199 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d029f9c-27a0-46cc-b80a-803cabf5106a admin admin] PATH_INFO: `/v3/projects/3d11f89faae94503a0224f011a4cb398` {{(pid=71938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 24 16:50:38.980650 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d029f9c-27a0-46cc-b80a-803cabf5106a admin admin] RBAC: Authorizing `identity:delete_project(project_id=3d11f89faae94503a0224f011a4cb398)` {{(pid=71938) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:442}} Nov 24 16:50:39.060539 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d029f9c-27a0-46cc-b80a-803cabf5106a admin admin] RBAC: Authorization granted {{(pid=71938) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 24 16:50:39.198244 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.notifications [None req-0d029f9c-27a0-46cc-b80a-803cabf5106a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '3d11f89faae94503a0224f011a4cb398', 'request_id': 'req-0d029f9c-27a0-46cc-b80a-803cabf5106a'} {{(pid=71938) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:357}} Nov 24 16:50:39.224787 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.notifications [None req-0d029f9c-27a0-46cc-b80a-803cabf5106a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '3d11f89faae94503a0224f011a4cb398', 'request_id': 'req-0d029f9c-27a0-46cc-b80a-803cabf5106a'} {{(pid=71938) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:357}} Nov 24 16:50:39.242819 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.notifications [None req-0d029f9c-27a0-46cc-b80a-803cabf5106a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '3d11f89faae94503a0224f011a4cb398', 'request_id': 'req-0d029f9c-27a0-46cc-b80a-803cabf5106a'} {{(pid=71938) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:357}} Nov 24 16:50:39.269278 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.notifications [None req-0d029f9c-27a0-46cc-b80a-803cabf5106a admin admin] The token cache is being invalidate because project 3d11f89faae94503a0224f011a4cb398 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=71938) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Nov 24 16:50:39.278876 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.notifications [None req-0d029f9c-27a0-46cc-b80a-803cabf5106a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=71938) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:357}} Nov 24 16:50:39.279687 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.notifications [None req-0d029f9c-27a0-46cc-b80a-803cabf5106a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=71938) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:357}} Nov 24 16:50:39.282328 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: [pid: 71938|app: 0|req: 1184/2380] 10.222.0.53 () {58 vars in 1223 bytes} [Wed Nov 24 16:50:38 2021] DELETE /identity/v3/projects/3d11f89faae94503a0224f011a4cb398 => generated 0 bytes in 340 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 24 16:50:39.288596 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b23574a-ba45-40b6-ab7a-8281dce47439 None None] REQUEST_METHOD: `POST` {{(pid=71939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 24 16:50:39.288951 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b23574a-ba45-40b6-ab7a-8281dce47439 None None] SCRIPT_NAME: `/identity` {{(pid=71939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 24 16:50:39.289294 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b23574a-ba45-40b6-ab7a-8281dce47439 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=71939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 24 16:50:39.370985 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.auth.core [None req-2b23574a-ba45-40b6-ab7a-8281dce47439 None None] MFA Rules not processed for user `0f2ba2e8375b4e8c8792ee1e22b60427`. Rule list: `[]` (Enabled: `True`). {{(pid=71939) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:442}} Nov 24 16:50:39.372425 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.fernet_utils [None req-2b23574a-ba45-40b6-ab7a-8281dce47439 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=71939) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:289}} Nov 24 16:50:39.544088 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: [pid: 71939|app: 0|req: 1197/2381] 10.222.0.53 () {58 vars in 948 bytes} [Wed Nov 24 16:50:39 2021] POST /identity/v3/auth/tokens => generated 3669 bytes in 249 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 24 16:50:39.547185 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d7f3269-bccc-41a7-8431-c75c7a7da2aa None None] REQUEST_METHOD: `POST` {{(pid=71938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 24 16:50:39.547185 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d7f3269-bccc-41a7-8431-c75c7a7da2aa None None] SCRIPT_NAME: `/identity` {{(pid=71938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 24 16:50:39.547185 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d7f3269-bccc-41a7-8431-c75c7a7da2aa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=71938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 24 16:50:39.592373 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.auth.core [None req-2d7f3269-bccc-41a7-8431-c75c7a7da2aa None None] MFA Rules not processed for user `0f2ba2e8375b4e8c8792ee1e22b60427`. Rule list: `[]` (Enabled: `True`). {{(pid=71938) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:442}} Nov 24 16:50:39.593662 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.fernet_utils [None req-2d7f3269-bccc-41a7-8431-c75c7a7da2aa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=71938) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:289}} Nov 24 16:50:39.614565 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: [pid: 71938|app: 0|req: 1185/2382] 10.222.0.53 () {58 vars in 948 bytes} [Wed Nov 24 16:50:39 2021] POST /identity/v3/auth/tokens => generated 3669 bytes in 69 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Nov 24 16:50:39.619311 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b23574a-ba45-40b6-ab7a-8281dce47439 None None] Authenticating user token {{(pid=71939) process_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 24 16:50:39.630223 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b23574a-ba45-40b6-ab7a-8281dce47439 None None] Validating token access rules against request {{(pid=71939) validate_allowed_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 24 16:50:39.646056 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1769be69-9439-4cc4-9aa6-1cefa6635e71 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f2ba2e8375b4e8c8792ee1e22b60427', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '00a5583c7b7443e98e7a1d31a0b638dc', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=71939) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 24 16:50:39.646952 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1769be69-9439-4cc4-9aa6-1cefa6635e71 admin admin] REQUEST_METHOD: `GET` {{(pid=71939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 24 16:50:39.647302 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1769be69-9439-4cc4-9aa6-1cefa6635e71 admin admin] SCRIPT_NAME: `/identity` {{(pid=71939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 24 16:50:39.647644 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1769be69-9439-4cc4-9aa6-1cefa6635e71 admin admin] PATH_INFO: `/v3/domains` {{(pid=71939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 24 16:50:39.648462 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1769be69-9439-4cc4-9aa6-1cefa6635e71 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=71939) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:161}} Nov 24 16:50:39.648814 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1769be69-9439-4cc4-9aa6-1cefa6635e71 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=71939) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:442}} Nov 24 16:50:39.712393 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1769be69-9439-4cc4-9aa6-1cefa6635e71 admin admin] RBAC: Authorization granted {{(pid=71939) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 24 16:50:39.752547 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: [pid: 71939|app: 0|req: 1198/2383] 10.222.0.53 () {58 vars in 1143 bytes} [Wed Nov 24 16:50:39 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 130 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Nov 24 16:50:39.753736 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d7f3269-bccc-41a7-8431-c75c7a7da2aa None None] Authenticating user token {{(pid=71938) process_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 24 16:50:39.766305 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d7f3269-bccc-41a7-8431-c75c7a7da2aa None None] Validating token access rules against request {{(pid=71938) validate_allowed_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 24 16:50:39.777322 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d41ab70-e735-41d9-9445-13573c2f0a52 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f2ba2e8375b4e8c8792ee1e22b60427', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '00a5583c7b7443e98e7a1d31a0b638dc', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=71938) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 24 16:50:39.779237 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d41ab70-e735-41d9-9445-13573c2f0a52 admin admin] REQUEST_METHOD: `POST` {{(pid=71938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 24 16:50:39.779782 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d41ab70-e735-41d9-9445-13573c2f0a52 admin admin] SCRIPT_NAME: `/identity` {{(pid=71938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 24 16:50:39.780136 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d41ab70-e735-41d9-9445-13573c2f0a52 admin admin] PATH_INFO: `/v3/projects` {{(pid=71938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 24 16:50:39.780908 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d41ab70-e735-41d9-9445-13573c2f0a52 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=71938) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:442}} Nov 24 16:50:39.814006 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d41ab70-e735-41d9-9445-13573c2f0a52 admin admin] RBAC: Authorization granted {{(pid=71938) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 24 16:50:39.876438 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: [pid: 71938|app: 0|req: 1186/2384] 10.222.0.53 () {60 vars in 1143 bytes} [Wed Nov 24 16:50:39 2021] POST /identity/v3/projects => generated 399 bytes in 123 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 24 16:50:39.881307 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1769be69-9439-4cc4-9aa6-1cefa6635e71 admin admin] Authenticating user token {{(pid=71939) process_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 24 16:50:39.896852 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1769be69-9439-4cc4-9aa6-1cefa6635e71 admin admin] Validating token access rules against request {{(pid=71939) validate_allowed_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 24 16:50:40.010240 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20d1ef04-03ac-47dd-85e5-20da568ecde9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f2ba2e8375b4e8c8792ee1e22b60427', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '00a5583c7b7443e98e7a1d31a0b638dc', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=71939) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 24 16:50:40.011376 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20d1ef04-03ac-47dd-85e5-20da568ecde9 admin admin] REQUEST_METHOD: `POST` {{(pid=71939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 24 16:50:40.012363 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20d1ef04-03ac-47dd-85e5-20da568ecde9 admin admin] SCRIPT_NAME: `/identity` {{(pid=71939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 24 16:50:40.012876 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20d1ef04-03ac-47dd-85e5-20da568ecde9 admin admin] PATH_INFO: `/v3/users` {{(pid=71939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 24 16:50:40.013792 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20d1ef04-03ac-47dd-85e5-20da568ecde9 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=71939) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:442}} Nov 24 16:50:40.095519 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20d1ef04-03ac-47dd-85e5-20da568ecde9 admin admin] RBAC: Authorization granted {{(pid=71939) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 24 16:50:40.139645 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: [pid: 71939|app: 0|req: 1199/2385] 10.222.0.53 () {60 vars in 1134 bytes} [Wed Nov 24 16:50:39 2021] POST /identity/v3/users => generated 300 bytes in 259 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 24 16:50:40.144247 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d41ab70-e735-41d9-9445-13573c2f0a52 admin admin] Authenticating user token {{(pid=71938) process_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 24 16:50:40.268703 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d41ab70-e735-41d9-9445-13573c2f0a52 admin admin] Validating token access rules against request {{(pid=71938) validate_allowed_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 24 16:50:40.287319 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd8b6af6-32d2-499d-90eb-3a141b62cbb0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f2ba2e8375b4e8c8792ee1e22b60427', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '00a5583c7b7443e98e7a1d31a0b638dc', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=71938) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 24 16:50:40.288856 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd8b6af6-32d2-499d-90eb-3a141b62cbb0 admin admin] REQUEST_METHOD: `GET` {{(pid=71938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 24 16:50:40.289435 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd8b6af6-32d2-499d-90eb-3a141b62cbb0 admin admin] SCRIPT_NAME: `/identity` {{(pid=71938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 24 16:50:40.289990 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd8b6af6-32d2-499d-90eb-3a141b62cbb0 admin admin] PATH_INFO: `/v3/roles` {{(pid=71938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 24 16:50:40.291050 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd8b6af6-32d2-499d-90eb-3a141b62cbb0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=71938) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:442}} Nov 24 16:50:40.375783 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd8b6af6-32d2-499d-90eb-3a141b62cbb0 admin admin] RBAC: Authorization granted {{(pid=71938) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 24 16:50:40.426837 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20d1ef04-03ac-47dd-85e5-20da568ecde9 admin admin] Authenticating user token {{(pid=71939) process_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 24 16:50:40.437661 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20d1ef04-03ac-47dd-85e5-20da568ecde9 admin admin] Validating token access rules against request {{(pid=71939) validate_allowed_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 24 16:50:40.444633 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: [pid: 71938|app: 0|req: 1187/2386] 10.222.0.53 () {58 vars in 1112 bytes} [Wed Nov 24 16:50:40 2021] GET /identity/v3/roles => generated 1420 bytes in 299 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 24 16:50:40.464898 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25a38822-cb5b-48ad-a54f-b265e1655033 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f2ba2e8375b4e8c8792ee1e22b60427', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '00a5583c7b7443e98e7a1d31a0b638dc', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=71939) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 24 16:50:40.466172 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25a38822-cb5b-48ad-a54f-b265e1655033 admin admin] REQUEST_METHOD: `PUT` {{(pid=71939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 24 16:50:40.466560 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25a38822-cb5b-48ad-a54f-b265e1655033 admin admin] SCRIPT_NAME: `/identity` {{(pid=71939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 24 16:50:40.467014 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25a38822-cb5b-48ad-a54f-b265e1655033 admin admin] PATH_INFO: `/v3/projects/dc90c24933cd487a811e31d94cc1b064/users/96cf360163c74a83be0e0b9bcd6ba1ad/roles/912ab5f10fa5477da74acf239f07604e` {{(pid=71939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 24 16:50:40.547717 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25a38822-cb5b-48ad-a54f-b265e1655033 admin admin] RBAC: Authorizing `identity:create_grant(project_id=dc90c24933cd487a811e31d94cc1b064, user_id=96cf360163c74a83be0e0b9bcd6ba1ad, role_id=912ab5f10fa5477da74acf239f07604e)` {{(pid=71939) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:442}} Nov 24 16:50:40.607713 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25a38822-cb5b-48ad-a54f-b265e1655033 admin admin] RBAC: Authorization granted {{(pid=71939) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 24 16:50:40.636705 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: [pid: 71939|app: 0|req: 1200/2387] 10.222.0.53 () {60 vars in 1473 bytes} [Wed Nov 24 16:50:40 2021] PUT /identity/v3/projects/dc90c24933cd487a811e31d94cc1b064/users/96cf360163c74a83be0e0b9bcd6ba1ad/roles/912ab5f10fa5477da74acf239f07604e => generated 0 bytes in 211 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 24 16:50:40.648078 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c21630c6-3ed9-40dd-b4a2-118f02a6bb66 None None] REQUEST_METHOD: `POST` {{(pid=71938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 24 16:50:40.648607 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c21630c6-3ed9-40dd-b4a2-118f02a6bb66 None None] SCRIPT_NAME: `/identity` {{(pid=71938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 24 16:50:40.649078 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c21630c6-3ed9-40dd-b4a2-118f02a6bb66 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=71938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 24 16:50:40.740898 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.auth.core [None req-c21630c6-3ed9-40dd-b4a2-118f02a6bb66 None None] MFA Rules not processed for user `96cf360163c74a83be0e0b9bcd6ba1ad`. Rule list: `[]` (Enabled: `True`). {{(pid=71938) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:442}} Nov 24 16:50:40.743043 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.fernet_utils [None req-c21630c6-3ed9-40dd-b4a2-118f02a6bb66 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=71938) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:289}} Nov 24 16:50:40.919206 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: [pid: 71938|app: 0|req: 1188/2388] 10.222.0.53 () {58 vars in 948 bytes} [Wed Nov 24 16:50:40 2021] POST /identity/v3/auth/tokens => generated 3706 bytes in 272 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Nov 24 16:50:40.938571 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25a38822-cb5b-48ad-a54f-b265e1655033 admin admin] Authenticating user token {{(pid=71939) process_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 24 16:50:40.943081 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.fernet_utils [None req-25a38822-cb5b-48ad-a54f-b265e1655033 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=71939) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:289}} Nov 24 16:50:41.427843 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25a38822-cb5b-48ad-a54f-b265e1655033 admin admin] Validating token access rules against request {{(pid=71939) validate_allowed_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 24 16:50:41.443462 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a64ad360-53c1-4475-a02c-7237ab931dbf service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a12374a3093a401a97c343ff0854184d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3b3940d4ae1c4177ae29c02377bb4b0b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=71939) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 24 16:50:41.444420 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a64ad360-53c1-4475-a02c-7237ab931dbf service cinder] REQUEST_METHOD: `GET` {{(pid=71939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 24 16:50:41.444913 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a64ad360-53c1-4475-a02c-7237ab931dbf service cinder] SCRIPT_NAME: `/identity` {{(pid=71939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 24 16:50:41.445415 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a64ad360-53c1-4475-a02c-7237ab931dbf service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=71939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 24 16:50:41.463528 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a64ad360-53c1-4475-a02c-7237ab931dbf service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=71939) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:442}} Nov 24 16:50:41.533414 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a64ad360-53c1-4475-a02c-7237ab931dbf service cinder] RBAC: Authorization granted {{(pid=71939) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 24 16:50:41.568809 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: [pid: 71939|app: 0|req: 1201/2389] 10.222.0.53 () {60 vars in 1356 bytes} [Wed Nov 24 16:50:40 2021] GET /identity/v3/auth/tokens => generated 3706 bytes in 631 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 24 16:50:51.466505 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c21630c6-3ed9-40dd-b4a2-118f02a6bb66 None None] Authenticating user token {{(pid=71938) process_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 24 16:50:51.690947 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c21630c6-3ed9-40dd-b4a2-118f02a6bb66 None None] Validating token access rules against request {{(pid=71938) validate_allowed_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 24 16:50:51.700994 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cb60102-dbe5-409f-82c4-84f18a34d2d9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f2ba2e8375b4e8c8792ee1e22b60427', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '00a5583c7b7443e98e7a1d31a0b638dc', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=71938) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 24 16:50:51.701917 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cb60102-dbe5-409f-82c4-84f18a34d2d9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=71938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 24 16:50:51.702336 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cb60102-dbe5-409f-82c4-84f18a34d2d9 admin admin] SCRIPT_NAME: `/identity` {{(pid=71938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 24 16:50:51.708367 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cb60102-dbe5-409f-82c4-84f18a34d2d9 admin admin] PATH_INFO: `/v3/users/96cf360163c74a83be0e0b9bcd6ba1ad` {{(pid=71938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 24 16:50:51.710367 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cb60102-dbe5-409f-82c4-84f18a34d2d9 admin admin] RBAC: Authorizing `identity:delete_user(user_id=96cf360163c74a83be0e0b9bcd6ba1ad)` {{(pid=71938) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:442}} Nov 24 16:50:51.778127 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cb60102-dbe5-409f-82c4-84f18a34d2d9 admin admin] RBAC: Authorization granted {{(pid=71938) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 24 16:50:51.903127 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.notifications [None req-7cb60102-dbe5-409f-82c4-84f18a34d2d9 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '96cf360163c74a83be0e0b9bcd6ba1ad'} {{(pid=71938) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:357}} Nov 24 16:50:51.928001 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.notifications [None req-7cb60102-dbe5-409f-82c4-84f18a34d2d9 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '96cf360163c74a83be0e0b9bcd6ba1ad'} {{(pid=71938) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:357}} Nov 24 16:50:51.929152 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.notifications [None req-7cb60102-dbe5-409f-82c4-84f18a34d2d9 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '96cf360163c74a83be0e0b9bcd6ba1ad'} {{(pid=71938) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:357}} Nov 24 16:50:51.939880 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.notifications [None req-7cb60102-dbe5-409f-82c4-84f18a34d2d9 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '96cf360163c74a83be0e0b9bcd6ba1ad'} {{(pid=71938) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:357}} Nov 24 16:50:51.951328 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.notifications [None req-7cb60102-dbe5-409f-82c4-84f18a34d2d9 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '96cf360163c74a83be0e0b9bcd6ba1ad'} {{(pid=71938) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:357}} Nov 24 16:50:51.980844 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: [pid: 71938|app: 0|req: 1189/2390] 10.222.0.53 () {58 vars in 1214 bytes} [Wed Nov 24 16:50:51 2021] DELETE /identity/v3/users/96cf360163c74a83be0e0b9bcd6ba1ad => generated 0 bytes in 515 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 24 16:50:51.985849 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9f21efd-b805-4d59-aa60-83521dc14e84 None None] REQUEST_METHOD: `POST` {{(pid=71939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 24 16:50:51.986245 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9f21efd-b805-4d59-aa60-83521dc14e84 None None] SCRIPT_NAME: `/identity` {{(pid=71939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 24 16:50:51.986589 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9f21efd-b805-4d59-aa60-83521dc14e84 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=71939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 24 16:50:52.046880 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.auth.core [None req-b9f21efd-b805-4d59-aa60-83521dc14e84 None None] MFA Rules not processed for user `0f2ba2e8375b4e8c8792ee1e22b60427`. Rule list: `[]` (Enabled: `True`). {{(pid=71939) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:442}} Nov 24 16:50:52.048168 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.fernet_utils [None req-b9f21efd-b805-4d59-aa60-83521dc14e84 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=71939) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:289}} Nov 24 16:50:52.163360 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: [pid: 71939|app: 0|req: 1202/2391] 10.222.0.53 () {58 vars in 948 bytes} [Wed Nov 24 16:50:51 2021] POST /identity/v3/auth/tokens => generated 3669 bytes in 179 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 24 16:50:52.181891 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cb60102-dbe5-409f-82c4-84f18a34d2d9 admin admin] Authenticating user token {{(pid=71938) process_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 24 16:50:52.184114 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.fernet_utils [None req-7cb60102-dbe5-409f-82c4-84f18a34d2d9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=71938) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:289}} Nov 24 16:50:52.356444 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cb60102-dbe5-409f-82c4-84f18a34d2d9 admin admin] Validating token access rules against request {{(pid=71938) validate_allowed_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 24 16:50:52.360323 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c76b6caf-f12a-4b7c-ae62-40cd020d2f6d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c90f21b9cdcb413282461fa83cb6b7a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3b3940d4ae1c4177ae29c02377bb4b0b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=71938) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 24 16:50:52.361788 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c76b6caf-f12a-4b7c-ae62-40cd020d2f6d service neutron] REQUEST_METHOD: `GET` {{(pid=71938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 24 16:50:52.362357 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c76b6caf-f12a-4b7c-ae62-40cd020d2f6d service neutron] SCRIPT_NAME: `/identity` {{(pid=71938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 24 16:50:52.362852 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c76b6caf-f12a-4b7c-ae62-40cd020d2f6d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=71938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 24 16:50:52.377111 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c76b6caf-f12a-4b7c-ae62-40cd020d2f6d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=71938) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:442}} Nov 24 16:50:52.407856 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c76b6caf-f12a-4b7c-ae62-40cd020d2f6d service neutron] RBAC: Authorization granted {{(pid=71938) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 24 16:50:52.419858 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: [pid: 71938|app: 0|req: 1190/2392] 10.222.0.53 () {60 vars in 1356 bytes} [Wed Nov 24 16:50:52 2021] GET /identity/v3/auth/tokens => generated 3669 bytes in 238 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 24 16:50:52.714859 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9f83e57-8e81-4c88-be7c-7eb035f0cc9e None None] REQUEST_METHOD: `POST` {{(pid=71939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 24 16:50:52.715304 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9f83e57-8e81-4c88-be7c-7eb035f0cc9e None None] SCRIPT_NAME: `/identity` {{(pid=71939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 24 16:50:52.715528 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9f83e57-8e81-4c88-be7c-7eb035f0cc9e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=71939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 24 16:50:52.742620 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.auth.core [None req-e9f83e57-8e81-4c88-be7c-7eb035f0cc9e None None] MFA Rules not processed for user `a925d4338c854b828b7417f96e9e04e6`. Rule list: `[]` (Enabled: `True`). {{(pid=71939) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:442}} Nov 24 16:50:52.744368 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.fernet_utils [None req-e9f83e57-8e81-4c88-be7c-7eb035f0cc9e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=71939) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:289}} Nov 24 16:50:52.821349 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: [pid: 71939|app: 0|req: 1203/2393] 10.222.0.53 () {58 vars in 948 bytes} [Wed Nov 24 16:50:52 2021] POST /identity/v3/auth/tokens => generated 3690 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Nov 24 16:50:52.903167 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c76b6caf-f12a-4b7c-ae62-40cd020d2f6d service neutron] Authenticating user token {{(pid=71938) process_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 24 16:50:52.904559 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.fernet_utils [None req-c76b6caf-f12a-4b7c-ae62-40cd020d2f6d service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=71938) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:289}} Nov 24 16:50:52.926253 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c76b6caf-f12a-4b7c-ae62-40cd020d2f6d service neutron] Validating token access rules against request {{(pid=71938) validate_allowed_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 24 16:50:52.926489 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dfa1184-45d9-4164-a698-6a7c540fd12e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f2ba2e8375b4e8c8792ee1e22b60427', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '00a5583c7b7443e98e7a1d31a0b638dc', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=71938) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 24 16:50:52.927988 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dfa1184-45d9-4164-a698-6a7c540fd12e admin admin] REQUEST_METHOD: `DELETE` {{(pid=71938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 24 16:50:52.928246 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dfa1184-45d9-4164-a698-6a7c540fd12e admin admin] SCRIPT_NAME: `/identity` {{(pid=71938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 24 16:50:52.928582 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dfa1184-45d9-4164-a698-6a7c540fd12e admin admin] PATH_INFO: `/v3/projects/dc90c24933cd487a811e31d94cc1b064` {{(pid=71938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 24 16:50:52.929803 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0dfa1184-45d9-4164-a698-6a7c540fd12e admin admin] RBAC: Authorizing `identity:delete_project(project_id=dc90c24933cd487a811e31d94cc1b064)` {{(pid=71938) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:442}} Nov 24 16:50:52.962287 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0dfa1184-45d9-4164-a698-6a7c540fd12e admin admin] RBAC: Authorization granted {{(pid=71938) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 24 16:50:53.034328 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.notifications [None req-0dfa1184-45d9-4164-a698-6a7c540fd12e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'dc90c24933cd487a811e31d94cc1b064', 'request_id': 'req-0dfa1184-45d9-4164-a698-6a7c540fd12e'} {{(pid=71938) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:357}} Nov 24 16:50:53.053330 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.notifications [None req-0dfa1184-45d9-4164-a698-6a7c540fd12e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'dc90c24933cd487a811e31d94cc1b064', 'request_id': 'req-0dfa1184-45d9-4164-a698-6a7c540fd12e'} {{(pid=71938) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:357}} Nov 24 16:50:53.059201 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.notifications [None req-0dfa1184-45d9-4164-a698-6a7c540fd12e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'dc90c24933cd487a811e31d94cc1b064', 'request_id': 'req-0dfa1184-45d9-4164-a698-6a7c540fd12e'} {{(pid=71938) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:357}} Nov 24 16:50:53.073256 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.notifications [None req-0dfa1184-45d9-4164-a698-6a7c540fd12e admin admin] The token cache is being invalidate because project dc90c24933cd487a811e31d94cc1b064 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=71938) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Nov 24 16:50:53.073581 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.notifications [None req-0dfa1184-45d9-4164-a698-6a7c540fd12e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=71938) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:357}} Nov 24 16:50:53.074285 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.notifications [None req-0dfa1184-45d9-4164-a698-6a7c540fd12e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=71938) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:357}} Nov 24 16:50:53.075821 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: [pid: 71938|app: 0|req: 1191/2394] 10.222.0.53 () {58 vars in 1223 bytes} [Wed Nov 24 16:50:52 2021] DELETE /identity/v3/projects/dc90c24933cd487a811e31d94cc1b064 => generated 0 bytes in 173 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 24 16:50:53.083199 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4579bb47-0c6c-4d61-9846-17bba2596c35 None None] REQUEST_METHOD: `POST` {{(pid=71939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 24 16:50:53.083547 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4579bb47-0c6c-4d61-9846-17bba2596c35 None None] SCRIPT_NAME: `/identity` {{(pid=71939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 24 16:50:53.083884 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4579bb47-0c6c-4d61-9846-17bba2596c35 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=71939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 24 16:50:53.110239 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.auth.core [None req-4579bb47-0c6c-4d61-9846-17bba2596c35 None None] MFA Rules not processed for user `0f2ba2e8375b4e8c8792ee1e22b60427`. Rule list: `[]` (Enabled: `True`). {{(pid=71939) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:442}} Nov 24 16:50:53.111492 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.fernet_utils [None req-4579bb47-0c6c-4d61-9846-17bba2596c35 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=71939) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:289}} Nov 24 16:50:53.235176 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: [pid: 71939|app: 0|req: 1204/2395] 10.222.0.53 () {58 vars in 948 bytes} [Wed Nov 24 16:50:53 2021] POST /identity/v3/auth/tokens => generated 3669 bytes in 153 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 24 16:50:53.245698 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e2a689e-6ce3-4d4b-a031-b2cc21b087c7 None None] REQUEST_METHOD: `POST` {{(pid=71938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 24 16:50:53.246010 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e2a689e-6ce3-4d4b-a031-b2cc21b087c7 None None] SCRIPT_NAME: `/identity` {{(pid=71938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 24 16:50:53.246468 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e2a689e-6ce3-4d4b-a031-b2cc21b087c7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=71938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 24 16:50:53.281304 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.auth.core [None req-6e2a689e-6ce3-4d4b-a031-b2cc21b087c7 None None] MFA Rules not processed for user `0f2ba2e8375b4e8c8792ee1e22b60427`. Rule list: `[]` (Enabled: `True`). {{(pid=71938) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:442}} Nov 24 16:50:53.282672 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.fernet_utils [None req-6e2a689e-6ce3-4d4b-a031-b2cc21b087c7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=71938) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:289}} Nov 24 16:50:53.290711 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: [pid: 71938|app: 0|req: 1192/2396] 10.222.0.53 () {58 vars in 948 bytes} [Wed Nov 24 16:50:53 2021] POST /identity/v3/auth/tokens => generated 3669 bytes in 46 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 24 16:50:53.295260 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4579bb47-0c6c-4d61-9846-17bba2596c35 None None] Authenticating user token {{(pid=71939) process_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 24 16:50:53.307044 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4579bb47-0c6c-4d61-9846-17bba2596c35 None None] Validating token access rules against request {{(pid=71939) validate_allowed_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 24 16:50:53.312662 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-678c84a7-ce82-4a78-8a33-418d9d4358b4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f2ba2e8375b4e8c8792ee1e22b60427', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '00a5583c7b7443e98e7a1d31a0b638dc', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=71939) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 24 16:50:53.313704 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-678c84a7-ce82-4a78-8a33-418d9d4358b4 admin admin] REQUEST_METHOD: `GET` {{(pid=71939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 24 16:50:53.314320 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-678c84a7-ce82-4a78-8a33-418d9d4358b4 admin admin] SCRIPT_NAME: `/identity` {{(pid=71939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 24 16:50:53.314868 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-678c84a7-ce82-4a78-8a33-418d9d4358b4 admin admin] PATH_INFO: `/v3/domains` {{(pid=71939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 24 16:50:53.316847 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-678c84a7-ce82-4a78-8a33-418d9d4358b4 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=71939) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:161}} Nov 24 16:50:53.317435 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-678c84a7-ce82-4a78-8a33-418d9d4358b4 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=71939) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:442}} Nov 24 16:50:53.349124 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-678c84a7-ce82-4a78-8a33-418d9d4358b4 admin admin] RBAC: Authorization granted {{(pid=71939) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 24 16:50:53.368535 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: [pid: 71939|app: 0|req: 1205/2397] 10.222.0.53 () {58 vars in 1143 bytes} [Wed Nov 24 16:50:53 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 74 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 24 16:50:53.373388 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e2a689e-6ce3-4d4b-a031-b2cc21b087c7 None None] Authenticating user token {{(pid=71938) process_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 24 16:50:53.384205 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e2a689e-6ce3-4d4b-a031-b2cc21b087c7 None None] Validating token access rules against request {{(pid=71938) validate_allowed_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 24 16:50:53.402413 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53c8338f-d900-4d6c-b1a9-92a44fc18fa3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f2ba2e8375b4e8c8792ee1e22b60427', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '00a5583c7b7443e98e7a1d31a0b638dc', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=71938) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 24 16:50:53.403132 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53c8338f-d900-4d6c-b1a9-92a44fc18fa3 admin admin] REQUEST_METHOD: `POST` {{(pid=71938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 24 16:50:53.403472 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53c8338f-d900-4d6c-b1a9-92a44fc18fa3 admin admin] SCRIPT_NAME: `/identity` {{(pid=71938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 24 16:50:53.403807 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53c8338f-d900-4d6c-b1a9-92a44fc18fa3 admin admin] PATH_INFO: `/v3/projects` {{(pid=71938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 24 16:50:53.406371 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53c8338f-d900-4d6c-b1a9-92a44fc18fa3 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=71938) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:442}} Nov 24 16:50:53.469534 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53c8338f-d900-4d6c-b1a9-92a44fc18fa3 admin admin] RBAC: Authorization granted {{(pid=71938) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 24 16:50:53.541631 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: [pid: 71938|app: 0|req: 1193/2398] 10.222.0.53 () {60 vars in 1143 bytes} [Wed Nov 24 16:50:53 2021] POST /identity/v3/projects => generated 379 bytes in 169 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 24 16:50:53.547578 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-678c84a7-ce82-4a78-8a33-418d9d4358b4 admin admin] Authenticating user token {{(pid=71939) process_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 24 16:50:53.567826 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-678c84a7-ce82-4a78-8a33-418d9d4358b4 admin admin] Validating token access rules against request {{(pid=71939) validate_allowed_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 24 16:50:53.667419 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b231b8d6-1c30-43e8-8362-931f9c336799 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f2ba2e8375b4e8c8792ee1e22b60427', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '00a5583c7b7443e98e7a1d31a0b638dc', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=71939) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 24 16:50:53.670628 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b231b8d6-1c30-43e8-8362-931f9c336799 admin admin] REQUEST_METHOD: `POST` {{(pid=71939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 24 16:50:53.676884 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b231b8d6-1c30-43e8-8362-931f9c336799 admin admin] SCRIPT_NAME: `/identity` {{(pid=71939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 24 16:50:53.677554 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b231b8d6-1c30-43e8-8362-931f9c336799 admin admin] PATH_INFO: `/v3/users` {{(pid=71939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 24 16:50:53.678932 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b231b8d6-1c30-43e8-8362-931f9c336799 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=71939) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:442}} Nov 24 16:50:53.721325 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b231b8d6-1c30-43e8-8362-931f9c336799 admin admin] RBAC: Authorization granted {{(pid=71939) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 24 16:50:53.773780 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: [pid: 71939|app: 0|req: 1206/2399] 10.222.0.53 () {60 vars in 1134 bytes} [Wed Nov 24 16:50:53 2021] POST /identity/v3/users => generated 290 bytes in 227 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 24 16:50:53.777843 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53c8338f-d900-4d6c-b1a9-92a44fc18fa3 admin admin] Authenticating user token {{(pid=71938) process_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 24 16:50:53.793572 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53c8338f-d900-4d6c-b1a9-92a44fc18fa3 admin admin] Validating token access rules against request {{(pid=71938) validate_allowed_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 24 16:50:53.804720 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79ace8c0-8b91-40f9-812e-e966b37cf5b9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f2ba2e8375b4e8c8792ee1e22b60427', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '00a5583c7b7443e98e7a1d31a0b638dc', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=71938) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 24 16:50:53.805589 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79ace8c0-8b91-40f9-812e-e966b37cf5b9 admin admin] REQUEST_METHOD: `GET` {{(pid=71938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 24 16:50:53.805934 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79ace8c0-8b91-40f9-812e-e966b37cf5b9 admin admin] SCRIPT_NAME: `/identity` {{(pid=71938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 24 16:50:53.806290 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79ace8c0-8b91-40f9-812e-e966b37cf5b9 admin admin] PATH_INFO: `/v3/roles` {{(pid=71938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 24 16:50:53.808376 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79ace8c0-8b91-40f9-812e-e966b37cf5b9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=71938) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:442}} Nov 24 16:50:53.841934 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79ace8c0-8b91-40f9-812e-e966b37cf5b9 admin admin] RBAC: Authorization granted {{(pid=71938) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 24 16:50:53.855597 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: [pid: 71938|app: 0|req: 1194/2400] 10.222.0.53 () {58 vars in 1112 bytes} [Wed Nov 24 16:50:53 2021] GET /identity/v3/roles => generated 1420 bytes in 78 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 24 16:50:53.862465 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b231b8d6-1c30-43e8-8362-931f9c336799 admin admin] Authenticating user token {{(pid=71939) process_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 24 16:50:53.874500 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b231b8d6-1c30-43e8-8362-931f9c336799 admin admin] Validating token access rules against request {{(pid=71939) validate_allowed_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 24 16:50:53.882880 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-428dd919-26d0-4a54-b2e1-dfafcf99663b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f2ba2e8375b4e8c8792ee1e22b60427', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '00a5583c7b7443e98e7a1d31a0b638dc', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=71939) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 24 16:50:53.883720 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-428dd919-26d0-4a54-b2e1-dfafcf99663b admin admin] REQUEST_METHOD: `PUT` {{(pid=71939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 24 16:50:53.884050 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-428dd919-26d0-4a54-b2e1-dfafcf99663b admin admin] SCRIPT_NAME: `/identity` {{(pid=71939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 24 16:50:53.884386 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-428dd919-26d0-4a54-b2e1-dfafcf99663b admin admin] PATH_INFO: `/v3/projects/0c827ebf0e074b438e8481308273611a/users/04f0237a0e8048189ca3c07f1fd8875d/roles/912ab5f10fa5477da74acf239f07604e` {{(pid=71939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 24 16:50:53.912616 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-428dd919-26d0-4a54-b2e1-dfafcf99663b admin admin] RBAC: Authorizing `identity:create_grant(project_id=0c827ebf0e074b438e8481308273611a, user_id=04f0237a0e8048189ca3c07f1fd8875d, role_id=912ab5f10fa5477da74acf239f07604e)` {{(pid=71939) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:442}} Nov 24 16:50:53.950478 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-428dd919-26d0-4a54-b2e1-dfafcf99663b admin admin] RBAC: Authorization granted {{(pid=71939) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 24 16:50:53.966225 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: [pid: 71939|app: 0|req: 1207/2401] 10.222.0.53 () {60 vars in 1473 bytes} [Wed Nov 24 16:50:53 2021] PUT /identity/v3/projects/0c827ebf0e074b438e8481308273611a/users/04f0237a0e8048189ca3c07f1fd8875d/roles/912ab5f10fa5477da74acf239f07604e => generated 0 bytes in 107 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 24 16:50:53.971658 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80837883-2b6a-49c4-96f4-749b053a2867 None None] REQUEST_METHOD: `POST` {{(pid=71938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 24 16:50:53.972001 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80837883-2b6a-49c4-96f4-749b053a2867 None None] SCRIPT_NAME: `/identity` {{(pid=71938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 24 16:50:53.972329 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80837883-2b6a-49c4-96f4-749b053a2867 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=71938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 24 16:50:54.021053 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.auth.core [None req-80837883-2b6a-49c4-96f4-749b053a2867 None None] MFA Rules not processed for user `0f2ba2e8375b4e8c8792ee1e22b60427`. Rule list: `[]` (Enabled: `True`). {{(pid=71938) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:442}} Nov 24 16:50:54.026608 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.fernet_utils [None req-80837883-2b6a-49c4-96f4-749b053a2867 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=71938) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:289}} Nov 24 16:50:54.163180 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: [pid: 71938|app: 0|req: 1195/2402] 10.222.0.53 () {58 vars in 948 bytes} [Wed Nov 24 16:50:53 2021] POST /identity/v3/auth/tokens => generated 3669 bytes in 189 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 24 16:50:54.180513 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-428dd919-26d0-4a54-b2e1-dfafcf99663b admin admin] Authenticating user token {{(pid=71939) process_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 24 16:50:54.182297 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.fernet_utils [None req-428dd919-26d0-4a54-b2e1-dfafcf99663b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=71939) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:289}} Nov 24 16:50:54.333272 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-428dd919-26d0-4a54-b2e1-dfafcf99663b admin admin] Validating token access rules against request {{(pid=71939) validate_allowed_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 24 16:50:54.343787 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04056e40-6175-4646-9015-f967ce5ce06e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c90f21b9cdcb413282461fa83cb6b7a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3b3940d4ae1c4177ae29c02377bb4b0b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=71939) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 24 16:50:54.344608 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04056e40-6175-4646-9015-f967ce5ce06e service neutron] REQUEST_METHOD: `GET` {{(pid=71939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 24 16:50:54.345253 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04056e40-6175-4646-9015-f967ce5ce06e service neutron] SCRIPT_NAME: `/identity` {{(pid=71939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 24 16:50:54.345591 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04056e40-6175-4646-9015-f967ce5ce06e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=71939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 24 16:50:54.387034 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04056e40-6175-4646-9015-f967ce5ce06e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=71939) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:442}} Nov 24 16:50:54.485363 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04056e40-6175-4646-9015-f967ce5ce06e service neutron] RBAC: Authorization granted {{(pid=71939) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 24 16:50:54.499527 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: [pid: 71939|app: 0|req: 1208/2403] 10.222.0.53 () {60 vars in 1356 bytes} [Wed Nov 24 16:50:54 2021] GET /identity/v3/auth/tokens => generated 3669 bytes in 320 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 24 16:50:56.321143 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5092e588-6776-4e9b-8395-36d9f78525a9 None None] REQUEST_METHOD: `POST` {{(pid=71938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 24 16:50:56.322342 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5092e588-6776-4e9b-8395-36d9f78525a9 None None] SCRIPT_NAME: `/identity` {{(pid=71938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 24 16:50:56.322865 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5092e588-6776-4e9b-8395-36d9f78525a9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=71938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 24 16:50:56.357600 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.auth.core [None req-5092e588-6776-4e9b-8395-36d9f78525a9 None None] MFA Rules not processed for user `f8a135ac0e4744a98258dc7f6c12e741`. Rule list: `[]` (Enabled: `True`). {{(pid=71938) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:442}} Nov 24 16:50:56.359720 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.fernet_utils [None req-5092e588-6776-4e9b-8395-36d9f78525a9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=71938) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:289}} Nov 24 16:50:56.448970 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: [pid: 71938|app: 0|req: 1196/2404] 10.222.0.53 () {58 vars in 999 bytes} [Wed Nov 24 16:50:56 2021] POST /identity/v3/auth/tokens => generated 3625 bytes in 131 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 24 16:50:56.464033 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04056e40-6175-4646-9015-f967ce5ce06e service neutron] Authenticating user token {{(pid=71939) process_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 24 16:50:56.465738 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.fernet_utils [None req-04056e40-6175-4646-9015-f967ce5ce06e service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=71939) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:289}} Nov 24 16:50:56.571989 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04056e40-6175-4646-9015-f967ce5ce06e service neutron] Validating token access rules against request {{(pid=71939) validate_allowed_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 24 16:50:56.579616 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2f1d2a7-b8aa-45ca-b3ed-cc84c1848c80 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a4cec9543ba4b7da4ecb1e6e8681302', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3b3940d4ae1c4177ae29c02377bb4b0b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=71939) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 24 16:50:56.580748 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2f1d2a7-b8aa-45ca-b3ed-cc84c1848c80 service swift] REQUEST_METHOD: `GET` {{(pid=71939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 24 16:50:56.581316 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2f1d2a7-b8aa-45ca-b3ed-cc84c1848c80 service swift] SCRIPT_NAME: `/identity` {{(pid=71939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 24 16:50:56.583458 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2f1d2a7-b8aa-45ca-b3ed-cc84c1848c80 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=71939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 24 16:50:56.593935 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2f1d2a7-b8aa-45ca-b3ed-cc84c1848c80 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=71939) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:442}} Nov 24 16:50:56.632718 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2f1d2a7-b8aa-45ca-b3ed-cc84c1848c80 service swift] RBAC: Authorization granted {{(pid=71939) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 24 16:50:56.642896 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: [pid: 71939|app: 0|req: 1209/2405] 10.222.0.53 () {60 vars in 1375 bytes} [Wed Nov 24 16:50:56 2021] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 179 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Nov 24 16:51:05.449649 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd0cda48-4223-44f8-80c3-1ab153ef96fa None None] REQUEST_METHOD: `POST` {{(pid=71938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 24 16:51:05.450182 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd0cda48-4223-44f8-80c3-1ab153ef96fa None None] SCRIPT_NAME: `/identity` {{(pid=71938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 24 16:51:05.452675 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd0cda48-4223-44f8-80c3-1ab153ef96fa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=71938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 24 16:51:05.540141 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.auth.core [None req-dd0cda48-4223-44f8-80c3-1ab153ef96fa None None] MFA Rules not processed for user `04f0237a0e8048189ca3c07f1fd8875d`. Rule list: `[]` (Enabled: `True`). {{(pid=71938) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:442}} Nov 24 16:51:05.541381 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.fernet_utils [None req-dd0cda48-4223-44f8-80c3-1ab153ef96fa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=71938) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:289}} Nov 24 16:51:05.652632 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: [pid: 71938|app: 0|req: 1197/2406] 10.222.0.53 () {58 vars in 948 bytes} [Wed Nov 24 16:51:05 2021] POST /identity/v3/auth/tokens => generated 3686 bytes in 211 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 24 16:51:05.657245 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2f1d2a7-b8aa-45ca-b3ed-cc84c1848c80 service swift] Authenticating user token {{(pid=71939) process_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 24 16:51:05.683384 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2f1d2a7-b8aa-45ca-b3ed-cc84c1848c80 service swift] Validating token access rules against request {{(pid=71939) validate_allowed_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 24 16:51:05.690847 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec58e31e-ed39-4d1d-bdb3-11d975c17bf5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f2ba2e8375b4e8c8792ee1e22b60427', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '00a5583c7b7443e98e7a1d31a0b638dc', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=71939) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 24 16:51:05.692659 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec58e31e-ed39-4d1d-bdb3-11d975c17bf5 admin admin] REQUEST_METHOD: `POST` {{(pid=71939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 24 16:51:05.693376 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec58e31e-ed39-4d1d-bdb3-11d975c17bf5 admin admin] SCRIPT_NAME: `/identity` {{(pid=71939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 24 16:51:05.693870 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec58e31e-ed39-4d1d-bdb3-11d975c17bf5 admin admin] PATH_INFO: `/v3/projects` {{(pid=71939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 24 16:51:05.695015 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec58e31e-ed39-4d1d-bdb3-11d975c17bf5 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=71939) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:442}} Nov 24 16:51:05.736648 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec58e31e-ed39-4d1d-bdb3-11d975c17bf5 admin admin] RBAC: Authorization granted {{(pid=71939) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 24 16:51:05.806089 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: [pid: 71939|app: 0|req: 1210/2407] 10.222.0.53 () {60 vars in 1143 bytes} [Wed Nov 24 16:51:05 2021] POST /identity/v3/projects => generated 377 bytes in 148 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 24 16:51:05.812519 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd0cda48-4223-44f8-80c3-1ab153ef96fa None None] Authenticating user token {{(pid=71938) process_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 24 16:51:05.824744 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd0cda48-4223-44f8-80c3-1ab153ef96fa None None] Validating token access rules against request {{(pid=71938) validate_allowed_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 24 16:51:05.922776 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-075240ae-3a62-47ce-b660-e4e20ce45384 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f2ba2e8375b4e8c8792ee1e22b60427', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '00a5583c7b7443e98e7a1d31a0b638dc', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=71938) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 24 16:51:05.923650 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-075240ae-3a62-47ce-b660-e4e20ce45384 admin admin] REQUEST_METHOD: `POST` {{(pid=71938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 24 16:51:05.924098 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-075240ae-3a62-47ce-b660-e4e20ce45384 admin admin] SCRIPT_NAME: `/identity` {{(pid=71938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 24 16:51:05.924550 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-075240ae-3a62-47ce-b660-e4e20ce45384 admin admin] PATH_INFO: `/v3/users` {{(pid=71938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 24 16:51:05.925411 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-075240ae-3a62-47ce-b660-e4e20ce45384 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=71938) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:442}} Nov 24 16:51:05.976176 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-075240ae-3a62-47ce-b660-e4e20ce45384 admin admin] RBAC: Authorization granted {{(pid=71938) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 24 16:51:06.010143 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: [pid: 71938|app: 0|req: 1198/2408] 10.222.0.53 () {60 vars in 1134 bytes} [Wed Nov 24 16:51:05 2021] POST /identity/v3/users => generated 295 bytes in 202 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 24 16:51:06.013974 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec58e31e-ed39-4d1d-bdb3-11d975c17bf5 admin admin] Authenticating user token {{(pid=71939) process_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 24 16:51:06.029522 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec58e31e-ed39-4d1d-bdb3-11d975c17bf5 admin admin] Validating token access rules against request {{(pid=71939) validate_allowed_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 24 16:51:06.034630 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4421904d-a88a-4f3e-898e-b1ecb707b4d3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f2ba2e8375b4e8c8792ee1e22b60427', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '00a5583c7b7443e98e7a1d31a0b638dc', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=71939) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 24 16:51:06.035533 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4421904d-a88a-4f3e-898e-b1ecb707b4d3 admin admin] REQUEST_METHOD: `GET` {{(pid=71939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 24 16:51:06.036029 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4421904d-a88a-4f3e-898e-b1ecb707b4d3 admin admin] SCRIPT_NAME: `/identity` {{(pid=71939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 24 16:51:06.036530 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4421904d-a88a-4f3e-898e-b1ecb707b4d3 admin admin] PATH_INFO: `/v3/roles` {{(pid=71939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 24 16:51:06.037481 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4421904d-a88a-4f3e-898e-b1ecb707b4d3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=71939) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:442}} Nov 24 16:51:06.083032 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4421904d-a88a-4f3e-898e-b1ecb707b4d3 admin admin] RBAC: Authorization granted {{(pid=71939) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 24 16:51:06.102543 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: [pid: 71939|app: 0|req: 1211/2409] 10.222.0.53 () {58 vars in 1112 bytes} [Wed Nov 24 16:51:06 2021] GET /identity/v3/roles => generated 1420 bytes in 89 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 24 16:51:06.106836 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-075240ae-3a62-47ce-b660-e4e20ce45384 admin admin] Authenticating user token {{(pid=71938) process_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 24 16:51:06.122257 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-075240ae-3a62-47ce-b660-e4e20ce45384 admin admin] Validating token access rules against request {{(pid=71938) validate_allowed_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 24 16:51:06.127577 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8edc6dc0-8ad6-4c0d-ba81-761299342bd5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f2ba2e8375b4e8c8792ee1e22b60427', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '00a5583c7b7443e98e7a1d31a0b638dc', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=71938) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 24 16:51:06.128723 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8edc6dc0-8ad6-4c0d-ba81-761299342bd5 admin admin] REQUEST_METHOD: `PUT` {{(pid=71938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 24 16:51:06.129060 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8edc6dc0-8ad6-4c0d-ba81-761299342bd5 admin admin] SCRIPT_NAME: `/identity` {{(pid=71938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 24 16:51:06.129391 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8edc6dc0-8ad6-4c0d-ba81-761299342bd5 admin admin] PATH_INFO: `/v3/projects/d190cd824bd54c228cfdf49a0e93eddb/users/25c84f2ee3ac443ca0b5d5131c2f8656/roles/5611724e350b41e19921b5961a342582` {{(pid=71938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 24 16:51:06.154102 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8edc6dc0-8ad6-4c0d-ba81-761299342bd5 admin admin] RBAC: Authorizing `identity:create_grant(project_id=d190cd824bd54c228cfdf49a0e93eddb, user_id=25c84f2ee3ac443ca0b5d5131c2f8656, role_id=5611724e350b41e19921b5961a342582)` {{(pid=71938) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:442}} Nov 24 16:51:06.187418 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8edc6dc0-8ad6-4c0d-ba81-761299342bd5 admin admin] RBAC: Authorization granted {{(pid=71938) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 24 16:51:06.202634 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: [pid: 71938|app: 0|req: 1199/2410] 10.222.0.53 () {60 vars in 1473 bytes} [Wed Nov 24 16:51:06 2021] PUT /identity/v3/projects/d190cd824bd54c228cfdf49a0e93eddb/users/25c84f2ee3ac443ca0b5d5131c2f8656/roles/5611724e350b41e19921b5961a342582 => generated 0 bytes in 96 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 24 16:51:06.207826 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4421904d-a88a-4f3e-898e-b1ecb707b4d3 admin admin] Authenticating user token {{(pid=71939) process_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 24 16:51:06.219171 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4421904d-a88a-4f3e-898e-b1ecb707b4d3 admin admin] Validating token access rules against request {{(pid=71939) validate_allowed_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 24 16:51:06.314239 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cd1da46-c081-471e-a233-42a6777d487f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f2ba2e8375b4e8c8792ee1e22b60427', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '00a5583c7b7443e98e7a1d31a0b638dc', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=71939) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 24 16:51:06.314927 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cd1da46-c081-471e-a233-42a6777d487f admin admin] REQUEST_METHOD: `GET` {{(pid=71939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 24 16:51:06.315269 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cd1da46-c081-471e-a233-42a6777d487f admin admin] SCRIPT_NAME: `/identity` {{(pid=71939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 24 16:51:06.315861 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cd1da46-c081-471e-a233-42a6777d487f admin admin] PATH_INFO: `/v3/roles` {{(pid=71939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 24 16:51:06.317260 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cd1da46-c081-471e-a233-42a6777d487f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=71939) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:442}} Nov 24 16:51:06.345869 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cd1da46-c081-471e-a233-42a6777d487f admin admin] RBAC: Authorization granted {{(pid=71939) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 24 16:51:06.359564 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: [pid: 71939|app: 0|req: 1212/2411] 10.222.0.53 () {58 vars in 1112 bytes} [Wed Nov 24 16:51:06 2021] GET /identity/v3/roles => generated 1420 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 24 16:51:06.362350 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8edc6dc0-8ad6-4c0d-ba81-761299342bd5 admin admin] Authenticating user token {{(pid=71938) process_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 24 16:51:06.374248 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8edc6dc0-8ad6-4c0d-ba81-761299342bd5 admin admin] Validating token access rules against request {{(pid=71938) validate_allowed_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 24 16:51:06.380125 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19da72f9-c121-46ff-aea5-0add3b2bf3ed admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f2ba2e8375b4e8c8792ee1e22b60427', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '00a5583c7b7443e98e7a1d31a0b638dc', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=71938) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 24 16:51:06.381311 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19da72f9-c121-46ff-aea5-0add3b2bf3ed admin admin] REQUEST_METHOD: `PUT` {{(pid=71938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 24 16:51:06.381763 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19da72f9-c121-46ff-aea5-0add3b2bf3ed admin admin] SCRIPT_NAME: `/identity` {{(pid=71938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 24 16:51:06.382200 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19da72f9-c121-46ff-aea5-0add3b2bf3ed admin admin] PATH_INFO: `/v3/projects/d190cd824bd54c228cfdf49a0e93eddb/users/25c84f2ee3ac443ca0b5d5131c2f8656/roles/5611724e350b41e19921b5961a342582` {{(pid=71938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 24 16:51:06.384365 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19da72f9-c121-46ff-aea5-0add3b2bf3ed admin admin] RBAC: Authorizing `identity:create_grant(project_id=d190cd824bd54c228cfdf49a0e93eddb, user_id=25c84f2ee3ac443ca0b5d5131c2f8656, role_id=5611724e350b41e19921b5961a342582)` {{(pid=71938) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:442}} Nov 24 16:51:06.416426 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19da72f9-c121-46ff-aea5-0add3b2bf3ed admin admin] RBAC: Authorization granted {{(pid=71938) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 24 16:51:06.427966 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: [pid: 71938|app: 0|req: 1200/2412] 10.222.0.53 () {60 vars in 1473 bytes} [Wed Nov 24 16:51:06 2021] PUT /identity/v3/projects/d190cd824bd54c228cfdf49a0e93eddb/users/25c84f2ee3ac443ca0b5d5131c2f8656/roles/5611724e350b41e19921b5961a342582 => generated 0 bytes in 66 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 24 16:51:06.432285 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cd1da46-c081-471e-a233-42a6777d487f admin admin] Authenticating user token {{(pid=71939) process_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 24 16:51:06.442810 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cd1da46-c081-471e-a233-42a6777d487f admin admin] Validating token access rules against request {{(pid=71939) validate_allowed_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 24 16:51:06.533195 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa7d3e7a-fc68-4ee7-a95c-c3b484a2a940 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f2ba2e8375b4e8c8792ee1e22b60427', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '00a5583c7b7443e98e7a1d31a0b638dc', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=71939) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 24 16:51:06.534351 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa7d3e7a-fc68-4ee7-a95c-c3b484a2a940 admin admin] REQUEST_METHOD: `GET` {{(pid=71939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 24 16:51:06.534757 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa7d3e7a-fc68-4ee7-a95c-c3b484a2a940 admin admin] SCRIPT_NAME: `/identity` {{(pid=71939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 24 16:51:06.535223 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa7d3e7a-fc68-4ee7-a95c-c3b484a2a940 admin admin] PATH_INFO: `/v3/roles` {{(pid=71939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 24 16:51:06.536132 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa7d3e7a-fc68-4ee7-a95c-c3b484a2a940 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=71939) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:442}} Nov 24 16:51:06.570087 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa7d3e7a-fc68-4ee7-a95c-c3b484a2a940 admin admin] RBAC: Authorization granted {{(pid=71939) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 24 16:51:06.587626 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: [pid: 71939|app: 0|req: 1213/2413] 10.222.0.53 () {58 vars in 1112 bytes} [Wed Nov 24 16:51:06 2021] GET /identity/v3/roles => generated 1420 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 24 16:51:06.594663 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19da72f9-c121-46ff-aea5-0add3b2bf3ed admin admin] Authenticating user token {{(pid=71938) process_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 24 16:51:06.614472 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19da72f9-c121-46ff-aea5-0add3b2bf3ed admin admin] Validating token access rules against request {{(pid=71938) validate_allowed_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 24 16:51:06.627155 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fba40185-daab-4bca-97ed-15f1a1968046 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f2ba2e8375b4e8c8792ee1e22b60427', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '00a5583c7b7443e98e7a1d31a0b638dc', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=71938) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 24 16:51:06.628102 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fba40185-daab-4bca-97ed-15f1a1968046 admin admin] REQUEST_METHOD: `PUT` {{(pid=71938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 24 16:51:06.628470 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fba40185-daab-4bca-97ed-15f1a1968046 admin admin] SCRIPT_NAME: `/identity` {{(pid=71938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 24 16:51:06.629412 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fba40185-daab-4bca-97ed-15f1a1968046 admin admin] PATH_INFO: `/v3/projects/d190cd824bd54c228cfdf49a0e93eddb/users/25c84f2ee3ac443ca0b5d5131c2f8656/roles/912ab5f10fa5477da74acf239f07604e` {{(pid=71938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 24 16:51:06.636765 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fba40185-daab-4bca-97ed-15f1a1968046 admin admin] RBAC: Authorizing `identity:create_grant(project_id=d190cd824bd54c228cfdf49a0e93eddb, user_id=25c84f2ee3ac443ca0b5d5131c2f8656, role_id=912ab5f10fa5477da74acf239f07604e)` {{(pid=71938) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:442}} Nov 24 16:51:06.685926 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fba40185-daab-4bca-97ed-15f1a1968046 admin admin] RBAC: Authorization granted {{(pid=71938) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 24 16:51:06.719685 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: [pid: 71938|app: 0|req: 1201/2414] 10.222.0.53 () {60 vars in 1473 bytes} [Wed Nov 24 16:51:06 2021] PUT /identity/v3/projects/d190cd824bd54c228cfdf49a0e93eddb/users/25c84f2ee3ac443ca0b5d5131c2f8656/roles/912ab5f10fa5477da74acf239f07604e => generated 0 bytes in 127 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Nov 24 16:51:09.367585 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa7d3e7a-fc68-4ee7-a95c-c3b484a2a940 admin admin] Authenticating user token {{(pid=71939) process_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 24 16:51:09.370278 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.fernet_utils [None req-fa7d3e7a-fc68-4ee7-a95c-c3b484a2a940 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=71939) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:289}} Nov 24 16:51:09.535491 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa7d3e7a-fc68-4ee7-a95c-c3b484a2a940 admin admin] Validating token access rules against request {{(pid=71939) validate_allowed_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 24 16:51:09.625944 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0d4cf09-d259-417a-bbe2-583382c6bae7 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a919320c9e2a48d7ba33453b5929d7ee', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3b3940d4ae1c4177ae29c02377bb4b0b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=71939) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 24 16:51:09.626851 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0d4cf09-d259-417a-bbe2-583382c6bae7 service placement] REQUEST_METHOD: `GET` {{(pid=71939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 24 16:51:09.627313 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0d4cf09-d259-417a-bbe2-583382c6bae7 service placement] SCRIPT_NAME: `/identity` {{(pid=71939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 24 16:51:09.627758 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0d4cf09-d259-417a-bbe2-583382c6bae7 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=71939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 24 16:51:09.630534 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.fernet_utils [None req-f0d4cf09-d259-417a-bbe2-583382c6bae7 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=71939) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:289}} Nov 24 16:51:09.647090 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0d4cf09-d259-417a-bbe2-583382c6bae7 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=71939) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:442}} Nov 24 16:51:09.710333 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0d4cf09-d259-417a-bbe2-583382c6bae7 service placement] RBAC: Authorization granted {{(pid=71939) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 24 16:51:09.723511 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: [pid: 71939|app: 0|req: 1214/2415] 10.222.0.53 () {60 vars in 1356 bytes} [Wed Nov 24 16:51:09 2021] GET /identity/v3/auth/tokens => generated 3738 bytes in 356 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 24 16:51:13.913499 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eccbf881-07e3-484e-a0fb-33a80f7ef3b7 None None] REQUEST_METHOD: `GET` {{(pid=71938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 24 16:51:13.914388 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eccbf881-07e3-484e-a0fb-33a80f7ef3b7 None None] SCRIPT_NAME: `/identity` {{(pid=71938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 24 16:51:13.914874 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eccbf881-07e3-484e-a0fb-33a80f7ef3b7 None None] PATH_INFO: `/` {{(pid=71938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 24 16:51:13.917399 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: [pid: 71938|app: 0|req: 1202/2416] 10.222.0.53 () {54 vars in 910 bytes} [Wed Nov 24 16:51:13 2021] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 24 16:51:13.924812 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98412089-7523-4523-a034-d3fae7fcafac None None] REQUEST_METHOD: `POST` {{(pid=71939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 24 16:51:13.926888 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98412089-7523-4523-a034-d3fae7fcafac None None] SCRIPT_NAME: `/identity` {{(pid=71939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 24 16:51:13.927356 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98412089-7523-4523-a034-d3fae7fcafac None None] PATH_INFO: `/v3/auth/tokens` {{(pid=71939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 24 16:51:14.164503 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.auth.core [None req-98412089-7523-4523-a034-d3fae7fcafac None None] MFA Rules not processed for user `c90f21b9cdcb413282461fa83cb6b7a5`. Rule list: `[]` (Enabled: `True`). {{(pid=71939) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:442}} Nov 24 16:51:14.165861 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.fernet_utils [None req-98412089-7523-4523-a034-d3fae7fcafac None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=71939) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:289}} Nov 24 16:51:14.417910 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: [pid: 71939|app: 0|req: 1215/2417] 10.222.0.53 () {58 vars in 1008 bytes} [Wed Nov 24 16:51:13 2021] POST /identity/v3/auth/tokens => generated 3551 bytes in 495 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 24 16:51:14.524630 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eccbf881-07e3-484e-a0fb-33a80f7ef3b7 None None] Authenticating user token {{(pid=71938) process_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 24 16:51:14.547894 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eccbf881-07e3-484e-a0fb-33a80f7ef3b7 None None] Validating token access rules against request {{(pid=71938) validate_allowed_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 24 16:51:14.555285 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5f91de9-8c6f-4273-866c-4b00a09dd43f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c90f21b9cdcb413282461fa83cb6b7a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3b3940d4ae1c4177ae29c02377bb4b0b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=71938) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 24 16:51:14.556085 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5f91de9-8c6f-4273-866c-4b00a09dd43f service neutron] REQUEST_METHOD: `GET` {{(pid=71938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 24 16:51:14.556540 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5f91de9-8c6f-4273-866c-4b00a09dd43f service neutron] SCRIPT_NAME: `/identity` {{(pid=71938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 24 16:51:14.556987 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5f91de9-8c6f-4273-866c-4b00a09dd43f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=71938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 24 16:51:14.579790 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5f91de9-8c6f-4273-866c-4b00a09dd43f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=71938) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:442}} Nov 24 16:51:14.646215 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5f91de9-8c6f-4273-866c-4b00a09dd43f service neutron] RBAC: Authorization granted {{(pid=71938) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 24 16:51:14.669468 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: [pid: 71938|app: 0|req: 1203/2418] 10.222.0.53 () {60 vars in 1356 bytes} [Wed Nov 24 16:51:14 2021] GET /identity/v3/auth/tokens => generated 3551 bytes in 145 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 24 16:51:17.220972 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a46ce11-748c-4513-8548-2ab7c04fa576 None None] REQUEST_METHOD: `POST` {{(pid=71939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 24 16:51:17.221477 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a46ce11-748c-4513-8548-2ab7c04fa576 None None] SCRIPT_NAME: `/identity` {{(pid=71939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 24 16:51:17.221659 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a46ce11-748c-4513-8548-2ab7c04fa576 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=71939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 24 16:51:17.272500 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.auth.core [None req-0a46ce11-748c-4513-8548-2ab7c04fa576 None None] MFA Rules not processed for user `25c84f2ee3ac443ca0b5d5131c2f8656`. Rule list: `[]` (Enabled: `True`). {{(pid=71939) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:442}} Nov 24 16:51:17.273919 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.fernet_utils [None req-0a46ce11-748c-4513-8548-2ab7c04fa576 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=71939) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:289}} Nov 24 16:51:17.392883 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: [pid: 71939|app: 0|req: 1216/2419] 10.222.0.53 () {58 vars in 948 bytes} [Wed Nov 24 16:51:17 2021] POST /identity/v3/auth/tokens => generated 3751 bytes in 173 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 24 16:51:17.405722 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5f91de9-8c6f-4273-866c-4b00a09dd43f service neutron] Authenticating user token {{(pid=71938) process_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 24 16:51:17.407927 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.fernet_utils [None req-e5f91de9-8c6f-4273-866c-4b00a09dd43f service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=71938) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:289}} Nov 24 16:51:17.577568 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5f91de9-8c6f-4273-866c-4b00a09dd43f service neutron] Validating token access rules against request {{(pid=71938) validate_allowed_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 24 16:51:17.584618 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6397e911-bd55-4290-b90e-4c737baddc2b service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e196802d4d5432482b6d2eabc25f74e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3b3940d4ae1c4177ae29c02377bb4b0b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'service', 'ResellerAdmin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=71938) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 24 16:51:17.585290 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6397e911-bd55-4290-b90e-4c737baddc2b service nova] REQUEST_METHOD: `GET` {{(pid=71938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 24 16:51:17.585592 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6397e911-bd55-4290-b90e-4c737baddc2b service nova] SCRIPT_NAME: `/identity` {{(pid=71938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 24 16:51:17.586243 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6397e911-bd55-4290-b90e-4c737baddc2b service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=71938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 24 16:51:17.664910 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6397e911-bd55-4290-b90e-4c737baddc2b service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=71938) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:442}} Nov 24 16:51:17.696341 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6397e911-bd55-4290-b90e-4c737baddc2b service nova] RBAC: Authorization granted {{(pid=71938) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 24 16:51:17.706655 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: [pid: 71938|app: 0|req: 1204/2420] 10.222.0.53 () {60 vars in 1356 bytes} [Wed Nov 24 16:51:17 2021] GET /identity/v3/auth/tokens => generated 3686 bytes in 302 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 24 16:51:21.923049 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bac4bd8-0fb6-4a5e-b6e8-81760a37de6f None None] REQUEST_METHOD: `POST` {{(pid=71939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 24 16:51:21.923548 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bac4bd8-0fb6-4a5e-b6e8-81760a37de6f None None] SCRIPT_NAME: `/identity` {{(pid=71939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 24 16:51:21.923728 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bac4bd8-0fb6-4a5e-b6e8-81760a37de6f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=71939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 24 16:51:21.974500 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.auth.core [None req-9bac4bd8-0fb6-4a5e-b6e8-81760a37de6f None None] MFA Rules not processed for user `f8a135ac0e4744a98258dc7f6c12e741`. Rule list: `[]` (Enabled: `True`). {{(pid=71939) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:442}} Nov 24 16:51:21.975773 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.fernet_utils [None req-9bac4bd8-0fb6-4a5e-b6e8-81760a37de6f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=71939) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:289}} Nov 24 16:51:22.082142 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: [pid: 71939|app: 0|req: 1217/2421] 10.222.0.53 () {58 vars in 999 bytes} [Wed Nov 24 16:51:21 2021] POST /identity/v3/auth/tokens => generated 3625 bytes in 160 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 24 16:51:22.091973 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6397e911-bd55-4290-b90e-4c737baddc2b service nova] Authenticating user token {{(pid=71938) process_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 24 16:51:22.218619 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6397e911-bd55-4290-b90e-4c737baddc2b service nova] Validating token access rules against request {{(pid=71938) validate_allowed_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 24 16:51:22.225285 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64963867-456f-4848-b6a5-7f8218ce547a service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a4cec9543ba4b7da4ecb1e6e8681302', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3b3940d4ae1c4177ae29c02377bb4b0b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=71938) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 24 16:51:22.226705 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64963867-456f-4848-b6a5-7f8218ce547a service swift] REQUEST_METHOD: `GET` {{(pid=71938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 24 16:51:22.227424 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64963867-456f-4848-b6a5-7f8218ce547a service swift] SCRIPT_NAME: `/identity` {{(pid=71938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 24 16:51:22.227932 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64963867-456f-4848-b6a5-7f8218ce547a service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=71938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 24 16:51:22.239817 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64963867-456f-4848-b6a5-7f8218ce547a service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=71938) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:442}} Nov 24 16:51:22.277212 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64963867-456f-4848-b6a5-7f8218ce547a service swift] RBAC: Authorization granted {{(pid=71938) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 24 16:51:22.290404 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: [pid: 71938|app: 0|req: 1205/2422] 10.222.0.53 () {60 vars in 1375 bytes} [Wed Nov 24 16:51:22 2021] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 199 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Nov 24 16:51:41.788459 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c24232c9-909a-4833-8645-de2fa0be1fff None None] REQUEST_METHOD: `POST` {{(pid=71939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 24 16:51:41.789116 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c24232c9-909a-4833-8645-de2fa0be1fff None None] SCRIPT_NAME: `/identity` {{(pid=71939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 24 16:51:41.789116 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c24232c9-909a-4833-8645-de2fa0be1fff None None] PATH_INFO: `/v3/auth/tokens` {{(pid=71939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 24 16:51:41.817981 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.auth.core [None req-c24232c9-909a-4833-8645-de2fa0be1fff None None] MFA Rules not processed for user `04f0237a0e8048189ca3c07f1fd8875d`. Rule list: `[]` (Enabled: `True`). {{(pid=71939) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:442}} Nov 24 16:51:41.819498 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.fernet_utils [None req-c24232c9-909a-4833-8645-de2fa0be1fff None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=71939) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:289}} Nov 24 16:51:41.827052 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: [pid: 71939|app: 0|req: 1218/2423] 10.222.0.53 () {58 vars in 948 bytes} [Wed Nov 24 16:51:41 2021] POST /identity/v3/auth/tokens => generated 3686 bytes in 40 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 24 16:51:45.144845 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb903200-91ad-4f4b-a56e-20dcbd413010 None None] REQUEST_METHOD: `POST` {{(pid=71938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 24 16:51:45.145330 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb903200-91ad-4f4b-a56e-20dcbd413010 None None] SCRIPT_NAME: `/identity` {{(pid=71938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 24 16:51:45.145538 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb903200-91ad-4f4b-a56e-20dcbd413010 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=71938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 24 16:51:45.172080 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.auth.core [None req-cb903200-91ad-4f4b-a56e-20dcbd413010 None None] MFA Rules not processed for user `f8a135ac0e4744a98258dc7f6c12e741`. Rule list: `[]` (Enabled: `True`). {{(pid=71938) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:442}} Nov 24 16:51:45.173366 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.fernet_utils [None req-cb903200-91ad-4f4b-a56e-20dcbd413010 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=71938) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:289}} Nov 24 16:51:45.186525 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: [pid: 71938|app: 0|req: 1206/2424] 10.222.0.53 () {58 vars in 958 bytes} [Wed Nov 24 16:51:45 2021] POST /identity/v3/auth/tokens => generated 3625 bytes in 43 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 24 16:51:45.210929 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c24232c9-909a-4833-8645-de2fa0be1fff None None] Authenticating user token {{(pid=71939) process_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 24 16:51:45.228120 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c24232c9-909a-4833-8645-de2fa0be1fff None None] Validating token access rules against request {{(pid=71939) validate_allowed_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 24 16:51:45.234579 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa1a9795-b2e4-4977-94f3-cf3fe581ccc9 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a4cec9543ba4b7da4ecb1e6e8681302', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3b3940d4ae1c4177ae29c02377bb4b0b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=71939) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 24 16:51:45.235968 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa1a9795-b2e4-4977-94f3-cf3fe581ccc9 service swift] REQUEST_METHOD: `GET` {{(pid=71939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 24 16:51:45.236547 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa1a9795-b2e4-4977-94f3-cf3fe581ccc9 service swift] SCRIPT_NAME: `/identity` {{(pid=71939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 24 16:51:45.237466 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa1a9795-b2e4-4977-94f3-cf3fe581ccc9 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=71939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 24 16:51:45.266367 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa1a9795-b2e4-4977-94f3-cf3fe581ccc9 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=71939) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:442}} Nov 24 16:51:45.301844 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa1a9795-b2e4-4977-94f3-cf3fe581ccc9 service swift] RBAC: Authorization granted {{(pid=71939) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 24 16:51:45.311612 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: [pid: 71939|app: 0|req: 1219/2425] 10.222.0.53 () {60 vars in 1375 bytes} [Wed Nov 24 16:51:45 2021] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 101 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Nov 24 16:51:48.524602 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb903200-91ad-4f4b-a56e-20dcbd413010 None None] Authenticating user token {{(pid=71938) process_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 24 16:51:48.527110 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.fernet_utils [None req-cb903200-91ad-4f4b-a56e-20dcbd413010 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=71938) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:289}} Nov 24 16:51:48.628712 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb903200-91ad-4f4b-a56e-20dcbd413010 None None] Validating token access rules against request {{(pid=71938) validate_allowed_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 24 16:51:48.634594 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b9bc4ea-8419-42d6-9ee3-7f0ad176efd9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f2ba2e8375b4e8c8792ee1e22b60427', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '00a5583c7b7443e98e7a1d31a0b638dc', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=71938) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 24 16:51:48.635576 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b9bc4ea-8419-42d6-9ee3-7f0ad176efd9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=71938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 24 16:51:48.636119 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b9bc4ea-8419-42d6-9ee3-7f0ad176efd9 admin admin] SCRIPT_NAME: `/identity` {{(pid=71938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 24 16:51:48.636601 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b9bc4ea-8419-42d6-9ee3-7f0ad176efd9 admin admin] PATH_INFO: `/v3/users/742ce97f1ebc4fd2a4e1fdc06aeb0edb` {{(pid=71938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 24 16:51:48.638084 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b9bc4ea-8419-42d6-9ee3-7f0ad176efd9 admin admin] RBAC: Authorizing `identity:delete_user(user_id=742ce97f1ebc4fd2a4e1fdc06aeb0edb)` {{(pid=71938) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:442}} Nov 24 16:51:48.671307 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b9bc4ea-8419-42d6-9ee3-7f0ad176efd9 admin admin] RBAC: Authorization granted {{(pid=71938) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 24 16:51:48.726910 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.notifications [None req-9b9bc4ea-8419-42d6-9ee3-7f0ad176efd9 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '742ce97f1ebc4fd2a4e1fdc06aeb0edb'} {{(pid=71938) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:357}} Nov 24 16:51:48.740536 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.notifications [None req-9b9bc4ea-8419-42d6-9ee3-7f0ad176efd9 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '742ce97f1ebc4fd2a4e1fdc06aeb0edb'} {{(pid=71938) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:357}} Nov 24 16:51:48.741734 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.notifications [None req-9b9bc4ea-8419-42d6-9ee3-7f0ad176efd9 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '742ce97f1ebc4fd2a4e1fdc06aeb0edb'} {{(pid=71938) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:357}} Nov 24 16:51:48.753034 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.notifications [None req-9b9bc4ea-8419-42d6-9ee3-7f0ad176efd9 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '742ce97f1ebc4fd2a4e1fdc06aeb0edb'} {{(pid=71938) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:357}} Nov 24 16:51:48.762546 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.notifications [None req-9b9bc4ea-8419-42d6-9ee3-7f0ad176efd9 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '742ce97f1ebc4fd2a4e1fdc06aeb0edb'} {{(pid=71938) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:357}} Nov 24 16:51:48.770055 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: [pid: 71938|app: 0|req: 1207/2426] 10.222.0.53 () {58 vars in 1214 bytes} [Wed Nov 24 16:51:48 2021] DELETE /identity/v3/users/742ce97f1ebc4fd2a4e1fdc06aeb0edb => generated 0 bytes in 246 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 24 16:51:49.728053 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa1a9795-b2e4-4977-94f3-cf3fe581ccc9 service swift] Authenticating user token {{(pid=71939) process_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 24 16:51:49.741288 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa1a9795-b2e4-4977-94f3-cf3fe581ccc9 service swift] Validating token access rules against request {{(pid=71939) validate_allowed_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 24 16:51:49.818381 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-875a11b6-d5b1-4d1c-b8e0-2fb27584937b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f2ba2e8375b4e8c8792ee1e22b60427', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '00a5583c7b7443e98e7a1d31a0b638dc', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=71939) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 24 16:51:49.819266 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-875a11b6-d5b1-4d1c-b8e0-2fb27584937b admin admin] REQUEST_METHOD: `DELETE` {{(pid=71939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 24 16:51:49.820084 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-875a11b6-d5b1-4d1c-b8e0-2fb27584937b admin admin] SCRIPT_NAME: `/identity` {{(pid=71939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 24 16:51:49.820084 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-875a11b6-d5b1-4d1c-b8e0-2fb27584937b admin admin] PATH_INFO: `/v3/projects/ea524ffee5024139848377aa032f1623` {{(pid=71939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 24 16:51:49.821250 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-875a11b6-d5b1-4d1c-b8e0-2fb27584937b admin admin] RBAC: Authorizing `identity:delete_project(project_id=ea524ffee5024139848377aa032f1623)` {{(pid=71939) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:442}} Nov 24 16:51:49.853668 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-875a11b6-d5b1-4d1c-b8e0-2fb27584937b admin admin] RBAC: Authorization granted {{(pid=71939) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 24 16:51:49.915551 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.notifications [None req-875a11b6-d5b1-4d1c-b8e0-2fb27584937b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ea524ffee5024139848377aa032f1623', 'request_id': 'req-875a11b6-d5b1-4d1c-b8e0-2fb27584937b'} {{(pid=71939) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:357}} Nov 24 16:51:49.930545 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.notifications [None req-875a11b6-d5b1-4d1c-b8e0-2fb27584937b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ea524ffee5024139848377aa032f1623', 'request_id': 'req-875a11b6-d5b1-4d1c-b8e0-2fb27584937b'} {{(pid=71939) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:357}} Nov 24 16:51:49.946447 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.notifications [None req-875a11b6-d5b1-4d1c-b8e0-2fb27584937b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ea524ffee5024139848377aa032f1623', 'request_id': 'req-875a11b6-d5b1-4d1c-b8e0-2fb27584937b'} {{(pid=71939) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:357}} Nov 24 16:51:49.957612 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.notifications [None req-875a11b6-d5b1-4d1c-b8e0-2fb27584937b admin admin] The token cache is being invalidate because project ea524ffee5024139848377aa032f1623 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=71939) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Nov 24 16:51:49.957943 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.notifications [None req-875a11b6-d5b1-4d1c-b8e0-2fb27584937b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=71939) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:357}} Nov 24 16:51:49.958697 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.notifications [None req-875a11b6-d5b1-4d1c-b8e0-2fb27584937b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=71939) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:357}} Nov 24 16:51:49.960268 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: [pid: 71939|app: 0|req: 1220/2427] 10.222.0.53 () {58 vars in 1223 bytes} [Wed Nov 24 16:51:49 2021] DELETE /identity/v3/projects/ea524ffee5024139848377aa032f1623 => generated 0 bytes in 233 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 24 16:51:49.966392 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e9df5e9-38dc-430c-8cab-85024ce5168e None None] REQUEST_METHOD: `POST` {{(pid=71938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 24 16:51:49.966741 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e9df5e9-38dc-430c-8cab-85024ce5168e None None] SCRIPT_NAME: `/identity` {{(pid=71938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 24 16:51:49.967077 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e9df5e9-38dc-430c-8cab-85024ce5168e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=71938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 24 16:51:49.991317 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.auth.core [None req-2e9df5e9-38dc-430c-8cab-85024ce5168e None None] MFA Rules not processed for user `0f2ba2e8375b4e8c8792ee1e22b60427`. Rule list: `[]` (Enabled: `True`). {{(pid=71938) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:442}} Nov 24 16:51:49.992746 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.fernet_utils [None req-2e9df5e9-38dc-430c-8cab-85024ce5168e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=71938) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:289}} Nov 24 16:51:50.074001 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: [pid: 71938|app: 0|req: 1208/2428] 10.222.0.53 () {58 vars in 948 bytes} [Wed Nov 24 16:51:49 2021] POST /identity/v3/auth/tokens => generated 3669 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 24 16:51:50.079035 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a40ef955-209c-4f9b-9e9f-67d29a1b618c None None] REQUEST_METHOD: `POST` {{(pid=71939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 24 16:51:50.079388 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a40ef955-209c-4f9b-9e9f-67d29a1b618c None None] SCRIPT_NAME: `/identity` {{(pid=71939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 24 16:51:50.079728 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a40ef955-209c-4f9b-9e9f-67d29a1b618c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=71939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 24 16:51:50.108430 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.auth.core [None req-a40ef955-209c-4f9b-9e9f-67d29a1b618c None None] MFA Rules not processed for user `0f2ba2e8375b4e8c8792ee1e22b60427`. Rule list: `[]` (Enabled: `True`). {{(pid=71939) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:442}} Nov 24 16:51:50.109634 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.fernet_utils [None req-a40ef955-209c-4f9b-9e9f-67d29a1b618c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=71939) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:289}} Nov 24 16:51:50.119097 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: [pid: 71939|app: 0|req: 1221/2429] 10.222.0.53 () {58 vars in 948 bytes} [Wed Nov 24 16:51:50 2021] POST /identity/v3/auth/tokens => generated 3669 bytes in 41 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 24 16:51:50.123323 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e9df5e9-38dc-430c-8cab-85024ce5168e None None] Authenticating user token {{(pid=71938) process_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 24 16:51:50.133179 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e9df5e9-38dc-430c-8cab-85024ce5168e None None] Validating token access rules against request {{(pid=71938) validate_allowed_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 24 16:51:50.138054 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8b06b95-a966-4568-9258-4db6b01d64ed admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f2ba2e8375b4e8c8792ee1e22b60427', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '00a5583c7b7443e98e7a1d31a0b638dc', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=71938) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 24 16:51:50.138741 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8b06b95-a966-4568-9258-4db6b01d64ed admin admin] REQUEST_METHOD: `GET` {{(pid=71938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 24 16:51:50.139082 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8b06b95-a966-4568-9258-4db6b01d64ed admin admin] SCRIPT_NAME: `/identity` {{(pid=71938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 24 16:51:50.139415 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8b06b95-a966-4568-9258-4db6b01d64ed admin admin] PATH_INFO: `/v3/domains` {{(pid=71938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 24 16:51:50.140213 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8b06b95-a966-4568-9258-4db6b01d64ed admin admin] RBAC: Adding query filter params (name=Default) {{(pid=71938) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:161}} Nov 24 16:51:50.140568 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8b06b95-a966-4568-9258-4db6b01d64ed admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=71938) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:442}} Nov 24 16:51:50.169979 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8b06b95-a966-4568-9258-4db6b01d64ed admin admin] RBAC: Authorization granted {{(pid=71938) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 24 16:51:50.185296 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: [pid: 71938|app: 0|req: 1209/2430] 10.222.0.53 () {58 vars in 1143 bytes} [Wed Nov 24 16:51:50 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 62 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 24 16:51:50.190857 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a40ef955-209c-4f9b-9e9f-67d29a1b618c None None] Authenticating user token {{(pid=71939) process_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 24 16:51:50.200234 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a40ef955-209c-4f9b-9e9f-67d29a1b618c None None] Validating token access rules against request {{(pid=71939) validate_allowed_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 24 16:51:50.204931 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22cab899-483f-4b80-b764-53e7aeb9801b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f2ba2e8375b4e8c8792ee1e22b60427', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '00a5583c7b7443e98e7a1d31a0b638dc', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=71939) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 24 16:51:50.206221 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22cab899-483f-4b80-b764-53e7aeb9801b admin admin] REQUEST_METHOD: `POST` {{(pid=71939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 24 16:51:50.206569 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22cab899-483f-4b80-b764-53e7aeb9801b admin admin] SCRIPT_NAME: `/identity` {{(pid=71939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 24 16:51:50.206908 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22cab899-483f-4b80-b764-53e7aeb9801b admin admin] PATH_INFO: `/v3/projects` {{(pid=71939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 24 16:51:50.207655 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22cab899-483f-4b80-b764-53e7aeb9801b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=71939) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:442}} Nov 24 16:51:50.236111 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22cab899-483f-4b80-b764-53e7aeb9801b admin admin] RBAC: Authorization granted {{(pid=71939) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 24 16:51:50.264052 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: [pid: 71939|app: 0|req: 1222/2431] 10.222.0.53 () {60 vars in 1143 bytes} [Wed Nov 24 16:51:50 2021] POST /identity/v3/projects => generated 365 bytes in 75 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 24 16:51:50.269147 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8b06b95-a966-4568-9258-4db6b01d64ed admin admin] Authenticating user token {{(pid=71938) process_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 24 16:51:50.279445 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8b06b95-a966-4568-9258-4db6b01d64ed admin admin] Validating token access rules against request {{(pid=71938) validate_allowed_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 24 16:51:50.349109 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-059955e0-61d4-4be2-a480-e46f4e0814a1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f2ba2e8375b4e8c8792ee1e22b60427', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '00a5583c7b7443e98e7a1d31a0b638dc', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=71938) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 24 16:51:50.349801 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-059955e0-61d4-4be2-a480-e46f4e0814a1 admin admin] REQUEST_METHOD: `POST` {{(pid=71938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 24 16:51:50.350217 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-059955e0-61d4-4be2-a480-e46f4e0814a1 admin admin] SCRIPT_NAME: `/identity` {{(pid=71938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 24 16:51:50.350556 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-059955e0-61d4-4be2-a480-e46f4e0814a1 admin admin] PATH_INFO: `/v3/users` {{(pid=71938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 24 16:51:50.351324 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-059955e0-61d4-4be2-a480-e46f4e0814a1 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=71938) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:442}} Nov 24 16:51:50.381991 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-059955e0-61d4-4be2-a480-e46f4e0814a1 admin admin] RBAC: Authorization granted {{(pid=71938) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 24 16:51:50.404416 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: [pid: 71938|app: 0|req: 1210/2432] 10.222.0.53 () {60 vars in 1134 bytes} [Wed Nov 24 16:51:50 2021] POST /identity/v3/users => generated 283 bytes in 136 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 24 16:51:50.409056 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22cab899-483f-4b80-b764-53e7aeb9801b admin admin] Authenticating user token {{(pid=71939) process_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 24 16:51:50.419916 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22cab899-483f-4b80-b764-53e7aeb9801b admin admin] Validating token access rules against request {{(pid=71939) validate_allowed_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 24 16:51:50.425547 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ef9d5a5-d428-49a6-b3e7-d20e2ca4e486 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f2ba2e8375b4e8c8792ee1e22b60427', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '00a5583c7b7443e98e7a1d31a0b638dc', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=71939) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 24 16:51:50.426353 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ef9d5a5-d428-49a6-b3e7-d20e2ca4e486 admin admin] REQUEST_METHOD: `GET` {{(pid=71939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 24 16:51:50.426769 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ef9d5a5-d428-49a6-b3e7-d20e2ca4e486 admin admin] SCRIPT_NAME: `/identity` {{(pid=71939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 24 16:51:50.427105 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ef9d5a5-d428-49a6-b3e7-d20e2ca4e486 admin admin] PATH_INFO: `/v3/roles` {{(pid=71939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 24 16:51:50.427973 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ef9d5a5-d428-49a6-b3e7-d20e2ca4e486 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=71939) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:442}} Nov 24 16:51:50.459349 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ef9d5a5-d428-49a6-b3e7-d20e2ca4e486 admin admin] RBAC: Authorization granted {{(pid=71939) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 24 16:51:50.476985 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: [pid: 71939|app: 0|req: 1223/2433] 10.222.0.53 () {58 vars in 1112 bytes} [Wed Nov 24 16:51:50 2021] GET /identity/v3/roles => generated 1420 bytes in 69 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 24 16:51:50.477833 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-059955e0-61d4-4be2-a480-e46f4e0814a1 admin admin] Authenticating user token {{(pid=71938) process_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 24 16:51:50.489050 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-059955e0-61d4-4be2-a480-e46f4e0814a1 admin admin] Validating token access rules against request {{(pid=71938) validate_allowed_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 24 16:51:50.493876 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f99ab50-d994-4320-9425-0a3d2f20efbb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f2ba2e8375b4e8c8792ee1e22b60427', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '00a5583c7b7443e98e7a1d31a0b638dc', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=71938) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 24 16:51:50.494861 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f99ab50-d994-4320-9425-0a3d2f20efbb admin admin] REQUEST_METHOD: `PUT` {{(pid=71938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 24 16:51:50.495188 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f99ab50-d994-4320-9425-0a3d2f20efbb admin admin] SCRIPT_NAME: `/identity` {{(pid=71938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 24 16:51:50.495525 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f99ab50-d994-4320-9425-0a3d2f20efbb admin admin] PATH_INFO: `/v3/projects/2baa9491054c446d893a3c57d4e21eec/users/18cb18e29cfd4bf3bee558695031d7f3/roles/912ab5f10fa5477da74acf239f07604e` {{(pid=71938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 24 16:51:50.517668 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f99ab50-d994-4320-9425-0a3d2f20efbb admin admin] RBAC: Authorizing `identity:create_grant(project_id=2baa9491054c446d893a3c57d4e21eec, user_id=18cb18e29cfd4bf3bee558695031d7f3, role_id=912ab5f10fa5477da74acf239f07604e)` {{(pid=71938) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:442}} Nov 24 16:51:50.548496 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f99ab50-d994-4320-9425-0a3d2f20efbb admin admin] RBAC: Authorization granted {{(pid=71938) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 24 16:51:50.561487 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: [pid: 71938|app: 0|req: 1211/2434] 10.222.0.53 () {60 vars in 1473 bytes} [Wed Nov 24 16:51:50 2021] PUT /identity/v3/projects/2baa9491054c446d893a3c57d4e21eec/users/18cb18e29cfd4bf3bee558695031d7f3/roles/912ab5f10fa5477da74acf239f07604e => generated 0 bytes in 84 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 24 16:51:50.572869 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24c52bde-cc61-486a-a4cf-9c8b1de427e1 None None] REQUEST_METHOD: `POST` {{(pid=71939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 24 16:51:50.573218 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24c52bde-cc61-486a-a4cf-9c8b1de427e1 None None] SCRIPT_NAME: `/identity` {{(pid=71939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 24 16:51:50.573556 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24c52bde-cc61-486a-a4cf-9c8b1de427e1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=71939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 24 16:51:50.617116 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.auth.core [None req-24c52bde-cc61-486a-a4cf-9c8b1de427e1 None None] MFA Rules not processed for user `18cb18e29cfd4bf3bee558695031d7f3`. Rule list: `[]` (Enabled: `True`). {{(pid=71939) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:442}} Nov 24 16:51:50.618418 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.fernet_utils [None req-24c52bde-cc61-486a-a4cf-9c8b1de427e1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=71939) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:289}} Nov 24 16:51:50.709246 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: [pid: 71939|app: 0|req: 1224/2435] 10.222.0.53 () {58 vars in 948 bytes} [Wed Nov 24 16:51:50 2021] POST /identity/v3/auth/tokens => generated 3672 bytes in 137 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 24 16:51:50.720693 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f99ab50-d994-4320-9425-0a3d2f20efbb admin admin] Authenticating user token {{(pid=71938) process_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 24 16:51:50.723931 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.fernet_utils [None req-3f99ab50-d994-4320-9425-0a3d2f20efbb admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=71938) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:289}} Nov 24 16:51:50.848694 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f99ab50-d994-4320-9425-0a3d2f20efbb admin admin] Validating token access rules against request {{(pid=71938) validate_allowed_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 24 16:51:50.852637 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-499efa9a-2a9a-4aef-b3d1-833eccca041e service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a12374a3093a401a97c343ff0854184d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3b3940d4ae1c4177ae29c02377bb4b0b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=71938) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 24 16:51:50.853381 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-499efa9a-2a9a-4aef-b3d1-833eccca041e service cinder] REQUEST_METHOD: `GET` {{(pid=71938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 24 16:51:50.853715 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-499efa9a-2a9a-4aef-b3d1-833eccca041e service cinder] SCRIPT_NAME: `/identity` {{(pid=71938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 24 16:51:50.854060 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-499efa9a-2a9a-4aef-b3d1-833eccca041e service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=71938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 24 16:51:50.864512 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-499efa9a-2a9a-4aef-b3d1-833eccca041e service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=71938) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:442}} Nov 24 16:51:50.895037 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-499efa9a-2a9a-4aef-b3d1-833eccca041e service cinder] RBAC: Authorization granted {{(pid=71938) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 24 16:51:50.905502 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: [pid: 71938|app: 0|req: 1212/2436] 10.222.0.53 () {60 vars in 1356 bytes} [Wed Nov 24 16:51:50 2021] GET /identity/v3/auth/tokens => generated 3672 bytes in 185 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 24 16:51:52.994438 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79e5a5c5-d542-46ba-bef0-6be1039cec34 None None] REQUEST_METHOD: `GET` {{(pid=71939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 24 16:51:52.994976 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79e5a5c5-d542-46ba-bef0-6be1039cec34 None None] SCRIPT_NAME: `/identity` {{(pid=71939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 24 16:51:52.995116 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79e5a5c5-d542-46ba-bef0-6be1039cec34 None None] PATH_INFO: `/` {{(pid=71939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 24 16:51:52.996903 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: [pid: 71939|app: 0|req: 1225/2437] 10.222.0.53 () {54 vars in 901 bytes} [Wed Nov 24 16:51:52 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 24 16:51:53.003496 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a58d0e6f-4a11-494f-aa33-ee5e9a0ccc9c None None] REQUEST_METHOD: `POST` {{(pid=71938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 24 16:51:53.003849 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a58d0e6f-4a11-494f-aa33-ee5e9a0ccc9c None None] SCRIPT_NAME: `/identity` {{(pid=71938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 24 16:51:53.004190 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a58d0e6f-4a11-494f-aa33-ee5e9a0ccc9c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=71938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 24 16:51:53.099607 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.auth.core [None req-a58d0e6f-4a11-494f-aa33-ee5e9a0ccc9c None None] MFA Rules not processed for user `a919320c9e2a48d7ba33453b5929d7ee`. Rule list: `[]` (Enabled: `True`). {{(pid=71938) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:442}} Nov 24 16:51:53.100864 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.fernet_utils [None req-a58d0e6f-4a11-494f-aa33-ee5e9a0ccc9c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=71938) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:289}} Nov 24 16:51:53.178303 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: [pid: 71938|app: 0|req: 1213/2438] 10.222.0.53 () {58 vars in 999 bytes} [Wed Nov 24 16:51:53 2021] POST /identity/v3/auth/tokens => generated 3738 bytes in 176 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 24 16:51:53.207712 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79e5a5c5-d542-46ba-bef0-6be1039cec34 None None] Authenticating user token {{(pid=71939) process_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 24 16:51:53.210649 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.fernet_utils [None req-79e5a5c5-d542-46ba-bef0-6be1039cec34 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=71939) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:289}} Nov 24 16:51:53.231572 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79e5a5c5-d542-46ba-bef0-6be1039cec34 None None] Validating token access rules against request {{(pid=71939) validate_allowed_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 24 16:51:53.243181 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c192c974-6067-43c9-ad7b-d669746909bc service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a919320c9e2a48d7ba33453b5929d7ee', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3b3940d4ae1c4177ae29c02377bb4b0b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=71939) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 24 16:51:53.243854 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c192c974-6067-43c9-ad7b-d669746909bc service placement] REQUEST_METHOD: `GET` {{(pid=71939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 24 16:51:53.244189 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c192c974-6067-43c9-ad7b-d669746909bc service placement] SCRIPT_NAME: `/identity` {{(pid=71939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 24 16:51:53.244518 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c192c974-6067-43c9-ad7b-d669746909bc service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=71939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 24 16:51:53.254397 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c192c974-6067-43c9-ad7b-d669746909bc service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=71939) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:442}} Nov 24 16:51:53.283139 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c192c974-6067-43c9-ad7b-d669746909bc service placement] RBAC: Authorization granted {{(pid=71939) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 24 16:51:53.294326 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: [pid: 71939|app: 0|req: 1226/2439] 10.222.0.53 () {60 vars in 1356 bytes} [Wed Nov 24 16:51:53 2021] GET /identity/v3/auth/tokens => generated 3738 bytes in 87 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 24 16:52:09.693876 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a58d0e6f-4a11-494f-aa33-ee5e9a0ccc9c None None] Authenticating user token {{(pid=71938) process_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 24 16:52:09.695465 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.fernet_utils [None req-a58d0e6f-4a11-494f-aa33-ee5e9a0ccc9c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=71938) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:289}} Nov 24 16:52:09.778692 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a58d0e6f-4a11-494f-aa33-ee5e9a0ccc9c None None] Validating token access rules against request {{(pid=71938) validate_allowed_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 24 16:52:09.783950 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-843014bc-3b9d-4821-bfee-5d1400fcf90f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f2ba2e8375b4e8c8792ee1e22b60427', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '00a5583c7b7443e98e7a1d31a0b638dc', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=71938) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 24 16:52:09.784843 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-843014bc-3b9d-4821-bfee-5d1400fcf90f admin admin] REQUEST_METHOD: `DELETE` {{(pid=71938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 24 16:52:09.785186 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-843014bc-3b9d-4821-bfee-5d1400fcf90f admin admin] SCRIPT_NAME: `/identity` {{(pid=71938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 24 16:52:09.785521 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-843014bc-3b9d-4821-bfee-5d1400fcf90f admin admin] PATH_INFO: `/v3/users/04f0237a0e8048189ca3c07f1fd8875d` {{(pid=71938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 24 16:52:09.786769 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-843014bc-3b9d-4821-bfee-5d1400fcf90f admin admin] RBAC: Authorizing `identity:delete_user(user_id=04f0237a0e8048189ca3c07f1fd8875d)` {{(pid=71938) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:442}} Nov 24 16:52:09.819570 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-843014bc-3b9d-4821-bfee-5d1400fcf90f admin admin] RBAC: Authorization granted {{(pid=71938) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 24 16:52:09.873532 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.notifications [None req-843014bc-3b9d-4821-bfee-5d1400fcf90f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '04f0237a0e8048189ca3c07f1fd8875d'} {{(pid=71938) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:357}} Nov 24 16:52:09.887374 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.notifications [None req-843014bc-3b9d-4821-bfee-5d1400fcf90f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '04f0237a0e8048189ca3c07f1fd8875d'} {{(pid=71938) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:357}} Nov 24 16:52:09.888157 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.notifications [None req-843014bc-3b9d-4821-bfee-5d1400fcf90f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '04f0237a0e8048189ca3c07f1fd8875d'} {{(pid=71938) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:357}} Nov 24 16:52:09.901210 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.notifications [None req-843014bc-3b9d-4821-bfee-5d1400fcf90f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '04f0237a0e8048189ca3c07f1fd8875d'} {{(pid=71938) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:357}} Nov 24 16:52:09.907779 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.notifications [None req-843014bc-3b9d-4821-bfee-5d1400fcf90f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '04f0237a0e8048189ca3c07f1fd8875d'} {{(pid=71938) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:357}} Nov 24 16:52:09.914418 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: [pid: 71938|app: 0|req: 1214/2440] 10.222.0.53 () {58 vars in 1214 bytes} [Wed Nov 24 16:52:09 2021] DELETE /identity/v3/users/04f0237a0e8048189ca3c07f1fd8875d => generated 0 bytes in 221 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Nov 24 16:52:10.161705 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c192c974-6067-43c9-ad7b-d669746909bc service placement] Authenticating user token {{(pid=71939) process_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 24 16:52:10.186077 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c192c974-6067-43c9-ad7b-d669746909bc service placement] Validating token access rules against request {{(pid=71939) validate_allowed_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 24 16:52:10.254183 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c18712fd-4784-4990-94e6-6bf4f015d8d5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f2ba2e8375b4e8c8792ee1e22b60427', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '00a5583c7b7443e98e7a1d31a0b638dc', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=71939) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 24 16:52:10.254993 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c18712fd-4784-4990-94e6-6bf4f015d8d5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=71939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 24 16:52:10.255335 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c18712fd-4784-4990-94e6-6bf4f015d8d5 admin admin] SCRIPT_NAME: `/identity` {{(pid=71939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 24 16:52:10.255671 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c18712fd-4784-4990-94e6-6bf4f015d8d5 admin admin] PATH_INFO: `/v3/projects/0c827ebf0e074b438e8481308273611a` {{(pid=71939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 24 16:52:10.256897 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c18712fd-4784-4990-94e6-6bf4f015d8d5 admin admin] RBAC: Authorizing `identity:delete_project(project_id=0c827ebf0e074b438e8481308273611a)` {{(pid=71939) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:442}} Nov 24 16:52:10.285137 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c18712fd-4784-4990-94e6-6bf4f015d8d5 admin admin] RBAC: Authorization granted {{(pid=71939) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 24 16:52:10.340947 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.notifications [None req-c18712fd-4784-4990-94e6-6bf4f015d8d5 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '0c827ebf0e074b438e8481308273611a', 'request_id': 'req-c18712fd-4784-4990-94e6-6bf4f015d8d5'} {{(pid=71939) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:357}} Nov 24 16:52:10.353771 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.notifications [None req-c18712fd-4784-4990-94e6-6bf4f015d8d5 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '0c827ebf0e074b438e8481308273611a', 'request_id': 'req-c18712fd-4784-4990-94e6-6bf4f015d8d5'} {{(pid=71939) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:357}} Nov 24 16:52:10.360090 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.notifications [None req-c18712fd-4784-4990-94e6-6bf4f015d8d5 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '0c827ebf0e074b438e8481308273611a', 'request_id': 'req-c18712fd-4784-4990-94e6-6bf4f015d8d5'} {{(pid=71939) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:357}} Nov 24 16:52:10.371335 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.notifications [None req-c18712fd-4784-4990-94e6-6bf4f015d8d5 admin admin] The token cache is being invalidate because project 0c827ebf0e074b438e8481308273611a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=71939) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Nov 24 16:52:10.371599 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.notifications [None req-c18712fd-4784-4990-94e6-6bf4f015d8d5 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=71939) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:357}} Nov 24 16:52:10.372283 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.notifications [None req-c18712fd-4784-4990-94e6-6bf4f015d8d5 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=71939) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:357}} Nov 24 16:52:10.373887 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: [pid: 71939|app: 0|req: 1227/2441] 10.222.0.53 () {58 vars in 1223 bytes} [Wed Nov 24 16:52:10 2021] DELETE /identity/v3/projects/0c827ebf0e074b438e8481308273611a => generated 0 bytes in 213 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 24 16:52:10.378895 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-843014bc-3b9d-4821-bfee-5d1400fcf90f admin admin] Authenticating user token {{(pid=71938) process_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 24 16:52:10.380423 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.fernet_utils [None req-843014bc-3b9d-4821-bfee-5d1400fcf90f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=71938) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:289}} Nov 24 16:52:10.393810 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-843014bc-3b9d-4821-bfee-5d1400fcf90f admin admin] Validating token access rules against request {{(pid=71938) validate_allowed_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 24 16:52:10.462334 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03bd60a8-b503-4099-acb1-8b40c4c2b4fc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f2ba2e8375b4e8c8792ee1e22b60427', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '00a5583c7b7443e98e7a1d31a0b638dc', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=71938) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 24 16:52:10.463248 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03bd60a8-b503-4099-acb1-8b40c4c2b4fc admin admin] REQUEST_METHOD: `DELETE` {{(pid=71938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 24 16:52:10.463585 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03bd60a8-b503-4099-acb1-8b40c4c2b4fc admin admin] SCRIPT_NAME: `/identity` {{(pid=71938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 24 16:52:10.463924 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03bd60a8-b503-4099-acb1-8b40c4c2b4fc admin admin] PATH_INFO: `/v3/users/25c84f2ee3ac443ca0b5d5131c2f8656` {{(pid=71938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 24 16:52:10.465155 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03bd60a8-b503-4099-acb1-8b40c4c2b4fc admin admin] RBAC: Authorizing `identity:delete_user(user_id=25c84f2ee3ac443ca0b5d5131c2f8656)` {{(pid=71938) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:442}} Nov 24 16:52:10.495019 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03bd60a8-b503-4099-acb1-8b40c4c2b4fc admin admin] RBAC: Authorization granted {{(pid=71938) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 24 16:52:10.552742 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.notifications [None req-03bd60a8-b503-4099-acb1-8b40c4c2b4fc admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '25c84f2ee3ac443ca0b5d5131c2f8656'} {{(pid=71938) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:357}} Nov 24 16:52:10.565477 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.notifications [None req-03bd60a8-b503-4099-acb1-8b40c4c2b4fc admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '25c84f2ee3ac443ca0b5d5131c2f8656'} {{(pid=71938) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:357}} Nov 24 16:52:10.566254 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.notifications [None req-03bd60a8-b503-4099-acb1-8b40c4c2b4fc admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '25c84f2ee3ac443ca0b5d5131c2f8656'} {{(pid=71938) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:357}} Nov 24 16:52:10.574499 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.notifications [None req-03bd60a8-b503-4099-acb1-8b40c4c2b4fc admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '25c84f2ee3ac443ca0b5d5131c2f8656'} {{(pid=71938) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:357}} Nov 24 16:52:10.580615 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.notifications [None req-03bd60a8-b503-4099-acb1-8b40c4c2b4fc admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '25c84f2ee3ac443ca0b5d5131c2f8656'} {{(pid=71938) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:357}} Nov 24 16:52:10.586956 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: [pid: 71938|app: 0|req: 1215/2442] 10.222.0.53 () {58 vars in 1214 bytes} [Wed Nov 24 16:52:10 2021] DELETE /identity/v3/users/25c84f2ee3ac443ca0b5d5131c2f8656 => generated 0 bytes in 209 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 24 16:52:10.835511 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c18712fd-4784-4990-94e6-6bf4f015d8d5 admin admin] Authenticating user token {{(pid=71939) process_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 24 16:52:10.837334 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.fernet_utils [None req-c18712fd-4784-4990-94e6-6bf4f015d8d5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=71939) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:289}} Nov 24 16:52:10.859779 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c18712fd-4784-4990-94e6-6bf4f015d8d5 admin admin] Validating token access rules against request {{(pid=71939) validate_allowed_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 24 16:52:10.931532 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d34f8507-a6cf-472c-9f31-9fa0cf807835 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f2ba2e8375b4e8c8792ee1e22b60427', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '00a5583c7b7443e98e7a1d31a0b638dc', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=71939) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 24 16:52:10.932414 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d34f8507-a6cf-472c-9f31-9fa0cf807835 admin admin] REQUEST_METHOD: `DELETE` {{(pid=71939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 24 16:52:10.932752 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d34f8507-a6cf-472c-9f31-9fa0cf807835 admin admin] SCRIPT_NAME: `/identity` {{(pid=71939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 24 16:52:10.933082 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d34f8507-a6cf-472c-9f31-9fa0cf807835 admin admin] PATH_INFO: `/v3/projects/d190cd824bd54c228cfdf49a0e93eddb` {{(pid=71939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 24 16:52:10.934321 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d34f8507-a6cf-472c-9f31-9fa0cf807835 admin admin] RBAC: Authorizing `identity:delete_project(project_id=d190cd824bd54c228cfdf49a0e93eddb)` {{(pid=71939) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:442}} Nov 24 16:52:10.968175 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d34f8507-a6cf-472c-9f31-9fa0cf807835 admin admin] RBAC: Authorization granted {{(pid=71939) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 24 16:52:11.027980 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.notifications [None req-d34f8507-a6cf-472c-9f31-9fa0cf807835 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd190cd824bd54c228cfdf49a0e93eddb', 'request_id': 'req-d34f8507-a6cf-472c-9f31-9fa0cf807835'} {{(pid=71939) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:357}} Nov 24 16:52:11.040719 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.notifications [None req-d34f8507-a6cf-472c-9f31-9fa0cf807835 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd190cd824bd54c228cfdf49a0e93eddb', 'request_id': 'req-d34f8507-a6cf-472c-9f31-9fa0cf807835'} {{(pid=71939) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:357}} Nov 24 16:52:11.047164 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.notifications [None req-d34f8507-a6cf-472c-9f31-9fa0cf807835 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd190cd824bd54c228cfdf49a0e93eddb', 'request_id': 'req-d34f8507-a6cf-472c-9f31-9fa0cf807835'} {{(pid=71939) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:357}} Nov 24 16:52:11.058683 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.notifications [None req-d34f8507-a6cf-472c-9f31-9fa0cf807835 admin admin] The token cache is being invalidate because project d190cd824bd54c228cfdf49a0e93eddb was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=71939) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Nov 24 16:52:11.059017 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.notifications [None req-d34f8507-a6cf-472c-9f31-9fa0cf807835 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=71939) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:357}} Nov 24 16:52:11.059701 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.notifications [None req-d34f8507-a6cf-472c-9f31-9fa0cf807835 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=71939) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:357}} Nov 24 16:52:11.061267 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: [pid: 71939|app: 0|req: 1228/2443] 10.222.0.53 () {58 vars in 1223 bytes} [Wed Nov 24 16:52:10 2021] DELETE /identity/v3/projects/d190cd824bd54c228cfdf49a0e93eddb => generated 0 bytes in 226 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 24 16:52:29.367692 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03bd60a8-b503-4099-acb1-8b40c4c2b4fc admin admin] Authenticating user token {{(pid=71938) process_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 24 16:52:29.371795 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.fernet_utils [None req-03bd60a8-b503-4099-acb1-8b40c4c2b4fc admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=71938) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:289}} Nov 24 16:52:29.385218 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03bd60a8-b503-4099-acb1-8b40c4c2b4fc admin admin] Validating token access rules against request {{(pid=71938) validate_allowed_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 24 16:52:29.455636 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6daf158e-777b-4365-9858-4d96f010d6f0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f2ba2e8375b4e8c8792ee1e22b60427', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '00a5583c7b7443e98e7a1d31a0b638dc', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=71938) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 24 16:52:29.456470 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6daf158e-777b-4365-9858-4d96f010d6f0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=71938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 24 16:52:29.456811 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6daf158e-777b-4365-9858-4d96f010d6f0 admin admin] SCRIPT_NAME: `/identity` {{(pid=71938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 24 16:52:29.457135 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6daf158e-777b-4365-9858-4d96f010d6f0 admin admin] PATH_INFO: `/v3/users/18cb18e29cfd4bf3bee558695031d7f3` {{(pid=71938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 24 16:52:29.458417 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6daf158e-777b-4365-9858-4d96f010d6f0 admin admin] RBAC: Authorizing `identity:delete_user(user_id=18cb18e29cfd4bf3bee558695031d7f3)` {{(pid=71938) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:442}} Nov 24 16:52:29.487310 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6daf158e-777b-4365-9858-4d96f010d6f0 admin admin] RBAC: Authorization granted {{(pid=71938) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 24 16:52:29.537412 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.notifications [None req-6daf158e-777b-4365-9858-4d96f010d6f0 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '18cb18e29cfd4bf3bee558695031d7f3'} {{(pid=71938) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:357}} Nov 24 16:52:29.550237 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.notifications [None req-6daf158e-777b-4365-9858-4d96f010d6f0 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '18cb18e29cfd4bf3bee558695031d7f3'} {{(pid=71938) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:357}} Nov 24 16:52:29.550949 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.notifications [None req-6daf158e-777b-4365-9858-4d96f010d6f0 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '18cb18e29cfd4bf3bee558695031d7f3'} {{(pid=71938) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:357}} Nov 24 16:52:29.559119 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.notifications [None req-6daf158e-777b-4365-9858-4d96f010d6f0 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '18cb18e29cfd4bf3bee558695031d7f3'} {{(pid=71938) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:357}} Nov 24 16:52:29.565889 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.notifications [None req-6daf158e-777b-4365-9858-4d96f010d6f0 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '18cb18e29cfd4bf3bee558695031d7f3'} {{(pid=71938) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:357}} Nov 24 16:52:29.572310 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: [pid: 71938|app: 0|req: 1216/2444] 10.222.0.53 () {58 vars in 1214 bytes} [Wed Nov 24 16:52:29 2021] DELETE /identity/v3/users/18cb18e29cfd4bf3bee558695031d7f3 => generated 0 bytes in 205 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 24 16:52:29.577430 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcc187e4-8e7b-4fdd-b7c6-c7a4e46f44d0 None None] REQUEST_METHOD: `POST` {{(pid=71939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 24 16:52:29.577781 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcc187e4-8e7b-4fdd-b7c6-c7a4e46f44d0 None None] SCRIPT_NAME: `/identity` {{(pid=71939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 24 16:52:29.578163 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcc187e4-8e7b-4fdd-b7c6-c7a4e46f44d0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=71939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 24 16:52:29.600883 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.auth.core [None req-fcc187e4-8e7b-4fdd-b7c6-c7a4e46f44d0 None None] MFA Rules not processed for user `0f2ba2e8375b4e8c8792ee1e22b60427`. Rule list: `[]` (Enabled: `True`). {{(pid=71939) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:442}} Nov 24 16:52:29.602139 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.fernet_utils [None req-fcc187e4-8e7b-4fdd-b7c6-c7a4e46f44d0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=71939) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:289}} Nov 24 16:52:29.672796 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: [pid: 71939|app: 0|req: 1229/2445] 10.222.0.53 () {58 vars in 948 bytes} [Wed Nov 24 16:52:29 2021] POST /identity/v3/auth/tokens => generated 3669 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 24 16:52:29.684784 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6daf158e-777b-4365-9858-4d96f010d6f0 admin admin] Authenticating user token {{(pid=71938) process_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 24 16:52:29.686441 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.fernet_utils [None req-6daf158e-777b-4365-9858-4d96f010d6f0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=71938) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:289}} Nov 24 16:52:29.758662 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6daf158e-777b-4365-9858-4d96f010d6f0 admin admin] Validating token access rules against request {{(pid=71938) validate_allowed_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 24 16:52:29.762805 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-836c47f5-51cc-485f-a4b9-371692fed9ee service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c90f21b9cdcb413282461fa83cb6b7a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3b3940d4ae1c4177ae29c02377bb4b0b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=71938) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 24 16:52:29.763555 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-836c47f5-51cc-485f-a4b9-371692fed9ee service neutron] REQUEST_METHOD: `GET` {{(pid=71938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 24 16:52:29.763952 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-836c47f5-51cc-485f-a4b9-371692fed9ee service neutron] SCRIPT_NAME: `/identity` {{(pid=71938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 24 16:52:29.764352 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-836c47f5-51cc-485f-a4b9-371692fed9ee service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=71938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 24 16:52:29.774714 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-836c47f5-51cc-485f-a4b9-371692fed9ee service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=71938) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:442}} Nov 24 16:52:29.804119 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-836c47f5-51cc-485f-a4b9-371692fed9ee service neutron] RBAC: Authorization granted {{(pid=71938) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 24 16:52:29.815940 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: [pid: 71938|app: 0|req: 1217/2446] 10.222.0.53 () {60 vars in 1356 bytes} [Wed Nov 24 16:52:29 2021] GET /identity/v3/auth/tokens => generated 3669 bytes in 132 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 24 16:52:30.185771 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcc187e4-8e7b-4fdd-b7c6-c7a4e46f44d0 None None] Authenticating user token {{(pid=71939) process_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 24 16:52:30.187291 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.fernet_utils [None req-fcc187e4-8e7b-4fdd-b7c6-c7a4e46f44d0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=71939) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:289}} Nov 24 16:52:30.200305 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcc187e4-8e7b-4fdd-b7c6-c7a4e46f44d0 None None] Validating token access rules against request {{(pid=71939) validate_allowed_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 24 16:52:30.206110 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c7b9477-4f25-4018-aa03-2f462e22b8ae admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f2ba2e8375b4e8c8792ee1e22b60427', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '00a5583c7b7443e98e7a1d31a0b638dc', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=71939) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 24 16:52:30.207033 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c7b9477-4f25-4018-aa03-2f462e22b8ae admin admin] REQUEST_METHOD: `DELETE` {{(pid=71939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 24 16:52:30.207444 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c7b9477-4f25-4018-aa03-2f462e22b8ae admin admin] SCRIPT_NAME: `/identity` {{(pid=71939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 24 16:52:30.207846 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c7b9477-4f25-4018-aa03-2f462e22b8ae admin admin] PATH_INFO: `/v3/projects/2baa9491054c446d893a3c57d4e21eec` {{(pid=71939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 24 16:52:30.209141 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c7b9477-4f25-4018-aa03-2f462e22b8ae admin admin] RBAC: Authorizing `identity:delete_project(project_id=2baa9491054c446d893a3c57d4e21eec)` {{(pid=71939) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:442}} Nov 24 16:52:30.238708 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c7b9477-4f25-4018-aa03-2f462e22b8ae admin admin] RBAC: Authorization granted {{(pid=71939) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 24 16:52:30.291917 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.notifications [None req-7c7b9477-4f25-4018-aa03-2f462e22b8ae admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '2baa9491054c446d893a3c57d4e21eec', 'request_id': 'req-7c7b9477-4f25-4018-aa03-2f462e22b8ae'} {{(pid=71939) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:357}} Nov 24 16:52:30.304288 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.notifications [None req-7c7b9477-4f25-4018-aa03-2f462e22b8ae admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '2baa9491054c446d893a3c57d4e21eec', 'request_id': 'req-7c7b9477-4f25-4018-aa03-2f462e22b8ae'} {{(pid=71939) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:357}} Nov 24 16:52:30.310554 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.notifications [None req-7c7b9477-4f25-4018-aa03-2f462e22b8ae admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '2baa9491054c446d893a3c57d4e21eec', 'request_id': 'req-7c7b9477-4f25-4018-aa03-2f462e22b8ae'} {{(pid=71939) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:357}} Nov 24 16:52:30.322169 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.notifications [None req-7c7b9477-4f25-4018-aa03-2f462e22b8ae admin admin] The token cache is being invalidate because project 2baa9491054c446d893a3c57d4e21eec was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=71939) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Nov 24 16:52:30.322449 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.notifications [None req-7c7b9477-4f25-4018-aa03-2f462e22b8ae admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=71939) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:357}} Nov 24 16:52:30.323138 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.notifications [None req-7c7b9477-4f25-4018-aa03-2f462e22b8ae admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=71939) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:357}} Nov 24 16:52:30.324706 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: [pid: 71939|app: 0|req: 1230/2447] 10.222.0.53 () {58 vars in 1223 bytes} [Wed Nov 24 16:52:30 2021] DELETE /identity/v3/projects/2baa9491054c446d893a3c57d4e21eec => generated 0 bytes in 140 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 24 16:52:30.331572 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c0fde90-128f-4328-a3f8-cd667c9eac5d None None] REQUEST_METHOD: `POST` {{(pid=71938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 24 16:52:30.331921 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c0fde90-128f-4328-a3f8-cd667c9eac5d None None] SCRIPT_NAME: `/identity` {{(pid=71938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 24 16:52:30.332292 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c0fde90-128f-4328-a3f8-cd667c9eac5d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=71938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 24 16:52:30.356120 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.auth.core [None req-1c0fde90-128f-4328-a3f8-cd667c9eac5d None None] MFA Rules not processed for user `0f2ba2e8375b4e8c8792ee1e22b60427`. Rule list: `[]` (Enabled: `True`). {{(pid=71938) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:442}} Nov 24 16:52:30.357324 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.fernet_utils [None req-1c0fde90-128f-4328-a3f8-cd667c9eac5d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=71938) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:289}} Nov 24 16:52:30.427359 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: [pid: 71938|app: 0|req: 1218/2448] 10.222.0.53 () {58 vars in 948 bytes} [Wed Nov 24 16:52:30 2021] POST /identity/v3/auth/tokens => generated 3669 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 24 16:52:30.435967 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0df6a2ce-35b9-4e97-897f-dddfe5721599 None None] REQUEST_METHOD: `POST` {{(pid=71939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 24 16:52:30.436395 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0df6a2ce-35b9-4e97-897f-dddfe5721599 None None] SCRIPT_NAME: `/identity` {{(pid=71939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 24 16:52:30.436788 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0df6a2ce-35b9-4e97-897f-dddfe5721599 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=71939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 24 16:52:30.462696 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.auth.core [None req-0df6a2ce-35b9-4e97-897f-dddfe5721599 None None] MFA Rules not processed for user `0f2ba2e8375b4e8c8792ee1e22b60427`. Rule list: `[]` (Enabled: `True`). {{(pid=71939) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:442}} Nov 24 16:52:30.464020 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.fernet_utils [None req-0df6a2ce-35b9-4e97-897f-dddfe5721599 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=71939) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:289}} Nov 24 16:52:30.473282 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: [pid: 71939|app: 0|req: 1231/2449] 10.222.0.53 () {58 vars in 948 bytes} [Wed Nov 24 16:52:30 2021] POST /identity/v3/auth/tokens => generated 3669 bytes in 39 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Nov 24 16:52:30.478796 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c0fde90-128f-4328-a3f8-cd667c9eac5d None None] Authenticating user token {{(pid=71938) process_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 24 16:52:30.489496 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c0fde90-128f-4328-a3f8-cd667c9eac5d None None] Validating token access rules against request {{(pid=71938) validate_allowed_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 24 16:52:30.494170 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18289328-7a3d-4539-9dff-3395b8a7f8df admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f2ba2e8375b4e8c8792ee1e22b60427', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '00a5583c7b7443e98e7a1d31a0b638dc', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=71938) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 24 16:52:30.494884 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18289328-7a3d-4539-9dff-3395b8a7f8df admin admin] REQUEST_METHOD: `GET` {{(pid=71938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 24 16:52:30.495230 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18289328-7a3d-4539-9dff-3395b8a7f8df admin admin] SCRIPT_NAME: `/identity` {{(pid=71938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 24 16:52:30.495567 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18289328-7a3d-4539-9dff-3395b8a7f8df admin admin] PATH_INFO: `/v3/domains` {{(pid=71938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 24 16:52:30.496403 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18289328-7a3d-4539-9dff-3395b8a7f8df admin admin] RBAC: Adding query filter params (name=Default) {{(pid=71938) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:161}} Nov 24 16:52:30.496759 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18289328-7a3d-4539-9dff-3395b8a7f8df admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=71938) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:442}} Nov 24 16:52:30.525500 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18289328-7a3d-4539-9dff-3395b8a7f8df admin admin] RBAC: Authorization granted {{(pid=71938) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 24 16:52:30.539876 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: [pid: 71938|app: 0|req: 1219/2450] 10.222.0.53 () {58 vars in 1143 bytes} [Wed Nov 24 16:52:30 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 61 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 24 16:52:30.543790 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0df6a2ce-35b9-4e97-897f-dddfe5721599 None None] Authenticating user token {{(pid=71939) process_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 24 16:52:30.553813 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0df6a2ce-35b9-4e97-897f-dddfe5721599 None None] Validating token access rules against request {{(pid=71939) validate_allowed_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 24 16:52:30.558559 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f56b182-e8ec-405e-b14e-78b7080839f6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f2ba2e8375b4e8c8792ee1e22b60427', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '00a5583c7b7443e98e7a1d31a0b638dc', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=71939) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 24 16:52:30.559223 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f56b182-e8ec-405e-b14e-78b7080839f6 admin admin] REQUEST_METHOD: `POST` {{(pid=71939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 24 16:52:30.559568 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f56b182-e8ec-405e-b14e-78b7080839f6 admin admin] SCRIPT_NAME: `/identity` {{(pid=71939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 24 16:52:30.559901 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f56b182-e8ec-405e-b14e-78b7080839f6 admin admin] PATH_INFO: `/v3/projects` {{(pid=71939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 24 16:52:30.560633 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f56b182-e8ec-405e-b14e-78b7080839f6 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=71939) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:442}} Nov 24 16:52:30.589836 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f56b182-e8ec-405e-b14e-78b7080839f6 admin admin] RBAC: Authorization granted {{(pid=71939) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 24 16:52:30.618112 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: [pid: 71939|app: 0|req: 1232/2451] 10.222.0.53 () {60 vars in 1143 bytes} [Wed Nov 24 16:52:30 2021] POST /identity/v3/projects => generated 375 bytes in 75 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 24 16:52:30.622751 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18289328-7a3d-4539-9dff-3395b8a7f8df admin admin] Authenticating user token {{(pid=71938) process_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 24 16:52:30.633272 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18289328-7a3d-4539-9dff-3395b8a7f8df admin admin] Validating token access rules against request {{(pid=71938) validate_allowed_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 24 16:52:30.699566 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f3e1f0b-96fd-4c62-945a-01c62bb3e04f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f2ba2e8375b4e8c8792ee1e22b60427', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '00a5583c7b7443e98e7a1d31a0b638dc', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=71938) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 24 16:52:30.700244 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f3e1f0b-96fd-4c62-945a-01c62bb3e04f admin admin] REQUEST_METHOD: `POST` {{(pid=71938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 24 16:52:30.700583 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f3e1f0b-96fd-4c62-945a-01c62bb3e04f admin admin] SCRIPT_NAME: `/identity` {{(pid=71938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 24 16:52:30.700915 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f3e1f0b-96fd-4c62-945a-01c62bb3e04f admin admin] PATH_INFO: `/v3/users` {{(pid=71938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 24 16:52:30.701644 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f3e1f0b-96fd-4c62-945a-01c62bb3e04f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=71938) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:442}} Nov 24 16:52:30.735221 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f3e1f0b-96fd-4c62-945a-01c62bb3e04f admin admin] RBAC: Authorization granted {{(pid=71938) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 24 16:52:30.757121 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: [pid: 71938|app: 0|req: 1220/2452] 10.222.0.53 () {60 vars in 1134 bytes} [Wed Nov 24 16:52:30 2021] POST /identity/v3/users => generated 288 bytes in 135 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 24 16:52:30.761675 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f56b182-e8ec-405e-b14e-78b7080839f6 admin admin] Authenticating user token {{(pid=71939) process_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 24 16:52:30.772410 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f56b182-e8ec-405e-b14e-78b7080839f6 admin admin] Validating token access rules against request {{(pid=71939) validate_allowed_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 24 16:52:30.776990 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a81a018d-f88a-4521-bd30-24cf69317b5f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f2ba2e8375b4e8c8792ee1e22b60427', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '00a5583c7b7443e98e7a1d31a0b638dc', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=71939) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 24 16:52:30.777927 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a81a018d-f88a-4521-bd30-24cf69317b5f admin admin] REQUEST_METHOD: `GET` {{(pid=71939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 24 16:52:30.778203 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a81a018d-f88a-4521-bd30-24cf69317b5f admin admin] SCRIPT_NAME: `/identity` {{(pid=71939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 24 16:52:30.778316 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a81a018d-f88a-4521-bd30-24cf69317b5f admin admin] PATH_INFO: `/v3/roles` {{(pid=71939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 24 16:52:30.779091 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a81a018d-f88a-4521-bd30-24cf69317b5f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=71939) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:442}} Nov 24 16:52:30.809465 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a81a018d-f88a-4521-bd30-24cf69317b5f admin admin] RBAC: Authorization granted {{(pid=71939) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 24 16:52:30.821583 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: [pid: 71939|app: 0|req: 1233/2453] 10.222.0.53 () {58 vars in 1112 bytes} [Wed Nov 24 16:52:30 2021] GET /identity/v3/roles => generated 1420 bytes in 60 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 24 16:52:30.826076 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f3e1f0b-96fd-4c62-945a-01c62bb3e04f admin admin] Authenticating user token {{(pid=71938) process_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 24 16:52:30.836331 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f3e1f0b-96fd-4c62-945a-01c62bb3e04f admin admin] Validating token access rules against request {{(pid=71938) validate_allowed_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 24 16:52:30.840830 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5b6943b-665a-4ab1-8ad4-0177b16b108d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f2ba2e8375b4e8c8792ee1e22b60427', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '00a5583c7b7443e98e7a1d31a0b638dc', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=71938) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 24 16:52:30.841728 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5b6943b-665a-4ab1-8ad4-0177b16b108d admin admin] REQUEST_METHOD: `PUT` {{(pid=71938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 24 16:52:30.842089 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5b6943b-665a-4ab1-8ad4-0177b16b108d admin admin] SCRIPT_NAME: `/identity` {{(pid=71938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 24 16:52:30.842418 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5b6943b-665a-4ab1-8ad4-0177b16b108d admin admin] PATH_INFO: `/v3/projects/1e66157305d648e1b85ddeea587f76b7/users/670db87fcf9f448888c07f9ed3075efd/roles/912ab5f10fa5477da74acf239f07604e` {{(pid=71938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 24 16:52:30.866087 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5b6943b-665a-4ab1-8ad4-0177b16b108d admin admin] RBAC: Authorizing `identity:create_grant(project_id=1e66157305d648e1b85ddeea587f76b7, user_id=670db87fcf9f448888c07f9ed3075efd, role_id=912ab5f10fa5477da74acf239f07604e)` {{(pid=71938) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:442}} Nov 24 16:52:30.895342 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5b6943b-665a-4ab1-8ad4-0177b16b108d admin admin] RBAC: Authorization granted {{(pid=71938) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 24 16:52:30.908011 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: [pid: 71938|app: 0|req: 1221/2454] 10.222.0.53 () {60 vars in 1473 bytes} [Wed Nov 24 16:52:30 2021] PUT /identity/v3/projects/1e66157305d648e1b85ddeea587f76b7/users/670db87fcf9f448888c07f9ed3075efd/roles/912ab5f10fa5477da74acf239f07604e => generated 0 bytes in 83 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 24 16:52:30.919835 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab199f29-7b29-46a2-bdac-eb2ee1afd51a None None] REQUEST_METHOD: `POST` {{(pid=71939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 24 16:52:30.920190 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab199f29-7b29-46a2-bdac-eb2ee1afd51a None None] SCRIPT_NAME: `/identity` {{(pid=71939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 24 16:52:30.920534 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab199f29-7b29-46a2-bdac-eb2ee1afd51a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=71939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 24 16:52:30.960217 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.auth.core [None req-ab199f29-7b29-46a2-bdac-eb2ee1afd51a None None] MFA Rules not processed for user `670db87fcf9f448888c07f9ed3075efd`. Rule list: `[]` (Enabled: `True`). {{(pid=71939) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:442}} Nov 24 16:52:30.961452 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.fernet_utils [None req-ab199f29-7b29-46a2-bdac-eb2ee1afd51a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=71939) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:289}} Nov 24 16:52:31.036983 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: [pid: 71939|app: 0|req: 1234/2455] 10.222.0.53 () {58 vars in 948 bytes} [Wed Nov 24 16:52:30 2021] POST /identity/v3/auth/tokens => generated 3682 bytes in 118 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 24 16:52:31.046998 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5b6943b-665a-4ab1-8ad4-0177b16b108d admin admin] Authenticating user token {{(pid=71938) process_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 24 16:52:31.049558 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.fernet_utils [None req-f5b6943b-665a-4ab1-8ad4-0177b16b108d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=71938) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:289}} Nov 24 16:52:31.124329 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5b6943b-665a-4ab1-8ad4-0177b16b108d admin admin] Validating token access rules against request {{(pid=71938) validate_allowed_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 24 16:52:31.128628 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1d0b72e-11d8-418d-bee8-4ec50580e9e6 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a12374a3093a401a97c343ff0854184d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3b3940d4ae1c4177ae29c02377bb4b0b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=71938) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 24 16:52:31.129288 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1d0b72e-11d8-418d-bee8-4ec50580e9e6 service cinder] REQUEST_METHOD: `GET` {{(pid=71938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 24 16:52:31.129629 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1d0b72e-11d8-418d-bee8-4ec50580e9e6 service cinder] SCRIPT_NAME: `/identity` {{(pid=71938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 24 16:52:31.130006 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1d0b72e-11d8-418d-bee8-4ec50580e9e6 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=71938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 24 16:52:31.139253 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1d0b72e-11d8-418d-bee8-4ec50580e9e6 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=71938) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:442}} Nov 24 16:52:31.167214 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1d0b72e-11d8-418d-bee8-4ec50580e9e6 service cinder] RBAC: Authorization granted {{(pid=71938) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 24 16:52:31.177992 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: [pid: 71938|app: 0|req: 1222/2456] 10.222.0.53 () {60 vars in 1356 bytes} [Wed Nov 24 16:52:31 2021] GET /identity/v3/auth/tokens => generated 3682 bytes in 131 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 24 16:52:32.761287 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdf6bbc2-e628-4529-86e2-09c4bd89627d None None] REQUEST_METHOD: `POST` {{(pid=71939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 24 16:52:32.761791 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdf6bbc2-e628-4529-86e2-09c4bd89627d None None] SCRIPT_NAME: `/identity` {{(pid=71939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 24 16:52:32.761914 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdf6bbc2-e628-4529-86e2-09c4bd89627d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=71939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 24 16:52:32.785729 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.auth.core [None req-fdf6bbc2-e628-4529-86e2-09c4bd89627d None None] MFA Rules not processed for user `670db87fcf9f448888c07f9ed3075efd`. Rule list: `[]` (Enabled: `True`). {{(pid=71939) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:442}} Nov 24 16:52:32.786992 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.fernet_utils [None req-fdf6bbc2-e628-4529-86e2-09c4bd89627d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=71939) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:289}} Nov 24 16:52:32.793999 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: [pid: 71939|app: 0|req: 1235/2457] 10.222.0.53 () {58 vars in 948 bytes} [Wed Nov 24 16:52:32 2021] POST /identity/v3/auth/tokens => generated 3682 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 24 16:52:49.931603 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83b1f756-a5ed-4a06-84b3-4f7c40432c11 None None] REQUEST_METHOD: `POST` {{(pid=71938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 24 16:52:49.932060 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83b1f756-a5ed-4a06-84b3-4f7c40432c11 None None] SCRIPT_NAME: `/identity` {{(pid=71938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 24 16:52:49.932280 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83b1f756-a5ed-4a06-84b3-4f7c40432c11 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=71938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 24 16:52:49.957580 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.auth.core [None req-83b1f756-a5ed-4a06-84b3-4f7c40432c11 None None] MFA Rules not processed for user `f8a135ac0e4744a98258dc7f6c12e741`. Rule list: `[]` (Enabled: `True`). {{(pid=71938) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:442}} Nov 24 16:52:49.958854 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.fernet_utils [None req-83b1f756-a5ed-4a06-84b3-4f7c40432c11 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=71938) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:289}} Nov 24 16:52:50.028466 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: [pid: 71938|app: 0|req: 1223/2458] 10.222.0.53 () {58 vars in 999 bytes} [Wed Nov 24 16:52:49 2021] POST /identity/v3/auth/tokens => generated 3625 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 24 16:52:50.101311 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdf6bbc2-e628-4529-86e2-09c4bd89627d None None] Authenticating user token {{(pid=71939) process_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 24 16:52:50.102857 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.fernet_utils [None req-fdf6bbc2-e628-4529-86e2-09c4bd89627d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=71939) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:289}} Nov 24 16:52:50.190615 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdf6bbc2-e628-4529-86e2-09c4bd89627d None None] Validating token access rules against request {{(pid=71939) validate_allowed_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 24 16:52:50.195807 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ff49d31-22ef-4d30-a079-0582653be8d6 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a4cec9543ba4b7da4ecb1e6e8681302', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3b3940d4ae1c4177ae29c02377bb4b0b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=71939) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 24 16:52:50.196475 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ff49d31-22ef-4d30-a079-0582653be8d6 service swift] REQUEST_METHOD: `GET` {{(pid=71939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 24 16:52:50.196860 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ff49d31-22ef-4d30-a079-0582653be8d6 service swift] SCRIPT_NAME: `/identity` {{(pid=71939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 24 16:52:50.197196 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ff49d31-22ef-4d30-a079-0582653be8d6 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=71939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 24 16:52:50.206507 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ff49d31-22ef-4d30-a079-0582653be8d6 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=71939) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:442}} Nov 24 16:52:50.235565 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ff49d31-22ef-4d30-a079-0582653be8d6 service swift] RBAC: Authorization granted {{(pid=71939) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 24 16:52:50.245332 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: [pid: 71939|app: 0|req: 1236/2459] 10.222.0.53 () {60 vars in 1375 bytes} [Wed Nov 24 16:52:50 2021] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 145 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Nov 24 16:52:50.894547 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0279e48-5dc6-4d97-b556-eb40641e02e7 None None] REQUEST_METHOD: `POST` {{(pid=71938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 24 16:52:50.894905 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0279e48-5dc6-4d97-b556-eb40641e02e7 None None] SCRIPT_NAME: `/identity` {{(pid=71938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 24 16:52:50.895250 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0279e48-5dc6-4d97-b556-eb40641e02e7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=71938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 24 16:52:50.918238 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.auth.core [None req-a0279e48-5dc6-4d97-b556-eb40641e02e7 None None] MFA Rules not processed for user `f8a135ac0e4744a98258dc7f6c12e741`. Rule list: `[]` (Enabled: `True`). {{(pid=71938) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:442}} Nov 24 16:52:50.919466 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.fernet_utils [None req-a0279e48-5dc6-4d97-b556-eb40641e02e7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=71938) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:289}} Nov 24 16:52:50.926429 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: [pid: 71938|app: 0|req: 1224/2460] 10.222.0.53 () {58 vars in 958 bytes} [Wed Nov 24 16:52:50 2021] POST /identity/v3/auth/tokens => generated 3625 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Nov 24 16:52:50.940422 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ff49d31-22ef-4d30-a079-0582653be8d6 service swift] Authenticating user token {{(pid=71939) process_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 24 16:52:50.951174 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ff49d31-22ef-4d30-a079-0582653be8d6 service swift] Validating token access rules against request {{(pid=71939) validate_allowed_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 24 16:52:50.956708 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c5f9ef2-a57a-42ad-92e4-89234863e6ea service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a4cec9543ba4b7da4ecb1e6e8681302', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3b3940d4ae1c4177ae29c02377bb4b0b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=71939) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 24 16:52:50.957356 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c5f9ef2-a57a-42ad-92e4-89234863e6ea service swift] REQUEST_METHOD: `GET` {{(pid=71939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 24 16:52:50.957692 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c5f9ef2-a57a-42ad-92e4-89234863e6ea service swift] SCRIPT_NAME: `/identity` {{(pid=71939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 24 16:52:50.958050 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c5f9ef2-a57a-42ad-92e4-89234863e6ea service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=71939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 24 16:52:50.967038 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c5f9ef2-a57a-42ad-92e4-89234863e6ea service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=71939) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:442}} Nov 24 16:52:50.995035 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c5f9ef2-a57a-42ad-92e4-89234863e6ea service swift] RBAC: Authorization granted {{(pid=71939) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 24 16:52:51.003935 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: [pid: 71939|app: 0|req: 1237/2461] 10.222.0.53 () {60 vars in 1375 bytes} [Wed Nov 24 16:52:50 2021] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 65 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Nov 24 16:52:51.233516 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1deb3eb3-5b8e-453b-82d1-2218fcee292c None None] REQUEST_METHOD: `POST` {{(pid=71938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 24 16:52:51.233965 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1deb3eb3-5b8e-453b-82d1-2218fcee292c None None] SCRIPT_NAME: `/identity` {{(pid=71938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 24 16:52:51.234562 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1deb3eb3-5b8e-453b-82d1-2218fcee292c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=71938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 24 16:52:51.258533 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.auth.core [None req-1deb3eb3-5b8e-453b-82d1-2218fcee292c None None] MFA Rules not processed for user `f8a135ac0e4744a98258dc7f6c12e741`. Rule list: `[]` (Enabled: `True`). {{(pid=71938) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:442}} Nov 24 16:52:51.259755 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.fernet_utils [None req-1deb3eb3-5b8e-453b-82d1-2218fcee292c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=71938) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:289}} Nov 24 16:52:51.266672 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: [pid: 71938|app: 0|req: 1225/2462] 10.222.0.53 () {58 vars in 999 bytes} [Wed Nov 24 16:52:51 2021] POST /identity/v3/auth/tokens => generated 3625 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 24 16:52:51.280584 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c5f9ef2-a57a-42ad-92e4-89234863e6ea service swift] Authenticating user token {{(pid=71939) process_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 24 16:52:51.291839 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c5f9ef2-a57a-42ad-92e4-89234863e6ea service swift] Validating token access rules against request {{(pid=71939) validate_allowed_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 24 16:52:51.297034 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-685b0cc3-b152-4885-b37a-bc31d8943c6d service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a4cec9543ba4b7da4ecb1e6e8681302', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3b3940d4ae1c4177ae29c02377bb4b0b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=71939) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 24 16:52:51.297891 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-685b0cc3-b152-4885-b37a-bc31d8943c6d service swift] REQUEST_METHOD: `GET` {{(pid=71939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 24 16:52:51.298403 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-685b0cc3-b152-4885-b37a-bc31d8943c6d service swift] SCRIPT_NAME: `/identity` {{(pid=71939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 24 16:52:51.299049 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-685b0cc3-b152-4885-b37a-bc31d8943c6d service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=71939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 24 16:52:51.308444 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-685b0cc3-b152-4885-b37a-bc31d8943c6d service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=71939) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:442}} Nov 24 16:52:51.339257 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-685b0cc3-b152-4885-b37a-bc31d8943c6d service swift] RBAC: Authorization granted {{(pid=71939) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 24 16:52:51.349183 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: [pid: 71939|app: 0|req: 1238/2463] 10.222.0.53 () {60 vars in 1375 bytes} [Wed Nov 24 16:52:51 2021] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 69 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Nov 24 16:52:51.735412 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c18cb6a-2a71-4a4f-8066-5c990620e7c4 None None] REQUEST_METHOD: `POST` {{(pid=71938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 24 16:52:51.735771 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c18cb6a-2a71-4a4f-8066-5c990620e7c4 None None] SCRIPT_NAME: `/identity` {{(pid=71938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 24 16:52:51.736118 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c18cb6a-2a71-4a4f-8066-5c990620e7c4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=71938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 24 16:52:51.759878 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.auth.core [None req-2c18cb6a-2a71-4a4f-8066-5c990620e7c4 None None] MFA Rules not processed for user `f8a135ac0e4744a98258dc7f6c12e741`. Rule list: `[]` (Enabled: `True`). {{(pid=71938) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:442}} Nov 24 16:52:51.761112 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.fernet_utils [None req-2c18cb6a-2a71-4a4f-8066-5c990620e7c4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=71938) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:289}} Nov 24 16:52:51.768693 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: [pid: 71938|app: 0|req: 1226/2464] 10.222.0.53 () {58 vars in 958 bytes} [Wed Nov 24 16:52:51 2021] POST /identity/v3/auth/tokens => generated 3625 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 24 16:52:51.782054 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-685b0cc3-b152-4885-b37a-bc31d8943c6d service swift] Authenticating user token {{(pid=71939) process_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 24 16:52:51.792669 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-685b0cc3-b152-4885-b37a-bc31d8943c6d service swift] Validating token access rules against request {{(pid=71939) validate_allowed_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 24 16:52:51.797719 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79048489-9824-4d0e-b8e5-453310a1067f service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a4cec9543ba4b7da4ecb1e6e8681302', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3b3940d4ae1c4177ae29c02377bb4b0b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=71939) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 24 16:52:51.798415 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79048489-9824-4d0e-b8e5-453310a1067f service swift] REQUEST_METHOD: `GET` {{(pid=71939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 24 16:52:51.798803 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79048489-9824-4d0e-b8e5-453310a1067f service swift] SCRIPT_NAME: `/identity` {{(pid=71939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 24 16:52:51.799141 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79048489-9824-4d0e-b8e5-453310a1067f service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=71939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 24 16:52:51.808181 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79048489-9824-4d0e-b8e5-453310a1067f service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=71939) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:442}} Nov 24 16:52:51.837982 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79048489-9824-4d0e-b8e5-453310a1067f service swift] RBAC: Authorization granted {{(pid=71939) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 24 16:52:51.847047 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: [pid: 71939|app: 0|req: 1239/2465] 10.222.0.53 () {60 vars in 1375 bytes} [Wed Nov 24 16:52:51 2021] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 66 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Nov 24 16:52:54.714742 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c18cb6a-2a71-4a4f-8066-5c990620e7c4 None None] Authenticating user token {{(pid=71938) process_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 24 16:52:54.789687 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c18cb6a-2a71-4a4f-8066-5c990620e7c4 None None] Validating token access rules against request {{(pid=71938) validate_allowed_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 24 16:52:54.794295 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67637573-1537-474a-b1df-a51909792a52 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f2ba2e8375b4e8c8792ee1e22b60427', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '00a5583c7b7443e98e7a1d31a0b638dc', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=71938) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 24 16:52:54.795192 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67637573-1537-474a-b1df-a51909792a52 admin admin] REQUEST_METHOD: `DELETE` {{(pid=71938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 24 16:52:54.795527 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67637573-1537-474a-b1df-a51909792a52 admin admin] SCRIPT_NAME: `/identity` {{(pid=71938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 24 16:52:54.795855 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67637573-1537-474a-b1df-a51909792a52 admin admin] PATH_INFO: `/v3/users/670db87fcf9f448888c07f9ed3075efd` {{(pid=71938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 24 16:52:54.797067 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67637573-1537-474a-b1df-a51909792a52 admin admin] RBAC: Authorizing `identity:delete_user(user_id=670db87fcf9f448888c07f9ed3075efd)` {{(pid=71938) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:442}} Nov 24 16:52:54.827515 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67637573-1537-474a-b1df-a51909792a52 admin admin] RBAC: Authorization granted {{(pid=71938) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 24 16:52:54.876039 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.notifications [None req-67637573-1537-474a-b1df-a51909792a52 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '670db87fcf9f448888c07f9ed3075efd'} {{(pid=71938) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:357}} Nov 24 16:52:54.888747 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.notifications [None req-67637573-1537-474a-b1df-a51909792a52 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '670db87fcf9f448888c07f9ed3075efd'} {{(pid=71938) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:357}} Nov 24 16:52:54.889447 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.notifications [None req-67637573-1537-474a-b1df-a51909792a52 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '670db87fcf9f448888c07f9ed3075efd'} {{(pid=71938) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:357}} Nov 24 16:52:54.898259 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.notifications [None req-67637573-1537-474a-b1df-a51909792a52 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '670db87fcf9f448888c07f9ed3075efd'} {{(pid=71938) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:357}} Nov 24 16:52:54.903995 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.notifications [None req-67637573-1537-474a-b1df-a51909792a52 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '670db87fcf9f448888c07f9ed3075efd'} {{(pid=71938) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:357}} Nov 24 16:52:54.910194 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: [pid: 71938|app: 0|req: 1227/2466] 10.222.0.53 () {58 vars in 1214 bytes} [Wed Nov 24 16:52:54 2021] DELETE /identity/v3/users/670db87fcf9f448888c07f9ed3075efd => generated 0 bytes in 196 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 24 16:52:54.914976 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd2309bf-2568-461f-8c21-55f9959f4033 None None] REQUEST_METHOD: `POST` {{(pid=71939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 24 16:52:54.915329 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd2309bf-2568-461f-8c21-55f9959f4033 None None] SCRIPT_NAME: `/identity` {{(pid=71939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 24 16:52:54.915671 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd2309bf-2568-461f-8c21-55f9959f4033 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=71939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 24 16:52:54.940367 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.auth.core [None req-dd2309bf-2568-461f-8c21-55f9959f4033 None None] MFA Rules not processed for user `0f2ba2e8375b4e8c8792ee1e22b60427`. Rule list: `[]` (Enabled: `True`). {{(pid=71939) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:442}} Nov 24 16:52:54.941596 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.fernet_utils [None req-dd2309bf-2568-461f-8c21-55f9959f4033 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=71939) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:289}} Nov 24 16:52:55.012352 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: [pid: 71939|app: 0|req: 1240/2467] 10.222.0.53 () {58 vars in 948 bytes} [Wed Nov 24 16:52:54 2021] POST /identity/v3/auth/tokens => generated 3669 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 24 16:52:55.024124 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67637573-1537-474a-b1df-a51909792a52 admin admin] Authenticating user token {{(pid=71938) process_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 24 16:52:55.025644 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.fernet_utils [None req-67637573-1537-474a-b1df-a51909792a52 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=71938) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:289}} Nov 24 16:52:55.095053 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67637573-1537-474a-b1df-a51909792a52 admin admin] Validating token access rules against request {{(pid=71938) validate_allowed_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 24 16:52:55.100658 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63b3f465-c21a-4fc4-a13a-04166f0918c3 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c90f21b9cdcb413282461fa83cb6b7a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3b3940d4ae1c4177ae29c02377bb4b0b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=71938) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 24 16:52:55.101328 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63b3f465-c21a-4fc4-a13a-04166f0918c3 service neutron] REQUEST_METHOD: `GET` {{(pid=71938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 24 16:52:55.101672 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63b3f465-c21a-4fc4-a13a-04166f0918c3 service neutron] SCRIPT_NAME: `/identity` {{(pid=71938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 24 16:52:55.102011 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63b3f465-c21a-4fc4-a13a-04166f0918c3 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=71938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 24 16:52:55.112053 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63b3f465-c21a-4fc4-a13a-04166f0918c3 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=71938) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:442}} Nov 24 16:52:55.140175 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63b3f465-c21a-4fc4-a13a-04166f0918c3 service neutron] RBAC: Authorization granted {{(pid=71938) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 24 16:52:55.150766 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: [pid: 71938|app: 0|req: 1228/2468] 10.222.0.53 () {60 vars in 1356 bytes} [Wed Nov 24 16:52:55 2021] GET /identity/v3/auth/tokens => generated 3669 bytes in 127 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 24 16:52:55.493561 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd2309bf-2568-461f-8c21-55f9959f4033 None None] Authenticating user token {{(pid=71939) process_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 24 16:52:55.495084 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.fernet_utils [None req-dd2309bf-2568-461f-8c21-55f9959f4033 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=71939) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:289}} Nov 24 16:52:55.506817 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd2309bf-2568-461f-8c21-55f9959f4033 None None] Validating token access rules against request {{(pid=71939) validate_allowed_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 24 16:52:55.511746 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3861126-0643-48c7-8b0d-55a0eb8ccd7c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f2ba2e8375b4e8c8792ee1e22b60427', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '00a5583c7b7443e98e7a1d31a0b638dc', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=71939) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 24 16:52:55.512620 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3861126-0643-48c7-8b0d-55a0eb8ccd7c admin admin] REQUEST_METHOD: `DELETE` {{(pid=71939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 24 16:52:55.512957 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3861126-0643-48c7-8b0d-55a0eb8ccd7c admin admin] SCRIPT_NAME: `/identity` {{(pid=71939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 24 16:52:55.513289 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3861126-0643-48c7-8b0d-55a0eb8ccd7c admin admin] PATH_INFO: `/v3/projects/1e66157305d648e1b85ddeea587f76b7` {{(pid=71939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 24 16:52:55.514561 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3861126-0643-48c7-8b0d-55a0eb8ccd7c admin admin] RBAC: Authorizing `identity:delete_project(project_id=1e66157305d648e1b85ddeea587f76b7)` {{(pid=71939) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:442}} Nov 24 16:52:55.543407 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3861126-0643-48c7-8b0d-55a0eb8ccd7c admin admin] RBAC: Authorization granted {{(pid=71939) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 24 16:52:55.593071 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.notifications [None req-a3861126-0643-48c7-8b0d-55a0eb8ccd7c admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '1e66157305d648e1b85ddeea587f76b7', 'request_id': 'req-a3861126-0643-48c7-8b0d-55a0eb8ccd7c'} {{(pid=71939) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:357}} Nov 24 16:52:55.605186 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.notifications [None req-a3861126-0643-48c7-8b0d-55a0eb8ccd7c admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '1e66157305d648e1b85ddeea587f76b7', 'request_id': 'req-a3861126-0643-48c7-8b0d-55a0eb8ccd7c'} {{(pid=71939) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:357}} Nov 24 16:52:55.610977 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.notifications [None req-a3861126-0643-48c7-8b0d-55a0eb8ccd7c admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '1e66157305d648e1b85ddeea587f76b7', 'request_id': 'req-a3861126-0643-48c7-8b0d-55a0eb8ccd7c'} {{(pid=71939) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:357}} Nov 24 16:52:55.621691 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.notifications [None req-a3861126-0643-48c7-8b0d-55a0eb8ccd7c admin admin] The token cache is being invalidate because project 1e66157305d648e1b85ddeea587f76b7 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=71939) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Nov 24 16:52:55.622016 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.notifications [None req-a3861126-0643-48c7-8b0d-55a0eb8ccd7c admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=71939) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:357}} Nov 24 16:52:55.622714 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.notifications [None req-a3861126-0643-48c7-8b0d-55a0eb8ccd7c admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=71939) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:357}} Nov 24 16:52:55.624207 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: [pid: 71939|app: 0|req: 1241/2469] 10.222.0.53 () {58 vars in 1223 bytes} [Wed Nov 24 16:52:55 2021] DELETE /identity/v3/projects/1e66157305d648e1b85ddeea587f76b7 => generated 0 bytes in 131 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 24 16:53:14.598325 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63b3f465-c21a-4fc4-a13a-04166f0918c3 service neutron] Authenticating user token {{(pid=71938) process_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 24 16:53:14.599873 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.fernet_utils [None req-63b3f465-c21a-4fc4-a13a-04166f0918c3 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=71938) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:289}} Nov 24 16:53:14.668827 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63b3f465-c21a-4fc4-a13a-04166f0918c3 service neutron] Validating token access rules against request {{(pid=71938) validate_allowed_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 24 16:53:14.728264 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-322b3fb3-5350-4529-b360-027572c9afd5 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a12374a3093a401a97c343ff0854184d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3b3940d4ae1c4177ae29c02377bb4b0b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=71938) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 24 16:53:14.728863 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-322b3fb3-5350-4529-b360-027572c9afd5 service cinder] REQUEST_METHOD: `GET` {{(pid=71938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 24 16:53:14.729191 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-322b3fb3-5350-4529-b360-027572c9afd5 service cinder] SCRIPT_NAME: `/identity` {{(pid=71938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 24 16:53:14.729514 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-322b3fb3-5350-4529-b360-027572c9afd5 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=71938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 24 16:53:14.731399 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.fernet_utils [None req-322b3fb3-5350-4529-b360-027572c9afd5 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=71938) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:289}} Nov 24 16:53:14.811333 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-322b3fb3-5350-4529-b360-027572c9afd5 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=71938) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:442}} Nov 24 16:53:14.840595 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-322b3fb3-5350-4529-b360-027572c9afd5 service cinder] RBAC: Authorization granted {{(pid=71938) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 24 16:53:14.850408 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: [pid: 71938|app: 0|req: 1229/2470] 10.222.0.53 () {60 vars in 1356 bytes} [Wed Nov 24 16:53:14 2021] GET /identity/v3/auth/tokens => generated 3686 bytes in 253 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 24 16:53:15.567245 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3861126-0643-48c7-8b0d-55a0eb8ccd7c admin admin] Authenticating user token {{(pid=71939) process_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 24 16:53:15.568714 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.fernet_utils [None req-a3861126-0643-48c7-8b0d-55a0eb8ccd7c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=71939) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:289}} Nov 24 16:53:15.638673 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3861126-0643-48c7-8b0d-55a0eb8ccd7c admin admin] Validating token access rules against request {{(pid=71939) validate_allowed_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 24 16:53:15.642371 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-caabc52e-8b3b-4498-ace7-5b13194ddc3f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c90f21b9cdcb413282461fa83cb6b7a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3b3940d4ae1c4177ae29c02377bb4b0b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=71939) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 24 16:53:15.643023 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caabc52e-8b3b-4498-ace7-5b13194ddc3f service neutron] REQUEST_METHOD: `GET` {{(pid=71939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 24 16:53:15.643365 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caabc52e-8b3b-4498-ace7-5b13194ddc3f service neutron] SCRIPT_NAME: `/identity` {{(pid=71939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 24 16:53:15.643697 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caabc52e-8b3b-4498-ace7-5b13194ddc3f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=71939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 24 16:53:15.645528 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.fernet_utils [None req-caabc52e-8b3b-4498-ace7-5b13194ddc3f service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=71939) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:289}} Nov 24 16:53:15.724755 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-caabc52e-8b3b-4498-ace7-5b13194ddc3f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=71939) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:442}} Nov 24 16:53:15.753127 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-caabc52e-8b3b-4498-ace7-5b13194ddc3f service neutron] RBAC: Authorization granted {{(pid=71939) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 24 16:53:15.763984 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: [pid: 71939|app: 0|req: 1242/2471] 10.222.0.53 () {60 vars in 1356 bytes} [Wed Nov 24 16:53:15 2021] GET /identity/v3/auth/tokens => generated 3802 bytes in 197 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 24 16:53:17.039584 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-322b3fb3-5350-4529-b360-027572c9afd5 service cinder] Authenticating user token {{(pid=71938) process_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 24 16:53:17.050093 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-322b3fb3-5350-4529-b360-027572c9afd5 service cinder] Validating token access rules against request {{(pid=71938) validate_allowed_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 24 16:53:17.053833 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96acc4d1-f3ea-44ad-92aa-7b6d9d44fb41 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c90f21b9cdcb413282461fa83cb6b7a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3b3940d4ae1c4177ae29c02377bb4b0b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=71938) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 24 16:53:17.054570 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96acc4d1-f3ea-44ad-92aa-7b6d9d44fb41 service neutron] REQUEST_METHOD: `GET` {{(pid=71938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 24 16:53:17.054913 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96acc4d1-f3ea-44ad-92aa-7b6d9d44fb41 service neutron] SCRIPT_NAME: `/identity` {{(pid=71938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 24 16:53:17.055248 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96acc4d1-f3ea-44ad-92aa-7b6d9d44fb41 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=71938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 24 16:53:17.057083 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.fernet_utils [None req-96acc4d1-f3ea-44ad-92aa-7b6d9d44fb41 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=71938) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:289}} Nov 24 16:53:17.071149 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96acc4d1-f3ea-44ad-92aa-7b6d9d44fb41 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=71938) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:442}} Nov 24 16:53:17.099907 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96acc4d1-f3ea-44ad-92aa-7b6d9d44fb41 service neutron] RBAC: Authorization granted {{(pid=71938) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 24 16:53:17.111301 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: [pid: 71938|app: 0|req: 1230/2472] 10.222.0.53 () {60 vars in 1356 bytes} [Wed Nov 24 16:53:17 2021] GET /identity/v3/auth/tokens => generated 3802 bytes in 72 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 24 16:53:27.926587 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-caabc52e-8b3b-4498-ace7-5b13194ddc3f service neutron] Authenticating user token {{(pid=71939) process_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 24 16:53:27.928067 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.fernet_utils [None req-caabc52e-8b3b-4498-ace7-5b13194ddc3f service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=71939) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:289}} Nov 24 16:53:27.940830 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-caabc52e-8b3b-4498-ace7-5b13194ddc3f service neutron] Validating token access rules against request {{(pid=71939) validate_allowed_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 24 16:53:27.945027 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a09411b-09b0-4d14-9176-0188d6e21bf9 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a12374a3093a401a97c343ff0854184d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3b3940d4ae1c4177ae29c02377bb4b0b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=71939) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 24 16:53:27.945696 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a09411b-09b0-4d14-9176-0188d6e21bf9 service cinder] REQUEST_METHOD: `GET` {{(pid=71939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 24 16:53:27.946072 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a09411b-09b0-4d14-9176-0188d6e21bf9 service cinder] SCRIPT_NAME: `/identity` {{(pid=71939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 24 16:53:27.946406 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a09411b-09b0-4d14-9176-0188d6e21bf9 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=71939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 24 16:53:27.948269 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.fernet_utils [None req-9a09411b-09b0-4d14-9176-0188d6e21bf9 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=71939) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:289}} Nov 24 16:53:28.018130 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a09411b-09b0-4d14-9176-0188d6e21bf9 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=71939) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:442}} Nov 24 16:53:28.047403 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a09411b-09b0-4d14-9176-0188d6e21bf9 service cinder] RBAC: Authorization granted {{(pid=71939) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 24 16:53:28.057455 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: [pid: 71939|app: 0|req: 1243/2473] 10.222.0.53 () {60 vars in 1356 bytes} [Wed Nov 24 16:53:27 2021] GET /identity/v3/auth/tokens => generated 3700 bytes in 131 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 24 16:53:35.218372 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96acc4d1-f3ea-44ad-92aa-7b6d9d44fb41 service neutron] Authenticating user token {{(pid=71938) process_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 24 16:53:35.219981 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.fernet_utils [None req-96acc4d1-f3ea-44ad-92aa-7b6d9d44fb41 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=71938) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:289}} Nov 24 16:53:35.232405 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96acc4d1-f3ea-44ad-92aa-7b6d9d44fb41 service neutron] Validating token access rules against request {{(pid=71938) validate_allowed_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 24 16:53:35.236039 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f332d0ea-bfcf-4018-8804-b518dcb06d83 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a12374a3093a401a97c343ff0854184d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3b3940d4ae1c4177ae29c02377bb4b0b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=71938) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 24 16:53:35.236701 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f332d0ea-bfcf-4018-8804-b518dcb06d83 service cinder] REQUEST_METHOD: `GET` {{(pid=71938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 24 16:53:35.237666 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f332d0ea-bfcf-4018-8804-b518dcb06d83 service cinder] SCRIPT_NAME: `/identity` {{(pid=71938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 24 16:53:35.237997 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f332d0ea-bfcf-4018-8804-b518dcb06d83 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=71938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 24 16:53:35.239832 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.fernet_utils [None req-f332d0ea-bfcf-4018-8804-b518dcb06d83 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=71938) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:289}} Nov 24 16:53:35.308687 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f332d0ea-bfcf-4018-8804-b518dcb06d83 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=71938) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:442}} Nov 24 16:53:35.339515 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f332d0ea-bfcf-4018-8804-b518dcb06d83 service cinder] RBAC: Authorization granted {{(pid=71938) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 24 16:53:35.348826 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: [pid: 71938|app: 0|req: 1231/2474] 10.222.0.53 () {60 vars in 1356 bytes} [Wed Nov 24 16:53:35 2021] GET /identity/v3/auth/tokens => generated 3682 bytes in 131 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Nov 24 16:53:36.073202 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a09411b-09b0-4d14-9176-0188d6e21bf9 service cinder] Authenticating user token {{(pid=71939) process_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 24 16:53:36.086382 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a09411b-09b0-4d14-9176-0188d6e21bf9 service cinder] Validating token access rules against request {{(pid=71939) validate_allowed_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 24 16:53:36.091845 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52ab384e-c052-423b-b369-ba02b34b9684 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e196802d4d5432482b6d2eabc25f74e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3b3940d4ae1c4177ae29c02377bb4b0b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'service', 'ResellerAdmin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=71939) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 24 16:53:36.092501 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52ab384e-c052-423b-b369-ba02b34b9684 service nova] REQUEST_METHOD: `GET` {{(pid=71939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 24 16:53:36.092847 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52ab384e-c052-423b-b369-ba02b34b9684 service nova] SCRIPT_NAME: `/identity` {{(pid=71939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 24 16:53:36.093186 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52ab384e-c052-423b-b369-ba02b34b9684 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=71939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 24 16:53:36.095040 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.fernet_utils [None req-52ab384e-c052-423b-b369-ba02b34b9684 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=71939) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:289}} Nov 24 16:53:36.164129 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52ab384e-c052-423b-b369-ba02b34b9684 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=71939) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:442}} Nov 24 16:53:36.192177 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52ab384e-c052-423b-b369-ba02b34b9684 service nova] RBAC: Authorization granted {{(pid=71939) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 24 16:53:36.201940 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: [pid: 71939|app: 0|req: 1244/2475] 10.222.0.53 () {60 vars in 1356 bytes} [Wed Nov 24 16:53:36 2021] GET /identity/v3/auth/tokens => generated 3692 bytes in 130 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 24 16:55:06.403385 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f332d0ea-bfcf-4018-8804-b518dcb06d83 service cinder] Authenticating user token {{(pid=71938) process_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 24 16:55:06.413805 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f332d0ea-bfcf-4018-8804-b518dcb06d83 service cinder] Validating token access rules against request {{(pid=71938) validate_allowed_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 24 16:55:06.417556 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbc1d22f-bea5-40a8-b582-07da982b880b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c90f21b9cdcb413282461fa83cb6b7a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3b3940d4ae1c4177ae29c02377bb4b0b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=71938) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 24 16:55:06.418351 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbc1d22f-bea5-40a8-b582-07da982b880b service neutron] REQUEST_METHOD: `GET` {{(pid=71938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 24 16:55:06.418778 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbc1d22f-bea5-40a8-b582-07da982b880b service neutron] SCRIPT_NAME: `/identity` {{(pid=71938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 24 16:55:06.419183 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbc1d22f-bea5-40a8-b582-07da982b880b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=71938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 24 16:55:06.421087 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.fernet_utils [None req-fbc1d22f-bea5-40a8-b582-07da982b880b service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=71938) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:289}} Nov 24 16:55:06.433276 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbc1d22f-bea5-40a8-b582-07da982b880b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=71938) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:442}} Nov 24 16:55:06.462226 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbc1d22f-bea5-40a8-b582-07da982b880b service neutron] RBAC: Authorization granted {{(pid=71938) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 24 16:55:06.470952 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: [pid: 71938|app: 0|req: 1232/2476] 10.222.0.53 () {60 vars in 1356 bytes} [Wed Nov 24 16:55:06 2021] GET /identity/v3/auth/tokens => generated 3551 bytes in 68 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 24 16:55:08.177898 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52ab384e-c052-423b-b369-ba02b34b9684 service nova] Authenticating user token {{(pid=71939) process_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 24 16:55:08.189082 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52ab384e-c052-423b-b369-ba02b34b9684 service nova] Validating token access rules against request {{(pid=71939) validate_allowed_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 24 16:55:08.195351 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1886828f-b9d8-4dca-b6cb-5a2bd4a1bb34 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e196802d4d5432482b6d2eabc25f74e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3b3940d4ae1c4177ae29c02377bb4b0b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'service', 'ResellerAdmin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=71939) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 24 16:55:08.195996 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1886828f-b9d8-4dca-b6cb-5a2bd4a1bb34 service nova] REQUEST_METHOD: `GET` {{(pid=71939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 24 16:55:08.196497 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1886828f-b9d8-4dca-b6cb-5a2bd4a1bb34 service nova] SCRIPT_NAME: `/identity` {{(pid=71939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 24 16:55:08.197139 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1886828f-b9d8-4dca-b6cb-5a2bd4a1bb34 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=71939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 24 16:55:08.199094 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.fernet_utils [None req-1886828f-b9d8-4dca-b6cb-5a2bd4a1bb34 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=71939) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:289}} Nov 24 16:55:08.225243 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1886828f-b9d8-4dca-b6cb-5a2bd4a1bb34 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=71939) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:442}} Nov 24 16:55:08.258085 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1886828f-b9d8-4dca-b6cb-5a2bd4a1bb34 service nova] RBAC: Authorization granted {{(pid=71939) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 24 16:55:08.270099 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: [pid: 71939|app: 0|req: 1245/2477] 10.222.0.53 () {60 vars in 1356 bytes} [Wed Nov 24 16:55:08 2021] GET /identity/v3/auth/tokens => generated 3802 bytes in 93 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 24 16:55:09.329556 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbc1d22f-bea5-40a8-b582-07da982b880b service neutron] Authenticating user token {{(pid=71938) process_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 24 16:55:09.338946 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbc1d22f-bea5-40a8-b582-07da982b880b service neutron] Validating token access rules against request {{(pid=71938) validate_allowed_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 24 16:55:09.342784 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68f70591-096d-42a6-b843-62d081c26954 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c90f21b9cdcb413282461fa83cb6b7a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3b3940d4ae1c4177ae29c02377bb4b0b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=71938) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 24 16:55:09.343449 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68f70591-096d-42a6-b843-62d081c26954 service neutron] REQUEST_METHOD: `GET` {{(pid=71938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 24 16:55:09.343791 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68f70591-096d-42a6-b843-62d081c26954 service neutron] SCRIPT_NAME: `/identity` {{(pid=71938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 24 16:55:09.344129 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68f70591-096d-42a6-b843-62d081c26954 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=71938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 24 16:55:09.346788 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.fernet_utils [None req-68f70591-096d-42a6-b843-62d081c26954 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=71938) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:289}} Nov 24 16:55:09.421605 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68f70591-096d-42a6-b843-62d081c26954 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=71938) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:442}} Nov 24 16:55:09.450502 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68f70591-096d-42a6-b843-62d081c26954 service neutron] RBAC: Authorization granted {{(pid=71938) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 24 16:55:09.460946 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: [pid: 71938|app: 0|req: 1233/2478] 10.222.0.53 () {60 vars in 1356 bytes} [Wed Nov 24 16:55:09 2021] GET /identity/v3/auth/tokens => generated 3669 bytes in 132 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 24 16:55:10.218498 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1886828f-b9d8-4dca-b6cb-5a2bd4a1bb34 service nova] Authenticating user token {{(pid=71939) process_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 24 16:55:10.220136 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.fernet_utils [None req-1886828f-b9d8-4dca-b6cb-5a2bd4a1bb34 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=71939) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:289}} Nov 24 16:55:10.236166 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1886828f-b9d8-4dca-b6cb-5a2bd4a1bb34 service nova] Validating token access rules against request {{(pid=71939) validate_allowed_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 24 16:55:10.242301 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02deb639-755e-45da-b934-745b17dd4caf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f2ba2e8375b4e8c8792ee1e22b60427', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '00a5583c7b7443e98e7a1d31a0b638dc', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=71939) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 24 16:55:10.243272 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02deb639-755e-45da-b934-745b17dd4caf admin admin] REQUEST_METHOD: `DELETE` {{(pid=71939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 24 16:55:10.243695 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02deb639-755e-45da-b934-745b17dd4caf admin admin] SCRIPT_NAME: `/identity` {{(pid=71939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 24 16:55:10.244121 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02deb639-755e-45da-b934-745b17dd4caf admin admin] PATH_INFO: `/v3/users/03d1d0f348814a6c972dbb75c3b32797` {{(pid=71939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 24 16:55:10.245432 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02deb639-755e-45da-b934-745b17dd4caf admin admin] RBAC: Authorizing `identity:delete_user(user_id=03d1d0f348814a6c972dbb75c3b32797)` {{(pid=71939) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:442}} Nov 24 16:55:10.274337 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02deb639-755e-45da-b934-745b17dd4caf admin admin] RBAC: Authorization granted {{(pid=71939) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 24 16:55:10.328622 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.notifications [None req-02deb639-755e-45da-b934-745b17dd4caf admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '03d1d0f348814a6c972dbb75c3b32797'} {{(pid=71939) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:357}} Nov 24 16:55:10.341678 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.notifications [None req-02deb639-755e-45da-b934-745b17dd4caf admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '03d1d0f348814a6c972dbb75c3b32797'} {{(pid=71939) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:357}} Nov 24 16:55:10.342417 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.notifications [None req-02deb639-755e-45da-b934-745b17dd4caf admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '03d1d0f348814a6c972dbb75c3b32797'} {{(pid=71939) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:357}} Nov 24 16:55:10.350606 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.notifications [None req-02deb639-755e-45da-b934-745b17dd4caf admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '03d1d0f348814a6c972dbb75c3b32797'} {{(pid=71939) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:357}} Nov 24 16:55:10.357611 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.notifications [None req-02deb639-755e-45da-b934-745b17dd4caf admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '03d1d0f348814a6c972dbb75c3b32797'} {{(pid=71939) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:357}} Nov 24 16:55:10.364627 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: [pid: 71939|app: 0|req: 1246/2479] 10.222.0.53 () {58 vars in 1214 bytes} [Wed Nov 24 16:55:10 2021] DELETE /identity/v3/users/03d1d0f348814a6c972dbb75c3b32797 => generated 0 bytes in 147 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 24 16:55:10.662785 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68f70591-096d-42a6-b843-62d081c26954 service neutron] Authenticating user token {{(pid=71938) process_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 24 16:55:10.675847 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68f70591-096d-42a6-b843-62d081c26954 service neutron] Validating token access rules against request {{(pid=71938) validate_allowed_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 24 16:55:10.744378 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6b84e65-a7d2-40e5-b281-4f84889ff3d1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f2ba2e8375b4e8c8792ee1e22b60427', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '00a5583c7b7443e98e7a1d31a0b638dc', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=71938) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 24 16:55:10.745273 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6b84e65-a7d2-40e5-b281-4f84889ff3d1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=71938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 24 16:55:10.745611 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6b84e65-a7d2-40e5-b281-4f84889ff3d1 admin admin] SCRIPT_NAME: `/identity` {{(pid=71938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 24 16:55:10.745948 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6b84e65-a7d2-40e5-b281-4f84889ff3d1 admin admin] PATH_INFO: `/v3/projects/e1293be0c07d47dc908154cfb3164097` {{(pid=71938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 24 16:55:10.747230 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6b84e65-a7d2-40e5-b281-4f84889ff3d1 admin admin] RBAC: Authorizing `identity:delete_project(project_id=e1293be0c07d47dc908154cfb3164097)` {{(pid=71938) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:442}} Nov 24 16:55:10.775996 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6b84e65-a7d2-40e5-b281-4f84889ff3d1 admin admin] RBAC: Authorization granted {{(pid=71938) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 24 16:55:10.834694 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.notifications [None req-a6b84e65-a7d2-40e5-b281-4f84889ff3d1 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e1293be0c07d47dc908154cfb3164097', 'request_id': 'req-a6b84e65-a7d2-40e5-b281-4f84889ff3d1'} {{(pid=71938) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:357}} Nov 24 16:55:10.848190 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.notifications [None req-a6b84e65-a7d2-40e5-b281-4f84889ff3d1 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e1293be0c07d47dc908154cfb3164097', 'request_id': 'req-a6b84e65-a7d2-40e5-b281-4f84889ff3d1'} {{(pid=71938) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:357}} Nov 24 16:55:10.853923 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.notifications [None req-a6b84e65-a7d2-40e5-b281-4f84889ff3d1 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e1293be0c07d47dc908154cfb3164097', 'request_id': 'req-a6b84e65-a7d2-40e5-b281-4f84889ff3d1'} {{(pid=71938) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:357}} Nov 24 16:55:10.866856 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.notifications [None req-a6b84e65-a7d2-40e5-b281-4f84889ff3d1 admin admin] The token cache is being invalidate because project e1293be0c07d47dc908154cfb3164097 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=71938) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Nov 24 16:55:10.867199 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.notifications [None req-a6b84e65-a7d2-40e5-b281-4f84889ff3d1 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=71938) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:357}} Nov 24 16:55:10.867913 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.notifications [None req-a6b84e65-a7d2-40e5-b281-4f84889ff3d1 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=71938) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:357}} Nov 24 16:55:10.869550 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: [pid: 71938|app: 0|req: 1234/2480] 10.222.0.53 () {58 vars in 1223 bytes} [Wed Nov 24 16:55:10 2021] DELETE /identity/v3/projects/e1293be0c07d47dc908154cfb3164097 => generated 0 bytes in 208 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 24 16:55:10.875939 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee6ab256-9123-48af-9ceb-baf6e06247a1 None None] REQUEST_METHOD: `POST` {{(pid=71939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 24 16:55:10.876311 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee6ab256-9123-48af-9ceb-baf6e06247a1 None None] SCRIPT_NAME: `/identity` {{(pid=71939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 24 16:55:10.876840 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee6ab256-9123-48af-9ceb-baf6e06247a1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=71939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 24 16:55:10.900291 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.auth.core [None req-ee6ab256-9123-48af-9ceb-baf6e06247a1 None None] MFA Rules not processed for user `0f2ba2e8375b4e8c8792ee1e22b60427`. Rule list: `[]` (Enabled: `True`). {{(pid=71939) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:442}} Nov 24 16:55:10.901518 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.fernet_utils [None req-ee6ab256-9123-48af-9ceb-baf6e06247a1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=71939) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:289}} Nov 24 16:55:10.973947 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: [pid: 71939|app: 0|req: 1247/2481] 10.222.0.53 () {58 vars in 948 bytes} [Wed Nov 24 16:55:10 2021] POST /identity/v3/auth/tokens => generated 3669 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 24 16:55:10.982631 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a69e3119-0fa1-44d7-984a-4006fe754ef0 None None] REQUEST_METHOD: `POST` {{(pid=71938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 24 16:55:10.982989 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a69e3119-0fa1-44d7-984a-4006fe754ef0 None None] SCRIPT_NAME: `/identity` {{(pid=71938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 24 16:55:10.983331 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a69e3119-0fa1-44d7-984a-4006fe754ef0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=71938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 24 16:55:11.082168 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.auth.core [None req-a69e3119-0fa1-44d7-984a-4006fe754ef0 None None] MFA Rules not processed for user `0f2ba2e8375b4e8c8792ee1e22b60427`. Rule list: `[]` (Enabled: `True`). {{(pid=71938) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:442}} Nov 24 16:55:11.083320 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.fernet_utils [None req-a69e3119-0fa1-44d7-984a-4006fe754ef0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=71938) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:289}} Nov 24 16:55:11.090942 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: [pid: 71938|app: 0|req: 1235/2482] 10.222.0.53 () {58 vars in 948 bytes} [Wed Nov 24 16:55:10 2021] POST /identity/v3/auth/tokens => generated 3669 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 24 16:55:11.095546 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee6ab256-9123-48af-9ceb-baf6e06247a1 None None] Authenticating user token {{(pid=71939) process_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 24 16:55:11.105574 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee6ab256-9123-48af-9ceb-baf6e06247a1 None None] Validating token access rules against request {{(pid=71939) validate_allowed_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 24 16:55:11.110312 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de801315-b394-4469-889c-3648e6230d71 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f2ba2e8375b4e8c8792ee1e22b60427', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '00a5583c7b7443e98e7a1d31a0b638dc', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=71939) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 24 16:55:11.110982 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de801315-b394-4469-889c-3648e6230d71 admin admin] REQUEST_METHOD: `GET` {{(pid=71939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 24 16:55:11.111321 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de801315-b394-4469-889c-3648e6230d71 admin admin] SCRIPT_NAME: `/identity` {{(pid=71939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 24 16:55:11.111654 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de801315-b394-4469-889c-3648e6230d71 admin admin] PATH_INFO: `/v3/domains` {{(pid=71939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 24 16:55:11.112991 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de801315-b394-4469-889c-3648e6230d71 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=71939) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:161}} Nov 24 16:55:11.113341 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de801315-b394-4469-889c-3648e6230d71 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=71939) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:442}} Nov 24 16:55:11.141815 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de801315-b394-4469-889c-3648e6230d71 admin admin] RBAC: Authorization granted {{(pid=71939) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 24 16:55:11.155314 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: [pid: 71939|app: 0|req: 1248/2483] 10.222.0.53 () {58 vars in 1143 bytes} [Wed Nov 24 16:55:11 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 60 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 24 16:55:11.159749 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a69e3119-0fa1-44d7-984a-4006fe754ef0 None None] Authenticating user token {{(pid=71938) process_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 24 16:55:11.168979 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a69e3119-0fa1-44d7-984a-4006fe754ef0 None None] Validating token access rules against request {{(pid=71938) validate_allowed_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 24 16:55:11.173606 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c692a580-d755-4a1f-88e4-3363d694024e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f2ba2e8375b4e8c8792ee1e22b60427', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '00a5583c7b7443e98e7a1d31a0b638dc', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=71938) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 24 16:55:11.174322 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c692a580-d755-4a1f-88e4-3363d694024e admin admin] REQUEST_METHOD: `POST` {{(pid=71938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 24 16:55:11.175161 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c692a580-d755-4a1f-88e4-3363d694024e admin admin] SCRIPT_NAME: `/identity` {{(pid=71938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 24 16:55:11.175495 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c692a580-d755-4a1f-88e4-3363d694024e admin admin] PATH_INFO: `/v3/projects` {{(pid=71938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 24 16:55:11.176230 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c692a580-d755-4a1f-88e4-3363d694024e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=71938) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:442}} Nov 24 16:55:11.205431 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c692a580-d755-4a1f-88e4-3363d694024e admin admin] RBAC: Authorization granted {{(pid=71938) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 24 16:55:11.244087 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: [pid: 71938|app: 0|req: 1236/2484] 10.222.0.53 () {60 vars in 1143 bytes} [Wed Nov 24 16:55:11 2021] POST /identity/v3/projects => generated 385 bytes in 85 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 24 16:55:11.248571 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de801315-b394-4469-889c-3648e6230d71 admin admin] Authenticating user token {{(pid=71939) process_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 24 16:55:11.263415 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de801315-b394-4469-889c-3648e6230d71 admin admin] Validating token access rules against request {{(pid=71939) validate_allowed_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 24 16:55:11.337334 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5152b97b-a5aa-4e36-92d1-a8af48ebe97b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f2ba2e8375b4e8c8792ee1e22b60427', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '00a5583c7b7443e98e7a1d31a0b638dc', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=71939) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 24 16:55:11.338045 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5152b97b-a5aa-4e36-92d1-a8af48ebe97b admin admin] REQUEST_METHOD: `POST` {{(pid=71939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 24 16:55:11.338401 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5152b97b-a5aa-4e36-92d1-a8af48ebe97b admin admin] SCRIPT_NAME: `/identity` {{(pid=71939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 24 16:55:11.338732 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5152b97b-a5aa-4e36-92d1-a8af48ebe97b admin admin] PATH_INFO: `/v3/users` {{(pid=71939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 24 16:55:11.339531 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5152b97b-a5aa-4e36-92d1-a8af48ebe97b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=71939) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:442}} Nov 24 16:55:11.369920 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5152b97b-a5aa-4e36-92d1-a8af48ebe97b admin admin] RBAC: Authorization granted {{(pid=71939) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 24 16:55:11.389851 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: [pid: 71939|app: 0|req: 1249/2485] 10.222.0.53 () {60 vars in 1134 bytes} [Wed Nov 24 16:55:11 2021] POST /identity/v3/users => generated 293 bytes in 142 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 24 16:55:11.394466 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c692a580-d755-4a1f-88e4-3363d694024e admin admin] Authenticating user token {{(pid=71938) process_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 24 16:55:11.405050 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c692a580-d755-4a1f-88e4-3363d694024e admin admin] Validating token access rules against request {{(pid=71938) validate_allowed_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 24 16:55:11.410199 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9572b6e6-1f0b-40d2-a6ac-7b67ad1c80b0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f2ba2e8375b4e8c8792ee1e22b60427', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '00a5583c7b7443e98e7a1d31a0b638dc', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=71938) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 24 16:55:11.410878 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9572b6e6-1f0b-40d2-a6ac-7b67ad1c80b0 admin admin] REQUEST_METHOD: `GET` {{(pid=71938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 24 16:55:11.411217 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9572b6e6-1f0b-40d2-a6ac-7b67ad1c80b0 admin admin] SCRIPT_NAME: `/identity` {{(pid=71938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 24 16:55:11.411550 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9572b6e6-1f0b-40d2-a6ac-7b67ad1c80b0 admin admin] PATH_INFO: `/v3/roles` {{(pid=71938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 24 16:55:11.412344 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9572b6e6-1f0b-40d2-a6ac-7b67ad1c80b0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=71938) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:442}} Nov 24 16:55:11.441463 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9572b6e6-1f0b-40d2-a6ac-7b67ad1c80b0 admin admin] RBAC: Authorization granted {{(pid=71938) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 24 16:55:11.452953 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: [pid: 71938|app: 0|req: 1237/2486] 10.222.0.53 () {58 vars in 1112 bytes} [Wed Nov 24 16:55:11 2021] GET /identity/v3/roles => generated 1420 bytes in 59 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Nov 24 16:55:11.457332 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5152b97b-a5aa-4e36-92d1-a8af48ebe97b admin admin] Authenticating user token {{(pid=71939) process_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 24 16:55:11.467617 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5152b97b-a5aa-4e36-92d1-a8af48ebe97b admin admin] Validating token access rules against request {{(pid=71939) validate_allowed_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 24 16:55:11.472725 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bb21a66-c558-4c83-8b9c-799d5994ec57 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f2ba2e8375b4e8c8792ee1e22b60427', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '00a5583c7b7443e98e7a1d31a0b638dc', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=71939) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 24 16:55:11.473671 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bb21a66-c558-4c83-8b9c-799d5994ec57 admin admin] REQUEST_METHOD: `PUT` {{(pid=71939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 24 16:55:11.474151 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bb21a66-c558-4c83-8b9c-799d5994ec57 admin admin] SCRIPT_NAME: `/identity` {{(pid=71939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 24 16:55:11.474596 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bb21a66-c558-4c83-8b9c-799d5994ec57 admin admin] PATH_INFO: `/v3/projects/ddf80c87c78545b596193aea044877ba/users/15ece405347842a29fbc06f934028a84/roles/912ab5f10fa5477da74acf239f07604e` {{(pid=71939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 24 16:55:11.495925 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bb21a66-c558-4c83-8b9c-799d5994ec57 admin admin] RBAC: Authorizing `identity:create_grant(project_id=ddf80c87c78545b596193aea044877ba, user_id=15ece405347842a29fbc06f934028a84, role_id=912ab5f10fa5477da74acf239f07604e)` {{(pid=71939) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:442}} Nov 24 16:55:11.524989 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bb21a66-c558-4c83-8b9c-799d5994ec57 admin admin] RBAC: Authorization granted {{(pid=71939) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 24 16:55:11.537423 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: [pid: 71939|app: 0|req: 1250/2487] 10.222.0.53 () {60 vars in 1473 bytes} [Wed Nov 24 16:55:11 2021] PUT /identity/v3/projects/ddf80c87c78545b596193aea044877ba/users/15ece405347842a29fbc06f934028a84/roles/912ab5f10fa5477da74acf239f07604e => generated 0 bytes in 81 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 24 16:55:11.542574 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f485c46-2886-4af4-8395-c5aed6bba902 None None] REQUEST_METHOD: `POST` {{(pid=71938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 24 16:55:11.542921 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f485c46-2886-4af4-8395-c5aed6bba902 None None] SCRIPT_NAME: `/identity` {{(pid=71938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 24 16:55:11.543257 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f485c46-2886-4af4-8395-c5aed6bba902 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=71938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 24 16:55:11.567076 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.auth.core [None req-7f485c46-2886-4af4-8395-c5aed6bba902 None None] MFA Rules not processed for user `0f2ba2e8375b4e8c8792ee1e22b60427`. Rule list: `[]` (Enabled: `True`). {{(pid=71938) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:442}} Nov 24 16:55:11.568286 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.fernet_utils [None req-7f485c46-2886-4af4-8395-c5aed6bba902 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=71938) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:289}} Nov 24 16:55:11.636401 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: [pid: 71938|app: 0|req: 1238/2488] 10.222.0.53 () {58 vars in 948 bytes} [Wed Nov 24 16:55:11 2021] POST /identity/v3/auth/tokens => generated 3669 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 24 16:55:11.647762 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bb21a66-c558-4c83-8b9c-799d5994ec57 admin admin] Authenticating user token {{(pid=71939) process_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 24 16:55:11.649767 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.fernet_utils [None req-8bb21a66-c558-4c83-8b9c-799d5994ec57 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=71939) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:289}} Nov 24 16:55:11.719705 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bb21a66-c558-4c83-8b9c-799d5994ec57 admin admin] Validating token access rules against request {{(pid=71939) validate_allowed_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 24 16:55:11.724035 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a0a4fc3-3e1b-419f-b968-e9c7c43fcb83 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c90f21b9cdcb413282461fa83cb6b7a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3b3940d4ae1c4177ae29c02377bb4b0b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=71939) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 24 16:55:11.724861 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a0a4fc3-3e1b-419f-b968-e9c7c43fcb83 service neutron] REQUEST_METHOD: `GET` {{(pid=71939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 24 16:55:11.725209 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a0a4fc3-3e1b-419f-b968-e9c7c43fcb83 service neutron] SCRIPT_NAME: `/identity` {{(pid=71939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 24 16:55:11.725544 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a0a4fc3-3e1b-419f-b968-e9c7c43fcb83 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=71939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 24 16:55:11.735151 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a0a4fc3-3e1b-419f-b968-e9c7c43fcb83 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=71939) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:442}} Nov 24 16:55:11.763325 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a0a4fc3-3e1b-419f-b968-e9c7c43fcb83 service neutron] RBAC: Authorization granted {{(pid=71939) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 24 16:55:11.778494 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: [pid: 71939|app: 0|req: 1251/2489] 10.222.0.53 () {60 vars in 1356 bytes} [Wed Nov 24 16:55:11 2021] GET /identity/v3/auth/tokens => generated 3669 bytes in 131 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 24 16:55:12.587441 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f7de531-c6c2-4a74-94db-d1e4000c47c8 None None] REQUEST_METHOD: `POST` {{(pid=71938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 24 16:55:12.587947 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f7de531-c6c2-4a74-94db-d1e4000c47c8 None None] SCRIPT_NAME: `/identity` {{(pid=71938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 24 16:55:12.588068 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f7de531-c6c2-4a74-94db-d1e4000c47c8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=71938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 24 16:55:12.633758 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.auth.core [None req-8f7de531-c6c2-4a74-94db-d1e4000c47c8 None None] MFA Rules not processed for user `15ece405347842a29fbc06f934028a84`. Rule list: `[]` (Enabled: `True`). {{(pid=71938) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:442}} Nov 24 16:55:12.635039 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.fernet_utils [None req-8f7de531-c6c2-4a74-94db-d1e4000c47c8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=71938) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:289}} Nov 24 16:55:12.712871 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: [pid: 71938|app: 0|req: 1239/2490] 10.222.0.53 () {58 vars in 948 bytes} [Wed Nov 24 16:55:12 2021] POST /identity/v3/auth/tokens => generated 3692 bytes in 127 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 24 16:55:12.724317 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f78dc98d-2547-493e-b1ed-ccfa32c769f4 None None] REQUEST_METHOD: `POST` {{(pid=71939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 24 16:55:12.724671 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f78dc98d-2547-493e-b1ed-ccfa32c769f4 None None] SCRIPT_NAME: `/identity` {{(pid=71939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 24 16:55:12.725010 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f78dc98d-2547-493e-b1ed-ccfa32c769f4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=71939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 24 16:55:12.748609 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.auth.core [None req-f78dc98d-2547-493e-b1ed-ccfa32c769f4 None None] MFA Rules not processed for user `15ece405347842a29fbc06f934028a84`. Rule list: `[]` (Enabled: `True`). {{(pid=71939) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:442}} Nov 24 16:55:12.749857 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.fernet_utils [None req-f78dc98d-2547-493e-b1ed-ccfa32c769f4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=71939) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:289}} Nov 24 16:55:12.756669 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: [pid: 71939|app: 0|req: 1252/2491] 10.222.0.53 () {58 vars in 948 bytes} [Wed Nov 24 16:55:12 2021] POST /identity/v3/auth/tokens => generated 3692 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Nov 24 16:55:12.768780 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f7de531-c6c2-4a74-94db-d1e4000c47c8 None None] Authenticating user token {{(pid=71938) process_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 24 16:55:12.770270 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.fernet_utils [None req-8f7de531-c6c2-4a74-94db-d1e4000c47c8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=71938) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:289}} Nov 24 16:55:12.855622 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f7de531-c6c2-4a74-94db-d1e4000c47c8 None None] Validating token access rules against request {{(pid=71938) validate_allowed_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 24 16:55:12.861109 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1c4bbfd-c880-4fb5-93ac-362c1d1cc1f4 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e196802d4d5432482b6d2eabc25f74e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3b3940d4ae1c4177ae29c02377bb4b0b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'service', 'ResellerAdmin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=71938) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 24 16:55:12.861777 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1c4bbfd-c880-4fb5-93ac-362c1d1cc1f4 service nova] REQUEST_METHOD: `GET` {{(pid=71938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 24 16:55:12.862705 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1c4bbfd-c880-4fb5-93ac-362c1d1cc1f4 service nova] SCRIPT_NAME: `/identity` {{(pid=71938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 24 16:55:12.863038 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1c4bbfd-c880-4fb5-93ac-362c1d1cc1f4 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=71938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 24 16:55:12.871727 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1c4bbfd-c880-4fb5-93ac-362c1d1cc1f4 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=71938) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:442}} Nov 24 16:55:12.900506 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1c4bbfd-c880-4fb5-93ac-362c1d1cc1f4 service nova] RBAC: Authorization granted {{(pid=71938) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 24 16:55:12.911352 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: [pid: 71938|app: 0|req: 1240/2492] 10.222.0.53 () {60 vars in 1356 bytes} [Wed Nov 24 16:55:12 2021] GET /identity/v3/auth/tokens => generated 3692 bytes in 143 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 24 16:55:13.320868 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f78dc98d-2547-493e-b1ed-ccfa32c769f4 None None] Authenticating user token {{(pid=71939) process_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 24 16:55:13.322531 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.fernet_utils [None req-f78dc98d-2547-493e-b1ed-ccfa32c769f4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=71939) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:289}} Nov 24 16:55:13.335273 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f78dc98d-2547-493e-b1ed-ccfa32c769f4 None None] Validating token access rules against request {{(pid=71939) validate_allowed_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 24 16:55:13.339379 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9fa1ee7-d80b-461a-9db4-ab8ec59d0ae5 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c90f21b9cdcb413282461fa83cb6b7a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3b3940d4ae1c4177ae29c02377bb4b0b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=71939) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 24 16:55:13.340037 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9fa1ee7-d80b-461a-9db4-ab8ec59d0ae5 service neutron] REQUEST_METHOD: `GET` {{(pid=71939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 24 16:55:13.340423 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9fa1ee7-d80b-461a-9db4-ab8ec59d0ae5 service neutron] SCRIPT_NAME: `/identity` {{(pid=71939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 24 16:55:13.340797 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9fa1ee7-d80b-461a-9db4-ab8ec59d0ae5 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=71939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 24 16:55:13.342679 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.fernet_utils [None req-c9fa1ee7-d80b-461a-9db4-ab8ec59d0ae5 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=71939) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:289}} Nov 24 16:55:13.352488 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9fa1ee7-d80b-461a-9db4-ab8ec59d0ae5 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=71939) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:442}} Nov 24 16:55:13.381520 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9fa1ee7-d80b-461a-9db4-ab8ec59d0ae5 service neutron] RBAC: Authorization granted {{(pid=71939) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 24 16:55:13.389780 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: [pid: 71939|app: 0|req: 1253/2493] 10.222.0.53 () {60 vars in 1356 bytes} [Wed Nov 24 16:55:13 2021] GET /identity/v3/auth/tokens => generated 3551 bytes in 69 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 24 16:55:13.805193 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1c4bbfd-c880-4fb5-93ac-362c1d1cc1f4 service nova] Authenticating user token {{(pid=71938) process_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 24 16:55:13.806719 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.fernet_utils [None req-e1c4bbfd-c880-4fb5-93ac-362c1d1cc1f4 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=71938) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:289}} Nov 24 16:55:13.888340 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1c4bbfd-c880-4fb5-93ac-362c1d1cc1f4 service nova] Validating token access rules against request {{(pid=71938) validate_allowed_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 24 16:55:13.893319 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c8e4bd4-7078-4d73-8db0-068da97f76fd service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a919320c9e2a48d7ba33453b5929d7ee', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3b3940d4ae1c4177ae29c02377bb4b0b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=71938) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 24 16:55:13.893974 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c8e4bd4-7078-4d73-8db0-068da97f76fd service placement] REQUEST_METHOD: `GET` {{(pid=71938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 24 16:55:13.894387 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c8e4bd4-7078-4d73-8db0-068da97f76fd service placement] SCRIPT_NAME: `/identity` {{(pid=71938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 24 16:55:13.894719 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c8e4bd4-7078-4d73-8db0-068da97f76fd service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=71938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 24 16:55:13.896588 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.fernet_utils [None req-4c8e4bd4-7078-4d73-8db0-068da97f76fd service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=71938) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:289}} Nov 24 16:55:13.907837 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c8e4bd4-7078-4d73-8db0-068da97f76fd service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=71938) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:442}} Nov 24 16:55:13.936730 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c8e4bd4-7078-4d73-8db0-068da97f76fd service placement] RBAC: Authorization granted {{(pid=71938) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 24 16:55:13.946751 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: [pid: 71938|app: 0|req: 1241/2494] 10.222.0.53 () {60 vars in 1356 bytes} [Wed Nov 24 16:55:13 2021] GET /identity/v3/auth/tokens => generated 3738 bytes in 142 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 24 16:55:14.057189 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9fa1ee7-d80b-461a-9db4-ab8ec59d0ae5 service neutron] Authenticating user token {{(pid=71939) process_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 24 16:55:14.058860 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.fernet_utils [None req-c9fa1ee7-d80b-461a-9db4-ab8ec59d0ae5 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=71939) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:289}} Nov 24 16:55:14.073481 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9fa1ee7-d80b-461a-9db4-ab8ec59d0ae5 service neutron] Validating token access rules against request {{(pid=71939) validate_allowed_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 24 16:55:14.078447 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea1b62f8-e937-4867-8106-76e21e1a2d26 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a919320c9e2a48d7ba33453b5929d7ee', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3b3940d4ae1c4177ae29c02377bb4b0b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=71939) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 24 16:55:14.079093 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea1b62f8-e937-4867-8106-76e21e1a2d26 service placement] REQUEST_METHOD: `GET` {{(pid=71939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 24 16:55:14.079434 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea1b62f8-e937-4867-8106-76e21e1a2d26 service placement] SCRIPT_NAME: `/identity` {{(pid=71939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 24 16:55:14.079771 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea1b62f8-e937-4867-8106-76e21e1a2d26 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=71939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 24 16:55:14.082112 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.fernet_utils [None req-ea1b62f8-e937-4867-8106-76e21e1a2d26 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=71939) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:289}} Nov 24 16:55:14.092996 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea1b62f8-e937-4867-8106-76e21e1a2d26 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=71939) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:442}} Nov 24 16:55:14.123727 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea1b62f8-e937-4867-8106-76e21e1a2d26 service placement] RBAC: Authorization granted {{(pid=71939) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 24 16:55:14.134211 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: [pid: 71939|app: 0|req: 1254/2495] 10.222.0.53 () {60 vars in 1356 bytes} [Wed Nov 24 16:55:14 2021] GET /identity/v3/auth/tokens => generated 3738 bytes in 78 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 24 16:55:24.217125 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c8e4bd4-7078-4d73-8db0-068da97f76fd service placement] Authenticating user token {{(pid=71938) process_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 24 16:55:24.218791 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.fernet_utils [None req-4c8e4bd4-7078-4d73-8db0-068da97f76fd service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=71938) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:289}} Nov 24 16:55:24.236437 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c8e4bd4-7078-4d73-8db0-068da97f76fd service placement] Validating token access rules against request {{(pid=71938) validate_allowed_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 24 16:55:24.242629 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e87b302a-0f05-46ce-99bf-3aa013d0aea4 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e196802d4d5432482b6d2eabc25f74e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3b3940d4ae1c4177ae29c02377bb4b0b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'service', 'ResellerAdmin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=71938) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 24 16:55:24.243297 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e87b302a-0f05-46ce-99bf-3aa013d0aea4 service nova] REQUEST_METHOD: `GET` {{(pid=71938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 24 16:55:24.243641 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e87b302a-0f05-46ce-99bf-3aa013d0aea4 service nova] SCRIPT_NAME: `/identity` {{(pid=71938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 24 16:55:24.243977 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e87b302a-0f05-46ce-99bf-3aa013d0aea4 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=71938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 24 16:55:24.246147 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.fernet_utils [None req-e87b302a-0f05-46ce-99bf-3aa013d0aea4 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=71938) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:289}} Nov 24 16:55:24.258818 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e87b302a-0f05-46ce-99bf-3aa013d0aea4 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=71938) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:442}} Nov 24 16:55:24.287429 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e87b302a-0f05-46ce-99bf-3aa013d0aea4 service nova] RBAC: Authorization granted {{(pid=71938) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 24 16:55:24.298700 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: [pid: 71938|app: 0|req: 1242/2496] 10.222.0.53 () {60 vars in 1356 bytes} [Wed Nov 24 16:55:24 2021] GET /identity/v3/auth/tokens => generated 3802 bytes in 82 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 24 16:55:34.324216 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea1b62f8-e937-4867-8106-76e21e1a2d26 service placement] Authenticating user token {{(pid=71939) process_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 24 16:55:34.325778 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.fernet_utils [None req-ea1b62f8-e937-4867-8106-76e21e1a2d26 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=71939) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:289}} Nov 24 16:55:34.394633 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea1b62f8-e937-4867-8106-76e21e1a2d26 service placement] Validating token access rules against request {{(pid=71939) validate_allowed_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 24 16:55:34.398327 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e06174e-828f-4a39-bd4b-1a1d1cc12375 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a12374a3093a401a97c343ff0854184d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3b3940d4ae1c4177ae29c02377bb4b0b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=71939) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 24 16:55:34.398978 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e06174e-828f-4a39-bd4b-1a1d1cc12375 service cinder] REQUEST_METHOD: `GET` {{(pid=71939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 24 16:55:34.399314 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e06174e-828f-4a39-bd4b-1a1d1cc12375 service cinder] SCRIPT_NAME: `/identity` {{(pid=71939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 24 16:55:34.399646 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e06174e-828f-4a39-bd4b-1a1d1cc12375 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=71939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 24 16:55:34.401483 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.fernet_utils [None req-4e06174e-828f-4a39-bd4b-1a1d1cc12375 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=71939) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:289}} Nov 24 16:55:34.472269 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e06174e-828f-4a39-bd4b-1a1d1cc12375 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=71939) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:442}} Nov 24 16:55:34.500608 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e06174e-828f-4a39-bd4b-1a1d1cc12375 service cinder] RBAC: Authorization granted {{(pid=71939) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 24 16:55:34.516275 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: [pid: 71939|app: 0|req: 1255/2497] 10.222.0.53 () {60 vars in 1356 bytes} [Wed Nov 24 16:55:34 2021] GET /identity/v3/auth/tokens => generated 3690 bytes in 193 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 24 16:56:16.876170 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e87b302a-0f05-46ce-99bf-3aa013d0aea4 service nova] Authenticating user token {{(pid=71938) process_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 24 16:56:16.887373 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e87b302a-0f05-46ce-99bf-3aa013d0aea4 service nova] Validating token access rules against request {{(pid=71938) validate_allowed_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 24 16:56:16.892385 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81d18614-84c1-445f-b36a-f81607c23830 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a919320c9e2a48d7ba33453b5929d7ee', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3b3940d4ae1c4177ae29c02377bb4b0b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=71938) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 24 16:56:16.893038 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81d18614-84c1-445f-b36a-f81607c23830 service placement] REQUEST_METHOD: `GET` {{(pid=71938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 24 16:56:16.893377 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81d18614-84c1-445f-b36a-f81607c23830 service placement] SCRIPT_NAME: `/identity` {{(pid=71938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 24 16:56:16.893709 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81d18614-84c1-445f-b36a-f81607c23830 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=71938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 24 16:56:16.895584 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.fernet_utils [None req-81d18614-84c1-445f-b36a-f81607c23830 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=71938) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:289}} Nov 24 16:56:16.907571 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81d18614-84c1-445f-b36a-f81607c23830 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=71938) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:442}} Nov 24 16:56:16.936007 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81d18614-84c1-445f-b36a-f81607c23830 service placement] RBAC: Authorization granted {{(pid=71938) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 24 16:56:16.947006 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: [pid: 71938|app: 0|req: 1243/2498] 10.222.0.53 () {60 vars in 1356 bytes} [Wed Nov 24 16:56:16 2021] GET /identity/v3/auth/tokens => generated 3738 bytes in 71 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 24 16:56:22.134424 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8340855c-ce68-459a-9c42-9ca0b0761b50 None None] REQUEST_METHOD: `POST` {{(pid=71939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 24 16:56:22.134905 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8340855c-ce68-459a-9c42-9ca0b0761b50 None None] SCRIPT_NAME: `/identity` {{(pid=71939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 24 16:56:22.135088 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8340855c-ce68-459a-9c42-9ca0b0761b50 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=71939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 24 16:56:22.159244 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.auth.core [None req-8340855c-ce68-459a-9c42-9ca0b0761b50 None None] MFA Rules not processed for user `b3526b1ee2664fb9a004a17eedce9868`. Rule list: `[]` (Enabled: `True`). {{(pid=71939) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:442}} Nov 24 16:56:22.160460 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.fernet_utils [None req-8340855c-ce68-459a-9c42-9ca0b0761b50 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=71939) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:289}} Nov 24 16:56:22.226340 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: [pid: 71939|app: 0|req: 1256/2499] 10.222.0.53 () {58 vars in 948 bytes} [Wed Nov 24 16:56:22 2021] POST /identity/v3/auth/tokens => generated 3682 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 24 16:56:32.012077 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81d18614-84c1-445f-b36a-f81607c23830 service placement] Authenticating user token {{(pid=71938) process_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 24 16:56:32.022001 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81d18614-84c1-445f-b36a-f81607c23830 service placement] Validating token access rules against request {{(pid=71938) validate_allowed_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 24 16:56:32.025903 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ab64266-ec1c-4c5b-bdb7-ddfb03c32ea4 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c90f21b9cdcb413282461fa83cb6b7a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3b3940d4ae1c4177ae29c02377bb4b0b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=71938) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 24 16:56:32.026602 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ab64266-ec1c-4c5b-bdb7-ddfb03c32ea4 service neutron] REQUEST_METHOD: `GET` {{(pid=71938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 24 16:56:32.026945 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ab64266-ec1c-4c5b-bdb7-ddfb03c32ea4 service neutron] SCRIPT_NAME: `/identity` {{(pid=71938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 24 16:56:32.027325 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ab64266-ec1c-4c5b-bdb7-ddfb03c32ea4 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=71938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 24 16:56:32.029207 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.fernet_utils [None req-7ab64266-ec1c-4c5b-bdb7-ddfb03c32ea4 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=71938) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:289}} Nov 24 16:56:32.041848 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ab64266-ec1c-4c5b-bdb7-ddfb03c32ea4 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=71938) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:442}} Nov 24 16:56:32.070564 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ab64266-ec1c-4c5b-bdb7-ddfb03c32ea4 service neutron] RBAC: Authorization granted {{(pid=71938) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 24 16:56:32.080275 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: [pid: 71938|app: 0|req: 1244/2500] 10.222.0.53 () {60 vars in 1356 bytes} [Wed Nov 24 16:56:32 2021] GET /identity/v3/auth/tokens => generated 3669 bytes in 69 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 24 16:56:38.372547 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8340855c-ce68-459a-9c42-9ca0b0761b50 None None] Authenticating user token {{(pid=71939) process_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 24 16:56:38.374041 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.fernet_utils [None req-8340855c-ce68-459a-9c42-9ca0b0761b50 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=71939) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:289}} Nov 24 16:56:38.389141 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8340855c-ce68-459a-9c42-9ca0b0761b50 None None] Validating token access rules against request {{(pid=71939) validate_allowed_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 24 16:56:38.394477 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c65de87-94ee-446b-9001-e77bb50e7a97 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f2ba2e8375b4e8c8792ee1e22b60427', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '00a5583c7b7443e98e7a1d31a0b638dc', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=71939) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 24 16:56:38.395625 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c65de87-94ee-446b-9001-e77bb50e7a97 admin admin] REQUEST_METHOD: `DELETE` {{(pid=71939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 24 16:56:38.396092 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c65de87-94ee-446b-9001-e77bb50e7a97 admin admin] SCRIPT_NAME: `/identity` {{(pid=71939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 24 16:56:38.396556 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c65de87-94ee-446b-9001-e77bb50e7a97 admin admin] PATH_INFO: `/v3/users/1e837ea3812449029236efda9a2d6448` {{(pid=71939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 24 16:56:38.398833 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c65de87-94ee-446b-9001-e77bb50e7a97 admin admin] RBAC: Authorizing `identity:delete_user(user_id=1e837ea3812449029236efda9a2d6448)` {{(pid=71939) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:442}} Nov 24 16:56:38.430978 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c65de87-94ee-446b-9001-e77bb50e7a97 admin admin] RBAC: Authorization granted {{(pid=71939) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 24 16:56:38.504853 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.notifications [None req-2c65de87-94ee-446b-9001-e77bb50e7a97 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '1e837ea3812449029236efda9a2d6448'} {{(pid=71939) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:357}} Nov 24 16:56:38.518518 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.notifications [None req-2c65de87-94ee-446b-9001-e77bb50e7a97 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '1e837ea3812449029236efda9a2d6448'} {{(pid=71939) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:357}} Nov 24 16:56:38.519384 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.notifications [None req-2c65de87-94ee-446b-9001-e77bb50e7a97 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '1e837ea3812449029236efda9a2d6448'} {{(pid=71939) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:357}} Nov 24 16:56:38.528111 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.notifications [None req-2c65de87-94ee-446b-9001-e77bb50e7a97 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '1e837ea3812449029236efda9a2d6448'} {{(pid=71939) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:357}} Nov 24 16:56:38.534496 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.notifications [None req-2c65de87-94ee-446b-9001-e77bb50e7a97 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '1e837ea3812449029236efda9a2d6448'} {{(pid=71939) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:357}} Nov 24 16:56:38.540903 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: [pid: 71939|app: 0|req: 1257/2501] 10.222.0.53 () {58 vars in 1214 bytes} [Wed Nov 24 16:56:38 2021] DELETE /identity/v3/users/1e837ea3812449029236efda9a2d6448 => generated 0 bytes in 169 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 24 16:56:38.777483 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ab64266-ec1c-4c5b-bdb7-ddfb03c32ea4 service neutron] Authenticating user token {{(pid=71938) process_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 24 16:56:38.789227 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ab64266-ec1c-4c5b-bdb7-ddfb03c32ea4 service neutron] Validating token access rules against request {{(pid=71938) validate_allowed_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 24 16:56:38.856897 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf3cbe5b-2c13-4215-add8-58fcd4f546b8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f2ba2e8375b4e8c8792ee1e22b60427', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '00a5583c7b7443e98e7a1d31a0b638dc', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=71938) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 24 16:56:38.857828 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf3cbe5b-2c13-4215-add8-58fcd4f546b8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=71938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 24 16:56:38.858227 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf3cbe5b-2c13-4215-add8-58fcd4f546b8 admin admin] SCRIPT_NAME: `/identity` {{(pid=71938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 24 16:56:38.858563 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf3cbe5b-2c13-4215-add8-58fcd4f546b8 admin admin] PATH_INFO: `/v3/projects/7b770c1ee1024ee4807e284a94960fd0` {{(pid=71938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 24 16:56:38.859796 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf3cbe5b-2c13-4215-add8-58fcd4f546b8 admin admin] RBAC: Authorizing `identity:delete_project(project_id=7b770c1ee1024ee4807e284a94960fd0)` {{(pid=71938) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:442}} Nov 24 16:56:38.889006 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf3cbe5b-2c13-4215-add8-58fcd4f546b8 admin admin] RBAC: Authorization granted {{(pid=71938) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 24 16:56:38.942579 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.notifications [None req-bf3cbe5b-2c13-4215-add8-58fcd4f546b8 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '7b770c1ee1024ee4807e284a94960fd0', 'request_id': 'req-bf3cbe5b-2c13-4215-add8-58fcd4f546b8'} {{(pid=71938) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:357}} Nov 24 16:56:38.954502 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.notifications [None req-bf3cbe5b-2c13-4215-add8-58fcd4f546b8 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '7b770c1ee1024ee4807e284a94960fd0', 'request_id': 'req-bf3cbe5b-2c13-4215-add8-58fcd4f546b8'} {{(pid=71938) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:357}} Nov 24 16:56:38.959856 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.notifications [None req-bf3cbe5b-2c13-4215-add8-58fcd4f546b8 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '7b770c1ee1024ee4807e284a94960fd0', 'request_id': 'req-bf3cbe5b-2c13-4215-add8-58fcd4f546b8'} {{(pid=71938) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:357}} Nov 24 16:56:38.971479 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.notifications [None req-bf3cbe5b-2c13-4215-add8-58fcd4f546b8 admin admin] The token cache is being invalidate because project 7b770c1ee1024ee4807e284a94960fd0 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=71938) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Nov 24 16:56:38.971814 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.notifications [None req-bf3cbe5b-2c13-4215-add8-58fcd4f546b8 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=71938) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:357}} Nov 24 16:56:38.972489 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.notifications [None req-bf3cbe5b-2c13-4215-add8-58fcd4f546b8 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=71938) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:357}} Nov 24 16:56:38.974080 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: [pid: 71938|app: 0|req: 1245/2502] 10.222.0.53 () {58 vars in 1223 bytes} [Wed Nov 24 16:56:38 2021] DELETE /identity/v3/projects/7b770c1ee1024ee4807e284a94960fd0 => generated 0 bytes in 197 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 24 16:56:38.982134 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be2f72a0-8df8-4d3d-a368-b2e3da5c9f52 None None] REQUEST_METHOD: `POST` {{(pid=71939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 24 16:56:38.982488 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be2f72a0-8df8-4d3d-a368-b2e3da5c9f52 None None] SCRIPT_NAME: `/identity` {{(pid=71939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 24 16:56:38.982824 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be2f72a0-8df8-4d3d-a368-b2e3da5c9f52 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=71939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 24 16:56:39.006810 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.auth.core [None req-be2f72a0-8df8-4d3d-a368-b2e3da5c9f52 None None] MFA Rules not processed for user `0f2ba2e8375b4e8c8792ee1e22b60427`. Rule list: `[]` (Enabled: `True`). {{(pid=71939) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:442}} Nov 24 16:56:39.008027 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.fernet_utils [None req-be2f72a0-8df8-4d3d-a368-b2e3da5c9f52 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=71939) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:289}} Nov 24 16:56:39.080992 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: [pid: 71939|app: 0|req: 1258/2503] 10.222.0.53 () {58 vars in 948 bytes} [Wed Nov 24 16:56:38 2021] POST /identity/v3/auth/tokens => generated 3669 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Nov 24 16:56:39.089014 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-332a5735-c80d-4ec0-bb20-bed8a827d8d4 None None] REQUEST_METHOD: `POST` {{(pid=71938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 24 16:56:39.089364 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-332a5735-c80d-4ec0-bb20-bed8a827d8d4 None None] SCRIPT_NAME: `/identity` {{(pid=71938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 24 16:56:39.089701 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-332a5735-c80d-4ec0-bb20-bed8a827d8d4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=71938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 24 16:56:39.113642 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.auth.core [None req-332a5735-c80d-4ec0-bb20-bed8a827d8d4 None None] MFA Rules not processed for user `0f2ba2e8375b4e8c8792ee1e22b60427`. Rule list: `[]` (Enabled: `True`). {{(pid=71938) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:442}} Nov 24 16:56:39.114900 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.fernet_utils [None req-332a5735-c80d-4ec0-bb20-bed8a827d8d4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=71938) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:289}} Nov 24 16:56:39.122656 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: [pid: 71938|app: 0|req: 1246/2504] 10.222.0.53 () {58 vars in 948 bytes} [Wed Nov 24 16:56:39 2021] POST /identity/v3/auth/tokens => generated 3669 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 24 16:56:39.127196 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be2f72a0-8df8-4d3d-a368-b2e3da5c9f52 None None] Authenticating user token {{(pid=71939) process_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 24 16:56:39.137124 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be2f72a0-8df8-4d3d-a368-b2e3da5c9f52 None None] Validating token access rules against request {{(pid=71939) validate_allowed_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 24 16:56:39.141799 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94a0fcb9-8c73-4d96-a006-2443143c5dbf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f2ba2e8375b4e8c8792ee1e22b60427', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '00a5583c7b7443e98e7a1d31a0b638dc', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=71939) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 24 16:56:39.143040 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94a0fcb9-8c73-4d96-a006-2443143c5dbf admin admin] REQUEST_METHOD: `GET` {{(pid=71939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 24 16:56:39.143377 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94a0fcb9-8c73-4d96-a006-2443143c5dbf admin admin] SCRIPT_NAME: `/identity` {{(pid=71939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 24 16:56:39.143705 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94a0fcb9-8c73-4d96-a006-2443143c5dbf admin admin] PATH_INFO: `/v3/domains` {{(pid=71939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 24 16:56:39.144496 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94a0fcb9-8c73-4d96-a006-2443143c5dbf admin admin] RBAC: Adding query filter params (name=Default) {{(pid=71939) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:161}} Nov 24 16:56:39.144841 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94a0fcb9-8c73-4d96-a006-2443143c5dbf admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=71939) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:442}} Nov 24 16:56:39.174237 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94a0fcb9-8c73-4d96-a006-2443143c5dbf admin admin] RBAC: Authorization granted {{(pid=71939) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 24 16:56:39.188678 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: [pid: 71939|app: 0|req: 1259/2505] 10.222.0.53 () {58 vars in 1143 bytes} [Wed Nov 24 16:56:39 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 62 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 24 16:56:39.193347 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-332a5735-c80d-4ec0-bb20-bed8a827d8d4 None None] Authenticating user token {{(pid=71938) process_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 24 16:56:39.209137 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-332a5735-c80d-4ec0-bb20-bed8a827d8d4 None None] Validating token access rules against request {{(pid=71938) validate_allowed_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 24 16:56:39.223391 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86e3cdac-0724-4519-ba11-c228111199e2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f2ba2e8375b4e8c8792ee1e22b60427', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '00a5583c7b7443e98e7a1d31a0b638dc', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=71938) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 24 16:56:39.224082 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86e3cdac-0724-4519-ba11-c228111199e2 admin admin] REQUEST_METHOD: `POST` {{(pid=71938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 24 16:56:39.224421 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86e3cdac-0724-4519-ba11-c228111199e2 admin admin] SCRIPT_NAME: `/identity` {{(pid=71938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 24 16:56:39.224756 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86e3cdac-0724-4519-ba11-c228111199e2 admin admin] PATH_INFO: `/v3/projects` {{(pid=71938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 24 16:56:39.225502 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86e3cdac-0724-4519-ba11-c228111199e2 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=71938) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:442}} Nov 24 16:56:39.274439 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86e3cdac-0724-4519-ba11-c228111199e2 admin admin] RBAC: Authorization granted {{(pid=71938) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 24 16:56:39.310554 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: [pid: 71938|app: 0|req: 1247/2506] 10.222.0.53 () {60 vars in 1143 bytes} [Wed Nov 24 16:56:39 2021] POST /identity/v3/projects => generated 373 bytes in 117 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 24 16:56:39.312231 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94a0fcb9-8c73-4d96-a006-2443143c5dbf admin admin] Authenticating user token {{(pid=71939) process_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 24 16:56:39.322982 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94a0fcb9-8c73-4d96-a006-2443143c5dbf admin admin] Validating token access rules against request {{(pid=71939) validate_allowed_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 24 16:56:39.402425 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e68f5d6-af24-4297-a268-7955ae7638c7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f2ba2e8375b4e8c8792ee1e22b60427', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '00a5583c7b7443e98e7a1d31a0b638dc', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=71939) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 24 16:56:39.403112 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e68f5d6-af24-4297-a268-7955ae7638c7 admin admin] REQUEST_METHOD: `POST` {{(pid=71939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 24 16:56:39.403456 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e68f5d6-af24-4297-a268-7955ae7638c7 admin admin] SCRIPT_NAME: `/identity` {{(pid=71939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 24 16:56:39.403801 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e68f5d6-af24-4297-a268-7955ae7638c7 admin admin] PATH_INFO: `/v3/users` {{(pid=71939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 24 16:56:39.404520 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e68f5d6-af24-4297-a268-7955ae7638c7 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=71939) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:442}} Nov 24 16:56:39.433458 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e68f5d6-af24-4297-a268-7955ae7638c7 admin admin] RBAC: Authorization granted {{(pid=71939) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 24 16:56:39.462085 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: [pid: 71939|app: 0|req: 1260/2507] 10.222.0.53 () {60 vars in 1134 bytes} [Wed Nov 24 16:56:39 2021] POST /identity/v3/users => generated 287 bytes in 150 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 24 16:56:39.466353 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86e3cdac-0724-4519-ba11-c228111199e2 admin admin] Authenticating user token {{(pid=71938) process_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 24 16:56:39.478460 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86e3cdac-0724-4519-ba11-c228111199e2 admin admin] Validating token access rules against request {{(pid=71938) validate_allowed_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 24 16:56:39.483672 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a051822-f672-4d2f-8430-041584a84b3b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f2ba2e8375b4e8c8792ee1e22b60427', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '00a5583c7b7443e98e7a1d31a0b638dc', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=71938) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 24 16:56:39.484909 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a051822-f672-4d2f-8430-041584a84b3b admin admin] REQUEST_METHOD: `GET` {{(pid=71938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 24 16:56:39.485326 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a051822-f672-4d2f-8430-041584a84b3b admin admin] SCRIPT_NAME: `/identity` {{(pid=71938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 24 16:56:39.485784 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a051822-f672-4d2f-8430-041584a84b3b admin admin] PATH_INFO: `/v3/roles` {{(pid=71938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 24 16:56:39.487472 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a051822-f672-4d2f-8430-041584a84b3b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=71938) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:442}} Nov 24 16:56:39.526774 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a051822-f672-4d2f-8430-041584a84b3b admin admin] RBAC: Authorization granted {{(pid=71938) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 24 16:56:39.541504 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: [pid: 71938|app: 0|req: 1248/2508] 10.222.0.53 () {58 vars in 1112 bytes} [Wed Nov 24 16:56:39 2021] GET /identity/v3/roles => generated 1420 bytes in 76 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 24 16:56:39.545596 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e68f5d6-af24-4297-a268-7955ae7638c7 admin admin] Authenticating user token {{(pid=71939) process_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 24 16:56:39.557950 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e68f5d6-af24-4297-a268-7955ae7638c7 admin admin] Validating token access rules against request {{(pid=71939) validate_allowed_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 24 16:56:39.564767 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2e37a17-e385-40cf-894d-881d1c7b95cc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f2ba2e8375b4e8c8792ee1e22b60427', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '00a5583c7b7443e98e7a1d31a0b638dc', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=71939) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 24 16:56:39.565681 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2e37a17-e385-40cf-894d-881d1c7b95cc admin admin] REQUEST_METHOD: `PUT` {{(pid=71939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 24 16:56:39.566016 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2e37a17-e385-40cf-894d-881d1c7b95cc admin admin] SCRIPT_NAME: `/identity` {{(pid=71939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 24 16:56:39.566418 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2e37a17-e385-40cf-894d-881d1c7b95cc admin admin] PATH_INFO: `/v3/projects/3c68df8b43024f92a5956f8f51b06561/users/2d66a760317140beaa29f7f5eb49cd7e/roles/912ab5f10fa5477da74acf239f07604e` {{(pid=71939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 24 16:56:39.590478 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2e37a17-e385-40cf-894d-881d1c7b95cc admin admin] RBAC: Authorizing `identity:create_grant(project_id=3c68df8b43024f92a5956f8f51b06561, user_id=2d66a760317140beaa29f7f5eb49cd7e, role_id=912ab5f10fa5477da74acf239f07604e)` {{(pid=71939) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:442}} Nov 24 16:56:39.625277 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2e37a17-e385-40cf-894d-881d1c7b95cc admin admin] RBAC: Authorization granted {{(pid=71939) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 24 16:56:39.645235 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: [pid: 71939|app: 0|req: 1261/2509] 10.222.0.53 () {60 vars in 1473 bytes} [Wed Nov 24 16:56:39 2021] PUT /identity/v3/projects/3c68df8b43024f92a5956f8f51b06561/users/2d66a760317140beaa29f7f5eb49cd7e/roles/912ab5f10fa5477da74acf239f07604e => generated 0 bytes in 100 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 24 16:56:39.665026 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2494eade-87da-4593-8efd-d69b4d323925 None None] REQUEST_METHOD: `POST` {{(pid=71938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 24 16:56:39.665373 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2494eade-87da-4593-8efd-d69b4d323925 None None] SCRIPT_NAME: `/identity` {{(pid=71938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 24 16:56:39.665707 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2494eade-87da-4593-8efd-d69b4d323925 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=71938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 24 16:56:39.709614 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.auth.core [None req-2494eade-87da-4593-8efd-d69b4d323925 None None] MFA Rules not processed for user `2d66a760317140beaa29f7f5eb49cd7e`. Rule list: `[]` (Enabled: `True`). {{(pid=71938) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:442}} Nov 24 16:56:39.710897 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.fernet_utils [None req-2494eade-87da-4593-8efd-d69b4d323925 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=71938) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:289}} Nov 24 16:56:39.801793 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: [pid: 71938|app: 0|req: 1249/2510] 10.222.0.53 () {58 vars in 948 bytes} [Wed Nov 24 16:56:39 2021] POST /identity/v3/auth/tokens => generated 3680 bytes in 138 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 24 16:56:39.816009 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2e37a17-e385-40cf-894d-881d1c7b95cc admin admin] Authenticating user token {{(pid=71939) process_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 24 16:56:39.817916 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.fernet_utils [None req-f2e37a17-e385-40cf-894d-881d1c7b95cc admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=71939) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:289}} Nov 24 16:56:39.916502 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2e37a17-e385-40cf-894d-881d1c7b95cc admin admin] Validating token access rules against request {{(pid=71939) validate_allowed_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 24 16:56:39.924234 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afbe5d1f-b907-4239-83de-0cd36e04b5b7 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e196802d4d5432482b6d2eabc25f74e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3b3940d4ae1c4177ae29c02377bb4b0b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'service', 'ResellerAdmin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=71939) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 24 16:56:39.924899 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afbe5d1f-b907-4239-83de-0cd36e04b5b7 service nova] REQUEST_METHOD: `GET` {{(pid=71939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 24 16:56:39.925239 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afbe5d1f-b907-4239-83de-0cd36e04b5b7 service nova] SCRIPT_NAME: `/identity` {{(pid=71939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 24 16:56:39.926327 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afbe5d1f-b907-4239-83de-0cd36e04b5b7 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=71939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 24 16:56:39.934489 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afbe5d1f-b907-4239-83de-0cd36e04b5b7 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=71939) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:442}} Nov 24 16:56:39.963206 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afbe5d1f-b907-4239-83de-0cd36e04b5b7 service nova] RBAC: Authorization granted {{(pid=71939) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 24 16:56:39.974264 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: [pid: 71939|app: 0|req: 1262/2511] 10.222.0.53 () {60 vars in 1356 bytes} [Wed Nov 24 16:56:39 2021] GET /identity/v3/auth/tokens => generated 3680 bytes in 159 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 24 16:56:40.345349 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2494eade-87da-4593-8efd-d69b4d323925 None None] Authenticating user token {{(pid=71938) process_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 24 16:56:40.447314 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2494eade-87da-4593-8efd-d69b4d323925 None None] Validating token access rules against request {{(pid=71938) validate_allowed_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 24 16:56:40.452976 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4dd59f1-1a18-4946-b88a-5975d85e350a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f2ba2e8375b4e8c8792ee1e22b60427', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '00a5583c7b7443e98e7a1d31a0b638dc', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=71938) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 24 16:56:40.453965 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4dd59f1-1a18-4946-b88a-5975d85e350a admin admin] REQUEST_METHOD: `DELETE` {{(pid=71938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 24 16:56:40.454404 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4dd59f1-1a18-4946-b88a-5975d85e350a admin admin] SCRIPT_NAME: `/identity` {{(pid=71938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 24 16:56:40.455508 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4dd59f1-1a18-4946-b88a-5975d85e350a admin admin] PATH_INFO: `/v3/users/2d66a760317140beaa29f7f5eb49cd7e` {{(pid=71938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 24 16:56:40.456908 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4dd59f1-1a18-4946-b88a-5975d85e350a admin admin] RBAC: Authorizing `identity:delete_user(user_id=2d66a760317140beaa29f7f5eb49cd7e)` {{(pid=71938) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:442}} Nov 24 16:56:40.487334 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4dd59f1-1a18-4946-b88a-5975d85e350a admin admin] RBAC: Authorization granted {{(pid=71938) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 24 16:56:40.541253 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.notifications [None req-c4dd59f1-1a18-4946-b88a-5975d85e350a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '2d66a760317140beaa29f7f5eb49cd7e'} {{(pid=71938) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:357}} Nov 24 16:56:40.553916 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.notifications [None req-c4dd59f1-1a18-4946-b88a-5975d85e350a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '2d66a760317140beaa29f7f5eb49cd7e'} {{(pid=71938) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:357}} Nov 24 16:56:40.554691 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.notifications [None req-c4dd59f1-1a18-4946-b88a-5975d85e350a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '2d66a760317140beaa29f7f5eb49cd7e'} {{(pid=71938) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:357}} Nov 24 16:56:40.563410 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.notifications [None req-c4dd59f1-1a18-4946-b88a-5975d85e350a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '2d66a760317140beaa29f7f5eb49cd7e'} {{(pid=71938) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:357}} Nov 24 16:56:40.570457 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.notifications [None req-c4dd59f1-1a18-4946-b88a-5975d85e350a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '2d66a760317140beaa29f7f5eb49cd7e'} {{(pid=71938) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:357}} Nov 24 16:56:40.576955 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: [pid: 71938|app: 0|req: 1250/2512] 10.222.0.53 () {58 vars in 1214 bytes} [Wed Nov 24 16:56:40 2021] DELETE /identity/v3/users/2d66a760317140beaa29f7f5eb49cd7e => generated 0 bytes in 232 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 24 16:56:40.581641 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cf080ee-3649-41c3-bed5-35c4765abf07 None None] REQUEST_METHOD: `POST` {{(pid=71939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 24 16:56:40.582046 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cf080ee-3649-41c3-bed5-35c4765abf07 None None] SCRIPT_NAME: `/identity` {{(pid=71939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 24 16:56:40.582383 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cf080ee-3649-41c3-bed5-35c4765abf07 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=71939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 24 16:56:40.606452 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.auth.core [None req-5cf080ee-3649-41c3-bed5-35c4765abf07 None None] MFA Rules not processed for user `0f2ba2e8375b4e8c8792ee1e22b60427`. Rule list: `[]` (Enabled: `True`). {{(pid=71939) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:442}} Nov 24 16:56:40.607696 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.fernet_utils [None req-5cf080ee-3649-41c3-bed5-35c4765abf07 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=71939) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:289}} Nov 24 16:56:40.680380 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: [pid: 71939|app: 0|req: 1263/2513] 10.222.0.53 () {58 vars in 948 bytes} [Wed Nov 24 16:56:40 2021] POST /identity/v3/auth/tokens => generated 3669 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Nov 24 16:56:40.692886 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4dd59f1-1a18-4946-b88a-5975d85e350a admin admin] Authenticating user token {{(pid=71938) process_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 24 16:56:40.694455 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.fernet_utils [None req-c4dd59f1-1a18-4946-b88a-5975d85e350a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=71938) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:289}} Nov 24 16:56:40.775456 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4dd59f1-1a18-4946-b88a-5975d85e350a admin admin] Validating token access rules against request {{(pid=71938) validate_allowed_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 24 16:56:40.779924 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-796022f5-183a-4853-81ce-991aeb13d66c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c90f21b9cdcb413282461fa83cb6b7a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3b3940d4ae1c4177ae29c02377bb4b0b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=71938) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 24 16:56:40.780594 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-796022f5-183a-4853-81ce-991aeb13d66c service neutron] REQUEST_METHOD: `GET` {{(pid=71938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 24 16:56:40.780936 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-796022f5-183a-4853-81ce-991aeb13d66c service neutron] SCRIPT_NAME: `/identity` {{(pid=71938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 24 16:56:40.781269 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-796022f5-183a-4853-81ce-991aeb13d66c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=71938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 24 16:56:40.793866 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-796022f5-183a-4853-81ce-991aeb13d66c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=71938) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:442}} Nov 24 16:56:40.822112 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-796022f5-183a-4853-81ce-991aeb13d66c service neutron] RBAC: Authorization granted {{(pid=71938) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 24 16:56:40.832754 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: [pid: 71938|app: 0|req: 1251/2514] 10.222.0.53 () {60 vars in 1356 bytes} [Wed Nov 24 16:56:40 2021] GET /identity/v3/auth/tokens => generated 3669 bytes in 140 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 24 16:56:41.276375 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cf080ee-3649-41c3-bed5-35c4765abf07 None None] Authenticating user token {{(pid=71939) process_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 24 16:56:41.279079 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.fernet_utils [None req-5cf080ee-3649-41c3-bed5-35c4765abf07 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=71939) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:289}} Nov 24 16:56:41.292430 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cf080ee-3649-41c3-bed5-35c4765abf07 None None] Validating token access rules against request {{(pid=71939) validate_allowed_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 24 16:56:41.297293 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af8d11c7-f8e2-4c3a-8524-4e39b4d8da3b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f2ba2e8375b4e8c8792ee1e22b60427', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '00a5583c7b7443e98e7a1d31a0b638dc', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=71939) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 24 16:56:41.298243 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af8d11c7-f8e2-4c3a-8524-4e39b4d8da3b admin admin] REQUEST_METHOD: `DELETE` {{(pid=71939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 24 16:56:41.299172 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af8d11c7-f8e2-4c3a-8524-4e39b4d8da3b admin admin] SCRIPT_NAME: `/identity` {{(pid=71939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 24 16:56:41.299435 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af8d11c7-f8e2-4c3a-8524-4e39b4d8da3b admin admin] PATH_INFO: `/v3/projects/3c68df8b43024f92a5956f8f51b06561` {{(pid=71939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 24 16:56:41.300691 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af8d11c7-f8e2-4c3a-8524-4e39b4d8da3b admin admin] RBAC: Authorizing `identity:delete_project(project_id=3c68df8b43024f92a5956f8f51b06561)` {{(pid=71939) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:442}} Nov 24 16:56:41.330643 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af8d11c7-f8e2-4c3a-8524-4e39b4d8da3b admin admin] RBAC: Authorization granted {{(pid=71939) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 24 16:56:41.398235 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.notifications [None req-af8d11c7-f8e2-4c3a-8524-4e39b4d8da3b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '3c68df8b43024f92a5956f8f51b06561', 'request_id': 'req-af8d11c7-f8e2-4c3a-8524-4e39b4d8da3b'} {{(pid=71939) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:357}} Nov 24 16:56:41.411900 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.notifications [None req-af8d11c7-f8e2-4c3a-8524-4e39b4d8da3b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '3c68df8b43024f92a5956f8f51b06561', 'request_id': 'req-af8d11c7-f8e2-4c3a-8524-4e39b4d8da3b'} {{(pid=71939) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:357}} Nov 24 16:56:41.419065 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.notifications [None req-af8d11c7-f8e2-4c3a-8524-4e39b4d8da3b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '3c68df8b43024f92a5956f8f51b06561', 'request_id': 'req-af8d11c7-f8e2-4c3a-8524-4e39b4d8da3b'} {{(pid=71939) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:357}} Nov 24 16:56:41.431065 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.notifications [None req-af8d11c7-f8e2-4c3a-8524-4e39b4d8da3b admin admin] The token cache is being invalidate because project 3c68df8b43024f92a5956f8f51b06561 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=71939) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Nov 24 16:56:41.431627 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.notifications [None req-af8d11c7-f8e2-4c3a-8524-4e39b4d8da3b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=71939) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:357}} Nov 24 16:56:41.432444 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.notifications [None req-af8d11c7-f8e2-4c3a-8524-4e39b4d8da3b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=71939) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:357}} Nov 24 16:56:41.434167 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: [pid: 71939|app: 0|req: 1264/2515] 10.222.0.53 () {58 vars in 1223 bytes} [Wed Nov 24 16:56:41 2021] DELETE /identity/v3/projects/3c68df8b43024f92a5956f8f51b06561 => generated 0 bytes in 159 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 24 16:56:41.443290 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c599b101-4c84-4623-84d8-6ef02cf07573 None None] REQUEST_METHOD: `POST` {{(pid=71938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 24 16:56:41.443638 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c599b101-4c84-4623-84d8-6ef02cf07573 None None] SCRIPT_NAME: `/identity` {{(pid=71938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 24 16:56:41.443971 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c599b101-4c84-4623-84d8-6ef02cf07573 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=71938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 24 16:56:41.471869 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.auth.core [None req-c599b101-4c84-4623-84d8-6ef02cf07573 None None] MFA Rules not processed for user `0f2ba2e8375b4e8c8792ee1e22b60427`. Rule list: `[]` (Enabled: `True`). {{(pid=71938) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:442}} Nov 24 16:56:41.473122 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.fernet_utils [None req-c599b101-4c84-4623-84d8-6ef02cf07573 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=71938) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:289}} Nov 24 16:56:41.543716 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: [pid: 71938|app: 0|req: 1252/2516] 10.222.0.53 () {58 vars in 948 bytes} [Wed Nov 24 16:56:41 2021] POST /identity/v3/auth/tokens => generated 3669 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 24 16:56:41.553736 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5597f23f-c420-4afc-be86-8ceb369ab8a3 None None] REQUEST_METHOD: `POST` {{(pid=71939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 24 16:56:41.554099 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5597f23f-c420-4afc-be86-8ceb369ab8a3 None None] SCRIPT_NAME: `/identity` {{(pid=71939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 24 16:56:41.554420 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5597f23f-c420-4afc-be86-8ceb369ab8a3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=71939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 24 16:56:41.578966 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.auth.core [None req-5597f23f-c420-4afc-be86-8ceb369ab8a3 None None] MFA Rules not processed for user `0f2ba2e8375b4e8c8792ee1e22b60427`. Rule list: `[]` (Enabled: `True`). {{(pid=71939) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:442}} Nov 24 16:56:41.580270 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.fernet_utils [None req-5597f23f-c420-4afc-be86-8ceb369ab8a3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=71939) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:289}} Nov 24 16:56:41.590175 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: [pid: 71939|app: 0|req: 1265/2517] 10.222.0.53 () {58 vars in 948 bytes} [Wed Nov 24 16:56:41 2021] POST /identity/v3/auth/tokens => generated 3669 bytes in 37 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 24 16:56:41.594830 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c599b101-4c84-4623-84d8-6ef02cf07573 None None] Authenticating user token {{(pid=71938) process_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 24 16:56:41.604777 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c599b101-4c84-4623-84d8-6ef02cf07573 None None] Validating token access rules against request {{(pid=71938) validate_allowed_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 24 16:56:41.609324 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74b52bc9-bee5-4922-91f6-b47d461bdc54 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f2ba2e8375b4e8c8792ee1e22b60427', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '00a5583c7b7443e98e7a1d31a0b638dc', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=71938) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 24 16:56:41.609990 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74b52bc9-bee5-4922-91f6-b47d461bdc54 admin admin] REQUEST_METHOD: `GET` {{(pid=71938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 24 16:56:41.610354 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74b52bc9-bee5-4922-91f6-b47d461bdc54 admin admin] SCRIPT_NAME: `/identity` {{(pid=71938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 24 16:56:41.610683 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74b52bc9-bee5-4922-91f6-b47d461bdc54 admin admin] PATH_INFO: `/v3/domains` {{(pid=71938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 24 16:56:41.612006 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74b52bc9-bee5-4922-91f6-b47d461bdc54 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=71938) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:161}} Nov 24 16:56:41.612352 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74b52bc9-bee5-4922-91f6-b47d461bdc54 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=71938) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:442}} Nov 24 16:56:41.641911 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74b52bc9-bee5-4922-91f6-b47d461bdc54 admin admin] RBAC: Authorization granted {{(pid=71938) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 24 16:56:41.656092 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: [pid: 71938|app: 0|req: 1253/2518] 10.222.0.53 () {58 vars in 1143 bytes} [Wed Nov 24 16:56:41 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 62 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 24 16:56:41.660956 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5597f23f-c420-4afc-be86-8ceb369ab8a3 None None] Authenticating user token {{(pid=71939) process_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 24 16:56:41.670395 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5597f23f-c420-4afc-be86-8ceb369ab8a3 None None] Validating token access rules against request {{(pid=71939) validate_allowed_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 24 16:56:41.675946 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-486c7b97-ed1f-4307-9e4c-f5b6a5b2c018 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f2ba2e8375b4e8c8792ee1e22b60427', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '00a5583c7b7443e98e7a1d31a0b638dc', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=71939) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 24 16:56:41.676660 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-486c7b97-ed1f-4307-9e4c-f5b6a5b2c018 admin admin] REQUEST_METHOD: `POST` {{(pid=71939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 24 16:56:41.676999 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-486c7b97-ed1f-4307-9e4c-f5b6a5b2c018 admin admin] SCRIPT_NAME: `/identity` {{(pid=71939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 24 16:56:41.677335 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-486c7b97-ed1f-4307-9e4c-f5b6a5b2c018 admin admin] PATH_INFO: `/v3/projects` {{(pid=71939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 24 16:56:41.678103 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-486c7b97-ed1f-4307-9e4c-f5b6a5b2c018 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=71939) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:442}} Nov 24 16:56:41.707697 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-486c7b97-ed1f-4307-9e4c-f5b6a5b2c018 admin admin] RBAC: Authorization granted {{(pid=71939) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 24 16:56:41.735543 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: [pid: 71939|app: 0|req: 1266/2519] 10.222.0.53 () {60 vars in 1143 bytes} [Wed Nov 24 16:56:41 2021] POST /identity/v3/projects => generated 401 bytes in 75 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 24 16:56:41.740678 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74b52bc9-bee5-4922-91f6-b47d461bdc54 admin admin] Authenticating user token {{(pid=71938) process_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 24 16:56:41.751312 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74b52bc9-bee5-4922-91f6-b47d461bdc54 admin admin] Validating token access rules against request {{(pid=71938) validate_allowed_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 24 16:56:41.829082 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c45a91d5-1736-4d70-9483-0389af89b21b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f2ba2e8375b4e8c8792ee1e22b60427', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '00a5583c7b7443e98e7a1d31a0b638dc', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=71938) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 24 16:56:41.830127 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c45a91d5-1736-4d70-9483-0389af89b21b admin admin] REQUEST_METHOD: `POST` {{(pid=71938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 24 16:56:41.830262 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c45a91d5-1736-4d70-9483-0389af89b21b admin admin] SCRIPT_NAME: `/identity` {{(pid=71938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 24 16:56:41.830512 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c45a91d5-1736-4d70-9483-0389af89b21b admin admin] PATH_INFO: `/v3/users` {{(pid=71938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 24 16:56:41.831566 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c45a91d5-1736-4d70-9483-0389af89b21b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=71938) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:442}} Nov 24 16:56:41.864258 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c45a91d5-1736-4d70-9483-0389af89b21b admin admin] RBAC: Authorization granted {{(pid=71938) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 24 16:56:41.884200 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: [pid: 71938|app: 0|req: 1254/2520] 10.222.0.53 () {60 vars in 1134 bytes} [Wed Nov 24 16:56:41 2021] POST /identity/v3/users => generated 301 bytes in 144 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 24 16:56:41.888387 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-486c7b97-ed1f-4307-9e4c-f5b6a5b2c018 admin admin] Authenticating user token {{(pid=71939) process_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 24 16:56:41.898920 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-486c7b97-ed1f-4307-9e4c-f5b6a5b2c018 admin admin] Validating token access rules against request {{(pid=71939) validate_allowed_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 24 16:56:41.903802 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1104d043-81ed-48d7-89d7-bce355ae9395 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f2ba2e8375b4e8c8792ee1e22b60427', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '00a5583c7b7443e98e7a1d31a0b638dc', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=71939) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 24 16:56:41.904498 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1104d043-81ed-48d7-89d7-bce355ae9395 admin admin] REQUEST_METHOD: `GET` {{(pid=71939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 24 16:56:41.904812 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1104d043-81ed-48d7-89d7-bce355ae9395 admin admin] SCRIPT_NAME: `/identity` {{(pid=71939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 24 16:56:41.905161 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1104d043-81ed-48d7-89d7-bce355ae9395 admin admin] PATH_INFO: `/v3/roles` {{(pid=71939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 24 16:56:41.905932 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1104d043-81ed-48d7-89d7-bce355ae9395 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=71939) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:442}} Nov 24 16:56:41.934848 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1104d043-81ed-48d7-89d7-bce355ae9395 admin admin] RBAC: Authorization granted {{(pid=71939) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 24 16:56:41.945975 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: [pid: 71939|app: 0|req: 1267/2521] 10.222.0.53 () {58 vars in 1112 bytes} [Wed Nov 24 16:56:41 2021] GET /identity/v3/roles => generated 1420 bytes in 58 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Nov 24 16:56:41.950435 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c45a91d5-1736-4d70-9483-0389af89b21b admin admin] Authenticating user token {{(pid=71938) process_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 24 16:56:41.960691 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c45a91d5-1736-4d70-9483-0389af89b21b admin admin] Validating token access rules against request {{(pid=71938) validate_allowed_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 24 16:56:41.965316 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e3fba4a-2b46-4e20-8f6e-6dfadbaa2288 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f2ba2e8375b4e8c8792ee1e22b60427', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '00a5583c7b7443e98e7a1d31a0b638dc', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=71938) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 24 16:56:41.966223 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e3fba4a-2b46-4e20-8f6e-6dfadbaa2288 admin admin] REQUEST_METHOD: `PUT` {{(pid=71938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 24 16:56:41.966564 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e3fba4a-2b46-4e20-8f6e-6dfadbaa2288 admin admin] SCRIPT_NAME: `/identity` {{(pid=71938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 24 16:56:41.966899 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e3fba4a-2b46-4e20-8f6e-6dfadbaa2288 admin admin] PATH_INFO: `/v3/projects/dfa69380dcd349ff8c1184506f5736dc/users/814a28b21ad94e9ba2793bc49acb0590/roles/912ab5f10fa5477da74acf239f07604e` {{(pid=71938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 24 16:56:41.988844 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e3fba4a-2b46-4e20-8f6e-6dfadbaa2288 admin admin] RBAC: Authorizing `identity:create_grant(project_id=dfa69380dcd349ff8c1184506f5736dc, user_id=814a28b21ad94e9ba2793bc49acb0590, role_id=912ab5f10fa5477da74acf239f07604e)` {{(pid=71938) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:442}} Nov 24 16:56:42.018070 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e3fba4a-2b46-4e20-8f6e-6dfadbaa2288 admin admin] RBAC: Authorization granted {{(pid=71938) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 24 16:56:42.031071 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: [pid: 71938|app: 0|req: 1255/2522] 10.222.0.53 () {60 vars in 1473 bytes} [Wed Nov 24 16:56:41 2021] PUT /identity/v3/projects/dfa69380dcd349ff8c1184506f5736dc/users/814a28b21ad94e9ba2793bc49acb0590/roles/912ab5f10fa5477da74acf239f07604e => generated 0 bytes in 81 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 24 16:56:42.036989 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58ef22cb-4d15-4d8b-a8c4-a23625d5d9fc None None] REQUEST_METHOD: `POST` {{(pid=71939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 24 16:56:42.037380 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58ef22cb-4d15-4d8b-a8c4-a23625d5d9fc None None] SCRIPT_NAME: `/identity` {{(pid=71939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 24 16:56:42.037715 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58ef22cb-4d15-4d8b-a8c4-a23625d5d9fc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=71939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 24 16:56:42.061643 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.auth.core [None req-58ef22cb-4d15-4d8b-a8c4-a23625d5d9fc None None] MFA Rules not processed for user `0f2ba2e8375b4e8c8792ee1e22b60427`. Rule list: `[]` (Enabled: `True`). {{(pid=71939) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:442}} Nov 24 16:56:42.062816 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.fernet_utils [None req-58ef22cb-4d15-4d8b-a8c4-a23625d5d9fc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=71939) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:289}} Nov 24 16:56:42.137138 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: [pid: 71939|app: 0|req: 1268/2523] 10.222.0.53 () {58 vars in 948 bytes} [Wed Nov 24 16:56:42 2021] POST /identity/v3/auth/tokens => generated 3669 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 24 16:56:42.148435 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e3fba4a-2b46-4e20-8f6e-6dfadbaa2288 admin admin] Authenticating user token {{(pid=71938) process_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 24 16:56:42.150332 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.fernet_utils [None req-6e3fba4a-2b46-4e20-8f6e-6dfadbaa2288 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=71938) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:289}} Nov 24 16:56:42.219269 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e3fba4a-2b46-4e20-8f6e-6dfadbaa2288 admin admin] Validating token access rules against request {{(pid=71938) validate_allowed_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 24 16:56:42.223646 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c12f4a0-b609-4514-99ab-7af6ec85473e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c90f21b9cdcb413282461fa83cb6b7a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3b3940d4ae1c4177ae29c02377bb4b0b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=71938) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 24 16:56:42.224308 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c12f4a0-b609-4514-99ab-7af6ec85473e service neutron] REQUEST_METHOD: `GET` {{(pid=71938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 24 16:56:42.224648 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c12f4a0-b609-4514-99ab-7af6ec85473e service neutron] SCRIPT_NAME: `/identity` {{(pid=71938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 24 16:56:42.224981 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c12f4a0-b609-4514-99ab-7af6ec85473e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=71938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 24 16:56:42.234763 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c12f4a0-b609-4514-99ab-7af6ec85473e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=71938) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:442}} Nov 24 16:56:42.262834 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c12f4a0-b609-4514-99ab-7af6ec85473e service neutron] RBAC: Authorization granted {{(pid=71938) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 24 16:56:42.273087 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: [pid: 71938|app: 0|req: 1256/2524] 10.222.0.53 () {60 vars in 1356 bytes} [Wed Nov 24 16:56:42 2021] GET /identity/v3/auth/tokens => generated 3669 bytes in 125 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 24 16:56:43.141521 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-908be2aa-6a79-4b91-ac1d-1cf5ac3b87aa None None] REQUEST_METHOD: `POST` {{(pid=71939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 24 16:56:43.142111 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-908be2aa-6a79-4b91-ac1d-1cf5ac3b87aa None None] SCRIPT_NAME: `/identity` {{(pid=71939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 24 16:56:43.142230 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-908be2aa-6a79-4b91-ac1d-1cf5ac3b87aa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=71939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 24 16:56:43.179763 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.auth.core [None req-908be2aa-6a79-4b91-ac1d-1cf5ac3b87aa None None] MFA Rules not processed for user `814a28b21ad94e9ba2793bc49acb0590`. Rule list: `[]` (Enabled: `True`). {{(pid=71939) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:442}} Nov 24 16:56:43.180999 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.fernet_utils [None req-908be2aa-6a79-4b91-ac1d-1cf5ac3b87aa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=71939) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:289}} Nov 24 16:56:43.260492 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: [pid: 71939|app: 0|req: 1269/2525] 10.222.0.53 () {58 vars in 948 bytes} [Wed Nov 24 16:56:43 2021] POST /identity/v3/auth/tokens => generated 3708 bytes in 120 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 24 16:56:43.265481 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c12f4a0-b609-4514-99ab-7af6ec85473e service neutron] Authenticating user token {{(pid=71938) process_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 24 16:56:43.275550 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c12f4a0-b609-4514-99ab-7af6ec85473e service neutron] Validating token access rules against request {{(pid=71938) validate_allowed_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 24 16:56:43.280171 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a9f0cd6-1727-4613-a9e7-3fff04137eeb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f2ba2e8375b4e8c8792ee1e22b60427', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '00a5583c7b7443e98e7a1d31a0b638dc', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=71938) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 24 16:56:43.280839 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a9f0cd6-1727-4613-a9e7-3fff04137eeb admin admin] REQUEST_METHOD: `POST` {{(pid=71938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 24 16:56:43.281181 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a9f0cd6-1727-4613-a9e7-3fff04137eeb admin admin] SCRIPT_NAME: `/identity` {{(pid=71938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 24 16:56:43.281517 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a9f0cd6-1727-4613-a9e7-3fff04137eeb admin admin] PATH_INFO: `/v3/projects` {{(pid=71938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 24 16:56:43.282288 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a9f0cd6-1727-4613-a9e7-3fff04137eeb admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=71938) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:442}} Nov 24 16:56:43.312684 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a9f0cd6-1727-4613-a9e7-3fff04137eeb admin admin] RBAC: Authorization granted {{(pid=71938) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 24 16:56:43.347193 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: [pid: 71938|app: 0|req: 1257/2526] 10.222.0.53 () {60 vars in 1143 bytes} [Wed Nov 24 16:56:43 2021] POST /identity/v3/projects => generated 405 bytes in 78 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 24 16:56:43.348392 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-908be2aa-6a79-4b91-ac1d-1cf5ac3b87aa None None] Authenticating user token {{(pid=71939) process_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 24 16:56:43.359784 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-908be2aa-6a79-4b91-ac1d-1cf5ac3b87aa None None] Validating token access rules against request {{(pid=71939) validate_allowed_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 24 16:56:43.425850 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98e3ae51-f532-46f6-9dac-022ac0088ee1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f2ba2e8375b4e8c8792ee1e22b60427', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '00a5583c7b7443e98e7a1d31a0b638dc', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=71939) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 24 16:56:43.426561 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98e3ae51-f532-46f6-9dac-022ac0088ee1 admin admin] REQUEST_METHOD: `POST` {{(pid=71939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 24 16:56:43.426903 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98e3ae51-f532-46f6-9dac-022ac0088ee1 admin admin] SCRIPT_NAME: `/identity` {{(pid=71939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 24 16:56:43.427233 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98e3ae51-f532-46f6-9dac-022ac0088ee1 admin admin] PATH_INFO: `/v3/users` {{(pid=71939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 24 16:56:43.427979 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98e3ae51-f532-46f6-9dac-022ac0088ee1 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=71939) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:442}} Nov 24 16:56:43.456649 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98e3ae51-f532-46f6-9dac-022ac0088ee1 admin admin] RBAC: Authorization granted {{(pid=71939) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 24 16:56:43.476197 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: [pid: 71939|app: 0|req: 1270/2527] 10.222.0.53 () {60 vars in 1134 bytes} [Wed Nov 24 16:56:43 2021] POST /identity/v3/users => generated 309 bytes in 128 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Nov 24 16:56:43.480526 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a9f0cd6-1727-4613-a9e7-3fff04137eeb admin admin] Authenticating user token {{(pid=71938) process_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 24 16:56:43.491771 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a9f0cd6-1727-4613-a9e7-3fff04137eeb admin admin] Validating token access rules against request {{(pid=71938) validate_allowed_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 24 16:56:43.496645 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c238830e-441f-4a16-ba23-3cd4e6bd56c5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f2ba2e8375b4e8c8792ee1e22b60427', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '00a5583c7b7443e98e7a1d31a0b638dc', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=71938) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 24 16:56:43.497321 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c238830e-441f-4a16-ba23-3cd4e6bd56c5 admin admin] REQUEST_METHOD: `GET` {{(pid=71938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 24 16:56:43.497661 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c238830e-441f-4a16-ba23-3cd4e6bd56c5 admin admin] SCRIPT_NAME: `/identity` {{(pid=71938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 24 16:56:43.497997 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c238830e-441f-4a16-ba23-3cd4e6bd56c5 admin admin] PATH_INFO: `/v3/roles` {{(pid=71938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 24 16:56:43.498852 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c238830e-441f-4a16-ba23-3cd4e6bd56c5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=71938) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:442}} Nov 24 16:56:43.527031 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c238830e-441f-4a16-ba23-3cd4e6bd56c5 admin admin] RBAC: Authorization granted {{(pid=71938) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 24 16:56:43.541907 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: [pid: 71938|app: 0|req: 1258/2528] 10.222.0.53 () {58 vars in 1112 bytes} [Wed Nov 24 16:56:43 2021] GET /identity/v3/roles => generated 1420 bytes in 59 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 24 16:56:43.543249 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98e3ae51-f532-46f6-9dac-022ac0088ee1 admin admin] Authenticating user token {{(pid=71939) process_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 24 16:56:43.554169 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98e3ae51-f532-46f6-9dac-022ac0088ee1 admin admin] Validating token access rules against request {{(pid=71939) validate_allowed_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 24 16:56:43.558859 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af967cad-1282-425f-81db-70ad968ec85f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f2ba2e8375b4e8c8792ee1e22b60427', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '00a5583c7b7443e98e7a1d31a0b638dc', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=71939) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 24 16:56:43.559769 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af967cad-1282-425f-81db-70ad968ec85f admin admin] REQUEST_METHOD: `PUT` {{(pid=71939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 24 16:56:43.560107 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af967cad-1282-425f-81db-70ad968ec85f admin admin] SCRIPT_NAME: `/identity` {{(pid=71939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 24 16:56:43.560435 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af967cad-1282-425f-81db-70ad968ec85f admin admin] PATH_INFO: `/v3/projects/049a9aa7e41049b19cf956325b7f9e6f/users/11e94a0040b14b32a0fda9cea3d6c8fe/roles/5611724e350b41e19921b5961a342582` {{(pid=71939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 24 16:56:43.581821 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af967cad-1282-425f-81db-70ad968ec85f admin admin] RBAC: Authorizing `identity:create_grant(project_id=049a9aa7e41049b19cf956325b7f9e6f, user_id=11e94a0040b14b32a0fda9cea3d6c8fe, role_id=5611724e350b41e19921b5961a342582)` {{(pid=71939) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:442}} Nov 24 16:56:43.611388 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af967cad-1282-425f-81db-70ad968ec85f admin admin] RBAC: Authorization granted {{(pid=71939) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 24 16:56:43.622995 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: [pid: 71939|app: 0|req: 1271/2529] 10.222.0.53 () {60 vars in 1473 bytes} [Wed Nov 24 16:56:43 2021] PUT /identity/v3/projects/049a9aa7e41049b19cf956325b7f9e6f/users/11e94a0040b14b32a0fda9cea3d6c8fe/roles/5611724e350b41e19921b5961a342582 => generated 0 bytes in 80 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 24 16:56:43.627204 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c238830e-441f-4a16-ba23-3cd4e6bd56c5 admin admin] Authenticating user token {{(pid=71938) process_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 24 16:56:43.637309 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c238830e-441f-4a16-ba23-3cd4e6bd56c5 admin admin] Validating token access rules against request {{(pid=71938) validate_allowed_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 24 16:56:43.704593 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-633fdd3b-a9fc-43ae-ad81-9256bc818f80 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f2ba2e8375b4e8c8792ee1e22b60427', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '00a5583c7b7443e98e7a1d31a0b638dc', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=71938) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 24 16:56:43.705268 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-633fdd3b-a9fc-43ae-ad81-9256bc818f80 admin admin] REQUEST_METHOD: `GET` {{(pid=71938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 24 16:56:43.705636 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-633fdd3b-a9fc-43ae-ad81-9256bc818f80 admin admin] SCRIPT_NAME: `/identity` {{(pid=71938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 24 16:56:43.705970 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-633fdd3b-a9fc-43ae-ad81-9256bc818f80 admin admin] PATH_INFO: `/v3/roles` {{(pid=71938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 24 16:56:43.706785 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-633fdd3b-a9fc-43ae-ad81-9256bc818f80 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=71938) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:442}} Nov 24 16:56:43.734898 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-633fdd3b-a9fc-43ae-ad81-9256bc818f80 admin admin] RBAC: Authorization granted {{(pid=71938) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 24 16:56:43.746660 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: [pid: 71938|app: 0|req: 1259/2530] 10.222.0.53 () {58 vars in 1112 bytes} [Wed Nov 24 16:56:43 2021] GET /identity/v3/roles => generated 1420 bytes in 120 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 24 16:56:43.751053 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af967cad-1282-425f-81db-70ad968ec85f admin admin] Authenticating user token {{(pid=71939) process_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 24 16:56:43.764046 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af967cad-1282-425f-81db-70ad968ec85f admin admin] Validating token access rules against request {{(pid=71939) validate_allowed_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 24 16:56:43.768643 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a220009-063d-4105-97c3-c20729d1de7f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f2ba2e8375b4e8c8792ee1e22b60427', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '00a5583c7b7443e98e7a1d31a0b638dc', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=71939) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 24 16:56:43.769574 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a220009-063d-4105-97c3-c20729d1de7f admin admin] REQUEST_METHOD: `PUT` {{(pid=71939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 24 16:56:43.769907 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a220009-063d-4105-97c3-c20729d1de7f admin admin] SCRIPT_NAME: `/identity` {{(pid=71939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 24 16:56:43.770273 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a220009-063d-4105-97c3-c20729d1de7f admin admin] PATH_INFO: `/v3/projects/049a9aa7e41049b19cf956325b7f9e6f/users/11e94a0040b14b32a0fda9cea3d6c8fe/roles/5611724e350b41e19921b5961a342582` {{(pid=71939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 24 16:56:43.772232 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a220009-063d-4105-97c3-c20729d1de7f admin admin] RBAC: Authorizing `identity:create_grant(project_id=049a9aa7e41049b19cf956325b7f9e6f, user_id=11e94a0040b14b32a0fda9cea3d6c8fe, role_id=5611724e350b41e19921b5961a342582)` {{(pid=71939) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:442}} Nov 24 16:56:43.801920 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a220009-063d-4105-97c3-c20729d1de7f admin admin] RBAC: Authorization granted {{(pid=71939) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 24 16:56:43.812934 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: [pid: 71939|app: 0|req: 1272/2531] 10.222.0.53 () {60 vars in 1473 bytes} [Wed Nov 24 16:56:43 2021] PUT /identity/v3/projects/049a9aa7e41049b19cf956325b7f9e6f/users/11e94a0040b14b32a0fda9cea3d6c8fe/roles/5611724e350b41e19921b5961a342582 => generated 0 bytes in 62 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 24 16:56:43.817733 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-633fdd3b-a9fc-43ae-ad81-9256bc818f80 admin admin] Authenticating user token {{(pid=71938) process_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 24 16:56:43.828349 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-633fdd3b-a9fc-43ae-ad81-9256bc818f80 admin admin] Validating token access rules against request {{(pid=71938) validate_allowed_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 24 16:56:43.896065 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9366bc3-92bd-44f6-b9b7-ce85f3145920 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f2ba2e8375b4e8c8792ee1e22b60427', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '00a5583c7b7443e98e7a1d31a0b638dc', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=71938) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 24 16:56:43.896683 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9366bc3-92bd-44f6-b9b7-ce85f3145920 admin admin] REQUEST_METHOD: `GET` {{(pid=71938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 24 16:56:43.897023 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9366bc3-92bd-44f6-b9b7-ce85f3145920 admin admin] SCRIPT_NAME: `/identity` {{(pid=71938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 24 16:56:43.897442 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9366bc3-92bd-44f6-b9b7-ce85f3145920 admin admin] PATH_INFO: `/v3/roles` {{(pid=71938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 24 16:56:43.898129 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9366bc3-92bd-44f6-b9b7-ce85f3145920 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=71938) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:442}} Nov 24 16:56:43.928074 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9366bc3-92bd-44f6-b9b7-ce85f3145920 admin admin] RBAC: Authorization granted {{(pid=71938) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 24 16:56:43.944063 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: [pid: 71938|app: 0|req: 1260/2532] 10.222.0.53 () {58 vars in 1112 bytes} [Wed Nov 24 16:56:43 2021] GET /identity/v3/roles => generated 1420 bytes in 127 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 24 16:56:43.948575 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a220009-063d-4105-97c3-c20729d1de7f admin admin] Authenticating user token {{(pid=71939) process_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 24 16:56:43.960762 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a220009-063d-4105-97c3-c20729d1de7f admin admin] Validating token access rules against request {{(pid=71939) validate_allowed_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 24 16:56:43.965489 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f818ee08-5c73-4228-8491-0055b9561453 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f2ba2e8375b4e8c8792ee1e22b60427', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '00a5583c7b7443e98e7a1d31a0b638dc', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=71939) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 24 16:56:43.967905 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f818ee08-5c73-4228-8491-0055b9561453 admin admin] REQUEST_METHOD: `PUT` {{(pid=71939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 24 16:56:43.967905 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f818ee08-5c73-4228-8491-0055b9561453 admin admin] SCRIPT_NAME: `/identity` {{(pid=71939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 24 16:56:43.967905 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f818ee08-5c73-4228-8491-0055b9561453 admin admin] PATH_INFO: `/v3/projects/049a9aa7e41049b19cf956325b7f9e6f/users/11e94a0040b14b32a0fda9cea3d6c8fe/roles/912ab5f10fa5477da74acf239f07604e` {{(pid=71939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 24 16:56:43.969241 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f818ee08-5c73-4228-8491-0055b9561453 admin admin] RBAC: Authorizing `identity:create_grant(project_id=049a9aa7e41049b19cf956325b7f9e6f, user_id=11e94a0040b14b32a0fda9cea3d6c8fe, role_id=912ab5f10fa5477da74acf239f07604e)` {{(pid=71939) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:442}} Nov 24 16:56:44.001191 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f818ee08-5c73-4228-8491-0055b9561453 admin admin] RBAC: Authorization granted {{(pid=71939) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 24 16:56:44.017609 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: [pid: 71939|app: 0|req: 1273/2533] 10.222.0.53 () {60 vars in 1473 bytes} [Wed Nov 24 16:56:43 2021] PUT /identity/v3/projects/049a9aa7e41049b19cf956325b7f9e6f/users/11e94a0040b14b32a0fda9cea3d6c8fe/roles/912ab5f10fa5477da74acf239f07604e => generated 0 bytes in 69 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 24 16:56:44.819432 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7163f5d-3253-4a0e-82bb-a54e917bedf7 None None] REQUEST_METHOD: `POST` {{(pid=71938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 24 16:56:44.819943 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7163f5d-3253-4a0e-82bb-a54e917bedf7 None None] SCRIPT_NAME: `/identity` {{(pid=71938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 24 16:56:44.820076 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7163f5d-3253-4a0e-82bb-a54e917bedf7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=71938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 24 16:56:44.858089 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.auth.core [None req-e7163f5d-3253-4a0e-82bb-a54e917bedf7 None None] MFA Rules not processed for user `11e94a0040b14b32a0fda9cea3d6c8fe`. Rule list: `[]` (Enabled: `True`). {{(pid=71938) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:442}} Nov 24 16:56:44.859319 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.fernet_utils [None req-e7163f5d-3253-4a0e-82bb-a54e917bedf7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=71938) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:289}} Nov 24 16:56:44.939502 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: [pid: 71938|app: 0|req: 1261/2534] 10.222.0.53 () {58 vars in 948 bytes} [Wed Nov 24 16:56:44 2021] POST /identity/v3/auth/tokens => generated 3779 bytes in 121 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 24 16:56:46.784929 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f818ee08-5c73-4228-8491-0055b9561453 admin admin] Authenticating user token {{(pid=71939) process_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 24 16:56:46.857358 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f818ee08-5c73-4228-8491-0055b9561453 admin admin] Validating token access rules against request {{(pid=71939) validate_allowed_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 24 16:56:46.862614 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e121a131-6595-4a15-9602-8052318f73c0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f2ba2e8375b4e8c8792ee1e22b60427', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '00a5583c7b7443e98e7a1d31a0b638dc', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=71939) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 24 16:56:46.863550 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e121a131-6595-4a15-9602-8052318f73c0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=71939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 24 16:56:46.863889 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e121a131-6595-4a15-9602-8052318f73c0 admin admin] SCRIPT_NAME: `/identity` {{(pid=71939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 24 16:56:46.864224 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e121a131-6595-4a15-9602-8052318f73c0 admin admin] PATH_INFO: `/v3/users/814a28b21ad94e9ba2793bc49acb0590` {{(pid=71939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 24 16:56:46.865452 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e121a131-6595-4a15-9602-8052318f73c0 admin admin] RBAC: Authorizing `identity:delete_user(user_id=814a28b21ad94e9ba2793bc49acb0590)` {{(pid=71939) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:442}} Nov 24 16:56:46.894526 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e121a131-6595-4a15-9602-8052318f73c0 admin admin] RBAC: Authorization granted {{(pid=71939) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 24 16:56:46.943739 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.notifications [None req-e121a131-6595-4a15-9602-8052318f73c0 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '814a28b21ad94e9ba2793bc49acb0590'} {{(pid=71939) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:357}} Nov 24 16:56:46.956085 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.notifications [None req-e121a131-6595-4a15-9602-8052318f73c0 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '814a28b21ad94e9ba2793bc49acb0590'} {{(pid=71939) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:357}} Nov 24 16:56:46.956793 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.notifications [None req-e121a131-6595-4a15-9602-8052318f73c0 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '814a28b21ad94e9ba2793bc49acb0590'} {{(pid=71939) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:357}} Nov 24 16:56:46.964991 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.notifications [None req-e121a131-6595-4a15-9602-8052318f73c0 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '814a28b21ad94e9ba2793bc49acb0590'} {{(pid=71939) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:357}} Nov 24 16:56:46.971245 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.notifications [None req-e121a131-6595-4a15-9602-8052318f73c0 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '814a28b21ad94e9ba2793bc49acb0590'} {{(pid=71939) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:357}} Nov 24 16:56:46.977412 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: [pid: 71939|app: 0|req: 1274/2535] 10.222.0.53 () {58 vars in 1214 bytes} [Wed Nov 24 16:56:46 2021] DELETE /identity/v3/users/814a28b21ad94e9ba2793bc49acb0590 => generated 0 bytes in 193 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 24 16:56:47.195810 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7163f5d-3253-4a0e-82bb-a54e917bedf7 None None] Authenticating user token {{(pid=71938) process_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 24 16:56:47.207893 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7163f5d-3253-4a0e-82bb-a54e917bedf7 None None] Validating token access rules against request {{(pid=71938) validate_allowed_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 24 16:56:47.275369 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53622947-c141-4ef6-802e-a4f593109c83 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f2ba2e8375b4e8c8792ee1e22b60427', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '00a5583c7b7443e98e7a1d31a0b638dc', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=71938) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 24 16:56:47.276248 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53622947-c141-4ef6-802e-a4f593109c83 admin admin] REQUEST_METHOD: `DELETE` {{(pid=71938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 24 16:56:47.276630 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53622947-c141-4ef6-802e-a4f593109c83 admin admin] SCRIPT_NAME: `/identity` {{(pid=71938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 24 16:56:47.276968 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53622947-c141-4ef6-802e-a4f593109c83 admin admin] PATH_INFO: `/v3/projects/dfa69380dcd349ff8c1184506f5736dc` {{(pid=71938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 24 16:56:47.278257 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53622947-c141-4ef6-802e-a4f593109c83 admin admin] RBAC: Authorizing `identity:delete_project(project_id=dfa69380dcd349ff8c1184506f5736dc)` {{(pid=71938) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:442}} Nov 24 16:56:47.307652 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53622947-c141-4ef6-802e-a4f593109c83 admin admin] RBAC: Authorization granted {{(pid=71938) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 24 16:56:47.358586 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.notifications [None req-53622947-c141-4ef6-802e-a4f593109c83 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'dfa69380dcd349ff8c1184506f5736dc', 'request_id': 'req-53622947-c141-4ef6-802e-a4f593109c83'} {{(pid=71938) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:357}} Nov 24 16:56:47.370955 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.notifications [None req-53622947-c141-4ef6-802e-a4f593109c83 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'dfa69380dcd349ff8c1184506f5736dc', 'request_id': 'req-53622947-c141-4ef6-802e-a4f593109c83'} {{(pid=71938) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:357}} Nov 24 16:56:47.376913 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.notifications [None req-53622947-c141-4ef6-802e-a4f593109c83 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'dfa69380dcd349ff8c1184506f5736dc', 'request_id': 'req-53622947-c141-4ef6-802e-a4f593109c83'} {{(pid=71938) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:357}} Nov 24 16:56:47.388327 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.notifications [None req-53622947-c141-4ef6-802e-a4f593109c83 admin admin] The token cache is being invalidate because project dfa69380dcd349ff8c1184506f5736dc was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=71938) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Nov 24 16:56:47.388660 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.notifications [None req-53622947-c141-4ef6-802e-a4f593109c83 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=71938) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:357}} Nov 24 16:56:47.389330 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.notifications [None req-53622947-c141-4ef6-802e-a4f593109c83 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=71938) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:357}} Nov 24 16:56:47.391156 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: [pid: 71938|app: 0|req: 1262/2536] 10.222.0.53 () {58 vars in 1223 bytes} [Wed Nov 24 16:56:47 2021] DELETE /identity/v3/projects/dfa69380dcd349ff8c1184506f5736dc => generated 0 bytes in 196 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 24 16:56:47.395734 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e121a131-6595-4a15-9602-8052318f73c0 admin admin] Authenticating user token {{(pid=71939) process_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 24 16:56:47.397200 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.fernet_utils [None req-e121a131-6595-4a15-9602-8052318f73c0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=71939) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:289}} Nov 24 16:56:47.410758 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e121a131-6595-4a15-9602-8052318f73c0 admin admin] Validating token access rules against request {{(pid=71939) validate_allowed_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 24 16:56:47.481224 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fd92dd5-8819-445c-8045-59a6190b0d88 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f2ba2e8375b4e8c8792ee1e22b60427', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '00a5583c7b7443e98e7a1d31a0b638dc', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=71939) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 24 16:56:47.482149 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fd92dd5-8819-445c-8045-59a6190b0d88 admin admin] REQUEST_METHOD: `DELETE` {{(pid=71939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 24 16:56:47.482489 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fd92dd5-8819-445c-8045-59a6190b0d88 admin admin] SCRIPT_NAME: `/identity` {{(pid=71939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 24 16:56:47.482822 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fd92dd5-8819-445c-8045-59a6190b0d88 admin admin] PATH_INFO: `/v3/users/11e94a0040b14b32a0fda9cea3d6c8fe` {{(pid=71939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 24 16:56:47.484041 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fd92dd5-8819-445c-8045-59a6190b0d88 admin admin] RBAC: Authorizing `identity:delete_user(user_id=11e94a0040b14b32a0fda9cea3d6c8fe)` {{(pid=71939) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:442}} Nov 24 16:56:47.512508 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fd92dd5-8819-445c-8045-59a6190b0d88 admin admin] RBAC: Authorization granted {{(pid=71939) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 24 16:56:47.559943 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.notifications [None req-2fd92dd5-8819-445c-8045-59a6190b0d88 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '11e94a0040b14b32a0fda9cea3d6c8fe'} {{(pid=71939) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:357}} Nov 24 16:56:47.572084 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.notifications [None req-2fd92dd5-8819-445c-8045-59a6190b0d88 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '11e94a0040b14b32a0fda9cea3d6c8fe'} {{(pid=71939) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:357}} Nov 24 16:56:47.572773 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.notifications [None req-2fd92dd5-8819-445c-8045-59a6190b0d88 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '11e94a0040b14b32a0fda9cea3d6c8fe'} {{(pid=71939) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:357}} Nov 24 16:56:47.581268 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.notifications [None req-2fd92dd5-8819-445c-8045-59a6190b0d88 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '11e94a0040b14b32a0fda9cea3d6c8fe'} {{(pid=71939) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:357}} Nov 24 16:56:47.587143 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.notifications [None req-2fd92dd5-8819-445c-8045-59a6190b0d88 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '11e94a0040b14b32a0fda9cea3d6c8fe'} {{(pid=71939) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:357}} Nov 24 16:56:47.593499 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: [pid: 71939|app: 0|req: 1275/2537] 10.222.0.53 () {58 vars in 1214 bytes} [Wed Nov 24 16:56:47 2021] DELETE /identity/v3/users/11e94a0040b14b32a0fda9cea3d6c8fe => generated 0 bytes in 198 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 24 16:56:47.821397 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53622947-c141-4ef6-802e-a4f593109c83 admin admin] Authenticating user token {{(pid=71938) process_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 24 16:56:47.825711 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.fernet_utils [None req-53622947-c141-4ef6-802e-a4f593109c83 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=71938) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:289}} Nov 24 16:56:47.847054 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53622947-c141-4ef6-802e-a4f593109c83 admin admin] Validating token access rules against request {{(pid=71938) validate_allowed_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 24 16:56:47.916218 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82ce10ba-7c87-42bd-ac08-a92b41128625 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f2ba2e8375b4e8c8792ee1e22b60427', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '00a5583c7b7443e98e7a1d31a0b638dc', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=71938) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 24 16:56:47.917046 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82ce10ba-7c87-42bd-ac08-a92b41128625 admin admin] REQUEST_METHOD: `DELETE` {{(pid=71938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 24 16:56:47.917388 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82ce10ba-7c87-42bd-ac08-a92b41128625 admin admin] SCRIPT_NAME: `/identity` {{(pid=71938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 24 16:56:47.917719 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82ce10ba-7c87-42bd-ac08-a92b41128625 admin admin] PATH_INFO: `/v3/projects/049a9aa7e41049b19cf956325b7f9e6f` {{(pid=71938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 24 16:56:47.918983 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82ce10ba-7c87-42bd-ac08-a92b41128625 admin admin] RBAC: Authorizing `identity:delete_project(project_id=049a9aa7e41049b19cf956325b7f9e6f)` {{(pid=71938) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:442}} Nov 24 16:56:47.948049 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82ce10ba-7c87-42bd-ac08-a92b41128625 admin admin] RBAC: Authorization granted {{(pid=71938) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 24 16:56:47.997539 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.notifications [None req-82ce10ba-7c87-42bd-ac08-a92b41128625 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '049a9aa7e41049b19cf956325b7f9e6f', 'request_id': 'req-82ce10ba-7c87-42bd-ac08-a92b41128625'} {{(pid=71938) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:357}} Nov 24 16:56:48.009799 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.notifications [None req-82ce10ba-7c87-42bd-ac08-a92b41128625 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '049a9aa7e41049b19cf956325b7f9e6f', 'request_id': 'req-82ce10ba-7c87-42bd-ac08-a92b41128625'} {{(pid=71938) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:357}} Nov 24 16:56:48.015290 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.notifications [None req-82ce10ba-7c87-42bd-ac08-a92b41128625 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '049a9aa7e41049b19cf956325b7f9e6f', 'request_id': 'req-82ce10ba-7c87-42bd-ac08-a92b41128625'} {{(pid=71938) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:357}} Nov 24 16:56:48.027184 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.notifications [None req-82ce10ba-7c87-42bd-ac08-a92b41128625 admin admin] The token cache is being invalidate because project 049a9aa7e41049b19cf956325b7f9e6f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=71938) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Nov 24 16:56:48.027532 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.notifications [None req-82ce10ba-7c87-42bd-ac08-a92b41128625 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=71938) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:357}} Nov 24 16:56:48.028288 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.notifications [None req-82ce10ba-7c87-42bd-ac08-a92b41128625 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=71938) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:357}} Nov 24 16:56:48.029987 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: [pid: 71938|app: 0|req: 1263/2538] 10.222.0.53 () {58 vars in 1223 bytes} [Wed Nov 24 16:56:47 2021] DELETE /identity/v3/projects/049a9aa7e41049b19cf956325b7f9e6f => generated 0 bytes in 209 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 24 16:56:48.036067 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9a51b11-0ff4-4b51-bb60-1202ef65c0f1 None None] REQUEST_METHOD: `POST` {{(pid=71939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 24 16:56:48.036422 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9a51b11-0ff4-4b51-bb60-1202ef65c0f1 None None] SCRIPT_NAME: `/identity` {{(pid=71939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 24 16:56:48.036761 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9a51b11-0ff4-4b51-bb60-1202ef65c0f1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=71939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 24 16:56:48.062233 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.auth.core [None req-d9a51b11-0ff4-4b51-bb60-1202ef65c0f1 None None] MFA Rules not processed for user `0f2ba2e8375b4e8c8792ee1e22b60427`. Rule list: `[]` (Enabled: `True`). {{(pid=71939) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:442}} Nov 24 16:56:48.063471 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.fernet_utils [None req-d9a51b11-0ff4-4b51-bb60-1202ef65c0f1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=71939) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:289}} Nov 24 16:56:48.133364 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: [pid: 71939|app: 0|req: 1276/2539] 10.222.0.53 () {58 vars in 948 bytes} [Wed Nov 24 16:56:48 2021] POST /identity/v3/auth/tokens => generated 3669 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Nov 24 16:56:48.141802 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49f3772f-c877-4fff-90b4-641577dd6407 None None] REQUEST_METHOD: `POST` {{(pid=71938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 24 16:56:48.142205 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49f3772f-c877-4fff-90b4-641577dd6407 None None] SCRIPT_NAME: `/identity` {{(pid=71938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 24 16:56:48.142544 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49f3772f-c877-4fff-90b4-641577dd6407 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=71938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 24 16:56:48.165813 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.auth.core [None req-49f3772f-c877-4fff-90b4-641577dd6407 None None] MFA Rules not processed for user `0f2ba2e8375b4e8c8792ee1e22b60427`. Rule list: `[]` (Enabled: `True`). {{(pid=71938) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:442}} Nov 24 16:56:48.167100 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.fernet_utils [None req-49f3772f-c877-4fff-90b4-641577dd6407 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=71938) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:289}} Nov 24 16:56:48.175500 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: [pid: 71938|app: 0|req: 1264/2540] 10.222.0.53 () {58 vars in 948 bytes} [Wed Nov 24 16:56:48 2021] POST /identity/v3/auth/tokens => generated 3669 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 24 16:56:48.179701 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9a51b11-0ff4-4b51-bb60-1202ef65c0f1 None None] Authenticating user token {{(pid=71939) process_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 24 16:56:48.190835 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9a51b11-0ff4-4b51-bb60-1202ef65c0f1 None None] Validating token access rules against request {{(pid=71939) validate_allowed_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 24 16:56:48.195363 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc0fae16-94e1-43ce-b61e-0bf8a1f9578e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f2ba2e8375b4e8c8792ee1e22b60427', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '00a5583c7b7443e98e7a1d31a0b638dc', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=71939) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 24 16:56:48.196278 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc0fae16-94e1-43ce-b61e-0bf8a1f9578e admin admin] REQUEST_METHOD: `GET` {{(pid=71939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 24 16:56:48.196619 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc0fae16-94e1-43ce-b61e-0bf8a1f9578e admin admin] SCRIPT_NAME: `/identity` {{(pid=71939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 24 16:56:48.196950 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc0fae16-94e1-43ce-b61e-0bf8a1f9578e admin admin] PATH_INFO: `/v3/domains` {{(pid=71939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 24 16:56:48.197743 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc0fae16-94e1-43ce-b61e-0bf8a1f9578e admin admin] RBAC: Adding query filter params (name=Default) {{(pid=71939) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:161}} Nov 24 16:56:48.198144 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc0fae16-94e1-43ce-b61e-0bf8a1f9578e admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=71939) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:442}} Nov 24 16:56:48.226098 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc0fae16-94e1-43ce-b61e-0bf8a1f9578e admin admin] RBAC: Authorization granted {{(pid=71939) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 24 16:56:48.240741 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: [pid: 71939|app: 0|req: 1277/2541] 10.222.0.53 () {58 vars in 1143 bytes} [Wed Nov 24 16:56:48 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 62 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 24 16:56:48.245509 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49f3772f-c877-4fff-90b4-641577dd6407 None None] Authenticating user token {{(pid=71938) process_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 24 16:56:48.255710 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49f3772f-c877-4fff-90b4-641577dd6407 None None] Validating token access rules against request {{(pid=71938) validate_allowed_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 24 16:56:48.260303 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7f8451f-1b91-474b-8ea1-1c6b63b30229 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f2ba2e8375b4e8c8792ee1e22b60427', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '00a5583c7b7443e98e7a1d31a0b638dc', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=71938) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 24 16:56:48.260964 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7f8451f-1b91-474b-8ea1-1c6b63b30229 admin admin] REQUEST_METHOD: `POST` {{(pid=71938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 24 16:56:48.261303 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7f8451f-1b91-474b-8ea1-1c6b63b30229 admin admin] SCRIPT_NAME: `/identity` {{(pid=71938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 24 16:56:48.261636 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7f8451f-1b91-474b-8ea1-1c6b63b30229 admin admin] PATH_INFO: `/v3/projects` {{(pid=71938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 24 16:56:48.262401 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7f8451f-1b91-474b-8ea1-1c6b63b30229 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=71938) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:442}} Nov 24 16:56:48.290550 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7f8451f-1b91-474b-8ea1-1c6b63b30229 admin admin] RBAC: Authorization granted {{(pid=71938) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 24 16:56:48.318260 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: [pid: 71938|app: 0|req: 1265/2542] 10.222.0.53 () {60 vars in 1143 bytes} [Wed Nov 24 16:56:48 2021] POST /identity/v3/projects => generated 367 bytes in 73 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 24 16:56:48.322738 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc0fae16-94e1-43ce-b61e-0bf8a1f9578e admin admin] Authenticating user token {{(pid=71939) process_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 24 16:56:48.333286 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc0fae16-94e1-43ce-b61e-0bf8a1f9578e admin admin] Validating token access rules against request {{(pid=71939) validate_allowed_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 24 16:56:48.397957 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77fc8919-7ee4-4cd3-948f-c1a8dc30b6f2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f2ba2e8375b4e8c8792ee1e22b60427', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '00a5583c7b7443e98e7a1d31a0b638dc', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=71939) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 24 16:56:48.398661 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77fc8919-7ee4-4cd3-948f-c1a8dc30b6f2 admin admin] REQUEST_METHOD: `POST` {{(pid=71939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 24 16:56:48.398999 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77fc8919-7ee4-4cd3-948f-c1a8dc30b6f2 admin admin] SCRIPT_NAME: `/identity` {{(pid=71939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 24 16:56:48.399335 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77fc8919-7ee4-4cd3-948f-c1a8dc30b6f2 admin admin] PATH_INFO: `/v3/users` {{(pid=71939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 24 16:56:48.400062 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77fc8919-7ee4-4cd3-948f-c1a8dc30b6f2 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=71939) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:442}} Nov 24 16:56:48.428992 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77fc8919-7ee4-4cd3-948f-c1a8dc30b6f2 admin admin] RBAC: Authorization granted {{(pid=71939) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 24 16:56:48.448912 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: [pid: 71939|app: 0|req: 1278/2543] 10.222.0.53 () {60 vars in 1134 bytes} [Wed Nov 24 16:56:48 2021] POST /identity/v3/users => generated 284 bytes in 127 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 24 16:56:48.453186 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7f8451f-1b91-474b-8ea1-1c6b63b30229 admin admin] Authenticating user token {{(pid=71938) process_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 24 16:56:48.463811 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7f8451f-1b91-474b-8ea1-1c6b63b30229 admin admin] Validating token access rules against request {{(pid=71938) validate_allowed_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 24 16:56:48.468594 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff0f7379-4633-4a3b-9efb-a49af0eded26 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f2ba2e8375b4e8c8792ee1e22b60427', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '00a5583c7b7443e98e7a1d31a0b638dc', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=71938) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 24 16:56:48.469281 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff0f7379-4633-4a3b-9efb-a49af0eded26 admin admin] REQUEST_METHOD: `GET` {{(pid=71938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 24 16:56:48.469624 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff0f7379-4633-4a3b-9efb-a49af0eded26 admin admin] SCRIPT_NAME: `/identity` {{(pid=71938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 24 16:56:48.469960 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff0f7379-4633-4a3b-9efb-a49af0eded26 admin admin] PATH_INFO: `/v3/roles` {{(pid=71938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 24 16:56:48.471291 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff0f7379-4633-4a3b-9efb-a49af0eded26 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=71938) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:442}} Nov 24 16:56:48.500499 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff0f7379-4633-4a3b-9efb-a49af0eded26 admin admin] RBAC: Authorization granted {{(pid=71938) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 24 16:56:48.512059 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: [pid: 71938|app: 0|req: 1266/2544] 10.222.0.53 () {58 vars in 1112 bytes} [Wed Nov 24 16:56:48 2021] GET /identity/v3/roles => generated 1420 bytes in 59 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 24 16:56:48.517009 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77fc8919-7ee4-4cd3-948f-c1a8dc30b6f2 admin admin] Authenticating user token {{(pid=71939) process_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 24 16:56:48.527540 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77fc8919-7ee4-4cd3-948f-c1a8dc30b6f2 admin admin] Validating token access rules against request {{(pid=71939) validate_allowed_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 24 16:56:48.533267 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58561efe-f842-48e8-b489-8ba8316c0b5b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f2ba2e8375b4e8c8792ee1e22b60427', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '00a5583c7b7443e98e7a1d31a0b638dc', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=71939) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 24 16:56:48.533977 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58561efe-f842-48e8-b489-8ba8316c0b5b admin admin] REQUEST_METHOD: `PUT` {{(pid=71939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 24 16:56:48.534363 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58561efe-f842-48e8-b489-8ba8316c0b5b admin admin] SCRIPT_NAME: `/identity` {{(pid=71939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 24 16:56:48.534683 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58561efe-f842-48e8-b489-8ba8316c0b5b admin admin] PATH_INFO: `/v3/projects/305d258b66624f20bbfd5439a0e228f5/users/ddb645e5c64740a898b28f560f5b4524/roles/912ab5f10fa5477da74acf239f07604e` {{(pid=71939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 24 16:56:48.556995 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58561efe-f842-48e8-b489-8ba8316c0b5b admin admin] RBAC: Authorizing `identity:create_grant(project_id=305d258b66624f20bbfd5439a0e228f5, user_id=ddb645e5c64740a898b28f560f5b4524, role_id=912ab5f10fa5477da74acf239f07604e)` {{(pid=71939) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:442}} Nov 24 16:56:48.587253 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58561efe-f842-48e8-b489-8ba8316c0b5b admin admin] RBAC: Authorization granted {{(pid=71939) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 24 16:56:48.599903 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: [pid: 71939|app: 0|req: 1279/2545] 10.222.0.53 () {60 vars in 1473 bytes} [Wed Nov 24 16:56:48 2021] PUT /identity/v3/projects/305d258b66624f20bbfd5439a0e228f5/users/ddb645e5c64740a898b28f560f5b4524/roles/912ab5f10fa5477da74acf239f07604e => generated 0 bytes in 84 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 24 16:56:48.610724 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74115f77-49ab-4261-8b35-42beefda2444 None None] REQUEST_METHOD: `POST` {{(pid=71938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 24 16:56:48.611596 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74115f77-49ab-4261-8b35-42beefda2444 None None] SCRIPT_NAME: `/identity` {{(pid=71938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 24 16:56:48.611933 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74115f77-49ab-4261-8b35-42beefda2444 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=71938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 24 16:56:48.649406 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.auth.core [None req-74115f77-49ab-4261-8b35-42beefda2444 None None] MFA Rules not processed for user `ddb645e5c64740a898b28f560f5b4524`. Rule list: `[]` (Enabled: `True`). {{(pid=71938) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:442}} Nov 24 16:56:48.650654 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.fernet_utils [None req-74115f77-49ab-4261-8b35-42beefda2444 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=71938) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:289}} Nov 24 16:56:48.729119 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: [pid: 71938|app: 0|req: 1267/2546] 10.222.0.53 () {58 vars in 948 bytes} [Wed Nov 24 16:56:48 2021] POST /identity/v3/auth/tokens => generated 3674 bytes in 117 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 24 16:56:48.731940 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58561efe-f842-48e8-b489-8ba8316c0b5b admin admin] Authenticating user token {{(pid=71939) process_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 24 16:56:48.808477 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58561efe-f842-48e8-b489-8ba8316c0b5b admin admin] Validating token access rules against request {{(pid=71939) validate_allowed_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 24 16:56:48.813308 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf719058-37ee-46b3-87e0-1ad1202b7146 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f2ba2e8375b4e8c8792ee1e22b60427', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '00a5583c7b7443e98e7a1d31a0b638dc', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=71939) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 24 16:56:48.813966 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf719058-37ee-46b3-87e0-1ad1202b7146 admin admin] REQUEST_METHOD: `POST` {{(pid=71939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 24 16:56:48.814329 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf719058-37ee-46b3-87e0-1ad1202b7146 admin admin] SCRIPT_NAME: `/identity` {{(pid=71939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 24 16:56:48.814658 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf719058-37ee-46b3-87e0-1ad1202b7146 admin admin] PATH_INFO: `/v3/projects` {{(pid=71939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 24 16:56:48.815380 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf719058-37ee-46b3-87e0-1ad1202b7146 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=71939) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:442}} Nov 24 16:56:48.843875 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf719058-37ee-46b3-87e0-1ad1202b7146 admin admin] RBAC: Authorization granted {{(pid=71939) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 24 16:56:48.869458 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: [pid: 71939|app: 0|req: 1280/2547] 10.222.0.53 () {60 vars in 1143 bytes} [Wed Nov 24 16:56:48 2021] POST /identity/v3/projects => generated 367 bytes in 138 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 24 16:56:48.873805 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74115f77-49ab-4261-8b35-42beefda2444 None None] Authenticating user token {{(pid=71938) process_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 24 16:56:48.884593 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74115f77-49ab-4261-8b35-42beefda2444 None None] Validating token access rules against request {{(pid=71938) validate_allowed_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 24 16:56:48.950376 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd24790a-0a7e-4bde-bca3-fd9cbc301848 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f2ba2e8375b4e8c8792ee1e22b60427', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '00a5583c7b7443e98e7a1d31a0b638dc', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=71938) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 24 16:56:48.951061 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd24790a-0a7e-4bde-bca3-fd9cbc301848 admin admin] REQUEST_METHOD: `POST` {{(pid=71938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 24 16:56:48.951397 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd24790a-0a7e-4bde-bca3-fd9cbc301848 admin admin] SCRIPT_NAME: `/identity` {{(pid=71938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 24 16:56:48.951724 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd24790a-0a7e-4bde-bca3-fd9cbc301848 admin admin] PATH_INFO: `/v3/users` {{(pid=71938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 24 16:56:48.952445 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd24790a-0a7e-4bde-bca3-fd9cbc301848 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=71938) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:442}} Nov 24 16:56:48.982108 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd24790a-0a7e-4bde-bca3-fd9cbc301848 admin admin] RBAC: Authorization granted {{(pid=71938) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 24 16:56:49.004459 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: [pid: 71938|app: 0|req: 1268/2548] 10.222.0.53 () {60 vars in 1134 bytes} [Wed Nov 24 16:56:48 2021] POST /identity/v3/users => generated 290 bytes in 128 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 24 16:56:49.006137 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf719058-37ee-46b3-87e0-1ad1202b7146 admin admin] Authenticating user token {{(pid=71939) process_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 24 16:56:49.016818 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf719058-37ee-46b3-87e0-1ad1202b7146 admin admin] Validating token access rules against request {{(pid=71939) validate_allowed_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 24 16:56:49.022060 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d080564-7873-465f-b939-3feec4cb5dc6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f2ba2e8375b4e8c8792ee1e22b60427', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '00a5583c7b7443e98e7a1d31a0b638dc', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=71939) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 24 16:56:49.022762 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d080564-7873-465f-b939-3feec4cb5dc6 admin admin] REQUEST_METHOD: `GET` {{(pid=71939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 24 16:56:49.023099 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d080564-7873-465f-b939-3feec4cb5dc6 admin admin] SCRIPT_NAME: `/identity` {{(pid=71939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 24 16:56:49.023436 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d080564-7873-465f-b939-3feec4cb5dc6 admin admin] PATH_INFO: `/v3/roles` {{(pid=71939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 24 16:56:49.024225 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d080564-7873-465f-b939-3feec4cb5dc6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=71939) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:442}} Nov 24 16:56:49.052831 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d080564-7873-465f-b939-3feec4cb5dc6 admin admin] RBAC: Authorization granted {{(pid=71939) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 24 16:56:49.068817 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: [pid: 71939|app: 0|req: 1281/2549] 10.222.0.53 () {58 vars in 1112 bytes} [Wed Nov 24 16:56:49 2021] GET /identity/v3/roles => generated 1420 bytes in 60 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 24 16:56:49.070153 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd24790a-0a7e-4bde-bca3-fd9cbc301848 admin admin] Authenticating user token {{(pid=71938) process_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 24 16:56:49.081229 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd24790a-0a7e-4bde-bca3-fd9cbc301848 admin admin] Validating token access rules against request {{(pid=71938) validate_allowed_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 24 16:56:49.086089 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ce6941e-53ef-4669-81af-253b5cded219 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f2ba2e8375b4e8c8792ee1e22b60427', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '00a5583c7b7443e98e7a1d31a0b638dc', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=71938) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 24 16:56:49.086916 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ce6941e-53ef-4669-81af-253b5cded219 admin admin] REQUEST_METHOD: `PUT` {{(pid=71938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 24 16:56:49.087351 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ce6941e-53ef-4669-81af-253b5cded219 admin admin] SCRIPT_NAME: `/identity` {{(pid=71938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 24 16:56:49.087760 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ce6941e-53ef-4669-81af-253b5cded219 admin admin] PATH_INFO: `/v3/projects/1c4daf6a92084b6f8ab7198af9a4017f/users/27292ba608ac4077b74039e1e0cd158c/roles/5611724e350b41e19921b5961a342582` {{(pid=71938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 24 16:56:49.110561 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ce6941e-53ef-4669-81af-253b5cded219 admin admin] RBAC: Authorizing `identity:create_grant(project_id=1c4daf6a92084b6f8ab7198af9a4017f, user_id=27292ba608ac4077b74039e1e0cd158c, role_id=5611724e350b41e19921b5961a342582)` {{(pid=71938) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:442}} Nov 24 16:56:49.140395 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ce6941e-53ef-4669-81af-253b5cded219 admin admin] RBAC: Authorization granted {{(pid=71938) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 24 16:56:49.159614 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: [pid: 71938|app: 0|req: 1269/2550] 10.222.0.53 () {60 vars in 1473 bytes} [Wed Nov 24 16:56:49 2021] PUT /identity/v3/projects/1c4daf6a92084b6f8ab7198af9a4017f/users/27292ba608ac4077b74039e1e0cd158c/roles/5611724e350b41e19921b5961a342582 => generated 0 bytes in 90 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 24 16:56:49.163784 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d080564-7873-465f-b939-3feec4cb5dc6 admin admin] Authenticating user token {{(pid=71939) process_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 24 16:56:49.174409 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d080564-7873-465f-b939-3feec4cb5dc6 admin admin] Validating token access rules against request {{(pid=71939) validate_allowed_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 24 16:56:49.250797 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-361e5da8-8de1-490d-96be-62d6d89904e0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f2ba2e8375b4e8c8792ee1e22b60427', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '00a5583c7b7443e98e7a1d31a0b638dc', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=71939) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 24 16:56:49.252014 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-361e5da8-8de1-490d-96be-62d6d89904e0 admin admin] REQUEST_METHOD: `GET` {{(pid=71939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 24 16:56:49.252355 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-361e5da8-8de1-490d-96be-62d6d89904e0 admin admin] SCRIPT_NAME: `/identity` {{(pid=71939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 24 16:56:49.252919 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-361e5da8-8de1-490d-96be-62d6d89904e0 admin admin] PATH_INFO: `/v3/roles` {{(pid=71939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 24 16:56:49.253711 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-361e5da8-8de1-490d-96be-62d6d89904e0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=71939) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:442}} Nov 24 16:56:49.282579 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-361e5da8-8de1-490d-96be-62d6d89904e0 admin admin] RBAC: Authorization granted {{(pid=71939) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 24 16:56:49.297098 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: [pid: 71939|app: 0|req: 1282/2551] 10.222.0.53 () {58 vars in 1112 bytes} [Wed Nov 24 16:56:49 2021] GET /identity/v3/roles => generated 1420 bytes in 131 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 24 16:56:49.298611 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ce6941e-53ef-4669-81af-253b5cded219 admin admin] Authenticating user token {{(pid=71938) process_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 24 16:56:49.310238 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ce6941e-53ef-4669-81af-253b5cded219 admin admin] Validating token access rules against request {{(pid=71938) validate_allowed_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 24 16:56:49.315740 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ed937f3-945f-459c-ab63-6d21c6384368 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f2ba2e8375b4e8c8792ee1e22b60427', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '00a5583c7b7443e98e7a1d31a0b638dc', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=71938) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 24 16:56:49.316649 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ed937f3-945f-459c-ab63-6d21c6384368 admin admin] REQUEST_METHOD: `PUT` {{(pid=71938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 24 16:56:49.316988 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ed937f3-945f-459c-ab63-6d21c6384368 admin admin] SCRIPT_NAME: `/identity` {{(pid=71938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 24 16:56:49.317321 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ed937f3-945f-459c-ab63-6d21c6384368 admin admin] PATH_INFO: `/v3/projects/1c4daf6a92084b6f8ab7198af9a4017f/users/27292ba608ac4077b74039e1e0cd158c/roles/5611724e350b41e19921b5961a342582` {{(pid=71938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 24 16:56:49.319345 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ed937f3-945f-459c-ab63-6d21c6384368 admin admin] RBAC: Authorizing `identity:create_grant(project_id=1c4daf6a92084b6f8ab7198af9a4017f, user_id=27292ba608ac4077b74039e1e0cd158c, role_id=5611724e350b41e19921b5961a342582)` {{(pid=71938) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:442}} Nov 24 16:56:49.349780 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ed937f3-945f-459c-ab63-6d21c6384368 admin admin] RBAC: Authorization granted {{(pid=71938) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 24 16:56:49.360354 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: [pid: 71938|app: 0|req: 1270/2552] 10.222.0.53 () {60 vars in 1473 bytes} [Wed Nov 24 16:56:49 2021] PUT /identity/v3/projects/1c4daf6a92084b6f8ab7198af9a4017f/users/27292ba608ac4077b74039e1e0cd158c/roles/5611724e350b41e19921b5961a342582 => generated 0 bytes in 62 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 24 16:56:49.364680 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-361e5da8-8de1-490d-96be-62d6d89904e0 admin admin] Authenticating user token {{(pid=71939) process_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 24 16:56:49.374960 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-361e5da8-8de1-490d-96be-62d6d89904e0 admin admin] Validating token access rules against request {{(pid=71939) validate_allowed_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 24 16:56:49.441311 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dd7d0e6-2744-441e-9aa9-90989186c7be admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f2ba2e8375b4e8c8792ee1e22b60427', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '00a5583c7b7443e98e7a1d31a0b638dc', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=71939) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 24 16:56:49.441988 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dd7d0e6-2744-441e-9aa9-90989186c7be admin admin] REQUEST_METHOD: `GET` {{(pid=71939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 24 16:56:49.442375 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dd7d0e6-2744-441e-9aa9-90989186c7be admin admin] SCRIPT_NAME: `/identity` {{(pid=71939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 24 16:56:49.442714 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dd7d0e6-2744-441e-9aa9-90989186c7be admin admin] PATH_INFO: `/v3/roles` {{(pid=71939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 24 16:56:49.443503 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5dd7d0e6-2744-441e-9aa9-90989186c7be admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=71939) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:442}} Nov 24 16:56:49.476349 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5dd7d0e6-2744-441e-9aa9-90989186c7be admin admin] RBAC: Authorization granted {{(pid=71939) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 24 16:56:49.487813 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: [pid: 71939|app: 0|req: 1283/2553] 10.222.0.53 () {58 vars in 1112 bytes} [Wed Nov 24 16:56:49 2021] GET /identity/v3/roles => generated 1420 bytes in 124 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 24 16:56:49.492402 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ed937f3-945f-459c-ab63-6d21c6384368 admin admin] Authenticating user token {{(pid=71938) process_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 24 16:56:49.503570 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ed937f3-945f-459c-ab63-6d21c6384368 admin admin] Validating token access rules against request {{(pid=71938) validate_allowed_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 24 16:56:49.508209 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51a47002-56a6-495f-a146-dc3855e6492c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f2ba2e8375b4e8c8792ee1e22b60427', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '00a5583c7b7443e98e7a1d31a0b638dc', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=71938) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 24 16:56:49.509108 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51a47002-56a6-495f-a146-dc3855e6492c admin admin] REQUEST_METHOD: `PUT` {{(pid=71938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 24 16:56:49.509447 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51a47002-56a6-495f-a146-dc3855e6492c admin admin] SCRIPT_NAME: `/identity` {{(pid=71938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 24 16:56:49.509780 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51a47002-56a6-495f-a146-dc3855e6492c admin admin] PATH_INFO: `/v3/projects/1c4daf6a92084b6f8ab7198af9a4017f/users/27292ba608ac4077b74039e1e0cd158c/roles/912ab5f10fa5477da74acf239f07604e` {{(pid=71938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 24 16:56:49.511795 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51a47002-56a6-495f-a146-dc3855e6492c admin admin] RBAC: Authorizing `identity:create_grant(project_id=1c4daf6a92084b6f8ab7198af9a4017f, user_id=27292ba608ac4077b74039e1e0cd158c, role_id=912ab5f10fa5477da74acf239f07604e)` {{(pid=71938) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:442}} Nov 24 16:56:49.541709 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51a47002-56a6-495f-a146-dc3855e6492c admin admin] RBAC: Authorization granted {{(pid=71938) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 24 16:56:49.556712 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: [pid: 71938|app: 0|req: 1271/2554] 10.222.0.53 () {60 vars in 1473 bytes} [Wed Nov 24 16:56:49 2021] PUT /identity/v3/projects/1c4daf6a92084b6f8ab7198af9a4017f/users/27292ba608ac4077b74039e1e0cd158c/roles/912ab5f10fa5477da74acf239f07604e => generated 0 bytes in 65 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 24 16:56:49.569719 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11849b96-872d-4598-9c44-74d1f47ec037 None None] REQUEST_METHOD: `POST` {{(pid=71939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 24 16:56:49.570107 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11849b96-872d-4598-9c44-74d1f47ec037 None None] SCRIPT_NAME: `/identity` {{(pid=71939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 24 16:56:49.570446 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11849b96-872d-4598-9c44-74d1f47ec037 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=71939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 24 16:56:49.608145 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.auth.core [None req-11849b96-872d-4598-9c44-74d1f47ec037 None None] MFA Rules not processed for user `27292ba608ac4077b74039e1e0cd158c`. Rule list: `[]` (Enabled: `True`). {{(pid=71939) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:442}} Nov 24 16:56:49.609440 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.fernet_utils [None req-11849b96-872d-4598-9c44-74d1f47ec037 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=71939) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:289}} Nov 24 16:56:49.693173 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: [pid: 71939|app: 0|req: 1284/2555] 10.222.0.53 () {58 vars in 948 bytes} [Wed Nov 24 16:56:49 2021] POST /identity/v3/auth/tokens => generated 3741 bytes in 125 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Nov 24 16:56:49.703928 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51a47002-56a6-495f-a146-dc3855e6492c admin admin] Authenticating user token {{(pid=71938) process_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 24 16:56:49.705692 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.fernet_utils [None req-51a47002-56a6-495f-a146-dc3855e6492c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=71938) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:289}} Nov 24 16:56:49.772456 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51a47002-56a6-495f-a146-dc3855e6492c admin admin] Validating token access rules against request {{(pid=71938) validate_allowed_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 24 16:56:49.776061 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eea41125-7868-472a-bc29-34b300609b22 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a12374a3093a401a97c343ff0854184d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3b3940d4ae1c4177ae29c02377bb4b0b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=71938) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 24 16:56:49.776712 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eea41125-7868-472a-bc29-34b300609b22 service cinder] REQUEST_METHOD: `GET` {{(pid=71938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 24 16:56:49.777049 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eea41125-7868-472a-bc29-34b300609b22 service cinder] SCRIPT_NAME: `/identity` {{(pid=71938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 24 16:56:49.777375 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eea41125-7868-472a-bc29-34b300609b22 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=71938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 24 16:56:49.795427 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eea41125-7868-472a-bc29-34b300609b22 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=71938) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:442}} Nov 24 16:56:49.816169 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eea41125-7868-472a-bc29-34b300609b22 service cinder] RBAC: Authorization granted {{(pid=71938) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 24 16:56:49.828084 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: [pid: 71938|app: 0|req: 1272/2556] 10.222.0.53 () {60 vars in 1356 bytes} [Wed Nov 24 16:56:49 2021] GET /identity/v3/auth/tokens => generated 3741 bytes in 125 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 24 16:56:49.893311 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11849b96-872d-4598-9c44-74d1f47ec037 None None] Authenticating user token {{(pid=71939) process_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 24 16:56:49.894907 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.fernet_utils [None req-11849b96-872d-4598-9c44-74d1f47ec037 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=71939) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:289}} Nov 24 16:56:49.907074 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11849b96-872d-4598-9c44-74d1f47ec037 None None] Validating token access rules against request {{(pid=71939) validate_allowed_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 24 16:56:49.910755 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82eac7c9-dbff-4eea-aa29-e5d4443b0d2d service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a12374a3093a401a97c343ff0854184d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3b3940d4ae1c4177ae29c02377bb4b0b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=71939) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 24 16:56:49.911405 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82eac7c9-dbff-4eea-aa29-e5d4443b0d2d service cinder] REQUEST_METHOD: `GET` {{(pid=71939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 24 16:56:49.911740 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82eac7c9-dbff-4eea-aa29-e5d4443b0d2d service cinder] SCRIPT_NAME: `/identity` {{(pid=71939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 24 16:56:49.912064 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82eac7c9-dbff-4eea-aa29-e5d4443b0d2d service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=71939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 24 16:56:49.978589 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82eac7c9-dbff-4eea-aa29-e5d4443b0d2d service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=71939) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:442}} Nov 24 16:56:50.007116 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82eac7c9-dbff-4eea-aa29-e5d4443b0d2d service cinder] RBAC: Authorization granted {{(pid=71939) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 24 16:56:50.016531 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: [pid: 71939|app: 0|req: 1285/2557] 10.222.0.53 () {60 vars in 1356 bytes} [Wed Nov 24 16:56:49 2021] GET /identity/v3/auth/tokens => generated 3674 bytes in 124 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 24 16:56:51.733653 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eea41125-7868-472a-bc29-34b300609b22 service cinder] Authenticating user token {{(pid=71938) process_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 24 16:56:51.813712 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eea41125-7868-472a-bc29-34b300609b22 service cinder] Validating token access rules against request {{(pid=71938) validate_allowed_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 24 16:56:51.818430 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71497d36-02e4-4ed6-a1a6-d709b57eb1b4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f2ba2e8375b4e8c8792ee1e22b60427', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '00a5583c7b7443e98e7a1d31a0b638dc', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=71938) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 24 16:56:51.819317 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71497d36-02e4-4ed6-a1a6-d709b57eb1b4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=71938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 24 16:56:51.819649 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71497d36-02e4-4ed6-a1a6-d709b57eb1b4 admin admin] SCRIPT_NAME: `/identity` {{(pid=71938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 24 16:56:51.819976 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71497d36-02e4-4ed6-a1a6-d709b57eb1b4 admin admin] PATH_INFO: `/v3/users/ddb645e5c64740a898b28f560f5b4524` {{(pid=71938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 24 16:56:51.821184 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71497d36-02e4-4ed6-a1a6-d709b57eb1b4 admin admin] RBAC: Authorizing `identity:delete_user(user_id=ddb645e5c64740a898b28f560f5b4524)` {{(pid=71938) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:442}} Nov 24 16:56:51.850661 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71497d36-02e4-4ed6-a1a6-d709b57eb1b4 admin admin] RBAC: Authorization granted {{(pid=71938) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 24 16:56:51.898843 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.notifications [None req-71497d36-02e4-4ed6-a1a6-d709b57eb1b4 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ddb645e5c64740a898b28f560f5b4524'} {{(pid=71938) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:357}} Nov 24 16:56:51.911755 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.notifications [None req-71497d36-02e4-4ed6-a1a6-d709b57eb1b4 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ddb645e5c64740a898b28f560f5b4524'} {{(pid=71938) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:357}} Nov 24 16:56:51.912467 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.notifications [None req-71497d36-02e4-4ed6-a1a6-d709b57eb1b4 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ddb645e5c64740a898b28f560f5b4524'} {{(pid=71938) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:357}} Nov 24 16:56:51.920624 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.notifications [None req-71497d36-02e4-4ed6-a1a6-d709b57eb1b4 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ddb645e5c64740a898b28f560f5b4524'} {{(pid=71938) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:357}} Nov 24 16:56:51.934953 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.notifications [None req-71497d36-02e4-4ed6-a1a6-d709b57eb1b4 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ddb645e5c64740a898b28f560f5b4524'} {{(pid=71938) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:357}} Nov 24 16:56:51.941528 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: [pid: 71938|app: 0|req: 1273/2558] 10.222.0.53 () {58 vars in 1214 bytes} [Wed Nov 24 16:56:51 2021] DELETE /identity/v3/users/ddb645e5c64740a898b28f560f5b4524 => generated 0 bytes in 208 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 24 16:56:51.946286 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0cae986-0fd5-467b-8b19-b1b317f83599 None None] REQUEST_METHOD: `POST` {{(pid=71939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 24 16:56:51.946640 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0cae986-0fd5-467b-8b19-b1b317f83599 None None] SCRIPT_NAME: `/identity` {{(pid=71939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 24 16:56:51.946982 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0cae986-0fd5-467b-8b19-b1b317f83599 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=71939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 24 16:56:51.972385 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.auth.core [None req-f0cae986-0fd5-467b-8b19-b1b317f83599 None None] MFA Rules not processed for user `0f2ba2e8375b4e8c8792ee1e22b60427`. Rule list: `[]` (Enabled: `True`). {{(pid=71939) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:442}} Nov 24 16:56:51.973596 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.fernet_utils [None req-f0cae986-0fd5-467b-8b19-b1b317f83599 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=71939) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:289}} Nov 24 16:56:52.040690 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: [pid: 71939|app: 0|req: 1286/2559] 10.222.0.53 () {58 vars in 948 bytes} [Wed Nov 24 16:56:51 2021] POST /identity/v3/auth/tokens => generated 3669 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 24 16:56:52.051995 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71497d36-02e4-4ed6-a1a6-d709b57eb1b4 admin admin] Authenticating user token {{(pid=71938) process_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 24 16:56:52.053590 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.fernet_utils [None req-71497d36-02e4-4ed6-a1a6-d709b57eb1b4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=71938) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:289}} Nov 24 16:56:52.122051 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71497d36-02e4-4ed6-a1a6-d709b57eb1b4 admin admin] Validating token access rules against request {{(pid=71938) validate_allowed_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 24 16:56:52.125767 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a5699eb-9b54-48ee-963a-c84fdee39cae service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c90f21b9cdcb413282461fa83cb6b7a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3b3940d4ae1c4177ae29c02377bb4b0b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=71938) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 24 16:56:52.126514 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a5699eb-9b54-48ee-963a-c84fdee39cae service neutron] REQUEST_METHOD: `GET` {{(pid=71938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 24 16:56:52.126854 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a5699eb-9b54-48ee-963a-c84fdee39cae service neutron] SCRIPT_NAME: `/identity` {{(pid=71938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 24 16:56:52.127224 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a5699eb-9b54-48ee-963a-c84fdee39cae service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=71938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 24 16:56:52.136745 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a5699eb-9b54-48ee-963a-c84fdee39cae service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=71938) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:442}} Nov 24 16:56:52.166101 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a5699eb-9b54-48ee-963a-c84fdee39cae service neutron] RBAC: Authorization granted {{(pid=71938) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 24 16:56:52.176177 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: [pid: 71938|app: 0|req: 1274/2560] 10.222.0.53 () {60 vars in 1356 bytes} [Wed Nov 24 16:56:52 2021] GET /identity/v3/auth/tokens => generated 3669 bytes in 125 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 24 16:56:52.535507 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0cae986-0fd5-467b-8b19-b1b317f83599 None None] Authenticating user token {{(pid=71939) process_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 24 16:56:52.537133 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.fernet_utils [None req-f0cae986-0fd5-467b-8b19-b1b317f83599 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=71939) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:289}} Nov 24 16:56:52.549437 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0cae986-0fd5-467b-8b19-b1b317f83599 None None] Validating token access rules against request {{(pid=71939) validate_allowed_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 24 16:56:52.554254 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0ab4f06-82eb-4222-abe3-726c812cf28b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f2ba2e8375b4e8c8792ee1e22b60427', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '00a5583c7b7443e98e7a1d31a0b638dc', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=71939) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 24 16:56:52.555125 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0ab4f06-82eb-4222-abe3-726c812cf28b admin admin] REQUEST_METHOD: `DELETE` {{(pid=71939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 24 16:56:52.555464 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0ab4f06-82eb-4222-abe3-726c812cf28b admin admin] SCRIPT_NAME: `/identity` {{(pid=71939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 24 16:56:52.555796 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0ab4f06-82eb-4222-abe3-726c812cf28b admin admin] PATH_INFO: `/v3/projects/305d258b66624f20bbfd5439a0e228f5` {{(pid=71939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 24 16:56:52.557007 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0ab4f06-82eb-4222-abe3-726c812cf28b admin admin] RBAC: Authorizing `identity:delete_project(project_id=305d258b66624f20bbfd5439a0e228f5)` {{(pid=71939) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:442}} Nov 24 16:56:52.586650 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0ab4f06-82eb-4222-abe3-726c812cf28b admin admin] RBAC: Authorization granted {{(pid=71939) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 24 16:56:52.636788 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.notifications [None req-e0ab4f06-82eb-4222-abe3-726c812cf28b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '305d258b66624f20bbfd5439a0e228f5', 'request_id': 'req-e0ab4f06-82eb-4222-abe3-726c812cf28b'} {{(pid=71939) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:357}} Nov 24 16:56:52.648989 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.notifications [None req-e0ab4f06-82eb-4222-abe3-726c812cf28b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '305d258b66624f20bbfd5439a0e228f5', 'request_id': 'req-e0ab4f06-82eb-4222-abe3-726c812cf28b'} {{(pid=71939) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:357}} Nov 24 16:56:52.655424 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.notifications [None req-e0ab4f06-82eb-4222-abe3-726c812cf28b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '305d258b66624f20bbfd5439a0e228f5', 'request_id': 'req-e0ab4f06-82eb-4222-abe3-726c812cf28b'} {{(pid=71939) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:357}} Nov 24 16:56:52.666182 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.notifications [None req-e0ab4f06-82eb-4222-abe3-726c812cf28b admin admin] The token cache is being invalidate because project 305d258b66624f20bbfd5439a0e228f5 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=71939) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Nov 24 16:56:52.666511 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.notifications [None req-e0ab4f06-82eb-4222-abe3-726c812cf28b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=71939) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:357}} Nov 24 16:56:52.667178 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.notifications [None req-e0ab4f06-82eb-4222-abe3-726c812cf28b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=71939) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:357}} Nov 24 16:56:52.668723 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: [pid: 71939|app: 0|req: 1287/2561] 10.222.0.53 () {58 vars in 1223 bytes} [Wed Nov 24 16:56:52 2021] DELETE /identity/v3/projects/305d258b66624f20bbfd5439a0e228f5 => generated 0 bytes in 134 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 24 16:56:52.673009 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a5699eb-9b54-48ee-963a-c84fdee39cae service neutron] Authenticating user token {{(pid=71938) process_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 24 16:56:52.683083 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a5699eb-9b54-48ee-963a-c84fdee39cae service neutron] Validating token access rules against request {{(pid=71938) validate_allowed_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 24 16:56:52.750541 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-246b266d-c73f-45ca-8d68-842951fa4da3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f2ba2e8375b4e8c8792ee1e22b60427', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '00a5583c7b7443e98e7a1d31a0b638dc', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=71938) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 24 16:56:52.751474 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-246b266d-c73f-45ca-8d68-842951fa4da3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=71938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 24 16:56:52.751761 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-246b266d-c73f-45ca-8d68-842951fa4da3 admin admin] SCRIPT_NAME: `/identity` {{(pid=71938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 24 16:56:52.752095 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-246b266d-c73f-45ca-8d68-842951fa4da3 admin admin] PATH_INFO: `/v3/users/27292ba608ac4077b74039e1e0cd158c` {{(pid=71938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 24 16:56:52.753327 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-246b266d-c73f-45ca-8d68-842951fa4da3 admin admin] RBAC: Authorizing `identity:delete_user(user_id=27292ba608ac4077b74039e1e0cd158c)` {{(pid=71938) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:442}} Nov 24 16:56:52.786186 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-246b266d-c73f-45ca-8d68-842951fa4da3 admin admin] RBAC: Authorization granted {{(pid=71938) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 24 16:56:52.836518 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.notifications [None req-246b266d-c73f-45ca-8d68-842951fa4da3 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '27292ba608ac4077b74039e1e0cd158c'} {{(pid=71938) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:357}} Nov 24 16:56:52.850517 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.notifications [None req-246b266d-c73f-45ca-8d68-842951fa4da3 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '27292ba608ac4077b74039e1e0cd158c'} {{(pid=71938) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:357}} Nov 24 16:56:52.851249 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.notifications [None req-246b266d-c73f-45ca-8d68-842951fa4da3 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '27292ba608ac4077b74039e1e0cd158c'} {{(pid=71938) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:357}} Nov 24 16:56:52.859574 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.notifications [None req-246b266d-c73f-45ca-8d68-842951fa4da3 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '27292ba608ac4077b74039e1e0cd158c'} {{(pid=71938) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:357}} Nov 24 16:56:52.865911 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.notifications [None req-246b266d-c73f-45ca-8d68-842951fa4da3 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '27292ba608ac4077b74039e1e0cd158c'} {{(pid=71938) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:357}} Nov 24 16:56:52.872260 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: [pid: 71938|app: 0|req: 1275/2562] 10.222.0.53 () {58 vars in 1214 bytes} [Wed Nov 24 16:56:52 2021] DELETE /identity/v3/users/27292ba608ac4077b74039e1e0cd158c => generated 0 bytes in 200 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 24 16:56:53.247446 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0ab4f06-82eb-4222-abe3-726c812cf28b admin admin] Authenticating user token {{(pid=71939) process_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 24 16:56:53.249171 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.fernet_utils [None req-e0ab4f06-82eb-4222-abe3-726c812cf28b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=71939) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:289}} Nov 24 16:56:53.264110 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0ab4f06-82eb-4222-abe3-726c812cf28b admin admin] Validating token access rules against request {{(pid=71939) validate_allowed_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 24 16:56:53.332100 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02d3e5c7-3e16-4d9a-851d-1bbaa784d7dc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f2ba2e8375b4e8c8792ee1e22b60427', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '00a5583c7b7443e98e7a1d31a0b638dc', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=71939) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 24 16:56:53.332986 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02d3e5c7-3e16-4d9a-851d-1bbaa784d7dc admin admin] REQUEST_METHOD: `DELETE` {{(pid=71939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 24 16:56:53.333322 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02d3e5c7-3e16-4d9a-851d-1bbaa784d7dc admin admin] SCRIPT_NAME: `/identity` {{(pid=71939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 24 16:56:53.333651 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02d3e5c7-3e16-4d9a-851d-1bbaa784d7dc admin admin] PATH_INFO: `/v3/projects/1c4daf6a92084b6f8ab7198af9a4017f` {{(pid=71939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 24 16:56:53.334901 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02d3e5c7-3e16-4d9a-851d-1bbaa784d7dc admin admin] RBAC: Authorizing `identity:delete_project(project_id=1c4daf6a92084b6f8ab7198af9a4017f)` {{(pid=71939) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:442}} Nov 24 16:56:53.363825 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02d3e5c7-3e16-4d9a-851d-1bbaa784d7dc admin admin] RBAC: Authorization granted {{(pid=71939) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 24 16:56:53.413093 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.notifications [None req-02d3e5c7-3e16-4d9a-851d-1bbaa784d7dc admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '1c4daf6a92084b6f8ab7198af9a4017f', 'request_id': 'req-02d3e5c7-3e16-4d9a-851d-1bbaa784d7dc'} {{(pid=71939) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:357}} Nov 24 16:56:53.425189 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.notifications [None req-02d3e5c7-3e16-4d9a-851d-1bbaa784d7dc admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '1c4daf6a92084b6f8ab7198af9a4017f', 'request_id': 'req-02d3e5c7-3e16-4d9a-851d-1bbaa784d7dc'} {{(pid=71939) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:357}} Nov 24 16:56:53.431089 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.notifications [None req-02d3e5c7-3e16-4d9a-851d-1bbaa784d7dc admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '1c4daf6a92084b6f8ab7198af9a4017f', 'request_id': 'req-02d3e5c7-3e16-4d9a-851d-1bbaa784d7dc'} {{(pid=71939) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:357}} Nov 24 16:56:53.442238 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.notifications [None req-02d3e5c7-3e16-4d9a-851d-1bbaa784d7dc admin admin] The token cache is being invalidate because project 1c4daf6a92084b6f8ab7198af9a4017f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=71939) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Nov 24 16:56:53.442569 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.notifications [None req-02d3e5c7-3e16-4d9a-851d-1bbaa784d7dc admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=71939) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:357}} Nov 24 16:56:53.443233 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.notifications [None req-02d3e5c7-3e16-4d9a-851d-1bbaa784d7dc admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=71939) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:357}} Nov 24 16:56:53.444766 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: [pid: 71939|app: 0|req: 1288/2563] 10.222.0.53 () {58 vars in 1223 bytes} [Wed Nov 24 16:56:53 2021] DELETE /identity/v3/projects/1c4daf6a92084b6f8ab7198af9a4017f => generated 0 bytes in 198 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 24 16:56:53.452812 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc02ade1-e5f5-4252-80ff-bfe5d35bed65 None None] REQUEST_METHOD: `POST` {{(pid=71938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 24 16:56:53.453158 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc02ade1-e5f5-4252-80ff-bfe5d35bed65 None None] SCRIPT_NAME: `/identity` {{(pid=71938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 24 16:56:53.453489 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc02ade1-e5f5-4252-80ff-bfe5d35bed65 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=71938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 24 16:56:53.476738 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.auth.core [None req-fc02ade1-e5f5-4252-80ff-bfe5d35bed65 None None] MFA Rules not processed for user `0f2ba2e8375b4e8c8792ee1e22b60427`. Rule list: `[]` (Enabled: `True`). {{(pid=71938) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:442}} Nov 24 16:56:53.477935 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.fernet_utils [None req-fc02ade1-e5f5-4252-80ff-bfe5d35bed65 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=71938) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:289}} Nov 24 16:56:53.549548 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: [pid: 71938|app: 0|req: 1276/2564] 10.222.0.53 () {58 vars in 948 bytes} [Wed Nov 24 16:56:53 2021] POST /identity/v3/auth/tokens => generated 3669 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 24 16:56:53.557962 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2d0f15f-5ee2-46c5-a3e3-942508d55aaa None None] REQUEST_METHOD: `POST` {{(pid=71939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 24 16:56:53.558339 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2d0f15f-5ee2-46c5-a3e3-942508d55aaa None None] SCRIPT_NAME: `/identity` {{(pid=71939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 24 16:56:53.558679 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2d0f15f-5ee2-46c5-a3e3-942508d55aaa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=71939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 24 16:56:53.582725 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.auth.core [None req-d2d0f15f-5ee2-46c5-a3e3-942508d55aaa None None] MFA Rules not processed for user `0f2ba2e8375b4e8c8792ee1e22b60427`. Rule list: `[]` (Enabled: `True`). {{(pid=71939) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:442}} Nov 24 16:56:53.583949 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.fernet_utils [None req-d2d0f15f-5ee2-46c5-a3e3-942508d55aaa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=71939) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:289}} Nov 24 16:56:53.591371 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: [pid: 71939|app: 0|req: 1289/2565] 10.222.0.53 () {58 vars in 948 bytes} [Wed Nov 24 16:56:53 2021] POST /identity/v3/auth/tokens => generated 3669 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 24 16:56:53.595624 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc02ade1-e5f5-4252-80ff-bfe5d35bed65 None None] Authenticating user token {{(pid=71938) process_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 24 16:56:53.605276 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc02ade1-e5f5-4252-80ff-bfe5d35bed65 None None] Validating token access rules against request {{(pid=71938) validate_allowed_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 24 16:56:53.609718 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-970c20d5-a5b2-4550-8658-ad534f81bdf7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f2ba2e8375b4e8c8792ee1e22b60427', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '00a5583c7b7443e98e7a1d31a0b638dc', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=71938) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 24 16:56:53.610407 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-970c20d5-a5b2-4550-8658-ad534f81bdf7 admin admin] REQUEST_METHOD: `GET` {{(pid=71938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 24 16:56:53.611249 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-970c20d5-a5b2-4550-8658-ad534f81bdf7 admin admin] SCRIPT_NAME: `/identity` {{(pid=71938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 24 16:56:53.611578 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-970c20d5-a5b2-4550-8658-ad534f81bdf7 admin admin] PATH_INFO: `/v3/domains` {{(pid=71938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 24 16:56:53.612354 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-970c20d5-a5b2-4550-8658-ad534f81bdf7 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=71938) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:161}} Nov 24 16:56:53.612698 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-970c20d5-a5b2-4550-8658-ad534f81bdf7 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=71938) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:442}} Nov 24 16:56:53.641149 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-970c20d5-a5b2-4550-8658-ad534f81bdf7 admin admin] RBAC: Authorization granted {{(pid=71938) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 24 16:56:53.654795 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: [pid: 71938|app: 0|req: 1277/2566] 10.222.0.53 () {58 vars in 1143 bytes} [Wed Nov 24 16:56:53 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 60 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 24 16:56:53.659315 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2d0f15f-5ee2-46c5-a3e3-942508d55aaa None None] Authenticating user token {{(pid=71939) process_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 24 16:56:53.668484 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2d0f15f-5ee2-46c5-a3e3-942508d55aaa None None] Validating token access rules against request {{(pid=71939) validate_allowed_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 24 16:56:53.673596 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27b7edd7-c5aa-4f02-9132-f1c3546d69b5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f2ba2e8375b4e8c8792ee1e22b60427', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '00a5583c7b7443e98e7a1d31a0b638dc', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=71939) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 24 16:56:53.674298 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27b7edd7-c5aa-4f02-9132-f1c3546d69b5 admin admin] REQUEST_METHOD: `POST` {{(pid=71939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 24 16:56:53.674620 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27b7edd7-c5aa-4f02-9132-f1c3546d69b5 admin admin] SCRIPT_NAME: `/identity` {{(pid=71939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 24 16:56:53.674955 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27b7edd7-c5aa-4f02-9132-f1c3546d69b5 admin admin] PATH_INFO: `/v3/projects` {{(pid=71939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 24 16:56:53.675681 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27b7edd7-c5aa-4f02-9132-f1c3546d69b5 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=71939) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:442}} Nov 24 16:56:53.704795 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27b7edd7-c5aa-4f02-9132-f1c3546d69b5 admin admin] RBAC: Authorization granted {{(pid=71939) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 24 16:56:53.732391 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: [pid: 71939|app: 0|req: 1290/2567] 10.222.0.53 () {60 vars in 1143 bytes} [Wed Nov 24 16:56:53 2021] POST /identity/v3/projects => generated 409 bytes in 73 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 24 16:56:53.737256 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-970c20d5-a5b2-4550-8658-ad534f81bdf7 admin admin] Authenticating user token {{(pid=71938) process_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 24 16:56:53.747307 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-970c20d5-a5b2-4550-8658-ad534f81bdf7 admin admin] Validating token access rules against request {{(pid=71938) validate_allowed_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 24 16:56:53.813086 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e34285ba-17ef-422d-885e-00de16495694 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f2ba2e8375b4e8c8792ee1e22b60427', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '00a5583c7b7443e98e7a1d31a0b638dc', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=71938) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 24 16:56:53.813796 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e34285ba-17ef-422d-885e-00de16495694 admin admin] REQUEST_METHOD: `POST` {{(pid=71938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 24 16:56:53.814166 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e34285ba-17ef-422d-885e-00de16495694 admin admin] SCRIPT_NAME: `/identity` {{(pid=71938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 24 16:56:53.814502 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e34285ba-17ef-422d-885e-00de16495694 admin admin] PATH_INFO: `/v3/users` {{(pid=71938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 24 16:56:53.815229 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e34285ba-17ef-422d-885e-00de16495694 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=71938) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:442}} Nov 24 16:56:53.843862 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e34285ba-17ef-422d-885e-00de16495694 admin admin] RBAC: Authorization granted {{(pid=71938) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 24 16:56:53.863220 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: [pid: 71938|app: 0|req: 1278/2568] 10.222.0.53 () {60 vars in 1134 bytes} [Wed Nov 24 16:56:53 2021] POST /identity/v3/users => generated 305 bytes in 126 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 24 16:56:53.867727 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27b7edd7-c5aa-4f02-9132-f1c3546d69b5 admin admin] Authenticating user token {{(pid=71939) process_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 24 16:56:53.878260 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27b7edd7-c5aa-4f02-9132-f1c3546d69b5 admin admin] Validating token access rules against request {{(pid=71939) validate_allowed_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 24 16:56:53.882847 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43cd3e86-f390-45c5-b0c7-0aa36fb7f5f3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f2ba2e8375b4e8c8792ee1e22b60427', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '00a5583c7b7443e98e7a1d31a0b638dc', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=71939) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 24 16:56:53.883517 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43cd3e86-f390-45c5-b0c7-0aa36fb7f5f3 admin admin] REQUEST_METHOD: `GET` {{(pid=71939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 24 16:56:53.883859 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43cd3e86-f390-45c5-b0c7-0aa36fb7f5f3 admin admin] SCRIPT_NAME: `/identity` {{(pid=71939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 24 16:56:53.884191 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43cd3e86-f390-45c5-b0c7-0aa36fb7f5f3 admin admin] PATH_INFO: `/v3/roles` {{(pid=71939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 24 16:56:53.884974 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43cd3e86-f390-45c5-b0c7-0aa36fb7f5f3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=71939) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:442}} Nov 24 16:56:53.913762 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43cd3e86-f390-45c5-b0c7-0aa36fb7f5f3 admin admin] RBAC: Authorization granted {{(pid=71939) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 24 16:56:53.925231 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: [pid: 71939|app: 0|req: 1291/2569] 10.222.0.53 () {58 vars in 1112 bytes} [Wed Nov 24 16:56:53 2021] GET /identity/v3/roles => generated 1420 bytes in 58 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 24 16:56:53.929431 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e34285ba-17ef-422d-885e-00de16495694 admin admin] Authenticating user token {{(pid=71938) process_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 24 16:56:53.939789 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e34285ba-17ef-422d-885e-00de16495694 admin admin] Validating token access rules against request {{(pid=71938) validate_allowed_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 24 16:56:53.944339 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9efe64c8-8256-4fa5-a0e2-93cc2ce42203 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f2ba2e8375b4e8c8792ee1e22b60427', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '00a5583c7b7443e98e7a1d31a0b638dc', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=71938) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 24 16:56:53.945235 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9efe64c8-8256-4fa5-a0e2-93cc2ce42203 admin admin] REQUEST_METHOD: `PUT` {{(pid=71938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 24 16:56:53.945577 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9efe64c8-8256-4fa5-a0e2-93cc2ce42203 admin admin] SCRIPT_NAME: `/identity` {{(pid=71938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 24 16:56:53.945910 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9efe64c8-8256-4fa5-a0e2-93cc2ce42203 admin admin] PATH_INFO: `/v3/projects/e9f1444dfc314afb83e0a8df010e3c29/users/466cad83eb9c4adeb6add61ebebda853/roles/912ab5f10fa5477da74acf239f07604e` {{(pid=71938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 24 16:56:53.966711 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9efe64c8-8256-4fa5-a0e2-93cc2ce42203 admin admin] RBAC: Authorizing `identity:create_grant(project_id=e9f1444dfc314afb83e0a8df010e3c29, user_id=466cad83eb9c4adeb6add61ebebda853, role_id=912ab5f10fa5477da74acf239f07604e)` {{(pid=71938) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:442}} Nov 24 16:56:53.996834 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9efe64c8-8256-4fa5-a0e2-93cc2ce42203 admin admin] RBAC: Authorization granted {{(pid=71938) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 24 16:56:54.009523 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: [pid: 71938|app: 0|req: 1279/2570] 10.222.0.53 () {60 vars in 1473 bytes} [Wed Nov 24 16:56:53 2021] PUT /identity/v3/projects/e9f1444dfc314afb83e0a8df010e3c29/users/466cad83eb9c4adeb6add61ebebda853/roles/912ab5f10fa5477da74acf239f07604e => generated 0 bytes in 81 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 24 16:56:54.020525 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4130f17-df60-489f-a526-8be8c859dea2 None None] REQUEST_METHOD: `POST` {{(pid=71939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 24 16:56:54.020969 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4130f17-df60-489f-a526-8be8c859dea2 None None] SCRIPT_NAME: `/identity` {{(pid=71939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 24 16:56:54.021311 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4130f17-df60-489f-a526-8be8c859dea2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=71939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 24 16:56:54.062053 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.auth.core [None req-a4130f17-df60-489f-a526-8be8c859dea2 None None] MFA Rules not processed for user `466cad83eb9c4adeb6add61ebebda853`. Rule list: `[]` (Enabled: `True`). {{(pid=71939) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:442}} Nov 24 16:56:54.063490 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.fernet_utils [None req-a4130f17-df60-489f-a526-8be8c859dea2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=71939) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:289}} Nov 24 16:56:54.151258 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: [pid: 71939|app: 0|req: 1292/2571] 10.222.0.53 () {58 vars in 948 bytes} [Wed Nov 24 16:56:54 2021] POST /identity/v3/auth/tokens => generated 3716 bytes in 132 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Nov 24 16:56:54.156043 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9efe64c8-8256-4fa5-a0e2-93cc2ce42203 admin admin] Authenticating user token {{(pid=71938) process_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 24 16:56:54.235193 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9efe64c8-8256-4fa5-a0e2-93cc2ce42203 admin admin] Validating token access rules against request {{(pid=71938) validate_allowed_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 24 16:56:54.239896 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29bcba7f-def6-4d87-b8ca-85e2f1a7139d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f2ba2e8375b4e8c8792ee1e22b60427', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '00a5583c7b7443e98e7a1d31a0b638dc', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=71938) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 24 16:56:54.240562 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29bcba7f-def6-4d87-b8ca-85e2f1a7139d admin admin] REQUEST_METHOD: `POST` {{(pid=71938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 24 16:56:54.240898 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29bcba7f-def6-4d87-b8ca-85e2f1a7139d admin admin] SCRIPT_NAME: `/identity` {{(pid=71938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 24 16:56:54.241227 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29bcba7f-def6-4d87-b8ca-85e2f1a7139d admin admin] PATH_INFO: `/v3/projects` {{(pid=71938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 24 16:56:54.241956 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29bcba7f-def6-4d87-b8ca-85e2f1a7139d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=71938) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:442}} Nov 24 16:56:54.270960 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29bcba7f-def6-4d87-b8ca-85e2f1a7139d admin admin] RBAC: Authorization granted {{(pid=71938) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 24 16:56:54.300760 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: [pid: 71938|app: 0|req: 1280/2572] 10.222.0.53 () {60 vars in 1143 bytes} [Wed Nov 24 16:56:54 2021] POST /identity/v3/projects => generated 407 bytes in 142 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 24 16:56:54.301925 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4130f17-df60-489f-a526-8be8c859dea2 None None] Authenticating user token {{(pid=71939) process_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 24 16:56:54.313102 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4130f17-df60-489f-a526-8be8c859dea2 None None] Validating token access rules against request {{(pid=71939) validate_allowed_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 24 16:56:54.380753 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c411d54b-ffea-4294-bd7a-0e36ebf6fdab admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f2ba2e8375b4e8c8792ee1e22b60427', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '00a5583c7b7443e98e7a1d31a0b638dc', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=71939) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 24 16:56:54.381438 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c411d54b-ffea-4294-bd7a-0e36ebf6fdab admin admin] REQUEST_METHOD: `POST` {{(pid=71939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 24 16:56:54.381775 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c411d54b-ffea-4294-bd7a-0e36ebf6fdab admin admin] SCRIPT_NAME: `/identity` {{(pid=71939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 24 16:56:54.382148 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c411d54b-ffea-4294-bd7a-0e36ebf6fdab admin admin] PATH_INFO: `/v3/users` {{(pid=71939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 24 16:56:54.382888 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c411d54b-ffea-4294-bd7a-0e36ebf6fdab admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=71939) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:442}} Nov 24 16:56:54.412392 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c411d54b-ffea-4294-bd7a-0e36ebf6fdab admin admin] RBAC: Authorization granted {{(pid=71939) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 24 16:56:54.433453 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: [pid: 71939|app: 0|req: 1293/2573] 10.222.0.53 () {60 vars in 1134 bytes} [Wed Nov 24 16:56:54 2021] POST /identity/v3/users => generated 310 bytes in 132 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Nov 24 16:56:54.438018 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29bcba7f-def6-4d87-b8ca-85e2f1a7139d admin admin] Authenticating user token {{(pid=71938) process_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 24 16:56:54.449042 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29bcba7f-def6-4d87-b8ca-85e2f1a7139d admin admin] Validating token access rules against request {{(pid=71938) validate_allowed_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 24 16:56:54.453659 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1b4d907-47ef-4702-a59a-1531b50ba8e8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f2ba2e8375b4e8c8792ee1e22b60427', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '00a5583c7b7443e98e7a1d31a0b638dc', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=71938) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 24 16:56:54.454396 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1b4d907-47ef-4702-a59a-1531b50ba8e8 admin admin] REQUEST_METHOD: `GET` {{(pid=71938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 24 16:56:54.455252 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1b4d907-47ef-4702-a59a-1531b50ba8e8 admin admin] SCRIPT_NAME: `/identity` {{(pid=71938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 24 16:56:54.455578 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1b4d907-47ef-4702-a59a-1531b50ba8e8 admin admin] PATH_INFO: `/v3/roles` {{(pid=71938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 24 16:56:54.456360 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1b4d907-47ef-4702-a59a-1531b50ba8e8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=71938) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:442}} Nov 24 16:56:54.484251 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1b4d907-47ef-4702-a59a-1531b50ba8e8 admin admin] RBAC: Authorization granted {{(pid=71938) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 24 16:56:54.496043 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: [pid: 71938|app: 0|req: 1281/2574] 10.222.0.53 () {58 vars in 1112 bytes} [Wed Nov 24 16:56:54 2021] GET /identity/v3/roles => generated 1420 bytes in 59 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 24 16:56:54.500590 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c411d54b-ffea-4294-bd7a-0e36ebf6fdab admin admin] Authenticating user token {{(pid=71939) process_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 24 16:56:54.511338 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c411d54b-ffea-4294-bd7a-0e36ebf6fdab admin admin] Validating token access rules against request {{(pid=71939) validate_allowed_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 24 16:56:54.515965 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b79f0825-0c62-4e2e-bab4-5d087e5fd579 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f2ba2e8375b4e8c8792ee1e22b60427', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '00a5583c7b7443e98e7a1d31a0b638dc', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=71939) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 24 16:56:54.517489 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b79f0825-0c62-4e2e-bab4-5d087e5fd579 admin admin] REQUEST_METHOD: `PUT` {{(pid=71939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 24 16:56:54.517833 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b79f0825-0c62-4e2e-bab4-5d087e5fd579 admin admin] SCRIPT_NAME: `/identity` {{(pid=71939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 24 16:56:54.518236 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b79f0825-0c62-4e2e-bab4-5d087e5fd579 admin admin] PATH_INFO: `/v3/projects/26d81836e6e141dabbd9fec5061e7d49/users/ab0fdbbb20c54b8b943f98f84c901a8c/roles/5611724e350b41e19921b5961a342582` {{(pid=71939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 24 16:56:54.539048 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b79f0825-0c62-4e2e-bab4-5d087e5fd579 admin admin] RBAC: Authorizing `identity:create_grant(project_id=26d81836e6e141dabbd9fec5061e7d49, user_id=ab0fdbbb20c54b8b943f98f84c901a8c, role_id=5611724e350b41e19921b5961a342582)` {{(pid=71939) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:442}} Nov 24 16:56:54.568686 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b79f0825-0c62-4e2e-bab4-5d087e5fd579 admin admin] RBAC: Authorization granted {{(pid=71939) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 24 16:56:54.581162 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: [pid: 71939|app: 0|req: 1294/2575] 10.222.0.53 () {60 vars in 1473 bytes} [Wed Nov 24 16:56:54 2021] PUT /identity/v3/projects/26d81836e6e141dabbd9fec5061e7d49/users/ab0fdbbb20c54b8b943f98f84c901a8c/roles/5611724e350b41e19921b5961a342582 => generated 0 bytes in 81 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 24 16:56:54.585431 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1b4d907-47ef-4702-a59a-1531b50ba8e8 admin admin] Authenticating user token {{(pid=71938) process_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 24 16:56:54.595557 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1b4d907-47ef-4702-a59a-1531b50ba8e8 admin admin] Validating token access rules against request {{(pid=71938) validate_allowed_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 24 16:56:54.660520 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67c63bb3-6ff8-4a93-8062-19e3878572a9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f2ba2e8375b4e8c8792ee1e22b60427', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '00a5583c7b7443e98e7a1d31a0b638dc', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=71938) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 24 16:56:54.661191 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67c63bb3-6ff8-4a93-8062-19e3878572a9 admin admin] REQUEST_METHOD: `GET` {{(pid=71938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 24 16:56:54.661536 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67c63bb3-6ff8-4a93-8062-19e3878572a9 admin admin] SCRIPT_NAME: `/identity` {{(pid=71938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 24 16:56:54.661868 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67c63bb3-6ff8-4a93-8062-19e3878572a9 admin admin] PATH_INFO: `/v3/roles` {{(pid=71938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 24 16:56:54.662681 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67c63bb3-6ff8-4a93-8062-19e3878572a9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=71938) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:442}} Nov 24 16:56:54.691714 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67c63bb3-6ff8-4a93-8062-19e3878572a9 admin admin] RBAC: Authorization granted {{(pid=71938) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 24 16:56:54.702197 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: [pid: 71938|app: 0|req: 1282/2576] 10.222.0.53 () {58 vars in 1112 bytes} [Wed Nov 24 16:56:54 2021] GET /identity/v3/roles => generated 1420 bytes in 117 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 24 16:56:54.707151 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b79f0825-0c62-4e2e-bab4-5d087e5fd579 admin admin] Authenticating user token {{(pid=71939) process_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 24 16:56:54.717502 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b79f0825-0c62-4e2e-bab4-5d087e5fd579 admin admin] Validating token access rules against request {{(pid=71939) validate_allowed_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 24 16:56:54.722060 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bc86c78-e79f-4ce8-a10d-8d31e26fbe4d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f2ba2e8375b4e8c8792ee1e22b60427', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '00a5583c7b7443e98e7a1d31a0b638dc', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=71939) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 24 16:56:54.722968 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bc86c78-e79f-4ce8-a10d-8d31e26fbe4d admin admin] REQUEST_METHOD: `PUT` {{(pid=71939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 24 16:56:54.723313 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bc86c78-e79f-4ce8-a10d-8d31e26fbe4d admin admin] SCRIPT_NAME: `/identity` {{(pid=71939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 24 16:56:54.723647 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bc86c78-e79f-4ce8-a10d-8d31e26fbe4d admin admin] PATH_INFO: `/v3/projects/26d81836e6e141dabbd9fec5061e7d49/users/ab0fdbbb20c54b8b943f98f84c901a8c/roles/5611724e350b41e19921b5961a342582` {{(pid=71939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 24 16:56:54.725633 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bc86c78-e79f-4ce8-a10d-8d31e26fbe4d admin admin] RBAC: Authorizing `identity:create_grant(project_id=26d81836e6e141dabbd9fec5061e7d49, user_id=ab0fdbbb20c54b8b943f98f84c901a8c, role_id=5611724e350b41e19921b5961a342582)` {{(pid=71939) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:442}} Nov 24 16:56:54.755275 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bc86c78-e79f-4ce8-a10d-8d31e26fbe4d admin admin] RBAC: Authorization granted {{(pid=71939) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 24 16:56:54.765762 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: [pid: 71939|app: 0|req: 1295/2577] 10.222.0.53 () {60 vars in 1473 bytes} [Wed Nov 24 16:56:54 2021] PUT /identity/v3/projects/26d81836e6e141dabbd9fec5061e7d49/users/ab0fdbbb20c54b8b943f98f84c901a8c/roles/5611724e350b41e19921b5961a342582 => generated 0 bytes in 59 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 24 16:56:54.773169 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67c63bb3-6ff8-4a93-8062-19e3878572a9 admin admin] Authenticating user token {{(pid=71938) process_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 24 16:56:54.784415 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67c63bb3-6ff8-4a93-8062-19e3878572a9 admin admin] Validating token access rules against request {{(pid=71938) validate_allowed_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 24 16:56:54.855033 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-031b880e-bf78-4c50-8d8b-9f62e0e7b0ac admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f2ba2e8375b4e8c8792ee1e22b60427', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '00a5583c7b7443e98e7a1d31a0b638dc', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=71938) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 24 16:56:54.855717 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-031b880e-bf78-4c50-8d8b-9f62e0e7b0ac admin admin] REQUEST_METHOD: `GET` {{(pid=71938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 24 16:56:54.856058 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-031b880e-bf78-4c50-8d8b-9f62e0e7b0ac admin admin] SCRIPT_NAME: `/identity` {{(pid=71938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 24 16:56:54.856418 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-031b880e-bf78-4c50-8d8b-9f62e0e7b0ac admin admin] PATH_INFO: `/v3/roles` {{(pid=71938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 24 16:56:54.857181 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-031b880e-bf78-4c50-8d8b-9f62e0e7b0ac admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=71938) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:442}} Nov 24 16:56:54.886223 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-031b880e-bf78-4c50-8d8b-9f62e0e7b0ac admin admin] RBAC: Authorization granted {{(pid=71938) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 24 16:56:54.897288 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: [pid: 71938|app: 0|req: 1283/2578] 10.222.0.53 () {58 vars in 1112 bytes} [Wed Nov 24 16:56:54 2021] GET /identity/v3/roles => generated 1420 bytes in 127 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 24 16:56:54.901756 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bc86c78-e79f-4ce8-a10d-8d31e26fbe4d admin admin] Authenticating user token {{(pid=71939) process_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 24 16:56:54.912141 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bc86c78-e79f-4ce8-a10d-8d31e26fbe4d admin admin] Validating token access rules against request {{(pid=71939) validate_allowed_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 24 16:56:54.916746 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60f9d13d-5b4a-48cf-9894-88c2c1c6fc4f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f2ba2e8375b4e8c8792ee1e22b60427', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '00a5583c7b7443e98e7a1d31a0b638dc', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=71939) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 24 16:56:54.917641 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60f9d13d-5b4a-48cf-9894-88c2c1c6fc4f admin admin] REQUEST_METHOD: `PUT` {{(pid=71939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 24 16:56:54.917981 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60f9d13d-5b4a-48cf-9894-88c2c1c6fc4f admin admin] SCRIPT_NAME: `/identity` {{(pid=71939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 24 16:56:54.918365 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60f9d13d-5b4a-48cf-9894-88c2c1c6fc4f admin admin] PATH_INFO: `/v3/projects/26d81836e6e141dabbd9fec5061e7d49/users/ab0fdbbb20c54b8b943f98f84c901a8c/roles/912ab5f10fa5477da74acf239f07604e` {{(pid=71939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 24 16:56:54.920353 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60f9d13d-5b4a-48cf-9894-88c2c1c6fc4f admin admin] RBAC: Authorizing `identity:create_grant(project_id=26d81836e6e141dabbd9fec5061e7d49, user_id=ab0fdbbb20c54b8b943f98f84c901a8c, role_id=912ab5f10fa5477da74acf239f07604e)` {{(pid=71939) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:442}} Nov 24 16:56:54.950738 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60f9d13d-5b4a-48cf-9894-88c2c1c6fc4f admin admin] RBAC: Authorization granted {{(pid=71939) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 24 16:56:54.963847 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: [pid: 71939|app: 0|req: 1296/2579] 10.222.0.53 () {60 vars in 1473 bytes} [Wed Nov 24 16:56:54 2021] PUT /identity/v3/projects/26d81836e6e141dabbd9fec5061e7d49/users/ab0fdbbb20c54b8b943f98f84c901a8c/roles/912ab5f10fa5477da74acf239f07604e => generated 0 bytes in 63 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 24 16:56:54.975604 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8911e0f-87be-41b9-b107-bcff461fa420 None None] REQUEST_METHOD: `POST` {{(pid=71938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 24 16:56:54.975953 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8911e0f-87be-41b9-b107-bcff461fa420 None None] SCRIPT_NAME: `/identity` {{(pid=71938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 24 16:56:54.976282 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8911e0f-87be-41b9-b107-bcff461fa420 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=71938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 24 16:56:55.015313 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.auth.core [None req-a8911e0f-87be-41b9-b107-bcff461fa420 None None] MFA Rules not processed for user `ab0fdbbb20c54b8b943f98f84c901a8c`. Rule list: `[]` (Enabled: `True`). {{(pid=71938) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:442}} Nov 24 16:56:55.016524 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.fernet_utils [None req-a8911e0f-87be-41b9-b107-bcff461fa420 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=71938) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:289}} Nov 24 16:56:55.098878 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: [pid: 71938|app: 0|req: 1284/2580] 10.222.0.53 () {58 vars in 948 bytes} [Wed Nov 24 16:56:54 2021] POST /identity/v3/auth/tokens => generated 3781 bytes in 121 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 24 16:56:55.106374 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60f9d13d-5b4a-48cf-9894-88c2c1c6fc4f admin admin] Authenticating user token {{(pid=71939) process_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 24 16:56:55.108327 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.fernet_utils [None req-60f9d13d-5b4a-48cf-9894-88c2c1c6fc4f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=71939) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:289}} Nov 24 16:56:55.180283 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60f9d13d-5b4a-48cf-9894-88c2c1c6fc4f admin admin] Validating token access rules against request {{(pid=71939) validate_allowed_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 24 16:56:55.184089 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a1ea928-2c4e-403f-ae6a-a216dca865b1 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a12374a3093a401a97c343ff0854184d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3b3940d4ae1c4177ae29c02377bb4b0b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=71939) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 24 16:56:55.184765 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a1ea928-2c4e-403f-ae6a-a216dca865b1 service cinder] REQUEST_METHOD: `GET` {{(pid=71939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 24 16:56:55.185110 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a1ea928-2c4e-403f-ae6a-a216dca865b1 service cinder] SCRIPT_NAME: `/identity` {{(pid=71939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 24 16:56:55.185531 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a1ea928-2c4e-403f-ae6a-a216dca865b1 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=71939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 24 16:56:55.197397 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a1ea928-2c4e-403f-ae6a-a216dca865b1 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=71939) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:442}} Nov 24 16:56:55.226456 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a1ea928-2c4e-403f-ae6a-a216dca865b1 service cinder] RBAC: Authorization granted {{(pid=71939) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 24 16:56:55.238132 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: [pid: 71939|app: 0|req: 1297/2581] 10.222.0.53 () {60 vars in 1356 bytes} [Wed Nov 24 16:56:55 2021] GET /identity/v3/auth/tokens => generated 3781 bytes in 132 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 24 16:56:55.411670 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8911e0f-87be-41b9-b107-bcff461fa420 None None] Authenticating user token {{(pid=71938) process_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 24 16:56:55.421629 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8911e0f-87be-41b9-b107-bcff461fa420 None None] Validating token access rules against request {{(pid=71938) validate_allowed_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 24 16:56:55.425900 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fc5d791-8f58-4b01-8709-e338e825d82c service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a12374a3093a401a97c343ff0854184d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3b3940d4ae1c4177ae29c02377bb4b0b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=71938) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 24 16:56:55.426586 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fc5d791-8f58-4b01-8709-e338e825d82c service cinder] REQUEST_METHOD: `GET` {{(pid=71938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 24 16:56:55.426926 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fc5d791-8f58-4b01-8709-e338e825d82c service cinder] SCRIPT_NAME: `/identity` {{(pid=71938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 24 16:56:55.427257 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fc5d791-8f58-4b01-8709-e338e825d82c service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=71938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 24 16:56:55.496791 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fc5d791-8f58-4b01-8709-e338e825d82c service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=71938) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:442}} Nov 24 16:56:55.526565 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fc5d791-8f58-4b01-8709-e338e825d82c service cinder] RBAC: Authorization granted {{(pid=71938) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 24 16:56:55.537610 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: [pid: 71938|app: 0|req: 1285/2582] 10.222.0.53 () {60 vars in 1356 bytes} [Wed Nov 24 16:56:55 2021] GET /identity/v3/auth/tokens => generated 3716 bytes in 126 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 24 16:57:03.553349 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a1ea928-2c4e-403f-ae6a-a216dca865b1 service cinder] Authenticating user token {{(pid=71939) process_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 24 16:57:03.625485 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a1ea928-2c4e-403f-ae6a-a216dca865b1 service cinder] Validating token access rules against request {{(pid=71939) validate_allowed_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 24 16:57:03.630120 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-754b2b1c-74f7-4529-ad7c-5dcd6da887de admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f2ba2e8375b4e8c8792ee1e22b60427', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '00a5583c7b7443e98e7a1d31a0b638dc', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=71939) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 24 16:57:03.631274 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-754b2b1c-74f7-4529-ad7c-5dcd6da887de admin admin] REQUEST_METHOD: `DELETE` {{(pid=71939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 24 16:57:03.631620 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-754b2b1c-74f7-4529-ad7c-5dcd6da887de admin admin] SCRIPT_NAME: `/identity` {{(pid=71939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 24 16:57:03.631962 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-754b2b1c-74f7-4529-ad7c-5dcd6da887de admin admin] PATH_INFO: `/v3/users/466cad83eb9c4adeb6add61ebebda853` {{(pid=71939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 24 16:57:03.633195 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-754b2b1c-74f7-4529-ad7c-5dcd6da887de admin admin] RBAC: Authorizing `identity:delete_user(user_id=466cad83eb9c4adeb6add61ebebda853)` {{(pid=71939) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:442}} Nov 24 16:57:03.662151 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-754b2b1c-74f7-4529-ad7c-5dcd6da887de admin admin] RBAC: Authorization granted {{(pid=71939) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 24 16:57:03.709489 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.notifications [None req-754b2b1c-74f7-4529-ad7c-5dcd6da887de admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '466cad83eb9c4adeb6add61ebebda853'} {{(pid=71939) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:357}} Nov 24 16:57:03.722111 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.notifications [None req-754b2b1c-74f7-4529-ad7c-5dcd6da887de admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '466cad83eb9c4adeb6add61ebebda853'} {{(pid=71939) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:357}} Nov 24 16:57:03.722813 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.notifications [None req-754b2b1c-74f7-4529-ad7c-5dcd6da887de admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '466cad83eb9c4adeb6add61ebebda853'} {{(pid=71939) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:357}} Nov 24 16:57:03.730953 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.notifications [None req-754b2b1c-74f7-4529-ad7c-5dcd6da887de admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '466cad83eb9c4adeb6add61ebebda853'} {{(pid=71939) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:357}} Nov 24 16:57:03.737669 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.notifications [None req-754b2b1c-74f7-4529-ad7c-5dcd6da887de admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '466cad83eb9c4adeb6add61ebebda853'} {{(pid=71939) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:357}} Nov 24 16:57:03.743883 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: [pid: 71939|app: 0|req: 1298/2583] 10.222.0.53 () {58 vars in 1214 bytes} [Wed Nov 24 16:57:03 2021] DELETE /identity/v3/users/466cad83eb9c4adeb6add61ebebda853 => generated 0 bytes in 191 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 24 16:57:03.748819 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be4f0510-f17b-4630-b4f0-6ae9f5a1a0c1 None None] REQUEST_METHOD: `POST` {{(pid=71938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 24 16:57:03.749154 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be4f0510-f17b-4630-b4f0-6ae9f5a1a0c1 None None] SCRIPT_NAME: `/identity` {{(pid=71938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 24 16:57:03.749486 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be4f0510-f17b-4630-b4f0-6ae9f5a1a0c1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=71938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 24 16:57:03.773840 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.auth.core [None req-be4f0510-f17b-4630-b4f0-6ae9f5a1a0c1 None None] MFA Rules not processed for user `0f2ba2e8375b4e8c8792ee1e22b60427`. Rule list: `[]` (Enabled: `True`). {{(pid=71938) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:442}} Nov 24 16:57:03.775133 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.fernet_utils [None req-be4f0510-f17b-4630-b4f0-6ae9f5a1a0c1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=71938) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:289}} Nov 24 16:57:03.848415 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: [pid: 71938|app: 0|req: 1286/2584] 10.222.0.53 () {58 vars in 948 bytes} [Wed Nov 24 16:57:03 2021] POST /identity/v3/auth/tokens => generated 3669 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Nov 24 16:57:03.859537 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-754b2b1c-74f7-4529-ad7c-5dcd6da887de admin admin] Authenticating user token {{(pid=71939) process_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 24 16:57:03.860983 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.fernet_utils [None req-754b2b1c-74f7-4529-ad7c-5dcd6da887de admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=71939) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:289}} Nov 24 16:57:03.931558 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-754b2b1c-74f7-4529-ad7c-5dcd6da887de admin admin] Validating token access rules against request {{(pid=71939) validate_allowed_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 24 16:57:03.935258 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9db8aa6c-b47c-4927-96ef-13edc63119d4 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c90f21b9cdcb413282461fa83cb6b7a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3b3940d4ae1c4177ae29c02377bb4b0b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=71939) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 24 16:57:03.935923 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9db8aa6c-b47c-4927-96ef-13edc63119d4 service neutron] REQUEST_METHOD: `GET` {{(pid=71939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 24 16:57:03.936582 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9db8aa6c-b47c-4927-96ef-13edc63119d4 service neutron] SCRIPT_NAME: `/identity` {{(pid=71939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 24 16:57:03.936919 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9db8aa6c-b47c-4927-96ef-13edc63119d4 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=71939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 24 16:57:03.946478 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9db8aa6c-b47c-4927-96ef-13edc63119d4 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=71939) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:442}} Nov 24 16:57:03.975358 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9db8aa6c-b47c-4927-96ef-13edc63119d4 service neutron] RBAC: Authorization granted {{(pid=71939) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 24 16:57:03.985479 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: [pid: 71939|app: 0|req: 1299/2585] 10.222.0.53 () {60 vars in 1356 bytes} [Wed Nov 24 16:57:03 2021] GET /identity/v3/auth/tokens => generated 3669 bytes in 127 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 24 16:57:04.339092 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be4f0510-f17b-4630-b4f0-6ae9f5a1a0c1 None None] Authenticating user token {{(pid=71938) process_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 24 16:57:04.340695 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.fernet_utils [None req-be4f0510-f17b-4630-b4f0-6ae9f5a1a0c1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=71938) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:289}} Nov 24 16:57:04.353773 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be4f0510-f17b-4630-b4f0-6ae9f5a1a0c1 None None] Validating token access rules against request {{(pid=71938) validate_allowed_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 24 16:57:04.358564 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-213e8310-62b3-4818-abf4-c5cc4985b9fa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f2ba2e8375b4e8c8792ee1e22b60427', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '00a5583c7b7443e98e7a1d31a0b638dc', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=71938) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 24 16:57:04.359422 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-213e8310-62b3-4818-abf4-c5cc4985b9fa admin admin] REQUEST_METHOD: `DELETE` {{(pid=71938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 24 16:57:04.359767 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-213e8310-62b3-4818-abf4-c5cc4985b9fa admin admin] SCRIPT_NAME: `/identity` {{(pid=71938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 24 16:57:04.360098 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-213e8310-62b3-4818-abf4-c5cc4985b9fa admin admin] PATH_INFO: `/v3/projects/e9f1444dfc314afb83e0a8df010e3c29` {{(pid=71938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 24 16:57:04.361401 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-213e8310-62b3-4818-abf4-c5cc4985b9fa admin admin] RBAC: Authorizing `identity:delete_project(project_id=e9f1444dfc314afb83e0a8df010e3c29)` {{(pid=71938) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:442}} Nov 24 16:57:04.390439 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-213e8310-62b3-4818-abf4-c5cc4985b9fa admin admin] RBAC: Authorization granted {{(pid=71938) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 24 16:57:04.442040 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.notifications [None req-213e8310-62b3-4818-abf4-c5cc4985b9fa admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e9f1444dfc314afb83e0a8df010e3c29', 'request_id': 'req-213e8310-62b3-4818-abf4-c5cc4985b9fa'} {{(pid=71938) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:357}} Nov 24 16:57:04.454551 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.notifications [None req-213e8310-62b3-4818-abf4-c5cc4985b9fa admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e9f1444dfc314afb83e0a8df010e3c29', 'request_id': 'req-213e8310-62b3-4818-abf4-c5cc4985b9fa'} {{(pid=71938) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:357}} Nov 24 16:57:04.459830 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.notifications [None req-213e8310-62b3-4818-abf4-c5cc4985b9fa admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e9f1444dfc314afb83e0a8df010e3c29', 'request_id': 'req-213e8310-62b3-4818-abf4-c5cc4985b9fa'} {{(pid=71938) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:357}} Nov 24 16:57:04.470948 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.notifications [None req-213e8310-62b3-4818-abf4-c5cc4985b9fa admin admin] The token cache is being invalidate because project e9f1444dfc314afb83e0a8df010e3c29 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=71938) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Nov 24 16:57:04.471247 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.notifications [None req-213e8310-62b3-4818-abf4-c5cc4985b9fa admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=71938) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:357}} Nov 24 16:57:04.471922 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.notifications [None req-213e8310-62b3-4818-abf4-c5cc4985b9fa admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=71938) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:357}} Nov 24 16:57:04.473472 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: [pid: 71938|app: 0|req: 1287/2586] 10.222.0.53 () {58 vars in 1223 bytes} [Wed Nov 24 16:57:04 2021] DELETE /identity/v3/projects/e9f1444dfc314afb83e0a8df010e3c29 => generated 0 bytes in 135 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 24 16:57:04.477725 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9db8aa6c-b47c-4927-96ef-13edc63119d4 service neutron] Authenticating user token {{(pid=71939) process_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 24 16:57:04.487542 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9db8aa6c-b47c-4927-96ef-13edc63119d4 service neutron] Validating token access rules against request {{(pid=71939) validate_allowed_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 24 16:57:04.631358 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45527221-2d8d-439b-a600-2c2fdec08c73 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f2ba2e8375b4e8c8792ee1e22b60427', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '00a5583c7b7443e98e7a1d31a0b638dc', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=71939) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 24 16:57:04.632249 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45527221-2d8d-439b-a600-2c2fdec08c73 admin admin] REQUEST_METHOD: `DELETE` {{(pid=71939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 24 16:57:04.632589 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45527221-2d8d-439b-a600-2c2fdec08c73 admin admin] SCRIPT_NAME: `/identity` {{(pid=71939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 24 16:57:04.632925 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45527221-2d8d-439b-a600-2c2fdec08c73 admin admin] PATH_INFO: `/v3/users/ab0fdbbb20c54b8b943f98f84c901a8c` {{(pid=71939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 24 16:57:04.634193 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45527221-2d8d-439b-a600-2c2fdec08c73 admin admin] RBAC: Authorizing `identity:delete_user(user_id=ab0fdbbb20c54b8b943f98f84c901a8c)` {{(pid=71939) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:442}} Nov 24 16:57:04.663565 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45527221-2d8d-439b-a600-2c2fdec08c73 admin admin] RBAC: Authorization granted {{(pid=71939) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 24 16:57:04.718682 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.notifications [None req-45527221-2d8d-439b-a600-2c2fdec08c73 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ab0fdbbb20c54b8b943f98f84c901a8c'} {{(pid=71939) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:357}} Nov 24 16:57:04.731479 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.notifications [None req-45527221-2d8d-439b-a600-2c2fdec08c73 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ab0fdbbb20c54b8b943f98f84c901a8c'} {{(pid=71939) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:357}} Nov 24 16:57:04.732171 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.notifications [None req-45527221-2d8d-439b-a600-2c2fdec08c73 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ab0fdbbb20c54b8b943f98f84c901a8c'} {{(pid=71939) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:357}} Nov 24 16:57:04.740365 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.notifications [None req-45527221-2d8d-439b-a600-2c2fdec08c73 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ab0fdbbb20c54b8b943f98f84c901a8c'} {{(pid=71939) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:357}} Nov 24 16:57:04.746593 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.notifications [None req-45527221-2d8d-439b-a600-2c2fdec08c73 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ab0fdbbb20c54b8b943f98f84c901a8c'} {{(pid=71939) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:357}} Nov 24 16:57:04.752854 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: [pid: 71939|app: 0|req: 1300/2587] 10.222.0.53 () {58 vars in 1214 bytes} [Wed Nov 24 16:57:04 2021] DELETE /identity/v3/users/ab0fdbbb20c54b8b943f98f84c901a8c => generated 0 bytes in 276 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 24 16:57:05.131836 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-213e8310-62b3-4818-abf4-c5cc4985b9fa admin admin] Authenticating user token {{(pid=71938) process_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 24 16:57:05.133460 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.fernet_utils [None req-213e8310-62b3-4818-abf4-c5cc4985b9fa admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=71938) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:289}} Nov 24 16:57:05.147609 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-213e8310-62b3-4818-abf4-c5cc4985b9fa admin admin] Validating token access rules against request {{(pid=71938) validate_allowed_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 24 16:57:05.221023 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a68a8c0-8424-483e-998e-3f80d60f3fb5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f2ba2e8375b4e8c8792ee1e22b60427', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '00a5583c7b7443e98e7a1d31a0b638dc', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=71938) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 24 16:57:05.221960 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a68a8c0-8424-483e-998e-3f80d60f3fb5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=71938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 24 16:57:05.222335 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a68a8c0-8424-483e-998e-3f80d60f3fb5 admin admin] SCRIPT_NAME: `/identity` {{(pid=71938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 24 16:57:05.222675 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a68a8c0-8424-483e-998e-3f80d60f3fb5 admin admin] PATH_INFO: `/v3/projects/26d81836e6e141dabbd9fec5061e7d49` {{(pid=71938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 24 16:57:05.224083 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a68a8c0-8424-483e-998e-3f80d60f3fb5 admin admin] RBAC: Authorizing `identity:delete_project(project_id=26d81836e6e141dabbd9fec5061e7d49)` {{(pid=71938) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:442}} Nov 24 16:57:05.252950 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a68a8c0-8424-483e-998e-3f80d60f3fb5 admin admin] RBAC: Authorization granted {{(pid=71938) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 24 16:57:05.303686 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.notifications [None req-1a68a8c0-8424-483e-998e-3f80d60f3fb5 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '26d81836e6e141dabbd9fec5061e7d49', 'request_id': 'req-1a68a8c0-8424-483e-998e-3f80d60f3fb5'} {{(pid=71938) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:357}} Nov 24 16:57:05.316535 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.notifications [None req-1a68a8c0-8424-483e-998e-3f80d60f3fb5 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '26d81836e6e141dabbd9fec5061e7d49', 'request_id': 'req-1a68a8c0-8424-483e-998e-3f80d60f3fb5'} {{(pid=71938) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:357}} Nov 24 16:57:05.322050 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.notifications [None req-1a68a8c0-8424-483e-998e-3f80d60f3fb5 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '26d81836e6e141dabbd9fec5061e7d49', 'request_id': 'req-1a68a8c0-8424-483e-998e-3f80d60f3fb5'} {{(pid=71938) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:357}} Nov 24 16:57:05.333679 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.notifications [None req-1a68a8c0-8424-483e-998e-3f80d60f3fb5 admin admin] The token cache is being invalidate because project 26d81836e6e141dabbd9fec5061e7d49 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=71938) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Nov 24 16:57:05.334008 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.notifications [None req-1a68a8c0-8424-483e-998e-3f80d60f3fb5 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=71938) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:357}} Nov 24 16:57:05.334758 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.notifications [None req-1a68a8c0-8424-483e-998e-3f80d60f3fb5 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=71938) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:357}} Nov 24 16:57:05.336285 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: [pid: 71938|app: 0|req: 1288/2588] 10.222.0.53 () {58 vars in 1223 bytes} [Wed Nov 24 16:57:05 2021] DELETE /identity/v3/projects/26d81836e6e141dabbd9fec5061e7d49 => generated 0 bytes in 205 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 24 16:57:05.342422 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c88e75de-6413-4e00-ad43-b73de581e4ad None None] REQUEST_METHOD: `POST` {{(pid=71939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 24 16:57:05.342778 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c88e75de-6413-4e00-ad43-b73de581e4ad None None] SCRIPT_NAME: `/identity` {{(pid=71939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 24 16:57:05.343129 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c88e75de-6413-4e00-ad43-b73de581e4ad None None] PATH_INFO: `/v3/auth/tokens` {{(pid=71939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 24 16:57:05.367229 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.auth.core [None req-c88e75de-6413-4e00-ad43-b73de581e4ad None None] MFA Rules not processed for user `0f2ba2e8375b4e8c8792ee1e22b60427`. Rule list: `[]` (Enabled: `True`). {{(pid=71939) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:442}} Nov 24 16:57:05.368466 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.fernet_utils [None req-c88e75de-6413-4e00-ad43-b73de581e4ad None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=71939) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:289}} Nov 24 16:57:05.435349 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: [pid: 71939|app: 0|req: 1301/2589] 10.222.0.53 () {58 vars in 948 bytes} [Wed Nov 24 16:57:05 2021] POST /identity/v3/auth/tokens => generated 3669 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 24 16:57:05.445078 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1eb2d78-68a3-4103-950b-9722caf3d026 None None] REQUEST_METHOD: `POST` {{(pid=71938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 24 16:57:05.445432 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1eb2d78-68a3-4103-950b-9722caf3d026 None None] SCRIPT_NAME: `/identity` {{(pid=71938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 24 16:57:05.445769 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1eb2d78-68a3-4103-950b-9722caf3d026 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=71938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 24 16:57:05.474448 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.auth.core [None req-e1eb2d78-68a3-4103-950b-9722caf3d026 None None] MFA Rules not processed for user `0f2ba2e8375b4e8c8792ee1e22b60427`. Rule list: `[]` (Enabled: `True`). {{(pid=71938) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:442}} Nov 24 16:57:05.475627 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.fernet_utils [None req-e1eb2d78-68a3-4103-950b-9722caf3d026 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=71938) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:289}} Nov 24 16:57:05.485010 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: [pid: 71938|app: 0|req: 1289/2590] 10.222.0.53 () {58 vars in 948 bytes} [Wed Nov 24 16:57:05 2021] POST /identity/v3/auth/tokens => generated 3669 bytes in 41 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 24 16:57:05.490113 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c88e75de-6413-4e00-ad43-b73de581e4ad None None] Authenticating user token {{(pid=71939) process_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 24 16:57:05.500088 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c88e75de-6413-4e00-ad43-b73de581e4ad None None] Validating token access rules against request {{(pid=71939) validate_allowed_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 24 16:57:05.505225 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e72a4d9b-dc20-458a-94ad-d3fa04b8f68b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f2ba2e8375b4e8c8792ee1e22b60427', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '00a5583c7b7443e98e7a1d31a0b638dc', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=71939) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 24 16:57:05.505895 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e72a4d9b-dc20-458a-94ad-d3fa04b8f68b admin admin] REQUEST_METHOD: `GET` {{(pid=71939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 24 16:57:05.506298 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e72a4d9b-dc20-458a-94ad-d3fa04b8f68b admin admin] SCRIPT_NAME: `/identity` {{(pid=71939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 24 16:57:05.506631 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e72a4d9b-dc20-458a-94ad-d3fa04b8f68b admin admin] PATH_INFO: `/v3/domains` {{(pid=71939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 24 16:57:05.507421 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e72a4d9b-dc20-458a-94ad-d3fa04b8f68b admin admin] RBAC: Adding query filter params (name=Default) {{(pid=71939) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:161}} Nov 24 16:57:05.507773 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e72a4d9b-dc20-458a-94ad-d3fa04b8f68b admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=71939) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:442}} Nov 24 16:57:05.535641 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e72a4d9b-dc20-458a-94ad-d3fa04b8f68b admin admin] RBAC: Authorization granted {{(pid=71939) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 24 16:57:05.549701 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: [pid: 71939|app: 0|req: 1302/2591] 10.222.0.53 () {58 vars in 1143 bytes} [Wed Nov 24 16:57:05 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 60 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 24 16:57:05.554169 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1eb2d78-68a3-4103-950b-9722caf3d026 None None] Authenticating user token {{(pid=71938) process_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 24 16:57:05.564513 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1eb2d78-68a3-4103-950b-9722caf3d026 None None] Validating token access rules against request {{(pid=71938) validate_allowed_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 24 16:57:05.569148 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf2e1674-d33e-41e4-a90e-98c1f5531111 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f2ba2e8375b4e8c8792ee1e22b60427', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '00a5583c7b7443e98e7a1d31a0b638dc', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=71938) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 24 16:57:05.569809 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf2e1674-d33e-41e4-a90e-98c1f5531111 admin admin] REQUEST_METHOD: `POST` {{(pid=71938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 24 16:57:05.570180 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf2e1674-d33e-41e4-a90e-98c1f5531111 admin admin] SCRIPT_NAME: `/identity` {{(pid=71938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 24 16:57:05.570518 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf2e1674-d33e-41e4-a90e-98c1f5531111 admin admin] PATH_INFO: `/v3/projects` {{(pid=71938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 24 16:57:05.571257 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf2e1674-d33e-41e4-a90e-98c1f5531111 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=71938) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:442}} Nov 24 16:57:05.599534 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf2e1674-d33e-41e4-a90e-98c1f5531111 admin admin] RBAC: Authorization granted {{(pid=71938) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 24 16:57:05.627501 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: [pid: 71938|app: 0|req: 1290/2592] 10.222.0.53 () {60 vars in 1143 bytes} [Wed Nov 24 16:57:05 2021] POST /identity/v3/projects => generated 389 bytes in 74 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 24 16:57:05.631886 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e72a4d9b-dc20-458a-94ad-d3fa04b8f68b admin admin] Authenticating user token {{(pid=71939) process_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 24 16:57:05.642109 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e72a4d9b-dc20-458a-94ad-d3fa04b8f68b admin admin] Validating token access rules against request {{(pid=71939) validate_allowed_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 24 16:57:05.708437 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5312f4c-e4e3-4baf-a4de-83c198598abc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f2ba2e8375b4e8c8792ee1e22b60427', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '00a5583c7b7443e98e7a1d31a0b638dc', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=71939) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 24 16:57:05.709156 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5312f4c-e4e3-4baf-a4de-83c198598abc admin admin] REQUEST_METHOD: `POST` {{(pid=71939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 24 16:57:05.709491 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5312f4c-e4e3-4baf-a4de-83c198598abc admin admin] SCRIPT_NAME: `/identity` {{(pid=71939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 24 16:57:05.709822 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5312f4c-e4e3-4baf-a4de-83c198598abc admin admin] PATH_INFO: `/v3/users` {{(pid=71939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 24 16:57:05.710608 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5312f4c-e4e3-4baf-a4de-83c198598abc admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=71939) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:442}} Nov 24 16:57:05.740102 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5312f4c-e4e3-4baf-a4de-83c198598abc admin admin] RBAC: Authorization granted {{(pid=71939) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 24 16:57:05.763283 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: [pid: 71939|app: 0|req: 1303/2593] 10.222.0.53 () {60 vars in 1134 bytes} [Wed Nov 24 16:57:05 2021] POST /identity/v3/users => generated 295 bytes in 132 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 24 16:57:05.767726 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf2e1674-d33e-41e4-a90e-98c1f5531111 admin admin] Authenticating user token {{(pid=71938) process_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 24 16:57:05.779052 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf2e1674-d33e-41e4-a90e-98c1f5531111 admin admin] Validating token access rules against request {{(pid=71938) validate_allowed_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 24 16:57:05.784791 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c66ca42-75ec-4bc7-925c-1c8fc706ccbf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f2ba2e8375b4e8c8792ee1e22b60427', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '00a5583c7b7443e98e7a1d31a0b638dc', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=71938) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 24 16:57:05.785039 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c66ca42-75ec-4bc7-925c-1c8fc706ccbf admin admin] REQUEST_METHOD: `GET` {{(pid=71938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 24 16:57:05.785384 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c66ca42-75ec-4bc7-925c-1c8fc706ccbf admin admin] SCRIPT_NAME: `/identity` {{(pid=71938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 24 16:57:05.785758 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c66ca42-75ec-4bc7-925c-1c8fc706ccbf admin admin] PATH_INFO: `/v3/roles` {{(pid=71938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 24 16:57:05.786586 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c66ca42-75ec-4bc7-925c-1c8fc706ccbf admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=71938) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:442}} Nov 24 16:57:05.815475 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c66ca42-75ec-4bc7-925c-1c8fc706ccbf admin admin] RBAC: Authorization granted {{(pid=71938) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 24 16:57:05.827491 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: [pid: 71938|app: 0|req: 1291/2594] 10.222.0.53 () {58 vars in 1112 bytes} [Wed Nov 24 16:57:05 2021] GET /identity/v3/roles => generated 1420 bytes in 60 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 24 16:57:05.832241 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5312f4c-e4e3-4baf-a4de-83c198598abc admin admin] Authenticating user token {{(pid=71939) process_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 24 16:57:05.842902 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5312f4c-e4e3-4baf-a4de-83c198598abc admin admin] Validating token access rules against request {{(pid=71939) validate_allowed_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 24 16:57:05.848421 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43de068e-0f49-4134-9fb9-dea1190878db admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f2ba2e8375b4e8c8792ee1e22b60427', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '00a5583c7b7443e98e7a1d31a0b638dc', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=71939) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 24 16:57:05.849440 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43de068e-0f49-4134-9fb9-dea1190878db admin admin] REQUEST_METHOD: `PUT` {{(pid=71939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 24 16:57:05.850047 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43de068e-0f49-4134-9fb9-dea1190878db admin admin] SCRIPT_NAME: `/identity` {{(pid=71939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 24 16:57:05.850467 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43de068e-0f49-4134-9fb9-dea1190878db admin admin] PATH_INFO: `/v3/projects/ddb23f4edcc64ea785461b0cdef2e232/users/06d3bfb9c7ab4defa2ece7d4b5db282b/roles/912ab5f10fa5477da74acf239f07604e` {{(pid=71939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 24 16:57:05.873726 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43de068e-0f49-4134-9fb9-dea1190878db admin admin] RBAC: Authorizing `identity:create_grant(project_id=ddb23f4edcc64ea785461b0cdef2e232, user_id=06d3bfb9c7ab4defa2ece7d4b5db282b, role_id=912ab5f10fa5477da74acf239f07604e)` {{(pid=71939) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:442}} Nov 24 16:57:05.903489 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43de068e-0f49-4134-9fb9-dea1190878db admin admin] RBAC: Authorization granted {{(pid=71939) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 24 16:57:05.916360 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: [pid: 71939|app: 0|req: 1304/2595] 10.222.0.53 () {60 vars in 1473 bytes} [Wed Nov 24 16:57:05 2021] PUT /identity/v3/projects/ddb23f4edcc64ea785461b0cdef2e232/users/06d3bfb9c7ab4defa2ece7d4b5db282b/roles/912ab5f10fa5477da74acf239f07604e => generated 0 bytes in 85 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 24 16:57:05.927850 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fa69101-d2ea-4cdb-84e4-3ff7dc508e49 None None] REQUEST_METHOD: `POST` {{(pid=71938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 24 16:57:05.928205 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fa69101-d2ea-4cdb-84e4-3ff7dc508e49 None None] SCRIPT_NAME: `/identity` {{(pid=71938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 24 16:57:05.928582 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fa69101-d2ea-4cdb-84e4-3ff7dc508e49 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=71938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 24 16:57:05.966300 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.auth.core [None req-4fa69101-d2ea-4cdb-84e4-3ff7dc508e49 None None] MFA Rules not processed for user `06d3bfb9c7ab4defa2ece7d4b5db282b`. Rule list: `[]` (Enabled: `True`). {{(pid=71938) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:442}} Nov 24 16:57:05.967524 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.fernet_utils [None req-4fa69101-d2ea-4cdb-84e4-3ff7dc508e49 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=71938) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:289}} Nov 24 16:57:06.046942 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: [pid: 71938|app: 0|req: 1292/2596] 10.222.0.53 () {58 vars in 948 bytes} [Wed Nov 24 16:57:05 2021] POST /identity/v3/auth/tokens => generated 3696 bytes in 117 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 24 16:57:06.054401 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43de068e-0f49-4134-9fb9-dea1190878db admin admin] Authenticating user token {{(pid=71939) process_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 24 16:57:06.056162 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.fernet_utils [None req-43de068e-0f49-4134-9fb9-dea1190878db admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=71939) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:289}} Nov 24 16:57:06.125112 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43de068e-0f49-4134-9fb9-dea1190878db admin admin] Validating token access rules against request {{(pid=71939) validate_allowed_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 24 16:57:06.128925 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-906a0fba-38f9-458f-9bc7-f504c814aa5e service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a12374a3093a401a97c343ff0854184d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3b3940d4ae1c4177ae29c02377bb4b0b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=71939) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 24 16:57:06.129588 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-906a0fba-38f9-458f-9bc7-f504c814aa5e service cinder] REQUEST_METHOD: `GET` {{(pid=71939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 24 16:57:06.129931 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-906a0fba-38f9-458f-9bc7-f504c814aa5e service cinder] SCRIPT_NAME: `/identity` {{(pid=71939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 24 16:57:06.130298 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-906a0fba-38f9-458f-9bc7-f504c814aa5e service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=71939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 24 16:57:06.139207 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-906a0fba-38f9-458f-9bc7-f504c814aa5e service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=71939) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:442}} Nov 24 16:57:06.168160 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-906a0fba-38f9-458f-9bc7-f504c814aa5e service cinder] RBAC: Authorization granted {{(pid=71939) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 24 16:57:06.179040 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: [pid: 71939|app: 0|req: 1305/2597] 10.222.0.53 () {60 vars in 1356 bytes} [Wed Nov 24 16:57:06 2021] GET /identity/v3/auth/tokens => generated 3696 bytes in 125 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 24 16:57:18.145250 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-305b0d9a-1a46-44ef-a9c2-19680a9cb165 None None] REQUEST_METHOD: `POST` {{(pid=71938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 24 16:57:18.145686 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-305b0d9a-1a46-44ef-a9c2-19680a9cb165 None None] SCRIPT_NAME: `/identity` {{(pid=71938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 24 16:57:18.145883 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-305b0d9a-1a46-44ef-a9c2-19680a9cb165 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=71938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 24 16:57:18.172438 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.auth.core [None req-305b0d9a-1a46-44ef-a9c2-19680a9cb165 None None] MFA Rules not processed for user `f8a135ac0e4744a98258dc7f6c12e741`. Rule list: `[]` (Enabled: `True`). {{(pid=71938) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:442}} Nov 24 16:57:18.174309 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.fernet_utils [None req-305b0d9a-1a46-44ef-a9c2-19680a9cb165 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=71938) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:289}} Nov 24 16:57:18.248434 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: [pid: 71938|app: 0|req: 1293/2598] 10.222.0.53 () {58 vars in 958 bytes} [Wed Nov 24 16:57:18 2021] POST /identity/v3/auth/tokens => generated 3625 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 24 16:57:18.303219 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-906a0fba-38f9-458f-9bc7-f504c814aa5e service cinder] Authenticating user token {{(pid=71939) process_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 24 16:57:18.304957 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.fernet_utils [None req-906a0fba-38f9-458f-9bc7-f504c814aa5e service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=71939) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:289}} Nov 24 16:57:18.393718 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-906a0fba-38f9-458f-9bc7-f504c814aa5e service cinder] Validating token access rules against request {{(pid=71939) validate_allowed_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 24 16:57:18.398809 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed9e469f-8adf-44c0-bc45-a0cf38a76e60 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a4cec9543ba4b7da4ecb1e6e8681302', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3b3940d4ae1c4177ae29c02377bb4b0b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=71939) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 24 16:57:18.399469 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed9e469f-8adf-44c0-bc45-a0cf38a76e60 service swift] REQUEST_METHOD: `GET` {{(pid=71939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 24 16:57:18.399812 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed9e469f-8adf-44c0-bc45-a0cf38a76e60 service swift] SCRIPT_NAME: `/identity` {{(pid=71939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 24 16:57:18.400150 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed9e469f-8adf-44c0-bc45-a0cf38a76e60 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=71939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 24 16:57:18.408922 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed9e469f-8adf-44c0-bc45-a0cf38a76e60 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=71939) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:442}} Nov 24 16:57:18.439007 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed9e469f-8adf-44c0-bc45-a0cf38a76e60 service swift] RBAC: Authorization granted {{(pid=71939) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 24 16:57:18.448661 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: [pid: 71939|app: 0|req: 1306/2599] 10.222.0.53 () {60 vars in 1375 bytes} [Wed Nov 24 16:57:18 2021] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 146 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Nov 24 16:57:20.411658 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c4ab271-a472-4b06-8281-7b3e045786dc None None] REQUEST_METHOD: `GET` {{(pid=71938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 24 16:57:20.413223 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c4ab271-a472-4b06-8281-7b3e045786dc None None] SCRIPT_NAME: `/identity` {{(pid=71938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 24 16:57:20.413724 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c4ab271-a472-4b06-8281-7b3e045786dc None None] PATH_INFO: `/` {{(pid=71938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 24 16:57:20.417022 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: [pid: 71938|app: 0|req: 1294/2600] 10.222.0.53 () {54 vars in 901 bytes} [Wed Nov 24 16:57:20 2021] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 24 16:57:20.425099 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63d52592-259e-4cbe-9898-b5355988ea87 None None] REQUEST_METHOD: `POST` {{(pid=71939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 24 16:57:20.425673 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63d52592-259e-4cbe-9898-b5355988ea87 None None] SCRIPT_NAME: `/identity` {{(pid=71939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 24 16:57:20.426225 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63d52592-259e-4cbe-9898-b5355988ea87 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=71939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 24 16:57:20.455391 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.auth.core [None req-63d52592-259e-4cbe-9898-b5355988ea87 None None] MFA Rules not processed for user `a919320c9e2a48d7ba33453b5929d7ee`. Rule list: `[]` (Enabled: `True`). {{(pid=71939) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:442}} Nov 24 16:57:20.457113 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.fernet_utils [None req-63d52592-259e-4cbe-9898-b5355988ea87 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=71939) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:289}} Nov 24 16:57:20.543421 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: [pid: 71939|app: 0|req: 1307/2601] 10.222.0.53 () {58 vars in 999 bytes} [Wed Nov 24 16:57:20 2021] POST /identity/v3/auth/tokens => generated 3738 bytes in 120 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 24 16:57:20.564072 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c4ab271-a472-4b06-8281-7b3e045786dc None None] Authenticating user token {{(pid=71938) process_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 24 16:57:20.567095 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.fernet_utils [None req-8c4ab271-a472-4b06-8281-7b3e045786dc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=71938) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:289}} Nov 24 16:57:20.590741 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c4ab271-a472-4b06-8281-7b3e045786dc None None] Validating token access rules against request {{(pid=71938) validate_allowed_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 24 16:57:20.603503 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e429b3e-7a2b-4d69-9514-9de426c5f824 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a919320c9e2a48d7ba33453b5929d7ee', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3b3940d4ae1c4177ae29c02377bb4b0b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=71938) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 24 16:57:20.608713 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e429b3e-7a2b-4d69-9514-9de426c5f824 service placement] REQUEST_METHOD: `GET` {{(pid=71938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 24 16:57:20.609265 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e429b3e-7a2b-4d69-9514-9de426c5f824 service placement] SCRIPT_NAME: `/identity` {{(pid=71938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 24 16:57:20.609695 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e429b3e-7a2b-4d69-9514-9de426c5f824 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=71938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 24 16:57:20.628168 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e429b3e-7a2b-4d69-9514-9de426c5f824 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=71938) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:442}} Nov 24 16:57:20.661566 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e429b3e-7a2b-4d69-9514-9de426c5f824 service placement] RBAC: Authorization granted {{(pid=71938) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 24 16:57:20.672830 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: [pid: 71938|app: 0|req: 1295/2602] 10.222.0.53 () {60 vars in 1356 bytes} [Wed Nov 24 16:57:20 2021] GET /identity/v3/auth/tokens => generated 3738 bytes in 109 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 24 16:57:23.764096 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63d52592-259e-4cbe-9898-b5355988ea87 None None] Authenticating user token {{(pid=71939) process_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 24 16:57:23.838371 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63d52592-259e-4cbe-9898-b5355988ea87 None None] Validating token access rules against request {{(pid=71939) validate_allowed_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 24 16:57:23.842901 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-daf038af-d4da-40c2-8fcd-48060d9a023d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f2ba2e8375b4e8c8792ee1e22b60427', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '00a5583c7b7443e98e7a1d31a0b638dc', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=71939) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 24 16:57:23.843938 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daf038af-d4da-40c2-8fcd-48060d9a023d admin admin] REQUEST_METHOD: `DELETE` {{(pid=71939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 24 16:57:23.844203 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daf038af-d4da-40c2-8fcd-48060d9a023d admin admin] SCRIPT_NAME: `/identity` {{(pid=71939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 24 16:57:23.844581 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daf038af-d4da-40c2-8fcd-48060d9a023d admin admin] PATH_INFO: `/v3/users/06d3bfb9c7ab4defa2ece7d4b5db282b` {{(pid=71939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 24 16:57:23.845851 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-daf038af-d4da-40c2-8fcd-48060d9a023d admin admin] RBAC: Authorizing `identity:delete_user(user_id=06d3bfb9c7ab4defa2ece7d4b5db282b)` {{(pid=71939) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:442}} Nov 24 16:57:23.876495 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-daf038af-d4da-40c2-8fcd-48060d9a023d admin admin] RBAC: Authorization granted {{(pid=71939) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 24 16:57:23.926057 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.notifications [None req-daf038af-d4da-40c2-8fcd-48060d9a023d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '06d3bfb9c7ab4defa2ece7d4b5db282b'} {{(pid=71939) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:357}} Nov 24 16:57:23.939837 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.notifications [None req-daf038af-d4da-40c2-8fcd-48060d9a023d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '06d3bfb9c7ab4defa2ece7d4b5db282b'} {{(pid=71939) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:357}} Nov 24 16:57:23.940588 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.notifications [None req-daf038af-d4da-40c2-8fcd-48060d9a023d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '06d3bfb9c7ab4defa2ece7d4b5db282b'} {{(pid=71939) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:357}} Nov 24 16:57:23.949460 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.notifications [None req-daf038af-d4da-40c2-8fcd-48060d9a023d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '06d3bfb9c7ab4defa2ece7d4b5db282b'} {{(pid=71939) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:357}} Nov 24 16:57:23.957617 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.notifications [None req-daf038af-d4da-40c2-8fcd-48060d9a023d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '06d3bfb9c7ab4defa2ece7d4b5db282b'} {{(pid=71939) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:357}} Nov 24 16:57:23.964258 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: [pid: 71939|app: 0|req: 1308/2603] 10.222.0.53 () {58 vars in 1214 bytes} [Wed Nov 24 16:57:23 2021] DELETE /identity/v3/users/06d3bfb9c7ab4defa2ece7d4b5db282b => generated 0 bytes in 201 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 24 16:57:23.968881 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4653d3e-d110-46d0-a4b2-469345d557a5 None None] REQUEST_METHOD: `POST` {{(pid=71938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 24 16:57:23.969472 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4653d3e-d110-46d0-a4b2-469345d557a5 None None] SCRIPT_NAME: `/identity` {{(pid=71938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 24 16:57:23.970241 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4653d3e-d110-46d0-a4b2-469345d557a5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=71938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 24 16:57:23.996284 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.auth.core [None req-b4653d3e-d110-46d0-a4b2-469345d557a5 None None] MFA Rules not processed for user `0f2ba2e8375b4e8c8792ee1e22b60427`. Rule list: `[]` (Enabled: `True`). {{(pid=71938) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:442}} Nov 24 16:57:23.997607 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.fernet_utils [None req-b4653d3e-d110-46d0-a4b2-469345d557a5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=71938) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:289}} Nov 24 16:57:24.070164 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: [pid: 71938|app: 0|req: 1296/2604] 10.222.0.53 () {58 vars in 948 bytes} [Wed Nov 24 16:57:23 2021] POST /identity/v3/auth/tokens => generated 3669 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 24 16:57:24.081353 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-daf038af-d4da-40c2-8fcd-48060d9a023d admin admin] Authenticating user token {{(pid=71939) process_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 24 16:57:24.082848 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.fernet_utils [None req-daf038af-d4da-40c2-8fcd-48060d9a023d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=71939) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:289}} Nov 24 16:57:24.150435 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-daf038af-d4da-40c2-8fcd-48060d9a023d admin admin] Validating token access rules against request {{(pid=71939) validate_allowed_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 24 16:57:24.154245 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a81489e1-1afa-4278-b11f-7e0a62137e60 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c90f21b9cdcb413282461fa83cb6b7a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3b3940d4ae1c4177ae29c02377bb4b0b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=71939) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 24 16:57:24.154915 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a81489e1-1afa-4278-b11f-7e0a62137e60 service neutron] REQUEST_METHOD: `GET` {{(pid=71939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 24 16:57:24.155266 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a81489e1-1afa-4278-b11f-7e0a62137e60 service neutron] SCRIPT_NAME: `/identity` {{(pid=71939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 24 16:57:24.155606 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a81489e1-1afa-4278-b11f-7e0a62137e60 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=71939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 24 16:57:24.165551 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a81489e1-1afa-4278-b11f-7e0a62137e60 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=71939) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:442}} Nov 24 16:57:24.194950 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a81489e1-1afa-4278-b11f-7e0a62137e60 service neutron] RBAC: Authorization granted {{(pid=71939) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 24 16:57:24.205620 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: [pid: 71939|app: 0|req: 1309/2605] 10.222.0.53 () {60 vars in 1356 bytes} [Wed Nov 24 16:57:24 2021] GET /identity/v3/auth/tokens => generated 3669 bytes in 125 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 24 16:57:24.254977 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a4d0150-4e6c-4e22-9990-367d50f83662 None None] REQUEST_METHOD: `POST` {{(pid=71938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 24 16:57:24.255330 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a4d0150-4e6c-4e22-9990-367d50f83662 None None] SCRIPT_NAME: `/identity` {{(pid=71938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 24 16:57:24.255733 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a4d0150-4e6c-4e22-9990-367d50f83662 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=71938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 24 16:57:24.278498 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.auth.core [None req-6a4d0150-4e6c-4e22-9990-367d50f83662 None None] MFA Rules not processed for user `5e2f5fe0a70c48dfa7bfaff9973b6e62`. Rule list: `[]` (Enabled: `True`). {{(pid=71938) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:442}} Nov 24 16:57:24.279766 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.fernet_utils [None req-6a4d0150-4e6c-4e22-9990-367d50f83662 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=71938) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:289}} Nov 24 16:57:24.348452 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: [pid: 71938|app: 0|req: 1297/2606] 10.222.0.53 () {58 vars in 948 bytes} [Wed Nov 24 16:57:24 2021] POST /identity/v3/auth/tokens => generated 3692 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 24 16:57:24.758619 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a81489e1-1afa-4278-b11f-7e0a62137e60 service neutron] Authenticating user token {{(pid=71939) process_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 24 16:57:24.760147 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.fernet_utils [None req-a81489e1-1afa-4278-b11f-7e0a62137e60 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=71939) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:289}} Nov 24 16:57:24.775667 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a81489e1-1afa-4278-b11f-7e0a62137e60 service neutron] Validating token access rules against request {{(pid=71939) validate_allowed_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 24 16:57:24.780532 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b1d02b1-853d-414d-bd79-f1dfbcdf1394 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f2ba2e8375b4e8c8792ee1e22b60427', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '00a5583c7b7443e98e7a1d31a0b638dc', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=71939) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 24 16:57:24.781578 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b1d02b1-853d-414d-bd79-f1dfbcdf1394 admin admin] REQUEST_METHOD: `DELETE` {{(pid=71939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 24 16:57:24.782014 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b1d02b1-853d-414d-bd79-f1dfbcdf1394 admin admin] SCRIPT_NAME: `/identity` {{(pid=71939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 24 16:57:24.782470 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b1d02b1-853d-414d-bd79-f1dfbcdf1394 admin admin] PATH_INFO: `/v3/projects/ddb23f4edcc64ea785461b0cdef2e232` {{(pid=71939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 24 16:57:24.783783 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b1d02b1-853d-414d-bd79-f1dfbcdf1394 admin admin] RBAC: Authorizing `identity:delete_project(project_id=ddb23f4edcc64ea785461b0cdef2e232)` {{(pid=71939) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:442}} Nov 24 16:57:24.814306 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b1d02b1-853d-414d-bd79-f1dfbcdf1394 admin admin] RBAC: Authorization granted {{(pid=71939) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 24 16:57:24.877716 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.notifications [None req-3b1d02b1-853d-414d-bd79-f1dfbcdf1394 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ddb23f4edcc64ea785461b0cdef2e232', 'request_id': 'req-3b1d02b1-853d-414d-bd79-f1dfbcdf1394'} {{(pid=71939) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:357}} Nov 24 16:57:24.893409 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.notifications [None req-3b1d02b1-853d-414d-bd79-f1dfbcdf1394 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ddb23f4edcc64ea785461b0cdef2e232', 'request_id': 'req-3b1d02b1-853d-414d-bd79-f1dfbcdf1394'} {{(pid=71939) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:357}} Nov 24 16:57:24.901550 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.notifications [None req-3b1d02b1-853d-414d-bd79-f1dfbcdf1394 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ddb23f4edcc64ea785461b0cdef2e232', 'request_id': 'req-3b1d02b1-853d-414d-bd79-f1dfbcdf1394'} {{(pid=71939) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:357}} Nov 24 16:57:24.921727 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.notifications [None req-3b1d02b1-853d-414d-bd79-f1dfbcdf1394 admin admin] The token cache is being invalidate because project ddb23f4edcc64ea785461b0cdef2e232 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=71939) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Nov 24 16:57:24.922065 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.notifications [None req-3b1d02b1-853d-414d-bd79-f1dfbcdf1394 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=71939) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:357}} Nov 24 16:57:24.923442 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.notifications [None req-3b1d02b1-853d-414d-bd79-f1dfbcdf1394 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=71939) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:357}} Nov 24 16:57:24.925416 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: [pid: 71939|app: 0|req: 1310/2607] 10.222.0.53 () {58 vars in 1223 bytes} [Wed Nov 24 16:57:24 2021] DELETE /identity/v3/projects/ddb23f4edcc64ea785461b0cdef2e232 => generated 0 bytes in 167 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 24 16:57:24.968467 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a4d0150-4e6c-4e22-9990-367d50f83662 None None] Authenticating user token {{(pid=71938) process_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 24 16:57:24.990169 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a4d0150-4e6c-4e22-9990-367d50f83662 None None] Validating token access rules against request {{(pid=71938) validate_allowed_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 24 16:57:25.061936 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49a3dce9-93e7-4e35-a79d-af8c24bbd920 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c90f21b9cdcb413282461fa83cb6b7a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3b3940d4ae1c4177ae29c02377bb4b0b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=71938) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 24 16:57:25.062678 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49a3dce9-93e7-4e35-a79d-af8c24bbd920 service neutron] REQUEST_METHOD: `GET` {{(pid=71938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 24 16:57:25.062979 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49a3dce9-93e7-4e35-a79d-af8c24bbd920 service neutron] SCRIPT_NAME: `/identity` {{(pid=71938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 24 16:57:25.063862 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49a3dce9-93e7-4e35-a79d-af8c24bbd920 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=71938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 24 16:57:25.065943 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.fernet_utils [None req-49a3dce9-93e7-4e35-a79d-af8c24bbd920 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=71938) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:289}} Nov 24 16:57:25.087067 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49a3dce9-93e7-4e35-a79d-af8c24bbd920 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=71938) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:442}} Nov 24 16:57:25.116258 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49a3dce9-93e7-4e35-a79d-af8c24bbd920 service neutron] RBAC: Authorization granted {{(pid=71938) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 24 16:57:25.125471 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: [pid: 71938|app: 0|req: 1298/2608] 10.222.0.53 () {60 vars in 1356 bytes} [Wed Nov 24 16:57:24 2021] GET /identity/v3/auth/tokens => generated 3551 bytes in 158 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 24 16:57:34.569140 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f91838a-9334-4c55-af38-53c2f04a60c6 None None] REQUEST_METHOD: `POST` {{(pid=71939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 24 16:57:34.569618 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f91838a-9334-4c55-af38-53c2f04a60c6 None None] SCRIPT_NAME: `/identity` {{(pid=71939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 24 16:57:34.569798 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f91838a-9334-4c55-af38-53c2f04a60c6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=71939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 24 16:57:34.596223 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.auth.core [None req-9f91838a-9334-4c55-af38-53c2f04a60c6 None None] MFA Rules not processed for user `f8a135ac0e4744a98258dc7f6c12e741`. Rule list: `[]` (Enabled: `True`). {{(pid=71939) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:442}} Nov 24 16:57:34.597379 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.fernet_utils [None req-9f91838a-9334-4c55-af38-53c2f04a60c6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=71939) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:289}} Nov 24 16:57:34.663423 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: [pid: 71939|app: 0|req: 1311/2609] 10.222.0.53 () {58 vars in 958 bytes} [Wed Nov 24 16:57:34 2021] POST /identity/v3/auth/tokens => generated 3625 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 24 16:57:34.677901 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49a3dce9-93e7-4e35-a79d-af8c24bbd920 service neutron] Authenticating user token {{(pid=71938) process_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 24 16:57:34.679386 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.fernet_utils [None req-49a3dce9-93e7-4e35-a79d-af8c24bbd920 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=71938) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:289}} Nov 24 16:57:34.769632 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49a3dce9-93e7-4e35-a79d-af8c24bbd920 service neutron] Validating token access rules against request {{(pid=71938) validate_allowed_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 24 16:57:34.774735 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b3aeee7-6b5a-40c1-9c48-be204f97e11b service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a4cec9543ba4b7da4ecb1e6e8681302', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3b3940d4ae1c4177ae29c02377bb4b0b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=71938) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 24 16:57:34.775510 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b3aeee7-6b5a-40c1-9c48-be204f97e11b service swift] REQUEST_METHOD: `GET` {{(pid=71938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 24 16:57:34.775922 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b3aeee7-6b5a-40c1-9c48-be204f97e11b service swift] SCRIPT_NAME: `/identity` {{(pid=71938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 24 16:57:34.776328 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b3aeee7-6b5a-40c1-9c48-be204f97e11b service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=71938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 24 16:57:34.786246 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b3aeee7-6b5a-40c1-9c48-be204f97e11b service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=71938) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:442}} Nov 24 16:57:34.815473 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b3aeee7-6b5a-40c1-9c48-be204f97e11b service swift] RBAC: Authorization granted {{(pid=71938) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 24 16:57:34.827107 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: [pid: 71938|app: 0|req: 1299/2610] 10.222.0.53 () {60 vars in 1375 bytes} [Wed Nov 24 16:57:34 2021] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 150 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Nov 24 16:57:35.307228 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f91838a-9334-4c55-af38-53c2f04a60c6 None None] Authenticating user token {{(pid=71939) process_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 24 16:57:35.308866 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.fernet_utils [None req-9f91838a-9334-4c55-af38-53c2f04a60c6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=71939) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:289}} Nov 24 16:57:35.321469 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f91838a-9334-4c55-af38-53c2f04a60c6 None None] Validating token access rules against request {{(pid=71939) validate_allowed_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 24 16:57:35.325107 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5de3b953-0be6-40cd-b953-7e06a1a2d783 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c90f21b9cdcb413282461fa83cb6b7a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3b3940d4ae1c4177ae29c02377bb4b0b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=71939) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 24 16:57:35.325760 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5de3b953-0be6-40cd-b953-7e06a1a2d783 service neutron] REQUEST_METHOD: `GET` {{(pid=71939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 24 16:57:35.326131 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5de3b953-0be6-40cd-b953-7e06a1a2d783 service neutron] SCRIPT_NAME: `/identity` {{(pid=71939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 24 16:57:35.326464 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5de3b953-0be6-40cd-b953-7e06a1a2d783 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=71939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 24 16:57:35.329289 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.fernet_utils [None req-5de3b953-0be6-40cd-b953-7e06a1a2d783 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=71939) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:289}} Nov 24 16:57:35.400611 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5de3b953-0be6-40cd-b953-7e06a1a2d783 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=71939) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:442}} Nov 24 16:57:35.428973 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5de3b953-0be6-40cd-b953-7e06a1a2d783 service neutron] RBAC: Authorization granted {{(pid=71939) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 24 16:57:35.439902 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: [pid: 71939|app: 0|req: 1312/2611] 10.222.0.53 () {60 vars in 1356 bytes} [Wed Nov 24 16:57:35 2021] GET /identity/v3/auth/tokens => generated 3669 bytes in 133 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 24 16:57:38.754636 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b3aeee7-6b5a-40c1-9c48-be204f97e11b service swift] Authenticating user token {{(pid=71938) process_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 24 16:57:38.756683 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.fernet_utils [None req-7b3aeee7-6b5a-40c1-9c48-be204f97e11b service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=71938) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:289}} Nov 24 16:57:38.964868 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b3aeee7-6b5a-40c1-9c48-be204f97e11b service swift] Validating token access rules against request {{(pid=71938) validate_allowed_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 24 16:57:38.971204 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a174a47-e6cd-480e-9415-a8f0b091a77d service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e196802d4d5432482b6d2eabc25f74e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3b3940d4ae1c4177ae29c02377bb4b0b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'service', 'ResellerAdmin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=71938) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 24 16:57:38.971980 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a174a47-e6cd-480e-9415-a8f0b091a77d service nova] REQUEST_METHOD: `GET` {{(pid=71938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 24 16:57:38.973555 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a174a47-e6cd-480e-9415-a8f0b091a77d service nova] SCRIPT_NAME: `/identity` {{(pid=71938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 24 16:57:38.975099 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a174a47-e6cd-480e-9415-a8f0b091a77d service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=71938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 24 16:57:38.977175 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.fernet_utils [None req-4a174a47-e6cd-480e-9415-a8f0b091a77d service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=71938) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:289}} Nov 24 16:57:38.996138 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a174a47-e6cd-480e-9415-a8f0b091a77d service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=71938) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:442}} Nov 24 16:57:39.031646 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a174a47-e6cd-480e-9415-a8f0b091a77d service nova] RBAC: Authorization granted {{(pid=71938) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 24 16:57:39.046873 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: [pid: 71938|app: 0|req: 1300/2612] 10.222.0.53 () {60 vars in 1356 bytes} [Wed Nov 24 16:57:38 2021] GET /identity/v3/auth/tokens => generated 3802 bytes in 290 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 24 16:57:48.519883 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5de3b953-0be6-40cd-b953-7e06a1a2d783 service neutron] Authenticating user token {{(pid=71939) process_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 24 16:57:48.521385 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.fernet_utils [None req-5de3b953-0be6-40cd-b953-7e06a1a2d783 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=71939) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:289}} Nov 24 16:57:48.533900 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5de3b953-0be6-40cd-b953-7e06a1a2d783 service neutron] Validating token access rules against request {{(pid=71939) validate_allowed_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 24 16:57:48.538593 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43e4ed76-f09b-4fdd-b878-8308551ccc85 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f2ba2e8375b4e8c8792ee1e22b60427', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '00a5583c7b7443e98e7a1d31a0b638dc', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=71939) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 24 16:57:48.539483 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43e4ed76-f09b-4fdd-b878-8308551ccc85 admin admin] REQUEST_METHOD: `DELETE` {{(pid=71939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 24 16:57:48.539820 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43e4ed76-f09b-4fdd-b878-8308551ccc85 admin admin] SCRIPT_NAME: `/identity` {{(pid=71939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 24 16:57:48.540156 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43e4ed76-f09b-4fdd-b878-8308551ccc85 admin admin] PATH_INFO: `/v3/users/a925d4338c854b828b7417f96e9e04e6` {{(pid=71939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 24 16:57:48.541378 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43e4ed76-f09b-4fdd-b878-8308551ccc85 admin admin] RBAC: Authorizing `identity:delete_user(user_id=a925d4338c854b828b7417f96e9e04e6)` {{(pid=71939) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:442}} Nov 24 16:57:48.577419 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43e4ed76-f09b-4fdd-b878-8308551ccc85 admin admin] RBAC: Authorization granted {{(pid=71939) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 24 16:57:48.630842 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.notifications [None req-43e4ed76-f09b-4fdd-b878-8308551ccc85 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a925d4338c854b828b7417f96e9e04e6'} {{(pid=71939) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:357}} Nov 24 16:57:48.644075 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.notifications [None req-43e4ed76-f09b-4fdd-b878-8308551ccc85 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a925d4338c854b828b7417f96e9e04e6'} {{(pid=71939) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:357}} Nov 24 16:57:48.644826 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.notifications [None req-43e4ed76-f09b-4fdd-b878-8308551ccc85 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a925d4338c854b828b7417f96e9e04e6'} {{(pid=71939) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:357}} Nov 24 16:57:48.654099 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.notifications [None req-43e4ed76-f09b-4fdd-b878-8308551ccc85 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a925d4338c854b828b7417f96e9e04e6'} {{(pid=71939) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:357}} Nov 24 16:57:48.661158 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.notifications [None req-43e4ed76-f09b-4fdd-b878-8308551ccc85 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a925d4338c854b828b7417f96e9e04e6'} {{(pid=71939) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:357}} Nov 24 16:57:48.667898 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: [pid: 71939|app: 0|req: 1313/2613] 10.222.0.53 () {58 vars in 1214 bytes} [Wed Nov 24 16:57:48 2021] DELETE /identity/v3/users/a925d4338c854b828b7417f96e9e04e6 => generated 0 bytes in 149 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 24 16:57:48.898344 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a174a47-e6cd-480e-9415-a8f0b091a77d service nova] Authenticating user token {{(pid=71938) process_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 24 16:57:48.910131 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a174a47-e6cd-480e-9415-a8f0b091a77d service nova] Validating token access rules against request {{(pid=71938) validate_allowed_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 24 16:57:48.978927 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b3b0c25-b09a-4194-baaa-775be83ff2a4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f2ba2e8375b4e8c8792ee1e22b60427', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '00a5583c7b7443e98e7a1d31a0b638dc', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=71938) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 24 16:57:48.979812 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b3b0c25-b09a-4194-baaa-775be83ff2a4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=71938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 24 16:57:48.980150 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b3b0c25-b09a-4194-baaa-775be83ff2a4 admin admin] SCRIPT_NAME: `/identity` {{(pid=71938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 24 16:57:48.980482 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b3b0c25-b09a-4194-baaa-775be83ff2a4 admin admin] PATH_INFO: `/v3/projects/da85f7b56be043949b7841a49547af64` {{(pid=71938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 24 16:57:48.981717 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b3b0c25-b09a-4194-baaa-775be83ff2a4 admin admin] RBAC: Authorizing `identity:delete_project(project_id=da85f7b56be043949b7841a49547af64)` {{(pid=71938) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:442}} Nov 24 16:57:49.010069 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b3b0c25-b09a-4194-baaa-775be83ff2a4 admin admin] RBAC: Authorization granted {{(pid=71938) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 24 16:57:49.064418 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.notifications [None req-1b3b0c25-b09a-4194-baaa-775be83ff2a4 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'da85f7b56be043949b7841a49547af64', 'request_id': 'req-1b3b0c25-b09a-4194-baaa-775be83ff2a4'} {{(pid=71938) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:357}} Nov 24 16:57:49.076267 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.notifications [None req-1b3b0c25-b09a-4194-baaa-775be83ff2a4 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'da85f7b56be043949b7841a49547af64', 'request_id': 'req-1b3b0c25-b09a-4194-baaa-775be83ff2a4'} {{(pid=71938) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:357}} Nov 24 16:57:49.082098 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.notifications [None req-1b3b0c25-b09a-4194-baaa-775be83ff2a4 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'da85f7b56be043949b7841a49547af64', 'request_id': 'req-1b3b0c25-b09a-4194-baaa-775be83ff2a4'} {{(pid=71938) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:357}} Nov 24 16:57:49.093525 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.notifications [None req-1b3b0c25-b09a-4194-baaa-775be83ff2a4 admin admin] The token cache is being invalidate because project da85f7b56be043949b7841a49547af64 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=71938) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Nov 24 16:57:49.094491 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.notifications [None req-1b3b0c25-b09a-4194-baaa-775be83ff2a4 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=71938) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:357}} Nov 24 16:57:49.095112 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.notifications [None req-1b3b0c25-b09a-4194-baaa-775be83ff2a4 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=71938) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:357}} Nov 24 16:57:49.096728 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: [pid: 71938|app: 0|req: 1301/2614] 10.222.0.53 () {58 vars in 1223 bytes} [Wed Nov 24 16:57:48 2021] DELETE /identity/v3/projects/da85f7b56be043949b7841a49547af64 => generated 0 bytes in 199 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 24 16:57:49.101006 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43e4ed76-f09b-4fdd-b878-8308551ccc85 admin admin] Authenticating user token {{(pid=71939) process_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 24 16:57:49.102603 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.fernet_utils [None req-43e4ed76-f09b-4fdd-b878-8308551ccc85 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=71939) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:289}} Nov 24 16:57:49.115891 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43e4ed76-f09b-4fdd-b878-8308551ccc85 admin admin] Validating token access rules against request {{(pid=71939) validate_allowed_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 24 16:57:49.183493 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09987233-ee9e-4856-8951-fca570b13e83 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f2ba2e8375b4e8c8792ee1e22b60427', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '00a5583c7b7443e98e7a1d31a0b638dc', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=71939) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 24 16:57:49.184209 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09987233-ee9e-4856-8951-fca570b13e83 admin admin] REQUEST_METHOD: `DELETE` {{(pid=71939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 24 16:57:49.184559 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09987233-ee9e-4856-8951-fca570b13e83 admin admin] SCRIPT_NAME: `/identity` {{(pid=71939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 24 16:57:49.184892 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09987233-ee9e-4856-8951-fca570b13e83 admin admin] PATH_INFO: `/v3/users/40db23df51d64c1cbf05a8b2556a497f` {{(pid=71939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 24 16:57:49.186450 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09987233-ee9e-4856-8951-fca570b13e83 admin admin] RBAC: Authorizing `identity:delete_user(user_id=40db23df51d64c1cbf05a8b2556a497f)` {{(pid=71939) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:442}} Nov 24 16:57:49.216730 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09987233-ee9e-4856-8951-fca570b13e83 admin admin] RBAC: Authorization granted {{(pid=71939) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 24 16:57:49.271046 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.notifications [None req-09987233-ee9e-4856-8951-fca570b13e83 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '40db23df51d64c1cbf05a8b2556a497f'} {{(pid=71939) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:357}} Nov 24 16:57:49.283664 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.notifications [None req-09987233-ee9e-4856-8951-fca570b13e83 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '40db23df51d64c1cbf05a8b2556a497f'} {{(pid=71939) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:357}} Nov 24 16:57:49.284376 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.notifications [None req-09987233-ee9e-4856-8951-fca570b13e83 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '40db23df51d64c1cbf05a8b2556a497f'} {{(pid=71939) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:357}} Nov 24 16:57:49.292614 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.notifications [None req-09987233-ee9e-4856-8951-fca570b13e83 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '40db23df51d64c1cbf05a8b2556a497f'} {{(pid=71939) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:357}} Nov 24 16:57:49.298933 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.notifications [None req-09987233-ee9e-4856-8951-fca570b13e83 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '40db23df51d64c1cbf05a8b2556a497f'} {{(pid=71939) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:357}} Nov 24 16:57:49.305501 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: [pid: 71939|app: 0|req: 1314/2615] 10.222.0.53 () {58 vars in 1214 bytes} [Wed Nov 24 16:57:49 2021] DELETE /identity/v3/users/40db23df51d64c1cbf05a8b2556a497f => generated 0 bytes in 205 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 24 16:57:49.541069 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b3b0c25-b09a-4194-baaa-775be83ff2a4 admin admin] Authenticating user token {{(pid=71938) process_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 24 16:57:49.542621 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.fernet_utils [None req-1b3b0c25-b09a-4194-baaa-775be83ff2a4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=71938) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:289}} Nov 24 16:57:49.555442 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b3b0c25-b09a-4194-baaa-775be83ff2a4 admin admin] Validating token access rules against request {{(pid=71938) validate_allowed_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 24 16:57:49.621439 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bda30bfc-4737-4b6f-829c-b342784fd206 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f2ba2e8375b4e8c8792ee1e22b60427', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '00a5583c7b7443e98e7a1d31a0b638dc', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=71938) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 24 16:57:49.622370 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bda30bfc-4737-4b6f-829c-b342784fd206 admin admin] REQUEST_METHOD: `DELETE` {{(pid=71938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 24 16:57:49.622716 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bda30bfc-4737-4b6f-829c-b342784fd206 admin admin] SCRIPT_NAME: `/identity` {{(pid=71938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 24 16:57:49.623050 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bda30bfc-4737-4b6f-829c-b342784fd206 admin admin] PATH_INFO: `/v3/projects/1d68ea1c7ff043f2943b93be6c8d5256` {{(pid=71938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 24 16:57:49.624283 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bda30bfc-4737-4b6f-829c-b342784fd206 admin admin] RBAC: Authorizing `identity:delete_project(project_id=1d68ea1c7ff043f2943b93be6c8d5256)` {{(pid=71938) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:442}} Nov 24 16:57:49.656188 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bda30bfc-4737-4b6f-829c-b342784fd206 admin admin] RBAC: Authorization granted {{(pid=71938) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 24 16:57:49.717380 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.notifications [None req-bda30bfc-4737-4b6f-829c-b342784fd206 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '1d68ea1c7ff043f2943b93be6c8d5256', 'request_id': 'req-bda30bfc-4737-4b6f-829c-b342784fd206'} {{(pid=71938) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:357}} Nov 24 16:57:49.729328 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.notifications [None req-bda30bfc-4737-4b6f-829c-b342784fd206 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '1d68ea1c7ff043f2943b93be6c8d5256', 'request_id': 'req-bda30bfc-4737-4b6f-829c-b342784fd206'} {{(pid=71938) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:357}} Nov 24 16:57:49.735111 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.notifications [None req-bda30bfc-4737-4b6f-829c-b342784fd206 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '1d68ea1c7ff043f2943b93be6c8d5256', 'request_id': 'req-bda30bfc-4737-4b6f-829c-b342784fd206'} {{(pid=71938) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:357}} Nov 24 16:57:49.746372 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.notifications [None req-bda30bfc-4737-4b6f-829c-b342784fd206 admin admin] The token cache is being invalidate because project 1d68ea1c7ff043f2943b93be6c8d5256 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=71938) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Nov 24 16:57:49.746673 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.notifications [None req-bda30bfc-4737-4b6f-829c-b342784fd206 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=71938) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:357}} Nov 24 16:57:49.747357 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.notifications [None req-bda30bfc-4737-4b6f-829c-b342784fd206 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=71938) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:357}} Nov 24 16:57:49.748959 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: [pid: 71938|app: 0|req: 1302/2616] 10.222.0.53 () {58 vars in 1223 bytes} [Wed Nov 24 16:57:49 2021] DELETE /identity/v3/projects/1d68ea1c7ff043f2943b93be6c8d5256 => generated 0 bytes in 209 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 24 16:58:18.023843 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09987233-ee9e-4856-8951-fca570b13e83 admin admin] Authenticating user token {{(pid=71939) process_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 24 16:58:18.025318 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.fernet_utils [None req-09987233-ee9e-4856-8951-fca570b13e83 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=71939) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:289}} Nov 24 16:58:18.122543 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09987233-ee9e-4856-8951-fca570b13e83 admin admin] Validating token access rules against request {{(pid=71939) validate_allowed_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 24 16:58:18.182037 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77847e83-6af9-4013-a1c7-ead582fb4936 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'af9e91f8d56c491d99fab4346754ce2e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3b3940d4ae1c4177ae29c02377bb4b0b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=71939) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 24 16:58:18.182721 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77847e83-6af9-4013-a1c7-ead582fb4936 service glance] REQUEST_METHOD: `GET` {{(pid=71939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 24 16:58:18.183061 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77847e83-6af9-4013-a1c7-ead582fb4936 service glance] SCRIPT_NAME: `/identity` {{(pid=71939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 24 16:58:18.183393 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77847e83-6af9-4013-a1c7-ead582fb4936 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=71939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 24 16:58:18.185236 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.fernet_utils [None req-77847e83-6af9-4013-a1c7-ead582fb4936 service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=71939) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:289}} Nov 24 16:58:18.264415 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77847e83-6af9-4013-a1c7-ead582fb4936 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=71939) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:442}} Nov 24 16:58:18.293294 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77847e83-6af9-4013-a1c7-ead582fb4936 service glance] RBAC: Authorization granted {{(pid=71939) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 24 16:58:18.304444 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: [pid: 71939|app: 0|req: 1315/2617] 10.222.0.53 () {60 vars in 1356 bytes} [Wed Nov 24 16:58:18 2021] GET /identity/v3/auth/tokens => generated 3802 bytes in 281 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 24 16:58:18.609186 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bda30bfc-4737-4b6f-829c-b342784fd206 admin admin] Authenticating user token {{(pid=71938) process_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 24 16:58:18.610667 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.fernet_utils [None req-bda30bfc-4737-4b6f-829c-b342784fd206 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=71938) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:289}} Nov 24 16:58:18.677189 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bda30bfc-4737-4b6f-829c-b342784fd206 admin admin] Validating token access rules against request {{(pid=71938) validate_allowed_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 24 16:58:18.681062 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-276bcc63-3e91-41fb-a20b-2296739f274f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c90f21b9cdcb413282461fa83cb6b7a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3b3940d4ae1c4177ae29c02377bb4b0b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=71938) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 24 16:58:18.681729 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-276bcc63-3e91-41fb-a20b-2296739f274f service neutron] REQUEST_METHOD: `GET` {{(pid=71938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 24 16:58:18.682098 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-276bcc63-3e91-41fb-a20b-2296739f274f service neutron] SCRIPT_NAME: `/identity` {{(pid=71938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 24 16:58:18.682437 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-276bcc63-3e91-41fb-a20b-2296739f274f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=71938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 24 16:58:18.684380 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.fernet_utils [None req-276bcc63-3e91-41fb-a20b-2296739f274f service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=71938) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:289}} Nov 24 16:58:18.698557 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-276bcc63-3e91-41fb-a20b-2296739f274f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=71938) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:442}} Nov 24 16:58:18.727062 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-276bcc63-3e91-41fb-a20b-2296739f274f service neutron] RBAC: Authorization granted {{(pid=71938) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 24 16:58:18.738304 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: [pid: 71938|app: 0|req: 1303/2618] 10.222.0.53 () {60 vars in 1356 bytes} [Wed Nov 24 16:58:18 2021] GET /identity/v3/auth/tokens => generated 3802 bytes in 130 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 24 16:58:31.023332 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9115489-4c2b-4a9a-aa93-6e3a2fd438bb None None] REQUEST_METHOD: `POST` {{(pid=71939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 24 16:58:31.023852 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9115489-4c2b-4a9a-aa93-6e3a2fd438bb None None] SCRIPT_NAME: `/identity` {{(pid=71939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 24 16:58:31.023971 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9115489-4c2b-4a9a-aa93-6e3a2fd438bb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=71939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 24 16:58:31.096668 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.auth.core [None req-e9115489-4c2b-4a9a-aa93-6e3a2fd438bb None None] MFA Rules not processed for user `f8a135ac0e4744a98258dc7f6c12e741`. Rule list: `[]` (Enabled: `True`). {{(pid=71939) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:442}} Nov 24 16:58:31.097913 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.fernet_utils [None req-e9115489-4c2b-4a9a-aa93-6e3a2fd438bb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=71939) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:289}} Nov 24 16:58:31.177943 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: [pid: 71939|app: 0|req: 1316/2619] 10.222.0.53 () {58 vars in 999 bytes} [Wed Nov 24 16:58:31 2021] POST /identity/v3/auth/tokens => generated 3625 bytes in 156 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 24 16:58:31.201877 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-276bcc63-3e91-41fb-a20b-2296739f274f service neutron] Authenticating user token {{(pid=71938) process_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 24 16:58:31.204049 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.fernet_utils [None req-276bcc63-3e91-41fb-a20b-2296739f274f service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=71938) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:289}} Nov 24 16:58:31.310998 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-276bcc63-3e91-41fb-a20b-2296739f274f service neutron] Validating token access rules against request {{(pid=71938) validate_allowed_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 24 16:58:31.316690 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a80ff74-7fb4-45ee-81fa-5f4d441e51a3 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a4cec9543ba4b7da4ecb1e6e8681302', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3b3940d4ae1c4177ae29c02377bb4b0b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=71938) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 24 16:58:31.317350 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a80ff74-7fb4-45ee-81fa-5f4d441e51a3 service swift] REQUEST_METHOD: `GET` {{(pid=71938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 24 16:58:31.317692 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a80ff74-7fb4-45ee-81fa-5f4d441e51a3 service swift] SCRIPT_NAME: `/identity` {{(pid=71938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 24 16:58:31.318062 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a80ff74-7fb4-45ee-81fa-5f4d441e51a3 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=71938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 24 16:58:31.326628 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a80ff74-7fb4-45ee-81fa-5f4d441e51a3 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=71938) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:442}} Nov 24 16:58:31.355931 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a80ff74-7fb4-45ee-81fa-5f4d441e51a3 service swift] RBAC: Authorization granted {{(pid=71938) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 24 16:58:31.364414 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: [pid: 71938|app: 0|req: 1304/2620] 10.222.0.53 () {60 vars in 1375 bytes} [Wed Nov 24 16:58:31 2021] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 163 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Nov 24 16:58:34.551259 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9115489-4c2b-4a9a-aa93-6e3a2fd438bb None None] Authenticating user token {{(pid=71939) process_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 24 16:58:34.563328 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9115489-4c2b-4a9a-aa93-6e3a2fd438bb None None] Validating token access rules against request {{(pid=71939) validate_allowed_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 24 16:58:34.567360 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0c6194e-71c7-4877-8570-68152777c240 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c90f21b9cdcb413282461fa83cb6b7a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3b3940d4ae1c4177ae29c02377bb4b0b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=71939) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 24 16:58:34.568098 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0c6194e-71c7-4877-8570-68152777c240 service neutron] REQUEST_METHOD: `GET` {{(pid=71939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 24 16:58:34.568510 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0c6194e-71c7-4877-8570-68152777c240 service neutron] SCRIPT_NAME: `/identity` {{(pid=71939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 24 16:58:34.568911 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0c6194e-71c7-4877-8570-68152777c240 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=71939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 24 16:58:34.571149 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.fernet_utils [None req-d0c6194e-71c7-4877-8570-68152777c240 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=71939) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:289}} Nov 24 16:58:34.690163 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0c6194e-71c7-4877-8570-68152777c240 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=71939) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:442}} Nov 24 16:58:34.723347 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0c6194e-71c7-4877-8570-68152777c240 service neutron] RBAC: Authorization granted {{(pid=71939) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 24 16:58:34.735320 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: [pid: 71939|app: 0|req: 1317/2621] 10.222.0.53 () {60 vars in 1387 bytes} [Wed Nov 24 16:58:34 2021] GET /identity/v3/auth/tokens?allow_expired=1 => generated 3692 bytes in 184 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 24 16:58:35.098364 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a80ff74-7fb4-45ee-81fa-5f4d441e51a3 service swift] Authenticating user token {{(pid=71938) process_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 24 16:58:35.100115 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.fernet_utils [None req-4a80ff74-7fb4-45ee-81fa-5f4d441e51a3 service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=71938) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:289}} Nov 24 16:58:35.179558 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a80ff74-7fb4-45ee-81fa-5f4d441e51a3 service swift] Validating token access rules against request {{(pid=71938) validate_allowed_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 24 16:58:35.183694 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-905f7f34-c495-47e7-b180-04272bae930b service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a12374a3093a401a97c343ff0854184d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3b3940d4ae1c4177ae29c02377bb4b0b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=71938) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 24 16:58:35.184634 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-905f7f34-c495-47e7-b180-04272bae930b service cinder] REQUEST_METHOD: `GET` {{(pid=71938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 24 16:58:35.184634 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-905f7f34-c495-47e7-b180-04272bae930b service cinder] SCRIPT_NAME: `/identity` {{(pid=71938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 24 16:58:35.184817 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-905f7f34-c495-47e7-b180-04272bae930b service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=71938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 24 16:58:35.187178 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.fernet_utils [None req-905f7f34-c495-47e7-b180-04272bae930b service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=71938) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:289}} Nov 24 16:58:35.302070 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-905f7f34-c495-47e7-b180-04272bae930b service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=71938) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:442}} Nov 24 16:58:35.332820 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-905f7f34-c495-47e7-b180-04272bae930b service cinder] RBAC: Authorization granted {{(pid=71938) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 24 16:58:35.356675 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: [pid: 71938|app: 0|req: 1305/2622] 10.222.0.53 () {60 vars in 1356 bytes} [Wed Nov 24 16:58:35 2021] GET /identity/v3/auth/tokens => generated 3682 bytes in 259 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 24 16:58:45.668641 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0c6194e-71c7-4877-8570-68152777c240 service neutron] Authenticating user token {{(pid=71939) process_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 24 16:58:45.670182 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.fernet_utils [None req-d0c6194e-71c7-4877-8570-68152777c240 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=71939) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:289}} Nov 24 16:58:45.681426 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0c6194e-71c7-4877-8570-68152777c240 service neutron] Validating token access rules against request {{(pid=71939) validate_allowed_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 24 16:58:45.685681 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12c742c8-2035-44aa-a172-a77c51de4c5d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c90f21b9cdcb413282461fa83cb6b7a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3b3940d4ae1c4177ae29c02377bb4b0b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=71939) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 24 16:58:45.686449 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12c742c8-2035-44aa-a172-a77c51de4c5d service neutron] REQUEST_METHOD: `GET` {{(pid=71939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 24 16:58:45.686795 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12c742c8-2035-44aa-a172-a77c51de4c5d service neutron] SCRIPT_NAME: `/identity` {{(pid=71939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 24 16:58:45.687133 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12c742c8-2035-44aa-a172-a77c51de4c5d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=71939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 24 16:58:45.689466 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.fernet_utils [None req-12c742c8-2035-44aa-a172-a77c51de4c5d service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=71939) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:289}} Nov 24 16:58:45.699581 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12c742c8-2035-44aa-a172-a77c51de4c5d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=71939) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:442}} Nov 24 16:58:45.728306 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12c742c8-2035-44aa-a172-a77c51de4c5d service neutron] RBAC: Authorization granted {{(pid=71939) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 24 16:58:45.737553 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: [pid: 71939|app: 0|req: 1318/2623] 10.222.0.53 () {60 vars in 1356 bytes} [Wed Nov 24 16:58:45 2021] GET /identity/v3/auth/tokens => generated 3551 bytes in 69 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 24 16:58:47.835670 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4228b04-f70e-456d-827d-470e55a6ec42 None None] REQUEST_METHOD: `POST` {{(pid=71938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 24 16:58:47.836205 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4228b04-f70e-456d-827d-470e55a6ec42 None None] SCRIPT_NAME: `/identity` {{(pid=71938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 24 16:58:47.836376 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4228b04-f70e-456d-827d-470e55a6ec42 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=71938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 24 16:58:47.861126 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.auth.core [None req-b4228b04-f70e-456d-827d-470e55a6ec42 None None] MFA Rules not processed for user `f8a135ac0e4744a98258dc7f6c12e741`. Rule list: `[]` (Enabled: `True`). {{(pid=71938) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:442}} Nov 24 16:58:47.862365 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.fernet_utils [None req-b4228b04-f70e-456d-827d-470e55a6ec42 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=71938) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:289}} Nov 24 16:58:47.869227 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: [pid: 71938|app: 0|req: 1306/2624] 10.222.0.53 () {58 vars in 999 bytes} [Wed Nov 24 16:58:47 2021] POST /identity/v3/auth/tokens => generated 3625 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 24 16:58:47.882307 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12c742c8-2035-44aa-a172-a77c51de4c5d service neutron] Authenticating user token {{(pid=71939) process_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 24 16:58:47.894771 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12c742c8-2035-44aa-a172-a77c51de4c5d service neutron] Validating token access rules against request {{(pid=71939) validate_allowed_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 24 16:58:47.899723 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9323b8e1-649b-44fe-9d09-e47d59ff7349 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a4cec9543ba4b7da4ecb1e6e8681302', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3b3940d4ae1c4177ae29c02377bb4b0b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=71939) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 24 16:58:47.900379 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9323b8e1-649b-44fe-9d09-e47d59ff7349 service swift] REQUEST_METHOD: `GET` {{(pid=71939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 24 16:58:47.900718 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9323b8e1-649b-44fe-9d09-e47d59ff7349 service swift] SCRIPT_NAME: `/identity` {{(pid=71939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 24 16:58:47.901051 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9323b8e1-649b-44fe-9d09-e47d59ff7349 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=71939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 24 16:58:47.909965 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9323b8e1-649b-44fe-9d09-e47d59ff7349 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=71939) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:442}} Nov 24 16:58:47.944494 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9323b8e1-649b-44fe-9d09-e47d59ff7349 service swift] RBAC: Authorization granted {{(pid=71939) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 24 16:58:47.953795 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: [pid: 71939|app: 0|req: 1319/2625] 10.222.0.53 () {60 vars in 1375 bytes} [Wed Nov 24 16:58:47 2021] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 72 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Nov 24 16:59:04.371221 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d8f6dd9-67ee-4827-a8fc-96ae0bbd0d2a None None] REQUEST_METHOD: `POST` {{(pid=71938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 24 16:59:04.371685 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d8f6dd9-67ee-4827-a8fc-96ae0bbd0d2a None None] SCRIPT_NAME: `/identity` {{(pid=71938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 24 16:59:04.371933 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d8f6dd9-67ee-4827-a8fc-96ae0bbd0d2a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=71938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 24 16:59:04.395251 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.auth.core [None req-1d8f6dd9-67ee-4827-a8fc-96ae0bbd0d2a None None] MFA Rules not processed for user `f8a135ac0e4744a98258dc7f6c12e741`. Rule list: `[]` (Enabled: `True`). {{(pid=71938) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:442}} Nov 24 16:59:04.396469 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.fernet_utils [None req-1d8f6dd9-67ee-4827-a8fc-96ae0bbd0d2a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=71938) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:289}} Nov 24 16:59:04.403444 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: [pid: 71938|app: 0|req: 1307/2626] 10.222.0.53 () {58 vars in 958 bytes} [Wed Nov 24 16:59:04 2021] POST /identity/v3/auth/tokens => generated 3625 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 24 16:59:04.417604 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9323b8e1-649b-44fe-9d09-e47d59ff7349 service swift] Authenticating user token {{(pid=71939) process_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 24 16:59:04.428743 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9323b8e1-649b-44fe-9d09-e47d59ff7349 service swift] Validating token access rules against request {{(pid=71939) validate_allowed_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 24 16:59:04.433775 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ed90ff6-2b25-43a0-8b96-8d5f86190be8 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a4cec9543ba4b7da4ecb1e6e8681302', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3b3940d4ae1c4177ae29c02377bb4b0b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=71939) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 24 16:59:04.434488 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ed90ff6-2b25-43a0-8b96-8d5f86190be8 service swift] REQUEST_METHOD: `GET` {{(pid=71939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 24 16:59:04.435082 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ed90ff6-2b25-43a0-8b96-8d5f86190be8 service swift] SCRIPT_NAME: `/identity` {{(pid=71939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 24 16:59:04.435410 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ed90ff6-2b25-43a0-8b96-8d5f86190be8 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=71939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 24 16:59:04.444286 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ed90ff6-2b25-43a0-8b96-8d5f86190be8 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=71939) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:442}} Nov 24 16:59:04.474002 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ed90ff6-2b25-43a0-8b96-8d5f86190be8 service swift] RBAC: Authorization granted {{(pid=71939) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 24 16:59:04.483162 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: [pid: 71939|app: 0|req: 1320/2627] 10.222.0.53 () {60 vars in 1375 bytes} [Wed Nov 24 16:59:04 2021] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 66 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Nov 24 16:59:43.630147 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d8f6dd9-67ee-4827-a8fc-96ae0bbd0d2a None None] Authenticating user token {{(pid=71938) process_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 24 16:59:43.640053 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d8f6dd9-67ee-4827-a8fc-96ae0bbd0d2a None None] Validating token access rules against request {{(pid=71938) validate_allowed_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 24 16:59:43.644590 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-518c3872-28f5-4ad9-85b3-f7c7248e6d53 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c90f21b9cdcb413282461fa83cb6b7a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3b3940d4ae1c4177ae29c02377bb4b0b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=71938) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 24 16:59:43.645234 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-518c3872-28f5-4ad9-85b3-f7c7248e6d53 service neutron] REQUEST_METHOD: `GET` {{(pid=71938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 24 16:59:43.645576 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-518c3872-28f5-4ad9-85b3-f7c7248e6d53 service neutron] SCRIPT_NAME: `/identity` {{(pid=71938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 24 16:59:43.645906 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-518c3872-28f5-4ad9-85b3-f7c7248e6d53 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=71938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 24 16:59:43.647758 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.fernet_utils [None req-518c3872-28f5-4ad9-85b3-f7c7248e6d53 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=71938) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:289}} Nov 24 16:59:43.722108 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-518c3872-28f5-4ad9-85b3-f7c7248e6d53 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=71938) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:442}} Nov 24 16:59:43.750320 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-518c3872-28f5-4ad9-85b3-f7c7248e6d53 service neutron] RBAC: Authorization granted {{(pid=71938) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 24 16:59:43.760781 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: [pid: 71938|app: 0|req: 1308/2628] 10.222.0.53 () {60 vars in 1356 bytes} [Wed Nov 24 16:59:43 2021] GET /identity/v3/auth/tokens => generated 3669 bytes in 131 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 24 16:59:50.249299 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ed90ff6-2b25-43a0-8b96-8d5f86190be8 service swift] Authenticating user token {{(pid=71939) process_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 24 16:59:50.250813 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.fernet_utils [None req-2ed90ff6-2b25-43a0-8b96-8d5f86190be8 service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=71939) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:289}} Nov 24 16:59:50.265161 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ed90ff6-2b25-43a0-8b96-8d5f86190be8 service swift] Validating token access rules against request {{(pid=71939) validate_allowed_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 24 16:59:50.270388 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02b333a4-3c08-45e8-afdc-56bc91f4de7f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f2ba2e8375b4e8c8792ee1e22b60427', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '00a5583c7b7443e98e7a1d31a0b638dc', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=71939) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 24 16:59:50.271271 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02b333a4-3c08-45e8-afdc-56bc91f4de7f admin admin] REQUEST_METHOD: `DELETE` {{(pid=71939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 24 16:59:50.271618 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02b333a4-3c08-45e8-afdc-56bc91f4de7f admin admin] SCRIPT_NAME: `/identity` {{(pid=71939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 24 16:59:50.272068 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02b333a4-3c08-45e8-afdc-56bc91f4de7f admin admin] PATH_INFO: `/v3/users/5e2f5fe0a70c48dfa7bfaff9973b6e62` {{(pid=71939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 24 16:59:50.273382 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02b333a4-3c08-45e8-afdc-56bc91f4de7f admin admin] RBAC: Authorizing `identity:delete_user(user_id=5e2f5fe0a70c48dfa7bfaff9973b6e62)` {{(pid=71939) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:442}} Nov 24 16:59:50.301791 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02b333a4-3c08-45e8-afdc-56bc91f4de7f admin admin] RBAC: Authorization granted {{(pid=71939) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 24 16:59:50.352841 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.notifications [None req-02b333a4-3c08-45e8-afdc-56bc91f4de7f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '5e2f5fe0a70c48dfa7bfaff9973b6e62'} {{(pid=71939) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:357}} Nov 24 16:59:50.365161 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.notifications [None req-02b333a4-3c08-45e8-afdc-56bc91f4de7f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '5e2f5fe0a70c48dfa7bfaff9973b6e62'} {{(pid=71939) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:357}} Nov 24 16:59:50.365862 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.notifications [None req-02b333a4-3c08-45e8-afdc-56bc91f4de7f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '5e2f5fe0a70c48dfa7bfaff9973b6e62'} {{(pid=71939) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:357}} Nov 24 16:59:50.374192 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.notifications [None req-02b333a4-3c08-45e8-afdc-56bc91f4de7f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '5e2f5fe0a70c48dfa7bfaff9973b6e62'} {{(pid=71939) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:357}} Nov 24 16:59:50.380700 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.notifications [None req-02b333a4-3c08-45e8-afdc-56bc91f4de7f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '5e2f5fe0a70c48dfa7bfaff9973b6e62'} {{(pid=71939) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:357}} Nov 24 16:59:50.386945 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: [pid: 71939|app: 0|req: 1321/2629] 10.222.0.53 () {58 vars in 1214 bytes} [Wed Nov 24 16:59:50 2021] DELETE /identity/v3/users/5e2f5fe0a70c48dfa7bfaff9973b6e62 => generated 0 bytes in 138 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 24 16:59:50.612468 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-518c3872-28f5-4ad9-85b3-f7c7248e6d53 service neutron] Authenticating user token {{(pid=71938) process_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 24 16:59:50.622539 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-518c3872-28f5-4ad9-85b3-f7c7248e6d53 service neutron] Validating token access rules against request {{(pid=71938) validate_allowed_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 24 16:59:50.689414 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebead612-8978-4834-9b05-78065ab1b5ca admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f2ba2e8375b4e8c8792ee1e22b60427', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '00a5583c7b7443e98e7a1d31a0b638dc', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=71938) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 24 16:59:50.690321 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebead612-8978-4834-9b05-78065ab1b5ca admin admin] REQUEST_METHOD: `DELETE` {{(pid=71938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 24 16:59:50.690662 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebead612-8978-4834-9b05-78065ab1b5ca admin admin] SCRIPT_NAME: `/identity` {{(pid=71938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 24 16:59:50.690999 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebead612-8978-4834-9b05-78065ab1b5ca admin admin] PATH_INFO: `/v3/projects/5bc4b64f600d48fe89469791c11343df` {{(pid=71938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 24 16:59:50.692226 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebead612-8978-4834-9b05-78065ab1b5ca admin admin] RBAC: Authorizing `identity:delete_project(project_id=5bc4b64f600d48fe89469791c11343df)` {{(pid=71938) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:442}} Nov 24 16:59:50.720649 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebead612-8978-4834-9b05-78065ab1b5ca admin admin] RBAC: Authorization granted {{(pid=71938) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 24 16:59:50.773836 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.notifications [None req-ebead612-8978-4834-9b05-78065ab1b5ca admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '5bc4b64f600d48fe89469791c11343df', 'request_id': 'req-ebead612-8978-4834-9b05-78065ab1b5ca'} {{(pid=71938) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:357}} Nov 24 16:59:50.785669 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.notifications [None req-ebead612-8978-4834-9b05-78065ab1b5ca admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '5bc4b64f600d48fe89469791c11343df', 'request_id': 'req-ebead612-8978-4834-9b05-78065ab1b5ca'} {{(pid=71938) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:357}} Nov 24 16:59:50.791031 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.notifications [None req-ebead612-8978-4834-9b05-78065ab1b5ca admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '5bc4b64f600d48fe89469791c11343df', 'request_id': 'req-ebead612-8978-4834-9b05-78065ab1b5ca'} {{(pid=71938) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:357}} Nov 24 16:59:50.802386 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.notifications [None req-ebead612-8978-4834-9b05-78065ab1b5ca admin admin] The token cache is being invalidate because project 5bc4b64f600d48fe89469791c11343df was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=71938) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Nov 24 16:59:50.802717 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.notifications [None req-ebead612-8978-4834-9b05-78065ab1b5ca admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=71938) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:357}} Nov 24 16:59:50.803391 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.notifications [None req-ebead612-8978-4834-9b05-78065ab1b5ca admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=71938) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:357}} Nov 24 16:59:50.804938 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: [pid: 71938|app: 0|req: 1309/2630] 10.222.0.53 () {58 vars in 1223 bytes} [Wed Nov 24 16:59:50 2021] DELETE /identity/v3/projects/5bc4b64f600d48fe89469791c11343df => generated 0 bytes in 193 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 24 16:59:50.811440 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f58c239e-cb43-4152-818b-f8d1514f3507 None None] REQUEST_METHOD: `POST` {{(pid=71939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 24 16:59:50.811798 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f58c239e-cb43-4152-818b-f8d1514f3507 None None] SCRIPT_NAME: `/identity` {{(pid=71939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 24 16:59:50.812139 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f58c239e-cb43-4152-818b-f8d1514f3507 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=71939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 24 16:59:50.835857 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.auth.core [None req-f58c239e-cb43-4152-818b-f8d1514f3507 None None] MFA Rules not processed for user `0f2ba2e8375b4e8c8792ee1e22b60427`. Rule list: `[]` (Enabled: `True`). {{(pid=71939) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:442}} Nov 24 16:59:50.837083 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.fernet_utils [None req-f58c239e-cb43-4152-818b-f8d1514f3507 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=71939) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:289}} Nov 24 16:59:50.905124 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: [pid: 71939|app: 0|req: 1322/2631] 10.222.0.53 () {58 vars in 948 bytes} [Wed Nov 24 16:59:50 2021] POST /identity/v3/auth/tokens => generated 3669 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 24 16:59:50.913613 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e0ee95c-5fb5-4102-abf6-baf2ebe437e5 None None] REQUEST_METHOD: `POST` {{(pid=71938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 24 16:59:50.913956 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e0ee95c-5fb5-4102-abf6-baf2ebe437e5 None None] SCRIPT_NAME: `/identity` {{(pid=71938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 24 16:59:50.914376 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e0ee95c-5fb5-4102-abf6-baf2ebe437e5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=71938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 24 16:59:50.939049 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.auth.core [None req-9e0ee95c-5fb5-4102-abf6-baf2ebe437e5 None None] MFA Rules not processed for user `0f2ba2e8375b4e8c8792ee1e22b60427`. Rule list: `[]` (Enabled: `True`). {{(pid=71938) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:442}} Nov 24 16:59:50.940280 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.fernet_utils [None req-9e0ee95c-5fb5-4102-abf6-baf2ebe437e5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=71938) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:289}} Nov 24 16:59:50.947660 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: [pid: 71938|app: 0|req: 1310/2632] 10.222.0.53 () {58 vars in 948 bytes} [Wed Nov 24 16:59:50 2021] POST /identity/v3/auth/tokens => generated 3669 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 24 16:59:50.951939 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f58c239e-cb43-4152-818b-f8d1514f3507 None None] Authenticating user token {{(pid=71939) process_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 24 16:59:50.961733 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f58c239e-cb43-4152-818b-f8d1514f3507 None None] Validating token access rules against request {{(pid=71939) validate_allowed_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 24 16:59:50.966380 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5793b26e-280c-454f-af41-511b1341260c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f2ba2e8375b4e8c8792ee1e22b60427', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '00a5583c7b7443e98e7a1d31a0b638dc', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=71939) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 24 16:59:50.967040 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5793b26e-280c-454f-af41-511b1341260c admin admin] REQUEST_METHOD: `GET` {{(pid=71939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 24 16:59:50.967377 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5793b26e-280c-454f-af41-511b1341260c admin admin] SCRIPT_NAME: `/identity` {{(pid=71939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 24 16:59:50.967704 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5793b26e-280c-454f-af41-511b1341260c admin admin] PATH_INFO: `/v3/domains` {{(pid=71939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 24 16:59:50.968486 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5793b26e-280c-454f-af41-511b1341260c admin admin] RBAC: Adding query filter params (name=Default) {{(pid=71939) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:161}} Nov 24 16:59:50.968833 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5793b26e-280c-454f-af41-511b1341260c admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=71939) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:442}} Nov 24 16:59:50.997587 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5793b26e-280c-454f-af41-511b1341260c admin admin] RBAC: Authorization granted {{(pid=71939) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 24 16:59:51.010979 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: [pid: 71939|app: 0|req: 1323/2633] 10.222.0.53 () {58 vars in 1143 bytes} [Wed Nov 24 16:59:50 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 60 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 24 16:59:51.015285 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e0ee95c-5fb5-4102-abf6-baf2ebe437e5 None None] Authenticating user token {{(pid=71938) process_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 24 16:59:51.024502 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e0ee95c-5fb5-4102-abf6-baf2ebe437e5 None None] Validating token access rules against request {{(pid=71938) validate_allowed_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 24 16:59:51.029026 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9bbad60-19d5-4a59-b255-5c9b5ed8b6ae admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f2ba2e8375b4e8c8792ee1e22b60427', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '00a5583c7b7443e98e7a1d31a0b638dc', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=71938) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 24 16:59:51.029680 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9bbad60-19d5-4a59-b255-5c9b5ed8b6ae admin admin] REQUEST_METHOD: `POST` {{(pid=71938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 24 16:59:51.030013 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9bbad60-19d5-4a59-b255-5c9b5ed8b6ae admin admin] SCRIPT_NAME: `/identity` {{(pid=71938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 24 16:59:51.030386 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9bbad60-19d5-4a59-b255-5c9b5ed8b6ae admin admin] PATH_INFO: `/v3/projects` {{(pid=71938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 24 16:59:51.031109 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9bbad60-19d5-4a59-b255-5c9b5ed8b6ae admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=71938) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:442}} Nov 24 16:59:51.060791 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9bbad60-19d5-4a59-b255-5c9b5ed8b6ae admin admin] RBAC: Authorization granted {{(pid=71938) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 24 16:59:51.089055 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: [pid: 71938|app: 0|req: 1311/2634] 10.222.0.53 () {60 vars in 1143 bytes} [Wed Nov 24 16:59:51 2021] POST /identity/v3/projects => generated 369 bytes in 74 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 24 16:59:51.093521 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5793b26e-280c-454f-af41-511b1341260c admin admin] Authenticating user token {{(pid=71939) process_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 24 16:59:51.104292 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5793b26e-280c-454f-af41-511b1341260c admin admin] Validating token access rules against request {{(pid=71939) validate_allowed_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 24 16:59:51.169492 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b3e70e7-5ccf-438e-bdd1-93227653dd89 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f2ba2e8375b4e8c8792ee1e22b60427', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '00a5583c7b7443e98e7a1d31a0b638dc', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=71939) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 24 16:59:51.170148 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b3e70e7-5ccf-438e-bdd1-93227653dd89 admin admin] REQUEST_METHOD: `POST` {{(pid=71939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 24 16:59:51.170496 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b3e70e7-5ccf-438e-bdd1-93227653dd89 admin admin] SCRIPT_NAME: `/identity` {{(pid=71939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 24 16:59:51.170837 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b3e70e7-5ccf-438e-bdd1-93227653dd89 admin admin] PATH_INFO: `/v3/users` {{(pid=71939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 24 16:59:51.171572 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b3e70e7-5ccf-438e-bdd1-93227653dd89 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=71939) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:442}} Nov 24 16:59:51.201387 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b3e70e7-5ccf-438e-bdd1-93227653dd89 admin admin] RBAC: Authorization granted {{(pid=71939) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 24 16:59:51.224794 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: [pid: 71939|app: 0|req: 1324/2635] 10.222.0.53 () {60 vars in 1134 bytes} [Wed Nov 24 16:59:51 2021] POST /identity/v3/users => generated 285 bytes in 129 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 24 16:59:51.226245 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9bbad60-19d5-4a59-b255-5c9b5ed8b6ae admin admin] Authenticating user token {{(pid=71938) process_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 24 16:59:51.238402 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9bbad60-19d5-4a59-b255-5c9b5ed8b6ae admin admin] Validating token access rules against request {{(pid=71938) validate_allowed_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 24 16:59:51.242969 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44263bff-ec1f-40e8-9aad-1b597768b04f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f2ba2e8375b4e8c8792ee1e22b60427', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '00a5583c7b7443e98e7a1d31a0b638dc', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=71938) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 24 16:59:51.243643 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44263bff-ec1f-40e8-9aad-1b597768b04f admin admin] REQUEST_METHOD: `GET` {{(pid=71938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 24 16:59:51.243978 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44263bff-ec1f-40e8-9aad-1b597768b04f admin admin] SCRIPT_NAME: `/identity` {{(pid=71938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 24 16:59:51.244310 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44263bff-ec1f-40e8-9aad-1b597768b04f admin admin] PATH_INFO: `/v3/roles` {{(pid=71938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 24 16:59:51.245089 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44263bff-ec1f-40e8-9aad-1b597768b04f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=71938) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:442}} Nov 24 16:59:51.273023 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44263bff-ec1f-40e8-9aad-1b597768b04f admin admin] RBAC: Authorization granted {{(pid=71938) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 24 16:59:51.285440 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: [pid: 71938|app: 0|req: 1312/2636] 10.222.0.53 () {58 vars in 1112 bytes} [Wed Nov 24 16:59:51 2021] GET /identity/v3/roles => generated 1420 bytes in 60 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 24 16:59:51.290012 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b3e70e7-5ccf-438e-bdd1-93227653dd89 admin admin] Authenticating user token {{(pid=71939) process_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 24 16:59:51.300737 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b3e70e7-5ccf-438e-bdd1-93227653dd89 admin admin] Validating token access rules against request {{(pid=71939) validate_allowed_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 24 16:59:51.305339 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc185567-1b80-4692-a7a1-b10013a35ab4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f2ba2e8375b4e8c8792ee1e22b60427', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '00a5583c7b7443e98e7a1d31a0b638dc', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=71939) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 24 16:59:51.306281 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc185567-1b80-4692-a7a1-b10013a35ab4 admin admin] REQUEST_METHOD: `PUT` {{(pid=71939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 24 16:59:51.306622 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc185567-1b80-4692-a7a1-b10013a35ab4 admin admin] SCRIPT_NAME: `/identity` {{(pid=71939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 24 16:59:51.306960 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc185567-1b80-4692-a7a1-b10013a35ab4 admin admin] PATH_INFO: `/v3/projects/8f3dfdc3fec1451b8da166c2870f5e39/users/a18d72d9d9b4440b94be7c7ac1f49175/roles/912ab5f10fa5477da74acf239f07604e` {{(pid=71939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 24 16:59:51.328548 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc185567-1b80-4692-a7a1-b10013a35ab4 admin admin] RBAC: Authorizing `identity:create_grant(project_id=8f3dfdc3fec1451b8da166c2870f5e39, user_id=a18d72d9d9b4440b94be7c7ac1f49175, role_id=912ab5f10fa5477da74acf239f07604e)` {{(pid=71939) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:442}} Nov 24 16:59:51.360137 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc185567-1b80-4692-a7a1-b10013a35ab4 admin admin] RBAC: Authorization granted {{(pid=71939) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 24 16:59:51.373755 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: [pid: 71939|app: 0|req: 1325/2637] 10.222.0.53 () {60 vars in 1473 bytes} [Wed Nov 24 16:59:51 2021] PUT /identity/v3/projects/8f3dfdc3fec1451b8da166c2870f5e39/users/a18d72d9d9b4440b94be7c7ac1f49175/roles/912ab5f10fa5477da74acf239f07604e => generated 0 bytes in 84 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 24 16:59:51.385216 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6dab572-eb04-4671-9d3b-4f8a00e12d2d None None] REQUEST_METHOD: `POST` {{(pid=71938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 24 16:59:51.385563 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6dab572-eb04-4671-9d3b-4f8a00e12d2d None None] SCRIPT_NAME: `/identity` {{(pid=71938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 24 16:59:51.385897 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6dab572-eb04-4671-9d3b-4f8a00e12d2d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=71938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 24 16:59:51.424470 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.auth.core [None req-e6dab572-eb04-4671-9d3b-4f8a00e12d2d None None] MFA Rules not processed for user `a18d72d9d9b4440b94be7c7ac1f49175`. Rule list: `[]` (Enabled: `True`). {{(pid=71938) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:442}} Nov 24 16:59:51.425633 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.fernet_utils [None req-e6dab572-eb04-4671-9d3b-4f8a00e12d2d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=71938) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:289}} Nov 24 16:59:51.506205 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: [pid: 71938|app: 0|req: 1313/2638] 10.222.0.53 () {58 vars in 948 bytes} [Wed Nov 24 16:59:51 2021] POST /identity/v3/auth/tokens => generated 3676 bytes in 122 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 24 16:59:51.517652 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc185567-1b80-4692-a7a1-b10013a35ab4 admin admin] Authenticating user token {{(pid=71939) process_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 24 16:59:51.519473 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.fernet_utils [None req-cc185567-1b80-4692-a7a1-b10013a35ab4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=71939) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:289}} Nov 24 16:59:51.603430 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc185567-1b80-4692-a7a1-b10013a35ab4 admin admin] Validating token access rules against request {{(pid=71939) validate_allowed_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 24 16:59:51.608836 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cd5bef9-2dc9-4908-8e72-8a302c4c8806 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e196802d4d5432482b6d2eabc25f74e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3b3940d4ae1c4177ae29c02377bb4b0b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'service', 'ResellerAdmin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=71939) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 24 16:59:51.609496 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cd5bef9-2dc9-4908-8e72-8a302c4c8806 service nova] REQUEST_METHOD: `GET` {{(pid=71939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 24 16:59:51.609837 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cd5bef9-2dc9-4908-8e72-8a302c4c8806 service nova] SCRIPT_NAME: `/identity` {{(pid=71939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 24 16:59:51.610212 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cd5bef9-2dc9-4908-8e72-8a302c4c8806 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=71939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 24 16:59:51.618455 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cd5bef9-2dc9-4908-8e72-8a302c4c8806 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=71939) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:442}} Nov 24 16:59:51.646918 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cd5bef9-2dc9-4908-8e72-8a302c4c8806 service nova] RBAC: Authorization granted {{(pid=71939) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 24 16:59:51.655996 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: [pid: 71939|app: 0|req: 1326/2639] 10.222.0.53 () {60 vars in 1356 bytes} [Wed Nov 24 16:59:51 2021] GET /identity/v3/auth/tokens => generated 3676 bytes in 139 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 24 16:59:53.797940 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6dab572-eb04-4671-9d3b-4f8a00e12d2d None None] Authenticating user token {{(pid=71938) process_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 24 16:59:53.869438 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6dab572-eb04-4671-9d3b-4f8a00e12d2d None None] Validating token access rules against request {{(pid=71938) validate_allowed_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 24 16:59:53.874045 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe0f6b70-d668-4096-ac50-0ca6b7d30238 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f2ba2e8375b4e8c8792ee1e22b60427', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '00a5583c7b7443e98e7a1d31a0b638dc', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=71938) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 24 16:59:53.874951 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe0f6b70-d668-4096-ac50-0ca6b7d30238 admin admin] REQUEST_METHOD: `DELETE` {{(pid=71938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 24 16:59:53.875289 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe0f6b70-d668-4096-ac50-0ca6b7d30238 admin admin] SCRIPT_NAME: `/identity` {{(pid=71938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 24 16:59:53.875617 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe0f6b70-d668-4096-ac50-0ca6b7d30238 admin admin] PATH_INFO: `/v3/users/a18d72d9d9b4440b94be7c7ac1f49175` {{(pid=71938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 24 16:59:53.877411 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe0f6b70-d668-4096-ac50-0ca6b7d30238 admin admin] RBAC: Authorizing `identity:delete_user(user_id=a18d72d9d9b4440b94be7c7ac1f49175)` {{(pid=71938) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:442}} Nov 24 16:59:53.905670 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe0f6b70-d668-4096-ac50-0ca6b7d30238 admin admin] RBAC: Authorization granted {{(pid=71938) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 24 16:59:53.957539 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.notifications [None req-fe0f6b70-d668-4096-ac50-0ca6b7d30238 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a18d72d9d9b4440b94be7c7ac1f49175'} {{(pid=71938) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:357}} Nov 24 16:59:53.969828 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.notifications [None req-fe0f6b70-d668-4096-ac50-0ca6b7d30238 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a18d72d9d9b4440b94be7c7ac1f49175'} {{(pid=71938) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:357}} Nov 24 16:59:53.971059 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.notifications [None req-fe0f6b70-d668-4096-ac50-0ca6b7d30238 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a18d72d9d9b4440b94be7c7ac1f49175'} {{(pid=71938) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:357}} Nov 24 16:59:53.979211 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.notifications [None req-fe0f6b70-d668-4096-ac50-0ca6b7d30238 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a18d72d9d9b4440b94be7c7ac1f49175'} {{(pid=71938) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:357}} Nov 24 16:59:53.985045 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.notifications [None req-fe0f6b70-d668-4096-ac50-0ca6b7d30238 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a18d72d9d9b4440b94be7c7ac1f49175'} {{(pid=71938) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:357}} Nov 24 16:59:53.991913 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: [pid: 71938|app: 0|req: 1314/2640] 10.222.0.53 () {58 vars in 1214 bytes} [Wed Nov 24 16:59:53 2021] DELETE /identity/v3/users/a18d72d9d9b4440b94be7c7ac1f49175 => generated 0 bytes in 195 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 24 16:59:53.996779 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d26e8c0e-3172-448f-98ae-8100a5c6b852 None None] REQUEST_METHOD: `POST` {{(pid=71939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 24 16:59:53.997122 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d26e8c0e-3172-448f-98ae-8100a5c6b852 None None] SCRIPT_NAME: `/identity` {{(pid=71939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 24 16:59:53.997464 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d26e8c0e-3172-448f-98ae-8100a5c6b852 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=71939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 24 16:59:54.022018 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.auth.core [None req-d26e8c0e-3172-448f-98ae-8100a5c6b852 None None] MFA Rules not processed for user `0f2ba2e8375b4e8c8792ee1e22b60427`. Rule list: `[]` (Enabled: `True`). {{(pid=71939) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:442}} Nov 24 16:59:54.023283 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.fernet_utils [None req-d26e8c0e-3172-448f-98ae-8100a5c6b852 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=71939) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:289}} Nov 24 16:59:54.090261 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: [pid: 71939|app: 0|req: 1327/2641] 10.222.0.53 () {58 vars in 948 bytes} [Wed Nov 24 16:59:53 2021] POST /identity/v3/auth/tokens => generated 3669 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 24 16:59:54.101726 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe0f6b70-d668-4096-ac50-0ca6b7d30238 admin admin] Authenticating user token {{(pid=71938) process_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 24 16:59:54.103206 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.fernet_utils [None req-fe0f6b70-d668-4096-ac50-0ca6b7d30238 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=71938) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:289}} Nov 24 16:59:54.170885 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe0f6b70-d668-4096-ac50-0ca6b7d30238 admin admin] Validating token access rules against request {{(pid=71938) validate_allowed_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 24 16:59:54.175117 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48998452-afaf-47e3-adad-45e448d86568 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c90f21b9cdcb413282461fa83cb6b7a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3b3940d4ae1c4177ae29c02377bb4b0b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=71938) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 24 16:59:54.175783 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48998452-afaf-47e3-adad-45e448d86568 service neutron] REQUEST_METHOD: `GET` {{(pid=71938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 24 16:59:54.176124 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48998452-afaf-47e3-adad-45e448d86568 service neutron] SCRIPT_NAME: `/identity` {{(pid=71938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 24 16:59:54.176462 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48998452-afaf-47e3-adad-45e448d86568 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=71938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 24 16:59:54.186574 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48998452-afaf-47e3-adad-45e448d86568 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=71938) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:442}} Nov 24 16:59:54.214692 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48998452-afaf-47e3-adad-45e448d86568 service neutron] RBAC: Authorization granted {{(pid=71938) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 24 16:59:54.225419 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: [pid: 71938|app: 0|req: 1315/2642] 10.222.0.53 () {60 vars in 1356 bytes} [Wed Nov 24 16:59:54 2021] GET /identity/v3/auth/tokens => generated 3669 bytes in 124 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 24 16:59:54.589181 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d26e8c0e-3172-448f-98ae-8100a5c6b852 None None] Authenticating user token {{(pid=71939) process_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 24 16:59:54.590727 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.fernet_utils [None req-d26e8c0e-3172-448f-98ae-8100a5c6b852 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=71939) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:289}} Nov 24 16:59:54.603362 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d26e8c0e-3172-448f-98ae-8100a5c6b852 None None] Validating token access rules against request {{(pid=71939) validate_allowed_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 24 16:59:54.608560 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1fa1856-e5f6-48bf-8e66-7e8a679c61bd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f2ba2e8375b4e8c8792ee1e22b60427', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '00a5583c7b7443e98e7a1d31a0b638dc', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=71939) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 24 16:59:54.609544 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1fa1856-e5f6-48bf-8e66-7e8a679c61bd admin admin] REQUEST_METHOD: `DELETE` {{(pid=71939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 24 16:59:54.609829 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1fa1856-e5f6-48bf-8e66-7e8a679c61bd admin admin] SCRIPT_NAME: `/identity` {{(pid=71939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 24 16:59:54.610221 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1fa1856-e5f6-48bf-8e66-7e8a679c61bd admin admin] PATH_INFO: `/v3/projects/8f3dfdc3fec1451b8da166c2870f5e39` {{(pid=71939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 24 16:59:54.611446 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1fa1856-e5f6-48bf-8e66-7e8a679c61bd admin admin] RBAC: Authorizing `identity:delete_project(project_id=8f3dfdc3fec1451b8da166c2870f5e39)` {{(pid=71939) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:442}} Nov 24 16:59:54.639799 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1fa1856-e5f6-48bf-8e66-7e8a679c61bd admin admin] RBAC: Authorization granted {{(pid=71939) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 24 16:59:54.692197 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.notifications [None req-a1fa1856-e5f6-48bf-8e66-7e8a679c61bd admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '8f3dfdc3fec1451b8da166c2870f5e39', 'request_id': 'req-a1fa1856-e5f6-48bf-8e66-7e8a679c61bd'} {{(pid=71939) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:357}} Nov 24 16:59:54.704892 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.notifications [None req-a1fa1856-e5f6-48bf-8e66-7e8a679c61bd admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '8f3dfdc3fec1451b8da166c2870f5e39', 'request_id': 'req-a1fa1856-e5f6-48bf-8e66-7e8a679c61bd'} {{(pid=71939) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:357}} Nov 24 16:59:54.711781 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.notifications [None req-a1fa1856-e5f6-48bf-8e66-7e8a679c61bd admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '8f3dfdc3fec1451b8da166c2870f5e39', 'request_id': 'req-a1fa1856-e5f6-48bf-8e66-7e8a679c61bd'} {{(pid=71939) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:357}} Nov 24 16:59:54.722777 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.notifications [None req-a1fa1856-e5f6-48bf-8e66-7e8a679c61bd admin admin] The token cache is being invalidate because project 8f3dfdc3fec1451b8da166c2870f5e39 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=71939) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Nov 24 16:59:54.723111 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.notifications [None req-a1fa1856-e5f6-48bf-8e66-7e8a679c61bd admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=71939) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:357}} Nov 24 16:59:54.723782 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.notifications [None req-a1fa1856-e5f6-48bf-8e66-7e8a679c61bd admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=71939) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:357}} Nov 24 16:59:54.725349 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: [pid: 71939|app: 0|req: 1328/2643] 10.222.0.53 () {58 vars in 1223 bytes} [Wed Nov 24 16:59:54 2021] DELETE /identity/v3/projects/8f3dfdc3fec1451b8da166c2870f5e39 => generated 0 bytes in 137 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 24 16:59:54.731463 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b008bc13-c035-423d-bdaa-baec633d3ac1 None None] REQUEST_METHOD: `POST` {{(pid=71938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 24 16:59:54.731815 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b008bc13-c035-423d-bdaa-baec633d3ac1 None None] SCRIPT_NAME: `/identity` {{(pid=71938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 24 16:59:54.732161 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b008bc13-c035-423d-bdaa-baec633d3ac1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=71938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 24 16:59:54.756438 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.auth.core [None req-b008bc13-c035-423d-bdaa-baec633d3ac1 None None] MFA Rules not processed for user `0f2ba2e8375b4e8c8792ee1e22b60427`. Rule list: `[]` (Enabled: `True`). {{(pid=71938) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:442}} Nov 24 16:59:54.757655 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.fernet_utils [None req-b008bc13-c035-423d-bdaa-baec633d3ac1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=71938) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:289}} Nov 24 16:59:54.826895 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: [pid: 71938|app: 0|req: 1316/2644] 10.222.0.53 () {58 vars in 948 bytes} [Wed Nov 24 16:59:54 2021] POST /identity/v3/auth/tokens => generated 3669 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 24 16:59:54.836736 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a601175-f737-4683-be53-8fad44607f63 None None] REQUEST_METHOD: `POST` {{(pid=71939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 24 16:59:54.837077 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a601175-f737-4683-be53-8fad44607f63 None None] SCRIPT_NAME: `/identity` {{(pid=71939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 24 16:59:54.837413 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a601175-f737-4683-be53-8fad44607f63 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=71939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 24 16:59:54.860341 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.auth.core [None req-4a601175-f737-4683-be53-8fad44607f63 None None] MFA Rules not processed for user `0f2ba2e8375b4e8c8792ee1e22b60427`. Rule list: `[]` (Enabled: `True`). {{(pid=71939) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:442}} Nov 24 16:59:54.861548 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.fernet_utils [None req-4a601175-f737-4683-be53-8fad44607f63 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=71939) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:289}} Nov 24 16:59:54.868987 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: [pid: 71939|app: 0|req: 1329/2645] 10.222.0.53 () {58 vars in 948 bytes} [Wed Nov 24 16:59:54 2021] POST /identity/v3/auth/tokens => generated 3669 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 24 16:59:54.873326 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b008bc13-c035-423d-bdaa-baec633d3ac1 None None] Authenticating user token {{(pid=71938) process_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 24 16:59:54.883863 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b008bc13-c035-423d-bdaa-baec633d3ac1 None None] Validating token access rules against request {{(pid=71938) validate_allowed_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 24 16:59:54.888332 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9187c88-679d-4cb4-898c-2235f690cb47 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f2ba2e8375b4e8c8792ee1e22b60427', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '00a5583c7b7443e98e7a1d31a0b638dc', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=71938) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 24 16:59:54.889005 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9187c88-679d-4cb4-898c-2235f690cb47 admin admin] REQUEST_METHOD: `GET` {{(pid=71938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 24 16:59:54.889347 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9187c88-679d-4cb4-898c-2235f690cb47 admin admin] SCRIPT_NAME: `/identity` {{(pid=71938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 24 16:59:54.889683 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9187c88-679d-4cb4-898c-2235f690cb47 admin admin] PATH_INFO: `/v3/domains` {{(pid=71938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 24 16:59:54.890502 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9187c88-679d-4cb4-898c-2235f690cb47 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=71938) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:161}} Nov 24 16:59:54.890864 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9187c88-679d-4cb4-898c-2235f690cb47 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=71938) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:442}} Nov 24 16:59:54.919361 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9187c88-679d-4cb4-898c-2235f690cb47 admin admin] RBAC: Authorization granted {{(pid=71938) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 24 16:59:54.932789 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: [pid: 71938|app: 0|req: 1317/2646] 10.222.0.53 () {58 vars in 1143 bytes} [Wed Nov 24 16:59:54 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 60 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 24 16:59:54.937539 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a601175-f737-4683-be53-8fad44607f63 None None] Authenticating user token {{(pid=71939) process_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 24 16:59:54.947346 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a601175-f737-4683-be53-8fad44607f63 None None] Validating token access rules against request {{(pid=71939) validate_allowed_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 24 16:59:54.951958 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-712bb51a-c059-4a87-b0ea-bc74d30a2fe5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f2ba2e8375b4e8c8792ee1e22b60427', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '00a5583c7b7443e98e7a1d31a0b638dc', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=71939) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 24 16:59:54.952616 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-712bb51a-c059-4a87-b0ea-bc74d30a2fe5 admin admin] REQUEST_METHOD: `POST` {{(pid=71939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 24 16:59:54.952956 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-712bb51a-c059-4a87-b0ea-bc74d30a2fe5 admin admin] SCRIPT_NAME: `/identity` {{(pid=71939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 24 16:59:54.953288 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-712bb51a-c059-4a87-b0ea-bc74d30a2fe5 admin admin] PATH_INFO: `/v3/projects` {{(pid=71939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 24 16:59:54.954014 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-712bb51a-c059-4a87-b0ea-bc74d30a2fe5 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=71939) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:442}} Nov 24 16:59:54.982977 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-712bb51a-c059-4a87-b0ea-bc74d30a2fe5 admin admin] RBAC: Authorization granted {{(pid=71939) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 24 16:59:55.009796 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: [pid: 71939|app: 0|req: 1330/2647] 10.222.0.53 () {60 vars in 1143 bytes} [Wed Nov 24 16:59:54 2021] POST /identity/v3/projects => generated 373 bytes in 73 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 24 16:59:55.014269 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9187c88-679d-4cb4-898c-2235f690cb47 admin admin] Authenticating user token {{(pid=71938) process_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 24 16:59:55.025182 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9187c88-679d-4cb4-898c-2235f690cb47 admin admin] Validating token access rules against request {{(pid=71938) validate_allowed_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 24 16:59:55.090540 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b78a8bce-b5a2-4f32-b13c-a319b10a6024 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f2ba2e8375b4e8c8792ee1e22b60427', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '00a5583c7b7443e98e7a1d31a0b638dc', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=71938) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 24 16:59:55.091264 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b78a8bce-b5a2-4f32-b13c-a319b10a6024 admin admin] REQUEST_METHOD: `POST` {{(pid=71938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 24 16:59:55.091644 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b78a8bce-b5a2-4f32-b13c-a319b10a6024 admin admin] SCRIPT_NAME: `/identity` {{(pid=71938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 24 16:59:55.091983 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b78a8bce-b5a2-4f32-b13c-a319b10a6024 admin admin] PATH_INFO: `/v3/users` {{(pid=71938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 24 16:59:55.092713 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b78a8bce-b5a2-4f32-b13c-a319b10a6024 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=71938) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:442}} Nov 24 16:59:55.121636 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b78a8bce-b5a2-4f32-b13c-a319b10a6024 admin admin] RBAC: Authorization granted {{(pid=71938) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 24 16:59:55.144930 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: [pid: 71938|app: 0|req: 1318/2648] 10.222.0.53 () {60 vars in 1134 bytes} [Wed Nov 24 16:59:55 2021] POST /identity/v3/users => generated 287 bytes in 131 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 24 16:59:55.149257 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-712bb51a-c059-4a87-b0ea-bc74d30a2fe5 admin admin] Authenticating user token {{(pid=71939) process_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 24 16:59:55.160100 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-712bb51a-c059-4a87-b0ea-bc74d30a2fe5 admin admin] Validating token access rules against request {{(pid=71939) validate_allowed_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 24 16:59:55.164625 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50c25dfb-0899-4b84-b8bc-fe354f6c31bf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f2ba2e8375b4e8c8792ee1e22b60427', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '00a5583c7b7443e98e7a1d31a0b638dc', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=71939) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 24 16:59:55.165303 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50c25dfb-0899-4b84-b8bc-fe354f6c31bf admin admin] REQUEST_METHOD: `GET` {{(pid=71939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 24 16:59:55.165647 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50c25dfb-0899-4b84-b8bc-fe354f6c31bf admin admin] SCRIPT_NAME: `/identity` {{(pid=71939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 24 16:59:55.165986 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50c25dfb-0899-4b84-b8bc-fe354f6c31bf admin admin] PATH_INFO: `/v3/roles` {{(pid=71939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 24 16:59:55.166826 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50c25dfb-0899-4b84-b8bc-fe354f6c31bf admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=71939) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:442}} Nov 24 16:59:55.196121 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50c25dfb-0899-4b84-b8bc-fe354f6c31bf admin admin] RBAC: Authorization granted {{(pid=71939) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 24 16:59:55.207818 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: [pid: 71939|app: 0|req: 1331/2649] 10.222.0.53 () {58 vars in 1112 bytes} [Wed Nov 24 16:59:55 2021] GET /identity/v3/roles => generated 1420 bytes in 59 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 24 16:59:55.212017 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b78a8bce-b5a2-4f32-b13c-a319b10a6024 admin admin] Authenticating user token {{(pid=71938) process_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 24 16:59:55.222413 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b78a8bce-b5a2-4f32-b13c-a319b10a6024 admin admin] Validating token access rules against request {{(pid=71938) validate_allowed_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 24 16:59:55.227010 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbfddbf0-344a-4bc1-b838-3811f487227b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f2ba2e8375b4e8c8792ee1e22b60427', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '00a5583c7b7443e98e7a1d31a0b638dc', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=71938) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 24 16:59:55.227915 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbfddbf0-344a-4bc1-b838-3811f487227b admin admin] REQUEST_METHOD: `PUT` {{(pid=71938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 24 16:59:55.228257 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbfddbf0-344a-4bc1-b838-3811f487227b admin admin] SCRIPT_NAME: `/identity` {{(pid=71938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 24 16:59:55.228592 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbfddbf0-344a-4bc1-b838-3811f487227b admin admin] PATH_INFO: `/v3/projects/4d04ec27fd474779808ac05451eecefc/users/3f4b36099aec4558967e9c4927dfb48a/roles/912ab5f10fa5477da74acf239f07604e` {{(pid=71938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 24 16:59:55.250346 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbfddbf0-344a-4bc1-b838-3811f487227b admin admin] RBAC: Authorizing `identity:create_grant(project_id=4d04ec27fd474779808ac05451eecefc, user_id=3f4b36099aec4558967e9c4927dfb48a, role_id=912ab5f10fa5477da74acf239f07604e)` {{(pid=71938) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:442}} Nov 24 16:59:55.280199 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbfddbf0-344a-4bc1-b838-3811f487227b admin admin] RBAC: Authorization granted {{(pid=71938) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 24 16:59:55.292301 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: [pid: 71938|app: 0|req: 1319/2650] 10.222.0.53 () {60 vars in 1473 bytes} [Wed Nov 24 16:59:55 2021] PUT /identity/v3/projects/4d04ec27fd474779808ac05451eecefc/users/3f4b36099aec4558967e9c4927dfb48a/roles/912ab5f10fa5477da74acf239f07604e => generated 0 bytes in 81 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 24 16:59:55.303765 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a2d308b-5aea-46eb-ab09-a78a9d526120 None None] REQUEST_METHOD: `POST` {{(pid=71939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 24 16:59:55.304147 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a2d308b-5aea-46eb-ab09-a78a9d526120 None None] SCRIPT_NAME: `/identity` {{(pid=71939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 24 16:59:55.304490 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a2d308b-5aea-46eb-ab09-a78a9d526120 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=71939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 24 16:59:55.343435 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.auth.core [None req-4a2d308b-5aea-46eb-ab09-a78a9d526120 None None] MFA Rules not processed for user `3f4b36099aec4558967e9c4927dfb48a`. Rule list: `[]` (Enabled: `True`). {{(pid=71939) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:442}} Nov 24 16:59:55.344667 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.fernet_utils [None req-4a2d308b-5aea-46eb-ab09-a78a9d526120 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=71939) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:289}} Nov 24 16:59:55.425484 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: [pid: 71939|app: 0|req: 1332/2651] 10.222.0.53 () {58 vars in 948 bytes} [Wed Nov 24 16:59:55 2021] POST /identity/v3/auth/tokens => generated 3680 bytes in 123 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 24 16:59:55.432508 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbfddbf0-344a-4bc1-b838-3811f487227b admin admin] Authenticating user token {{(pid=71938) process_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 24 16:59:55.508654 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbfddbf0-344a-4bc1-b838-3811f487227b admin admin] Validating token access rules against request {{(pid=71938) validate_allowed_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 24 16:59:55.513295 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ea19156-3134-4196-ac21-840c9063d06a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f2ba2e8375b4e8c8792ee1e22b60427', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '00a5583c7b7443e98e7a1d31a0b638dc', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=71938) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 24 16:59:55.513972 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ea19156-3134-4196-ac21-840c9063d06a admin admin] REQUEST_METHOD: `POST` {{(pid=71938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 24 16:59:55.514344 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ea19156-3134-4196-ac21-840c9063d06a admin admin] SCRIPT_NAME: `/identity` {{(pid=71938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 24 16:59:55.514678 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ea19156-3134-4196-ac21-840c9063d06a admin admin] PATH_INFO: `/v3/projects` {{(pid=71938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 24 16:59:55.515410 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ea19156-3134-4196-ac21-840c9063d06a admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=71938) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:442}} Nov 24 16:59:55.544239 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ea19156-3134-4196-ac21-840c9063d06a admin admin] RBAC: Authorization granted {{(pid=71938) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 24 16:59:55.571072 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: [pid: 71938|app: 0|req: 1320/2652] 10.222.0.53 () {60 vars in 1143 bytes} [Wed Nov 24 16:59:55 2021] POST /identity/v3/projects => generated 373 bytes in 140 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 24 16:59:55.575470 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a2d308b-5aea-46eb-ab09-a78a9d526120 None None] Authenticating user token {{(pid=71939) process_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 24 16:59:55.586424 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a2d308b-5aea-46eb-ab09-a78a9d526120 None None] Validating token access rules against request {{(pid=71939) validate_allowed_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 24 16:59:55.654164 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-129a220e-6fc3-4c0f-bc31-e6d422c6f047 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f2ba2e8375b4e8c8792ee1e22b60427', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '00a5583c7b7443e98e7a1d31a0b638dc', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=71939) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 24 16:59:55.654853 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-129a220e-6fc3-4c0f-bc31-e6d422c6f047 admin admin] REQUEST_METHOD: `POST` {{(pid=71939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 24 16:59:55.655198 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-129a220e-6fc3-4c0f-bc31-e6d422c6f047 admin admin] SCRIPT_NAME: `/identity` {{(pid=71939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 24 16:59:55.655535 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-129a220e-6fc3-4c0f-bc31-e6d422c6f047 admin admin] PATH_INFO: `/v3/users` {{(pid=71939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 24 16:59:55.656270 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-129a220e-6fc3-4c0f-bc31-e6d422c6f047 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=71939) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:442}} Nov 24 16:59:55.686109 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-129a220e-6fc3-4c0f-bc31-e6d422c6f047 admin admin] RBAC: Authorization granted {{(pid=71939) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 24 16:59:55.705118 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: [pid: 71939|app: 0|req: 1333/2653] 10.222.0.53 () {60 vars in 1134 bytes} [Wed Nov 24 16:59:55 2021] POST /identity/v3/users => generated 293 bytes in 130 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 24 16:59:55.709555 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ea19156-3134-4196-ac21-840c9063d06a admin admin] Authenticating user token {{(pid=71938) process_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 24 16:59:55.720180 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ea19156-3134-4196-ac21-840c9063d06a admin admin] Validating token access rules against request {{(pid=71938) validate_allowed_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 24 16:59:55.725622 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1680d38a-0213-44b5-8712-35995d637fb5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f2ba2e8375b4e8c8792ee1e22b60427', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '00a5583c7b7443e98e7a1d31a0b638dc', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=71938) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 24 16:59:55.726411 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1680d38a-0213-44b5-8712-35995d637fb5 admin admin] REQUEST_METHOD: `GET` {{(pid=71938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 24 16:59:55.726832 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1680d38a-0213-44b5-8712-35995d637fb5 admin admin] SCRIPT_NAME: `/identity` {{(pid=71938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 24 16:59:55.727252 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1680d38a-0213-44b5-8712-35995d637fb5 admin admin] PATH_INFO: `/v3/roles` {{(pid=71938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 24 16:59:55.728133 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1680d38a-0213-44b5-8712-35995d637fb5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=71938) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:442}} Nov 24 16:59:55.758296 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1680d38a-0213-44b5-8712-35995d637fb5 admin admin] RBAC: Authorization granted {{(pid=71938) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 24 16:59:55.770782 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: [pid: 71938|app: 0|req: 1321/2654] 10.222.0.53 () {58 vars in 1112 bytes} [Wed Nov 24 16:59:55 2021] GET /identity/v3/roles => generated 1420 bytes in 62 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 24 16:59:55.775360 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-129a220e-6fc3-4c0f-bc31-e6d422c6f047 admin admin] Authenticating user token {{(pid=71939) process_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 24 16:59:55.786432 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-129a220e-6fc3-4c0f-bc31-e6d422c6f047 admin admin] Validating token access rules against request {{(pid=71939) validate_allowed_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 24 16:59:55.791369 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6caab57-1a02-46fc-9e94-88fbefa4397f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f2ba2e8375b4e8c8792ee1e22b60427', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '00a5583c7b7443e98e7a1d31a0b638dc', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=71939) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 24 16:59:55.792646 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6caab57-1a02-46fc-9e94-88fbefa4397f admin admin] REQUEST_METHOD: `PUT` {{(pid=71939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 24 16:59:55.792990 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6caab57-1a02-46fc-9e94-88fbefa4397f admin admin] SCRIPT_NAME: `/identity` {{(pid=71939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 24 16:59:55.793327 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6caab57-1a02-46fc-9e94-88fbefa4397f admin admin] PATH_INFO: `/v3/projects/d284b123320a446c93d243c6ad52266e/users/8b6c6caf116b41fbb60a62243545e550/roles/5611724e350b41e19921b5961a342582` {{(pid=71939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 24 16:59:55.817588 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6caab57-1a02-46fc-9e94-88fbefa4397f admin admin] RBAC: Authorizing `identity:create_grant(project_id=d284b123320a446c93d243c6ad52266e, user_id=8b6c6caf116b41fbb60a62243545e550, role_id=5611724e350b41e19921b5961a342582)` {{(pid=71939) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:442}} Nov 24 16:59:55.847762 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6caab57-1a02-46fc-9e94-88fbefa4397f admin admin] RBAC: Authorization granted {{(pid=71939) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 24 16:59:55.860321 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: [pid: 71939|app: 0|req: 1334/2655] 10.222.0.53 () {60 vars in 1473 bytes} [Wed Nov 24 16:59:55 2021] PUT /identity/v3/projects/d284b123320a446c93d243c6ad52266e/users/8b6c6caf116b41fbb60a62243545e550/roles/5611724e350b41e19921b5961a342582 => generated 0 bytes in 86 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 24 16:59:55.864560 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1680d38a-0213-44b5-8712-35995d637fb5 admin admin] Authenticating user token {{(pid=71938) process_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 24 16:59:55.874796 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1680d38a-0213-44b5-8712-35995d637fb5 admin admin] Validating token access rules against request {{(pid=71938) validate_allowed_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 24 16:59:55.940935 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-303ee325-1d9b-418b-be3d-22c0ea3a51dd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f2ba2e8375b4e8c8792ee1e22b60427', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '00a5583c7b7443e98e7a1d31a0b638dc', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=71938) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 24 16:59:55.941551 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-303ee325-1d9b-418b-be3d-22c0ea3a51dd admin admin] REQUEST_METHOD: `GET` {{(pid=71938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 24 16:59:55.941891 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-303ee325-1d9b-418b-be3d-22c0ea3a51dd admin admin] SCRIPT_NAME: `/identity` {{(pid=71938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 24 16:59:55.942255 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-303ee325-1d9b-418b-be3d-22c0ea3a51dd admin admin] PATH_INFO: `/v3/roles` {{(pid=71938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 24 16:59:55.943040 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-303ee325-1d9b-418b-be3d-22c0ea3a51dd admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=71938) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:442}} Nov 24 16:59:55.972192 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-303ee325-1d9b-418b-be3d-22c0ea3a51dd admin admin] RBAC: Authorization granted {{(pid=71938) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 24 16:59:55.982707 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: [pid: 71938|app: 0|req: 1322/2656] 10.222.0.53 () {58 vars in 1112 bytes} [Wed Nov 24 16:59:55 2021] GET /identity/v3/roles => generated 1420 bytes in 119 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 24 16:59:55.987095 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6caab57-1a02-46fc-9e94-88fbefa4397f admin admin] Authenticating user token {{(pid=71939) process_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 24 16:59:55.997418 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6caab57-1a02-46fc-9e94-88fbefa4397f admin admin] Validating token access rules against request {{(pid=71939) validate_allowed_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 24 16:59:56.001908 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dccb0bb-07ff-4eb0-91eb-48b56cf72f38 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f2ba2e8375b4e8c8792ee1e22b60427', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '00a5583c7b7443e98e7a1d31a0b638dc', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=71939) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 24 16:59:56.002850 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dccb0bb-07ff-4eb0-91eb-48b56cf72f38 admin admin] REQUEST_METHOD: `PUT` {{(pid=71939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 24 16:59:56.003192 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dccb0bb-07ff-4eb0-91eb-48b56cf72f38 admin admin] SCRIPT_NAME: `/identity` {{(pid=71939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 24 16:59:56.003526 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dccb0bb-07ff-4eb0-91eb-48b56cf72f38 admin admin] PATH_INFO: `/v3/projects/d284b123320a446c93d243c6ad52266e/users/8b6c6caf116b41fbb60a62243545e550/roles/5611724e350b41e19921b5961a342582` {{(pid=71939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 24 16:59:56.005510 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1dccb0bb-07ff-4eb0-91eb-48b56cf72f38 admin admin] RBAC: Authorizing `identity:create_grant(project_id=d284b123320a446c93d243c6ad52266e, user_id=8b6c6caf116b41fbb60a62243545e550, role_id=5611724e350b41e19921b5961a342582)` {{(pid=71939) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:442}} Nov 24 16:59:56.035388 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1dccb0bb-07ff-4eb0-91eb-48b56cf72f38 admin admin] RBAC: Authorization granted {{(pid=71939) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 24 16:59:56.045714 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: [pid: 71939|app: 0|req: 1335/2657] 10.222.0.53 () {60 vars in 1473 bytes} [Wed Nov 24 16:59:55 2021] PUT /identity/v3/projects/d284b123320a446c93d243c6ad52266e/users/8b6c6caf116b41fbb60a62243545e550/roles/5611724e350b41e19921b5961a342582 => generated 0 bytes in 59 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 24 16:59:56.049734 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-303ee325-1d9b-418b-be3d-22c0ea3a51dd admin admin] Authenticating user token {{(pid=71938) process_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 24 16:59:56.059983 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-303ee325-1d9b-418b-be3d-22c0ea3a51dd admin admin] Validating token access rules against request {{(pid=71938) validate_allowed_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 24 16:59:56.130650 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a4b2ae0-f3ca-4ed0-8700-50961cebb21b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f2ba2e8375b4e8c8792ee1e22b60427', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '00a5583c7b7443e98e7a1d31a0b638dc', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=71938) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 24 16:59:56.131332 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a4b2ae0-f3ca-4ed0-8700-50961cebb21b admin admin] REQUEST_METHOD: `GET` {{(pid=71938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 24 16:59:56.131675 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a4b2ae0-f3ca-4ed0-8700-50961cebb21b admin admin] SCRIPT_NAME: `/identity` {{(pid=71938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 24 16:59:56.132007 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a4b2ae0-f3ca-4ed0-8700-50961cebb21b admin admin] PATH_INFO: `/v3/roles` {{(pid=71938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 24 16:59:56.132798 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a4b2ae0-f3ca-4ed0-8700-50961cebb21b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=71938) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:442}} Nov 24 16:59:56.162288 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a4b2ae0-f3ca-4ed0-8700-50961cebb21b admin admin] RBAC: Authorization granted {{(pid=71938) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 24 16:59:56.173055 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: [pid: 71938|app: 0|req: 1323/2658] 10.222.0.53 () {58 vars in 1112 bytes} [Wed Nov 24 16:59:56 2021] GET /identity/v3/roles => generated 1420 bytes in 124 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 24 16:59:56.177647 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dccb0bb-07ff-4eb0-91eb-48b56cf72f38 admin admin] Authenticating user token {{(pid=71939) process_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 24 16:59:56.188446 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dccb0bb-07ff-4eb0-91eb-48b56cf72f38 admin admin] Validating token access rules against request {{(pid=71939) validate_allowed_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 24 16:59:56.193636 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a6b690e-db08-4c89-9cb4-f8ff9eafc68e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f2ba2e8375b4e8c8792ee1e22b60427', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '00a5583c7b7443e98e7a1d31a0b638dc', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=71939) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 24 16:59:56.194514 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a6b690e-db08-4c89-9cb4-f8ff9eafc68e admin admin] REQUEST_METHOD: `PUT` {{(pid=71939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 24 16:59:56.194852 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a6b690e-db08-4c89-9cb4-f8ff9eafc68e admin admin] SCRIPT_NAME: `/identity` {{(pid=71939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 24 16:59:56.195186 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a6b690e-db08-4c89-9cb4-f8ff9eafc68e admin admin] PATH_INFO: `/v3/projects/d284b123320a446c93d243c6ad52266e/users/8b6c6caf116b41fbb60a62243545e550/roles/912ab5f10fa5477da74acf239f07604e` {{(pid=71939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 24 16:59:56.197229 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a6b690e-db08-4c89-9cb4-f8ff9eafc68e admin admin] RBAC: Authorizing `identity:create_grant(project_id=d284b123320a446c93d243c6ad52266e, user_id=8b6c6caf116b41fbb60a62243545e550, role_id=912ab5f10fa5477da74acf239f07604e)` {{(pid=71939) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:442}} Nov 24 16:59:56.226809 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a6b690e-db08-4c89-9cb4-f8ff9eafc68e admin admin] RBAC: Authorization granted {{(pid=71939) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 24 16:59:56.240048 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: [pid: 71939|app: 0|req: 1336/2659] 10.222.0.53 () {60 vars in 1473 bytes} [Wed Nov 24 16:59:56 2021] PUT /identity/v3/projects/d284b123320a446c93d243c6ad52266e/users/8b6c6caf116b41fbb60a62243545e550/roles/912ab5f10fa5477da74acf239f07604e => generated 0 bytes in 63 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 24 16:59:56.251151 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf40f60f-d5dc-4dff-8035-5af49999ea4b None None] REQUEST_METHOD: `POST` {{(pid=71938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 24 16:59:56.251506 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf40f60f-d5dc-4dff-8035-5af49999ea4b None None] SCRIPT_NAME: `/identity` {{(pid=71938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 24 16:59:56.252345 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf40f60f-d5dc-4dff-8035-5af49999ea4b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=71938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 24 16:59:56.292291 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.auth.core [None req-bf40f60f-d5dc-4dff-8035-5af49999ea4b None None] MFA Rules not processed for user `8b6c6caf116b41fbb60a62243545e550`. Rule list: `[]` (Enabled: `True`). {{(pid=71938) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:442}} Nov 24 16:59:56.293534 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.fernet_utils [None req-bf40f60f-d5dc-4dff-8035-5af49999ea4b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=71938) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:289}} Nov 24 16:59:56.374190 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: [pid: 71938|app: 0|req: 1324/2660] 10.222.0.53 () {58 vars in 948 bytes} [Wed Nov 24 16:59:56 2021] POST /identity/v3/auth/tokens => generated 3747 bytes in 124 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 24 16:59:56.386804 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a6b690e-db08-4c89-9cb4-f8ff9eafc68e admin admin] Authenticating user token {{(pid=71939) process_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 24 16:59:56.388574 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.fernet_utils [None req-3a6b690e-db08-4c89-9cb4-f8ff9eafc68e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=71939) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:289}} Nov 24 16:59:56.455870 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a6b690e-db08-4c89-9cb4-f8ff9eafc68e admin admin] Validating token access rules against request {{(pid=71939) validate_allowed_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 24 16:59:56.459758 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8928c7e8-90fb-4104-8a29-e64c5b718fcf service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a12374a3093a401a97c343ff0854184d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3b3940d4ae1c4177ae29c02377bb4b0b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=71939) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 24 16:59:56.460417 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8928c7e8-90fb-4104-8a29-e64c5b718fcf service cinder] REQUEST_METHOD: `GET` {{(pid=71939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 24 16:59:56.460756 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8928c7e8-90fb-4104-8a29-e64c5b718fcf service cinder] SCRIPT_NAME: `/identity` {{(pid=71939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 24 16:59:56.461090 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8928c7e8-90fb-4104-8a29-e64c5b718fcf service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=71939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 24 16:59:56.470731 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8928c7e8-90fb-4104-8a29-e64c5b718fcf service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=71939) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:442}} Nov 24 16:59:56.498334 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8928c7e8-90fb-4104-8a29-e64c5b718fcf service cinder] RBAC: Authorization granted {{(pid=71939) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 24 16:59:56.508477 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: [pid: 71939|app: 0|req: 1337/2661] 10.222.0.53 () {60 vars in 1356 bytes} [Wed Nov 24 16:59:56 2021] GET /identity/v3/auth/tokens => generated 3747 bytes in 122 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 24 16:59:56.612833 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf40f60f-d5dc-4dff-8035-5af49999ea4b None None] Authenticating user token {{(pid=71938) process_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 24 16:59:56.622878 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf40f60f-d5dc-4dff-8035-5af49999ea4b None None] Validating token access rules against request {{(pid=71938) validate_allowed_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 24 16:59:56.626543 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c7cb95c-927e-4427-bdfa-55e269cb74d0 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a12374a3093a401a97c343ff0854184d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3b3940d4ae1c4177ae29c02377bb4b0b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=71938) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 24 16:59:56.627779 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c7cb95c-927e-4427-bdfa-55e269cb74d0 service cinder] REQUEST_METHOD: `GET` {{(pid=71938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 24 16:59:56.628093 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c7cb95c-927e-4427-bdfa-55e269cb74d0 service cinder] SCRIPT_NAME: `/identity` {{(pid=71938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 24 16:59:56.628425 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c7cb95c-927e-4427-bdfa-55e269cb74d0 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=71938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 24 16:59:56.695512 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c7cb95c-927e-4427-bdfa-55e269cb74d0 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=71938) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:442}} Nov 24 16:59:56.723403 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c7cb95c-927e-4427-bdfa-55e269cb74d0 service cinder] RBAC: Authorization granted {{(pid=71938) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 24 16:59:56.732458 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: [pid: 71938|app: 0|req: 1325/2662] 10.222.0.53 () {60 vars in 1356 bytes} [Wed Nov 24 16:59:56 2021] GET /identity/v3/auth/tokens => generated 3680 bytes in 120 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 24 17:00:13.335129 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8928c7e8-90fb-4104-8a29-e64c5b718fcf service cinder] Authenticating user token {{(pid=71939) process_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 24 17:00:13.348762 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8928c7e8-90fb-4104-8a29-e64c5b718fcf service cinder] Validating token access rules against request {{(pid=71939) validate_allowed_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 24 17:00:13.352616 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2596e27-e438-41f3-898e-ef283ed6d3aa service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a12374a3093a401a97c343ff0854184d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3b3940d4ae1c4177ae29c02377bb4b0b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=71939) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 24 17:00:13.353264 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2596e27-e438-41f3-898e-ef283ed6d3aa service cinder] REQUEST_METHOD: `GET` {{(pid=71939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 24 17:00:13.353602 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2596e27-e438-41f3-898e-ef283ed6d3aa service cinder] SCRIPT_NAME: `/identity` {{(pid=71939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 24 17:00:13.353932 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2596e27-e438-41f3-898e-ef283ed6d3aa service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=71939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 24 17:00:13.355764 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.fernet_utils [None req-a2596e27-e438-41f3-898e-ef283ed6d3aa service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=71939) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:289}} Nov 24 17:00:13.450407 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2596e27-e438-41f3-898e-ef283ed6d3aa service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=71939) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:442}} Nov 24 17:00:13.479088 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2596e27-e438-41f3-898e-ef283ed6d3aa service cinder] RBAC: Authorization granted {{(pid=71939) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 24 17:00:13.489750 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: [pid: 71939|app: 0|req: 1338/2663] 10.222.0.53 () {60 vars in 1356 bytes} [Wed Nov 24 17:00:13 2021] GET /identity/v3/auth/tokens => generated 3692 bytes in 155 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 24 17:00:38.265019 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c7cb95c-927e-4427-bdfa-55e269cb74d0 service cinder] Authenticating user token {{(pid=71938) process_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 24 17:00:38.385885 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c7cb95c-927e-4427-bdfa-55e269cb74d0 service cinder] Validating token access rules against request {{(pid=71938) validate_allowed_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 24 17:00:38.390517 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee12bc2c-efc4-4106-863f-aa164910c7b1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f2ba2e8375b4e8c8792ee1e22b60427', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '00a5583c7b7443e98e7a1d31a0b638dc', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=71938) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 24 17:00:38.391404 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee12bc2c-efc4-4106-863f-aa164910c7b1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=71938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 24 17:00:38.391739 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee12bc2c-efc4-4106-863f-aa164910c7b1 admin admin] SCRIPT_NAME: `/identity` {{(pid=71938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 24 17:00:38.392064 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee12bc2c-efc4-4106-863f-aa164910c7b1 admin admin] PATH_INFO: `/v3/users/3f4b36099aec4558967e9c4927dfb48a` {{(pid=71938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 24 17:00:38.393284 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee12bc2c-efc4-4106-863f-aa164910c7b1 admin admin] RBAC: Authorizing `identity:delete_user(user_id=3f4b36099aec4558967e9c4927dfb48a)` {{(pid=71938) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:442}} Nov 24 17:00:38.422739 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee12bc2c-efc4-4106-863f-aa164910c7b1 admin admin] RBAC: Authorization granted {{(pid=71938) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 24 17:00:38.470288 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.notifications [None req-ee12bc2c-efc4-4106-863f-aa164910c7b1 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '3f4b36099aec4558967e9c4927dfb48a'} {{(pid=71938) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:357}} Nov 24 17:00:38.482902 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.notifications [None req-ee12bc2c-efc4-4106-863f-aa164910c7b1 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '3f4b36099aec4558967e9c4927dfb48a'} {{(pid=71938) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:357}} Nov 24 17:00:38.483599 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.notifications [None req-ee12bc2c-efc4-4106-863f-aa164910c7b1 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '3f4b36099aec4558967e9c4927dfb48a'} {{(pid=71938) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:357}} Nov 24 17:00:38.491664 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.notifications [None req-ee12bc2c-efc4-4106-863f-aa164910c7b1 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '3f4b36099aec4558967e9c4927dfb48a'} {{(pid=71938) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:357}} Nov 24 17:00:38.497966 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.notifications [None req-ee12bc2c-efc4-4106-863f-aa164910c7b1 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '3f4b36099aec4558967e9c4927dfb48a'} {{(pid=71938) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:357}} Nov 24 17:00:38.504105 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: [pid: 71938|app: 0|req: 1326/2664] 10.222.0.53 () {58 vars in 1214 bytes} [Wed Nov 24 17:00:38 2021] DELETE /identity/v3/users/3f4b36099aec4558967e9c4927dfb48a => generated 0 bytes in 240 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 24 17:00:38.509053 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21745602-2f57-4b6e-b02a-2376561990eb None None] REQUEST_METHOD: `POST` {{(pid=71939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 24 17:00:38.509415 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21745602-2f57-4b6e-b02a-2376561990eb None None] SCRIPT_NAME: `/identity` {{(pid=71939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 24 17:00:38.509796 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21745602-2f57-4b6e-b02a-2376561990eb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=71939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 24 17:00:38.565535 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.auth.core [None req-21745602-2f57-4b6e-b02a-2376561990eb None None] MFA Rules not processed for user `0f2ba2e8375b4e8c8792ee1e22b60427`. Rule list: `[]` (Enabled: `True`). {{(pid=71939) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:442}} Nov 24 17:00:38.566798 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.fernet_utils [None req-21745602-2f57-4b6e-b02a-2376561990eb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=71939) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:289}} Nov 24 17:00:38.635305 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: [pid: 71939|app: 0|req: 1339/2665] 10.222.0.53 () {58 vars in 948 bytes} [Wed Nov 24 17:00:38 2021] POST /identity/v3/auth/tokens => generated 3669 bytes in 127 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 24 17:00:38.646698 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee12bc2c-efc4-4106-863f-aa164910c7b1 admin admin] Authenticating user token {{(pid=71938) process_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 24 17:00:38.648169 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.fernet_utils [None req-ee12bc2c-efc4-4106-863f-aa164910c7b1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=71938) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:289}} Nov 24 17:00:38.767408 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee12bc2c-efc4-4106-863f-aa164910c7b1 admin admin] Validating token access rules against request {{(pid=71938) validate_allowed_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 24 17:00:38.771094 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48aa5796-ca7e-4452-811a-5bfc94f559e8 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c90f21b9cdcb413282461fa83cb6b7a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3b3940d4ae1c4177ae29c02377bb4b0b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=71938) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 24 17:00:38.771758 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48aa5796-ca7e-4452-811a-5bfc94f559e8 service neutron] REQUEST_METHOD: `GET` {{(pid=71938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 24 17:00:38.772100 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48aa5796-ca7e-4452-811a-5bfc94f559e8 service neutron] SCRIPT_NAME: `/identity` {{(pid=71938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 24 17:00:38.772435 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48aa5796-ca7e-4452-811a-5bfc94f559e8 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=71938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 24 17:00:38.782064 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48aa5796-ca7e-4452-811a-5bfc94f559e8 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=71938) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:442}} Nov 24 17:00:38.810865 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48aa5796-ca7e-4452-811a-5bfc94f559e8 service neutron] RBAC: Authorization granted {{(pid=71938) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 24 17:00:38.820980 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: [pid: 71938|app: 0|req: 1327/2666] 10.222.0.53 () {60 vars in 1356 bytes} [Wed Nov 24 17:00:38 2021] GET /identity/v3/auth/tokens => generated 3669 bytes in 175 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 24 17:00:39.185021 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21745602-2f57-4b6e-b02a-2376561990eb None None] Authenticating user token {{(pid=71939) process_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 24 17:00:39.186644 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.fernet_utils [None req-21745602-2f57-4b6e-b02a-2376561990eb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=71939) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:289}} Nov 24 17:00:39.198429 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21745602-2f57-4b6e-b02a-2376561990eb None None] Validating token access rules against request {{(pid=71939) validate_allowed_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 24 17:00:39.203559 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c7b15c7-3c95-4a77-b844-fd07d9456af9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f2ba2e8375b4e8c8792ee1e22b60427', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '00a5583c7b7443e98e7a1d31a0b638dc', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=71939) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 24 17:00:39.204557 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c7b15c7-3c95-4a77-b844-fd07d9456af9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=71939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 24 17:00:39.204968 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c7b15c7-3c95-4a77-b844-fd07d9456af9 admin admin] SCRIPT_NAME: `/identity` {{(pid=71939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 24 17:00:39.205368 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c7b15c7-3c95-4a77-b844-fd07d9456af9 admin admin] PATH_INFO: `/v3/projects/4d04ec27fd474779808ac05451eecefc` {{(pid=71939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 24 17:00:39.206588 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c7b15c7-3c95-4a77-b844-fd07d9456af9 admin admin] RBAC: Authorizing `identity:delete_project(project_id=4d04ec27fd474779808ac05451eecefc)` {{(pid=71939) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:442}} Nov 24 17:00:39.235437 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c7b15c7-3c95-4a77-b844-fd07d9456af9 admin admin] RBAC: Authorization granted {{(pid=71939) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 24 17:00:39.285432 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.notifications [None req-1c7b15c7-3c95-4a77-b844-fd07d9456af9 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '4d04ec27fd474779808ac05451eecefc', 'request_id': 'req-1c7b15c7-3c95-4a77-b844-fd07d9456af9'} {{(pid=71939) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:357}} Nov 24 17:00:39.297605 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.notifications [None req-1c7b15c7-3c95-4a77-b844-fd07d9456af9 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '4d04ec27fd474779808ac05451eecefc', 'request_id': 'req-1c7b15c7-3c95-4a77-b844-fd07d9456af9'} {{(pid=71939) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:357}} Nov 24 17:00:39.303478 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.notifications [None req-1c7b15c7-3c95-4a77-b844-fd07d9456af9 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '4d04ec27fd474779808ac05451eecefc', 'request_id': 'req-1c7b15c7-3c95-4a77-b844-fd07d9456af9'} {{(pid=71939) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:357}} Nov 24 17:00:39.314496 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.notifications [None req-1c7b15c7-3c95-4a77-b844-fd07d9456af9 admin admin] The token cache is being invalidate because project 4d04ec27fd474779808ac05451eecefc was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=71939) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Nov 24 17:00:39.314823 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.notifications [None req-1c7b15c7-3c95-4a77-b844-fd07d9456af9 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=71939) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:357}} Nov 24 17:00:39.315479 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.notifications [None req-1c7b15c7-3c95-4a77-b844-fd07d9456af9 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=71939) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:357}} Nov 24 17:00:39.316990 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: [pid: 71939|app: 0|req: 1340/2667] 10.222.0.53 () {58 vars in 1223 bytes} [Wed Nov 24 17:00:39 2021] DELETE /identity/v3/projects/4d04ec27fd474779808ac05451eecefc => generated 0 bytes in 133 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 24 17:00:39.321318 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48aa5796-ca7e-4452-811a-5bfc94f559e8 service neutron] Authenticating user token {{(pid=71938) process_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 24 17:00:39.331949 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48aa5796-ca7e-4452-811a-5bfc94f559e8 service neutron] Validating token access rules against request {{(pid=71938) validate_allowed_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 24 17:00:39.472313 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1b2cb81-13b8-47a1-a79e-c297bf3f48cb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f2ba2e8375b4e8c8792ee1e22b60427', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '00a5583c7b7443e98e7a1d31a0b638dc', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=71938) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 24 17:00:39.473197 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1b2cb81-13b8-47a1-a79e-c297bf3f48cb admin admin] REQUEST_METHOD: `DELETE` {{(pid=71938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 24 17:00:39.473543 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1b2cb81-13b8-47a1-a79e-c297bf3f48cb admin admin] SCRIPT_NAME: `/identity` {{(pid=71938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 24 17:00:39.473879 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1b2cb81-13b8-47a1-a79e-c297bf3f48cb admin admin] PATH_INFO: `/v3/users/8b6c6caf116b41fbb60a62243545e550` {{(pid=71938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 24 17:00:39.475136 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1b2cb81-13b8-47a1-a79e-c297bf3f48cb admin admin] RBAC: Authorizing `identity:delete_user(user_id=8b6c6caf116b41fbb60a62243545e550)` {{(pid=71938) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:442}} Nov 24 17:00:39.504077 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1b2cb81-13b8-47a1-a79e-c297bf3f48cb admin admin] RBAC: Authorization granted {{(pid=71938) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 24 17:00:39.551075 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.notifications [None req-a1b2cb81-13b8-47a1-a79e-c297bf3f48cb admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '8b6c6caf116b41fbb60a62243545e550'} {{(pid=71938) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:357}} Nov 24 17:00:39.563490 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.notifications [None req-a1b2cb81-13b8-47a1-a79e-c297bf3f48cb admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '8b6c6caf116b41fbb60a62243545e550'} {{(pid=71938) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:357}} Nov 24 17:00:39.564188 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.notifications [None req-a1b2cb81-13b8-47a1-a79e-c297bf3f48cb admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '8b6c6caf116b41fbb60a62243545e550'} {{(pid=71938) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:357}} Nov 24 17:00:39.572438 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.notifications [None req-a1b2cb81-13b8-47a1-a79e-c297bf3f48cb admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '8b6c6caf116b41fbb60a62243545e550'} {{(pid=71938) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:357}} Nov 24 17:00:39.578474 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.notifications [None req-a1b2cb81-13b8-47a1-a79e-c297bf3f48cb admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '8b6c6caf116b41fbb60a62243545e550'} {{(pid=71938) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:357}} Nov 24 17:00:39.584692 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: [pid: 71938|app: 0|req: 1328/2668] 10.222.0.53 () {58 vars in 1214 bytes} [Wed Nov 24 17:00:39 2021] DELETE /identity/v3/users/8b6c6caf116b41fbb60a62243545e550 => generated 0 bytes in 264 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 24 17:00:39.949275 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c7b15c7-3c95-4a77-b844-fd07d9456af9 admin admin] Authenticating user token {{(pid=71939) process_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 24 17:00:39.950804 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.fernet_utils [None req-1c7b15c7-3c95-4a77-b844-fd07d9456af9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=71939) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:289}} Nov 24 17:00:39.964123 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c7b15c7-3c95-4a77-b844-fd07d9456af9 admin admin] Validating token access rules against request {{(pid=71939) validate_allowed_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 24 17:00:40.031246 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d38624c-28ca-4a10-8ff5-1cf38a68cd52 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f2ba2e8375b4e8c8792ee1e22b60427', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '00a5583c7b7443e98e7a1d31a0b638dc', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=71939) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 24 17:00:40.032059 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d38624c-28ca-4a10-8ff5-1cf38a68cd52 admin admin] REQUEST_METHOD: `DELETE` {{(pid=71939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 24 17:00:40.032406 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d38624c-28ca-4a10-8ff5-1cf38a68cd52 admin admin] SCRIPT_NAME: `/identity` {{(pid=71939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 24 17:00:40.032740 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d38624c-28ca-4a10-8ff5-1cf38a68cd52 admin admin] PATH_INFO: `/v3/projects/d284b123320a446c93d243c6ad52266e` {{(pid=71939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 24 17:00:40.033973 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d38624c-28ca-4a10-8ff5-1cf38a68cd52 admin admin] RBAC: Authorizing `identity:delete_project(project_id=d284b123320a446c93d243c6ad52266e)` {{(pid=71939) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:442}} Nov 24 17:00:40.062516 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d38624c-28ca-4a10-8ff5-1cf38a68cd52 admin admin] RBAC: Authorization granted {{(pid=71939) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 24 17:00:40.112739 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.notifications [None req-7d38624c-28ca-4a10-8ff5-1cf38a68cd52 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd284b123320a446c93d243c6ad52266e', 'request_id': 'req-7d38624c-28ca-4a10-8ff5-1cf38a68cd52'} {{(pid=71939) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:357}} Nov 24 17:00:40.124510 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.notifications [None req-7d38624c-28ca-4a10-8ff5-1cf38a68cd52 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd284b123320a446c93d243c6ad52266e', 'request_id': 'req-7d38624c-28ca-4a10-8ff5-1cf38a68cd52'} {{(pid=71939) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:357}} Nov 24 17:00:40.130441 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.notifications [None req-7d38624c-28ca-4a10-8ff5-1cf38a68cd52 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd284b123320a446c93d243c6ad52266e', 'request_id': 'req-7d38624c-28ca-4a10-8ff5-1cf38a68cd52'} {{(pid=71939) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:357}} Nov 24 17:00:40.141579 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.notifications [None req-7d38624c-28ca-4a10-8ff5-1cf38a68cd52 admin admin] The token cache is being invalidate because project d284b123320a446c93d243c6ad52266e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=71939) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Nov 24 17:00:40.141912 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.notifications [None req-7d38624c-28ca-4a10-8ff5-1cf38a68cd52 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=71939) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:357}} Nov 24 17:00:40.142622 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.notifications [None req-7d38624c-28ca-4a10-8ff5-1cf38a68cd52 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=71939) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:357}} Nov 24 17:00:40.144164 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: [pid: 71939|app: 0|req: 1341/2669] 10.222.0.53 () {58 vars in 1223 bytes} [Wed Nov 24 17:00:39 2021] DELETE /identity/v3/projects/d284b123320a446c93d243c6ad52266e => generated 0 bytes in 196 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 24 17:00:40.150260 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bc5f57b-a4e8-4bbd-a4ae-b352dadd115d None None] REQUEST_METHOD: `POST` {{(pid=71938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 24 17:00:40.150611 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bc5f57b-a4e8-4bbd-a4ae-b352dadd115d None None] SCRIPT_NAME: `/identity` {{(pid=71938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 24 17:00:40.150955 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bc5f57b-a4e8-4bbd-a4ae-b352dadd115d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=71938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 24 17:00:40.213202 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.auth.core [None req-6bc5f57b-a4e8-4bbd-a4ae-b352dadd115d None None] MFA Rules not processed for user `0f2ba2e8375b4e8c8792ee1e22b60427`. Rule list: `[]` (Enabled: `True`). {{(pid=71938) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:442}} Nov 24 17:00:40.215059 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.fernet_utils [None req-6bc5f57b-a4e8-4bbd-a4ae-b352dadd115d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=71938) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:289}} Nov 24 17:00:40.283093 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: [pid: 71938|app: 0|req: 1329/2670] 10.222.0.53 () {58 vars in 948 bytes} [Wed Nov 24 17:00:40 2021] POST /identity/v3/auth/tokens => generated 3669 bytes in 134 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 24 17:00:40.291899 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c85a8fff-34a2-4019-9772-4f8eafce1f73 None None] REQUEST_METHOD: `POST` {{(pid=71939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 24 17:00:40.292951 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c85a8fff-34a2-4019-9772-4f8eafce1f73 None None] SCRIPT_NAME: `/identity` {{(pid=71939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 24 17:00:40.293132 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c85a8fff-34a2-4019-9772-4f8eafce1f73 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=71939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 24 17:00:40.316494 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.auth.core [None req-c85a8fff-34a2-4019-9772-4f8eafce1f73 None None] MFA Rules not processed for user `0f2ba2e8375b4e8c8792ee1e22b60427`. Rule list: `[]` (Enabled: `True`). {{(pid=71939) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:442}} Nov 24 17:00:40.317702 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.fernet_utils [None req-c85a8fff-34a2-4019-9772-4f8eafce1f73 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=71939) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:289}} Nov 24 17:00:40.325066 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: [pid: 71939|app: 0|req: 1342/2671] 10.222.0.53 () {58 vars in 948 bytes} [Wed Nov 24 17:00:40 2021] POST /identity/v3/auth/tokens => generated 3669 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 24 17:00:40.329761 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bc5f57b-a4e8-4bbd-a4ae-b352dadd115d None None] Authenticating user token {{(pid=71938) process_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 24 17:00:40.340122 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bc5f57b-a4e8-4bbd-a4ae-b352dadd115d None None] Validating token access rules against request {{(pid=71938) validate_allowed_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 24 17:00:40.344671 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4e653f4-e219-4915-bd2b-be376ebd703a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f2ba2e8375b4e8c8792ee1e22b60427', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '00a5583c7b7443e98e7a1d31a0b638dc', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=71938) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 24 17:00:40.345341 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4e653f4-e219-4915-bd2b-be376ebd703a admin admin] REQUEST_METHOD: `GET` {{(pid=71938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 24 17:00:40.345682 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4e653f4-e219-4915-bd2b-be376ebd703a admin admin] SCRIPT_NAME: `/identity` {{(pid=71938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 24 17:00:40.346014 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4e653f4-e219-4915-bd2b-be376ebd703a admin admin] PATH_INFO: `/v3/domains` {{(pid=71938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 24 17:00:40.346844 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4e653f4-e219-4915-bd2b-be376ebd703a admin admin] RBAC: Adding query filter params (name=Default) {{(pid=71938) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:161}} Nov 24 17:00:40.347199 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4e653f4-e219-4915-bd2b-be376ebd703a admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=71938) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:442}} Nov 24 17:00:40.376026 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4e653f4-e219-4915-bd2b-be376ebd703a admin admin] RBAC: Authorization granted {{(pid=71938) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 24 17:00:40.389420 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: [pid: 71938|app: 0|req: 1330/2672] 10.222.0.53 () {58 vars in 1143 bytes} [Wed Nov 24 17:00:40 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 60 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 24 17:00:40.393998 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c85a8fff-34a2-4019-9772-4f8eafce1f73 None None] Authenticating user token {{(pid=71939) process_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 24 17:00:40.403927 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c85a8fff-34a2-4019-9772-4f8eafce1f73 None None] Validating token access rules against request {{(pid=71939) validate_allowed_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 24 17:00:40.408457 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e7f18d3-b0e8-4ebf-b145-7b28ffbe066c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f2ba2e8375b4e8c8792ee1e22b60427', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '00a5583c7b7443e98e7a1d31a0b638dc', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=71939) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 24 17:00:40.409157 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e7f18d3-b0e8-4ebf-b145-7b28ffbe066c admin admin] REQUEST_METHOD: `POST` {{(pid=71939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 24 17:00:40.409496 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e7f18d3-b0e8-4ebf-b145-7b28ffbe066c admin admin] SCRIPT_NAME: `/identity` {{(pid=71939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 24 17:00:40.409827 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e7f18d3-b0e8-4ebf-b145-7b28ffbe066c admin admin] PATH_INFO: `/v3/projects` {{(pid=71939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 24 17:00:40.410595 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e7f18d3-b0e8-4ebf-b145-7b28ffbe066c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=71939) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:442}} Nov 24 17:00:40.439599 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e7f18d3-b0e8-4ebf-b145-7b28ffbe066c admin admin] RBAC: Authorization granted {{(pid=71939) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 24 17:00:40.465836 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: [pid: 71939|app: 0|req: 1343/2673] 10.222.0.53 () {60 vars in 1143 bytes} [Wed Nov 24 17:00:40 2021] POST /identity/v3/projects => generated 389 bytes in 72 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 24 17:00:40.470153 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4e653f4-e219-4915-bd2b-be376ebd703a admin admin] Authenticating user token {{(pid=71938) process_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 24 17:00:40.481040 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4e653f4-e219-4915-bd2b-be376ebd703a admin admin] Validating token access rules against request {{(pid=71938) validate_allowed_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 24 17:00:40.545687 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d16c17ba-35e3-4948-b696-ef36b0bbf0db admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f2ba2e8375b4e8c8792ee1e22b60427', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '00a5583c7b7443e98e7a1d31a0b638dc', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=71938) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 24 17:00:40.546333 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d16c17ba-35e3-4948-b696-ef36b0bbf0db admin admin] REQUEST_METHOD: `POST` {{(pid=71938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 24 17:00:40.546674 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d16c17ba-35e3-4948-b696-ef36b0bbf0db admin admin] SCRIPT_NAME: `/identity` {{(pid=71938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 24 17:00:40.547005 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d16c17ba-35e3-4948-b696-ef36b0bbf0db admin admin] PATH_INFO: `/v3/users` {{(pid=71938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 24 17:00:40.547729 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d16c17ba-35e3-4948-b696-ef36b0bbf0db admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=71938) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:442}} Nov 24 17:00:40.576907 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d16c17ba-35e3-4948-b696-ef36b0bbf0db admin admin] RBAC: Authorization granted {{(pid=71938) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 24 17:00:40.595445 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: [pid: 71938|app: 0|req: 1331/2674] 10.222.0.53 () {60 vars in 1134 bytes} [Wed Nov 24 17:00:40 2021] POST /identity/v3/users => generated 295 bytes in 126 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Nov 24 17:00:40.599813 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e7f18d3-b0e8-4ebf-b145-7b28ffbe066c admin admin] Authenticating user token {{(pid=71939) process_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 24 17:00:40.610130 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e7f18d3-b0e8-4ebf-b145-7b28ffbe066c admin admin] Validating token access rules against request {{(pid=71939) validate_allowed_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 24 17:00:40.614680 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07ce5830-4da5-4bac-852c-7224d7f5e8a2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f2ba2e8375b4e8c8792ee1e22b60427', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '00a5583c7b7443e98e7a1d31a0b638dc', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=71939) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 24 17:00:40.615352 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07ce5830-4da5-4bac-852c-7224d7f5e8a2 admin admin] REQUEST_METHOD: `GET` {{(pid=71939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 24 17:00:40.615695 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07ce5830-4da5-4bac-852c-7224d7f5e8a2 admin admin] SCRIPT_NAME: `/identity` {{(pid=71939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 24 17:00:40.616029 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07ce5830-4da5-4bac-852c-7224d7f5e8a2 admin admin] PATH_INFO: `/v3/roles` {{(pid=71939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 24 17:00:40.616812 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07ce5830-4da5-4bac-852c-7224d7f5e8a2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=71939) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:442}} Nov 24 17:00:40.645237 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07ce5830-4da5-4bac-852c-7224d7f5e8a2 admin admin] RBAC: Authorization granted {{(pid=71939) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 24 17:00:40.656527 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: [pid: 71939|app: 0|req: 1344/2675] 10.222.0.53 () {58 vars in 1112 bytes} [Wed Nov 24 17:00:40 2021] GET /identity/v3/roles => generated 1420 bytes in 57 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 24 17:00:40.660746 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d16c17ba-35e3-4948-b696-ef36b0bbf0db admin admin] Authenticating user token {{(pid=71938) process_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 24 17:00:40.670939 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d16c17ba-35e3-4948-b696-ef36b0bbf0db admin admin] Validating token access rules against request {{(pid=71938) validate_allowed_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 24 17:00:40.675513 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d55b351f-7aa2-4418-a320-c5e116ab59f5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f2ba2e8375b4e8c8792ee1e22b60427', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '00a5583c7b7443e98e7a1d31a0b638dc', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=71938) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 24 17:00:40.676412 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d55b351f-7aa2-4418-a320-c5e116ab59f5 admin admin] REQUEST_METHOD: `PUT` {{(pid=71938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 24 17:00:40.676757 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d55b351f-7aa2-4418-a320-c5e116ab59f5 admin admin] SCRIPT_NAME: `/identity` {{(pid=71938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 24 17:00:40.677095 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d55b351f-7aa2-4418-a320-c5e116ab59f5 admin admin] PATH_INFO: `/v3/projects/71a155cc696c491688838950c97d3fc4/users/b9f78602ac1d4fdd8a1d4169060d4b8c/roles/912ab5f10fa5477da74acf239f07604e` {{(pid=71938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 24 17:00:40.697996 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d55b351f-7aa2-4418-a320-c5e116ab59f5 admin admin] RBAC: Authorizing `identity:create_grant(project_id=71a155cc696c491688838950c97d3fc4, user_id=b9f78602ac1d4fdd8a1d4169060d4b8c, role_id=912ab5f10fa5477da74acf239f07604e)` {{(pid=71938) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:442}} Nov 24 17:00:40.728500 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d55b351f-7aa2-4418-a320-c5e116ab59f5 admin admin] RBAC: Authorization granted {{(pid=71938) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 24 17:00:40.740602 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: [pid: 71938|app: 0|req: 1332/2676] 10.222.0.53 () {60 vars in 1473 bytes} [Wed Nov 24 17:00:40 2021] PUT /identity/v3/projects/71a155cc696c491688838950c97d3fc4/users/b9f78602ac1d4fdd8a1d4169060d4b8c/roles/912ab5f10fa5477da74acf239f07604e => generated 0 bytes in 80 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 24 17:00:40.752094 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3f8e172-e15b-47aa-ae73-3eeae696e3c0 None None] REQUEST_METHOD: `POST` {{(pid=71939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 24 17:00:40.752448 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3f8e172-e15b-47aa-ae73-3eeae696e3c0 None None] SCRIPT_NAME: `/identity` {{(pid=71939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 24 17:00:40.752786 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3f8e172-e15b-47aa-ae73-3eeae696e3c0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=71939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 24 17:00:40.790892 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.auth.core [None req-b3f8e172-e15b-47aa-ae73-3eeae696e3c0 None None] MFA Rules not processed for user `b9f78602ac1d4fdd8a1d4169060d4b8c`. Rule list: `[]` (Enabled: `True`). {{(pid=71939) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:442}} Nov 24 17:00:40.792138 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.fernet_utils [None req-b3f8e172-e15b-47aa-ae73-3eeae696e3c0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=71939) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:289}} Nov 24 17:00:40.867800 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: [pid: 71939|app: 0|req: 1345/2677] 10.222.0.53 () {58 vars in 948 bytes} [Wed Nov 24 17:00:40 2021] POST /identity/v3/auth/tokens => generated 3696 bytes in 117 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 24 17:00:40.872567 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d55b351f-7aa2-4418-a320-c5e116ab59f5 admin admin] Authenticating user token {{(pid=71938) process_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 24 17:00:40.948083 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d55b351f-7aa2-4418-a320-c5e116ab59f5 admin admin] Validating token access rules against request {{(pid=71938) validate_allowed_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 24 17:00:40.953221 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ec5881e-26a6-4030-b126-25113ef0fc80 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f2ba2e8375b4e8c8792ee1e22b60427', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '00a5583c7b7443e98e7a1d31a0b638dc', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=71938) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 24 17:00:40.953903 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ec5881e-26a6-4030-b126-25113ef0fc80 admin admin] REQUEST_METHOD: `POST` {{(pid=71938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 24 17:00:40.954271 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ec5881e-26a6-4030-b126-25113ef0fc80 admin admin] SCRIPT_NAME: `/identity` {{(pid=71938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 24 17:00:40.954606 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ec5881e-26a6-4030-b126-25113ef0fc80 admin admin] PATH_INFO: `/v3/projects` {{(pid=71938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 24 17:00:40.955335 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ec5881e-26a6-4030-b126-25113ef0fc80 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=71938) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:442}} Nov 24 17:00:40.984325 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ec5881e-26a6-4030-b126-25113ef0fc80 admin admin] RBAC: Authorization granted {{(pid=71938) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 24 17:00:41.010849 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: [pid: 71938|app: 0|req: 1333/2678] 10.222.0.53 () {60 vars in 1143 bytes} [Wed Nov 24 17:00:40 2021] POST /identity/v3/projects => generated 389 bytes in 139 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 24 17:00:41.015841 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3f8e172-e15b-47aa-ae73-3eeae696e3c0 None None] Authenticating user token {{(pid=71939) process_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 24 17:00:41.035364 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3f8e172-e15b-47aa-ae73-3eeae696e3c0 None None] Validating token access rules against request {{(pid=71939) validate_allowed_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 24 17:00:41.094305 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ced2f643-0360-4aea-829c-4579cf539ae9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f2ba2e8375b4e8c8792ee1e22b60427', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '00a5583c7b7443e98e7a1d31a0b638dc', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=71939) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 24 17:00:41.094988 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ced2f643-0360-4aea-829c-4579cf539ae9 admin admin] REQUEST_METHOD: `POST` {{(pid=71939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 24 17:00:41.095328 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ced2f643-0360-4aea-829c-4579cf539ae9 admin admin] SCRIPT_NAME: `/identity` {{(pid=71939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 24 17:00:41.095660 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ced2f643-0360-4aea-829c-4579cf539ae9 admin admin] PATH_INFO: `/v3/users` {{(pid=71939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 24 17:00:41.096390 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ced2f643-0360-4aea-829c-4579cf539ae9 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=71939) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:442}} Nov 24 17:00:41.125209 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ced2f643-0360-4aea-829c-4579cf539ae9 admin admin] RBAC: Authorization granted {{(pid=71939) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 24 17:00:41.146793 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: [pid: 71939|app: 0|req: 1346/2679] 10.222.0.53 () {60 vars in 1134 bytes} [Wed Nov 24 17:00:41 2021] POST /identity/v3/users => generated 301 bytes in 131 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 24 17:00:41.151248 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ec5881e-26a6-4030-b126-25113ef0fc80 admin admin] Authenticating user token {{(pid=71938) process_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 24 17:00:41.162067 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ec5881e-26a6-4030-b126-25113ef0fc80 admin admin] Validating token access rules against request {{(pid=71938) validate_allowed_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 24 17:00:41.166714 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-467185b7-91f2-4551-9de9-9bd300bf9b02 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f2ba2e8375b4e8c8792ee1e22b60427', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '00a5583c7b7443e98e7a1d31a0b638dc', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=71938) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 24 17:00:41.167432 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-467185b7-91f2-4551-9de9-9bd300bf9b02 admin admin] REQUEST_METHOD: `GET` {{(pid=71938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 24 17:00:41.167774 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-467185b7-91f2-4551-9de9-9bd300bf9b02 admin admin] SCRIPT_NAME: `/identity` {{(pid=71938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 24 17:00:41.168147 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-467185b7-91f2-4551-9de9-9bd300bf9b02 admin admin] PATH_INFO: `/v3/roles` {{(pid=71938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 24 17:00:41.168968 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-467185b7-91f2-4551-9de9-9bd300bf9b02 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=71938) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:442}} Nov 24 17:00:41.197716 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-467185b7-91f2-4551-9de9-9bd300bf9b02 admin admin] RBAC: Authorization granted {{(pid=71938) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 24 17:00:41.210434 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: [pid: 71938|app: 0|req: 1334/2680] 10.222.0.53 () {58 vars in 1112 bytes} [Wed Nov 24 17:00:41 2021] GET /identity/v3/roles => generated 1420 bytes in 60 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 24 17:00:41.214952 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ced2f643-0360-4aea-829c-4579cf539ae9 admin admin] Authenticating user token {{(pid=71939) process_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 24 17:00:41.225053 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ced2f643-0360-4aea-829c-4579cf539ae9 admin admin] Validating token access rules against request {{(pid=71939) validate_allowed_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 24 17:00:41.229598 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-493e002c-c4b2-4965-8a01-1ec8f44e9756 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f2ba2e8375b4e8c8792ee1e22b60427', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '00a5583c7b7443e98e7a1d31a0b638dc', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=71939) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 24 17:00:41.230520 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-493e002c-c4b2-4965-8a01-1ec8f44e9756 admin admin] REQUEST_METHOD: `PUT` {{(pid=71939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 24 17:00:41.230859 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-493e002c-c4b2-4965-8a01-1ec8f44e9756 admin admin] SCRIPT_NAME: `/identity` {{(pid=71939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 24 17:00:41.231188 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-493e002c-c4b2-4965-8a01-1ec8f44e9756 admin admin] PATH_INFO: `/v3/projects/8ec70741acb94619b20132b14ef4f7b0/users/b9cbf381a6744923b4e11160fa2cccf0/roles/5611724e350b41e19921b5961a342582` {{(pid=71939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 24 17:00:41.252268 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-493e002c-c4b2-4965-8a01-1ec8f44e9756 admin admin] RBAC: Authorizing `identity:create_grant(project_id=8ec70741acb94619b20132b14ef4f7b0, user_id=b9cbf381a6744923b4e11160fa2cccf0, role_id=5611724e350b41e19921b5961a342582)` {{(pid=71939) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:442}} Nov 24 17:00:41.281723 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-493e002c-c4b2-4965-8a01-1ec8f44e9756 admin admin] RBAC: Authorization granted {{(pid=71939) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 24 17:00:41.294611 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: [pid: 71939|app: 0|req: 1347/2681] 10.222.0.53 () {60 vars in 1473 bytes} [Wed Nov 24 17:00:41 2021] PUT /identity/v3/projects/8ec70741acb94619b20132b14ef4f7b0/users/b9cbf381a6744923b4e11160fa2cccf0/roles/5611724e350b41e19921b5961a342582 => generated 0 bytes in 80 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 24 17:00:41.298922 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-467185b7-91f2-4551-9de9-9bd300bf9b02 admin admin] Authenticating user token {{(pid=71938) process_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 24 17:00:41.309840 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-467185b7-91f2-4551-9de9-9bd300bf9b02 admin admin] Validating token access rules against request {{(pid=71938) validate_allowed_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 24 17:00:41.376385 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51654d65-9fbf-4c85-a687-19cd2ee405bd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f2ba2e8375b4e8c8792ee1e22b60427', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '00a5583c7b7443e98e7a1d31a0b638dc', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=71938) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 24 17:00:41.377066 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51654d65-9fbf-4c85-a687-19cd2ee405bd admin admin] REQUEST_METHOD: `GET` {{(pid=71938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 24 17:00:41.377404 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51654d65-9fbf-4c85-a687-19cd2ee405bd admin admin] SCRIPT_NAME: `/identity` {{(pid=71938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 24 17:00:41.377737 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51654d65-9fbf-4c85-a687-19cd2ee405bd admin admin] PATH_INFO: `/v3/roles` {{(pid=71938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 24 17:00:41.378552 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51654d65-9fbf-4c85-a687-19cd2ee405bd admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=71938) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:442}} Nov 24 17:00:41.406375 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51654d65-9fbf-4c85-a687-19cd2ee405bd admin admin] RBAC: Authorization granted {{(pid=71938) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 24 17:00:41.417183 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: [pid: 71938|app: 0|req: 1335/2682] 10.222.0.53 () {58 vars in 1112 bytes} [Wed Nov 24 17:00:41 2021] GET /identity/v3/roles => generated 1420 bytes in 119 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 24 17:00:41.422016 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-493e002c-c4b2-4965-8a01-1ec8f44e9756 admin admin] Authenticating user token {{(pid=71939) process_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 24 17:00:41.432394 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-493e002c-c4b2-4965-8a01-1ec8f44e9756 admin admin] Validating token access rules against request {{(pid=71939) validate_allowed_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 24 17:00:41.437769 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec10038b-ef71-4edb-b2e8-52e3e0e97ed8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f2ba2e8375b4e8c8792ee1e22b60427', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '00a5583c7b7443e98e7a1d31a0b638dc', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=71939) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 24 17:00:41.438690 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec10038b-ef71-4edb-b2e8-52e3e0e97ed8 admin admin] REQUEST_METHOD: `PUT` {{(pid=71939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 24 17:00:41.439029 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec10038b-ef71-4edb-b2e8-52e3e0e97ed8 admin admin] SCRIPT_NAME: `/identity` {{(pid=71939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 24 17:00:41.439366 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec10038b-ef71-4edb-b2e8-52e3e0e97ed8 admin admin] PATH_INFO: `/v3/projects/8ec70741acb94619b20132b14ef4f7b0/users/b9cbf381a6744923b4e11160fa2cccf0/roles/5611724e350b41e19921b5961a342582` {{(pid=71939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 24 17:00:41.441331 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec10038b-ef71-4edb-b2e8-52e3e0e97ed8 admin admin] RBAC: Authorizing `identity:create_grant(project_id=8ec70741acb94619b20132b14ef4f7b0, user_id=b9cbf381a6744923b4e11160fa2cccf0, role_id=5611724e350b41e19921b5961a342582)` {{(pid=71939) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:442}} Nov 24 17:00:41.470806 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec10038b-ef71-4edb-b2e8-52e3e0e97ed8 admin admin] RBAC: Authorization granted {{(pid=71939) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 24 17:00:41.482505 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: [pid: 71939|app: 0|req: 1348/2683] 10.222.0.53 () {60 vars in 1473 bytes} [Wed Nov 24 17:00:41 2021] PUT /identity/v3/projects/8ec70741acb94619b20132b14ef4f7b0/users/b9cbf381a6744923b4e11160fa2cccf0/roles/5611724e350b41e19921b5961a342582 => generated 0 bytes in 61 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 24 17:00:41.486712 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51654d65-9fbf-4c85-a687-19cd2ee405bd admin admin] Authenticating user token {{(pid=71938) process_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 24 17:00:41.497323 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51654d65-9fbf-4c85-a687-19cd2ee405bd admin admin] Validating token access rules against request {{(pid=71938) validate_allowed_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 24 17:00:41.563821 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b6d9d05-bb3b-4b85-a2f8-97ba263867fd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f2ba2e8375b4e8c8792ee1e22b60427', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '00a5583c7b7443e98e7a1d31a0b638dc', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=71938) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 24 17:00:41.564492 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b6d9d05-bb3b-4b85-a2f8-97ba263867fd admin admin] REQUEST_METHOD: `GET` {{(pid=71938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 24 17:00:41.564836 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b6d9d05-bb3b-4b85-a2f8-97ba263867fd admin admin] SCRIPT_NAME: `/identity` {{(pid=71938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 24 17:00:41.565167 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b6d9d05-bb3b-4b85-a2f8-97ba263867fd admin admin] PATH_INFO: `/v3/roles` {{(pid=71938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 24 17:00:41.565952 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b6d9d05-bb3b-4b85-a2f8-97ba263867fd admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=71938) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:442}} Nov 24 17:00:41.593878 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b6d9d05-bb3b-4b85-a2f8-97ba263867fd admin admin] RBAC: Authorization granted {{(pid=71938) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 24 17:00:41.604486 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: [pid: 71938|app: 0|req: 1336/2684] 10.222.0.53 () {58 vars in 1112 bytes} [Wed Nov 24 17:00:41 2021] GET /identity/v3/roles => generated 1420 bytes in 118 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 24 17:00:41.609397 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec10038b-ef71-4edb-b2e8-52e3e0e97ed8 admin admin] Authenticating user token {{(pid=71939) process_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 24 17:00:41.619681 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec10038b-ef71-4edb-b2e8-52e3e0e97ed8 admin admin] Validating token access rules against request {{(pid=71939) validate_allowed_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 24 17:00:41.624836 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffffe5c1-dd07-45d2-9692-f9fd3d3a0265 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f2ba2e8375b4e8c8792ee1e22b60427', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '00a5583c7b7443e98e7a1d31a0b638dc', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=71939) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 24 17:00:41.625724 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffffe5c1-dd07-45d2-9692-f9fd3d3a0265 admin admin] REQUEST_METHOD: `PUT` {{(pid=71939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 24 17:00:41.626080 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffffe5c1-dd07-45d2-9692-f9fd3d3a0265 admin admin] SCRIPT_NAME: `/identity` {{(pid=71939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 24 17:00:41.626466 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffffe5c1-dd07-45d2-9692-f9fd3d3a0265 admin admin] PATH_INFO: `/v3/projects/8ec70741acb94619b20132b14ef4f7b0/users/b9cbf381a6744923b4e11160fa2cccf0/roles/912ab5f10fa5477da74acf239f07604e` {{(pid=71939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 24 17:00:41.628387 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffffe5c1-dd07-45d2-9692-f9fd3d3a0265 admin admin] RBAC: Authorizing `identity:create_grant(project_id=8ec70741acb94619b20132b14ef4f7b0, user_id=b9cbf381a6744923b4e11160fa2cccf0, role_id=912ab5f10fa5477da74acf239f07604e)` {{(pid=71939) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:442}} Nov 24 17:00:41.657179 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffffe5c1-dd07-45d2-9692-f9fd3d3a0265 admin admin] RBAC: Authorization granted {{(pid=71939) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 24 17:00:41.670122 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: [pid: 71939|app: 0|req: 1349/2685] 10.222.0.53 () {60 vars in 1473 bytes} [Wed Nov 24 17:00:41 2021] PUT /identity/v3/projects/8ec70741acb94619b20132b14ef4f7b0/users/b9cbf381a6744923b4e11160fa2cccf0/roles/912ab5f10fa5477da74acf239f07604e => generated 0 bytes in 61 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 24 17:00:41.680818 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a08677f2-3e12-4934-9d3a-759327cec712 None None] REQUEST_METHOD: `POST` {{(pid=71938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 24 17:00:41.681157 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a08677f2-3e12-4934-9d3a-759327cec712 None None] SCRIPT_NAME: `/identity` {{(pid=71938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 24 17:00:41.681495 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a08677f2-3e12-4934-9d3a-759327cec712 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=71938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 24 17:00:41.721354 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.auth.core [None req-a08677f2-3e12-4934-9d3a-759327cec712 None None] MFA Rules not processed for user `b9cbf381a6744923b4e11160fa2cccf0`. Rule list: `[]` (Enabled: `True`). {{(pid=71938) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:442}} Nov 24 17:00:41.723034 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.fernet_utils [None req-a08677f2-3e12-4934-9d3a-759327cec712 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=71938) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:289}} Nov 24 17:00:41.804637 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: [pid: 71938|app: 0|req: 1337/2686] 10.222.0.53 () {58 vars in 948 bytes} [Wed Nov 24 17:00:41 2021] POST /identity/v3/auth/tokens => generated 3763 bytes in 125 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 24 17:00:41.815014 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffffe5c1-dd07-45d2-9692-f9fd3d3a0265 admin admin] Authenticating user token {{(pid=71939) process_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 24 17:00:41.816750 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.fernet_utils [None req-ffffe5c1-dd07-45d2-9692-f9fd3d3a0265 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=71939) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:289}} Nov 24 17:00:41.883772 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffffe5c1-dd07-45d2-9692-f9fd3d3a0265 admin admin] Validating token access rules against request {{(pid=71939) validate_allowed_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 24 17:00:41.887440 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cda013b-1f79-4426-b5a6-355fbd9ebadb service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a12374a3093a401a97c343ff0854184d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3b3940d4ae1c4177ae29c02377bb4b0b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=71939) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 24 17:00:41.888095 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cda013b-1f79-4426-b5a6-355fbd9ebadb service cinder] REQUEST_METHOD: `GET` {{(pid=71939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 24 17:00:41.888440 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cda013b-1f79-4426-b5a6-355fbd9ebadb service cinder] SCRIPT_NAME: `/identity` {{(pid=71939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 24 17:00:41.888774 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cda013b-1f79-4426-b5a6-355fbd9ebadb service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=71939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 24 17:00:41.898113 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cda013b-1f79-4426-b5a6-355fbd9ebadb service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=71939) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:442}} Nov 24 17:00:41.926717 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cda013b-1f79-4426-b5a6-355fbd9ebadb service cinder] RBAC: Authorization granted {{(pid=71939) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 24 17:00:41.936562 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: [pid: 71939|app: 0|req: 1350/2687] 10.222.0.53 () {60 vars in 1356 bytes} [Wed Nov 24 17:00:41 2021] GET /identity/v3/auth/tokens => generated 3763 bytes in 122 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 24 17:00:42.063692 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a08677f2-3e12-4934-9d3a-759327cec712 None None] Authenticating user token {{(pid=71938) process_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 24 17:00:42.144099 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a08677f2-3e12-4934-9d3a-759327cec712 None None] Validating token access rules against request {{(pid=71938) validate_allowed_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 24 17:00:42.148613 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5169bb9d-9866-41ec-8d4b-3c26e4c6976f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f2ba2e8375b4e8c8792ee1e22b60427', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '00a5583c7b7443e98e7a1d31a0b638dc', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=71938) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 24 17:00:42.149520 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5169bb9d-9866-41ec-8d4b-3c26e4c6976f admin admin] REQUEST_METHOD: `DELETE` {{(pid=71938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 24 17:00:42.149846 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5169bb9d-9866-41ec-8d4b-3c26e4c6976f admin admin] SCRIPT_NAME: `/identity` {{(pid=71938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 24 17:00:42.150215 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5169bb9d-9866-41ec-8d4b-3c26e4c6976f admin admin] PATH_INFO: `/v3/users/b9f78602ac1d4fdd8a1d4169060d4b8c` {{(pid=71938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 24 17:00:42.151439 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5169bb9d-9866-41ec-8d4b-3c26e4c6976f admin admin] RBAC: Authorizing `identity:delete_user(user_id=b9f78602ac1d4fdd8a1d4169060d4b8c)` {{(pid=71938) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:442}} Nov 24 17:00:42.180475 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5169bb9d-9866-41ec-8d4b-3c26e4c6976f admin admin] RBAC: Authorization granted {{(pid=71938) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 24 17:00:42.229257 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.notifications [None req-5169bb9d-9866-41ec-8d4b-3c26e4c6976f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b9f78602ac1d4fdd8a1d4169060d4b8c'} {{(pid=71938) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:357}} Nov 24 17:00:42.241524 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.notifications [None req-5169bb9d-9866-41ec-8d4b-3c26e4c6976f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b9f78602ac1d4fdd8a1d4169060d4b8c'} {{(pid=71938) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:357}} Nov 24 17:00:42.242282 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.notifications [None req-5169bb9d-9866-41ec-8d4b-3c26e4c6976f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b9f78602ac1d4fdd8a1d4169060d4b8c'} {{(pid=71938) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:357}} Nov 24 17:00:42.250432 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.notifications [None req-5169bb9d-9866-41ec-8d4b-3c26e4c6976f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b9f78602ac1d4fdd8a1d4169060d4b8c'} {{(pid=71938) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:357}} Nov 24 17:00:42.256293 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.notifications [None req-5169bb9d-9866-41ec-8d4b-3c26e4c6976f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b9f78602ac1d4fdd8a1d4169060d4b8c'} {{(pid=71938) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:357}} Nov 24 17:00:42.263063 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: [pid: 71938|app: 0|req: 1338/2688] 10.222.0.53 () {58 vars in 1214 bytes} [Wed Nov 24 17:00:42 2021] DELETE /identity/v3/users/b9f78602ac1d4fdd8a1d4169060d4b8c => generated 0 bytes in 200 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 24 17:00:42.268086 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b39f0176-5650-4058-8fb8-045352096361 None None] REQUEST_METHOD: `POST` {{(pid=71939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 24 17:00:42.268437 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b39f0176-5650-4058-8fb8-045352096361 None None] SCRIPT_NAME: `/identity` {{(pid=71939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 24 17:00:42.268781 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b39f0176-5650-4058-8fb8-045352096361 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=71939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 24 17:00:42.292429 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.auth.core [None req-b39f0176-5650-4058-8fb8-045352096361 None None] MFA Rules not processed for user `0f2ba2e8375b4e8c8792ee1e22b60427`. Rule list: `[]` (Enabled: `True`). {{(pid=71939) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:442}} Nov 24 17:00:42.293664 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.fernet_utils [None req-b39f0176-5650-4058-8fb8-045352096361 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=71939) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:289}} Nov 24 17:00:42.366521 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: [pid: 71939|app: 0|req: 1351/2689] 10.222.0.53 () {58 vars in 948 bytes} [Wed Nov 24 17:00:42 2021] POST /identity/v3/auth/tokens => generated 3669 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 24 17:00:42.381935 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5169bb9d-9866-41ec-8d4b-3c26e4c6976f admin admin] Authenticating user token {{(pid=71938) process_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 24 17:00:42.383421 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.fernet_utils [None req-5169bb9d-9866-41ec-8d4b-3c26e4c6976f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=71938) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:289}} Nov 24 17:00:42.451318 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5169bb9d-9866-41ec-8d4b-3c26e4c6976f admin admin] Validating token access rules against request {{(pid=71938) validate_allowed_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 24 17:00:42.454957 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33d9a82e-0e47-4dac-90ff-e3e58084727d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c90f21b9cdcb413282461fa83cb6b7a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3b3940d4ae1c4177ae29c02377bb4b0b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=71938) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 24 17:00:42.455666 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33d9a82e-0e47-4dac-90ff-e3e58084727d service neutron] REQUEST_METHOD: `GET` {{(pid=71938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 24 17:00:42.456005 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33d9a82e-0e47-4dac-90ff-e3e58084727d service neutron] SCRIPT_NAME: `/identity` {{(pid=71938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 24 17:00:42.456347 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33d9a82e-0e47-4dac-90ff-e3e58084727d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=71938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 24 17:00:42.466781 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33d9a82e-0e47-4dac-90ff-e3e58084727d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=71938) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:442}} Nov 24 17:00:42.494630 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33d9a82e-0e47-4dac-90ff-e3e58084727d service neutron] RBAC: Authorization granted {{(pid=71938) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 24 17:00:42.504936 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: [pid: 71938|app: 0|req: 1339/2690] 10.222.0.53 () {60 vars in 1356 bytes} [Wed Nov 24 17:00:42 2021] GET /identity/v3/auth/tokens => generated 3669 bytes in 124 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 24 17:00:42.860856 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b39f0176-5650-4058-8fb8-045352096361 None None] Authenticating user token {{(pid=71939) process_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 24 17:00:42.862369 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.fernet_utils [None req-b39f0176-5650-4058-8fb8-045352096361 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=71939) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:289}} Nov 24 17:00:42.874788 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b39f0176-5650-4058-8fb8-045352096361 None None] Validating token access rules against request {{(pid=71939) validate_allowed_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 24 17:00:42.879669 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-011dd02e-38a4-4d43-91a6-d1d8055d33df admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f2ba2e8375b4e8c8792ee1e22b60427', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '00a5583c7b7443e98e7a1d31a0b638dc', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=71939) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 24 17:00:42.880630 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-011dd02e-38a4-4d43-91a6-d1d8055d33df admin admin] REQUEST_METHOD: `DELETE` {{(pid=71939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 24 17:00:42.880976 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-011dd02e-38a4-4d43-91a6-d1d8055d33df admin admin] SCRIPT_NAME: `/identity` {{(pid=71939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 24 17:00:42.881422 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-011dd02e-38a4-4d43-91a6-d1d8055d33df admin admin] PATH_INFO: `/v3/projects/71a155cc696c491688838950c97d3fc4` {{(pid=71939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 24 17:00:42.882856 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-011dd02e-38a4-4d43-91a6-d1d8055d33df admin admin] RBAC: Authorizing `identity:delete_project(project_id=71a155cc696c491688838950c97d3fc4)` {{(pid=71939) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:442}} Nov 24 17:00:42.911427 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-011dd02e-38a4-4d43-91a6-d1d8055d33df admin admin] RBAC: Authorization granted {{(pid=71939) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 24 17:00:42.962006 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.notifications [None req-011dd02e-38a4-4d43-91a6-d1d8055d33df admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '71a155cc696c491688838950c97d3fc4', 'request_id': 'req-011dd02e-38a4-4d43-91a6-d1d8055d33df'} {{(pid=71939) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:357}} Nov 24 17:00:42.973687 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.notifications [None req-011dd02e-38a4-4d43-91a6-d1d8055d33df admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '71a155cc696c491688838950c97d3fc4', 'request_id': 'req-011dd02e-38a4-4d43-91a6-d1d8055d33df'} {{(pid=71939) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:357}} Nov 24 17:00:42.979515 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.notifications [None req-011dd02e-38a4-4d43-91a6-d1d8055d33df admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '71a155cc696c491688838950c97d3fc4', 'request_id': 'req-011dd02e-38a4-4d43-91a6-d1d8055d33df'} {{(pid=71939) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:357}} Nov 24 17:00:42.990406 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.notifications [None req-011dd02e-38a4-4d43-91a6-d1d8055d33df admin admin] The token cache is being invalidate because project 71a155cc696c491688838950c97d3fc4 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=71939) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Nov 24 17:00:42.990741 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.notifications [None req-011dd02e-38a4-4d43-91a6-d1d8055d33df admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=71939) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:357}} Nov 24 17:00:42.991407 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.notifications [None req-011dd02e-38a4-4d43-91a6-d1d8055d33df admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=71939) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:357}} Nov 24 17:00:42.992939 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: [pid: 71939|app: 0|req: 1352/2691] 10.222.0.53 () {58 vars in 1223 bytes} [Wed Nov 24 17:00:42 2021] DELETE /identity/v3/projects/71a155cc696c491688838950c97d3fc4 => generated 0 bytes in 133 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 24 17:00:42.997819 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33d9a82e-0e47-4dac-90ff-e3e58084727d service neutron] Authenticating user token {{(pid=71938) process_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 24 17:00:43.007602 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33d9a82e-0e47-4dac-90ff-e3e58084727d service neutron] Validating token access rules against request {{(pid=71938) validate_allowed_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 24 17:00:43.074685 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fd8cec4-41b9-4418-8dc9-02e291d536b8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f2ba2e8375b4e8c8792ee1e22b60427', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '00a5583c7b7443e98e7a1d31a0b638dc', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=71938) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 24 17:00:43.075580 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fd8cec4-41b9-4418-8dc9-02e291d536b8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=71938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 24 17:00:43.075909 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fd8cec4-41b9-4418-8dc9-02e291d536b8 admin admin] SCRIPT_NAME: `/identity` {{(pid=71938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 24 17:00:43.076241 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fd8cec4-41b9-4418-8dc9-02e291d536b8 admin admin] PATH_INFO: `/v3/users/b9cbf381a6744923b4e11160fa2cccf0` {{(pid=71938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 24 17:00:43.077451 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fd8cec4-41b9-4418-8dc9-02e291d536b8 admin admin] RBAC: Authorizing `identity:delete_user(user_id=b9cbf381a6744923b4e11160fa2cccf0)` {{(pid=71938) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:442}} Nov 24 17:00:43.106364 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fd8cec4-41b9-4418-8dc9-02e291d536b8 admin admin] RBAC: Authorization granted {{(pid=71938) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 24 17:00:43.156267 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.notifications [None req-1fd8cec4-41b9-4418-8dc9-02e291d536b8 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b9cbf381a6744923b4e11160fa2cccf0'} {{(pid=71938) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:357}} Nov 24 17:00:43.169251 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.notifications [None req-1fd8cec4-41b9-4418-8dc9-02e291d536b8 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b9cbf381a6744923b4e11160fa2cccf0'} {{(pid=71938) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:357}} Nov 24 17:00:43.169957 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.notifications [None req-1fd8cec4-41b9-4418-8dc9-02e291d536b8 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b9cbf381a6744923b4e11160fa2cccf0'} {{(pid=71938) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:357}} Nov 24 17:00:43.179271 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.notifications [None req-1fd8cec4-41b9-4418-8dc9-02e291d536b8 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b9cbf381a6744923b4e11160fa2cccf0'} {{(pid=71938) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:357}} Nov 24 17:00:43.188212 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.notifications [None req-1fd8cec4-41b9-4418-8dc9-02e291d536b8 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b9cbf381a6744923b4e11160fa2cccf0'} {{(pid=71938) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:357}} Nov 24 17:00:43.195276 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: [pid: 71938|app: 0|req: 1340/2692] 10.222.0.53 () {58 vars in 1214 bytes} [Wed Nov 24 17:00:42 2021] DELETE /identity/v3/users/b9cbf381a6744923b4e11160fa2cccf0 => generated 0 bytes in 198 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 24 17:00:43.565058 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-011dd02e-38a4-4d43-91a6-d1d8055d33df admin admin] Authenticating user token {{(pid=71939) process_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 24 17:00:43.566639 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.fernet_utils [None req-011dd02e-38a4-4d43-91a6-d1d8055d33df admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=71939) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:289}} Nov 24 17:00:43.580585 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-011dd02e-38a4-4d43-91a6-d1d8055d33df admin admin] Validating token access rules against request {{(pid=71939) validate_allowed_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 24 17:00:43.648184 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2d5a57d-7a9e-4091-821f-1dcbf2299bd4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f2ba2e8375b4e8c8792ee1e22b60427', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '00a5583c7b7443e98e7a1d31a0b638dc', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=71939) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 24 17:00:43.649062 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2d5a57d-7a9e-4091-821f-1dcbf2299bd4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=71939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 24 17:00:43.649405 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2d5a57d-7a9e-4091-821f-1dcbf2299bd4 admin admin] SCRIPT_NAME: `/identity` {{(pid=71939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 24 17:00:43.649745 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2d5a57d-7a9e-4091-821f-1dcbf2299bd4 admin admin] PATH_INFO: `/v3/projects/8ec70741acb94619b20132b14ef4f7b0` {{(pid=71939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 24 17:00:43.650998 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2d5a57d-7a9e-4091-821f-1dcbf2299bd4 admin admin] RBAC: Authorizing `identity:delete_project(project_id=8ec70741acb94619b20132b14ef4f7b0)` {{(pid=71939) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:442}} Nov 24 17:00:43.679703 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2d5a57d-7a9e-4091-821f-1dcbf2299bd4 admin admin] RBAC: Authorization granted {{(pid=71939) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 24 17:00:43.730746 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.notifications [None req-a2d5a57d-7a9e-4091-821f-1dcbf2299bd4 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '8ec70741acb94619b20132b14ef4f7b0', 'request_id': 'req-a2d5a57d-7a9e-4091-821f-1dcbf2299bd4'} {{(pid=71939) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:357}} Nov 24 17:00:43.742449 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.notifications [None req-a2d5a57d-7a9e-4091-821f-1dcbf2299bd4 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '8ec70741acb94619b20132b14ef4f7b0', 'request_id': 'req-a2d5a57d-7a9e-4091-821f-1dcbf2299bd4'} {{(pid=71939) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:357}} Nov 24 17:00:43.748420 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.notifications [None req-a2d5a57d-7a9e-4091-821f-1dcbf2299bd4 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '8ec70741acb94619b20132b14ef4f7b0', 'request_id': 'req-a2d5a57d-7a9e-4091-821f-1dcbf2299bd4'} {{(pid=71939) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:357}} Nov 24 17:00:43.758579 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.notifications [None req-a2d5a57d-7a9e-4091-821f-1dcbf2299bd4 admin admin] The token cache is being invalidate because project 8ec70741acb94619b20132b14ef4f7b0 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=71939) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Nov 24 17:00:43.758910 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.notifications [None req-a2d5a57d-7a9e-4091-821f-1dcbf2299bd4 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=71939) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:357}} Nov 24 17:00:43.759569 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.notifications [None req-a2d5a57d-7a9e-4091-821f-1dcbf2299bd4 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=71939) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:357}} Nov 24 17:00:43.761607 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: [pid: 71939|app: 0|req: 1353/2693] 10.222.0.53 () {58 vars in 1223 bytes} [Wed Nov 24 17:00:43 2021] DELETE /identity/v3/projects/8ec70741acb94619b20132b14ef4f7b0 => generated 0 bytes in 197 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 24 17:00:43.769735 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e63e8c4e-3cd4-4d25-a6f1-c5dcb797240a None None] REQUEST_METHOD: `POST` {{(pid=71938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 24 17:00:43.770112 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e63e8c4e-3cd4-4d25-a6f1-c5dcb797240a None None] SCRIPT_NAME: `/identity` {{(pid=71938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 24 17:00:43.770455 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e63e8c4e-3cd4-4d25-a6f1-c5dcb797240a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=71938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 24 17:00:43.794504 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.auth.core [None req-e63e8c4e-3cd4-4d25-a6f1-c5dcb797240a None None] MFA Rules not processed for user `0f2ba2e8375b4e8c8792ee1e22b60427`. Rule list: `[]` (Enabled: `True`). {{(pid=71938) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:442}} Nov 24 17:00:43.795731 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.fernet_utils [None req-e63e8c4e-3cd4-4d25-a6f1-c5dcb797240a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=71938) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:289}} Nov 24 17:00:43.863781 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: [pid: 71938|app: 0|req: 1341/2694] 10.222.0.53 () {58 vars in 948 bytes} [Wed Nov 24 17:00:43 2021] POST /identity/v3/auth/tokens => generated 3669 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 24 17:00:43.872171 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4014e518-4d4d-4f6d-8444-1da3d89781a1 None None] REQUEST_METHOD: `POST` {{(pid=71939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 24 17:00:43.872524 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4014e518-4d4d-4f6d-8444-1da3d89781a1 None None] SCRIPT_NAME: `/identity` {{(pid=71939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 24 17:00:43.872867 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4014e518-4d4d-4f6d-8444-1da3d89781a1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=71939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 24 17:00:43.896768 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.auth.core [None req-4014e518-4d4d-4f6d-8444-1da3d89781a1 None None] MFA Rules not processed for user `0f2ba2e8375b4e8c8792ee1e22b60427`. Rule list: `[]` (Enabled: `True`). {{(pid=71939) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:442}} Nov 24 17:00:43.898095 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.fernet_utils [None req-4014e518-4d4d-4f6d-8444-1da3d89781a1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=71939) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:289}} Nov 24 17:00:43.905994 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: [pid: 71939|app: 0|req: 1354/2695] 10.222.0.53 () {58 vars in 948 bytes} [Wed Nov 24 17:00:43 2021] POST /identity/v3/auth/tokens => generated 3669 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 24 17:00:43.910533 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e63e8c4e-3cd4-4d25-a6f1-c5dcb797240a None None] Authenticating user token {{(pid=71938) process_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 24 17:00:43.920522 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e63e8c4e-3cd4-4d25-a6f1-c5dcb797240a None None] Validating token access rules against request {{(pid=71938) validate_allowed_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 24 17:00:43.925088 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84b72067-89b4-427b-8fbf-b42dc925c951 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f2ba2e8375b4e8c8792ee1e22b60427', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '00a5583c7b7443e98e7a1d31a0b638dc', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=71938) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 24 17:00:43.925752 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84b72067-89b4-427b-8fbf-b42dc925c951 admin admin] REQUEST_METHOD: `GET` {{(pid=71938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 24 17:00:43.926120 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84b72067-89b4-427b-8fbf-b42dc925c951 admin admin] SCRIPT_NAME: `/identity` {{(pid=71938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 24 17:00:43.926461 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84b72067-89b4-427b-8fbf-b42dc925c951 admin admin] PATH_INFO: `/v3/domains` {{(pid=71938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 24 17:00:43.927250 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84b72067-89b4-427b-8fbf-b42dc925c951 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=71938) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:161}} Nov 24 17:00:43.927629 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84b72067-89b4-427b-8fbf-b42dc925c951 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=71938) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:442}} Nov 24 17:00:43.956648 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84b72067-89b4-427b-8fbf-b42dc925c951 admin admin] RBAC: Authorization granted {{(pid=71938) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 24 17:00:43.970805 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: [pid: 71938|app: 0|req: 1342/2696] 10.222.0.53 () {58 vars in 1143 bytes} [Wed Nov 24 17:00:43 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 61 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 24 17:00:43.975340 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4014e518-4d4d-4f6d-8444-1da3d89781a1 None None] Authenticating user token {{(pid=71939) process_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 24 17:00:43.984858 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4014e518-4d4d-4f6d-8444-1da3d89781a1 None None] Validating token access rules against request {{(pid=71939) validate_allowed_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 24 17:00:43.989484 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d49e720-1417-4a2c-bb45-96dee2b48e14 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f2ba2e8375b4e8c8792ee1e22b60427', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '00a5583c7b7443e98e7a1d31a0b638dc', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=71939) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 24 17:00:43.990172 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d49e720-1417-4a2c-bb45-96dee2b48e14 admin admin] REQUEST_METHOD: `POST` {{(pid=71939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 24 17:00:43.990513 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d49e720-1417-4a2c-bb45-96dee2b48e14 admin admin] SCRIPT_NAME: `/identity` {{(pid=71939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 24 17:00:43.990848 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d49e720-1417-4a2c-bb45-96dee2b48e14 admin admin] PATH_INFO: `/v3/projects` {{(pid=71939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 24 17:00:43.991577 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d49e720-1417-4a2c-bb45-96dee2b48e14 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=71939) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:442}} Nov 24 17:00:44.020478 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d49e720-1417-4a2c-bb45-96dee2b48e14 admin admin] RBAC: Authorization granted {{(pid=71939) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 24 17:00:44.047353 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: [pid: 71939|app: 0|req: 1355/2697] 10.222.0.53 () {60 vars in 1143 bytes} [Wed Nov 24 17:00:43 2021] POST /identity/v3/projects => generated 373 bytes in 73 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 24 17:00:44.051722 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84b72067-89b4-427b-8fbf-b42dc925c951 admin admin] Authenticating user token {{(pid=71938) process_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 24 17:00:44.063044 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84b72067-89b4-427b-8fbf-b42dc925c951 admin admin] Validating token access rules against request {{(pid=71938) validate_allowed_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 24 17:00:44.130735 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2cf34ac-2430-47be-a36e-12e2dccba3cd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f2ba2e8375b4e8c8792ee1e22b60427', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '00a5583c7b7443e98e7a1d31a0b638dc', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=71938) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 24 17:00:44.131411 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2cf34ac-2430-47be-a36e-12e2dccba3cd admin admin] REQUEST_METHOD: `POST` {{(pid=71938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 24 17:00:44.131747 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2cf34ac-2430-47be-a36e-12e2dccba3cd admin admin] SCRIPT_NAME: `/identity` {{(pid=71938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 24 17:00:44.132078 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2cf34ac-2430-47be-a36e-12e2dccba3cd admin admin] PATH_INFO: `/v3/users` {{(pid=71938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 24 17:00:44.132799 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2cf34ac-2430-47be-a36e-12e2dccba3cd admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=71938) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:442}} Nov 24 17:00:44.161616 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2cf34ac-2430-47be-a36e-12e2dccba3cd admin admin] RBAC: Authorization granted {{(pid=71938) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 24 17:00:44.183568 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: [pid: 71938|app: 0|req: 1343/2698] 10.222.0.53 () {60 vars in 1134 bytes} [Wed Nov 24 17:00:44 2021] POST /identity/v3/users => generated 287 bytes in 132 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 24 17:00:44.189310 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d49e720-1417-4a2c-bb45-96dee2b48e14 admin admin] Authenticating user token {{(pid=71939) process_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 24 17:00:44.200161 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d49e720-1417-4a2c-bb45-96dee2b48e14 admin admin] Validating token access rules against request {{(pid=71939) validate_allowed_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 24 17:00:44.205246 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53dda93f-0aed-4d42-bd85-80fc550fd0c5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f2ba2e8375b4e8c8792ee1e22b60427', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '00a5583c7b7443e98e7a1d31a0b638dc', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=71939) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 24 17:00:44.205931 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53dda93f-0aed-4d42-bd85-80fc550fd0c5 admin admin] REQUEST_METHOD: `GET` {{(pid=71939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 24 17:00:44.206409 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53dda93f-0aed-4d42-bd85-80fc550fd0c5 admin admin] SCRIPT_NAME: `/identity` {{(pid=71939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 24 17:00:44.206749 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53dda93f-0aed-4d42-bd85-80fc550fd0c5 admin admin] PATH_INFO: `/v3/roles` {{(pid=71939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 24 17:00:44.207581 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53dda93f-0aed-4d42-bd85-80fc550fd0c5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=71939) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:442}} Nov 24 17:00:44.239662 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53dda93f-0aed-4d42-bd85-80fc550fd0c5 admin admin] RBAC: Authorization granted {{(pid=71939) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 24 17:00:44.249187 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: [pid: 71939|app: 0|req: 1356/2699] 10.222.0.53 () {58 vars in 1112 bytes} [Wed Nov 24 17:00:44 2021] GET /identity/v3/roles => generated 1420 bytes in 60 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 24 17:00:44.253403 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2cf34ac-2430-47be-a36e-12e2dccba3cd admin admin] Authenticating user token {{(pid=71938) process_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 24 17:00:44.263821 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2cf34ac-2430-47be-a36e-12e2dccba3cd admin admin] Validating token access rules against request {{(pid=71938) validate_allowed_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 24 17:00:44.268547 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23945f35-1f92-40fa-8193-9cd7955e6cfa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f2ba2e8375b4e8c8792ee1e22b60427', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '00a5583c7b7443e98e7a1d31a0b638dc', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=71938) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 24 17:00:44.269444 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23945f35-1f92-40fa-8193-9cd7955e6cfa admin admin] REQUEST_METHOD: `PUT` {{(pid=71938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 24 17:00:44.269781 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23945f35-1f92-40fa-8193-9cd7955e6cfa admin admin] SCRIPT_NAME: `/identity` {{(pid=71938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 24 17:00:44.270162 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23945f35-1f92-40fa-8193-9cd7955e6cfa admin admin] PATH_INFO: `/v3/projects/e80c2db4948848d18f01e2a82c2f1f16/users/bb2f833677274b6bae681f5f2e629b5f/roles/912ab5f10fa5477da74acf239f07604e` {{(pid=71938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 24 17:00:44.292107 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23945f35-1f92-40fa-8193-9cd7955e6cfa admin admin] RBAC: Authorizing `identity:create_grant(project_id=e80c2db4948848d18f01e2a82c2f1f16, user_id=bb2f833677274b6bae681f5f2e629b5f, role_id=912ab5f10fa5477da74acf239f07604e)` {{(pid=71938) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:442}} Nov 24 17:00:44.322452 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23945f35-1f92-40fa-8193-9cd7955e6cfa admin admin] RBAC: Authorization granted {{(pid=71938) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 24 17:00:44.336281 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: [pid: 71938|app: 0|req: 1344/2700] 10.222.0.53 () {60 vars in 1473 bytes} [Wed Nov 24 17:00:44 2021] PUT /identity/v3/projects/e80c2db4948848d18f01e2a82c2f1f16/users/bb2f833677274b6bae681f5f2e629b5f/roles/912ab5f10fa5477da74acf239f07604e => generated 0 bytes in 83 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 24 17:00:44.347817 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abf5b8c9-fe48-405d-878e-46244f36acaf None None] REQUEST_METHOD: `POST` {{(pid=71939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 24 17:00:44.348169 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abf5b8c9-fe48-405d-878e-46244f36acaf None None] SCRIPT_NAME: `/identity` {{(pid=71939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 24 17:00:44.348512 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abf5b8c9-fe48-405d-878e-46244f36acaf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=71939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 24 17:00:44.388596 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.auth.core [None req-abf5b8c9-fe48-405d-878e-46244f36acaf None None] MFA Rules not processed for user `bb2f833677274b6bae681f5f2e629b5f`. Rule list: `[]` (Enabled: `True`). {{(pid=71939) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:442}} Nov 24 17:00:44.389885 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.fernet_utils [None req-abf5b8c9-fe48-405d-878e-46244f36acaf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=71939) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:289}} Nov 24 17:00:44.468763 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: [pid: 71939|app: 0|req: 1357/2701] 10.222.0.53 () {58 vars in 948 bytes} [Wed Nov 24 17:00:44 2021] POST /identity/v3/auth/tokens => generated 3680 bytes in 122 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 24 17:00:44.473951 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23945f35-1f92-40fa-8193-9cd7955e6cfa admin admin] Authenticating user token {{(pid=71938) process_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 24 17:00:44.546651 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23945f35-1f92-40fa-8193-9cd7955e6cfa admin admin] Validating token access rules against request {{(pid=71938) validate_allowed_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 24 17:00:44.551294 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a674bff-3a5b-40e8-ba76-5525c751f278 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f2ba2e8375b4e8c8792ee1e22b60427', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '00a5583c7b7443e98e7a1d31a0b638dc', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=71938) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 24 17:00:44.551966 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a674bff-3a5b-40e8-ba76-5525c751f278 admin admin] REQUEST_METHOD: `POST` {{(pid=71938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 24 17:00:44.552305 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a674bff-3a5b-40e8-ba76-5525c751f278 admin admin] SCRIPT_NAME: `/identity` {{(pid=71938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 24 17:00:44.552640 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a674bff-3a5b-40e8-ba76-5525c751f278 admin admin] PATH_INFO: `/v3/projects` {{(pid=71938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 24 17:00:44.553375 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a674bff-3a5b-40e8-ba76-5525c751f278 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=71938) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:442}} Nov 24 17:00:44.582448 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a674bff-3a5b-40e8-ba76-5525c751f278 admin admin] RBAC: Authorization granted {{(pid=71938) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 24 17:00:44.609982 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: [pid: 71938|app: 0|req: 1345/2702] 10.222.0.53 () {60 vars in 1143 bytes} [Wed Nov 24 17:00:44 2021] POST /identity/v3/projects => generated 373 bytes in 137 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 24 17:00:44.614590 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abf5b8c9-fe48-405d-878e-46244f36acaf None None] Authenticating user token {{(pid=71939) process_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 24 17:00:44.626547 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abf5b8c9-fe48-405d-878e-46244f36acaf None None] Validating token access rules against request {{(pid=71939) validate_allowed_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 24 17:00:44.711838 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bed77d3c-9f3d-4eef-b246-d62af5b232eb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f2ba2e8375b4e8c8792ee1e22b60427', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '00a5583c7b7443e98e7a1d31a0b638dc', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=71939) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 24 17:00:44.712618 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bed77d3c-9f3d-4eef-b246-d62af5b232eb admin admin] REQUEST_METHOD: `POST` {{(pid=71939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 24 17:00:44.712999 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bed77d3c-9f3d-4eef-b246-d62af5b232eb admin admin] SCRIPT_NAME: `/identity` {{(pid=71939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 24 17:00:44.713411 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bed77d3c-9f3d-4eef-b246-d62af5b232eb admin admin] PATH_INFO: `/v3/users` {{(pid=71939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 24 17:00:44.714713 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bed77d3c-9f3d-4eef-b246-d62af5b232eb admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=71939) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:442}} Nov 24 17:00:44.747164 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bed77d3c-9f3d-4eef-b246-d62af5b232eb admin admin] RBAC: Authorization granted {{(pid=71939) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 24 17:00:44.767689 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: [pid: 71939|app: 0|req: 1358/2703] 10.222.0.53 () {60 vars in 1134 bytes} [Wed Nov 24 17:00:44 2021] POST /identity/v3/users => generated 293 bytes in 154 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 24 17:00:44.772405 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a674bff-3a5b-40e8-ba76-5525c751f278 admin admin] Authenticating user token {{(pid=71938) process_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 24 17:00:44.783491 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a674bff-3a5b-40e8-ba76-5525c751f278 admin admin] Validating token access rules against request {{(pid=71938) validate_allowed_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 24 17:00:44.788059 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6421e485-aa16-4163-8540-f20f1e3d31a0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f2ba2e8375b4e8c8792ee1e22b60427', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '00a5583c7b7443e98e7a1d31a0b638dc', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=71938) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 24 17:00:44.788738 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6421e485-aa16-4163-8540-f20f1e3d31a0 admin admin] REQUEST_METHOD: `GET` {{(pid=71938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 24 17:00:44.789081 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6421e485-aa16-4163-8540-f20f1e3d31a0 admin admin] SCRIPT_NAME: `/identity` {{(pid=71938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 24 17:00:44.789417 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6421e485-aa16-4163-8540-f20f1e3d31a0 admin admin] PATH_INFO: `/v3/roles` {{(pid=71938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 24 17:00:44.790240 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6421e485-aa16-4163-8540-f20f1e3d31a0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=71938) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:442}} Nov 24 17:00:44.819382 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6421e485-aa16-4163-8540-f20f1e3d31a0 admin admin] RBAC: Authorization granted {{(pid=71938) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 24 17:00:44.831687 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: [pid: 71938|app: 0|req: 1346/2704] 10.222.0.53 () {58 vars in 1112 bytes} [Wed Nov 24 17:00:44 2021] GET /identity/v3/roles => generated 1420 bytes in 60 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 24 17:00:44.836236 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bed77d3c-9f3d-4eef-b246-d62af5b232eb admin admin] Authenticating user token {{(pid=71939) process_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 24 17:00:44.847003 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bed77d3c-9f3d-4eef-b246-d62af5b232eb admin admin] Validating token access rules against request {{(pid=71939) validate_allowed_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 24 17:00:44.851660 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad1fd9d2-abaf-455c-b7e9-9be1b071b44c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f2ba2e8375b4e8c8792ee1e22b60427', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '00a5583c7b7443e98e7a1d31a0b638dc', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=71939) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 24 17:00:44.852544 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad1fd9d2-abaf-455c-b7e9-9be1b071b44c admin admin] REQUEST_METHOD: `PUT` {{(pid=71939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 24 17:00:44.852887 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad1fd9d2-abaf-455c-b7e9-9be1b071b44c admin admin] SCRIPT_NAME: `/identity` {{(pid=71939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 24 17:00:44.853224 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad1fd9d2-abaf-455c-b7e9-9be1b071b44c admin admin] PATH_INFO: `/v3/projects/5cc13cae27b44244a8689655f00d3360/users/7048df0d26e94c8f946118e72d8325c7/roles/5611724e350b41e19921b5961a342582` {{(pid=71939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 24 17:00:44.874931 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad1fd9d2-abaf-455c-b7e9-9be1b071b44c admin admin] RBAC: Authorizing `identity:create_grant(project_id=5cc13cae27b44244a8689655f00d3360, user_id=7048df0d26e94c8f946118e72d8325c7, role_id=5611724e350b41e19921b5961a342582)` {{(pid=71939) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:442}} Nov 24 17:00:44.904761 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad1fd9d2-abaf-455c-b7e9-9be1b071b44c admin admin] RBAC: Authorization granted {{(pid=71939) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 24 17:00:44.917335 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: [pid: 71939|app: 0|req: 1359/2705] 10.222.0.53 () {60 vars in 1473 bytes} [Wed Nov 24 17:00:44 2021] PUT /identity/v3/projects/5cc13cae27b44244a8689655f00d3360/users/7048df0d26e94c8f946118e72d8325c7/roles/5611724e350b41e19921b5961a342582 => generated 0 bytes in 82 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 24 17:00:44.922216 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6421e485-aa16-4163-8540-f20f1e3d31a0 admin admin] Authenticating user token {{(pid=71938) process_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 24 17:00:44.932475 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6421e485-aa16-4163-8540-f20f1e3d31a0 admin admin] Validating token access rules against request {{(pid=71938) validate_allowed_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 24 17:00:44.999050 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99eb5b5a-ce45-4ce0-a5b4-dfea423341dc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f2ba2e8375b4e8c8792ee1e22b60427', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '00a5583c7b7443e98e7a1d31a0b638dc', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=71938) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 24 17:00:44.999744 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99eb5b5a-ce45-4ce0-a5b4-dfea423341dc admin admin] REQUEST_METHOD: `GET` {{(pid=71938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 24 17:00:45.000064 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99eb5b5a-ce45-4ce0-a5b4-dfea423341dc admin admin] SCRIPT_NAME: `/identity` {{(pid=71938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 24 17:00:45.000397 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99eb5b5a-ce45-4ce0-a5b4-dfea423341dc admin admin] PATH_INFO: `/v3/roles` {{(pid=71938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 24 17:00:45.001171 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99eb5b5a-ce45-4ce0-a5b4-dfea423341dc admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=71938) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:442}} Nov 24 17:00:45.029706 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99eb5b5a-ce45-4ce0-a5b4-dfea423341dc admin admin] RBAC: Authorization granted {{(pid=71938) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 24 17:00:45.041448 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: [pid: 71938|app: 0|req: 1347/2706] 10.222.0.53 () {58 vars in 1112 bytes} [Wed Nov 24 17:00:44 2021] GET /identity/v3/roles => generated 1420 bytes in 120 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 24 17:00:45.046761 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad1fd9d2-abaf-455c-b7e9-9be1b071b44c admin admin] Authenticating user token {{(pid=71939) process_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 24 17:00:45.059883 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad1fd9d2-abaf-455c-b7e9-9be1b071b44c admin admin] Validating token access rules against request {{(pid=71939) validate_allowed_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 24 17:00:45.065090 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f42673b-e5fd-4ea6-b7bf-0a7a92ca3f89 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f2ba2e8375b4e8c8792ee1e22b60427', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '00a5583c7b7443e98e7a1d31a0b638dc', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=71939) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 24 17:00:45.066011 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f42673b-e5fd-4ea6-b7bf-0a7a92ca3f89 admin admin] REQUEST_METHOD: `PUT` {{(pid=71939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 24 17:00:45.066397 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f42673b-e5fd-4ea6-b7bf-0a7a92ca3f89 admin admin] SCRIPT_NAME: `/identity` {{(pid=71939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 24 17:00:45.066733 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f42673b-e5fd-4ea6-b7bf-0a7a92ca3f89 admin admin] PATH_INFO: `/v3/projects/5cc13cae27b44244a8689655f00d3360/users/7048df0d26e94c8f946118e72d8325c7/roles/5611724e350b41e19921b5961a342582` {{(pid=71939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 24 17:00:45.068744 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f42673b-e5fd-4ea6-b7bf-0a7a92ca3f89 admin admin] RBAC: Authorizing `identity:create_grant(project_id=5cc13cae27b44244a8689655f00d3360, user_id=7048df0d26e94c8f946118e72d8325c7, role_id=5611724e350b41e19921b5961a342582)` {{(pid=71939) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:442}} Nov 24 17:00:45.099431 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f42673b-e5fd-4ea6-b7bf-0a7a92ca3f89 admin admin] RBAC: Authorization granted {{(pid=71939) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 24 17:00:45.111031 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: [pid: 71939|app: 0|req: 1360/2707] 10.222.0.53 () {60 vars in 1473 bytes} [Wed Nov 24 17:00:45 2021] PUT /identity/v3/projects/5cc13cae27b44244a8689655f00d3360/users/7048df0d26e94c8f946118e72d8325c7/roles/5611724e350b41e19921b5961a342582 => generated 0 bytes in 65 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 24 17:00:45.115339 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99eb5b5a-ce45-4ce0-a5b4-dfea423341dc admin admin] Authenticating user token {{(pid=71938) process_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 24 17:00:45.125846 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99eb5b5a-ce45-4ce0-a5b4-dfea423341dc admin admin] Validating token access rules against request {{(pid=71938) validate_allowed_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 24 17:00:45.193154 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84618c06-47da-479b-91af-727d41750e00 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f2ba2e8375b4e8c8792ee1e22b60427', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '00a5583c7b7443e98e7a1d31a0b638dc', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=71938) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 24 17:00:45.193836 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84618c06-47da-479b-91af-727d41750e00 admin admin] REQUEST_METHOD: `GET` {{(pid=71938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 24 17:00:45.194218 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84618c06-47da-479b-91af-727d41750e00 admin admin] SCRIPT_NAME: `/identity` {{(pid=71938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 24 17:00:45.194559 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84618c06-47da-479b-91af-727d41750e00 admin admin] PATH_INFO: `/v3/roles` {{(pid=71938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 24 17:00:45.195347 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84618c06-47da-479b-91af-727d41750e00 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=71938) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:442}} Nov 24 17:00:45.224520 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84618c06-47da-479b-91af-727d41750e00 admin admin] RBAC: Authorization granted {{(pid=71938) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 24 17:00:45.235723 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: [pid: 71938|app: 0|req: 1348/2708] 10.222.0.53 () {58 vars in 1112 bytes} [Wed Nov 24 17:00:45 2021] GET /identity/v3/roles => generated 1420 bytes in 121 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 24 17:00:45.240300 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f42673b-e5fd-4ea6-b7bf-0a7a92ca3f89 admin admin] Authenticating user token {{(pid=71939) process_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 24 17:00:45.250894 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f42673b-e5fd-4ea6-b7bf-0a7a92ca3f89 admin admin] Validating token access rules against request {{(pid=71939) validate_allowed_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 24 17:00:45.255679 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55c30828-cd09-4476-8c17-bba75c423832 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f2ba2e8375b4e8c8792ee1e22b60427', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '00a5583c7b7443e98e7a1d31a0b638dc', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=71939) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 24 17:00:45.256600 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55c30828-cd09-4476-8c17-bba75c423832 admin admin] REQUEST_METHOD: `PUT` {{(pid=71939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 24 17:00:45.256941 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55c30828-cd09-4476-8c17-bba75c423832 admin admin] SCRIPT_NAME: `/identity` {{(pid=71939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 24 17:00:45.257278 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55c30828-cd09-4476-8c17-bba75c423832 admin admin] PATH_INFO: `/v3/projects/5cc13cae27b44244a8689655f00d3360/users/7048df0d26e94c8f946118e72d8325c7/roles/912ab5f10fa5477da74acf239f07604e` {{(pid=71939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 24 17:00:45.259376 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55c30828-cd09-4476-8c17-bba75c423832 admin admin] RBAC: Authorizing `identity:create_grant(project_id=5cc13cae27b44244a8689655f00d3360, user_id=7048df0d26e94c8f946118e72d8325c7, role_id=912ab5f10fa5477da74acf239f07604e)` {{(pid=71939) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:442}} Nov 24 17:00:45.289951 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55c30828-cd09-4476-8c17-bba75c423832 admin admin] RBAC: Authorization granted {{(pid=71939) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 24 17:00:45.303210 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: [pid: 71939|app: 0|req: 1361/2709] 10.222.0.53 () {60 vars in 1473 bytes} [Wed Nov 24 17:00:45 2021] PUT /identity/v3/projects/5cc13cae27b44244a8689655f00d3360/users/7048df0d26e94c8f946118e72d8325c7/roles/912ab5f10fa5477da74acf239f07604e => generated 0 bytes in 63 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 24 17:00:45.314325 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9212ac07-f747-4221-af41-13de8dbc32a9 None None] REQUEST_METHOD: `POST` {{(pid=71938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 24 17:00:45.314684 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9212ac07-f747-4221-af41-13de8dbc32a9 None None] SCRIPT_NAME: `/identity` {{(pid=71938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 24 17:00:45.315022 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9212ac07-f747-4221-af41-13de8dbc32a9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=71938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 24 17:00:45.357233 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.auth.core [None req-9212ac07-f747-4221-af41-13de8dbc32a9 None None] MFA Rules not processed for user `7048df0d26e94c8f946118e72d8325c7`. Rule list: `[]` (Enabled: `True`). {{(pid=71938) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:442}} Nov 24 17:00:45.358474 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.fernet_utils [None req-9212ac07-f747-4221-af41-13de8dbc32a9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=71938) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:289}} Nov 24 17:00:45.440741 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: [pid: 71938|app: 0|req: 1349/2710] 10.222.0.53 () {58 vars in 948 bytes} [Wed Nov 24 17:00:45 2021] POST /identity/v3/auth/tokens => generated 3747 bytes in 128 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 24 17:00:45.451634 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55c30828-cd09-4476-8c17-bba75c423832 admin admin] Authenticating user token {{(pid=71939) process_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 24 17:00:45.453368 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.fernet_utils [None req-55c30828-cd09-4476-8c17-bba75c423832 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=71939) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:289}} Nov 24 17:00:45.522869 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55c30828-cd09-4476-8c17-bba75c423832 admin admin] Validating token access rules against request {{(pid=71939) validate_allowed_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 24 17:00:45.526557 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f035e0c5-5d28-4e89-a4c6-6605c3be19d7 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a12374a3093a401a97c343ff0854184d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3b3940d4ae1c4177ae29c02377bb4b0b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=71939) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 24 17:00:45.527191 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f035e0c5-5d28-4e89-a4c6-6605c3be19d7 service cinder] REQUEST_METHOD: `GET` {{(pid=71939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 24 17:00:45.527528 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f035e0c5-5d28-4e89-a4c6-6605c3be19d7 service cinder] SCRIPT_NAME: `/identity` {{(pid=71939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 24 17:00:45.527856 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f035e0c5-5d28-4e89-a4c6-6605c3be19d7 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=71939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 24 17:00:45.592813 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f035e0c5-5d28-4e89-a4c6-6605c3be19d7 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=71939) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:442}} Nov 24 17:00:45.620970 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f035e0c5-5d28-4e89-a4c6-6605c3be19d7 service cinder] RBAC: Authorization granted {{(pid=71939) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 24 17:00:45.629870 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: [pid: 71939|app: 0|req: 1362/2711] 10.222.0.53 () {60 vars in 1356 bytes} [Wed Nov 24 17:00:45 2021] GET /identity/v3/auth/tokens => generated 3680 bytes in 179 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 24 17:00:48.481539 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9212ac07-f747-4221-af41-13de8dbc32a9 None None] Authenticating user token {{(pid=71938) process_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 24 17:00:48.552706 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9212ac07-f747-4221-af41-13de8dbc32a9 None None] Validating token access rules against request {{(pid=71938) validate_allowed_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 24 17:00:48.557294 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9673d3af-1b0a-498e-9360-025f7301f750 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f2ba2e8375b4e8c8792ee1e22b60427', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '00a5583c7b7443e98e7a1d31a0b638dc', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=71938) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 24 17:00:48.558223 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9673d3af-1b0a-498e-9360-025f7301f750 admin admin] REQUEST_METHOD: `DELETE` {{(pid=71938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 24 17:00:48.558820 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9673d3af-1b0a-498e-9360-025f7301f750 admin admin] SCRIPT_NAME: `/identity` {{(pid=71938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 24 17:00:48.559166 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9673d3af-1b0a-498e-9360-025f7301f750 admin admin] PATH_INFO: `/v3/users/bb2f833677274b6bae681f5f2e629b5f` {{(pid=71938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 24 17:00:48.560387 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9673d3af-1b0a-498e-9360-025f7301f750 admin admin] RBAC: Authorizing `identity:delete_user(user_id=bb2f833677274b6bae681f5f2e629b5f)` {{(pid=71938) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:442}} Nov 24 17:00:48.589923 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9673d3af-1b0a-498e-9360-025f7301f750 admin admin] RBAC: Authorization granted {{(pid=71938) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 24 17:00:48.640947 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.notifications [None req-9673d3af-1b0a-498e-9360-025f7301f750 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'bb2f833677274b6bae681f5f2e629b5f'} {{(pid=71938) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:357}} Nov 24 17:00:48.654285 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.notifications [None req-9673d3af-1b0a-498e-9360-025f7301f750 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'bb2f833677274b6bae681f5f2e629b5f'} {{(pid=71938) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:357}} Nov 24 17:00:48.655025 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.notifications [None req-9673d3af-1b0a-498e-9360-025f7301f750 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'bb2f833677274b6bae681f5f2e629b5f'} {{(pid=71938) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:357}} Nov 24 17:00:48.663433 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.notifications [None req-9673d3af-1b0a-498e-9360-025f7301f750 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'bb2f833677274b6bae681f5f2e629b5f'} {{(pid=71938) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:357}} Nov 24 17:00:48.669614 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.notifications [None req-9673d3af-1b0a-498e-9360-025f7301f750 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'bb2f833677274b6bae681f5f2e629b5f'} {{(pid=71938) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:357}} Nov 24 17:00:48.675911 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: [pid: 71938|app: 0|req: 1350/2712] 10.222.0.53 () {58 vars in 1214 bytes} [Wed Nov 24 17:00:48 2021] DELETE /identity/v3/users/bb2f833677274b6bae681f5f2e629b5f => generated 0 bytes in 195 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 24 17:00:48.680773 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dafdfe84-37dc-4de7-94ec-46febd3d2991 None None] REQUEST_METHOD: `POST` {{(pid=71939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 24 17:00:48.681073 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dafdfe84-37dc-4de7-94ec-46febd3d2991 None None] SCRIPT_NAME: `/identity` {{(pid=71939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 24 17:00:48.681411 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dafdfe84-37dc-4de7-94ec-46febd3d2991 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=71939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 24 17:00:48.705406 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.auth.core [None req-dafdfe84-37dc-4de7-94ec-46febd3d2991 None None] MFA Rules not processed for user `0f2ba2e8375b4e8c8792ee1e22b60427`. Rule list: `[]` (Enabled: `True`). {{(pid=71939) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:442}} Nov 24 17:00:48.706655 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.fernet_utils [None req-dafdfe84-37dc-4de7-94ec-46febd3d2991 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=71939) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:289}} Nov 24 17:00:48.775683 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: [pid: 71939|app: 0|req: 1363/2713] 10.222.0.53 () {58 vars in 948 bytes} [Wed Nov 24 17:00:48 2021] POST /identity/v3/auth/tokens => generated 3669 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Nov 24 17:00:48.787394 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9673d3af-1b0a-498e-9360-025f7301f750 admin admin] Authenticating user token {{(pid=71938) process_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 24 17:00:48.788863 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.fernet_utils [None req-9673d3af-1b0a-498e-9360-025f7301f750 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=71938) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:289}} Nov 24 17:00:48.855832 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9673d3af-1b0a-498e-9360-025f7301f750 admin admin] Validating token access rules against request {{(pid=71938) validate_allowed_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 24 17:00:48.859524 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea8f1974-743e-41b5-89de-10976e4f9304 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c90f21b9cdcb413282461fa83cb6b7a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3b3940d4ae1c4177ae29c02377bb4b0b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=71938) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 24 17:00:48.860181 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea8f1974-743e-41b5-89de-10976e4f9304 service neutron] REQUEST_METHOD: `GET` {{(pid=71938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 24 17:00:48.860525 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea8f1974-743e-41b5-89de-10976e4f9304 service neutron] SCRIPT_NAME: `/identity` {{(pid=71938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 24 17:00:48.860863 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea8f1974-743e-41b5-89de-10976e4f9304 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=71938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 24 17:00:48.870874 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea8f1974-743e-41b5-89de-10976e4f9304 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=71938) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:442}} Nov 24 17:00:48.899254 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea8f1974-743e-41b5-89de-10976e4f9304 service neutron] RBAC: Authorization granted {{(pid=71938) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 24 17:00:48.908912 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: [pid: 71938|app: 0|req: 1351/2714] 10.222.0.53 () {60 vars in 1356 bytes} [Wed Nov 24 17:00:48 2021] GET /identity/v3/auth/tokens => generated 3669 bytes in 122 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 24 17:00:49.279608 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dafdfe84-37dc-4de7-94ec-46febd3d2991 None None] Authenticating user token {{(pid=71939) process_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 24 17:00:49.281128 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.fernet_utils [None req-dafdfe84-37dc-4de7-94ec-46febd3d2991 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=71939) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:289}} Nov 24 17:00:49.294822 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dafdfe84-37dc-4de7-94ec-46febd3d2991 None None] Validating token access rules against request {{(pid=71939) validate_allowed_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 24 17:00:49.299444 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5b87c68-6c74-40d3-80ed-3b4103dbfc9b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f2ba2e8375b4e8c8792ee1e22b60427', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '00a5583c7b7443e98e7a1d31a0b638dc', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=71939) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 24 17:00:49.300328 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5b87c68-6c74-40d3-80ed-3b4103dbfc9b admin admin] REQUEST_METHOD: `DELETE` {{(pid=71939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 24 17:00:49.300671 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5b87c68-6c74-40d3-80ed-3b4103dbfc9b admin admin] SCRIPT_NAME: `/identity` {{(pid=71939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 24 17:00:49.301007 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5b87c68-6c74-40d3-80ed-3b4103dbfc9b admin admin] PATH_INFO: `/v3/projects/e80c2db4948848d18f01e2a82c2f1f16` {{(pid=71939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 24 17:00:49.302261 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5b87c68-6c74-40d3-80ed-3b4103dbfc9b admin admin] RBAC: Authorizing `identity:delete_project(project_id=e80c2db4948848d18f01e2a82c2f1f16)` {{(pid=71939) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:442}} Nov 24 17:00:49.331923 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5b87c68-6c74-40d3-80ed-3b4103dbfc9b admin admin] RBAC: Authorization granted {{(pid=71939) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 24 17:00:49.383103 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.notifications [None req-a5b87c68-6c74-40d3-80ed-3b4103dbfc9b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e80c2db4948848d18f01e2a82c2f1f16', 'request_id': 'req-a5b87c68-6c74-40d3-80ed-3b4103dbfc9b'} {{(pid=71939) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:357}} Nov 24 17:00:49.394815 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.notifications [None req-a5b87c68-6c74-40d3-80ed-3b4103dbfc9b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e80c2db4948848d18f01e2a82c2f1f16', 'request_id': 'req-a5b87c68-6c74-40d3-80ed-3b4103dbfc9b'} {{(pid=71939) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:357}} Nov 24 17:00:49.400635 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.notifications [None req-a5b87c68-6c74-40d3-80ed-3b4103dbfc9b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e80c2db4948848d18f01e2a82c2f1f16', 'request_id': 'req-a5b87c68-6c74-40d3-80ed-3b4103dbfc9b'} {{(pid=71939) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:357}} Nov 24 17:00:49.412355 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.notifications [None req-a5b87c68-6c74-40d3-80ed-3b4103dbfc9b admin admin] The token cache is being invalidate because project e80c2db4948848d18f01e2a82c2f1f16 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=71939) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Nov 24 17:00:49.412689 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.notifications [None req-a5b87c68-6c74-40d3-80ed-3b4103dbfc9b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=71939) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:357}} Nov 24 17:00:49.413592 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.notifications [None req-a5b87c68-6c74-40d3-80ed-3b4103dbfc9b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=71939) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:357}} Nov 24 17:00:49.416325 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: [pid: 71939|app: 0|req: 1364/2715] 10.222.0.53 () {58 vars in 1223 bytes} [Wed Nov 24 17:00:49 2021] DELETE /identity/v3/projects/e80c2db4948848d18f01e2a82c2f1f16 => generated 0 bytes in 138 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 24 17:00:49.421147 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea8f1974-743e-41b5-89de-10976e4f9304 service neutron] Authenticating user token {{(pid=71938) process_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 24 17:00:49.431478 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea8f1974-743e-41b5-89de-10976e4f9304 service neutron] Validating token access rules against request {{(pid=71938) validate_allowed_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 24 17:00:49.498512 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8b11bd4-020c-4d64-a072-adcf2dbaa833 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f2ba2e8375b4e8c8792ee1e22b60427', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '00a5583c7b7443e98e7a1d31a0b638dc', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=71938) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 24 17:00:49.499325 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8b11bd4-020c-4d64-a072-adcf2dbaa833 admin admin] REQUEST_METHOD: `DELETE` {{(pid=71938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 24 17:00:49.499662 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8b11bd4-020c-4d64-a072-adcf2dbaa833 admin admin] SCRIPT_NAME: `/identity` {{(pid=71938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 24 17:00:49.499998 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8b11bd4-020c-4d64-a072-adcf2dbaa833 admin admin] PATH_INFO: `/v3/users/7048df0d26e94c8f946118e72d8325c7` {{(pid=71938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 24 17:00:49.501210 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8b11bd4-020c-4d64-a072-adcf2dbaa833 admin admin] RBAC: Authorizing `identity:delete_user(user_id=7048df0d26e94c8f946118e72d8325c7)` {{(pid=71938) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:442}} Nov 24 17:00:49.529601 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8b11bd4-020c-4d64-a072-adcf2dbaa833 admin admin] RBAC: Authorization granted {{(pid=71938) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 24 17:00:49.576560 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.notifications [None req-a8b11bd4-020c-4d64-a072-adcf2dbaa833 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '7048df0d26e94c8f946118e72d8325c7'} {{(pid=71938) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:357}} Nov 24 17:00:49.588609 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.notifications [None req-a8b11bd4-020c-4d64-a072-adcf2dbaa833 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '7048df0d26e94c8f946118e72d8325c7'} {{(pid=71938) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:357}} Nov 24 17:00:49.589884 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.notifications [None req-a8b11bd4-020c-4d64-a072-adcf2dbaa833 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '7048df0d26e94c8f946118e72d8325c7'} {{(pid=71938) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:357}} Nov 24 17:00:49.598276 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.notifications [None req-a8b11bd4-020c-4d64-a072-adcf2dbaa833 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '7048df0d26e94c8f946118e72d8325c7'} {{(pid=71938) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:357}} Nov 24 17:00:49.604113 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.notifications [None req-a8b11bd4-020c-4d64-a072-adcf2dbaa833 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '7048df0d26e94c8f946118e72d8325c7'} {{(pid=71938) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:357}} Nov 24 17:00:49.610849 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: [pid: 71938|app: 0|req: 1352/2716] 10.222.0.53 () {58 vars in 1214 bytes} [Wed Nov 24 17:00:49 2021] DELETE /identity/v3/users/7048df0d26e94c8f946118e72d8325c7 => generated 0 bytes in 190 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 24 17:00:49.988336 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5b87c68-6c74-40d3-80ed-3b4103dbfc9b admin admin] Authenticating user token {{(pid=71939) process_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 24 17:00:49.989841 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.fernet_utils [None req-a5b87c68-6c74-40d3-80ed-3b4103dbfc9b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=71939) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:289}} Nov 24 17:00:50.003927 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5b87c68-6c74-40d3-80ed-3b4103dbfc9b admin admin] Validating token access rules against request {{(pid=71939) validate_allowed_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 24 17:00:50.070653 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31b26429-e803-4480-aba3-23d16f171d38 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f2ba2e8375b4e8c8792ee1e22b60427', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '00a5583c7b7443e98e7a1d31a0b638dc', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=71939) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 24 17:00:50.071468 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31b26429-e803-4480-aba3-23d16f171d38 admin admin] REQUEST_METHOD: `DELETE` {{(pid=71939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 24 17:00:50.071805 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31b26429-e803-4480-aba3-23d16f171d38 admin admin] SCRIPT_NAME: `/identity` {{(pid=71939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 24 17:00:50.072134 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31b26429-e803-4480-aba3-23d16f171d38 admin admin] PATH_INFO: `/v3/projects/5cc13cae27b44244a8689655f00d3360` {{(pid=71939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 24 17:00:50.073893 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31b26429-e803-4480-aba3-23d16f171d38 admin admin] RBAC: Authorizing `identity:delete_project(project_id=5cc13cae27b44244a8689655f00d3360)` {{(pid=71939) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:442}} Nov 24 17:00:50.103008 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31b26429-e803-4480-aba3-23d16f171d38 admin admin] RBAC: Authorization granted {{(pid=71939) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 24 17:00:50.154379 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.notifications [None req-31b26429-e803-4480-aba3-23d16f171d38 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '5cc13cae27b44244a8689655f00d3360', 'request_id': 'req-31b26429-e803-4480-aba3-23d16f171d38'} {{(pid=71939) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:357}} Nov 24 17:00:50.166689 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.notifications [None req-31b26429-e803-4480-aba3-23d16f171d38 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '5cc13cae27b44244a8689655f00d3360', 'request_id': 'req-31b26429-e803-4480-aba3-23d16f171d38'} {{(pid=71939) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:357}} Nov 24 17:00:50.173033 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.notifications [None req-31b26429-e803-4480-aba3-23d16f171d38 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '5cc13cae27b44244a8689655f00d3360', 'request_id': 'req-31b26429-e803-4480-aba3-23d16f171d38'} {{(pid=71939) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:357}} Nov 24 17:00:50.184769 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.notifications [None req-31b26429-e803-4480-aba3-23d16f171d38 admin admin] The token cache is being invalidate because project 5cc13cae27b44244a8689655f00d3360 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=71939) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Nov 24 17:00:50.185102 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.notifications [None req-31b26429-e803-4480-aba3-23d16f171d38 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=71939) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:357}} Nov 24 17:00:50.185779 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.notifications [None req-31b26429-e803-4480-aba3-23d16f171d38 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=71939) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:357}} Nov 24 17:00:50.187357 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: [pid: 71939|app: 0|req: 1365/2717] 10.222.0.53 () {58 vars in 1223 bytes} [Wed Nov 24 17:00:49 2021] DELETE /identity/v3/projects/5cc13cae27b44244a8689655f00d3360 => generated 0 bytes in 200 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 24 17:00:50.193673 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-156242f4-5633-44c6-be72-02291a6d9838 None None] REQUEST_METHOD: `POST` {{(pid=71938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 24 17:00:50.194039 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-156242f4-5633-44c6-be72-02291a6d9838 None None] SCRIPT_NAME: `/identity` {{(pid=71938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 24 17:00:50.194422 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-156242f4-5633-44c6-be72-02291a6d9838 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=71938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 24 17:00:50.218860 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.auth.core [None req-156242f4-5633-44c6-be72-02291a6d9838 None None] MFA Rules not processed for user `0f2ba2e8375b4e8c8792ee1e22b60427`. Rule list: `[]` (Enabled: `True`). {{(pid=71938) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:442}} Nov 24 17:00:50.220075 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.fernet_utils [None req-156242f4-5633-44c6-be72-02291a6d9838 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=71938) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:289}} Nov 24 17:00:50.287513 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: [pid: 71938|app: 0|req: 1353/2718] 10.222.0.53 () {58 vars in 948 bytes} [Wed Nov 24 17:00:50 2021] POST /identity/v3/auth/tokens => generated 3669 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 24 17:00:50.296864 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db1ae23c-3c3f-43d5-80c3-367ef9e7e299 None None] REQUEST_METHOD: `POST` {{(pid=71939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 24 17:00:50.297210 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db1ae23c-3c3f-43d5-80c3-367ef9e7e299 None None] SCRIPT_NAME: `/identity` {{(pid=71939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 24 17:00:50.297547 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db1ae23c-3c3f-43d5-80c3-367ef9e7e299 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=71939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 24 17:00:50.324074 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.auth.core [None req-db1ae23c-3c3f-43d5-80c3-367ef9e7e299 None None] MFA Rules not processed for user `0f2ba2e8375b4e8c8792ee1e22b60427`. Rule list: `[]` (Enabled: `True`). {{(pid=71939) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:442}} Nov 24 17:00:50.325305 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.fernet_utils [None req-db1ae23c-3c3f-43d5-80c3-367ef9e7e299 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=71939) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:289}} Nov 24 17:00:50.333067 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: [pid: 71939|app: 0|req: 1366/2719] 10.222.0.53 () {58 vars in 948 bytes} [Wed Nov 24 17:00:50 2021] POST /identity/v3/auth/tokens => generated 3669 bytes in 37 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 24 17:00:50.337490 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-156242f4-5633-44c6-be72-02291a6d9838 None None] Authenticating user token {{(pid=71938) process_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 24 17:00:50.347792 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-156242f4-5633-44c6-be72-02291a6d9838 None None] Validating token access rules against request {{(pid=71938) validate_allowed_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 24 17:00:50.352268 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1126b554-107e-402c-b456-4c6f0dd47ed4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f2ba2e8375b4e8c8792ee1e22b60427', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '00a5583c7b7443e98e7a1d31a0b638dc', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=71938) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 24 17:00:50.352926 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1126b554-107e-402c-b456-4c6f0dd47ed4 admin admin] REQUEST_METHOD: `GET` {{(pid=71938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 24 17:00:50.353260 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1126b554-107e-402c-b456-4c6f0dd47ed4 admin admin] SCRIPT_NAME: `/identity` {{(pid=71938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 24 17:00:50.353592 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1126b554-107e-402c-b456-4c6f0dd47ed4 admin admin] PATH_INFO: `/v3/domains` {{(pid=71938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 24 17:00:50.354404 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1126b554-107e-402c-b456-4c6f0dd47ed4 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=71938) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:161}} Nov 24 17:00:50.354779 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1126b554-107e-402c-b456-4c6f0dd47ed4 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=71938) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:442}} Nov 24 17:00:50.383282 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1126b554-107e-402c-b456-4c6f0dd47ed4 admin admin] RBAC: Authorization granted {{(pid=71938) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 24 17:00:50.398610 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: [pid: 71938|app: 0|req: 1354/2720] 10.222.0.53 () {58 vars in 1143 bytes} [Wed Nov 24 17:00:50 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 62 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 24 17:00:50.403174 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db1ae23c-3c3f-43d5-80c3-367ef9e7e299 None None] Authenticating user token {{(pid=71939) process_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 24 17:00:50.412551 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db1ae23c-3c3f-43d5-80c3-367ef9e7e299 None None] Validating token access rules against request {{(pid=71939) validate_allowed_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 24 17:00:50.417102 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d718f50c-8dfb-4376-9c1c-2ba9004c04af admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f2ba2e8375b4e8c8792ee1e22b60427', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '00a5583c7b7443e98e7a1d31a0b638dc', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=71939) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 24 17:00:50.417758 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d718f50c-8dfb-4376-9c1c-2ba9004c04af admin admin] REQUEST_METHOD: `POST` {{(pid=71939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 24 17:00:50.418126 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d718f50c-8dfb-4376-9c1c-2ba9004c04af admin admin] SCRIPT_NAME: `/identity` {{(pid=71939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 24 17:00:50.418464 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d718f50c-8dfb-4376-9c1c-2ba9004c04af admin admin] PATH_INFO: `/v3/projects` {{(pid=71939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 24 17:00:50.419204 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d718f50c-8dfb-4376-9c1c-2ba9004c04af admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=71939) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:442}} Nov 24 17:00:50.448217 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d718f50c-8dfb-4376-9c1c-2ba9004c04af admin admin] RBAC: Authorization granted {{(pid=71939) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 24 17:00:50.475695 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: [pid: 71939|app: 0|req: 1367/2721] 10.222.0.53 () {60 vars in 1143 bytes} [Wed Nov 24 17:00:50 2021] POST /identity/v3/projects => generated 365 bytes in 73 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Nov 24 17:00:50.480408 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1126b554-107e-402c-b456-4c6f0dd47ed4 admin admin] Authenticating user token {{(pid=71938) process_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 24 17:00:50.490519 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1126b554-107e-402c-b456-4c6f0dd47ed4 admin admin] Validating token access rules against request {{(pid=71938) validate_allowed_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 24 17:00:50.555436 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8d2f7ba-c08f-47d8-9bd7-0dcc3215737b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f2ba2e8375b4e8c8792ee1e22b60427', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '00a5583c7b7443e98e7a1d31a0b638dc', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=71938) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 24 17:00:50.556115 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8d2f7ba-c08f-47d8-9bd7-0dcc3215737b admin admin] REQUEST_METHOD: `POST` {{(pid=71938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 24 17:00:50.556462 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8d2f7ba-c08f-47d8-9bd7-0dcc3215737b admin admin] SCRIPT_NAME: `/identity` {{(pid=71938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 24 17:00:50.556797 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8d2f7ba-c08f-47d8-9bd7-0dcc3215737b admin admin] PATH_INFO: `/v3/users` {{(pid=71938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 24 17:00:50.557523 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8d2f7ba-c08f-47d8-9bd7-0dcc3215737b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=71938) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:442}} Nov 24 17:00:50.587116 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8d2f7ba-c08f-47d8-9bd7-0dcc3215737b admin admin] RBAC: Authorization granted {{(pid=71938) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 24 17:00:50.605240 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: [pid: 71938|app: 0|req: 1355/2722] 10.222.0.53 () {60 vars in 1134 bytes} [Wed Nov 24 17:00:50 2021] POST /identity/v3/users => generated 283 bytes in 125 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 24 17:00:50.609754 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d718f50c-8dfb-4376-9c1c-2ba9004c04af admin admin] Authenticating user token {{(pid=71939) process_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 24 17:00:50.620113 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d718f50c-8dfb-4376-9c1c-2ba9004c04af admin admin] Validating token access rules against request {{(pid=71939) validate_allowed_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 24 17:00:50.625108 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-189112c8-fb43-4f7c-aa7f-bea58b8e204e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f2ba2e8375b4e8c8792ee1e22b60427', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '00a5583c7b7443e98e7a1d31a0b638dc', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=71939) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 24 17:00:50.625776 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-189112c8-fb43-4f7c-aa7f-bea58b8e204e admin admin] REQUEST_METHOD: `GET` {{(pid=71939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 24 17:00:50.626142 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-189112c8-fb43-4f7c-aa7f-bea58b8e204e admin admin] SCRIPT_NAME: `/identity` {{(pid=71939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 24 17:00:50.626485 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-189112c8-fb43-4f7c-aa7f-bea58b8e204e admin admin] PATH_INFO: `/v3/roles` {{(pid=71939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 24 17:00:50.627248 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-189112c8-fb43-4f7c-aa7f-bea58b8e204e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=71939) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:442}} Nov 24 17:00:50.655577 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-189112c8-fb43-4f7c-aa7f-bea58b8e204e admin admin] RBAC: Authorization granted {{(pid=71939) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 24 17:00:50.666196 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: [pid: 71939|app: 0|req: 1368/2723] 10.222.0.53 () {58 vars in 1112 bytes} [Wed Nov 24 17:00:50 2021] GET /identity/v3/roles => generated 1420 bytes in 57 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 24 17:00:50.670425 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8d2f7ba-c08f-47d8-9bd7-0dcc3215737b admin admin] Authenticating user token {{(pid=71938) process_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 24 17:00:50.681180 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8d2f7ba-c08f-47d8-9bd7-0dcc3215737b admin admin] Validating token access rules against request {{(pid=71938) validate_allowed_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 24 17:00:50.687079 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a57c8618-9137-40f9-a77a-1ab8b9520d44 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f2ba2e8375b4e8c8792ee1e22b60427', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '00a5583c7b7443e98e7a1d31a0b638dc', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=71938) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 24 17:00:50.688023 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a57c8618-9137-40f9-a77a-1ab8b9520d44 admin admin] REQUEST_METHOD: `PUT` {{(pid=71938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 24 17:00:50.688363 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a57c8618-9137-40f9-a77a-1ab8b9520d44 admin admin] SCRIPT_NAME: `/identity` {{(pid=71938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 24 17:00:50.688701 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a57c8618-9137-40f9-a77a-1ab8b9520d44 admin admin] PATH_INFO: `/v3/projects/519ff2d632e54d55ba8baddb010d06cb/users/d644fa6a308f4ce488b71471a1e2f0c0/roles/912ab5f10fa5477da74acf239f07604e` {{(pid=71938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 24 17:00:50.712886 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a57c8618-9137-40f9-a77a-1ab8b9520d44 admin admin] RBAC: Authorizing `identity:create_grant(project_id=519ff2d632e54d55ba8baddb010d06cb, user_id=d644fa6a308f4ce488b71471a1e2f0c0, role_id=912ab5f10fa5477da74acf239f07604e)` {{(pid=71938) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:442}} Nov 24 17:00:50.743133 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a57c8618-9137-40f9-a77a-1ab8b9520d44 admin admin] RBAC: Authorization granted {{(pid=71938) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 24 17:00:50.756745 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: [pid: 71938|app: 0|req: 1356/2724] 10.222.0.53 () {60 vars in 1473 bytes} [Wed Nov 24 17:00:50 2021] PUT /identity/v3/projects/519ff2d632e54d55ba8baddb010d06cb/users/d644fa6a308f4ce488b71471a1e2f0c0/roles/912ab5f10fa5477da74acf239f07604e => generated 0 bytes in 87 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 24 17:00:50.768072 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccbf9ae6-1e23-45ff-8f71-5603ec3a96f6 None None] REQUEST_METHOD: `POST` {{(pid=71939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 24 17:00:50.768540 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccbf9ae6-1e23-45ff-8f71-5603ec3a96f6 None None] SCRIPT_NAME: `/identity` {{(pid=71939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 24 17:00:50.768955 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccbf9ae6-1e23-45ff-8f71-5603ec3a96f6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=71939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 24 17:00:50.810632 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.auth.core [None req-ccbf9ae6-1e23-45ff-8f71-5603ec3a96f6 None None] MFA Rules not processed for user `d644fa6a308f4ce488b71471a1e2f0c0`. Rule list: `[]` (Enabled: `True`). {{(pid=71939) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:442}} Nov 24 17:00:50.811855 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.fernet_utils [None req-ccbf9ae6-1e23-45ff-8f71-5603ec3a96f6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=71939) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:289}} Nov 24 17:00:50.888219 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: [pid: 71939|app: 0|req: 1369/2725] 10.222.0.53 () {58 vars in 948 bytes} [Wed Nov 24 17:00:50 2021] POST /identity/v3/auth/tokens => generated 3672 bytes in 121 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 24 17:00:50.901045 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a57c8618-9137-40f9-a77a-1ab8b9520d44 admin admin] Authenticating user token {{(pid=71938) process_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 24 17:00:50.902907 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.fernet_utils [None req-a57c8618-9137-40f9-a77a-1ab8b9520d44 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=71938) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:289}} Nov 24 17:00:50.971036 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a57c8618-9137-40f9-a77a-1ab8b9520d44 admin admin] Validating token access rules against request {{(pid=71938) validate_allowed_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 24 17:00:50.974743 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58a4770d-99b6-41b1-9bd5-deeb876a7e0a service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'af9e91f8d56c491d99fab4346754ce2e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3b3940d4ae1c4177ae29c02377bb4b0b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=71938) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 24 17:00:50.975407 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58a4770d-99b6-41b1-9bd5-deeb876a7e0a service glance] REQUEST_METHOD: `GET` {{(pid=71938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 24 17:00:50.975750 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58a4770d-99b6-41b1-9bd5-deeb876a7e0a service glance] SCRIPT_NAME: `/identity` {{(pid=71938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 24 17:00:50.976086 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58a4770d-99b6-41b1-9bd5-deeb876a7e0a service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=71938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 24 17:00:50.985384 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58a4770d-99b6-41b1-9bd5-deeb876a7e0a service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=71938) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:442}} Nov 24 17:00:51.014020 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58a4770d-99b6-41b1-9bd5-deeb876a7e0a service glance] RBAC: Authorization granted {{(pid=71938) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 24 17:00:51.023256 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: [pid: 71938|app: 0|req: 1357/2726] 10.222.0.53 () {60 vars in 1356 bytes} [Wed Nov 24 17:00:50 2021] GET /identity/v3/auth/tokens => generated 3672 bytes in 123 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Nov 24 17:01:12.270402 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccbf9ae6-1e23-45ff-8f71-5603ec3a96f6 None None] Authenticating user token {{(pid=71939) process_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 24 17:01:12.271974 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.fernet_utils [None req-ccbf9ae6-1e23-45ff-8f71-5603ec3a96f6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=71939) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:289}} Nov 24 17:01:12.340953 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccbf9ae6-1e23-45ff-8f71-5603ec3a96f6 None None] Validating token access rules against request {{(pid=71939) validate_allowed_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 24 17:01:12.344559 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ecc8ab6-d316-4f40-8dbc-980fa53ad298 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c90f21b9cdcb413282461fa83cb6b7a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3b3940d4ae1c4177ae29c02377bb4b0b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=71939) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 24 17:01:12.345216 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ecc8ab6-d316-4f40-8dbc-980fa53ad298 service neutron] REQUEST_METHOD: `GET` {{(pid=71939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 24 17:01:12.345560 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ecc8ab6-d316-4f40-8dbc-980fa53ad298 service neutron] SCRIPT_NAME: `/identity` {{(pid=71939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 24 17:01:12.345894 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ecc8ab6-d316-4f40-8dbc-980fa53ad298 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=71939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 24 17:01:12.347795 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.fernet_utils [None req-8ecc8ab6-d316-4f40-8dbc-980fa53ad298 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=71939) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:289}} Nov 24 17:01:12.357794 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ecc8ab6-d316-4f40-8dbc-980fa53ad298 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=71939) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:442}} Nov 24 17:01:12.386370 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ecc8ab6-d316-4f40-8dbc-980fa53ad298 service neutron] RBAC: Authorization granted {{(pid=71939) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 24 17:01:12.395689 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: [pid: 71939|app: 0|req: 1370/2727] 10.222.0.53 () {60 vars in 1356 bytes} [Wed Nov 24 17:01:12 2021] GET /identity/v3/auth/tokens => generated 3551 bytes in 126 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 24 17:01:23.841584 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58a4770d-99b6-41b1-9bd5-deeb876a7e0a service glance] Authenticating user token {{(pid=71938) process_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 24 17:01:23.917929 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58a4770d-99b6-41b1-9bd5-deeb876a7e0a service glance] Validating token access rules against request {{(pid=71938) validate_allowed_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 24 17:01:23.922524 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0aeeeb7b-096b-4e21-9724-ec101e612c36 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f2ba2e8375b4e8c8792ee1e22b60427', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '00a5583c7b7443e98e7a1d31a0b638dc', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=71938) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 24 17:01:23.923421 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0aeeeb7b-096b-4e21-9724-ec101e612c36 admin admin] REQUEST_METHOD: `DELETE` {{(pid=71938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 24 17:01:23.923760 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0aeeeb7b-096b-4e21-9724-ec101e612c36 admin admin] SCRIPT_NAME: `/identity` {{(pid=71938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 24 17:01:23.924087 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0aeeeb7b-096b-4e21-9724-ec101e612c36 admin admin] PATH_INFO: `/v3/users/d644fa6a308f4ce488b71471a1e2f0c0` {{(pid=71938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 24 17:01:23.925311 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0aeeeb7b-096b-4e21-9724-ec101e612c36 admin admin] RBAC: Authorizing `identity:delete_user(user_id=d644fa6a308f4ce488b71471a1e2f0c0)` {{(pid=71938) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:442}} Nov 24 17:01:23.954654 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0aeeeb7b-096b-4e21-9724-ec101e612c36 admin admin] RBAC: Authorization granted {{(pid=71938) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 24 17:01:24.001854 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.notifications [None req-0aeeeb7b-096b-4e21-9724-ec101e612c36 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd644fa6a308f4ce488b71471a1e2f0c0'} {{(pid=71938) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:357}} Nov 24 17:01:24.014993 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.notifications [None req-0aeeeb7b-096b-4e21-9724-ec101e612c36 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd644fa6a308f4ce488b71471a1e2f0c0'} {{(pid=71938) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:357}} Nov 24 17:01:24.015714 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.notifications [None req-0aeeeb7b-096b-4e21-9724-ec101e612c36 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd644fa6a308f4ce488b71471a1e2f0c0'} {{(pid=71938) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:357}} Nov 24 17:01:24.023884 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.notifications [None req-0aeeeb7b-096b-4e21-9724-ec101e612c36 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd644fa6a308f4ce488b71471a1e2f0c0'} {{(pid=71938) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:357}} Nov 24 17:01:24.030295 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.notifications [None req-0aeeeb7b-096b-4e21-9724-ec101e612c36 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd644fa6a308f4ce488b71471a1e2f0c0'} {{(pid=71938) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:357}} Nov 24 17:01:24.036511 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: [pid: 71938|app: 0|req: 1358/2728] 10.222.0.53 () {58 vars in 1214 bytes} [Wed Nov 24 17:01:23 2021] DELETE /identity/v3/users/d644fa6a308f4ce488b71471a1e2f0c0 => generated 0 bytes in 196 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 24 17:01:24.041357 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a60170d-c635-4416-8f5c-0f7be60f8d18 None None] REQUEST_METHOD: `POST` {{(pid=71939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 24 17:01:24.041709 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a60170d-c635-4416-8f5c-0f7be60f8d18 None None] SCRIPT_NAME: `/identity` {{(pid=71939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 24 17:01:24.042082 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a60170d-c635-4416-8f5c-0f7be60f8d18 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=71939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 24 17:01:24.066510 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.auth.core [None req-0a60170d-c635-4416-8f5c-0f7be60f8d18 None None] MFA Rules not processed for user `0f2ba2e8375b4e8c8792ee1e22b60427`. Rule list: `[]` (Enabled: `True`). {{(pid=71939) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:442}} Nov 24 17:01:24.067729 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.fernet_utils [None req-0a60170d-c635-4416-8f5c-0f7be60f8d18 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=71939) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:289}} Nov 24 17:01:24.135056 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: [pid: 71939|app: 0|req: 1371/2729] 10.222.0.53 () {58 vars in 948 bytes} [Wed Nov 24 17:01:24 2021] POST /identity/v3/auth/tokens => generated 3669 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 24 17:01:24.146660 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0aeeeb7b-096b-4e21-9724-ec101e612c36 admin admin] Authenticating user token {{(pid=71938) process_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 24 17:01:24.148117 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.fernet_utils [None req-0aeeeb7b-096b-4e21-9724-ec101e612c36 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=71938) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:289}} Nov 24 17:01:24.216067 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0aeeeb7b-096b-4e21-9724-ec101e612c36 admin admin] Validating token access rules against request {{(pid=71938) validate_allowed_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 24 17:01:24.219677 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbc2604e-36e2-492e-a111-e9d7b992af9a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c90f21b9cdcb413282461fa83cb6b7a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3b3940d4ae1c4177ae29c02377bb4b0b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=71938) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 24 17:01:24.220334 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbc2604e-36e2-492e-a111-e9d7b992af9a service neutron] REQUEST_METHOD: `GET` {{(pid=71938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 24 17:01:24.220672 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbc2604e-36e2-492e-a111-e9d7b992af9a service neutron] SCRIPT_NAME: `/identity` {{(pid=71938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 24 17:01:24.221002 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbc2604e-36e2-492e-a111-e9d7b992af9a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=71938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 24 17:01:24.230510 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbc2604e-36e2-492e-a111-e9d7b992af9a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=71938) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:442}} Nov 24 17:01:24.259227 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbc2604e-36e2-492e-a111-e9d7b992af9a service neutron] RBAC: Authorization granted {{(pid=71938) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 24 17:01:24.269716 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: [pid: 71938|app: 0|req: 1359/2730] 10.222.0.53 () {60 vars in 1356 bytes} [Wed Nov 24 17:01:24 2021] GET /identity/v3/auth/tokens => generated 3669 bytes in 124 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 24 17:01:24.626526 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a60170d-c635-4416-8f5c-0f7be60f8d18 None None] Authenticating user token {{(pid=71939) process_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 24 17:01:24.628014 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.fernet_utils [None req-0a60170d-c635-4416-8f5c-0f7be60f8d18 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=71939) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:289}} Nov 24 17:01:24.640725 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a60170d-c635-4416-8f5c-0f7be60f8d18 None None] Validating token access rules against request {{(pid=71939) validate_allowed_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 24 17:01:24.645474 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b83446e4-6872-4381-bb41-9ae8010d90d1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f2ba2e8375b4e8c8792ee1e22b60427', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '00a5583c7b7443e98e7a1d31a0b638dc', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=71939) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 24 17:01:24.646387 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b83446e4-6872-4381-bb41-9ae8010d90d1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=71939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 24 17:01:24.646730 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b83446e4-6872-4381-bb41-9ae8010d90d1 admin admin] SCRIPT_NAME: `/identity` {{(pid=71939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 24 17:01:24.647063 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b83446e4-6872-4381-bb41-9ae8010d90d1 admin admin] PATH_INFO: `/v3/projects/519ff2d632e54d55ba8baddb010d06cb` {{(pid=71939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 24 17:01:24.648279 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b83446e4-6872-4381-bb41-9ae8010d90d1 admin admin] RBAC: Authorizing `identity:delete_project(project_id=519ff2d632e54d55ba8baddb010d06cb)` {{(pid=71939) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:442}} Nov 24 17:01:24.677056 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b83446e4-6872-4381-bb41-9ae8010d90d1 admin admin] RBAC: Authorization granted {{(pid=71939) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 24 17:01:24.729718 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.notifications [None req-b83446e4-6872-4381-bb41-9ae8010d90d1 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '519ff2d632e54d55ba8baddb010d06cb', 'request_id': 'req-b83446e4-6872-4381-bb41-9ae8010d90d1'} {{(pid=71939) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:357}} Nov 24 17:01:24.742134 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.notifications [None req-b83446e4-6872-4381-bb41-9ae8010d90d1 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '519ff2d632e54d55ba8baddb010d06cb', 'request_id': 'req-b83446e4-6872-4381-bb41-9ae8010d90d1'} {{(pid=71939) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:357}} Nov 24 17:01:24.748871 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.notifications [None req-b83446e4-6872-4381-bb41-9ae8010d90d1 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '519ff2d632e54d55ba8baddb010d06cb', 'request_id': 'req-b83446e4-6872-4381-bb41-9ae8010d90d1'} {{(pid=71939) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:357}} Nov 24 17:01:24.759193 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.notifications [None req-b83446e4-6872-4381-bb41-9ae8010d90d1 admin admin] The token cache is being invalidate because project 519ff2d632e54d55ba8baddb010d06cb was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=71939) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Nov 24 17:01:24.759522 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.notifications [None req-b83446e4-6872-4381-bb41-9ae8010d90d1 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=71939) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:357}} Nov 24 17:01:24.760192 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.notifications [None req-b83446e4-6872-4381-bb41-9ae8010d90d1 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=71939) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:357}} Nov 24 17:01:24.761732 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: [pid: 71939|app: 0|req: 1372/2731] 10.222.0.53 () {58 vars in 1223 bytes} [Wed Nov 24 17:01:24 2021] DELETE /identity/v3/projects/519ff2d632e54d55ba8baddb010d06cb => generated 0 bytes in 136 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 24 17:01:24.768206 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1cb1aff-c04e-4700-b538-e6f13974ef22 None None] REQUEST_METHOD: `POST` {{(pid=71938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 24 17:01:24.768553 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1cb1aff-c04e-4700-b538-e6f13974ef22 None None] SCRIPT_NAME: `/identity` {{(pid=71938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 24 17:01:24.768888 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1cb1aff-c04e-4700-b538-e6f13974ef22 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=71938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 24 17:01:24.792805 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.auth.core [None req-f1cb1aff-c04e-4700-b538-e6f13974ef22 None None] MFA Rules not processed for user `0f2ba2e8375b4e8c8792ee1e22b60427`. Rule list: `[]` (Enabled: `True`). {{(pid=71938) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:442}} Nov 24 17:01:24.794698 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.fernet_utils [None req-f1cb1aff-c04e-4700-b538-e6f13974ef22 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=71938) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:289}} Nov 24 17:01:24.866801 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: [pid: 71938|app: 0|req: 1360/2732] 10.222.0.53 () {58 vars in 948 bytes} [Wed Nov 24 17:01:24 2021] POST /identity/v3/auth/tokens => generated 3669 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 24 17:01:24.876163 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3b7c04b-db63-4197-8560-dbdb998d0fef None None] REQUEST_METHOD: `POST` {{(pid=71939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 24 17:01:24.876512 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3b7c04b-db63-4197-8560-dbdb998d0fef None None] SCRIPT_NAME: `/identity` {{(pid=71939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 24 17:01:24.876848 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3b7c04b-db63-4197-8560-dbdb998d0fef None None] PATH_INFO: `/v3/auth/tokens` {{(pid=71939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 24 17:01:24.900690 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.auth.core [None req-c3b7c04b-db63-4197-8560-dbdb998d0fef None None] MFA Rules not processed for user `0f2ba2e8375b4e8c8792ee1e22b60427`. Rule list: `[]` (Enabled: `True`). {{(pid=71939) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:442}} Nov 24 17:01:24.901955 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.fernet_utils [None req-c3b7c04b-db63-4197-8560-dbdb998d0fef None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=71939) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:289}} Nov 24 17:01:24.910480 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: [pid: 71939|app: 0|req: 1373/2733] 10.222.0.53 () {58 vars in 948 bytes} [Wed Nov 24 17:01:24 2021] POST /identity/v3/auth/tokens => generated 3669 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 24 17:01:24.915059 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1cb1aff-c04e-4700-b538-e6f13974ef22 None None] Authenticating user token {{(pid=71938) process_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 24 17:01:24.925590 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1cb1aff-c04e-4700-b538-e6f13974ef22 None None] Validating token access rules against request {{(pid=71938) validate_allowed_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 24 17:01:24.930245 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ae4ff1d-d742-4f74-a43f-7b043290b36b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f2ba2e8375b4e8c8792ee1e22b60427', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '00a5583c7b7443e98e7a1d31a0b638dc', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=71938) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 24 17:01:24.930919 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ae4ff1d-d742-4f74-a43f-7b043290b36b admin admin] REQUEST_METHOD: `GET` {{(pid=71938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 24 17:01:24.931260 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ae4ff1d-d742-4f74-a43f-7b043290b36b admin admin] SCRIPT_NAME: `/identity` {{(pid=71938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 24 17:01:24.931591 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ae4ff1d-d742-4f74-a43f-7b043290b36b admin admin] PATH_INFO: `/v3/domains` {{(pid=71938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 24 17:01:24.932384 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ae4ff1d-d742-4f74-a43f-7b043290b36b admin admin] RBAC: Adding query filter params (name=Default) {{(pid=71938) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:161}} Nov 24 17:01:24.933455 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ae4ff1d-d742-4f74-a43f-7b043290b36b admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=71938) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:442}} Nov 24 17:01:24.961175 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ae4ff1d-d742-4f74-a43f-7b043290b36b admin admin] RBAC: Authorization granted {{(pid=71938) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 24 17:01:24.975572 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: [pid: 71938|app: 0|req: 1361/2734] 10.222.0.53 () {58 vars in 1143 bytes} [Wed Nov 24 17:01:24 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 61 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 24 17:01:24.980400 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3b7c04b-db63-4197-8560-dbdb998d0fef None None] Authenticating user token {{(pid=71939) process_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 24 17:01:24.990524 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3b7c04b-db63-4197-8560-dbdb998d0fef None None] Validating token access rules against request {{(pid=71939) validate_allowed_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 24 17:01:24.995152 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c66bbe34-9e1b-4b13-9299-81e3321e2ffb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f2ba2e8375b4e8c8792ee1e22b60427', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '00a5583c7b7443e98e7a1d31a0b638dc', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=71939) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 24 17:01:24.995810 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c66bbe34-9e1b-4b13-9299-81e3321e2ffb admin admin] REQUEST_METHOD: `POST` {{(pid=71939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 24 17:01:24.996151 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c66bbe34-9e1b-4b13-9299-81e3321e2ffb admin admin] SCRIPT_NAME: `/identity` {{(pid=71939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 24 17:01:24.996517 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c66bbe34-9e1b-4b13-9299-81e3321e2ffb admin admin] PATH_INFO: `/v3/projects` {{(pid=71939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 24 17:01:24.997290 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c66bbe34-9e1b-4b13-9299-81e3321e2ffb admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=71939) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:442}} Nov 24 17:01:25.025498 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c66bbe34-9e1b-4b13-9299-81e3321e2ffb admin admin] RBAC: Authorization granted {{(pid=71939) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 24 17:01:25.053724 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: [pid: 71939|app: 0|req: 1374/2735] 10.222.0.53 () {60 vars in 1143 bytes} [Wed Nov 24 17:01:24 2021] POST /identity/v3/projects => generated 383 bytes in 74 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 24 17:01:25.058485 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ae4ff1d-d742-4f74-a43f-7b043290b36b admin admin] Authenticating user token {{(pid=71938) process_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 24 17:01:25.069124 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ae4ff1d-d742-4f74-a43f-7b043290b36b admin admin] Validating token access rules against request {{(pid=71938) validate_allowed_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 24 17:01:25.134160 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5aa7a27-8e55-4c97-a87f-d52e7a56df6c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f2ba2e8375b4e8c8792ee1e22b60427', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '00a5583c7b7443e98e7a1d31a0b638dc', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=71938) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 24 17:01:25.134845 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5aa7a27-8e55-4c97-a87f-d52e7a56df6c admin admin] REQUEST_METHOD: `POST` {{(pid=71938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 24 17:01:25.135185 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5aa7a27-8e55-4c97-a87f-d52e7a56df6c admin admin] SCRIPT_NAME: `/identity` {{(pid=71938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 24 17:01:25.135519 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5aa7a27-8e55-4c97-a87f-d52e7a56df6c admin admin] PATH_INFO: `/v3/users` {{(pid=71938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 24 17:01:25.136244 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5aa7a27-8e55-4c97-a87f-d52e7a56df6c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=71938) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:442}} Nov 24 17:01:25.165512 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5aa7a27-8e55-4c97-a87f-d52e7a56df6c admin admin] RBAC: Authorization granted {{(pid=71938) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 24 17:01:25.187551 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: [pid: 71938|app: 0|req: 1362/2736] 10.222.0.53 () {60 vars in 1134 bytes} [Wed Nov 24 17:01:25 2021] POST /identity/v3/users => generated 292 bytes in 130 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 24 17:01:25.192107 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c66bbe34-9e1b-4b13-9299-81e3321e2ffb admin admin] Authenticating user token {{(pid=71939) process_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 24 17:01:25.202639 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c66bbe34-9e1b-4b13-9299-81e3321e2ffb admin admin] Validating token access rules against request {{(pid=71939) validate_allowed_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 24 17:01:25.207180 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d930ed02-2a84-4020-a02c-c735486d6b84 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f2ba2e8375b4e8c8792ee1e22b60427', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '00a5583c7b7443e98e7a1d31a0b638dc', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=71939) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 24 17:01:25.207855 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d930ed02-2a84-4020-a02c-c735486d6b84 admin admin] REQUEST_METHOD: `GET` {{(pid=71939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 24 17:01:25.208197 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d930ed02-2a84-4020-a02c-c735486d6b84 admin admin] SCRIPT_NAME: `/identity` {{(pid=71939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 24 17:01:25.208530 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d930ed02-2a84-4020-a02c-c735486d6b84 admin admin] PATH_INFO: `/v3/roles` {{(pid=71939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 24 17:01:25.209358 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d930ed02-2a84-4020-a02c-c735486d6b84 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=71939) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:442}} Nov 24 17:01:25.237861 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d930ed02-2a84-4020-a02c-c735486d6b84 admin admin] RBAC: Authorization granted {{(pid=71939) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 24 17:01:25.249651 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: [pid: 71939|app: 0|req: 1375/2737] 10.222.0.53 () {58 vars in 1112 bytes} [Wed Nov 24 17:01:25 2021] GET /identity/v3/roles => generated 1420 bytes in 58 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 24 17:01:25.254160 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5aa7a27-8e55-4c97-a87f-d52e7a56df6c admin admin] Authenticating user token {{(pid=71938) process_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 24 17:01:25.264363 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5aa7a27-8e55-4c97-a87f-d52e7a56df6c admin admin] Validating token access rules against request {{(pid=71938) validate_allowed_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 24 17:01:25.268957 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f34d95a0-c077-4571-93ee-d50f59738998 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f2ba2e8375b4e8c8792ee1e22b60427', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '00a5583c7b7443e98e7a1d31a0b638dc', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=71938) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 24 17:01:25.269858 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f34d95a0-c077-4571-93ee-d50f59738998 admin admin] REQUEST_METHOD: `PUT` {{(pid=71938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 24 17:01:25.270236 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f34d95a0-c077-4571-93ee-d50f59738998 admin admin] SCRIPT_NAME: `/identity` {{(pid=71938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 24 17:01:25.270602 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f34d95a0-c077-4571-93ee-d50f59738998 admin admin] PATH_INFO: `/v3/projects/c81e7a74b5d641a4809c97b8741f3cf7/users/d26062d73eba417cade03161e754914b/roles/912ab5f10fa5477da74acf239f07604e` {{(pid=71938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 24 17:01:25.291244 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f34d95a0-c077-4571-93ee-d50f59738998 admin admin] RBAC: Authorizing `identity:create_grant(project_id=c81e7a74b5d641a4809c97b8741f3cf7, user_id=d26062d73eba417cade03161e754914b, role_id=912ab5f10fa5477da74acf239f07604e)` {{(pid=71938) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:442}} Nov 24 17:01:25.321641 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f34d95a0-c077-4571-93ee-d50f59738998 admin admin] RBAC: Authorization granted {{(pid=71938) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 24 17:01:25.334941 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: [pid: 71938|app: 0|req: 1363/2738] 10.222.0.53 () {60 vars in 1473 bytes} [Wed Nov 24 17:01:25 2021] PUT /identity/v3/projects/c81e7a74b5d641a4809c97b8741f3cf7/users/d26062d73eba417cade03161e754914b/roles/912ab5f10fa5477da74acf239f07604e => generated 0 bytes in 81 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 24 17:01:25.340259 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b887434c-d922-41b8-918b-b49976e2f1d0 None None] REQUEST_METHOD: `POST` {{(pid=71939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 24 17:01:25.340647 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b887434c-d922-41b8-918b-b49976e2f1d0 None None] SCRIPT_NAME: `/identity` {{(pid=71939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 24 17:01:25.341021 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b887434c-d922-41b8-918b-b49976e2f1d0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=71939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 24 17:01:25.365157 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.auth.core [None req-b887434c-d922-41b8-918b-b49976e2f1d0 None None] MFA Rules not processed for user `0f2ba2e8375b4e8c8792ee1e22b60427`. Rule list: `[]` (Enabled: `True`). {{(pid=71939) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:442}} Nov 24 17:01:25.366424 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.fernet_utils [None req-b887434c-d922-41b8-918b-b49976e2f1d0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=71939) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:289}} Nov 24 17:01:25.435332 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: [pid: 71939|app: 0|req: 1376/2739] 10.222.0.53 () {58 vars in 948 bytes} [Wed Nov 24 17:01:25 2021] POST /identity/v3/auth/tokens => generated 3669 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 24 17:01:25.446369 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f34d95a0-c077-4571-93ee-d50f59738998 admin admin] Authenticating user token {{(pid=71938) process_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 24 17:01:25.448113 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.fernet_utils [None req-f34d95a0-c077-4571-93ee-d50f59738998 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=71938) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:289}} Nov 24 17:01:25.515420 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f34d95a0-c077-4571-93ee-d50f59738998 admin admin] Validating token access rules against request {{(pid=71938) validate_allowed_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 24 17:01:25.519042 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fc20d9c-47bf-443b-8bc1-4d71e47e29ef service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c90f21b9cdcb413282461fa83cb6b7a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3b3940d4ae1c4177ae29c02377bb4b0b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=71938) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 24 17:01:25.519700 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fc20d9c-47bf-443b-8bc1-4d71e47e29ef service neutron] REQUEST_METHOD: `GET` {{(pid=71938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 24 17:01:25.520044 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fc20d9c-47bf-443b-8bc1-4d71e47e29ef service neutron] SCRIPT_NAME: `/identity` {{(pid=71938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 24 17:01:25.520380 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fc20d9c-47bf-443b-8bc1-4d71e47e29ef service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=71938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 24 17:01:25.529734 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fc20d9c-47bf-443b-8bc1-4d71e47e29ef service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=71938) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:442}} Nov 24 17:01:25.558090 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fc20d9c-47bf-443b-8bc1-4d71e47e29ef service neutron] RBAC: Authorization granted {{(pid=71938) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 24 17:01:25.568464 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: [pid: 71938|app: 0|req: 1364/2740] 10.222.0.53 () {60 vars in 1356 bytes} [Wed Nov 24 17:01:25 2021] GET /identity/v3/auth/tokens => generated 3669 bytes in 123 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 24 17:01:26.376026 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01ddafcb-5d03-4f31-8d8b-fe815bd37dc3 None None] REQUEST_METHOD: `POST` {{(pid=71939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 24 17:01:26.376543 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01ddafcb-5d03-4f31-8d8b-fe815bd37dc3 None None] SCRIPT_NAME: `/identity` {{(pid=71939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 24 17:01:26.376684 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01ddafcb-5d03-4f31-8d8b-fe815bd37dc3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=71939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 24 17:01:26.414286 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.auth.core [None req-01ddafcb-5d03-4f31-8d8b-fe815bd37dc3 None None] MFA Rules not processed for user `d26062d73eba417cade03161e754914b`. Rule list: `[]` (Enabled: `True`). {{(pid=71939) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:442}} Nov 24 17:01:26.415502 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.fernet_utils [None req-01ddafcb-5d03-4f31-8d8b-fe815bd37dc3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=71939) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:289}} Nov 24 17:01:26.492365 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: [pid: 71939|app: 0|req: 1377/2741] 10.222.0.53 () {58 vars in 948 bytes} [Wed Nov 24 17:01:26 2021] POST /identity/v3/auth/tokens => generated 3690 bytes in 117 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 24 17:01:26.503389 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fc20d9c-47bf-443b-8bc1-4d71e47e29ef service neutron] Authenticating user token {{(pid=71938) process_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 24 17:01:26.504850 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.fernet_utils [None req-1fc20d9c-47bf-443b-8bc1-4d71e47e29ef service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=71938) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:289}} Nov 24 17:01:26.574128 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fc20d9c-47bf-443b-8bc1-4d71e47e29ef service neutron] Validating token access rules against request {{(pid=71938) validate_allowed_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 24 17:01:26.578450 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-503b82e0-aaba-400b-9ab4-e20c8e01a9db service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a12374a3093a401a97c343ff0854184d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3b3940d4ae1c4177ae29c02377bb4b0b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=71938) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 24 17:01:26.579116 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-503b82e0-aaba-400b-9ab4-e20c8e01a9db service cinder] REQUEST_METHOD: `GET` {{(pid=71938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 24 17:01:26.579463 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-503b82e0-aaba-400b-9ab4-e20c8e01a9db service cinder] SCRIPT_NAME: `/identity` {{(pid=71938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 24 17:01:26.579825 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-503b82e0-aaba-400b-9ab4-e20c8e01a9db service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=71938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 24 17:01:26.588950 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-503b82e0-aaba-400b-9ab4-e20c8e01a9db service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=71938) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:442}} Nov 24 17:01:26.616985 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-503b82e0-aaba-400b-9ab4-e20c8e01a9db service cinder] RBAC: Authorization granted {{(pid=71938) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 24 17:01:26.626985 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: [pid: 71938|app: 0|req: 1365/2742] 10.222.0.53 () {60 vars in 1356 bytes} [Wed Nov 24 17:01:26 2021] GET /identity/v3/auth/tokens => generated 3690 bytes in 124 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Nov 24 17:01:28.193565 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20a120ad-ec0b-46f9-9afc-2d87f2cf3ab9 None None] REQUEST_METHOD: `POST` {{(pid=71939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 24 17:01:28.194105 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20a120ad-ec0b-46f9-9afc-2d87f2cf3ab9 None None] SCRIPT_NAME: `/identity` {{(pid=71939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 24 17:01:28.194281 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20a120ad-ec0b-46f9-9afc-2d87f2cf3ab9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=71939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 24 17:01:28.217681 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.auth.core [None req-20a120ad-ec0b-46f9-9afc-2d87f2cf3ab9 None None] MFA Rules not processed for user `d26062d73eba417cade03161e754914b`. Rule list: `[]` (Enabled: `True`). {{(pid=71939) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:442}} Nov 24 17:01:28.218943 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.fernet_utils [None req-20a120ad-ec0b-46f9-9afc-2d87f2cf3ab9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=71939) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:289}} Nov 24 17:01:28.226658 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: [pid: 71939|app: 0|req: 1378/2743] 10.222.0.53 () {58 vars in 948 bytes} [Wed Nov 24 17:01:28 2021] POST /identity/v3/auth/tokens => generated 3690 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 24 17:01:28.817975 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-503b82e0-aaba-400b-9ab4-e20c8e01a9db service cinder] Authenticating user token {{(pid=71938) process_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 24 17:01:28.819513 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.fernet_utils [None req-503b82e0-aaba-400b-9ab4-e20c8e01a9db service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=71938) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:289}} Nov 24 17:01:28.831624 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-503b82e0-aaba-400b-9ab4-e20c8e01a9db service cinder] Validating token access rules against request {{(pid=71938) validate_allowed_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 24 17:01:28.835292 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ae5bf81-291f-45e7-9e1b-be1385d34c02 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c90f21b9cdcb413282461fa83cb6b7a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3b3940d4ae1c4177ae29c02377bb4b0b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=71938) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 24 17:01:28.835947 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ae5bf81-291f-45e7-9e1b-be1385d34c02 service neutron] REQUEST_METHOD: `GET` {{(pid=71938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 24 17:01:28.836290 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ae5bf81-291f-45e7-9e1b-be1385d34c02 service neutron] SCRIPT_NAME: `/identity` {{(pid=71938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 24 17:01:28.836629 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ae5bf81-291f-45e7-9e1b-be1385d34c02 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=71938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 24 17:01:28.838421 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.fernet_utils [None req-4ae5bf81-291f-45e7-9e1b-be1385d34c02 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=71938) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:289}} Nov 24 17:01:28.848499 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ae5bf81-291f-45e7-9e1b-be1385d34c02 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=71938) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:442}} Nov 24 17:01:28.877130 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ae5bf81-291f-45e7-9e1b-be1385d34c02 service neutron] RBAC: Authorization granted {{(pid=71938) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 24 17:01:28.885428 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: [pid: 71938|app: 0|req: 1366/2744] 10.222.0.53 () {60 vars in 1356 bytes} [Wed Nov 24 17:01:28 2021] GET /identity/v3/auth/tokens => generated 3551 bytes in 68 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 24 17:01:29.319501 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f73c69b5-567f-4010-bb13-3a3479afa58f None None] REQUEST_METHOD: `POST` {{(pid=71939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 24 17:01:29.320104 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f73c69b5-567f-4010-bb13-3a3479afa58f None None] SCRIPT_NAME: `/identity` {{(pid=71939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 24 17:01:29.320104 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f73c69b5-567f-4010-bb13-3a3479afa58f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=71939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 24 17:01:29.349156 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.auth.core [None req-f73c69b5-567f-4010-bb13-3a3479afa58f None None] MFA Rules not processed for user `15ece405347842a29fbc06f934028a84`. Rule list: `[]` (Enabled: `True`). {{(pid=71939) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:442}} Nov 24 17:01:29.350516 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.fernet_utils [None req-f73c69b5-567f-4010-bb13-3a3479afa58f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=71939) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:289}} Nov 24 17:01:29.422675 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: [pid: 71939|app: 0|req: 1379/2745] 10.222.0.53 () {58 vars in 948 bytes} [Wed Nov 24 17:01:29 2021] POST /identity/v3/auth/tokens => generated 3692 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 24 17:01:30.184446 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ae5bf81-291f-45e7-9e1b-be1385d34c02 service neutron] Authenticating user token {{(pid=71938) process_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 24 17:01:30.185949 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.fernet_utils [None req-4ae5bf81-291f-45e7-9e1b-be1385d34c02 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=71938) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:289}} Nov 24 17:01:30.303816 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ae5bf81-291f-45e7-9e1b-be1385d34c02 service neutron] Validating token access rules against request {{(pid=71938) validate_allowed_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 24 17:01:30.309627 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b9434d3-06f4-40e5-acb6-a1ea216cceda service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a919320c9e2a48d7ba33453b5929d7ee', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3b3940d4ae1c4177ae29c02377bb4b0b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=71938) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 24 17:01:30.310345 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b9434d3-06f4-40e5-acb6-a1ea216cceda service placement] REQUEST_METHOD: `GET` {{(pid=71938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 24 17:01:30.310680 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b9434d3-06f4-40e5-acb6-a1ea216cceda service placement] SCRIPT_NAME: `/identity` {{(pid=71938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 24 17:01:30.311005 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b9434d3-06f4-40e5-acb6-a1ea216cceda service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=71938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 24 17:01:30.312873 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.fernet_utils [None req-6b9434d3-06f4-40e5-acb6-a1ea216cceda service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=71938) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:289}} Nov 24 17:01:30.325116 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b9434d3-06f4-40e5-acb6-a1ea216cceda service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=71938) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:442}} Nov 24 17:01:30.354009 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b9434d3-06f4-40e5-acb6-a1ea216cceda service placement] RBAC: Authorization granted {{(pid=71938) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 24 17:01:30.364478 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: [pid: 71938|app: 0|req: 1367/2746] 10.222.0.53 () {60 vars in 1356 bytes} [Wed Nov 24 17:01:30 2021] GET /identity/v3/auth/tokens => generated 3738 bytes in 180 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 24 17:01:30.479062 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f73c69b5-567f-4010-bb13-3a3479afa58f None None] Authenticating user token {{(pid=71939) process_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 24 17:01:30.492466 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f73c69b5-567f-4010-bb13-3a3479afa58f None None] Validating token access rules against request {{(pid=71939) validate_allowed_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 24 17:01:30.498005 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6072c9a7-f8a2-41a6-87fe-fa1cd99435a1 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a919320c9e2a48d7ba33453b5929d7ee', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3b3940d4ae1c4177ae29c02377bb4b0b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=71939) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 24 17:01:30.498691 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6072c9a7-f8a2-41a6-87fe-fa1cd99435a1 service placement] REQUEST_METHOD: `GET` {{(pid=71939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 24 17:01:30.499031 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6072c9a7-f8a2-41a6-87fe-fa1cd99435a1 service placement] SCRIPT_NAME: `/identity` {{(pid=71939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 24 17:01:30.499364 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6072c9a7-f8a2-41a6-87fe-fa1cd99435a1 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=71939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 24 17:01:30.501243 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.fernet_utils [None req-6072c9a7-f8a2-41a6-87fe-fa1cd99435a1 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=71939) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:289}} Nov 24 17:01:30.512751 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6072c9a7-f8a2-41a6-87fe-fa1cd99435a1 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=71939) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:442}} Nov 24 17:01:30.540596 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6072c9a7-f8a2-41a6-87fe-fa1cd99435a1 service placement] RBAC: Authorization granted {{(pid=71939) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 24 17:01:30.551463 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: [pid: 71939|app: 0|req: 1380/2747] 10.222.0.53 () {60 vars in 1356 bytes} [Wed Nov 24 17:01:30 2021] GET /identity/v3/auth/tokens => generated 3738 bytes in 73 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 24 17:01:30.909923 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b9434d3-06f4-40e5-acb6-a1ea216cceda service placement] Authenticating user token {{(pid=71938) process_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 24 17:01:30.921015 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b9434d3-06f4-40e5-acb6-a1ea216cceda service placement] Validating token access rules against request {{(pid=71938) validate_allowed_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 24 17:01:30.926138 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54032dcb-0fef-45fe-93fe-7479aaa889fc service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a919320c9e2a48d7ba33453b5929d7ee', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3b3940d4ae1c4177ae29c02377bb4b0b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=71938) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 24 17:01:30.926803 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54032dcb-0fef-45fe-93fe-7479aaa889fc service placement] REQUEST_METHOD: `GET` {{(pid=71938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 24 17:01:30.927151 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54032dcb-0fef-45fe-93fe-7479aaa889fc service placement] SCRIPT_NAME: `/identity` {{(pid=71938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 24 17:01:30.927490 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54032dcb-0fef-45fe-93fe-7479aaa889fc service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=71938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 24 17:01:30.929345 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.fernet_utils [None req-54032dcb-0fef-45fe-93fe-7479aaa889fc service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=71938) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:289}} Nov 24 17:01:30.942333 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54032dcb-0fef-45fe-93fe-7479aaa889fc service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=71938) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:442}} Nov 24 17:01:30.970883 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54032dcb-0fef-45fe-93fe-7479aaa889fc service placement] RBAC: Authorization granted {{(pid=71938) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 24 17:01:30.980713 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: [pid: 71938|app: 0|req: 1368/2748] 10.222.0.53 () {60 vars in 1356 bytes} [Wed Nov 24 17:01:30 2021] GET /identity/v3/auth/tokens => generated 3738 bytes in 72 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 24 17:01:33.686294 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6072c9a7-f8a2-41a6-87fe-fa1cd99435a1 service placement] Authenticating user token {{(pid=71939) process_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 24 17:01:33.688272 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.fernet_utils [None req-6072c9a7-f8a2-41a6-87fe-fa1cd99435a1 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=71939) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:289}} Nov 24 17:01:33.810873 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6072c9a7-f8a2-41a6-87fe-fa1cd99435a1 service placement] Validating token access rules against request {{(pid=71939) validate_allowed_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 24 17:01:33.816415 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3db06cf7-c587-4116-a195-7e1e49f0bc1c service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e196802d4d5432482b6d2eabc25f74e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3b3940d4ae1c4177ae29c02377bb4b0b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'service', 'ResellerAdmin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=71939) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 24 17:01:33.817392 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3db06cf7-c587-4116-a195-7e1e49f0bc1c service nova] REQUEST_METHOD: `GET` {{(pid=71939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 24 17:01:33.817392 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3db06cf7-c587-4116-a195-7e1e49f0bc1c service nova] SCRIPT_NAME: `/identity` {{(pid=71939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 24 17:01:33.817697 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3db06cf7-c587-4116-a195-7e1e49f0bc1c service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=71939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 24 17:01:33.819785 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.fernet_utils [None req-3db06cf7-c587-4116-a195-7e1e49f0bc1c service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=71939) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:289}} Nov 24 17:01:33.832633 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3db06cf7-c587-4116-a195-7e1e49f0bc1c service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=71939) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:442}} Nov 24 17:01:33.862245 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3db06cf7-c587-4116-a195-7e1e49f0bc1c service nova] RBAC: Authorization granted {{(pid=71939) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 24 17:01:33.873530 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: [pid: 71939|app: 0|req: 1381/2749] 10.222.0.53 () {60 vars in 1356 bytes} [Wed Nov 24 17:01:33 2021] GET /identity/v3/auth/tokens => generated 3802 bytes in 188 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 24 17:01:37.643155 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54032dcb-0fef-45fe-93fe-7479aaa889fc service placement] Authenticating user token {{(pid=71938) process_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 24 17:01:37.645694 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.fernet_utils [None req-54032dcb-0fef-45fe-93fe-7479aaa889fc service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=71938) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:289}} Nov 24 17:01:37.667016 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54032dcb-0fef-45fe-93fe-7479aaa889fc service placement] Validating token access rules against request {{(pid=71938) validate_allowed_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 24 17:01:37.676182 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c1e6cf0-e8d8-4520-85c7-bc958810a81e service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e196802d4d5432482b6d2eabc25f74e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3b3940d4ae1c4177ae29c02377bb4b0b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'service', 'ResellerAdmin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=71938) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 24 17:01:37.676867 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c1e6cf0-e8d8-4520-85c7-bc958810a81e service nova] REQUEST_METHOD: `GET` {{(pid=71938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 24 17:01:37.677208 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c1e6cf0-e8d8-4520-85c7-bc958810a81e service nova] SCRIPT_NAME: `/identity` {{(pid=71938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 24 17:01:37.677554 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c1e6cf0-e8d8-4520-85c7-bc958810a81e service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=71938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 24 17:01:37.679481 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.fernet_utils [None req-3c1e6cf0-e8d8-4520-85c7-bc958810a81e service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=71938) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:289}} Nov 24 17:01:37.700417 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c1e6cf0-e8d8-4520-85c7-bc958810a81e service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=71938) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:442}} Nov 24 17:01:37.729620 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c1e6cf0-e8d8-4520-85c7-bc958810a81e service nova] RBAC: Authorization granted {{(pid=71938) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 24 17:01:37.743001 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: [pid: 71938|app: 0|req: 1369/2750] 10.222.0.53 () {60 vars in 1356 bytes} [Wed Nov 24 17:01:37 2021] GET /identity/v3/auth/tokens => generated 3802 bytes in 100 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 24 17:03:22.607738 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3db06cf7-c587-4116-a195-7e1e49f0bc1c service nova] Authenticating user token {{(pid=71939) process_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 24 17:03:22.617360 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3db06cf7-c587-4116-a195-7e1e49f0bc1c service nova] Validating token access rules against request {{(pid=71939) validate_allowed_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 24 17:03:22.621599 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4d126f0-505f-4ce4-97a1-6191a2856583 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c90f21b9cdcb413282461fa83cb6b7a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3b3940d4ae1c4177ae29c02377bb4b0b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=71939) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 24 17:03:22.622255 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4d126f0-505f-4ce4-97a1-6191a2856583 service neutron] REQUEST_METHOD: `GET` {{(pid=71939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 24 17:03:22.622598 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4d126f0-505f-4ce4-97a1-6191a2856583 service neutron] SCRIPT_NAME: `/identity` {{(pid=71939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 24 17:03:22.622931 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4d126f0-505f-4ce4-97a1-6191a2856583 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=71939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 24 17:03:22.633366 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4d126f0-505f-4ce4-97a1-6191a2856583 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=71939) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:442}} Nov 24 17:03:22.663016 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4d126f0-505f-4ce4-97a1-6191a2856583 service neutron] RBAC: Authorization granted {{(pid=71939) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 24 17:03:22.674563 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: [pid: 71939|app: 0|req: 1382/2751] 10.222.0.53 () {60 vars in 1356 bytes} [Wed Nov 24 17:03:22 2021] GET /identity/v3/auth/tokens => generated 3802 bytes in 67 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 24 17:03:23.952529 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c1e6cf0-e8d8-4520-85c7-bc958810a81e service nova] Authenticating user token {{(pid=71938) process_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 24 17:03:23.962157 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c1e6cf0-e8d8-4520-85c7-bc958810a81e service nova] Validating token access rules against request {{(pid=71938) validate_allowed_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 24 17:03:23.966408 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dbf2cfb-61c8-45ea-be94-95b09cc2c533 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c90f21b9cdcb413282461fa83cb6b7a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3b3940d4ae1c4177ae29c02377bb4b0b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=71938) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 24 17:03:23.967057 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dbf2cfb-61c8-45ea-be94-95b09cc2c533 service neutron] REQUEST_METHOD: `GET` {{(pid=71938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 24 17:03:23.967394 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dbf2cfb-61c8-45ea-be94-95b09cc2c533 service neutron] SCRIPT_NAME: `/identity` {{(pid=71938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 24 17:03:23.967724 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dbf2cfb-61c8-45ea-be94-95b09cc2c533 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=71938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 24 17:03:23.978307 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3dbf2cfb-61c8-45ea-be94-95b09cc2c533 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=71938) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:442}} Nov 24 17:03:24.007286 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3dbf2cfb-61c8-45ea-be94-95b09cc2c533 service neutron] RBAC: Authorization granted {{(pid=71938) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 24 17:03:24.020601 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: [pid: 71938|app: 0|req: 1370/2752] 10.222.0.53 () {60 vars in 1356 bytes} [Wed Nov 24 17:03:23 2021] GET /identity/v3/auth/tokens => generated 3802 bytes in 69 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Nov 24 17:03:29.140978 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4d126f0-505f-4ce4-97a1-6191a2856583 service neutron] Authenticating user token {{(pid=71939) process_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 24 17:03:29.150274 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4d126f0-505f-4ce4-97a1-6191a2856583 service neutron] Validating token access rules against request {{(pid=71939) validate_allowed_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 24 17:03:29.154065 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dacba279-278d-4f2a-a8e9-8c6b3a4da361 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c90f21b9cdcb413282461fa83cb6b7a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3b3940d4ae1c4177ae29c02377bb4b0b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=71939) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 24 17:03:29.154741 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dacba279-278d-4f2a-a8e9-8c6b3a4da361 service neutron] REQUEST_METHOD: `GET` {{(pid=71939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 24 17:03:29.155085 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dacba279-278d-4f2a-a8e9-8c6b3a4da361 service neutron] SCRIPT_NAME: `/identity` {{(pid=71939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 24 17:03:29.155424 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dacba279-278d-4f2a-a8e9-8c6b3a4da361 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=71939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 24 17:03:29.157281 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.fernet_utils [None req-dacba279-278d-4f2a-a8e9-8c6b3a4da361 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=71939) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:289}} Nov 24 17:03:29.170140 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dacba279-278d-4f2a-a8e9-8c6b3a4da361 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=71939) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:442}} Nov 24 17:03:29.199732 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dacba279-278d-4f2a-a8e9-8c6b3a4da361 service neutron] RBAC: Authorization granted {{(pid=71939) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 24 17:03:29.210466 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: [pid: 71939|app: 0|req: 1383/2753] 10.222.0.53 () {60 vars in 1356 bytes} [Wed Nov 24 17:03:29 2021] GET /identity/v3/auth/tokens => generated 3669 bytes in 70 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 24 17:03:35.125272 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dbf2cfb-61c8-45ea-be94-95b09cc2c533 service neutron] Authenticating user token {{(pid=71938) process_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 24 17:03:35.126860 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.fernet_utils [None req-3dbf2cfb-61c8-45ea-be94-95b09cc2c533 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=71938) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:289}} Nov 24 17:03:35.140295 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dbf2cfb-61c8-45ea-be94-95b09cc2c533 service neutron] Validating token access rules against request {{(pid=71938) validate_allowed_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 24 17:03:35.144763 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8d0975b-2440-4f0e-baf1-87be0dcfdf2e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f2ba2e8375b4e8c8792ee1e22b60427', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '00a5583c7b7443e98e7a1d31a0b638dc', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=71938) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 24 17:03:35.145644 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8d0975b-2440-4f0e-baf1-87be0dcfdf2e admin admin] REQUEST_METHOD: `DELETE` {{(pid=71938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 24 17:03:35.145979 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8d0975b-2440-4f0e-baf1-87be0dcfdf2e admin admin] SCRIPT_NAME: `/identity` {{(pid=71938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 24 17:03:35.146342 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8d0975b-2440-4f0e-baf1-87be0dcfdf2e admin admin] PATH_INFO: `/v3/users/b3526b1ee2664fb9a004a17eedce9868` {{(pid=71938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 24 17:03:35.147553 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8d0975b-2440-4f0e-baf1-87be0dcfdf2e admin admin] RBAC: Authorizing `identity:delete_user(user_id=b3526b1ee2664fb9a004a17eedce9868)` {{(pid=71938) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:442}} Nov 24 17:03:35.176660 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8d0975b-2440-4f0e-baf1-87be0dcfdf2e admin admin] RBAC: Authorization granted {{(pid=71938) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 24 17:03:35.226590 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.notifications [None req-d8d0975b-2440-4f0e-baf1-87be0dcfdf2e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b3526b1ee2664fb9a004a17eedce9868'} {{(pid=71938) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:357}} Nov 24 17:03:35.239225 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.notifications [None req-d8d0975b-2440-4f0e-baf1-87be0dcfdf2e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b3526b1ee2664fb9a004a17eedce9868'} {{(pid=71938) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:357}} Nov 24 17:03:35.239946 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.notifications [None req-d8d0975b-2440-4f0e-baf1-87be0dcfdf2e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b3526b1ee2664fb9a004a17eedce9868'} {{(pid=71938) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:357}} Nov 24 17:03:35.248653 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.notifications [None req-d8d0975b-2440-4f0e-baf1-87be0dcfdf2e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b3526b1ee2664fb9a004a17eedce9868'} {{(pid=71938) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:357}} Nov 24 17:03:35.254533 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.notifications [None req-d8d0975b-2440-4f0e-baf1-87be0dcfdf2e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b3526b1ee2664fb9a004a17eedce9868'} {{(pid=71938) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:357}} Nov 24 17:03:35.260977 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: [pid: 71938|app: 0|req: 1371/2754] 10.222.0.53 () {58 vars in 1214 bytes} [Wed Nov 24 17:03:35 2021] DELETE /identity/v3/users/b3526b1ee2664fb9a004a17eedce9868 => generated 0 bytes in 136 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 24 17:03:35.502967 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dacba279-278d-4f2a-a8e9-8c6b3a4da361 service neutron] Authenticating user token {{(pid=71939) process_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 24 17:03:35.513475 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dacba279-278d-4f2a-a8e9-8c6b3a4da361 service neutron] Validating token access rules against request {{(pid=71939) validate_allowed_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 24 17:03:35.583522 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0c22fa3-0d8e-46ed-bfe4-871a1e5d34f0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f2ba2e8375b4e8c8792ee1e22b60427', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '00a5583c7b7443e98e7a1d31a0b638dc', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=71939) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 24 17:03:35.584416 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0c22fa3-0d8e-46ed-bfe4-871a1e5d34f0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=71939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 24 17:03:35.584763 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0c22fa3-0d8e-46ed-bfe4-871a1e5d34f0 admin admin] SCRIPT_NAME: `/identity` {{(pid=71939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 24 17:03:35.585095 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0c22fa3-0d8e-46ed-bfe4-871a1e5d34f0 admin admin] PATH_INFO: `/v3/projects/2e1db92b17144247b41c70a2ad4c19eb` {{(pid=71939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 24 17:03:35.586424 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0c22fa3-0d8e-46ed-bfe4-871a1e5d34f0 admin admin] RBAC: Authorizing `identity:delete_project(project_id=2e1db92b17144247b41c70a2ad4c19eb)` {{(pid=71939) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:442}} Nov 24 17:03:35.616064 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0c22fa3-0d8e-46ed-bfe4-871a1e5d34f0 admin admin] RBAC: Authorization granted {{(pid=71939) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 24 17:03:35.666387 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.notifications [None req-a0c22fa3-0d8e-46ed-bfe4-871a1e5d34f0 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '2e1db92b17144247b41c70a2ad4c19eb', 'request_id': 'req-a0c22fa3-0d8e-46ed-bfe4-871a1e5d34f0'} {{(pid=71939) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:357}} Nov 24 17:03:35.678192 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.notifications [None req-a0c22fa3-0d8e-46ed-bfe4-871a1e5d34f0 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '2e1db92b17144247b41c70a2ad4c19eb', 'request_id': 'req-a0c22fa3-0d8e-46ed-bfe4-871a1e5d34f0'} {{(pid=71939) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:357}} Nov 24 17:03:35.684501 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.notifications [None req-a0c22fa3-0d8e-46ed-bfe4-871a1e5d34f0 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '2e1db92b17144247b41c70a2ad4c19eb', 'request_id': 'req-a0c22fa3-0d8e-46ed-bfe4-871a1e5d34f0'} {{(pid=71939) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:357}} Nov 24 17:03:35.697210 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.notifications [None req-a0c22fa3-0d8e-46ed-bfe4-871a1e5d34f0 admin admin] The token cache is being invalidate because project 2e1db92b17144247b41c70a2ad4c19eb was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=71939) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Nov 24 17:03:35.698094 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.notifications [None req-a0c22fa3-0d8e-46ed-bfe4-871a1e5d34f0 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=71939) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:357}} Nov 24 17:03:35.698836 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.notifications [None req-a0c22fa3-0d8e-46ed-bfe4-871a1e5d34f0 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=71939) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:357}} Nov 24 17:03:35.700422 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: [pid: 71939|app: 0|req: 1384/2755] 10.222.0.53 () {58 vars in 1223 bytes} [Wed Nov 24 17:03:35 2021] DELETE /identity/v3/projects/2e1db92b17144247b41c70a2ad4c19eb => generated 0 bytes in 198 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 24 17:03:35.706674 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca50bb8e-e14f-479e-8ddb-783c3ae87949 None None] REQUEST_METHOD: `POST` {{(pid=71938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 24 17:03:35.707023 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca50bb8e-e14f-479e-8ddb-783c3ae87949 None None] SCRIPT_NAME: `/identity` {{(pid=71938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 24 17:03:35.707360 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca50bb8e-e14f-479e-8ddb-783c3ae87949 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=71938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 24 17:03:35.731543 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.auth.core [None req-ca50bb8e-e14f-479e-8ddb-783c3ae87949 None None] MFA Rules not processed for user `0f2ba2e8375b4e8c8792ee1e22b60427`. Rule list: `[]` (Enabled: `True`). {{(pid=71938) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:442}} Nov 24 17:03:35.732752 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.fernet_utils [None req-ca50bb8e-e14f-479e-8ddb-783c3ae87949 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=71938) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:289}} Nov 24 17:03:35.799989 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: [pid: 71938|app: 0|req: 1372/2756] 10.222.0.53 () {58 vars in 948 bytes} [Wed Nov 24 17:03:35 2021] POST /identity/v3/auth/tokens => generated 3669 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 24 17:03:35.808690 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-074a5f45-9f4c-4fec-abe7-39506fdac144 None None] REQUEST_METHOD: `POST` {{(pid=71939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 24 17:03:35.809052 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-074a5f45-9f4c-4fec-abe7-39506fdac144 None None] SCRIPT_NAME: `/identity` {{(pid=71939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 24 17:03:35.809371 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-074a5f45-9f4c-4fec-abe7-39506fdac144 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=71939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 24 17:03:35.833259 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.auth.core [None req-074a5f45-9f4c-4fec-abe7-39506fdac144 None None] MFA Rules not processed for user `0f2ba2e8375b4e8c8792ee1e22b60427`. Rule list: `[]` (Enabled: `True`). {{(pid=71939) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:442}} Nov 24 17:03:35.834494 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.fernet_utils [None req-074a5f45-9f4c-4fec-abe7-39506fdac144 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=71939) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:289}} Nov 24 17:03:35.842413 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: [pid: 71939|app: 0|req: 1385/2757] 10.222.0.53 () {58 vars in 948 bytes} [Wed Nov 24 17:03:35 2021] POST /identity/v3/auth/tokens => generated 3669 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 24 17:03:35.846818 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca50bb8e-e14f-479e-8ddb-783c3ae87949 None None] Authenticating user token {{(pid=71938) process_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 24 17:03:35.856743 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca50bb8e-e14f-479e-8ddb-783c3ae87949 None None] Validating token access rules against request {{(pid=71938) validate_allowed_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 24 17:03:35.861315 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8674a4f-33f7-4a94-8687-5b83e7db9528 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f2ba2e8375b4e8c8792ee1e22b60427', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '00a5583c7b7443e98e7a1d31a0b638dc', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=71938) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 24 17:03:35.861988 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8674a4f-33f7-4a94-8687-5b83e7db9528 admin admin] REQUEST_METHOD: `GET` {{(pid=71938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 24 17:03:35.862383 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8674a4f-33f7-4a94-8687-5b83e7db9528 admin admin] SCRIPT_NAME: `/identity` {{(pid=71938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 24 17:03:35.862724 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8674a4f-33f7-4a94-8687-5b83e7db9528 admin admin] PATH_INFO: `/v3/domains` {{(pid=71938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 24 17:03:35.863558 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8674a4f-33f7-4a94-8687-5b83e7db9528 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=71938) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:161}} Nov 24 17:03:35.863915 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8674a4f-33f7-4a94-8687-5b83e7db9528 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=71938) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:442}} Nov 24 17:03:35.892583 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8674a4f-33f7-4a94-8687-5b83e7db9528 admin admin] RBAC: Authorization granted {{(pid=71938) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 24 17:03:35.906633 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: [pid: 71938|app: 0|req: 1373/2758] 10.222.0.53 () {58 vars in 1143 bytes} [Wed Nov 24 17:03:35 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 60 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 24 17:03:35.910970 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-074a5f45-9f4c-4fec-abe7-39506fdac144 None None] Authenticating user token {{(pid=71939) process_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 24 17:03:35.920081 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-074a5f45-9f4c-4fec-abe7-39506fdac144 None None] Validating token access rules against request {{(pid=71939) validate_allowed_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 24 17:03:35.924699 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9beb9aac-fd04-422d-be5e-eb488d3bcd5c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f2ba2e8375b4e8c8792ee1e22b60427', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '00a5583c7b7443e98e7a1d31a0b638dc', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=71939) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 24 17:03:35.925351 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9beb9aac-fd04-422d-be5e-eb488d3bcd5c admin admin] REQUEST_METHOD: `POST` {{(pid=71939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 24 17:03:35.925688 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9beb9aac-fd04-422d-be5e-eb488d3bcd5c admin admin] SCRIPT_NAME: `/identity` {{(pid=71939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 24 17:03:35.926020 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9beb9aac-fd04-422d-be5e-eb488d3bcd5c admin admin] PATH_INFO: `/v3/projects` {{(pid=71939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 24 17:03:35.926785 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9beb9aac-fd04-422d-be5e-eb488d3bcd5c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=71939) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:442}} Nov 24 17:03:35.955517 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9beb9aac-fd04-422d-be5e-eb488d3bcd5c admin admin] RBAC: Authorization granted {{(pid=71939) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 24 17:03:35.981684 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: [pid: 71939|app: 0|req: 1386/2759] 10.222.0.53 () {60 vars in 1143 bytes} [Wed Nov 24 17:03:35 2021] POST /identity/v3/projects => generated 381 bytes in 71 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 24 17:03:35.986112 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8674a4f-33f7-4a94-8687-5b83e7db9528 admin admin] Authenticating user token {{(pid=71938) process_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 24 17:03:35.996177 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8674a4f-33f7-4a94-8687-5b83e7db9528 admin admin] Validating token access rules against request {{(pid=71938) validate_allowed_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 24 17:03:36.062206 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe0a2d8f-f704-4812-88c6-4d8a9186597b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f2ba2e8375b4e8c8792ee1e22b60427', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '00a5583c7b7443e98e7a1d31a0b638dc', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=71938) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 24 17:03:36.062856 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe0a2d8f-f704-4812-88c6-4d8a9186597b admin admin] REQUEST_METHOD: `POST` {{(pid=71938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 24 17:03:36.063173 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe0a2d8f-f704-4812-88c6-4d8a9186597b admin admin] SCRIPT_NAME: `/identity` {{(pid=71938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 24 17:03:36.063507 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe0a2d8f-f704-4812-88c6-4d8a9186597b admin admin] PATH_INFO: `/v3/users` {{(pid=71938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 24 17:03:36.064234 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe0a2d8f-f704-4812-88c6-4d8a9186597b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=71938) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:442}} Nov 24 17:03:36.093489 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe0a2d8f-f704-4812-88c6-4d8a9186597b admin admin] RBAC: Authorization granted {{(pid=71938) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 24 17:03:36.112217 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: [pid: 71938|app: 0|req: 1374/2760] 10.222.0.53 () {60 vars in 1134 bytes} [Wed Nov 24 17:03:35 2021] POST /identity/v3/users => generated 291 bytes in 127 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 24 17:03:36.116596 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9beb9aac-fd04-422d-be5e-eb488d3bcd5c admin admin] Authenticating user token {{(pid=71939) process_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 24 17:03:36.127623 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9beb9aac-fd04-422d-be5e-eb488d3bcd5c admin admin] Validating token access rules against request {{(pid=71939) validate_allowed_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 24 17:03:36.132203 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-318a3065-d237-4986-941d-b3ffa95ad2d7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f2ba2e8375b4e8c8792ee1e22b60427', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '00a5583c7b7443e98e7a1d31a0b638dc', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=71939) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 24 17:03:36.132877 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-318a3065-d237-4986-941d-b3ffa95ad2d7 admin admin] REQUEST_METHOD: `GET` {{(pid=71939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 24 17:03:36.133221 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-318a3065-d237-4986-941d-b3ffa95ad2d7 admin admin] SCRIPT_NAME: `/identity` {{(pid=71939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 24 17:03:36.133560 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-318a3065-d237-4986-941d-b3ffa95ad2d7 admin admin] PATH_INFO: `/v3/roles` {{(pid=71939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 24 17:03:36.134376 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-318a3065-d237-4986-941d-b3ffa95ad2d7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=71939) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:442}} Nov 24 17:03:36.162684 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-318a3065-d237-4986-941d-b3ffa95ad2d7 admin admin] RBAC: Authorization granted {{(pid=71939) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 24 17:03:36.173554 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: [pid: 71939|app: 0|req: 1387/2761] 10.222.0.53 () {58 vars in 1112 bytes} [Wed Nov 24 17:03:36 2021] GET /identity/v3/roles => generated 1420 bytes in 57 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 24 17:03:36.178141 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe0a2d8f-f704-4812-88c6-4d8a9186597b admin admin] Authenticating user token {{(pid=71938) process_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 24 17:03:36.189269 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe0a2d8f-f704-4812-88c6-4d8a9186597b admin admin] Validating token access rules against request {{(pid=71938) validate_allowed_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 24 17:03:36.193933 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03c67785-be02-4b93-8b85-6fc3f43fcac8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f2ba2e8375b4e8c8792ee1e22b60427', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '00a5583c7b7443e98e7a1d31a0b638dc', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=71938) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 24 17:03:36.194957 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03c67785-be02-4b93-8b85-6fc3f43fcac8 admin admin] REQUEST_METHOD: `PUT` {{(pid=71938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 24 17:03:36.195368 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03c67785-be02-4b93-8b85-6fc3f43fcac8 admin admin] SCRIPT_NAME: `/identity` {{(pid=71938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 24 17:03:36.195773 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03c67785-be02-4b93-8b85-6fc3f43fcac8 admin admin] PATH_INFO: `/v3/projects/a8bae0f615cc4e73bd9c2d792b492e71/users/982c645cd8724e0d946e84e9b155e5cb/roles/912ab5f10fa5477da74acf239f07604e` {{(pid=71938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 24 17:03:36.217748 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03c67785-be02-4b93-8b85-6fc3f43fcac8 admin admin] RBAC: Authorizing `identity:create_grant(project_id=a8bae0f615cc4e73bd9c2d792b492e71, user_id=982c645cd8724e0d946e84e9b155e5cb, role_id=912ab5f10fa5477da74acf239f07604e)` {{(pid=71938) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:442}} Nov 24 17:03:36.249181 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03c67785-be02-4b93-8b85-6fc3f43fcac8 admin admin] RBAC: Authorization granted {{(pid=71938) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 24 17:03:36.262697 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: [pid: 71938|app: 0|req: 1375/2762] 10.222.0.53 () {60 vars in 1473 bytes} [Wed Nov 24 17:03:36 2021] PUT /identity/v3/projects/a8bae0f615cc4e73bd9c2d792b492e71/users/982c645cd8724e0d946e84e9b155e5cb/roles/912ab5f10fa5477da74acf239f07604e => generated 0 bytes in 85 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 24 17:03:36.274175 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14aad63a-7d76-4918-a668-b29e54fcffc4 None None] REQUEST_METHOD: `POST` {{(pid=71939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 24 17:03:36.274529 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14aad63a-7d76-4918-a668-b29e54fcffc4 None None] SCRIPT_NAME: `/identity` {{(pid=71939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 24 17:03:36.274869 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14aad63a-7d76-4918-a668-b29e54fcffc4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=71939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 24 17:03:36.314505 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.auth.core [None req-14aad63a-7d76-4918-a668-b29e54fcffc4 None None] MFA Rules not processed for user `982c645cd8724e0d946e84e9b155e5cb`. Rule list: `[]` (Enabled: `True`). {{(pid=71939) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:442}} Nov 24 17:03:36.315677 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.fernet_utils [None req-14aad63a-7d76-4918-a668-b29e54fcffc4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=71939) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:289}} Nov 24 17:03:36.392301 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: [pid: 71939|app: 0|req: 1388/2763] 10.222.0.53 () {58 vars in 948 bytes} [Wed Nov 24 17:03:36 2021] POST /identity/v3/auth/tokens => generated 3688 bytes in 119 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 24 17:03:36.397183 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03c67785-be02-4b93-8b85-6fc3f43fcac8 admin admin] Authenticating user token {{(pid=71938) process_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 24 17:03:36.473107 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03c67785-be02-4b93-8b85-6fc3f43fcac8 admin admin] Validating token access rules against request {{(pid=71938) validate_allowed_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 24 17:03:36.477815 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18bdd97d-3167-41cf-b2c2-60a30a70e83e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f2ba2e8375b4e8c8792ee1e22b60427', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '00a5583c7b7443e98e7a1d31a0b638dc', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=71938) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 24 17:03:36.478519 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18bdd97d-3167-41cf-b2c2-60a30a70e83e admin admin] REQUEST_METHOD: `POST` {{(pid=71938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 24 17:03:36.479364 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18bdd97d-3167-41cf-b2c2-60a30a70e83e admin admin] SCRIPT_NAME: `/identity` {{(pid=71938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 24 17:03:36.479697 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18bdd97d-3167-41cf-b2c2-60a30a70e83e admin admin] PATH_INFO: `/v3/projects` {{(pid=71938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 24 17:03:36.480531 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18bdd97d-3167-41cf-b2c2-60a30a70e83e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=71938) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:442}} Nov 24 17:03:36.510151 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18bdd97d-3167-41cf-b2c2-60a30a70e83e admin admin] RBAC: Authorization granted {{(pid=71938) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 24 17:03:36.536736 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: [pid: 71938|app: 0|req: 1376/2764] 10.222.0.53 () {60 vars in 1143 bytes} [Wed Nov 24 17:03:36 2021] POST /identity/v3/projects => generated 381 bytes in 140 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 24 17:03:36.541693 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14aad63a-7d76-4918-a668-b29e54fcffc4 None None] Authenticating user token {{(pid=71939) process_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 24 17:03:36.552744 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14aad63a-7d76-4918-a668-b29e54fcffc4 None None] Validating token access rules against request {{(pid=71939) validate_allowed_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 24 17:03:36.618565 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c46f882-b6b4-4b60-8627-02e717a52a90 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f2ba2e8375b4e8c8792ee1e22b60427', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '00a5583c7b7443e98e7a1d31a0b638dc', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=71939) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 24 17:03:36.619274 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c46f882-b6b4-4b60-8627-02e717a52a90 admin admin] REQUEST_METHOD: `POST` {{(pid=71939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 24 17:03:36.620112 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c46f882-b6b4-4b60-8627-02e717a52a90 admin admin] SCRIPT_NAME: `/identity` {{(pid=71939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 24 17:03:36.620443 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c46f882-b6b4-4b60-8627-02e717a52a90 admin admin] PATH_INFO: `/v3/users` {{(pid=71939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 24 17:03:36.621168 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c46f882-b6b4-4b60-8627-02e717a52a90 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=71939) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:442}} Nov 24 17:03:36.649387 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c46f882-b6b4-4b60-8627-02e717a52a90 admin admin] RBAC: Authorization granted {{(pid=71939) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 24 17:03:36.671102 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: [pid: 71939|app: 0|req: 1389/2765] 10.222.0.53 () {60 vars in 1134 bytes} [Wed Nov 24 17:03:36 2021] POST /identity/v3/users => generated 297 bytes in 130 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 24 17:03:36.675531 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18bdd97d-3167-41cf-b2c2-60a30a70e83e admin admin] Authenticating user token {{(pid=71938) process_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 24 17:03:36.687060 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18bdd97d-3167-41cf-b2c2-60a30a70e83e admin admin] Validating token access rules against request {{(pid=71938) validate_allowed_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 24 17:03:36.691881 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbfeaf1c-fdfa-419e-af0d-24c69aab1120 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f2ba2e8375b4e8c8792ee1e22b60427', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '00a5583c7b7443e98e7a1d31a0b638dc', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=71938) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 24 17:03:36.692560 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbfeaf1c-fdfa-419e-af0d-24c69aab1120 admin admin] REQUEST_METHOD: `GET` {{(pid=71938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 24 17:03:36.692908 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbfeaf1c-fdfa-419e-af0d-24c69aab1120 admin admin] SCRIPT_NAME: `/identity` {{(pid=71938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 24 17:03:36.693244 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbfeaf1c-fdfa-419e-af0d-24c69aab1120 admin admin] PATH_INFO: `/v3/roles` {{(pid=71938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 24 17:03:36.694052 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbfeaf1c-fdfa-419e-af0d-24c69aab1120 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=71938) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:442}} Nov 24 17:03:36.735471 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbfeaf1c-fdfa-419e-af0d-24c69aab1120 admin admin] RBAC: Authorization granted {{(pid=71938) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 24 17:03:36.755179 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: [pid: 71938|app: 0|req: 1377/2766] 10.222.0.53 () {58 vars in 1112 bytes} [Wed Nov 24 17:03:36 2021] GET /identity/v3/roles => generated 1420 bytes in 80 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 24 17:03:36.759639 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c46f882-b6b4-4b60-8627-02e717a52a90 admin admin] Authenticating user token {{(pid=71939) process_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 24 17:03:36.769760 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c46f882-b6b4-4b60-8627-02e717a52a90 admin admin] Validating token access rules against request {{(pid=71939) validate_allowed_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 24 17:03:36.774331 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0096b298-7dc5-4eb7-ba43-c9e4a5ee40e4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f2ba2e8375b4e8c8792ee1e22b60427', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '00a5583c7b7443e98e7a1d31a0b638dc', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=71939) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 24 17:03:36.775229 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0096b298-7dc5-4eb7-ba43-c9e4a5ee40e4 admin admin] REQUEST_METHOD: `PUT` {{(pid=71939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 24 17:03:36.776064 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0096b298-7dc5-4eb7-ba43-c9e4a5ee40e4 admin admin] SCRIPT_NAME: `/identity` {{(pid=71939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 24 17:03:36.776393 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0096b298-7dc5-4eb7-ba43-c9e4a5ee40e4 admin admin] PATH_INFO: `/v3/projects/173d485cf8d04e8f9c8d3036926ff63c/users/c28a2ece9e434e5fbee0cc36ab213b2c/roles/5611724e350b41e19921b5961a342582` {{(pid=71939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 24 17:03:36.797641 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0096b298-7dc5-4eb7-ba43-c9e4a5ee40e4 admin admin] RBAC: Authorizing `identity:create_grant(project_id=173d485cf8d04e8f9c8d3036926ff63c, user_id=c28a2ece9e434e5fbee0cc36ab213b2c, role_id=5611724e350b41e19921b5961a342582)` {{(pid=71939) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:442}} Nov 24 17:03:36.827626 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0096b298-7dc5-4eb7-ba43-c9e4a5ee40e4 admin admin] RBAC: Authorization granted {{(pid=71939) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 24 17:03:36.840528 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: [pid: 71939|app: 0|req: 1390/2767] 10.222.0.53 () {60 vars in 1473 bytes} [Wed Nov 24 17:03:36 2021] PUT /identity/v3/projects/173d485cf8d04e8f9c8d3036926ff63c/users/c28a2ece9e434e5fbee0cc36ab213b2c/roles/5611724e350b41e19921b5961a342582 => generated 0 bytes in 81 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 24 17:03:36.844837 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbfeaf1c-fdfa-419e-af0d-24c69aab1120 admin admin] Authenticating user token {{(pid=71938) process_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 24 17:03:36.855652 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbfeaf1c-fdfa-419e-af0d-24c69aab1120 admin admin] Validating token access rules against request {{(pid=71938) validate_allowed_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 24 17:03:36.923087 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a49cfb33-62d1-4247-861a-35dc90f86053 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f2ba2e8375b4e8c8792ee1e22b60427', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '00a5583c7b7443e98e7a1d31a0b638dc', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=71938) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 24 17:03:36.923764 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a49cfb33-62d1-4247-861a-35dc90f86053 admin admin] REQUEST_METHOD: `GET` {{(pid=71938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 24 17:03:36.924103 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a49cfb33-62d1-4247-861a-35dc90f86053 admin admin] SCRIPT_NAME: `/identity` {{(pid=71938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 24 17:03:36.924433 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a49cfb33-62d1-4247-861a-35dc90f86053 admin admin] PATH_INFO: `/v3/roles` {{(pid=71938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 24 17:03:36.925211 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a49cfb33-62d1-4247-861a-35dc90f86053 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=71938) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:442}} Nov 24 17:03:36.953274 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a49cfb33-62d1-4247-861a-35dc90f86053 admin admin] RBAC: Authorization granted {{(pid=71938) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 24 17:03:36.964362 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: [pid: 71938|app: 0|req: 1378/2768] 10.222.0.53 () {58 vars in 1112 bytes} [Wed Nov 24 17:03:36 2021] GET /identity/v3/roles => generated 1420 bytes in 120 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 24 17:03:36.968816 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0096b298-7dc5-4eb7-ba43-c9e4a5ee40e4 admin admin] Authenticating user token {{(pid=71939) process_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 24 17:03:36.979776 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0096b298-7dc5-4eb7-ba43-c9e4a5ee40e4 admin admin] Validating token access rules against request {{(pid=71939) validate_allowed_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 24 17:03:36.984300 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb2d75c6-c430-4aab-85b0-d3db9df00edd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f2ba2e8375b4e8c8792ee1e22b60427', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '00a5583c7b7443e98e7a1d31a0b638dc', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=71939) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 24 17:03:36.985195 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb2d75c6-c430-4aab-85b0-d3db9df00edd admin admin] REQUEST_METHOD: `PUT` {{(pid=71939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 24 17:03:36.985540 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb2d75c6-c430-4aab-85b0-d3db9df00edd admin admin] SCRIPT_NAME: `/identity` {{(pid=71939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 24 17:03:36.985870 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb2d75c6-c430-4aab-85b0-d3db9df00edd admin admin] PATH_INFO: `/v3/projects/173d485cf8d04e8f9c8d3036926ff63c/users/c28a2ece9e434e5fbee0cc36ab213b2c/roles/5611724e350b41e19921b5961a342582` {{(pid=71939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 24 17:03:36.987878 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb2d75c6-c430-4aab-85b0-d3db9df00edd admin admin] RBAC: Authorizing `identity:create_grant(project_id=173d485cf8d04e8f9c8d3036926ff63c, user_id=c28a2ece9e434e5fbee0cc36ab213b2c, role_id=5611724e350b41e19921b5961a342582)` {{(pid=71939) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:442}} Nov 24 17:03:37.017152 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb2d75c6-c430-4aab-85b0-d3db9df00edd admin admin] RBAC: Authorization granted {{(pid=71939) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 24 17:03:37.028035 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: [pid: 71939|app: 0|req: 1391/2769] 10.222.0.53 () {60 vars in 1473 bytes} [Wed Nov 24 17:03:36 2021] PUT /identity/v3/projects/173d485cf8d04e8f9c8d3036926ff63c/users/c28a2ece9e434e5fbee0cc36ab213b2c/roles/5611724e350b41e19921b5961a342582 => generated 0 bytes in 60 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 24 17:03:37.032131 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a49cfb33-62d1-4247-861a-35dc90f86053 admin admin] Authenticating user token {{(pid=71938) process_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 24 17:03:37.043150 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a49cfb33-62d1-4247-861a-35dc90f86053 admin admin] Validating token access rules against request {{(pid=71938) validate_allowed_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 24 17:03:37.110748 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d83cde4a-ba57-4655-b2d8-361258341c2a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f2ba2e8375b4e8c8792ee1e22b60427', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '00a5583c7b7443e98e7a1d31a0b638dc', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=71938) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 24 17:03:37.111348 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d83cde4a-ba57-4655-b2d8-361258341c2a admin admin] REQUEST_METHOD: `GET` {{(pid=71938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 24 17:03:37.111687 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d83cde4a-ba57-4655-b2d8-361258341c2a admin admin] SCRIPT_NAME: `/identity` {{(pid=71938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 24 17:03:37.112020 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d83cde4a-ba57-4655-b2d8-361258341c2a admin admin] PATH_INFO: `/v3/roles` {{(pid=71938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 24 17:03:37.112809 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d83cde4a-ba57-4655-b2d8-361258341c2a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=71938) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:442}} Nov 24 17:03:37.141277 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d83cde4a-ba57-4655-b2d8-361258341c2a admin admin] RBAC: Authorization granted {{(pid=71938) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 24 17:03:37.152764 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: [pid: 71938|app: 0|req: 1379/2770] 10.222.0.53 () {58 vars in 1112 bytes} [Wed Nov 24 17:03:37 2021] GET /identity/v3/roles => generated 1420 bytes in 121 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 24 17:03:37.157348 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb2d75c6-c430-4aab-85b0-d3db9df00edd admin admin] Authenticating user token {{(pid=71939) process_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 24 17:03:37.167785 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb2d75c6-c430-4aab-85b0-d3db9df00edd admin admin] Validating token access rules against request {{(pid=71939) validate_allowed_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 24 17:03:37.172355 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a69a1ac3-faa6-4d01-9bd3-8659e6ad715a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f2ba2e8375b4e8c8792ee1e22b60427', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '00a5583c7b7443e98e7a1d31a0b638dc', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=71939) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 24 17:03:37.173252 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a69a1ac3-faa6-4d01-9bd3-8659e6ad715a admin admin] REQUEST_METHOD: `PUT` {{(pid=71939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 24 17:03:37.173587 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a69a1ac3-faa6-4d01-9bd3-8659e6ad715a admin admin] SCRIPT_NAME: `/identity` {{(pid=71939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 24 17:03:37.173918 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a69a1ac3-faa6-4d01-9bd3-8659e6ad715a admin admin] PATH_INFO: `/v3/projects/173d485cf8d04e8f9c8d3036926ff63c/users/c28a2ece9e434e5fbee0cc36ab213b2c/roles/912ab5f10fa5477da74acf239f07604e` {{(pid=71939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 24 17:03:37.175926 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a69a1ac3-faa6-4d01-9bd3-8659e6ad715a admin admin] RBAC: Authorizing `identity:create_grant(project_id=173d485cf8d04e8f9c8d3036926ff63c, user_id=c28a2ece9e434e5fbee0cc36ab213b2c, role_id=912ab5f10fa5477da74acf239f07604e)` {{(pid=71939) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:442}} Nov 24 17:03:37.205811 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a69a1ac3-faa6-4d01-9bd3-8659e6ad715a admin admin] RBAC: Authorization granted {{(pid=71939) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 24 17:03:37.220796 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: [pid: 71939|app: 0|req: 1392/2771] 10.222.0.53 () {60 vars in 1473 bytes} [Wed Nov 24 17:03:37 2021] PUT /identity/v3/projects/173d485cf8d04e8f9c8d3036926ff63c/users/c28a2ece9e434e5fbee0cc36ab213b2c/roles/912ab5f10fa5477da74acf239f07604e => generated 0 bytes in 64 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 24 17:03:37.231553 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ac42f42-e485-4873-b4ff-3567b6440201 None None] REQUEST_METHOD: `POST` {{(pid=71938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 24 17:03:37.231911 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ac42f42-e485-4873-b4ff-3567b6440201 None None] SCRIPT_NAME: `/identity` {{(pid=71938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 24 17:03:37.232255 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ac42f42-e485-4873-b4ff-3567b6440201 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=71938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 24 17:03:37.270844 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.auth.core [None req-1ac42f42-e485-4873-b4ff-3567b6440201 None None] MFA Rules not processed for user `c28a2ece9e434e5fbee0cc36ab213b2c`. Rule list: `[]` (Enabled: `True`). {{(pid=71938) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:442}} Nov 24 17:03:37.272089 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.fernet_utils [None req-1ac42f42-e485-4873-b4ff-3567b6440201 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=71938) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:289}} Nov 24 17:03:37.352931 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: [pid: 71938|app: 0|req: 1380/2772] 10.222.0.53 () {58 vars in 948 bytes} [Wed Nov 24 17:03:37 2021] POST /identity/v3/auth/tokens => generated 3755 bytes in 122 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 24 17:03:37.358956 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a69a1ac3-faa6-4d01-9bd3-8659e6ad715a admin admin] Authenticating user token {{(pid=71939) process_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 24 17:03:37.430175 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a69a1ac3-faa6-4d01-9bd3-8659e6ad715a admin admin] Validating token access rules against request {{(pid=71939) validate_allowed_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 24 17:03:37.435093 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-148b919f-a6d8-4a0e-9ee3-232d7134a49e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f2ba2e8375b4e8c8792ee1e22b60427', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '00a5583c7b7443e98e7a1d31a0b638dc', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=71939) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 24 17:03:37.435977 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-148b919f-a6d8-4a0e-9ee3-232d7134a49e admin admin] REQUEST_METHOD: `DELETE` {{(pid=71939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 24 17:03:37.436315 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-148b919f-a6d8-4a0e-9ee3-232d7134a49e admin admin] SCRIPT_NAME: `/identity` {{(pid=71939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 24 17:03:37.436648 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-148b919f-a6d8-4a0e-9ee3-232d7134a49e admin admin] PATH_INFO: `/v3/users/982c645cd8724e0d946e84e9b155e5cb` {{(pid=71939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 24 17:03:37.438052 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-148b919f-a6d8-4a0e-9ee3-232d7134a49e admin admin] RBAC: Authorizing `identity:delete_user(user_id=982c645cd8724e0d946e84e9b155e5cb)` {{(pid=71939) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:442}} Nov 24 17:03:37.467168 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-148b919f-a6d8-4a0e-9ee3-232d7134a49e admin admin] RBAC: Authorization granted {{(pid=71939) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 24 17:03:37.514863 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.notifications [None req-148b919f-a6d8-4a0e-9ee3-232d7134a49e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '982c645cd8724e0d946e84e9b155e5cb'} {{(pid=71939) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:357}} Nov 24 17:03:37.527345 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.notifications [None req-148b919f-a6d8-4a0e-9ee3-232d7134a49e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '982c645cd8724e0d946e84e9b155e5cb'} {{(pid=71939) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:357}} Nov 24 17:03:37.528034 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.notifications [None req-148b919f-a6d8-4a0e-9ee3-232d7134a49e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '982c645cd8724e0d946e84e9b155e5cb'} {{(pid=71939) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:357}} Nov 24 17:03:37.536041 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.notifications [None req-148b919f-a6d8-4a0e-9ee3-232d7134a49e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '982c645cd8724e0d946e84e9b155e5cb'} {{(pid=71939) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:357}} Nov 24 17:03:37.542447 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.notifications [None req-148b919f-a6d8-4a0e-9ee3-232d7134a49e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '982c645cd8724e0d946e84e9b155e5cb'} {{(pid=71939) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:357}} Nov 24 17:03:37.548556 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: [pid: 71939|app: 0|req: 1393/2773] 10.222.0.53 () {58 vars in 1214 bytes} [Wed Nov 24 17:03:37 2021] DELETE /identity/v3/users/982c645cd8724e0d946e84e9b155e5cb => generated 0 bytes in 190 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 24 17:03:37.553447 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94d3087e-db42-4e0d-8029-52158b7a7074 None None] REQUEST_METHOD: `POST` {{(pid=71938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 24 17:03:37.553806 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94d3087e-db42-4e0d-8029-52158b7a7074 None None] SCRIPT_NAME: `/identity` {{(pid=71938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 24 17:03:37.554180 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94d3087e-db42-4e0d-8029-52158b7a7074 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=71938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 24 17:03:37.577268 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.auth.core [None req-94d3087e-db42-4e0d-8029-52158b7a7074 None None] MFA Rules not processed for user `0f2ba2e8375b4e8c8792ee1e22b60427`. Rule list: `[]` (Enabled: `True`). {{(pid=71938) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:442}} Nov 24 17:03:37.578526 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.fernet_utils [None req-94d3087e-db42-4e0d-8029-52158b7a7074 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=71938) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:289}} Nov 24 17:03:37.647290 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: [pid: 71938|app: 0|req: 1381/2774] 10.222.0.53 () {58 vars in 948 bytes} [Wed Nov 24 17:03:37 2021] POST /identity/v3/auth/tokens => generated 3669 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 24 17:03:37.659466 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-148b919f-a6d8-4a0e-9ee3-232d7134a49e admin admin] Authenticating user token {{(pid=71939) process_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 24 17:03:37.660913 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.fernet_utils [None req-148b919f-a6d8-4a0e-9ee3-232d7134a49e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=71939) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:289}} Nov 24 17:03:37.726934 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-148b919f-a6d8-4a0e-9ee3-232d7134a49e admin admin] Validating token access rules against request {{(pid=71939) validate_allowed_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 24 17:03:37.731951 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36ef04e7-934f-4920-abcb-229490ce588a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c90f21b9cdcb413282461fa83cb6b7a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3b3940d4ae1c4177ae29c02377bb4b0b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=71939) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 24 17:03:37.732591 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36ef04e7-934f-4920-abcb-229490ce588a service neutron] REQUEST_METHOD: `GET` {{(pid=71939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 24 17:03:37.732931 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36ef04e7-934f-4920-abcb-229490ce588a service neutron] SCRIPT_NAME: `/identity` {{(pid=71939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 24 17:03:37.733261 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36ef04e7-934f-4920-abcb-229490ce588a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=71939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 24 17:03:37.743504 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36ef04e7-934f-4920-abcb-229490ce588a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=71939) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:442}} Nov 24 17:03:37.771416 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36ef04e7-934f-4920-abcb-229490ce588a service neutron] RBAC: Authorization granted {{(pid=71939) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 24 17:03:37.782275 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: [pid: 71939|app: 0|req: 1394/2775] 10.222.0.53 () {60 vars in 1356 bytes} [Wed Nov 24 17:03:37 2021] GET /identity/v3/auth/tokens => generated 3669 bytes in 123 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 24 17:03:38.151258 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94d3087e-db42-4e0d-8029-52158b7a7074 None None] Authenticating user token {{(pid=71938) process_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 24 17:03:38.152786 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.fernet_utils [None req-94d3087e-db42-4e0d-8029-52158b7a7074 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=71938) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:289}} Nov 24 17:03:38.164506 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94d3087e-db42-4e0d-8029-52158b7a7074 None None] Validating token access rules against request {{(pid=71938) validate_allowed_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 24 17:03:38.169953 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf737966-fbeb-4951-8175-c93e21afa72d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f2ba2e8375b4e8c8792ee1e22b60427', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '00a5583c7b7443e98e7a1d31a0b638dc', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=71938) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 24 17:03:38.170956 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf737966-fbeb-4951-8175-c93e21afa72d admin admin] REQUEST_METHOD: `DELETE` {{(pid=71938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 24 17:03:38.171457 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf737966-fbeb-4951-8175-c93e21afa72d admin admin] SCRIPT_NAME: `/identity` {{(pid=71938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 24 17:03:38.171769 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf737966-fbeb-4951-8175-c93e21afa72d admin admin] PATH_INFO: `/v3/projects/a8bae0f615cc4e73bd9c2d792b492e71` {{(pid=71938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 24 17:03:38.173002 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf737966-fbeb-4951-8175-c93e21afa72d admin admin] RBAC: Authorizing `identity:delete_project(project_id=a8bae0f615cc4e73bd9c2d792b492e71)` {{(pid=71938) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:442}} Nov 24 17:03:38.202457 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf737966-fbeb-4951-8175-c93e21afa72d admin admin] RBAC: Authorization granted {{(pid=71938) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 24 17:03:38.255525 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.notifications [None req-bf737966-fbeb-4951-8175-c93e21afa72d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a8bae0f615cc4e73bd9c2d792b492e71', 'request_id': 'req-bf737966-fbeb-4951-8175-c93e21afa72d'} {{(pid=71938) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:357}} Nov 24 17:03:38.267193 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.notifications [None req-bf737966-fbeb-4951-8175-c93e21afa72d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a8bae0f615cc4e73bd9c2d792b492e71', 'request_id': 'req-bf737966-fbeb-4951-8175-c93e21afa72d'} {{(pid=71938) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:357}} Nov 24 17:03:38.272489 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.notifications [None req-bf737966-fbeb-4951-8175-c93e21afa72d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a8bae0f615cc4e73bd9c2d792b492e71', 'request_id': 'req-bf737966-fbeb-4951-8175-c93e21afa72d'} {{(pid=71938) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:357}} Nov 24 17:03:38.284049 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.notifications [None req-bf737966-fbeb-4951-8175-c93e21afa72d admin admin] The token cache is being invalidate because project a8bae0f615cc4e73bd9c2d792b492e71 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=71938) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Nov 24 17:03:38.284377 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.notifications [None req-bf737966-fbeb-4951-8175-c93e21afa72d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=71938) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:357}} Nov 24 17:03:38.285047 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.notifications [None req-bf737966-fbeb-4951-8175-c93e21afa72d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=71938) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:357}} Nov 24 17:03:38.286648 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: [pid: 71938|app: 0|req: 1382/2776] 10.222.0.53 () {58 vars in 1223 bytes} [Wed Nov 24 17:03:38 2021] DELETE /identity/v3/projects/a8bae0f615cc4e73bd9c2d792b492e71 => generated 0 bytes in 136 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 24 17:03:38.291091 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36ef04e7-934f-4920-abcb-229490ce588a service neutron] Authenticating user token {{(pid=71939) process_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 24 17:03:38.301568 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36ef04e7-934f-4920-abcb-229490ce588a service neutron] Validating token access rules against request {{(pid=71939) validate_allowed_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 24 17:03:38.370282 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae146f0d-a558-4ced-87ef-0274d3e17e3a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f2ba2e8375b4e8c8792ee1e22b60427', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '00a5583c7b7443e98e7a1d31a0b638dc', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=71939) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 24 17:03:38.371169 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae146f0d-a558-4ced-87ef-0274d3e17e3a admin admin] REQUEST_METHOD: `DELETE` {{(pid=71939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 24 17:03:38.371518 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae146f0d-a558-4ced-87ef-0274d3e17e3a admin admin] SCRIPT_NAME: `/identity` {{(pid=71939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 24 17:03:38.371852 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae146f0d-a558-4ced-87ef-0274d3e17e3a admin admin] PATH_INFO: `/v3/users/c28a2ece9e434e5fbee0cc36ab213b2c` {{(pid=71939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 24 17:03:38.373071 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae146f0d-a558-4ced-87ef-0274d3e17e3a admin admin] RBAC: Authorizing `identity:delete_user(user_id=c28a2ece9e434e5fbee0cc36ab213b2c)` {{(pid=71939) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:442}} Nov 24 17:03:38.401634 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae146f0d-a558-4ced-87ef-0274d3e17e3a admin admin] RBAC: Authorization granted {{(pid=71939) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 24 17:03:38.525247 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.notifications [None req-ae146f0d-a558-4ced-87ef-0274d3e17e3a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c28a2ece9e434e5fbee0cc36ab213b2c'} {{(pid=71939) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:357}} Nov 24 17:03:38.538194 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.notifications [None req-ae146f0d-a558-4ced-87ef-0274d3e17e3a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c28a2ece9e434e5fbee0cc36ab213b2c'} {{(pid=71939) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:357}} Nov 24 17:03:38.538900 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.notifications [None req-ae146f0d-a558-4ced-87ef-0274d3e17e3a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c28a2ece9e434e5fbee0cc36ab213b2c'} {{(pid=71939) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:357}} Nov 24 17:03:38.547645 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.notifications [None req-ae146f0d-a558-4ced-87ef-0274d3e17e3a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c28a2ece9e434e5fbee0cc36ab213b2c'} {{(pid=71939) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:357}} Nov 24 17:03:38.553828 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.notifications [None req-ae146f0d-a558-4ced-87ef-0274d3e17e3a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c28a2ece9e434e5fbee0cc36ab213b2c'} {{(pid=71939) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:357}} Nov 24 17:03:38.560400 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: [pid: 71939|app: 0|req: 1395/2777] 10.222.0.53 () {58 vars in 1214 bytes} [Wed Nov 24 17:03:38 2021] DELETE /identity/v3/users/c28a2ece9e434e5fbee0cc36ab213b2c => generated 0 bytes in 270 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 24 17:03:38.922040 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf737966-fbeb-4951-8175-c93e21afa72d admin admin] Authenticating user token {{(pid=71938) process_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 24 17:03:38.923732 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.fernet_utils [None req-bf737966-fbeb-4951-8175-c93e21afa72d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=71938) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:289}} Nov 24 17:03:38.938204 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf737966-fbeb-4951-8175-c93e21afa72d admin admin] Validating token access rules against request {{(pid=71938) validate_allowed_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 24 17:03:39.004045 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e643b95e-d299-4a30-b3d8-1ef8281510e3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f2ba2e8375b4e8c8792ee1e22b60427', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '00a5583c7b7443e98e7a1d31a0b638dc', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=71938) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 24 17:03:39.004917 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e643b95e-d299-4a30-b3d8-1ef8281510e3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=71938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 24 17:03:39.005282 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e643b95e-d299-4a30-b3d8-1ef8281510e3 admin admin] SCRIPT_NAME: `/identity` {{(pid=71938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 24 17:03:39.005607 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e643b95e-d299-4a30-b3d8-1ef8281510e3 admin admin] PATH_INFO: `/v3/projects/173d485cf8d04e8f9c8d3036926ff63c` {{(pid=71938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 24 17:03:39.006846 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e643b95e-d299-4a30-b3d8-1ef8281510e3 admin admin] RBAC: Authorizing `identity:delete_project(project_id=173d485cf8d04e8f9c8d3036926ff63c)` {{(pid=71938) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:442}} Nov 24 17:03:39.035621 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e643b95e-d299-4a30-b3d8-1ef8281510e3 admin admin] RBAC: Authorization granted {{(pid=71938) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 24 17:03:39.087157 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.notifications [None req-e643b95e-d299-4a30-b3d8-1ef8281510e3 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '173d485cf8d04e8f9c8d3036926ff63c', 'request_id': 'req-e643b95e-d299-4a30-b3d8-1ef8281510e3'} {{(pid=71938) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:357}} Nov 24 17:03:39.102870 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.notifications [None req-e643b95e-d299-4a30-b3d8-1ef8281510e3 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '173d485cf8d04e8f9c8d3036926ff63c', 'request_id': 'req-e643b95e-d299-4a30-b3d8-1ef8281510e3'} {{(pid=71938) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:357}} Nov 24 17:03:39.109113 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.notifications [None req-e643b95e-d299-4a30-b3d8-1ef8281510e3 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '173d485cf8d04e8f9c8d3036926ff63c', 'request_id': 'req-e643b95e-d299-4a30-b3d8-1ef8281510e3'} {{(pid=71938) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:357}} Nov 24 17:03:39.120353 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.notifications [None req-e643b95e-d299-4a30-b3d8-1ef8281510e3 admin admin] The token cache is being invalidate because project 173d485cf8d04e8f9c8d3036926ff63c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=71938) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Nov 24 17:03:39.120689 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.notifications [None req-e643b95e-d299-4a30-b3d8-1ef8281510e3 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=71938) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:357}} Nov 24 17:03:39.121357 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.notifications [None req-e643b95e-d299-4a30-b3d8-1ef8281510e3 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=71938) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:357}} Nov 24 17:03:39.123047 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: [pid: 71938|app: 0|req: 1383/2778] 10.222.0.53 () {58 vars in 1223 bytes} [Wed Nov 24 17:03:38 2021] DELETE /identity/v3/projects/173d485cf8d04e8f9c8d3036926ff63c => generated 0 bytes in 202 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 24 17:03:39.129064 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55387c95-0686-4053-aabc-af4934a910ac None None] REQUEST_METHOD: `POST` {{(pid=71939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 24 17:03:39.129411 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55387c95-0686-4053-aabc-af4934a910ac None None] SCRIPT_NAME: `/identity` {{(pid=71939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 24 17:03:39.129747 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55387c95-0686-4053-aabc-af4934a910ac None None] PATH_INFO: `/v3/auth/tokens` {{(pid=71939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 24 17:03:39.153544 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.auth.core [None req-55387c95-0686-4053-aabc-af4934a910ac None None] MFA Rules not processed for user `0f2ba2e8375b4e8c8792ee1e22b60427`. Rule list: `[]` (Enabled: `True`). {{(pid=71939) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:442}} Nov 24 17:03:39.154832 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.fernet_utils [None req-55387c95-0686-4053-aabc-af4934a910ac None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=71939) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:289}} Nov 24 17:03:39.222848 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: [pid: 71939|app: 0|req: 1396/2779] 10.222.0.53 () {58 vars in 948 bytes} [Wed Nov 24 17:03:39 2021] POST /identity/v3/auth/tokens => generated 3669 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 24 17:03:39.231823 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37880bc3-c0fc-4089-8b58-afe3f82c7737 None None] REQUEST_METHOD: `POST` {{(pid=71938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 24 17:03:39.232168 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37880bc3-c0fc-4089-8b58-afe3f82c7737 None None] SCRIPT_NAME: `/identity` {{(pid=71938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 24 17:03:39.232532 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37880bc3-c0fc-4089-8b58-afe3f82c7737 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=71938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 24 17:03:39.255765 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.auth.core [None req-37880bc3-c0fc-4089-8b58-afe3f82c7737 None None] MFA Rules not processed for user `0f2ba2e8375b4e8c8792ee1e22b60427`. Rule list: `[]` (Enabled: `True`). {{(pid=71938) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:442}} Nov 24 17:03:39.256957 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.fernet_utils [None req-37880bc3-c0fc-4089-8b58-afe3f82c7737 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=71938) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:289}} Nov 24 17:03:39.264857 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: [pid: 71938|app: 0|req: 1384/2780] 10.222.0.53 () {58 vars in 948 bytes} [Wed Nov 24 17:03:39 2021] POST /identity/v3/auth/tokens => generated 3669 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 24 17:03:39.269166 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55387c95-0686-4053-aabc-af4934a910ac None None] Authenticating user token {{(pid=71939) process_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 24 17:03:39.279434 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55387c95-0686-4053-aabc-af4934a910ac None None] Validating token access rules against request {{(pid=71939) validate_allowed_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 24 17:03:39.283933 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-611751f7-6c57-4030-bd56-029973c56291 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f2ba2e8375b4e8c8792ee1e22b60427', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '00a5583c7b7443e98e7a1d31a0b638dc', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=71939) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 24 17:03:39.284596 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-611751f7-6c57-4030-bd56-029973c56291 admin admin] REQUEST_METHOD: `GET` {{(pid=71939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 24 17:03:39.284936 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-611751f7-6c57-4030-bd56-029973c56291 admin admin] SCRIPT_NAME: `/identity` {{(pid=71939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 24 17:03:39.285269 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-611751f7-6c57-4030-bd56-029973c56291 admin admin] PATH_INFO: `/v3/domains` {{(pid=71939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 24 17:03:39.286078 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-611751f7-6c57-4030-bd56-029973c56291 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=71939) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:161}} Nov 24 17:03:39.286436 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-611751f7-6c57-4030-bd56-029973c56291 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=71939) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:442}} Nov 24 17:03:39.314993 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-611751f7-6c57-4030-bd56-029973c56291 admin admin] RBAC: Authorization granted {{(pid=71939) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 24 17:03:39.328962 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: [pid: 71939|app: 0|req: 1397/2781] 10.222.0.53 () {58 vars in 1143 bytes} [Wed Nov 24 17:03:39 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 60 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 24 17:03:39.333547 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37880bc3-c0fc-4089-8b58-afe3f82c7737 None None] Authenticating user token {{(pid=71938) process_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 24 17:03:39.343620 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37880bc3-c0fc-4089-8b58-afe3f82c7737 None None] Validating token access rules against request {{(pid=71938) validate_allowed_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 24 17:03:39.348274 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9056c3d-d168-4968-9cc6-d957230b34b9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f2ba2e8375b4e8c8792ee1e22b60427', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '00a5583c7b7443e98e7a1d31a0b638dc', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=71938) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 24 17:03:39.348936 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9056c3d-d168-4968-9cc6-d957230b34b9 admin admin] REQUEST_METHOD: `POST` {{(pid=71938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 24 17:03:39.349275 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9056c3d-d168-4968-9cc6-d957230b34b9 admin admin] SCRIPT_NAME: `/identity` {{(pid=71938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 24 17:03:39.349608 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9056c3d-d168-4968-9cc6-d957230b34b9 admin admin] PATH_INFO: `/v3/projects` {{(pid=71938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 24 17:03:39.350398 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9056c3d-d168-4968-9cc6-d957230b34b9 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=71938) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:442}} Nov 24 17:03:39.379351 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9056c3d-d168-4968-9cc6-d957230b34b9 admin admin] RBAC: Authorization granted {{(pid=71938) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 24 17:03:39.406696 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: [pid: 71938|app: 0|req: 1385/2782] 10.222.0.53 () {60 vars in 1143 bytes} [Wed Nov 24 17:03:39 2021] POST /identity/v3/projects => generated 363 bytes in 74 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 24 17:03:39.410985 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-611751f7-6c57-4030-bd56-029973c56291 admin admin] Authenticating user token {{(pid=71939) process_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 24 17:03:39.420936 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-611751f7-6c57-4030-bd56-029973c56291 admin admin] Validating token access rules against request {{(pid=71939) validate_allowed_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 24 17:03:39.487073 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c8053b8-abae-43d4-a401-bf9788ca62d2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f2ba2e8375b4e8c8792ee1e22b60427', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '00a5583c7b7443e98e7a1d31a0b638dc', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=71939) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 24 17:03:39.487761 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c8053b8-abae-43d4-a401-bf9788ca62d2 admin admin] REQUEST_METHOD: `POST` {{(pid=71939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 24 17:03:39.488100 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c8053b8-abae-43d4-a401-bf9788ca62d2 admin admin] SCRIPT_NAME: `/identity` {{(pid=71939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 24 17:03:39.488433 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c8053b8-abae-43d4-a401-bf9788ca62d2 admin admin] PATH_INFO: `/v3/users` {{(pid=71939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 24 17:03:39.489166 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c8053b8-abae-43d4-a401-bf9788ca62d2 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=71939) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:442}} Nov 24 17:03:39.517990 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c8053b8-abae-43d4-a401-bf9788ca62d2 admin admin] RBAC: Authorization granted {{(pid=71939) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 24 17:03:39.537164 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: [pid: 71939|app: 0|req: 1398/2783] 10.222.0.53 () {60 vars in 1134 bytes} [Wed Nov 24 17:03:39 2021] POST /identity/v3/users => generated 282 bytes in 127 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 24 17:03:39.541611 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9056c3d-d168-4968-9cc6-d957230b34b9 admin admin] Authenticating user token {{(pid=71938) process_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 24 17:03:39.551934 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9056c3d-d168-4968-9cc6-d957230b34b9 admin admin] Validating token access rules against request {{(pid=71938) validate_allowed_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 24 17:03:39.556504 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad9d858a-769b-4ff5-9640-d680b977adb7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f2ba2e8375b4e8c8792ee1e22b60427', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '00a5583c7b7443e98e7a1d31a0b638dc', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=71938) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 24 17:03:39.557441 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad9d858a-769b-4ff5-9640-d680b977adb7 admin admin] REQUEST_METHOD: `GET` {{(pid=71938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 24 17:03:39.557781 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad9d858a-769b-4ff5-9640-d680b977adb7 admin admin] SCRIPT_NAME: `/identity` {{(pid=71938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 24 17:03:39.558145 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad9d858a-769b-4ff5-9640-d680b977adb7 admin admin] PATH_INFO: `/v3/roles` {{(pid=71938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 24 17:03:39.558931 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad9d858a-769b-4ff5-9640-d680b977adb7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=71938) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:442}} Nov 24 17:03:39.587571 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad9d858a-769b-4ff5-9640-d680b977adb7 admin admin] RBAC: Authorization granted {{(pid=71938) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 24 17:03:39.598820 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: [pid: 71938|app: 0|req: 1386/2784] 10.222.0.53 () {58 vars in 1112 bytes} [Wed Nov 24 17:03:39 2021] GET /identity/v3/roles => generated 1420 bytes in 58 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 24 17:03:39.603017 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c8053b8-abae-43d4-a401-bf9788ca62d2 admin admin] Authenticating user token {{(pid=71939) process_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 24 17:03:39.613901 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c8053b8-abae-43d4-a401-bf9788ca62d2 admin admin] Validating token access rules against request {{(pid=71939) validate_allowed_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 24 17:03:39.618662 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea902cdb-77b9-4403-9308-58a6fa85768e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f2ba2e8375b4e8c8792ee1e22b60427', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '00a5583c7b7443e98e7a1d31a0b638dc', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=71939) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 24 17:03:39.619570 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea902cdb-77b9-4403-9308-58a6fa85768e admin admin] REQUEST_METHOD: `PUT` {{(pid=71939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 24 17:03:39.619915 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea902cdb-77b9-4403-9308-58a6fa85768e admin admin] SCRIPT_NAME: `/identity` {{(pid=71939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 24 17:03:39.620254 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea902cdb-77b9-4403-9308-58a6fa85768e admin admin] PATH_INFO: `/v3/projects/5443b3068801477a811e1c24bd86819e/users/6967e08953ea4e13b6670d7e1d00c13b/roles/912ab5f10fa5477da74acf239f07604e` {{(pid=71939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 24 17:03:39.641586 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea902cdb-77b9-4403-9308-58a6fa85768e admin admin] RBAC: Authorizing `identity:create_grant(project_id=5443b3068801477a811e1c24bd86819e, user_id=6967e08953ea4e13b6670d7e1d00c13b, role_id=912ab5f10fa5477da74acf239f07604e)` {{(pid=71939) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:442}} Nov 24 17:03:39.671629 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea902cdb-77b9-4403-9308-58a6fa85768e admin admin] RBAC: Authorization granted {{(pid=71939) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 24 17:03:39.683685 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: [pid: 71939|app: 0|req: 1399/2785] 10.222.0.53 () {60 vars in 1473 bytes} [Wed Nov 24 17:03:39 2021] PUT /identity/v3/projects/5443b3068801477a811e1c24bd86819e/users/6967e08953ea4e13b6670d7e1d00c13b/roles/912ab5f10fa5477da74acf239f07604e => generated 0 bytes in 81 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 24 17:03:39.695644 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8128166f-4a40-419c-a0aa-e54a90bd525f None None] REQUEST_METHOD: `POST` {{(pid=71938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 24 17:03:39.695995 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8128166f-4a40-419c-a0aa-e54a90bd525f None None] SCRIPT_NAME: `/identity` {{(pid=71938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 24 17:03:39.696340 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8128166f-4a40-419c-a0aa-e54a90bd525f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=71938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 24 17:03:39.736982 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.auth.core [None req-8128166f-4a40-419c-a0aa-e54a90bd525f None None] MFA Rules not processed for user `6967e08953ea4e13b6670d7e1d00c13b`. Rule list: `[]` (Enabled: `True`). {{(pid=71938) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:442}} Nov 24 17:03:39.738265 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.fernet_utils [None req-8128166f-4a40-419c-a0aa-e54a90bd525f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=71938) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:289}} Nov 24 17:03:39.814272 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: [pid: 71938|app: 0|req: 1387/2786] 10.222.0.53 () {58 vars in 948 bytes} [Wed Nov 24 17:03:39 2021] POST /identity/v3/auth/tokens => generated 3670 bytes in 120 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 24 17:03:39.819091 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea902cdb-77b9-4403-9308-58a6fa85768e admin admin] Authenticating user token {{(pid=71939) process_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 24 17:03:39.891124 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea902cdb-77b9-4403-9308-58a6fa85768e admin admin] Validating token access rules against request {{(pid=71939) validate_allowed_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 24 17:03:39.895874 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-259d6194-f987-4197-93d8-a1e36f428d1d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f2ba2e8375b4e8c8792ee1e22b60427', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '00a5583c7b7443e98e7a1d31a0b638dc', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=71939) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 24 17:03:39.896544 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-259d6194-f987-4197-93d8-a1e36f428d1d admin admin] REQUEST_METHOD: `POST` {{(pid=71939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 24 17:03:39.896884 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-259d6194-f987-4197-93d8-a1e36f428d1d admin admin] SCRIPT_NAME: `/identity` {{(pid=71939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 24 17:03:39.897221 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-259d6194-f987-4197-93d8-a1e36f428d1d admin admin] PATH_INFO: `/v3/projects` {{(pid=71939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 24 17:03:39.897955 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-259d6194-f987-4197-93d8-a1e36f428d1d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=71939) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:442}} Nov 24 17:03:39.926275 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-259d6194-f987-4197-93d8-a1e36f428d1d admin admin] RBAC: Authorization granted {{(pid=71939) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 24 17:03:39.953243 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: [pid: 71939|app: 0|req: 1400/2787] 10.222.0.53 () {60 vars in 1143 bytes} [Wed Nov 24 17:03:39 2021] POST /identity/v3/projects => generated 363 bytes in 135 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 24 17:03:39.957517 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8128166f-4a40-419c-a0aa-e54a90bd525f None None] Authenticating user token {{(pid=71938) process_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 24 17:03:39.968388 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8128166f-4a40-419c-a0aa-e54a90bd525f None None] Validating token access rules against request {{(pid=71938) validate_allowed_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 24 17:03:40.035258 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1bc72e3-e262-445e-a52e-fe1ee5aba53a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f2ba2e8375b4e8c8792ee1e22b60427', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '00a5583c7b7443e98e7a1d31a0b638dc', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=71938) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 24 17:03:40.035937 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1bc72e3-e262-445e-a52e-fe1ee5aba53a admin admin] REQUEST_METHOD: `POST` {{(pid=71938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 24 17:03:40.036272 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1bc72e3-e262-445e-a52e-fe1ee5aba53a admin admin] SCRIPT_NAME: `/identity` {{(pid=71938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 24 17:03:40.036598 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1bc72e3-e262-445e-a52e-fe1ee5aba53a admin admin] PATH_INFO: `/v3/users` {{(pid=71938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 24 17:03:40.037329 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1bc72e3-e262-445e-a52e-fe1ee5aba53a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=71938) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:442}} Nov 24 17:03:40.066132 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1bc72e3-e262-445e-a52e-fe1ee5aba53a admin admin] RBAC: Authorization granted {{(pid=71938) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 24 17:03:40.086099 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: [pid: 71938|app: 0|req: 1388/2788] 10.222.0.53 () {60 vars in 1134 bytes} [Wed Nov 24 17:03:39 2021] POST /identity/v3/users => generated 288 bytes in 129 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 24 17:03:40.090464 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-259d6194-f987-4197-93d8-a1e36f428d1d admin admin] Authenticating user token {{(pid=71939) process_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 24 17:03:40.100982 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-259d6194-f987-4197-93d8-a1e36f428d1d admin admin] Validating token access rules against request {{(pid=71939) validate_allowed_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 24 17:03:40.105612 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11d825b8-5536-4858-90eb-dc5ce039c61b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f2ba2e8375b4e8c8792ee1e22b60427', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '00a5583c7b7443e98e7a1d31a0b638dc', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=71939) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 24 17:03:40.106316 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11d825b8-5536-4858-90eb-dc5ce039c61b admin admin] REQUEST_METHOD: `GET` {{(pid=71939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 24 17:03:40.106659 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11d825b8-5536-4858-90eb-dc5ce039c61b admin admin] SCRIPT_NAME: `/identity` {{(pid=71939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 24 17:03:40.106993 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11d825b8-5536-4858-90eb-dc5ce039c61b admin admin] PATH_INFO: `/v3/roles` {{(pid=71939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 24 17:03:40.107778 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11d825b8-5536-4858-90eb-dc5ce039c61b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=71939) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:442}} Nov 24 17:03:40.137487 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11d825b8-5536-4858-90eb-dc5ce039c61b admin admin] RBAC: Authorization granted {{(pid=71939) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 24 17:03:40.149625 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: [pid: 71939|app: 0|req: 1401/2789] 10.222.0.53 () {58 vars in 1112 bytes} [Wed Nov 24 17:03:40 2021] GET /identity/v3/roles => generated 1420 bytes in 60 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 24 17:03:40.154157 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1bc72e3-e262-445e-a52e-fe1ee5aba53a admin admin] Authenticating user token {{(pid=71938) process_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 24 17:03:40.165108 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1bc72e3-e262-445e-a52e-fe1ee5aba53a admin admin] Validating token access rules against request {{(pid=71938) validate_allowed_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 24 17:03:40.170431 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-556a84e9-3f60-4a35-b2a4-c593fab85dc6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f2ba2e8375b4e8c8792ee1e22b60427', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '00a5583c7b7443e98e7a1d31a0b638dc', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=71938) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 24 17:03:40.171642 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-556a84e9-3f60-4a35-b2a4-c593fab85dc6 admin admin] REQUEST_METHOD: `PUT` {{(pid=71938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 24 17:03:40.171773 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-556a84e9-3f60-4a35-b2a4-c593fab85dc6 admin admin] SCRIPT_NAME: `/identity` {{(pid=71938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 24 17:03:40.172157 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-556a84e9-3f60-4a35-b2a4-c593fab85dc6 admin admin] PATH_INFO: `/v3/projects/634c067bf7c44a9c93fb360dc67fa7bd/users/f98d110f82364c048694787cbfd94ce8/roles/5611724e350b41e19921b5961a342582` {{(pid=71938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 24 17:03:40.196520 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-556a84e9-3f60-4a35-b2a4-c593fab85dc6 admin admin] RBAC: Authorizing `identity:create_grant(project_id=634c067bf7c44a9c93fb360dc67fa7bd, user_id=f98d110f82364c048694787cbfd94ce8, role_id=5611724e350b41e19921b5961a342582)` {{(pid=71938) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:442}} Nov 24 17:03:40.227223 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-556a84e9-3f60-4a35-b2a4-c593fab85dc6 admin admin] RBAC: Authorization granted {{(pid=71938) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 24 17:03:40.240526 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: [pid: 71938|app: 0|req: 1389/2790] 10.222.0.53 () {60 vars in 1473 bytes} [Wed Nov 24 17:03:40 2021] PUT /identity/v3/projects/634c067bf7c44a9c93fb360dc67fa7bd/users/f98d110f82364c048694787cbfd94ce8/roles/5611724e350b41e19921b5961a342582 => generated 0 bytes in 87 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 24 17:03:40.245423 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11d825b8-5536-4858-90eb-dc5ce039c61b admin admin] Authenticating user token {{(pid=71939) process_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 24 17:03:40.255480 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11d825b8-5536-4858-90eb-dc5ce039c61b admin admin] Validating token access rules against request {{(pid=71939) validate_allowed_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 24 17:03:40.323338 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88b3638b-9156-479a-a245-f9ed92bf3e7c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f2ba2e8375b4e8c8792ee1e22b60427', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '00a5583c7b7443e98e7a1d31a0b638dc', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=71939) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 24 17:03:40.324022 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88b3638b-9156-479a-a245-f9ed92bf3e7c admin admin] REQUEST_METHOD: `GET` {{(pid=71939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 24 17:03:40.324390 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88b3638b-9156-479a-a245-f9ed92bf3e7c admin admin] SCRIPT_NAME: `/identity` {{(pid=71939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 24 17:03:40.324721 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88b3638b-9156-479a-a245-f9ed92bf3e7c admin admin] PATH_INFO: `/v3/roles` {{(pid=71939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 24 17:03:40.325559 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88b3638b-9156-479a-a245-f9ed92bf3e7c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=71939) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:442}} Nov 24 17:03:40.354397 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88b3638b-9156-479a-a245-f9ed92bf3e7c admin admin] RBAC: Authorization granted {{(pid=71939) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 24 17:03:40.365400 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: [pid: 71939|app: 0|req: 1402/2791] 10.222.0.53 () {58 vars in 1112 bytes} [Wed Nov 24 17:03:40 2021] GET /identity/v3/roles => generated 1420 bytes in 121 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 24 17:03:40.370067 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-556a84e9-3f60-4a35-b2a4-c593fab85dc6 admin admin] Authenticating user token {{(pid=71938) process_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 24 17:03:40.380577 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-556a84e9-3f60-4a35-b2a4-c593fab85dc6 admin admin] Validating token access rules against request {{(pid=71938) validate_allowed_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 24 17:03:40.385173 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-745948cd-b072-4905-a492-0df517d93038 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f2ba2e8375b4e8c8792ee1e22b60427', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '00a5583c7b7443e98e7a1d31a0b638dc', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=71938) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 24 17:03:40.386098 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-745948cd-b072-4905-a492-0df517d93038 admin admin] REQUEST_METHOD: `PUT` {{(pid=71938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 24 17:03:40.386443 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-745948cd-b072-4905-a492-0df517d93038 admin admin] SCRIPT_NAME: `/identity` {{(pid=71938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 24 17:03:40.386778 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-745948cd-b072-4905-a492-0df517d93038 admin admin] PATH_INFO: `/v3/projects/634c067bf7c44a9c93fb360dc67fa7bd/users/f98d110f82364c048694787cbfd94ce8/roles/5611724e350b41e19921b5961a342582` {{(pid=71938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 24 17:03:40.388759 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-745948cd-b072-4905-a492-0df517d93038 admin admin] RBAC: Authorizing `identity:create_grant(project_id=634c067bf7c44a9c93fb360dc67fa7bd, user_id=f98d110f82364c048694787cbfd94ce8, role_id=5611724e350b41e19921b5961a342582)` {{(pid=71938) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:442}} Nov 24 17:03:40.418505 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-745948cd-b072-4905-a492-0df517d93038 admin admin] RBAC: Authorization granted {{(pid=71938) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 24 17:03:40.428771 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: [pid: 71938|app: 0|req: 1390/2792] 10.222.0.53 () {60 vars in 1473 bytes} [Wed Nov 24 17:03:40 2021] PUT /identity/v3/projects/634c067bf7c44a9c93fb360dc67fa7bd/users/f98d110f82364c048694787cbfd94ce8/roles/5611724e350b41e19921b5961a342582 => generated 0 bytes in 60 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 24 17:03:40.433586 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88b3638b-9156-479a-a245-f9ed92bf3e7c admin admin] Authenticating user token {{(pid=71939) process_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 24 17:03:40.443787 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88b3638b-9156-479a-a245-f9ed92bf3e7c admin admin] Validating token access rules against request {{(pid=71939) validate_allowed_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 24 17:03:40.510385 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41ae52ba-4e9f-49fd-9a4e-065a0badd014 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f2ba2e8375b4e8c8792ee1e22b60427', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '00a5583c7b7443e98e7a1d31a0b638dc', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=71939) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 24 17:03:40.511062 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41ae52ba-4e9f-49fd-9a4e-065a0badd014 admin admin] REQUEST_METHOD: `GET` {{(pid=71939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 24 17:03:40.511406 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41ae52ba-4e9f-49fd-9a4e-065a0badd014 admin admin] SCRIPT_NAME: `/identity` {{(pid=71939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 24 17:03:40.511746 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41ae52ba-4e9f-49fd-9a4e-065a0badd014 admin admin] PATH_INFO: `/v3/roles` {{(pid=71939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 24 17:03:40.512532 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41ae52ba-4e9f-49fd-9a4e-065a0badd014 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=71939) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:442}} Nov 24 17:03:40.540894 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41ae52ba-4e9f-49fd-9a4e-065a0badd014 admin admin] RBAC: Authorization granted {{(pid=71939) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 24 17:03:40.552439 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: [pid: 71939|app: 0|req: 1403/2793] 10.222.0.53 () {58 vars in 1112 bytes} [Wed Nov 24 17:03:40 2021] GET /identity/v3/roles => generated 1420 bytes in 119 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Nov 24 17:03:40.557209 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-745948cd-b072-4905-a492-0df517d93038 admin admin] Authenticating user token {{(pid=71938) process_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 24 17:03:40.567582 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-745948cd-b072-4905-a492-0df517d93038 admin admin] Validating token access rules against request {{(pid=71938) validate_allowed_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 24 17:03:40.572199 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15e65621-d84c-41ff-91b2-971d80b9a034 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f2ba2e8375b4e8c8792ee1e22b60427', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '00a5583c7b7443e98e7a1d31a0b638dc', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=71938) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 24 17:03:40.573105 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15e65621-d84c-41ff-91b2-971d80b9a034 admin admin] REQUEST_METHOD: `PUT` {{(pid=71938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 24 17:03:40.573446 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15e65621-d84c-41ff-91b2-971d80b9a034 admin admin] SCRIPT_NAME: `/identity` {{(pid=71938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 24 17:03:40.573783 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15e65621-d84c-41ff-91b2-971d80b9a034 admin admin] PATH_INFO: `/v3/projects/634c067bf7c44a9c93fb360dc67fa7bd/users/f98d110f82364c048694787cbfd94ce8/roles/912ab5f10fa5477da74acf239f07604e` {{(pid=71938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 24 17:03:40.575784 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15e65621-d84c-41ff-91b2-971d80b9a034 admin admin] RBAC: Authorizing `identity:create_grant(project_id=634c067bf7c44a9c93fb360dc67fa7bd, user_id=f98d110f82364c048694787cbfd94ce8, role_id=912ab5f10fa5477da74acf239f07604e)` {{(pid=71938) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:442}} Nov 24 17:03:40.606222 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15e65621-d84c-41ff-91b2-971d80b9a034 admin admin] RBAC: Authorization granted {{(pid=71938) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 24 17:03:40.618706 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: [pid: 71938|app: 0|req: 1391/2794] 10.222.0.53 () {60 vars in 1473 bytes} [Wed Nov 24 17:03:40 2021] PUT /identity/v3/projects/634c067bf7c44a9c93fb360dc67fa7bd/users/f98d110f82364c048694787cbfd94ce8/roles/912ab5f10fa5477da74acf239f07604e => generated 0 bytes in 62 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 24 17:03:40.629530 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c979835-4d84-47c9-8f35-cbd8e0f34352 None None] REQUEST_METHOD: `POST` {{(pid=71939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 24 17:03:40.629884 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c979835-4d84-47c9-8f35-cbd8e0f34352 None None] SCRIPT_NAME: `/identity` {{(pid=71939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 24 17:03:40.630259 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c979835-4d84-47c9-8f35-cbd8e0f34352 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=71939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 24 17:03:40.669191 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.auth.core [None req-9c979835-4d84-47c9-8f35-cbd8e0f34352 None None] MFA Rules not processed for user `f98d110f82364c048694787cbfd94ce8`. Rule list: `[]` (Enabled: `True`). {{(pid=71939) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:442}} Nov 24 17:03:40.670411 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.fernet_utils [None req-9c979835-4d84-47c9-8f35-cbd8e0f34352 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=71939) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:289}} Nov 24 17:03:40.749754 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: [pid: 71939|app: 0|req: 1404/2795] 10.222.0.53 () {58 vars in 948 bytes} [Wed Nov 24 17:03:40 2021] POST /identity/v3/auth/tokens => generated 3737 bytes in 121 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 24 17:03:40.760612 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15e65621-d84c-41ff-91b2-971d80b9a034 admin admin] Authenticating user token {{(pid=71938) process_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 24 17:03:40.762507 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.fernet_utils [None req-15e65621-d84c-41ff-91b2-971d80b9a034 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=71938) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:289}} Nov 24 17:03:40.859393 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15e65621-d84c-41ff-91b2-971d80b9a034 admin admin] Validating token access rules against request {{(pid=71938) validate_allowed_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 24 17:03:40.863163 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78690faf-08b7-4839-b543-c3025bf5d66e service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a12374a3093a401a97c343ff0854184d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3b3940d4ae1c4177ae29c02377bb4b0b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=71938) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 24 17:03:40.863823 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78690faf-08b7-4839-b543-c3025bf5d66e service cinder] REQUEST_METHOD: `GET` {{(pid=71938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 24 17:03:40.864165 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78690faf-08b7-4839-b543-c3025bf5d66e service cinder] SCRIPT_NAME: `/identity` {{(pid=71938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 24 17:03:40.864501 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78690faf-08b7-4839-b543-c3025bf5d66e service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=71938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 24 17:03:40.874058 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78690faf-08b7-4839-b543-c3025bf5d66e service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=71938) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:442}} Nov 24 17:03:40.902764 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78690faf-08b7-4839-b543-c3025bf5d66e service cinder] RBAC: Authorization granted {{(pid=71938) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 24 17:03:40.912351 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: [pid: 71938|app: 0|req: 1392/2796] 10.222.0.53 () {60 vars in 1356 bytes} [Wed Nov 24 17:03:40 2021] GET /identity/v3/auth/tokens => generated 3737 bytes in 152 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 24 17:03:41.017693 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c979835-4d84-47c9-8f35-cbd8e0f34352 None None] Authenticating user token {{(pid=71939) process_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 24 17:03:41.028333 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c979835-4d84-47c9-8f35-cbd8e0f34352 None None] Validating token access rules against request {{(pid=71939) validate_allowed_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 24 17:03:41.032080 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7740bd05-e0f9-4eb0-9e3a-3e12d8eedaa0 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a12374a3093a401a97c343ff0854184d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3b3940d4ae1c4177ae29c02377bb4b0b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=71939) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 24 17:03:41.032739 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7740bd05-e0f9-4eb0-9e3a-3e12d8eedaa0 service cinder] REQUEST_METHOD: `GET` {{(pid=71939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 24 17:03:41.033082 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7740bd05-e0f9-4eb0-9e3a-3e12d8eedaa0 service cinder] SCRIPT_NAME: `/identity` {{(pid=71939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 24 17:03:41.033425 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7740bd05-e0f9-4eb0-9e3a-3e12d8eedaa0 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=71939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 24 17:03:41.111312 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7740bd05-e0f9-4eb0-9e3a-3e12d8eedaa0 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=71939) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:442}} Nov 24 17:03:41.139391 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7740bd05-e0f9-4eb0-9e3a-3e12d8eedaa0 service cinder] RBAC: Authorization granted {{(pid=71939) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 24 17:03:41.148724 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: [pid: 71939|app: 0|req: 1405/2797] 10.222.0.53 () {60 vars in 1356 bytes} [Wed Nov 24 17:03:41 2021] GET /identity/v3/auth/tokens => generated 3670 bytes in 132 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 24 17:03:44.001257 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78690faf-08b7-4839-b543-c3025bf5d66e service cinder] Authenticating user token {{(pid=71938) process_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 24 17:03:44.075481 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78690faf-08b7-4839-b543-c3025bf5d66e service cinder] Validating token access rules against request {{(pid=71938) validate_allowed_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 24 17:03:44.080076 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ea9d352-500a-4992-ac9b-70750d91579a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f2ba2e8375b4e8c8792ee1e22b60427', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '00a5583c7b7443e98e7a1d31a0b638dc', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=71938) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 24 17:03:44.080961 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ea9d352-500a-4992-ac9b-70750d91579a admin admin] REQUEST_METHOD: `DELETE` {{(pid=71938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 24 17:03:44.081299 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ea9d352-500a-4992-ac9b-70750d91579a admin admin] SCRIPT_NAME: `/identity` {{(pid=71938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 24 17:03:44.081633 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ea9d352-500a-4992-ac9b-70750d91579a admin admin] PATH_INFO: `/v3/users/6967e08953ea4e13b6670d7e1d00c13b` {{(pid=71938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 24 17:03:44.082877 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ea9d352-500a-4992-ac9b-70750d91579a admin admin] RBAC: Authorizing `identity:delete_user(user_id=6967e08953ea4e13b6670d7e1d00c13b)` {{(pid=71938) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:442}} Nov 24 17:03:44.111661 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ea9d352-500a-4992-ac9b-70750d91579a admin admin] RBAC: Authorization granted {{(pid=71938) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 24 17:03:44.159577 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.notifications [None req-7ea9d352-500a-4992-ac9b-70750d91579a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '6967e08953ea4e13b6670d7e1d00c13b'} {{(pid=71938) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:357}} Nov 24 17:03:44.171874 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.notifications [None req-7ea9d352-500a-4992-ac9b-70750d91579a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '6967e08953ea4e13b6670d7e1d00c13b'} {{(pid=71938) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:357}} Nov 24 17:03:44.172578 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.notifications [None req-7ea9d352-500a-4992-ac9b-70750d91579a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '6967e08953ea4e13b6670d7e1d00c13b'} {{(pid=71938) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:357}} Nov 24 17:03:44.180750 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.notifications [None req-7ea9d352-500a-4992-ac9b-70750d91579a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '6967e08953ea4e13b6670d7e1d00c13b'} {{(pid=71938) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:357}} Nov 24 17:03:44.187128 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.notifications [None req-7ea9d352-500a-4992-ac9b-70750d91579a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '6967e08953ea4e13b6670d7e1d00c13b'} {{(pid=71938) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:357}} Nov 24 17:03:44.193674 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: [pid: 71938|app: 0|req: 1393/2798] 10.222.0.53 () {58 vars in 1214 bytes} [Wed Nov 24 17:03:44 2021] DELETE /identity/v3/users/6967e08953ea4e13b6670d7e1d00c13b => generated 0 bytes in 193 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 24 17:03:44.198989 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46c0bd87-eece-4b23-b3cf-a16edfdc1d3f None None] REQUEST_METHOD: `POST` {{(pid=71939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 24 17:03:44.199415 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46c0bd87-eece-4b23-b3cf-a16edfdc1d3f None None] SCRIPT_NAME: `/identity` {{(pid=71939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 24 17:03:44.199856 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46c0bd87-eece-4b23-b3cf-a16edfdc1d3f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=71939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 24 17:03:44.224119 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.auth.core [None req-46c0bd87-eece-4b23-b3cf-a16edfdc1d3f None None] MFA Rules not processed for user `0f2ba2e8375b4e8c8792ee1e22b60427`. Rule list: `[]` (Enabled: `True`). {{(pid=71939) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:442}} Nov 24 17:03:44.225339 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.fernet_utils [None req-46c0bd87-eece-4b23-b3cf-a16edfdc1d3f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=71939) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:289}} Nov 24 17:03:44.291679 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: [pid: 71939|app: 0|req: 1406/2799] 10.222.0.53 () {58 vars in 948 bytes} [Wed Nov 24 17:03:44 2021] POST /identity/v3/auth/tokens => generated 3669 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 24 17:03:44.302849 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ea9d352-500a-4992-ac9b-70750d91579a admin admin] Authenticating user token {{(pid=71938) process_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 24 17:03:44.304298 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.fernet_utils [None req-7ea9d352-500a-4992-ac9b-70750d91579a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=71938) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:289}} Nov 24 17:03:44.373533 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ea9d352-500a-4992-ac9b-70750d91579a admin admin] Validating token access rules against request {{(pid=71938) validate_allowed_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 24 17:03:44.377259 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85575e0b-848f-4aac-b8b5-1ec8830a86db service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c90f21b9cdcb413282461fa83cb6b7a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3b3940d4ae1c4177ae29c02377bb4b0b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=71938) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 24 17:03:44.377931 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85575e0b-848f-4aac-b8b5-1ec8830a86db service neutron] REQUEST_METHOD: `GET` {{(pid=71938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 24 17:03:44.378320 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85575e0b-848f-4aac-b8b5-1ec8830a86db service neutron] SCRIPT_NAME: `/identity` {{(pid=71938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 24 17:03:44.378654 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85575e0b-848f-4aac-b8b5-1ec8830a86db service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=71938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 24 17:03:44.388970 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85575e0b-848f-4aac-b8b5-1ec8830a86db service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=71938) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:442}} Nov 24 17:03:44.417041 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85575e0b-848f-4aac-b8b5-1ec8830a86db service neutron] RBAC: Authorization granted {{(pid=71938) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 24 17:03:44.427131 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: [pid: 71938|app: 0|req: 1394/2800] 10.222.0.53 () {60 vars in 1356 bytes} [Wed Nov 24 17:03:44 2021] GET /identity/v3/auth/tokens => generated 3669 bytes in 125 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 24 17:03:44.785308 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46c0bd87-eece-4b23-b3cf-a16edfdc1d3f None None] Authenticating user token {{(pid=71939) process_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 24 17:03:44.786868 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.fernet_utils [None req-46c0bd87-eece-4b23-b3cf-a16edfdc1d3f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=71939) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:289}} Nov 24 17:03:44.799071 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46c0bd87-eece-4b23-b3cf-a16edfdc1d3f None None] Validating token access rules against request {{(pid=71939) validate_allowed_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 24 17:03:44.803936 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e70aae5-21fe-43bb-a76a-81168ca879dc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f2ba2e8375b4e8c8792ee1e22b60427', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '00a5583c7b7443e98e7a1d31a0b638dc', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=71939) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 24 17:03:44.804812 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e70aae5-21fe-43bb-a76a-81168ca879dc admin admin] REQUEST_METHOD: `DELETE` {{(pid=71939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 24 17:03:44.805153 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e70aae5-21fe-43bb-a76a-81168ca879dc admin admin] SCRIPT_NAME: `/identity` {{(pid=71939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 24 17:03:44.805487 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e70aae5-21fe-43bb-a76a-81168ca879dc admin admin] PATH_INFO: `/v3/projects/5443b3068801477a811e1c24bd86819e` {{(pid=71939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 24 17:03:44.807675 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e70aae5-21fe-43bb-a76a-81168ca879dc admin admin] RBAC: Authorizing `identity:delete_project(project_id=5443b3068801477a811e1c24bd86819e)` {{(pid=71939) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:442}} Nov 24 17:03:44.836075 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e70aae5-21fe-43bb-a76a-81168ca879dc admin admin] RBAC: Authorization granted {{(pid=71939) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 24 17:03:44.889195 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.notifications [None req-4e70aae5-21fe-43bb-a76a-81168ca879dc admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '5443b3068801477a811e1c24bd86819e', 'request_id': 'req-4e70aae5-21fe-43bb-a76a-81168ca879dc'} {{(pid=71939) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:357}} Nov 24 17:03:44.900957 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.notifications [None req-4e70aae5-21fe-43bb-a76a-81168ca879dc admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '5443b3068801477a811e1c24bd86819e', 'request_id': 'req-4e70aae5-21fe-43bb-a76a-81168ca879dc'} {{(pid=71939) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:357}} Nov 24 17:03:44.906843 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.notifications [None req-4e70aae5-21fe-43bb-a76a-81168ca879dc admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '5443b3068801477a811e1c24bd86819e', 'request_id': 'req-4e70aae5-21fe-43bb-a76a-81168ca879dc'} {{(pid=71939) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:357}} Nov 24 17:03:44.917704 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.notifications [None req-4e70aae5-21fe-43bb-a76a-81168ca879dc admin admin] The token cache is being invalidate because project 5443b3068801477a811e1c24bd86819e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=71939) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Nov 24 17:03:44.918065 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.notifications [None req-4e70aae5-21fe-43bb-a76a-81168ca879dc admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=71939) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:357}} Nov 24 17:03:44.918733 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.notifications [None req-4e70aae5-21fe-43bb-a76a-81168ca879dc admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=71939) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:357}} Nov 24 17:03:44.920289 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: [pid: 71939|app: 0|req: 1407/2801] 10.222.0.53 () {58 vars in 1223 bytes} [Wed Nov 24 17:03:44 2021] DELETE /identity/v3/projects/5443b3068801477a811e1c24bd86819e => generated 0 bytes in 136 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 24 17:03:44.924744 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85575e0b-848f-4aac-b8b5-1ec8830a86db service neutron] Authenticating user token {{(pid=71938) process_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 24 17:03:44.935814 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85575e0b-848f-4aac-b8b5-1ec8830a86db service neutron] Validating token access rules against request {{(pid=71938) validate_allowed_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 24 17:03:45.002126 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71daf23a-0d02-46ec-a4bc-74abd259bfa9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f2ba2e8375b4e8c8792ee1e22b60427', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '00a5583c7b7443e98e7a1d31a0b638dc', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=71938) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 24 17:03:45.003018 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71daf23a-0d02-46ec-a4bc-74abd259bfa9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=71938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 24 17:03:45.003354 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71daf23a-0d02-46ec-a4bc-74abd259bfa9 admin admin] SCRIPT_NAME: `/identity` {{(pid=71938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 24 17:03:45.003680 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71daf23a-0d02-46ec-a4bc-74abd259bfa9 admin admin] PATH_INFO: `/v3/users/f98d110f82364c048694787cbfd94ce8` {{(pid=71938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 24 17:03:45.004887 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71daf23a-0d02-46ec-a4bc-74abd259bfa9 admin admin] RBAC: Authorizing `identity:delete_user(user_id=f98d110f82364c048694787cbfd94ce8)` {{(pid=71938) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:442}} Nov 24 17:03:45.034306 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71daf23a-0d02-46ec-a4bc-74abd259bfa9 admin admin] RBAC: Authorization granted {{(pid=71938) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 24 17:03:45.082552 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.notifications [None req-71daf23a-0d02-46ec-a4bc-74abd259bfa9 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f98d110f82364c048694787cbfd94ce8'} {{(pid=71938) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:357}} Nov 24 17:03:45.095280 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.notifications [None req-71daf23a-0d02-46ec-a4bc-74abd259bfa9 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f98d110f82364c048694787cbfd94ce8'} {{(pid=71938) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:357}} Nov 24 17:03:45.095998 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.notifications [None req-71daf23a-0d02-46ec-a4bc-74abd259bfa9 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f98d110f82364c048694787cbfd94ce8'} {{(pid=71938) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:357}} Nov 24 17:03:45.104890 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.notifications [None req-71daf23a-0d02-46ec-a4bc-74abd259bfa9 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f98d110f82364c048694787cbfd94ce8'} {{(pid=71938) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:357}} Nov 24 17:03:45.110950 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.notifications [None req-71daf23a-0d02-46ec-a4bc-74abd259bfa9 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f98d110f82364c048694787cbfd94ce8'} {{(pid=71938) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:357}} Nov 24 17:03:45.117178 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: [pid: 71938|app: 0|req: 1395/2802] 10.222.0.53 () {58 vars in 1214 bytes} [Wed Nov 24 17:03:44 2021] DELETE /identity/v3/users/f98d110f82364c048694787cbfd94ce8 => generated 0 bytes in 193 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 24 17:03:45.472780 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e70aae5-21fe-43bb-a76a-81168ca879dc admin admin] Authenticating user token {{(pid=71939) process_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 24 17:03:45.474270 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.fernet_utils [None req-4e70aae5-21fe-43bb-a76a-81168ca879dc admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=71939) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:289}} Nov 24 17:03:45.487031 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e70aae5-21fe-43bb-a76a-81168ca879dc admin admin] Validating token access rules against request {{(pid=71939) validate_allowed_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 24 17:03:45.553389 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee561c5c-d189-4556-945a-6bd3be72ab59 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f2ba2e8375b4e8c8792ee1e22b60427', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '00a5583c7b7443e98e7a1d31a0b638dc', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=71939) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 24 17:03:45.554315 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee561c5c-d189-4556-945a-6bd3be72ab59 admin admin] REQUEST_METHOD: `DELETE` {{(pid=71939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 24 17:03:45.554661 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee561c5c-d189-4556-945a-6bd3be72ab59 admin admin] SCRIPT_NAME: `/identity` {{(pid=71939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 24 17:03:45.554992 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee561c5c-d189-4556-945a-6bd3be72ab59 admin admin] PATH_INFO: `/v3/projects/634c067bf7c44a9c93fb360dc67fa7bd` {{(pid=71939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 24 17:03:45.556217 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee561c5c-d189-4556-945a-6bd3be72ab59 admin admin] RBAC: Authorizing `identity:delete_project(project_id=634c067bf7c44a9c93fb360dc67fa7bd)` {{(pid=71939) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:442}} Nov 24 17:03:45.585311 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee561c5c-d189-4556-945a-6bd3be72ab59 admin admin] RBAC: Authorization granted {{(pid=71939) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 24 17:03:45.635535 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.notifications [None req-ee561c5c-d189-4556-945a-6bd3be72ab59 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '634c067bf7c44a9c93fb360dc67fa7bd', 'request_id': 'req-ee561c5c-d189-4556-945a-6bd3be72ab59'} {{(pid=71939) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:357}} Nov 24 17:03:45.647404 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.notifications [None req-ee561c5c-d189-4556-945a-6bd3be72ab59 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '634c067bf7c44a9c93fb360dc67fa7bd', 'request_id': 'req-ee561c5c-d189-4556-945a-6bd3be72ab59'} {{(pid=71939) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:357}} Nov 24 17:03:45.654219 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.notifications [None req-ee561c5c-d189-4556-945a-6bd3be72ab59 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '634c067bf7c44a9c93fb360dc67fa7bd', 'request_id': 'req-ee561c5c-d189-4556-945a-6bd3be72ab59'} {{(pid=71939) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:357}} Nov 24 17:03:45.664642 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.notifications [None req-ee561c5c-d189-4556-945a-6bd3be72ab59 admin admin] The token cache is being invalidate because project 634c067bf7c44a9c93fb360dc67fa7bd was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=71939) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Nov 24 17:03:45.664974 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.notifications [None req-ee561c5c-d189-4556-945a-6bd3be72ab59 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=71939) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:357}} Nov 24 17:03:45.665647 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.notifications [None req-ee561c5c-d189-4556-945a-6bd3be72ab59 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=71939) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:357}} Nov 24 17:03:45.667259 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: [pid: 71939|app: 0|req: 1408/2803] 10.222.0.53 () {58 vars in 1223 bytes} [Wed Nov 24 17:03:45 2021] DELETE /identity/v3/projects/634c067bf7c44a9c93fb360dc67fa7bd => generated 0 bytes in 195 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 24 17:03:45.673544 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d530846e-621e-4c06-aebf-4afc29592726 None None] REQUEST_METHOD: `POST` {{(pid=71938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 24 17:03:45.673892 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d530846e-621e-4c06-aebf-4afc29592726 None None] SCRIPT_NAME: `/identity` {{(pid=71938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 24 17:03:45.674283 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d530846e-621e-4c06-aebf-4afc29592726 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=71938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 24 17:03:45.698553 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.auth.core [None req-d530846e-621e-4c06-aebf-4afc29592726 None None] MFA Rules not processed for user `0f2ba2e8375b4e8c8792ee1e22b60427`. Rule list: `[]` (Enabled: `True`). {{(pid=71938) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:442}} Nov 24 17:03:45.699778 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.fernet_utils [None req-d530846e-621e-4c06-aebf-4afc29592726 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=71938) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:289}} Nov 24 17:03:45.767280 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: [pid: 71938|app: 0|req: 1396/2804] 10.222.0.53 () {58 vars in 948 bytes} [Wed Nov 24 17:03:45 2021] POST /identity/v3/auth/tokens => generated 3669 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 24 17:03:45.776350 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c30d778-fb03-4205-8791-0cbf3c25a5d1 None None] REQUEST_METHOD: `POST` {{(pid=71939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 24 17:03:45.776701 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c30d778-fb03-4205-8791-0cbf3c25a5d1 None None] SCRIPT_NAME: `/identity` {{(pid=71939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 24 17:03:45.777042 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c30d778-fb03-4205-8791-0cbf3c25a5d1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=71939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 24 17:03:45.800153 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.auth.core [None req-4c30d778-fb03-4205-8791-0cbf3c25a5d1 None None] MFA Rules not processed for user `0f2ba2e8375b4e8c8792ee1e22b60427`. Rule list: `[]` (Enabled: `True`). {{(pid=71939) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:442}} Nov 24 17:03:45.801413 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.fernet_utils [None req-4c30d778-fb03-4205-8791-0cbf3c25a5d1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=71939) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:289}} Nov 24 17:03:45.809457 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: [pid: 71939|app: 0|req: 1409/2805] 10.222.0.53 () {58 vars in 948 bytes} [Wed Nov 24 17:03:45 2021] POST /identity/v3/auth/tokens => generated 3669 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 24 17:03:45.813822 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d530846e-621e-4c06-aebf-4afc29592726 None None] Authenticating user token {{(pid=71938) process_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 24 17:03:45.824152 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d530846e-621e-4c06-aebf-4afc29592726 None None] Validating token access rules against request {{(pid=71938) validate_allowed_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 24 17:03:45.828752 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15e78974-6cc0-4a51-b2a1-1e9575b5093e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f2ba2e8375b4e8c8792ee1e22b60427', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '00a5583c7b7443e98e7a1d31a0b638dc', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=71938) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 24 17:03:45.829418 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15e78974-6cc0-4a51-b2a1-1e9575b5093e admin admin] REQUEST_METHOD: `GET` {{(pid=71938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 24 17:03:45.829759 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15e78974-6cc0-4a51-b2a1-1e9575b5093e admin admin] SCRIPT_NAME: `/identity` {{(pid=71938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 24 17:03:45.830119 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15e78974-6cc0-4a51-b2a1-1e9575b5093e admin admin] PATH_INFO: `/v3/domains` {{(pid=71938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 24 17:03:45.830908 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15e78974-6cc0-4a51-b2a1-1e9575b5093e admin admin] RBAC: Adding query filter params (name=Default) {{(pid=71938) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:161}} Nov 24 17:03:45.831264 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15e78974-6cc0-4a51-b2a1-1e9575b5093e admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=71938) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:442}} Nov 24 17:03:45.859315 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15e78974-6cc0-4a51-b2a1-1e9575b5093e admin admin] RBAC: Authorization granted {{(pid=71938) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 24 17:03:45.873719 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: [pid: 71938|app: 0|req: 1397/2806] 10.222.0.53 () {58 vars in 1143 bytes} [Wed Nov 24 17:03:45 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 60 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 24 17:03:45.878546 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c30d778-fb03-4205-8791-0cbf3c25a5d1 None None] Authenticating user token {{(pid=71939) process_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 24 17:03:45.888551 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c30d778-fb03-4205-8791-0cbf3c25a5d1 None None] Validating token access rules against request {{(pid=71939) validate_allowed_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 24 17:03:45.893193 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ef28b3e-a4ad-4edd-b73a-d460876dd48d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f2ba2e8375b4e8c8792ee1e22b60427', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '00a5583c7b7443e98e7a1d31a0b638dc', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=71939) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 24 17:03:45.893859 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ef28b3e-a4ad-4edd-b73a-d460876dd48d admin admin] REQUEST_METHOD: `POST` {{(pid=71939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 24 17:03:45.894259 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ef28b3e-a4ad-4edd-b73a-d460876dd48d admin admin] SCRIPT_NAME: `/identity` {{(pid=71939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 24 17:03:45.894600 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ef28b3e-a4ad-4edd-b73a-d460876dd48d admin admin] PATH_INFO: `/v3/projects` {{(pid=71939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 24 17:03:45.895338 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ef28b3e-a4ad-4edd-b73a-d460876dd48d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=71939) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:442}} Nov 24 17:03:45.923746 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ef28b3e-a4ad-4edd-b73a-d460876dd48d admin admin] RBAC: Authorization granted {{(pid=71939) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 24 17:03:45.950984 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: [pid: 71939|app: 0|req: 1410/2807] 10.222.0.53 () {60 vars in 1143 bytes} [Wed Nov 24 17:03:45 2021] POST /identity/v3/projects => generated 377 bytes in 73 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 24 17:03:45.955393 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15e78974-6cc0-4a51-b2a1-1e9575b5093e admin admin] Authenticating user token {{(pid=71938) process_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 24 17:03:45.965686 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15e78974-6cc0-4a51-b2a1-1e9575b5093e admin admin] Validating token access rules against request {{(pid=71938) validate_allowed_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 24 17:03:46.031338 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3c9fdf3-d132-4247-9a8e-ca8846f57491 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f2ba2e8375b4e8c8792ee1e22b60427', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '00a5583c7b7443e98e7a1d31a0b638dc', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=71938) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 24 17:03:46.032042 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3c9fdf3-d132-4247-9a8e-ca8846f57491 admin admin] REQUEST_METHOD: `POST` {{(pid=71938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 24 17:03:46.032362 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3c9fdf3-d132-4247-9a8e-ca8846f57491 admin admin] SCRIPT_NAME: `/identity` {{(pid=71938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 24 17:03:46.032698 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3c9fdf3-d132-4247-9a8e-ca8846f57491 admin admin] PATH_INFO: `/v3/users` {{(pid=71938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 24 17:03:46.033426 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3c9fdf3-d132-4247-9a8e-ca8846f57491 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=71938) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:442}} Nov 24 17:03:46.062491 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3c9fdf3-d132-4247-9a8e-ca8846f57491 admin admin] RBAC: Authorization granted {{(pid=71938) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 24 17:03:46.081351 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: [pid: 71938|app: 0|req: 1398/2808] 10.222.0.53 () {60 vars in 1134 bytes} [Wed Nov 24 17:03:45 2021] POST /identity/v3/users => generated 289 bytes in 126 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 24 17:03:46.085769 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ef28b3e-a4ad-4edd-b73a-d460876dd48d admin admin] Authenticating user token {{(pid=71939) process_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 24 17:03:46.096137 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ef28b3e-a4ad-4edd-b73a-d460876dd48d admin admin] Validating token access rules against request {{(pid=71939) validate_allowed_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 24 17:03:46.100658 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4670b49c-ad1c-4af7-95d4-96b4c787815c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f2ba2e8375b4e8c8792ee1e22b60427', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '00a5583c7b7443e98e7a1d31a0b638dc', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=71939) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 24 17:03:46.101326 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4670b49c-ad1c-4af7-95d4-96b4c787815c admin admin] REQUEST_METHOD: `GET` {{(pid=71939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 24 17:03:46.101663 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4670b49c-ad1c-4af7-95d4-96b4c787815c admin admin] SCRIPT_NAME: `/identity` {{(pid=71939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 24 17:03:46.101990 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4670b49c-ad1c-4af7-95d4-96b4c787815c admin admin] PATH_INFO: `/v3/roles` {{(pid=71939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 24 17:03:46.102791 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4670b49c-ad1c-4af7-95d4-96b4c787815c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=71939) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:442}} Nov 24 17:03:46.131149 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4670b49c-ad1c-4af7-95d4-96b4c787815c admin admin] RBAC: Authorization granted {{(pid=71939) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 24 17:03:46.142454 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: [pid: 71939|app: 0|req: 1411/2809] 10.222.0.53 () {58 vars in 1112 bytes} [Wed Nov 24 17:03:46 2021] GET /identity/v3/roles => generated 1420 bytes in 57 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 24 17:03:46.146680 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3c9fdf3-d132-4247-9a8e-ca8846f57491 admin admin] Authenticating user token {{(pid=71938) process_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 24 17:03:46.156791 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3c9fdf3-d132-4247-9a8e-ca8846f57491 admin admin] Validating token access rules against request {{(pid=71938) validate_allowed_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 24 17:03:46.161368 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62979928-773d-4b0d-af66-d2df34cd950d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f2ba2e8375b4e8c8792ee1e22b60427', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '00a5583c7b7443e98e7a1d31a0b638dc', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=71938) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 24 17:03:46.162295 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62979928-773d-4b0d-af66-d2df34cd950d admin admin] REQUEST_METHOD: `PUT` {{(pid=71938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 24 17:03:46.162637 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62979928-773d-4b0d-af66-d2df34cd950d admin admin] SCRIPT_NAME: `/identity` {{(pid=71938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 24 17:03:46.162972 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62979928-773d-4b0d-af66-d2df34cd950d admin admin] PATH_INFO: `/v3/projects/898c3c76facd4e24bdce4c224daa01c3/users/6caebf757cec47c0896fc125dfd2c531/roles/912ab5f10fa5477da74acf239f07604e` {{(pid=71938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 24 17:03:46.185251 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62979928-773d-4b0d-af66-d2df34cd950d admin admin] RBAC: Authorizing `identity:create_grant(project_id=898c3c76facd4e24bdce4c224daa01c3, user_id=6caebf757cec47c0896fc125dfd2c531, role_id=912ab5f10fa5477da74acf239f07604e)` {{(pid=71938) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:442}} Nov 24 17:03:46.214847 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62979928-773d-4b0d-af66-d2df34cd950d admin admin] RBAC: Authorization granted {{(pid=71938) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 24 17:03:46.227363 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: [pid: 71938|app: 0|req: 1399/2810] 10.222.0.53 () {60 vars in 1473 bytes} [Wed Nov 24 17:03:46 2021] PUT /identity/v3/projects/898c3c76facd4e24bdce4c224daa01c3/users/6caebf757cec47c0896fc125dfd2c531/roles/912ab5f10fa5477da74acf239f07604e => generated 0 bytes in 81 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 24 17:03:46.239672 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c634c56-823a-4074-b8b9-79f633bc0d0e None None] REQUEST_METHOD: `POST` {{(pid=71939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 24 17:03:46.240026 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c634c56-823a-4074-b8b9-79f633bc0d0e None None] SCRIPT_NAME: `/identity` {{(pid=71939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 24 17:03:46.240403 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c634c56-823a-4074-b8b9-79f633bc0d0e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=71939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 24 17:03:46.278880 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.auth.core [None req-9c634c56-823a-4074-b8b9-79f633bc0d0e None None] MFA Rules not processed for user `6caebf757cec47c0896fc125dfd2c531`. Rule list: `[]` (Enabled: `True`). {{(pid=71939) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:442}} Nov 24 17:03:46.280104 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.fernet_utils [None req-9c634c56-823a-4074-b8b9-79f633bc0d0e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=71939) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:289}} Nov 24 17:03:46.355757 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: [pid: 71939|app: 0|req: 1412/2811] 10.222.0.53 () {58 vars in 948 bytes} [Wed Nov 24 17:03:46 2021] POST /identity/v3/auth/tokens => generated 3684 bytes in 117 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 24 17:03:46.360538 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62979928-773d-4b0d-af66-d2df34cd950d admin admin] Authenticating user token {{(pid=71938) process_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 24 17:03:46.432561 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62979928-773d-4b0d-af66-d2df34cd950d admin admin] Validating token access rules against request {{(pid=71938) validate_allowed_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 24 17:03:46.437227 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76bef2f4-c14a-4773-9198-cf0cfca35aa2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f2ba2e8375b4e8c8792ee1e22b60427', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '00a5583c7b7443e98e7a1d31a0b638dc', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=71938) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 24 17:03:46.437833 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76bef2f4-c14a-4773-9198-cf0cfca35aa2 admin admin] REQUEST_METHOD: `POST` {{(pid=71938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 24 17:03:46.438193 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76bef2f4-c14a-4773-9198-cf0cfca35aa2 admin admin] SCRIPT_NAME: `/identity` {{(pid=71938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 24 17:03:46.438524 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76bef2f4-c14a-4773-9198-cf0cfca35aa2 admin admin] PATH_INFO: `/v3/projects` {{(pid=71938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 24 17:03:46.439250 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76bef2f4-c14a-4773-9198-cf0cfca35aa2 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=71938) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:442}} Nov 24 17:03:46.467571 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76bef2f4-c14a-4773-9198-cf0cfca35aa2 admin admin] RBAC: Authorization granted {{(pid=71938) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 24 17:03:46.493510 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: [pid: 71938|app: 0|req: 1400/2812] 10.222.0.53 () {60 vars in 1143 bytes} [Wed Nov 24 17:03:46 2021] POST /identity/v3/projects => generated 379 bytes in 133 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 24 17:03:46.498505 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c634c56-823a-4074-b8b9-79f633bc0d0e None None] Authenticating user token {{(pid=71939) process_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 24 17:03:46.510445 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c634c56-823a-4074-b8b9-79f633bc0d0e None None] Validating token access rules against request {{(pid=71939) validate_allowed_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 24 17:03:46.578452 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bced97e-310a-457c-8104-adfcb4e2448b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f2ba2e8375b4e8c8792ee1e22b60427', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '00a5583c7b7443e98e7a1d31a0b638dc', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=71939) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 24 17:03:46.579133 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bced97e-310a-457c-8104-adfcb4e2448b admin admin] REQUEST_METHOD: `POST` {{(pid=71939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 24 17:03:46.579475 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bced97e-310a-457c-8104-adfcb4e2448b admin admin] SCRIPT_NAME: `/identity` {{(pid=71939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 24 17:03:46.579813 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bced97e-310a-457c-8104-adfcb4e2448b admin admin] PATH_INFO: `/v3/users` {{(pid=71939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 24 17:03:46.580545 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bced97e-310a-457c-8104-adfcb4e2448b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=71939) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:442}} Nov 24 17:03:46.609848 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bced97e-310a-457c-8104-adfcb4e2448b admin admin] RBAC: Authorization granted {{(pid=71939) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 24 17:03:46.629557 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: [pid: 71939|app: 0|req: 1413/2813] 10.222.0.53 () {60 vars in 1134 bytes} [Wed Nov 24 17:03:46 2021] POST /identity/v3/users => generated 290 bytes in 131 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 24 17:03:46.633313 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76bef2f4-c14a-4773-9198-cf0cfca35aa2 admin admin] Authenticating user token {{(pid=71938) process_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 24 17:03:46.643988 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76bef2f4-c14a-4773-9198-cf0cfca35aa2 admin admin] Validating token access rules against request {{(pid=71938) validate_allowed_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 24 17:03:46.648621 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57470d57-5d0b-42ad-b24b-5a00bb6faff6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f2ba2e8375b4e8c8792ee1e22b60427', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '00a5583c7b7443e98e7a1d31a0b638dc', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=71938) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 24 17:03:46.649296 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57470d57-5d0b-42ad-b24b-5a00bb6faff6 admin admin] REQUEST_METHOD: `GET` {{(pid=71938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 24 17:03:46.649641 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57470d57-5d0b-42ad-b24b-5a00bb6faff6 admin admin] SCRIPT_NAME: `/identity` {{(pid=71938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 24 17:03:46.649974 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57470d57-5d0b-42ad-b24b-5a00bb6faff6 admin admin] PATH_INFO: `/v3/roles` {{(pid=71938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 24 17:03:46.651371 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57470d57-5d0b-42ad-b24b-5a00bb6faff6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=71938) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:442}} Nov 24 17:03:46.680161 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57470d57-5d0b-42ad-b24b-5a00bb6faff6 admin admin] RBAC: Authorization granted {{(pid=71938) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 24 17:03:46.692078 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: [pid: 71938|app: 0|req: 1401/2814] 10.222.0.53 () {58 vars in 1112 bytes} [Wed Nov 24 17:03:46 2021] GET /identity/v3/roles => generated 1420 bytes in 59 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 24 17:03:46.696310 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bced97e-310a-457c-8104-adfcb4e2448b admin admin] Authenticating user token {{(pid=71939) process_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 24 17:03:46.706715 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bced97e-310a-457c-8104-adfcb4e2448b admin admin] Validating token access rules against request {{(pid=71939) validate_allowed_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 24 17:03:46.711635 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8484c306-99dd-496d-9f7f-698c413a7a54 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f2ba2e8375b4e8c8792ee1e22b60427', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '00a5583c7b7443e98e7a1d31a0b638dc', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=71939) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 24 17:03:46.712581 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8484c306-99dd-496d-9f7f-698c413a7a54 admin admin] REQUEST_METHOD: `PUT` {{(pid=71939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 24 17:03:46.713429 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8484c306-99dd-496d-9f7f-698c413a7a54 admin admin] SCRIPT_NAME: `/identity` {{(pid=71939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 24 17:03:46.713811 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8484c306-99dd-496d-9f7f-698c413a7a54 admin admin] PATH_INFO: `/v3/projects/5aede6e126674f1eb60ea4105dfd1ed1/users/8c66a1e263c440e09c7f41131adb9c99/roles/912ab5f10fa5477da74acf239f07604e` {{(pid=71939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 24 17:03:46.735395 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8484c306-99dd-496d-9f7f-698c413a7a54 admin admin] RBAC: Authorizing `identity:create_grant(project_id=5aede6e126674f1eb60ea4105dfd1ed1, user_id=8c66a1e263c440e09c7f41131adb9c99, role_id=912ab5f10fa5477da74acf239f07604e)` {{(pid=71939) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:442}} Nov 24 17:03:46.764335 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8484c306-99dd-496d-9f7f-698c413a7a54 admin admin] RBAC: Authorization granted {{(pid=71939) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 24 17:03:46.777151 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: [pid: 71939|app: 0|req: 1414/2815] 10.222.0.53 () {60 vars in 1473 bytes} [Wed Nov 24 17:03:46 2021] PUT /identity/v3/projects/5aede6e126674f1eb60ea4105dfd1ed1/users/8c66a1e263c440e09c7f41131adb9c99/roles/912ab5f10fa5477da74acf239f07604e => generated 0 bytes in 81 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 24 17:03:46.789847 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2350b3e2-eb8c-4211-aff8-821dd3ea7183 None None] REQUEST_METHOD: `POST` {{(pid=71938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 24 17:03:46.790529 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2350b3e2-eb8c-4211-aff8-821dd3ea7183 None None] SCRIPT_NAME: `/identity` {{(pid=71938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 24 17:03:46.791722 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2350b3e2-eb8c-4211-aff8-821dd3ea7183 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=71938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 24 17:03:46.831881 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.auth.core [None req-2350b3e2-eb8c-4211-aff8-821dd3ea7183 None None] MFA Rules not processed for user `8c66a1e263c440e09c7f41131adb9c99`. Rule list: `[]` (Enabled: `True`). {{(pid=71938) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:442}} Nov 24 17:03:46.833099 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.fernet_utils [None req-2350b3e2-eb8c-4211-aff8-821dd3ea7183 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=71938) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:289}} Nov 24 17:03:46.910224 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: [pid: 71938|app: 0|req: 1402/2816] 10.222.0.53 () {58 vars in 948 bytes} [Wed Nov 24 17:03:46 2021] POST /identity/v3/auth/tokens => generated 3686 bytes in 122 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 24 17:03:46.915070 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8484c306-99dd-496d-9f7f-698c413a7a54 admin admin] Authenticating user token {{(pid=71939) process_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 24 17:03:46.985908 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8484c306-99dd-496d-9f7f-698c413a7a54 admin admin] Validating token access rules against request {{(pid=71939) validate_allowed_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 24 17:03:46.990430 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fed190e-a636-4ae2-bc0c-0fd9180f6b1e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f2ba2e8375b4e8c8792ee1e22b60427', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '00a5583c7b7443e98e7a1d31a0b638dc', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=71939) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 24 17:03:46.991086 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fed190e-a636-4ae2-bc0c-0fd9180f6b1e admin admin] REQUEST_METHOD: `POST` {{(pid=71939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 24 17:03:46.991420 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fed190e-a636-4ae2-bc0c-0fd9180f6b1e admin admin] SCRIPT_NAME: `/identity` {{(pid=71939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 24 17:03:46.991748 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fed190e-a636-4ae2-bc0c-0fd9180f6b1e admin admin] PATH_INFO: `/v3/projects` {{(pid=71939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 24 17:03:46.992468 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fed190e-a636-4ae2-bc0c-0fd9180f6b1e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=71939) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:442}} Nov 24 17:03:47.020814 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fed190e-a636-4ae2-bc0c-0fd9180f6b1e admin admin] RBAC: Authorization granted {{(pid=71939) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 24 17:03:47.046326 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: [pid: 71939|app: 0|req: 1415/2817] 10.222.0.53 () {60 vars in 1143 bytes} [Wed Nov 24 17:03:46 2021] POST /identity/v3/projects => generated 379 bytes in 132 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 24 17:03:47.050741 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2350b3e2-eb8c-4211-aff8-821dd3ea7183 None None] Authenticating user token {{(pid=71938) process_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 24 17:03:47.061958 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2350b3e2-eb8c-4211-aff8-821dd3ea7183 None None] Validating token access rules against request {{(pid=71938) validate_allowed_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 24 17:03:47.127191 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1306b1db-eeb5-4e92-88a8-52c3cbb47505 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f2ba2e8375b4e8c8792ee1e22b60427', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '00a5583c7b7443e98e7a1d31a0b638dc', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=71938) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 24 17:03:47.127890 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1306b1db-eeb5-4e92-88a8-52c3cbb47505 admin admin] REQUEST_METHOD: `POST` {{(pid=71938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 24 17:03:47.128237 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1306b1db-eeb5-4e92-88a8-52c3cbb47505 admin admin] SCRIPT_NAME: `/identity` {{(pid=71938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 24 17:03:47.128573 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1306b1db-eeb5-4e92-88a8-52c3cbb47505 admin admin] PATH_INFO: `/v3/users` {{(pid=71938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 24 17:03:47.129314 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1306b1db-eeb5-4e92-88a8-52c3cbb47505 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=71938) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:442}} Nov 24 17:03:47.162033 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1306b1db-eeb5-4e92-88a8-52c3cbb47505 admin admin] RBAC: Authorization granted {{(pid=71938) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 24 17:03:47.185210 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: [pid: 71938|app: 0|req: 1403/2818] 10.222.0.53 () {60 vars in 1134 bytes} [Wed Nov 24 17:03:47 2021] POST /identity/v3/users => generated 296 bytes in 135 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 24 17:03:47.189627 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fed190e-a636-4ae2-bc0c-0fd9180f6b1e admin admin] Authenticating user token {{(pid=71939) process_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 24 17:03:47.200325 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fed190e-a636-4ae2-bc0c-0fd9180f6b1e admin admin] Validating token access rules against request {{(pid=71939) validate_allowed_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 24 17:03:47.204896 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5cc09db-68ca-40dc-b1d6-e83943c96ca8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f2ba2e8375b4e8c8792ee1e22b60427', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '00a5583c7b7443e98e7a1d31a0b638dc', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=71939) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 24 17:03:47.205576 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5cc09db-68ca-40dc-b1d6-e83943c96ca8 admin admin] REQUEST_METHOD: `GET` {{(pid=71939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 24 17:03:47.205921 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5cc09db-68ca-40dc-b1d6-e83943c96ca8 admin admin] SCRIPT_NAME: `/identity` {{(pid=71939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 24 17:03:47.206287 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5cc09db-68ca-40dc-b1d6-e83943c96ca8 admin admin] PATH_INFO: `/v3/roles` {{(pid=71939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 24 17:03:47.207071 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5cc09db-68ca-40dc-b1d6-e83943c96ca8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=71939) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:442}} Nov 24 17:03:47.235650 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5cc09db-68ca-40dc-b1d6-e83943c96ca8 admin admin] RBAC: Authorization granted {{(pid=71939) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 24 17:03:47.249082 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: [pid: 71939|app: 0|req: 1416/2819] 10.222.0.53 () {58 vars in 1112 bytes} [Wed Nov 24 17:03:47 2021] GET /identity/v3/roles => generated 1420 bytes in 59 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 24 17:03:47.252751 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1306b1db-eeb5-4e92-88a8-52c3cbb47505 admin admin] Authenticating user token {{(pid=71938) process_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 24 17:03:47.263193 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1306b1db-eeb5-4e92-88a8-52c3cbb47505 admin admin] Validating token access rules against request {{(pid=71938) validate_allowed_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 24 17:03:47.267767 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a939b5ff-e66d-43ee-95a8-f53d0ee3c5a3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f2ba2e8375b4e8c8792ee1e22b60427', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '00a5583c7b7443e98e7a1d31a0b638dc', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=71938) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 24 17:03:47.268666 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a939b5ff-e66d-43ee-95a8-f53d0ee3c5a3 admin admin] REQUEST_METHOD: `PUT` {{(pid=71938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 24 17:03:47.269004 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a939b5ff-e66d-43ee-95a8-f53d0ee3c5a3 admin admin] SCRIPT_NAME: `/identity` {{(pid=71938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 24 17:03:47.269332 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a939b5ff-e66d-43ee-95a8-f53d0ee3c5a3 admin admin] PATH_INFO: `/v3/projects/da32bd1ebada4940ab262105a92db2ce/users/4d0a163704964cf1ac48aec8ced9aa9a/roles/5611724e350b41e19921b5961a342582` {{(pid=71938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 24 17:03:47.290377 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a939b5ff-e66d-43ee-95a8-f53d0ee3c5a3 admin admin] RBAC: Authorizing `identity:create_grant(project_id=da32bd1ebada4940ab262105a92db2ce, user_id=4d0a163704964cf1ac48aec8ced9aa9a, role_id=5611724e350b41e19921b5961a342582)` {{(pid=71938) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:442}} Nov 24 17:03:47.320311 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a939b5ff-e66d-43ee-95a8-f53d0ee3c5a3 admin admin] RBAC: Authorization granted {{(pid=71938) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 24 17:03:47.332113 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: [pid: 71938|app: 0|req: 1404/2820] 10.222.0.53 () {60 vars in 1473 bytes} [Wed Nov 24 17:03:47 2021] PUT /identity/v3/projects/da32bd1ebada4940ab262105a92db2ce/users/4d0a163704964cf1ac48aec8ced9aa9a/roles/5611724e350b41e19921b5961a342582 => generated 0 bytes in 80 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 24 17:03:47.336534 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5cc09db-68ca-40dc-b1d6-e83943c96ca8 admin admin] Authenticating user token {{(pid=71939) process_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 24 17:03:47.347262 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5cc09db-68ca-40dc-b1d6-e83943c96ca8 admin admin] Validating token access rules against request {{(pid=71939) validate_allowed_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 24 17:03:47.412051 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3aac0fca-beaa-4253-acb7-e16761fd0774 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f2ba2e8375b4e8c8792ee1e22b60427', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '00a5583c7b7443e98e7a1d31a0b638dc', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=71939) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 24 17:03:47.412716 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3aac0fca-beaa-4253-acb7-e16761fd0774 admin admin] REQUEST_METHOD: `GET` {{(pid=71939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 24 17:03:47.413058 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3aac0fca-beaa-4253-acb7-e16761fd0774 admin admin] SCRIPT_NAME: `/identity` {{(pid=71939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 24 17:03:47.413389 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3aac0fca-beaa-4253-acb7-e16761fd0774 admin admin] PATH_INFO: `/v3/roles` {{(pid=71939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 24 17:03:47.414195 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3aac0fca-beaa-4253-acb7-e16761fd0774 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=71939) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:442}} Nov 24 17:03:47.446219 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3aac0fca-beaa-4253-acb7-e16761fd0774 admin admin] RBAC: Authorization granted {{(pid=71939) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 24 17:03:47.457522 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: [pid: 71939|app: 0|req: 1417/2821] 10.222.0.53 () {58 vars in 1112 bytes} [Wed Nov 24 17:03:47 2021] GET /identity/v3/roles => generated 1420 bytes in 122 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 24 17:03:47.462095 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a939b5ff-e66d-43ee-95a8-f53d0ee3c5a3 admin admin] Authenticating user token {{(pid=71938) process_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 24 17:03:47.473185 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a939b5ff-e66d-43ee-95a8-f53d0ee3c5a3 admin admin] Validating token access rules against request {{(pid=71938) validate_allowed_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 24 17:03:47.477734 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0e0d223-ac7a-48f9-a138-691ac1444bfc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f2ba2e8375b4e8c8792ee1e22b60427', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '00a5583c7b7443e98e7a1d31a0b638dc', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=71938) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 24 17:03:47.479247 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0e0d223-ac7a-48f9-a138-691ac1444bfc admin admin] REQUEST_METHOD: `PUT` {{(pid=71938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 24 17:03:47.479582 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0e0d223-ac7a-48f9-a138-691ac1444bfc admin admin] SCRIPT_NAME: `/identity` {{(pid=71938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 24 17:03:47.479912 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0e0d223-ac7a-48f9-a138-691ac1444bfc admin admin] PATH_INFO: `/v3/projects/da32bd1ebada4940ab262105a92db2ce/users/4d0a163704964cf1ac48aec8ced9aa9a/roles/5611724e350b41e19921b5961a342582` {{(pid=71938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 24 17:03:47.481908 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0e0d223-ac7a-48f9-a138-691ac1444bfc admin admin] RBAC: Authorizing `identity:create_grant(project_id=da32bd1ebada4940ab262105a92db2ce, user_id=4d0a163704964cf1ac48aec8ced9aa9a, role_id=5611724e350b41e19921b5961a342582)` {{(pid=71938) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:442}} Nov 24 17:03:47.511296 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0e0d223-ac7a-48f9-a138-691ac1444bfc admin admin] RBAC: Authorization granted {{(pid=71938) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 24 17:03:47.521650 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: [pid: 71938|app: 0|req: 1405/2822] 10.222.0.53 () {60 vars in 1473 bytes} [Wed Nov 24 17:03:47 2021] PUT /identity/v3/projects/da32bd1ebada4940ab262105a92db2ce/users/4d0a163704964cf1ac48aec8ced9aa9a/roles/5611724e350b41e19921b5961a342582 => generated 0 bytes in 60 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 24 17:03:47.526444 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3aac0fca-beaa-4253-acb7-e16761fd0774 admin admin] Authenticating user token {{(pid=71939) process_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 24 17:03:47.536442 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3aac0fca-beaa-4253-acb7-e16761fd0774 admin admin] Validating token access rules against request {{(pid=71939) validate_allowed_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 24 17:03:47.601872 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ad47ab5-5bc9-4f3f-8009-e585962019bc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f2ba2e8375b4e8c8792ee1e22b60427', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '00a5583c7b7443e98e7a1d31a0b638dc', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=71939) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 24 17:03:47.602568 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ad47ab5-5bc9-4f3f-8009-e585962019bc admin admin] REQUEST_METHOD: `GET` {{(pid=71939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 24 17:03:47.602912 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ad47ab5-5bc9-4f3f-8009-e585962019bc admin admin] SCRIPT_NAME: `/identity` {{(pid=71939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 24 17:03:47.603266 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ad47ab5-5bc9-4f3f-8009-e585962019bc admin admin] PATH_INFO: `/v3/roles` {{(pid=71939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 24 17:03:47.604582 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ad47ab5-5bc9-4f3f-8009-e585962019bc admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=71939) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:442}} Nov 24 17:03:47.632200 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ad47ab5-5bc9-4f3f-8009-e585962019bc admin admin] RBAC: Authorization granted {{(pid=71939) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 24 17:03:47.643732 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: [pid: 71939|app: 0|req: 1418/2823] 10.222.0.53 () {58 vars in 1112 bytes} [Wed Nov 24 17:03:47 2021] GET /identity/v3/roles => generated 1420 bytes in 118 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 24 17:03:47.648194 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0e0d223-ac7a-48f9-a138-691ac1444bfc admin admin] Authenticating user token {{(pid=71938) process_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 24 17:03:47.660622 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0e0d223-ac7a-48f9-a138-691ac1444bfc admin admin] Validating token access rules against request {{(pid=71938) validate_allowed_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 24 17:03:47.665261 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a12afcb5-7420-4f98-b58b-e5edca2613d3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f2ba2e8375b4e8c8792ee1e22b60427', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '00a5583c7b7443e98e7a1d31a0b638dc', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=71938) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 24 17:03:47.666232 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a12afcb5-7420-4f98-b58b-e5edca2613d3 admin admin] REQUEST_METHOD: `PUT` {{(pid=71938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 24 17:03:47.666568 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a12afcb5-7420-4f98-b58b-e5edca2613d3 admin admin] SCRIPT_NAME: `/identity` {{(pid=71938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 24 17:03:47.666905 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a12afcb5-7420-4f98-b58b-e5edca2613d3 admin admin] PATH_INFO: `/v3/projects/da32bd1ebada4940ab262105a92db2ce/users/4d0a163704964cf1ac48aec8ced9aa9a/roles/912ab5f10fa5477da74acf239f07604e` {{(pid=71938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 24 17:03:47.668858 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a12afcb5-7420-4f98-b58b-e5edca2613d3 admin admin] RBAC: Authorizing `identity:create_grant(project_id=da32bd1ebada4940ab262105a92db2ce, user_id=4d0a163704964cf1ac48aec8ced9aa9a, role_id=912ab5f10fa5477da74acf239f07604e)` {{(pid=71938) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:442}} Nov 24 17:03:47.698826 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a12afcb5-7420-4f98-b58b-e5edca2613d3 admin admin] RBAC: Authorization granted {{(pid=71938) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 24 17:03:47.711984 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: [pid: 71938|app: 0|req: 1406/2824] 10.222.0.53 () {60 vars in 1473 bytes} [Wed Nov 24 17:03:47 2021] PUT /identity/v3/projects/da32bd1ebada4940ab262105a92db2ce/users/4d0a163704964cf1ac48aec8ced9aa9a/roles/912ab5f10fa5477da74acf239f07604e => generated 0 bytes in 64 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 24 17:03:47.765149 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9eef5877-f909-4178-8a1c-3c02561e202d None None] REQUEST_METHOD: `POST` {{(pid=71939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 24 17:03:47.765563 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9eef5877-f909-4178-8a1c-3c02561e202d None None] SCRIPT_NAME: `/identity` {{(pid=71939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 24 17:03:47.765974 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9eef5877-f909-4178-8a1c-3c02561e202d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=71939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 24 17:03:47.804282 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.auth.core [None req-9eef5877-f909-4178-8a1c-3c02561e202d None None] MFA Rules not processed for user `4d0a163704964cf1ac48aec8ced9aa9a`. Rule list: `[]` (Enabled: `True`). {{(pid=71939) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:442}} Nov 24 17:03:47.805550 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.fernet_utils [None req-9eef5877-f909-4178-8a1c-3c02561e202d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=71939) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:289}} Nov 24 17:03:47.887882 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: [pid: 71939|app: 0|req: 1419/2825] 10.222.0.53 () {58 vars in 948 bytes} [Wed Nov 24 17:03:47 2021] POST /identity/v3/auth/tokens => generated 3753 bytes in 124 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 24 17:03:47.901672 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a12afcb5-7420-4f98-b58b-e5edca2613d3 admin admin] Authenticating user token {{(pid=71938) process_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 24 17:03:47.903558 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.fernet_utils [None req-a12afcb5-7420-4f98-b58b-e5edca2613d3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=71938) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:289}} Nov 24 17:03:47.971491 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a12afcb5-7420-4f98-b58b-e5edca2613d3 admin admin] Validating token access rules against request {{(pid=71938) validate_allowed_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 24 17:03:47.975175 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e68098d-8416-42ed-8004-e9df53d12142 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a12374a3093a401a97c343ff0854184d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3b3940d4ae1c4177ae29c02377bb4b0b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=71938) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 24 17:03:47.975833 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e68098d-8416-42ed-8004-e9df53d12142 service cinder] REQUEST_METHOD: `GET` {{(pid=71938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 24 17:03:47.976173 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e68098d-8416-42ed-8004-e9df53d12142 service cinder] SCRIPT_NAME: `/identity` {{(pid=71938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 24 17:03:47.976504 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e68098d-8416-42ed-8004-e9df53d12142 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=71938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 24 17:03:47.986833 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e68098d-8416-42ed-8004-e9df53d12142 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=71938) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:442}} Nov 24 17:03:48.015753 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e68098d-8416-42ed-8004-e9df53d12142 service cinder] RBAC: Authorization granted {{(pid=71938) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 24 17:03:48.026116 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: [pid: 71938|app: 0|req: 1407/2826] 10.222.0.53 () {60 vars in 1356 bytes} [Wed Nov 24 17:03:47 2021] GET /identity/v3/auth/tokens => generated 3753 bytes in 126 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 24 17:03:48.083349 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9eef5877-f909-4178-8a1c-3c02561e202d None None] Authenticating user token {{(pid=71939) process_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 24 17:03:48.084835 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.fernet_utils [None req-9eef5877-f909-4178-8a1c-3c02561e202d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=71939) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:289}} Nov 24 17:03:48.097447 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9eef5877-f909-4178-8a1c-3c02561e202d None None] Validating token access rules against request {{(pid=71939) validate_allowed_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 24 17:03:48.101069 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26d4236a-2d30-48a3-84fd-d4814899deab service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a12374a3093a401a97c343ff0854184d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3b3940d4ae1c4177ae29c02377bb4b0b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=71939) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 24 17:03:48.101718 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26d4236a-2d30-48a3-84fd-d4814899deab service cinder] REQUEST_METHOD: `GET` {{(pid=71939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 24 17:03:48.102080 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26d4236a-2d30-48a3-84fd-d4814899deab service cinder] SCRIPT_NAME: `/identity` {{(pid=71939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 24 17:03:48.102418 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26d4236a-2d30-48a3-84fd-d4814899deab service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=71939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 24 17:03:48.169278 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26d4236a-2d30-48a3-84fd-d4814899deab service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=71939) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:442}} Nov 24 17:03:48.199965 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26d4236a-2d30-48a3-84fd-d4814899deab service cinder] RBAC: Authorization granted {{(pid=71939) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 24 17:03:48.210106 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: [pid: 71939|app: 0|req: 1420/2827] 10.222.0.53 () {60 vars in 1356 bytes} [Wed Nov 24 17:03:48 2021] GET /identity/v3/auth/tokens => generated 3684 bytes in 127 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 24 17:03:51.506525 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e68098d-8416-42ed-8004-e9df53d12142 service cinder] Authenticating user token {{(pid=71938) process_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 24 17:03:51.580631 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e68098d-8416-42ed-8004-e9df53d12142 service cinder] Validating token access rules against request {{(pid=71938) validate_allowed_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 24 17:03:51.585159 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9426b438-2a11-4f92-a015-ed4b9628dc5d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f2ba2e8375b4e8c8792ee1e22b60427', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '00a5583c7b7443e98e7a1d31a0b638dc', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=71938) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 24 17:03:51.586079 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9426b438-2a11-4f92-a015-ed4b9628dc5d admin admin] REQUEST_METHOD: `DELETE` {{(pid=71938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 24 17:03:51.586423 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9426b438-2a11-4f92-a015-ed4b9628dc5d admin admin] SCRIPT_NAME: `/identity` {{(pid=71938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 24 17:03:51.586755 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9426b438-2a11-4f92-a015-ed4b9628dc5d admin admin] PATH_INFO: `/v3/users/6caebf757cec47c0896fc125dfd2c531` {{(pid=71938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 24 17:03:51.588522 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9426b438-2a11-4f92-a015-ed4b9628dc5d admin admin] RBAC: Authorizing `identity:delete_user(user_id=6caebf757cec47c0896fc125dfd2c531)` {{(pid=71938) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:442}} Nov 24 17:03:51.616805 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9426b438-2a11-4f92-a015-ed4b9628dc5d admin admin] RBAC: Authorization granted {{(pid=71938) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 24 17:03:51.663606 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.notifications [None req-9426b438-2a11-4f92-a015-ed4b9628dc5d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '6caebf757cec47c0896fc125dfd2c531'} {{(pid=71938) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:357}} Nov 24 17:03:51.675820 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.notifications [None req-9426b438-2a11-4f92-a015-ed4b9628dc5d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '6caebf757cec47c0896fc125dfd2c531'} {{(pid=71938) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:357}} Nov 24 17:03:51.676507 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.notifications [None req-9426b438-2a11-4f92-a015-ed4b9628dc5d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '6caebf757cec47c0896fc125dfd2c531'} {{(pid=71938) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:357}} Nov 24 17:03:51.684898 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.notifications [None req-9426b438-2a11-4f92-a015-ed4b9628dc5d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '6caebf757cec47c0896fc125dfd2c531'} {{(pid=71938) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:357}} Nov 24 17:03:51.690715 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.notifications [None req-9426b438-2a11-4f92-a015-ed4b9628dc5d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '6caebf757cec47c0896fc125dfd2c531'} {{(pid=71938) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:357}} Nov 24 17:03:51.696863 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: [pid: 71938|app: 0|req: 1408/2828] 10.222.0.53 () {58 vars in 1214 bytes} [Wed Nov 24 17:03:51 2021] DELETE /identity/v3/users/6caebf757cec47c0896fc125dfd2c531 => generated 0 bytes in 191 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 24 17:03:51.702347 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8ce4ef7-0f40-4fe9-89e3-c897dd8c3709 None None] REQUEST_METHOD: `POST` {{(pid=71939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 24 17:03:51.702706 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8ce4ef7-0f40-4fe9-89e3-c897dd8c3709 None None] SCRIPT_NAME: `/identity` {{(pid=71939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 24 17:03:51.703049 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8ce4ef7-0f40-4fe9-89e3-c897dd8c3709 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=71939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 24 17:03:51.726629 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.auth.core [None req-b8ce4ef7-0f40-4fe9-89e3-c897dd8c3709 None None] MFA Rules not processed for user `0f2ba2e8375b4e8c8792ee1e22b60427`. Rule list: `[]` (Enabled: `True`). {{(pid=71939) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:442}} Nov 24 17:03:51.727803 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.fernet_utils [None req-b8ce4ef7-0f40-4fe9-89e3-c897dd8c3709 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=71939) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:289}} Nov 24 17:03:51.794715 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: [pid: 71939|app: 0|req: 1421/2829] 10.222.0.53 () {58 vars in 948 bytes} [Wed Nov 24 17:03:51 2021] POST /identity/v3/auth/tokens => generated 3669 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 24 17:03:51.805644 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9426b438-2a11-4f92-a015-ed4b9628dc5d admin admin] Authenticating user token {{(pid=71938) process_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 24 17:03:51.807665 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.fernet_utils [None req-9426b438-2a11-4f92-a015-ed4b9628dc5d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=71938) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:289}} Nov 24 17:03:51.876082 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9426b438-2a11-4f92-a015-ed4b9628dc5d admin admin] Validating token access rules against request {{(pid=71938) validate_allowed_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 24 17:03:51.879754 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82b37a9e-b316-4fe7-8f99-521711b63dcc service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c90f21b9cdcb413282461fa83cb6b7a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3b3940d4ae1c4177ae29c02377bb4b0b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=71938) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 24 17:03:51.880409 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82b37a9e-b316-4fe7-8f99-521711b63dcc service neutron] REQUEST_METHOD: `GET` {{(pid=71938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 24 17:03:51.880752 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82b37a9e-b316-4fe7-8f99-521711b63dcc service neutron] SCRIPT_NAME: `/identity` {{(pid=71938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 24 17:03:51.881088 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82b37a9e-b316-4fe7-8f99-521711b63dcc service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=71938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 24 17:03:51.891094 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82b37a9e-b316-4fe7-8f99-521711b63dcc service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=71938) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:442}} Nov 24 17:03:51.918771 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82b37a9e-b316-4fe7-8f99-521711b63dcc service neutron] RBAC: Authorization granted {{(pid=71938) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 24 17:03:51.928438 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: [pid: 71938|app: 0|req: 1409/2830] 10.222.0.53 () {60 vars in 1356 bytes} [Wed Nov 24 17:03:51 2021] GET /identity/v3/auth/tokens => generated 3669 bytes in 123 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 24 17:03:52.306868 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8ce4ef7-0f40-4fe9-89e3-c897dd8c3709 None None] Authenticating user token {{(pid=71939) process_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 24 17:03:52.308501 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.fernet_utils [None req-b8ce4ef7-0f40-4fe9-89e3-c897dd8c3709 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=71939) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:289}} Nov 24 17:03:52.320211 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8ce4ef7-0f40-4fe9-89e3-c897dd8c3709 None None] Validating token access rules against request {{(pid=71939) validate_allowed_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 24 17:03:52.325508 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b481607f-82c8-4f5f-a4ad-5ce828ce6304 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f2ba2e8375b4e8c8792ee1e22b60427', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '00a5583c7b7443e98e7a1d31a0b638dc', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=71939) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 24 17:03:52.326518 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b481607f-82c8-4f5f-a4ad-5ce828ce6304 admin admin] REQUEST_METHOD: `DELETE` {{(pid=71939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 24 17:03:52.326759 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b481607f-82c8-4f5f-a4ad-5ce828ce6304 admin admin] SCRIPT_NAME: `/identity` {{(pid=71939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 24 17:03:52.327096 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b481607f-82c8-4f5f-a4ad-5ce828ce6304 admin admin] PATH_INFO: `/v3/projects/898c3c76facd4e24bdce4c224daa01c3` {{(pid=71939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 24 17:03:52.328759 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b481607f-82c8-4f5f-a4ad-5ce828ce6304 admin admin] RBAC: Authorizing `identity:delete_project(project_id=898c3c76facd4e24bdce4c224daa01c3)` {{(pid=71939) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:442}} Nov 24 17:03:52.357577 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b481607f-82c8-4f5f-a4ad-5ce828ce6304 admin admin] RBAC: Authorization granted {{(pid=71939) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 24 17:03:52.408573 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.notifications [None req-b481607f-82c8-4f5f-a4ad-5ce828ce6304 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '898c3c76facd4e24bdce4c224daa01c3', 'request_id': 'req-b481607f-82c8-4f5f-a4ad-5ce828ce6304'} {{(pid=71939) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:357}} Nov 24 17:03:52.420502 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.notifications [None req-b481607f-82c8-4f5f-a4ad-5ce828ce6304 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '898c3c76facd4e24bdce4c224daa01c3', 'request_id': 'req-b481607f-82c8-4f5f-a4ad-5ce828ce6304'} {{(pid=71939) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:357}} Nov 24 17:03:52.427387 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.notifications [None req-b481607f-82c8-4f5f-a4ad-5ce828ce6304 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '898c3c76facd4e24bdce4c224daa01c3', 'request_id': 'req-b481607f-82c8-4f5f-a4ad-5ce828ce6304'} {{(pid=71939) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:357}} Nov 24 17:03:52.439364 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.notifications [None req-b481607f-82c8-4f5f-a4ad-5ce828ce6304 admin admin] The token cache is being invalidate because project 898c3c76facd4e24bdce4c224daa01c3 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=71939) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Nov 24 17:03:52.439663 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.notifications [None req-b481607f-82c8-4f5f-a4ad-5ce828ce6304 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=71939) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:357}} Nov 24 17:03:52.440352 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.notifications [None req-b481607f-82c8-4f5f-a4ad-5ce828ce6304 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=71939) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:357}} Nov 24 17:03:52.441963 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: [pid: 71939|app: 0|req: 1422/2831] 10.222.0.53 () {58 vars in 1223 bytes} [Wed Nov 24 17:03:52 2021] DELETE /identity/v3/projects/898c3c76facd4e24bdce4c224daa01c3 => generated 0 bytes in 136 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 24 17:03:52.446373 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82b37a9e-b316-4fe7-8f99-521711b63dcc service neutron] Authenticating user token {{(pid=71938) process_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 24 17:03:52.456840 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82b37a9e-b316-4fe7-8f99-521711b63dcc service neutron] Validating token access rules against request {{(pid=71938) validate_allowed_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 24 17:03:52.524017 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b5b5881-43a2-4185-aaff-6549ce50e2f6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f2ba2e8375b4e8c8792ee1e22b60427', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '00a5583c7b7443e98e7a1d31a0b638dc', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=71938) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 24 17:03:52.524845 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b5b5881-43a2-4185-aaff-6549ce50e2f6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=71938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 24 17:03:52.525688 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b5b5881-43a2-4185-aaff-6549ce50e2f6 admin admin] SCRIPT_NAME: `/identity` {{(pid=71938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 24 17:03:52.526062 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b5b5881-43a2-4185-aaff-6549ce50e2f6 admin admin] PATH_INFO: `/v3/users/8c66a1e263c440e09c7f41131adb9c99` {{(pid=71938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 24 17:03:52.527285 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b5b5881-43a2-4185-aaff-6549ce50e2f6 admin admin] RBAC: Authorizing `identity:delete_user(user_id=8c66a1e263c440e09c7f41131adb9c99)` {{(pid=71938) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:442}} Nov 24 17:03:52.556204 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b5b5881-43a2-4185-aaff-6549ce50e2f6 admin admin] RBAC: Authorization granted {{(pid=71938) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 24 17:03:52.603037 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.notifications [None req-3b5b5881-43a2-4185-aaff-6549ce50e2f6 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '8c66a1e263c440e09c7f41131adb9c99'} {{(pid=71938) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:357}} Nov 24 17:03:52.615843 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.notifications [None req-3b5b5881-43a2-4185-aaff-6549ce50e2f6 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '8c66a1e263c440e09c7f41131adb9c99'} {{(pid=71938) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:357}} Nov 24 17:03:52.616543 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.notifications [None req-3b5b5881-43a2-4185-aaff-6549ce50e2f6 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '8c66a1e263c440e09c7f41131adb9c99'} {{(pid=71938) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:357}} Nov 24 17:03:52.624822 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.notifications [None req-3b5b5881-43a2-4185-aaff-6549ce50e2f6 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '8c66a1e263c440e09c7f41131adb9c99'} {{(pid=71938) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:357}} Nov 24 17:03:52.630625 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.notifications [None req-3b5b5881-43a2-4185-aaff-6549ce50e2f6 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '8c66a1e263c440e09c7f41131adb9c99'} {{(pid=71938) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:357}} Nov 24 17:03:52.636838 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: [pid: 71938|app: 0|req: 1410/2832] 10.222.0.53 () {58 vars in 1214 bytes} [Wed Nov 24 17:03:52 2021] DELETE /identity/v3/users/8c66a1e263c440e09c7f41131adb9c99 => generated 0 bytes in 191 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 24 17:03:52.999809 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b481607f-82c8-4f5f-a4ad-5ce828ce6304 admin admin] Authenticating user token {{(pid=71939) process_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 24 17:03:53.001315 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.fernet_utils [None req-b481607f-82c8-4f5f-a4ad-5ce828ce6304 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=71939) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:289}} Nov 24 17:03:53.014810 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b481607f-82c8-4f5f-a4ad-5ce828ce6304 admin admin] Validating token access rules against request {{(pid=71939) validate_allowed_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 24 17:03:53.080476 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6246d50d-69e8-4464-ab48-92d6a10eab80 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f2ba2e8375b4e8c8792ee1e22b60427', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '00a5583c7b7443e98e7a1d31a0b638dc', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=71939) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 24 17:03:53.081291 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6246d50d-69e8-4464-ab48-92d6a10eab80 admin admin] REQUEST_METHOD: `DELETE` {{(pid=71939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 24 17:03:53.081631 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6246d50d-69e8-4464-ab48-92d6a10eab80 admin admin] SCRIPT_NAME: `/identity` {{(pid=71939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 24 17:03:53.081964 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6246d50d-69e8-4464-ab48-92d6a10eab80 admin admin] PATH_INFO: `/v3/projects/5aede6e126674f1eb60ea4105dfd1ed1` {{(pid=71939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 24 17:03:53.083243 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6246d50d-69e8-4464-ab48-92d6a10eab80 admin admin] RBAC: Authorizing `identity:delete_project(project_id=5aede6e126674f1eb60ea4105dfd1ed1)` {{(pid=71939) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:442}} Nov 24 17:03:53.112015 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6246d50d-69e8-4464-ab48-92d6a10eab80 admin admin] RBAC: Authorization granted {{(pid=71939) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 24 17:03:53.162287 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.notifications [None req-6246d50d-69e8-4464-ab48-92d6a10eab80 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '5aede6e126674f1eb60ea4105dfd1ed1', 'request_id': 'req-6246d50d-69e8-4464-ab48-92d6a10eab80'} {{(pid=71939) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:357}} Nov 24 17:03:53.174661 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.notifications [None req-6246d50d-69e8-4464-ab48-92d6a10eab80 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '5aede6e126674f1eb60ea4105dfd1ed1', 'request_id': 'req-6246d50d-69e8-4464-ab48-92d6a10eab80'} {{(pid=71939) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:357}} Nov 24 17:03:53.182194 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.notifications [None req-6246d50d-69e8-4464-ab48-92d6a10eab80 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '5aede6e126674f1eb60ea4105dfd1ed1', 'request_id': 'req-6246d50d-69e8-4464-ab48-92d6a10eab80'} {{(pid=71939) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:357}} Nov 24 17:03:53.193100 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.notifications [None req-6246d50d-69e8-4464-ab48-92d6a10eab80 admin admin] The token cache is being invalidate because project 5aede6e126674f1eb60ea4105dfd1ed1 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=71939) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Nov 24 17:03:53.193545 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.notifications [None req-6246d50d-69e8-4464-ab48-92d6a10eab80 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=71939) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:357}} Nov 24 17:03:53.194494 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.notifications [None req-6246d50d-69e8-4464-ab48-92d6a10eab80 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=71939) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:357}} Nov 24 17:03:53.196376 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: [pid: 71939|app: 0|req: 1423/2833] 10.222.0.53 () {58 vars in 1223 bytes} [Wed Nov 24 17:03:52 2021] DELETE /identity/v3/projects/5aede6e126674f1eb60ea4105dfd1ed1 => generated 0 bytes in 197 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 24 17:03:53.200627 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b5b5881-43a2-4185-aaff-6549ce50e2f6 admin admin] Authenticating user token {{(pid=71938) process_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 24 17:03:53.202069 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.fernet_utils [None req-3b5b5881-43a2-4185-aaff-6549ce50e2f6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=71938) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:289}} Nov 24 17:03:53.214984 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b5b5881-43a2-4185-aaff-6549ce50e2f6 admin admin] Validating token access rules against request {{(pid=71938) validate_allowed_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 24 17:03:53.289239 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e06ee536-d35d-4497-a6ba-ca4c73db5aa2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f2ba2e8375b4e8c8792ee1e22b60427', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '00a5583c7b7443e98e7a1d31a0b638dc', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=71938) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 24 17:03:53.290183 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e06ee536-d35d-4497-a6ba-ca4c73db5aa2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=71938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 24 17:03:53.290505 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e06ee536-d35d-4497-a6ba-ca4c73db5aa2 admin admin] SCRIPT_NAME: `/identity` {{(pid=71938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 24 17:03:53.290868 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e06ee536-d35d-4497-a6ba-ca4c73db5aa2 admin admin] PATH_INFO: `/v3/users/4d0a163704964cf1ac48aec8ced9aa9a` {{(pid=71938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 24 17:03:53.292093 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e06ee536-d35d-4497-a6ba-ca4c73db5aa2 admin admin] RBAC: Authorizing `identity:delete_user(user_id=4d0a163704964cf1ac48aec8ced9aa9a)` {{(pid=71938) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:442}} Nov 24 17:03:53.320931 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e06ee536-d35d-4497-a6ba-ca4c73db5aa2 admin admin] RBAC: Authorization granted {{(pid=71938) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 24 17:03:53.377611 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.notifications [None req-e06ee536-d35d-4497-a6ba-ca4c73db5aa2 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '4d0a163704964cf1ac48aec8ced9aa9a'} {{(pid=71938) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:357}} Nov 24 17:03:53.390864 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.notifications [None req-e06ee536-d35d-4497-a6ba-ca4c73db5aa2 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '4d0a163704964cf1ac48aec8ced9aa9a'} {{(pid=71938) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:357}} Nov 24 17:03:53.391676 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.notifications [None req-e06ee536-d35d-4497-a6ba-ca4c73db5aa2 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '4d0a163704964cf1ac48aec8ced9aa9a'} {{(pid=71938) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:357}} Nov 24 17:03:53.399950 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.notifications [None req-e06ee536-d35d-4497-a6ba-ca4c73db5aa2 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '4d0a163704964cf1ac48aec8ced9aa9a'} {{(pid=71938) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:357}} Nov 24 17:03:53.406054 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.notifications [None req-e06ee536-d35d-4497-a6ba-ca4c73db5aa2 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '4d0a163704964cf1ac48aec8ced9aa9a'} {{(pid=71938) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:357}} Nov 24 17:03:53.412341 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: [pid: 71938|app: 0|req: 1411/2834] 10.222.0.53 () {58 vars in 1214 bytes} [Wed Nov 24 17:03:53 2021] DELETE /identity/v3/users/4d0a163704964cf1ac48aec8ced9aa9a => generated 0 bytes in 212 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Nov 24 17:03:53.785376 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6246d50d-69e8-4464-ab48-92d6a10eab80 admin admin] Authenticating user token {{(pid=71939) process_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 24 17:03:53.786998 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.fernet_utils [None req-6246d50d-69e8-4464-ab48-92d6a10eab80 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=71939) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:289}} Nov 24 17:03:53.799624 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6246d50d-69e8-4464-ab48-92d6a10eab80 admin admin] Validating token access rules against request {{(pid=71939) validate_allowed_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 24 17:03:53.868766 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b960372-10dd-413e-aede-cf8106e3bff9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f2ba2e8375b4e8c8792ee1e22b60427', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '00a5583c7b7443e98e7a1d31a0b638dc', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=71939) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 24 17:03:53.869716 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b960372-10dd-413e-aede-cf8106e3bff9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=71939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 24 17:03:53.870078 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b960372-10dd-413e-aede-cf8106e3bff9 admin admin] SCRIPT_NAME: `/identity` {{(pid=71939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 24 17:03:53.870416 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b960372-10dd-413e-aede-cf8106e3bff9 admin admin] PATH_INFO: `/v3/projects/da32bd1ebada4940ab262105a92db2ce` {{(pid=71939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 24 17:03:53.871649 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b960372-10dd-413e-aede-cf8106e3bff9 admin admin] RBAC: Authorizing `identity:delete_project(project_id=da32bd1ebada4940ab262105a92db2ce)` {{(pid=71939) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:442}} Nov 24 17:03:53.900771 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b960372-10dd-413e-aede-cf8106e3bff9 admin admin] RBAC: Authorization granted {{(pid=71939) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 24 17:03:53.951186 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.notifications [None req-2b960372-10dd-413e-aede-cf8106e3bff9 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'da32bd1ebada4940ab262105a92db2ce', 'request_id': 'req-2b960372-10dd-413e-aede-cf8106e3bff9'} {{(pid=71939) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:357}} Nov 24 17:03:53.962956 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.notifications [None req-2b960372-10dd-413e-aede-cf8106e3bff9 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'da32bd1ebada4940ab262105a92db2ce', 'request_id': 'req-2b960372-10dd-413e-aede-cf8106e3bff9'} {{(pid=71939) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:357}} Nov 24 17:03:53.968815 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.notifications [None req-2b960372-10dd-413e-aede-cf8106e3bff9 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'da32bd1ebada4940ab262105a92db2ce', 'request_id': 'req-2b960372-10dd-413e-aede-cf8106e3bff9'} {{(pid=71939) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:357}} Nov 24 17:03:53.979642 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.notifications [None req-2b960372-10dd-413e-aede-cf8106e3bff9 admin admin] The token cache is being invalidate because project da32bd1ebada4940ab262105a92db2ce was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=71939) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Nov 24 17:03:53.979991 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.notifications [None req-2b960372-10dd-413e-aede-cf8106e3bff9 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=71939) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:357}} Nov 24 17:03:53.980665 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.notifications [None req-2b960372-10dd-413e-aede-cf8106e3bff9 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=71939) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:357}} Nov 24 17:03:53.982259 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: [pid: 71939|app: 0|req: 1424/2835] 10.222.0.53 () {58 vars in 1223 bytes} [Wed Nov 24 17:03:53 2021] DELETE /identity/v3/projects/da32bd1ebada4940ab262105a92db2ce => generated 0 bytes in 197 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 24 17:03:53.989589 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-729b2038-504e-4207-a539-5d8e3feadec3 None None] REQUEST_METHOD: `POST` {{(pid=71938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 24 17:03:53.989940 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-729b2038-504e-4207-a539-5d8e3feadec3 None None] SCRIPT_NAME: `/identity` {{(pid=71938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 24 17:03:53.990338 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-729b2038-504e-4207-a539-5d8e3feadec3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=71938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 24 17:03:54.014332 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.auth.core [None req-729b2038-504e-4207-a539-5d8e3feadec3 None None] MFA Rules not processed for user `0f2ba2e8375b4e8c8792ee1e22b60427`. Rule list: `[]` (Enabled: `True`). {{(pid=71938) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:442}} Nov 24 17:03:54.015556 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.fernet_utils [None req-729b2038-504e-4207-a539-5d8e3feadec3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=71938) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:289}} Nov 24 17:03:54.087052 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: [pid: 71938|app: 0|req: 1412/2836] 10.222.0.53 () {58 vars in 948 bytes} [Wed Nov 24 17:03:53 2021] POST /identity/v3/auth/tokens => generated 3669 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 24 17:03:54.096617 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e774f215-0d32-4b27-8d01-471341c52fcd None None] REQUEST_METHOD: `POST` {{(pid=71939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 24 17:03:54.096972 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e774f215-0d32-4b27-8d01-471341c52fcd None None] SCRIPT_NAME: `/identity` {{(pid=71939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 24 17:03:54.097318 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e774f215-0d32-4b27-8d01-471341c52fcd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=71939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 24 17:03:54.121235 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.auth.core [None req-e774f215-0d32-4b27-8d01-471341c52fcd None None] MFA Rules not processed for user `0f2ba2e8375b4e8c8792ee1e22b60427`. Rule list: `[]` (Enabled: `True`). {{(pid=71939) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:442}} Nov 24 17:03:54.122429 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.fernet_utils [None req-e774f215-0d32-4b27-8d01-471341c52fcd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=71939) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:289}} Nov 24 17:03:54.129869 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: [pid: 71939|app: 0|req: 1425/2837] 10.222.0.53 () {58 vars in 948 bytes} [Wed Nov 24 17:03:54 2021] POST /identity/v3/auth/tokens => generated 3669 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 24 17:03:54.134367 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-729b2038-504e-4207-a539-5d8e3feadec3 None None] Authenticating user token {{(pid=71938) process_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 24 17:03:54.144113 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-729b2038-504e-4207-a539-5d8e3feadec3 None None] Validating token access rules against request {{(pid=71938) validate_allowed_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 24 17:03:54.148610 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9116419-dfe8-4181-938b-62450c4d3e99 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f2ba2e8375b4e8c8792ee1e22b60427', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '00a5583c7b7443e98e7a1d31a0b638dc', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=71938) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 24 17:03:54.149275 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9116419-dfe8-4181-938b-62450c4d3e99 admin admin] REQUEST_METHOD: `GET` {{(pid=71938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 24 17:03:54.149616 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9116419-dfe8-4181-938b-62450c4d3e99 admin admin] SCRIPT_NAME: `/identity` {{(pid=71938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 24 17:03:54.149952 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9116419-dfe8-4181-938b-62450c4d3e99 admin admin] PATH_INFO: `/v3/domains` {{(pid=71938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 24 17:03:54.151272 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9116419-dfe8-4181-938b-62450c4d3e99 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=71938) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:161}} Nov 24 17:03:54.151628 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9116419-dfe8-4181-938b-62450c4d3e99 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=71938) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:442}} Nov 24 17:03:54.180290 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9116419-dfe8-4181-938b-62450c4d3e99 admin admin] RBAC: Authorization granted {{(pid=71938) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 24 17:03:54.194431 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: [pid: 71938|app: 0|req: 1413/2838] 10.222.0.53 () {58 vars in 1143 bytes} [Wed Nov 24 17:03:54 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 61 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 24 17:03:54.199270 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e774f215-0d32-4b27-8d01-471341c52fcd None None] Authenticating user token {{(pid=71939) process_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 24 17:03:54.208712 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e774f215-0d32-4b27-8d01-471341c52fcd None None] Validating token access rules against request {{(pid=71939) validate_allowed_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 24 17:03:54.214364 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03555502-f4ea-4905-8b98-e9cf674640ec admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f2ba2e8375b4e8c8792ee1e22b60427', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '00a5583c7b7443e98e7a1d31a0b638dc', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=71939) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 24 17:03:54.215038 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03555502-f4ea-4905-8b98-e9cf674640ec admin admin] REQUEST_METHOD: `POST` {{(pid=71939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 24 17:03:54.215384 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03555502-f4ea-4905-8b98-e9cf674640ec admin admin] SCRIPT_NAME: `/identity` {{(pid=71939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 24 17:03:54.215839 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03555502-f4ea-4905-8b98-e9cf674640ec admin admin] PATH_INFO: `/v3/projects` {{(pid=71939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 24 17:03:54.216450 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03555502-f4ea-4905-8b98-e9cf674640ec admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=71939) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:442}} Nov 24 17:03:54.245279 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03555502-f4ea-4905-8b98-e9cf674640ec admin admin] RBAC: Authorization granted {{(pid=71939) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 24 17:03:54.277901 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: [pid: 71939|app: 0|req: 1426/2839] 10.222.0.53 () {60 vars in 1143 bytes} [Wed Nov 24 17:03:54 2021] POST /identity/v3/projects => generated 367 bytes in 75 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 24 17:03:54.279346 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9116419-dfe8-4181-938b-62450c4d3e99 admin admin] Authenticating user token {{(pid=71938) process_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 24 17:03:54.289751 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9116419-dfe8-4181-938b-62450c4d3e99 admin admin] Validating token access rules against request {{(pid=71938) validate_allowed_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 24 17:03:54.436520 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cecec6d0-7580-486d-9dd5-8c765e734348 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f2ba2e8375b4e8c8792ee1e22b60427', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '00a5583c7b7443e98e7a1d31a0b638dc', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=71938) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 24 17:03:54.437200 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cecec6d0-7580-486d-9dd5-8c765e734348 admin admin] REQUEST_METHOD: `POST` {{(pid=71938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 24 17:03:54.437543 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cecec6d0-7580-486d-9dd5-8c765e734348 admin admin] SCRIPT_NAME: `/identity` {{(pid=71938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 24 17:03:54.437878 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cecec6d0-7580-486d-9dd5-8c765e734348 admin admin] PATH_INFO: `/v3/users` {{(pid=71938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 24 17:03:54.438669 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cecec6d0-7580-486d-9dd5-8c765e734348 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=71938) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:442}} Nov 24 17:03:54.467253 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cecec6d0-7580-486d-9dd5-8c765e734348 admin admin] RBAC: Authorization granted {{(pid=71938) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 24 17:03:54.488967 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: [pid: 71938|app: 0|req: 1414/2840] 10.222.0.53 () {60 vars in 1134 bytes} [Wed Nov 24 17:03:54 2021] POST /identity/v3/users => generated 284 bytes in 210 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 24 17:03:54.493581 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03555502-f4ea-4905-8b98-e9cf674640ec admin admin] Authenticating user token {{(pid=71939) process_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 24 17:03:54.504600 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03555502-f4ea-4905-8b98-e9cf674640ec admin admin] Validating token access rules against request {{(pid=71939) validate_allowed_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 24 17:03:54.509145 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b18d76c7-383d-4ce2-9fee-b3b7f309403d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f2ba2e8375b4e8c8792ee1e22b60427', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '00a5583c7b7443e98e7a1d31a0b638dc', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=71939) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 24 17:03:54.509863 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b18d76c7-383d-4ce2-9fee-b3b7f309403d admin admin] REQUEST_METHOD: `GET` {{(pid=71939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 24 17:03:54.510231 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b18d76c7-383d-4ce2-9fee-b3b7f309403d admin admin] SCRIPT_NAME: `/identity` {{(pid=71939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 24 17:03:54.510562 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b18d76c7-383d-4ce2-9fee-b3b7f309403d admin admin] PATH_INFO: `/v3/roles` {{(pid=71939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 24 17:03:54.511347 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b18d76c7-383d-4ce2-9fee-b3b7f309403d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=71939) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:442}} Nov 24 17:03:54.539159 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b18d76c7-383d-4ce2-9fee-b3b7f309403d admin admin] RBAC: Authorization granted {{(pid=71939) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 24 17:03:54.550601 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: [pid: 71939|app: 0|req: 1427/2841] 10.222.0.53 () {58 vars in 1112 bytes} [Wed Nov 24 17:03:54 2021] GET /identity/v3/roles => generated 1420 bytes in 58 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 24 17:03:54.555247 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cecec6d0-7580-486d-9dd5-8c765e734348 admin admin] Authenticating user token {{(pid=71938) process_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 24 17:03:54.565964 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cecec6d0-7580-486d-9dd5-8c765e734348 admin admin] Validating token access rules against request {{(pid=71938) validate_allowed_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 24 17:03:54.570574 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8384c1a2-3a83-4d0e-aaad-80003ec9ab21 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f2ba2e8375b4e8c8792ee1e22b60427', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '00a5583c7b7443e98e7a1d31a0b638dc', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=71938) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 24 17:03:54.571476 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8384c1a2-3a83-4d0e-aaad-80003ec9ab21 admin admin] REQUEST_METHOD: `PUT` {{(pid=71938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 24 17:03:54.571815 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8384c1a2-3a83-4d0e-aaad-80003ec9ab21 admin admin] SCRIPT_NAME: `/identity` {{(pid=71938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 24 17:03:54.572150 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8384c1a2-3a83-4d0e-aaad-80003ec9ab21 admin admin] PATH_INFO: `/v3/projects/f8127b083dff47719c4c9b65faf6b58c/users/27e1a70cf4034521a15f70aaf30d813c/roles/912ab5f10fa5477da74acf239f07604e` {{(pid=71938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 24 17:03:54.592665 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8384c1a2-3a83-4d0e-aaad-80003ec9ab21 admin admin] RBAC: Authorizing `identity:create_grant(project_id=f8127b083dff47719c4c9b65faf6b58c, user_id=27e1a70cf4034521a15f70aaf30d813c, role_id=912ab5f10fa5477da74acf239f07604e)` {{(pid=71938) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:442}} Nov 24 17:03:54.622794 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8384c1a2-3a83-4d0e-aaad-80003ec9ab21 admin admin] RBAC: Authorization granted {{(pid=71938) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 24 17:03:54.634783 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: [pid: 71938|app: 0|req: 1415/2842] 10.222.0.53 () {60 vars in 1473 bytes} [Wed Nov 24 17:03:54 2021] PUT /identity/v3/projects/f8127b083dff47719c4c9b65faf6b58c/users/27e1a70cf4034521a15f70aaf30d813c/roles/912ab5f10fa5477da74acf239f07604e => generated 0 bytes in 80 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 24 17:03:54.646559 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e2348c8-ffe4-494a-8a6a-0220ccaac998 None None] REQUEST_METHOD: `POST` {{(pid=71939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 24 17:03:54.646910 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e2348c8-ffe4-494a-8a6a-0220ccaac998 None None] SCRIPT_NAME: `/identity` {{(pid=71939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 24 17:03:54.647246 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e2348c8-ffe4-494a-8a6a-0220ccaac998 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=71939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 24 17:03:54.685883 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.auth.core [None req-8e2348c8-ffe4-494a-8a6a-0220ccaac998 None None] MFA Rules not processed for user `27e1a70cf4034521a15f70aaf30d813c`. Rule list: `[]` (Enabled: `True`). {{(pid=71939) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:442}} Nov 24 17:03:54.687073 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.fernet_utils [None req-8e2348c8-ffe4-494a-8a6a-0220ccaac998 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=71939) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:289}} Nov 24 17:03:54.760486 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: [pid: 71939|app: 0|req: 1428/2843] 10.222.0.53 () {58 vars in 948 bytes} [Wed Nov 24 17:03:54 2021] POST /identity/v3/auth/tokens => generated 3674 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 24 17:03:54.765223 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8384c1a2-3a83-4d0e-aaad-80003ec9ab21 admin admin] Authenticating user token {{(pid=71938) process_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 24 17:03:54.840258 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8384c1a2-3a83-4d0e-aaad-80003ec9ab21 admin admin] Validating token access rules against request {{(pid=71938) validate_allowed_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 24 17:03:54.844926 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2c3cdc5-c8ea-42ea-be8e-30f3370b6661 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f2ba2e8375b4e8c8792ee1e22b60427', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '00a5583c7b7443e98e7a1d31a0b638dc', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=71938) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 24 17:03:54.845600 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2c3cdc5-c8ea-42ea-be8e-30f3370b6661 admin admin] REQUEST_METHOD: `POST` {{(pid=71938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 24 17:03:54.845941 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2c3cdc5-c8ea-42ea-be8e-30f3370b6661 admin admin] SCRIPT_NAME: `/identity` {{(pid=71938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 24 17:03:54.846310 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2c3cdc5-c8ea-42ea-be8e-30f3370b6661 admin admin] PATH_INFO: `/v3/projects` {{(pid=71938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 24 17:03:54.847041 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2c3cdc5-c8ea-42ea-be8e-30f3370b6661 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=71938) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:442}} Nov 24 17:03:54.875959 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2c3cdc5-c8ea-42ea-be8e-30f3370b6661 admin admin] RBAC: Authorization granted {{(pid=71938) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 24 17:03:54.901645 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: [pid: 71938|app: 0|req: 1416/2844] 10.222.0.53 () {60 vars in 1143 bytes} [Wed Nov 24 17:03:54 2021] POST /identity/v3/projects => generated 365 bytes in 137 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 24 17:03:54.906218 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e2348c8-ffe4-494a-8a6a-0220ccaac998 None None] Authenticating user token {{(pid=71939) process_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 24 17:03:54.917626 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e2348c8-ffe4-494a-8a6a-0220ccaac998 None None] Validating token access rules against request {{(pid=71939) validate_allowed_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 24 17:03:54.983029 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5c3cd25-8496-4fe8-86c9-bfa415097a29 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f2ba2e8375b4e8c8792ee1e22b60427', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '00a5583c7b7443e98e7a1d31a0b638dc', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=71939) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 24 17:03:54.983650 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5c3cd25-8496-4fe8-86c9-bfa415097a29 admin admin] REQUEST_METHOD: `POST` {{(pid=71939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 24 17:03:54.983996 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5c3cd25-8496-4fe8-86c9-bfa415097a29 admin admin] SCRIPT_NAME: `/identity` {{(pid=71939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 24 17:03:54.984333 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5c3cd25-8496-4fe8-86c9-bfa415097a29 admin admin] PATH_INFO: `/v3/users` {{(pid=71939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 24 17:03:54.985066 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5c3cd25-8496-4fe8-86c9-bfa415097a29 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=71939) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:442}} Nov 24 17:03:55.013527 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5c3cd25-8496-4fe8-86c9-bfa415097a29 admin admin] RBAC: Authorization granted {{(pid=71939) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 24 17:03:55.032643 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: [pid: 71939|app: 0|req: 1429/2845] 10.222.0.53 () {60 vars in 1134 bytes} [Wed Nov 24 17:03:54 2021] POST /identity/v3/users => generated 289 bytes in 127 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Nov 24 17:03:55.037229 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2c3cdc5-c8ea-42ea-be8e-30f3370b6661 admin admin] Authenticating user token {{(pid=71938) process_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 24 17:03:55.048241 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2c3cdc5-c8ea-42ea-be8e-30f3370b6661 admin admin] Validating token access rules against request {{(pid=71938) validate_allowed_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 24 17:03:55.052764 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb46f062-2770-445a-aecd-df36dc537991 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f2ba2e8375b4e8c8792ee1e22b60427', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '00a5583c7b7443e98e7a1d31a0b638dc', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=71938) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 24 17:03:55.053436 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb46f062-2770-445a-aecd-df36dc537991 admin admin] REQUEST_METHOD: `GET` {{(pid=71938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 24 17:03:55.053772 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb46f062-2770-445a-aecd-df36dc537991 admin admin] SCRIPT_NAME: `/identity` {{(pid=71938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 24 17:03:55.054134 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb46f062-2770-445a-aecd-df36dc537991 admin admin] PATH_INFO: `/v3/roles` {{(pid=71938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 24 17:03:55.054925 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb46f062-2770-445a-aecd-df36dc537991 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=71938) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:442}} Nov 24 17:03:55.084303 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb46f062-2770-445a-aecd-df36dc537991 admin admin] RBAC: Authorization granted {{(pid=71938) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 24 17:03:55.096956 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: [pid: 71938|app: 0|req: 1417/2846] 10.222.0.53 () {58 vars in 1112 bytes} [Wed Nov 24 17:03:55 2021] GET /identity/v3/roles => generated 1420 bytes in 60 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 24 17:03:55.101611 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5c3cd25-8496-4fe8-86c9-bfa415097a29 admin admin] Authenticating user token {{(pid=71939) process_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 24 17:03:55.112537 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5c3cd25-8496-4fe8-86c9-bfa415097a29 admin admin] Validating token access rules against request {{(pid=71939) validate_allowed_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 24 17:03:55.117187 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39044d4b-4b9b-4459-a6d5-25d19253b239 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f2ba2e8375b4e8c8792ee1e22b60427', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '00a5583c7b7443e98e7a1d31a0b638dc', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=71939) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 24 17:03:55.118120 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39044d4b-4b9b-4459-a6d5-25d19253b239 admin admin] REQUEST_METHOD: `PUT` {{(pid=71939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 24 17:03:55.118470 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39044d4b-4b9b-4459-a6d5-25d19253b239 admin admin] SCRIPT_NAME: `/identity` {{(pid=71939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 24 17:03:55.118809 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39044d4b-4b9b-4459-a6d5-25d19253b239 admin admin] PATH_INFO: `/v3/projects/3a38d351a8624f6288ae8cdb4f6f70c3/users/1fe489dedf914ce396eae4cd9f24f18d/roles/5611724e350b41e19921b5961a342582` {{(pid=71939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 24 17:03:55.139962 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39044d4b-4b9b-4459-a6d5-25d19253b239 admin admin] RBAC: Authorizing `identity:create_grant(project_id=3a38d351a8624f6288ae8cdb4f6f70c3, user_id=1fe489dedf914ce396eae4cd9f24f18d, role_id=5611724e350b41e19921b5961a342582)` {{(pid=71939) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:442}} Nov 24 17:03:55.170502 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39044d4b-4b9b-4459-a6d5-25d19253b239 admin admin] RBAC: Authorization granted {{(pid=71939) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 24 17:03:55.183077 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: [pid: 71939|app: 0|req: 1430/2847] 10.222.0.53 () {60 vars in 1473 bytes} [Wed Nov 24 17:03:55 2021] PUT /identity/v3/projects/3a38d351a8624f6288ae8cdb4f6f70c3/users/1fe489dedf914ce396eae4cd9f24f18d/roles/5611724e350b41e19921b5961a342582 => generated 0 bytes in 82 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 24 17:03:55.187193 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb46f062-2770-445a-aecd-df36dc537991 admin admin] Authenticating user token {{(pid=71938) process_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 24 17:03:55.197810 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb46f062-2770-445a-aecd-df36dc537991 admin admin] Validating token access rules against request {{(pid=71938) validate_allowed_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 24 17:03:55.263373 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-153f9be0-0c5a-4e1f-961f-565b3f5c5118 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f2ba2e8375b4e8c8792ee1e22b60427', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '00a5583c7b7443e98e7a1d31a0b638dc', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=71938) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 24 17:03:55.263992 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-153f9be0-0c5a-4e1f-961f-565b3f5c5118 admin admin] REQUEST_METHOD: `GET` {{(pid=71938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 24 17:03:55.264328 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-153f9be0-0c5a-4e1f-961f-565b3f5c5118 admin admin] SCRIPT_NAME: `/identity` {{(pid=71938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 24 17:03:55.264656 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-153f9be0-0c5a-4e1f-961f-565b3f5c5118 admin admin] PATH_INFO: `/v3/roles` {{(pid=71938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 24 17:03:55.265437 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-153f9be0-0c5a-4e1f-961f-565b3f5c5118 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=71938) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:442}} Nov 24 17:03:55.294141 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-153f9be0-0c5a-4e1f-961f-565b3f5c5118 admin admin] RBAC: Authorization granted {{(pid=71938) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 24 17:03:55.304745 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: [pid: 71938|app: 0|req: 1418/2848] 10.222.0.53 () {58 vars in 1112 bytes} [Wed Nov 24 17:03:55 2021] GET /identity/v3/roles => generated 1420 bytes in 118 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 24 17:03:55.309705 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39044d4b-4b9b-4459-a6d5-25d19253b239 admin admin] Authenticating user token {{(pid=71939) process_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 24 17:03:55.320225 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39044d4b-4b9b-4459-a6d5-25d19253b239 admin admin] Validating token access rules against request {{(pid=71939) validate_allowed_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 24 17:03:55.326034 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a48ffc16-3aee-4407-a092-df938e2c02c0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f2ba2e8375b4e8c8792ee1e22b60427', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '00a5583c7b7443e98e7a1d31a0b638dc', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=71939) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 24 17:03:55.326970 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a48ffc16-3aee-4407-a092-df938e2c02c0 admin admin] REQUEST_METHOD: `PUT` {{(pid=71939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 24 17:03:55.327468 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a48ffc16-3aee-4407-a092-df938e2c02c0 admin admin] SCRIPT_NAME: `/identity` {{(pid=71939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 24 17:03:55.328286 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a48ffc16-3aee-4407-a092-df938e2c02c0 admin admin] PATH_INFO: `/v3/projects/3a38d351a8624f6288ae8cdb4f6f70c3/users/1fe489dedf914ce396eae4cd9f24f18d/roles/5611724e350b41e19921b5961a342582` {{(pid=71939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 24 17:03:55.330362 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a48ffc16-3aee-4407-a092-df938e2c02c0 admin admin] RBAC: Authorizing `identity:create_grant(project_id=3a38d351a8624f6288ae8cdb4f6f70c3, user_id=1fe489dedf914ce396eae4cd9f24f18d, role_id=5611724e350b41e19921b5961a342582)` {{(pid=71939) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:442}} Nov 24 17:03:55.360073 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a48ffc16-3aee-4407-a092-df938e2c02c0 admin admin] RBAC: Authorization granted {{(pid=71939) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 24 17:03:55.370937 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: [pid: 71939|app: 0|req: 1431/2849] 10.222.0.53 () {60 vars in 1473 bytes} [Wed Nov 24 17:03:55 2021] PUT /identity/v3/projects/3a38d351a8624f6288ae8cdb4f6f70c3/users/1fe489dedf914ce396eae4cd9f24f18d/roles/5611724e350b41e19921b5961a342582 => generated 0 bytes in 62 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 24 17:03:55.375214 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-153f9be0-0c5a-4e1f-961f-565b3f5c5118 admin admin] Authenticating user token {{(pid=71938) process_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 24 17:03:55.385765 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-153f9be0-0c5a-4e1f-961f-565b3f5c5118 admin admin] Validating token access rules against request {{(pid=71938) validate_allowed_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 24 17:03:55.452914 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb7de30e-d413-44d9-9df6-a4a0615fd700 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f2ba2e8375b4e8c8792ee1e22b60427', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '00a5583c7b7443e98e7a1d31a0b638dc', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=71938) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 24 17:03:55.453590 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb7de30e-d413-44d9-9df6-a4a0615fd700 admin admin] REQUEST_METHOD: `GET` {{(pid=71938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 24 17:03:55.453930 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb7de30e-d413-44d9-9df6-a4a0615fd700 admin admin] SCRIPT_NAME: `/identity` {{(pid=71938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 24 17:03:55.454290 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb7de30e-d413-44d9-9df6-a4a0615fd700 admin admin] PATH_INFO: `/v3/roles` {{(pid=71938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 24 17:03:55.455067 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb7de30e-d413-44d9-9df6-a4a0615fd700 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=71938) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:442}} Nov 24 17:03:55.483614 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb7de30e-d413-44d9-9df6-a4a0615fd700 admin admin] RBAC: Authorization granted {{(pid=71938) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 24 17:03:55.494310 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: [pid: 71938|app: 0|req: 1419/2850] 10.222.0.53 () {58 vars in 1112 bytes} [Wed Nov 24 17:03:55 2021] GET /identity/v3/roles => generated 1420 bytes in 120 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 24 17:03:55.498818 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a48ffc16-3aee-4407-a092-df938e2c02c0 admin admin] Authenticating user token {{(pid=71939) process_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 24 17:03:55.509080 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a48ffc16-3aee-4407-a092-df938e2c02c0 admin admin] Validating token access rules against request {{(pid=71939) validate_allowed_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 24 17:03:55.514259 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17326f03-880e-491e-96cf-e0ba649c3d7e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f2ba2e8375b4e8c8792ee1e22b60427', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '00a5583c7b7443e98e7a1d31a0b638dc', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=71939) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 24 17:03:55.515107 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17326f03-880e-491e-96cf-e0ba649c3d7e admin admin] REQUEST_METHOD: `PUT` {{(pid=71939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 24 17:03:55.515446 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17326f03-880e-491e-96cf-e0ba649c3d7e admin admin] SCRIPT_NAME: `/identity` {{(pid=71939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 24 17:03:55.515767 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17326f03-880e-491e-96cf-e0ba649c3d7e admin admin] PATH_INFO: `/v3/projects/3a38d351a8624f6288ae8cdb4f6f70c3/users/1fe489dedf914ce396eae4cd9f24f18d/roles/912ab5f10fa5477da74acf239f07604e` {{(pid=71939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 24 17:03:55.517719 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17326f03-880e-491e-96cf-e0ba649c3d7e admin admin] RBAC: Authorizing `identity:create_grant(project_id=3a38d351a8624f6288ae8cdb4f6f70c3, user_id=1fe489dedf914ce396eae4cd9f24f18d, role_id=912ab5f10fa5477da74acf239f07604e)` {{(pid=71939) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:442}} Nov 24 17:03:55.547392 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17326f03-880e-491e-96cf-e0ba649c3d7e admin admin] RBAC: Authorization granted {{(pid=71939) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 24 17:03:55.563027 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: [pid: 71939|app: 0|req: 1432/2851] 10.222.0.53 () {60 vars in 1473 bytes} [Wed Nov 24 17:03:55 2021] PUT /identity/v3/projects/3a38d351a8624f6288ae8cdb4f6f70c3/users/1fe489dedf914ce396eae4cd9f24f18d/roles/912ab5f10fa5477da74acf239f07604e => generated 0 bytes in 65 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 24 17:03:55.575693 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-975bf9f2-02b2-4733-934c-57e02d8af476 None None] REQUEST_METHOD: `POST` {{(pid=71938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 24 17:03:55.576120 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-975bf9f2-02b2-4733-934c-57e02d8af476 None None] SCRIPT_NAME: `/identity` {{(pid=71938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 24 17:03:55.576461 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-975bf9f2-02b2-4733-934c-57e02d8af476 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=71938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 24 17:03:55.614560 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.auth.core [None req-975bf9f2-02b2-4733-934c-57e02d8af476 None None] MFA Rules not processed for user `1fe489dedf914ce396eae4cd9f24f18d`. Rule list: `[]` (Enabled: `True`). {{(pid=71938) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:442}} Nov 24 17:03:55.615801 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.fernet_utils [None req-975bf9f2-02b2-4733-934c-57e02d8af476 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=71938) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:289}} Nov 24 17:03:55.697784 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: [pid: 71938|app: 0|req: 1420/2852] 10.222.0.53 () {58 vars in 948 bytes} [Wed Nov 24 17:03:55 2021] POST /identity/v3/auth/tokens => generated 3739 bytes in 123 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 24 17:03:55.709030 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17326f03-880e-491e-96cf-e0ba649c3d7e admin admin] Authenticating user token {{(pid=71939) process_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 24 17:03:55.710917 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.fernet_utils [None req-17326f03-880e-491e-96cf-e0ba649c3d7e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=71939) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:289}} Nov 24 17:03:55.779386 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17326f03-880e-491e-96cf-e0ba649c3d7e admin admin] Validating token access rules against request {{(pid=71939) validate_allowed_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 24 17:03:55.782958 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fb3d290-7516-4058-adc9-810677c4a7d9 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a12374a3093a401a97c343ff0854184d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3b3940d4ae1c4177ae29c02377bb4b0b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=71939) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 24 17:03:55.783601 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fb3d290-7516-4058-adc9-810677c4a7d9 service cinder] REQUEST_METHOD: `GET` {{(pid=71939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 24 17:03:55.783937 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fb3d290-7516-4058-adc9-810677c4a7d9 service cinder] SCRIPT_NAME: `/identity` {{(pid=71939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 24 17:03:55.784267 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fb3d290-7516-4058-adc9-810677c4a7d9 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=71939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 24 17:03:55.794053 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fb3d290-7516-4058-adc9-810677c4a7d9 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=71939) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:442}} Nov 24 17:03:55.821806 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fb3d290-7516-4058-adc9-810677c4a7d9 service cinder] RBAC: Authorization granted {{(pid=71939) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 24 17:03:55.831264 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: [pid: 71939|app: 0|req: 1433/2853] 10.222.0.53 () {60 vars in 1356 bytes} [Wed Nov 24 17:03:55 2021] GET /identity/v3/auth/tokens => generated 3739 bytes in 123 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 24 17:03:55.947977 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-975bf9f2-02b2-4733-934c-57e02d8af476 None None] Authenticating user token {{(pid=71938) process_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 24 17:03:55.957940 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-975bf9f2-02b2-4733-934c-57e02d8af476 None None] Validating token access rules against request {{(pid=71938) validate_allowed_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 24 17:03:55.961578 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e241c11-e4b2-4c05-bca0-08c87f5a0704 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a12374a3093a401a97c343ff0854184d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3b3940d4ae1c4177ae29c02377bb4b0b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=71938) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 24 17:03:55.962258 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e241c11-e4b2-4c05-bca0-08c87f5a0704 service cinder] REQUEST_METHOD: `GET` {{(pid=71938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 24 17:03:55.963214 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e241c11-e4b2-4c05-bca0-08c87f5a0704 service cinder] SCRIPT_NAME: `/identity` {{(pid=71938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 24 17:03:55.963552 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e241c11-e4b2-4c05-bca0-08c87f5a0704 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=71938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 24 17:03:56.029810 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e241c11-e4b2-4c05-bca0-08c87f5a0704 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=71938) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:442}} Nov 24 17:03:56.057965 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e241c11-e4b2-4c05-bca0-08c87f5a0704 service cinder] RBAC: Authorization granted {{(pid=71938) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 24 17:03:56.067132 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: [pid: 71938|app: 0|req: 1421/2854] 10.222.0.53 () {60 vars in 1356 bytes} [Wed Nov 24 17:03:55 2021] GET /identity/v3/auth/tokens => generated 3674 bytes in 120 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 24 17:04:01.533585 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fb3d290-7516-4058-adc9-810677c4a7d9 service cinder] Authenticating user token {{(pid=71939) process_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 24 17:04:01.606178 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fb3d290-7516-4058-adc9-810677c4a7d9 service cinder] Validating token access rules against request {{(pid=71939) validate_allowed_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 24 17:04:01.610697 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efad3a59-1ded-4d2d-8465-9fa17ae05dc8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f2ba2e8375b4e8c8792ee1e22b60427', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '00a5583c7b7443e98e7a1d31a0b638dc', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=71939) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 24 17:04:01.611579 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efad3a59-1ded-4d2d-8465-9fa17ae05dc8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=71939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 24 17:04:01.611918 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efad3a59-1ded-4d2d-8465-9fa17ae05dc8 admin admin] SCRIPT_NAME: `/identity` {{(pid=71939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 24 17:04:01.612253 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efad3a59-1ded-4d2d-8465-9fa17ae05dc8 admin admin] PATH_INFO: `/v3/users/27e1a70cf4034521a15f70aaf30d813c` {{(pid=71939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 24 17:04:01.613474 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efad3a59-1ded-4d2d-8465-9fa17ae05dc8 admin admin] RBAC: Authorizing `identity:delete_user(user_id=27e1a70cf4034521a15f70aaf30d813c)` {{(pid=71939) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:442}} Nov 24 17:04:01.641540 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efad3a59-1ded-4d2d-8465-9fa17ae05dc8 admin admin] RBAC: Authorization granted {{(pid=71939) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 24 17:04:01.688641 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.notifications [None req-efad3a59-1ded-4d2d-8465-9fa17ae05dc8 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '27e1a70cf4034521a15f70aaf30d813c'} {{(pid=71939) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:357}} Nov 24 17:04:01.700828 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.notifications [None req-efad3a59-1ded-4d2d-8465-9fa17ae05dc8 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '27e1a70cf4034521a15f70aaf30d813c'} {{(pid=71939) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:357}} Nov 24 17:04:01.701524 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.notifications [None req-efad3a59-1ded-4d2d-8465-9fa17ae05dc8 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '27e1a70cf4034521a15f70aaf30d813c'} {{(pid=71939) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:357}} Nov 24 17:04:01.709650 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.notifications [None req-efad3a59-1ded-4d2d-8465-9fa17ae05dc8 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '27e1a70cf4034521a15f70aaf30d813c'} {{(pid=71939) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:357}} Nov 24 17:04:01.715896 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.notifications [None req-efad3a59-1ded-4d2d-8465-9fa17ae05dc8 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '27e1a70cf4034521a15f70aaf30d813c'} {{(pid=71939) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:357}} Nov 24 17:04:01.722063 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: [pid: 71939|app: 0|req: 1434/2855] 10.222.0.53 () {58 vars in 1214 bytes} [Wed Nov 24 17:04:01 2021] DELETE /identity/v3/users/27e1a70cf4034521a15f70aaf30d813c => generated 0 bytes in 189 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 24 17:04:01.726918 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8d4548d-0869-4c9c-a42e-d342e338a4a0 None None] REQUEST_METHOD: `POST` {{(pid=71938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 24 17:04:01.727267 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8d4548d-0869-4c9c-a42e-d342e338a4a0 None None] SCRIPT_NAME: `/identity` {{(pid=71938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 24 17:04:01.727603 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8d4548d-0869-4c9c-a42e-d342e338a4a0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=71938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 24 17:04:01.750981 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.auth.core [None req-e8d4548d-0869-4c9c-a42e-d342e338a4a0 None None] MFA Rules not processed for user `0f2ba2e8375b4e8c8792ee1e22b60427`. Rule list: `[]` (Enabled: `True`). {{(pid=71938) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:442}} Nov 24 17:04:01.752180 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.fernet_utils [None req-e8d4548d-0869-4c9c-a42e-d342e338a4a0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=71938) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:289}} Nov 24 17:04:01.818239 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: [pid: 71938|app: 0|req: 1422/2856] 10.222.0.53 () {58 vars in 948 bytes} [Wed Nov 24 17:04:01 2021] POST /identity/v3/auth/tokens => generated 3669 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 24 17:04:01.829228 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efad3a59-1ded-4d2d-8465-9fa17ae05dc8 admin admin] Authenticating user token {{(pid=71939) process_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 24 17:04:01.830691 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.fernet_utils [None req-efad3a59-1ded-4d2d-8465-9fa17ae05dc8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=71939) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:289}} Nov 24 17:04:01.897802 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efad3a59-1ded-4d2d-8465-9fa17ae05dc8 admin admin] Validating token access rules against request {{(pid=71939) validate_allowed_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 24 17:04:01.901601 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91795262-1b9b-4a50-b99f-769d2838d9f8 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c90f21b9cdcb413282461fa83cb6b7a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3b3940d4ae1c4177ae29c02377bb4b0b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=71939) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 24 17:04:01.902292 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91795262-1b9b-4a50-b99f-769d2838d9f8 service neutron] REQUEST_METHOD: `GET` {{(pid=71939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 24 17:04:01.902636 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91795262-1b9b-4a50-b99f-769d2838d9f8 service neutron] SCRIPT_NAME: `/identity` {{(pid=71939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 24 17:04:01.902974 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91795262-1b9b-4a50-b99f-769d2838d9f8 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=71939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 24 17:04:01.912925 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91795262-1b9b-4a50-b99f-769d2838d9f8 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=71939) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:442}} Nov 24 17:04:01.942386 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91795262-1b9b-4a50-b99f-769d2838d9f8 service neutron] RBAC: Authorization granted {{(pid=71939) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 24 17:04:01.952623 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: [pid: 71939|app: 0|req: 1435/2857] 10.222.0.53 () {60 vars in 1356 bytes} [Wed Nov 24 17:04:01 2021] GET /identity/v3/auth/tokens => generated 3669 bytes in 124 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 24 17:04:02.322985 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8d4548d-0869-4c9c-a42e-d342e338a4a0 None None] Authenticating user token {{(pid=71938) process_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 24 17:04:02.324528 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.fernet_utils [None req-e8d4548d-0869-4c9c-a42e-d342e338a4a0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=71938) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:289}} Nov 24 17:04:02.337961 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8d4548d-0869-4c9c-a42e-d342e338a4a0 None None] Validating token access rules against request {{(pid=71938) validate_allowed_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 24 17:04:02.343518 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3abc9d81-2a0e-448e-b21b-a1719a04422f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f2ba2e8375b4e8c8792ee1e22b60427', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '00a5583c7b7443e98e7a1d31a0b638dc', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=71938) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 24 17:04:02.344397 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3abc9d81-2a0e-448e-b21b-a1719a04422f admin admin] REQUEST_METHOD: `DELETE` {{(pid=71938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 24 17:04:02.344733 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3abc9d81-2a0e-448e-b21b-a1719a04422f admin admin] SCRIPT_NAME: `/identity` {{(pid=71938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 24 17:04:02.345062 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3abc9d81-2a0e-448e-b21b-a1719a04422f admin admin] PATH_INFO: `/v3/projects/f8127b083dff47719c4c9b65faf6b58c` {{(pid=71938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 24 17:04:02.346301 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3abc9d81-2a0e-448e-b21b-a1719a04422f admin admin] RBAC: Authorizing `identity:delete_project(project_id=f8127b083dff47719c4c9b65faf6b58c)` {{(pid=71938) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:442}} Nov 24 17:04:02.375642 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3abc9d81-2a0e-448e-b21b-a1719a04422f admin admin] RBAC: Authorization granted {{(pid=71938) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 24 17:04:02.425734 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.notifications [None req-3abc9d81-2a0e-448e-b21b-a1719a04422f admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f8127b083dff47719c4c9b65faf6b58c', 'request_id': 'req-3abc9d81-2a0e-448e-b21b-a1719a04422f'} {{(pid=71938) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:357}} Nov 24 17:04:02.437614 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.notifications [None req-3abc9d81-2a0e-448e-b21b-a1719a04422f admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f8127b083dff47719c4c9b65faf6b58c', 'request_id': 'req-3abc9d81-2a0e-448e-b21b-a1719a04422f'} {{(pid=71938) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:357}} Nov 24 17:04:02.442957 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.notifications [None req-3abc9d81-2a0e-448e-b21b-a1719a04422f admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f8127b083dff47719c4c9b65faf6b58c', 'request_id': 'req-3abc9d81-2a0e-448e-b21b-a1719a04422f'} {{(pid=71938) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:357}} Nov 24 17:04:02.454479 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.notifications [None req-3abc9d81-2a0e-448e-b21b-a1719a04422f admin admin] The token cache is being invalidate because project f8127b083dff47719c4c9b65faf6b58c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=71938) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Nov 24 17:04:02.454812 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.notifications [None req-3abc9d81-2a0e-448e-b21b-a1719a04422f admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=71938) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:357}} Nov 24 17:04:02.455528 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.notifications [None req-3abc9d81-2a0e-448e-b21b-a1719a04422f admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=71938) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:357}} Nov 24 17:04:02.457081 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: [pid: 71938|app: 0|req: 1423/2858] 10.222.0.53 () {58 vars in 1223 bytes} [Wed Nov 24 17:04:02 2021] DELETE /identity/v3/projects/f8127b083dff47719c4c9b65faf6b58c => generated 0 bytes in 135 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 24 17:04:02.461463 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91795262-1b9b-4a50-b99f-769d2838d9f8 service neutron] Authenticating user token {{(pid=71939) process_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 24 17:04:02.471778 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91795262-1b9b-4a50-b99f-769d2838d9f8 service neutron] Validating token access rules against request {{(pid=71939) validate_allowed_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 24 17:04:02.539135 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9f01e9a-de7a-4c2c-9bd9-0e1da41ba72c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f2ba2e8375b4e8c8792ee1e22b60427', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '00a5583c7b7443e98e7a1d31a0b638dc', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=71939) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 24 17:04:02.540048 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9f01e9a-de7a-4c2c-9bd9-0e1da41ba72c admin admin] REQUEST_METHOD: `DELETE` {{(pid=71939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 24 17:04:02.540441 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9f01e9a-de7a-4c2c-9bd9-0e1da41ba72c admin admin] SCRIPT_NAME: `/identity` {{(pid=71939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 24 17:04:02.541308 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9f01e9a-de7a-4c2c-9bd9-0e1da41ba72c admin admin] PATH_INFO: `/v3/users/1fe489dedf914ce396eae4cd9f24f18d` {{(pid=71939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 24 17:04:02.542578 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9f01e9a-de7a-4c2c-9bd9-0e1da41ba72c admin admin] RBAC: Authorizing `identity:delete_user(user_id=1fe489dedf914ce396eae4cd9f24f18d)` {{(pid=71939) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:442}} Nov 24 17:04:02.571468 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9f01e9a-de7a-4c2c-9bd9-0e1da41ba72c admin admin] RBAC: Authorization granted {{(pid=71939) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 24 17:04:02.619306 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.notifications [None req-d9f01e9a-de7a-4c2c-9bd9-0e1da41ba72c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '1fe489dedf914ce396eae4cd9f24f18d'} {{(pid=71939) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:357}} Nov 24 17:04:02.631464 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.notifications [None req-d9f01e9a-de7a-4c2c-9bd9-0e1da41ba72c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '1fe489dedf914ce396eae4cd9f24f18d'} {{(pid=71939) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:357}} Nov 24 17:04:02.632164 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.notifications [None req-d9f01e9a-de7a-4c2c-9bd9-0e1da41ba72c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '1fe489dedf914ce396eae4cd9f24f18d'} {{(pid=71939) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:357}} Nov 24 17:04:02.641084 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.notifications [None req-d9f01e9a-de7a-4c2c-9bd9-0e1da41ba72c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '1fe489dedf914ce396eae4cd9f24f18d'} {{(pid=71939) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:357}} Nov 24 17:04:02.647434 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.notifications [None req-d9f01e9a-de7a-4c2c-9bd9-0e1da41ba72c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '1fe489dedf914ce396eae4cd9f24f18d'} {{(pid=71939) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:357}} Nov 24 17:04:02.654507 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: [pid: 71939|app: 0|req: 1436/2859] 10.222.0.53 () {58 vars in 1214 bytes} [Wed Nov 24 17:04:02 2021] DELETE /identity/v3/users/1fe489dedf914ce396eae4cd9f24f18d => generated 0 bytes in 194 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 24 17:04:03.012956 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3abc9d81-2a0e-448e-b21b-a1719a04422f admin admin] Authenticating user token {{(pid=71938) process_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 24 17:04:03.014486 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.fernet_utils [None req-3abc9d81-2a0e-448e-b21b-a1719a04422f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=71938) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:289}} Nov 24 17:04:03.028124 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3abc9d81-2a0e-448e-b21b-a1719a04422f admin admin] Validating token access rules against request {{(pid=71938) validate_allowed_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 24 17:04:03.095456 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-310f678a-c6f4-4018-9f99-6a8d832d4618 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f2ba2e8375b4e8c8792ee1e22b60427', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '00a5583c7b7443e98e7a1d31a0b638dc', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=71938) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 24 17:04:03.096354 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-310f678a-c6f4-4018-9f99-6a8d832d4618 admin admin] REQUEST_METHOD: `DELETE` {{(pid=71938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 24 17:04:03.096693 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-310f678a-c6f4-4018-9f99-6a8d832d4618 admin admin] SCRIPT_NAME: `/identity` {{(pid=71938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 24 17:04:03.097025 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-310f678a-c6f4-4018-9f99-6a8d832d4618 admin admin] PATH_INFO: `/v3/projects/3a38d351a8624f6288ae8cdb4f6f70c3` {{(pid=71938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 24 17:04:03.098280 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-310f678a-c6f4-4018-9f99-6a8d832d4618 admin admin] RBAC: Authorizing `identity:delete_project(project_id=3a38d351a8624f6288ae8cdb4f6f70c3)` {{(pid=71938) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:442}} Nov 24 17:04:03.130100 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-310f678a-c6f4-4018-9f99-6a8d832d4618 admin admin] RBAC: Authorization granted {{(pid=71938) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 24 17:04:03.181833 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.notifications [None req-310f678a-c6f4-4018-9f99-6a8d832d4618 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '3a38d351a8624f6288ae8cdb4f6f70c3', 'request_id': 'req-310f678a-c6f4-4018-9f99-6a8d832d4618'} {{(pid=71938) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:357}} Nov 24 17:04:03.193842 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.notifications [None req-310f678a-c6f4-4018-9f99-6a8d832d4618 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '3a38d351a8624f6288ae8cdb4f6f70c3', 'request_id': 'req-310f678a-c6f4-4018-9f99-6a8d832d4618'} {{(pid=71938) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:357}} Nov 24 17:04:03.200046 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.notifications [None req-310f678a-c6f4-4018-9f99-6a8d832d4618 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '3a38d351a8624f6288ae8cdb4f6f70c3', 'request_id': 'req-310f678a-c6f4-4018-9f99-6a8d832d4618'} {{(pid=71938) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:357}} Nov 24 17:04:03.211922 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.notifications [None req-310f678a-c6f4-4018-9f99-6a8d832d4618 admin admin] The token cache is being invalidate because project 3a38d351a8624f6288ae8cdb4f6f70c3 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=71938) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Nov 24 17:04:03.212262 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.notifications [None req-310f678a-c6f4-4018-9f99-6a8d832d4618 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=71938) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:357}} Nov 24 17:04:03.212925 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.notifications [None req-310f678a-c6f4-4018-9f99-6a8d832d4618 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=71938) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:357}} Nov 24 17:04:03.214722 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: [pid: 71938|app: 0|req: 1424/2860] 10.222.0.53 () {58 vars in 1223 bytes} [Wed Nov 24 17:04:03 2021] DELETE /identity/v3/projects/3a38d351a8624f6288ae8cdb4f6f70c3 => generated 0 bytes in 202 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 24 17:04:03.220962 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6463d77-87de-47de-a763-44289a4b14dd None None] REQUEST_METHOD: `POST` {{(pid=71939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 24 17:04:03.221327 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6463d77-87de-47de-a763-44289a4b14dd None None] SCRIPT_NAME: `/identity` {{(pid=71939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 24 17:04:03.221667 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6463d77-87de-47de-a763-44289a4b14dd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=71939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 24 17:04:03.245888 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.auth.core [None req-d6463d77-87de-47de-a763-44289a4b14dd None None] MFA Rules not processed for user `0f2ba2e8375b4e8c8792ee1e22b60427`. Rule list: `[]` (Enabled: `True`). {{(pid=71939) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:442}} Nov 24 17:04:03.247148 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.fernet_utils [None req-d6463d77-87de-47de-a763-44289a4b14dd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=71939) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:289}} Nov 24 17:04:03.317433 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: [pid: 71939|app: 0|req: 1437/2861] 10.222.0.53 () {58 vars in 948 bytes} [Wed Nov 24 17:04:03 2021] POST /identity/v3/auth/tokens => generated 3669 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 24 17:04:03.326366 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b4f3295-e78e-4c9c-b5e3-6123041e50a2 None None] REQUEST_METHOD: `POST` {{(pid=71938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 24 17:04:03.326717 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b4f3295-e78e-4c9c-b5e3-6123041e50a2 None None] SCRIPT_NAME: `/identity` {{(pid=71938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 24 17:04:03.327053 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b4f3295-e78e-4c9c-b5e3-6123041e50a2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=71938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 24 17:04:03.350912 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.auth.core [None req-4b4f3295-e78e-4c9c-b5e3-6123041e50a2 None None] MFA Rules not processed for user `0f2ba2e8375b4e8c8792ee1e22b60427`. Rule list: `[]` (Enabled: `True`). {{(pid=71938) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:442}} Nov 24 17:04:03.352117 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.fernet_utils [None req-4b4f3295-e78e-4c9c-b5e3-6123041e50a2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=71938) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:289}} Nov 24 17:04:03.359582 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: [pid: 71938|app: 0|req: 1425/2862] 10.222.0.53 () {58 vars in 948 bytes} [Wed Nov 24 17:04:03 2021] POST /identity/v3/auth/tokens => generated 3669 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 24 17:04:03.363912 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6463d77-87de-47de-a763-44289a4b14dd None None] Authenticating user token {{(pid=71939) process_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 24 17:04:03.374134 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6463d77-87de-47de-a763-44289a4b14dd None None] Validating token access rules against request {{(pid=71939) validate_allowed_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 24 17:04:03.378607 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62334e9d-75c5-4acc-8f15-ab9bb805407e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f2ba2e8375b4e8c8792ee1e22b60427', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '00a5583c7b7443e98e7a1d31a0b638dc', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=71939) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 24 17:04:03.379298 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62334e9d-75c5-4acc-8f15-ab9bb805407e admin admin] REQUEST_METHOD: `GET` {{(pid=71939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 24 17:04:03.379615 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62334e9d-75c5-4acc-8f15-ab9bb805407e admin admin] SCRIPT_NAME: `/identity` {{(pid=71939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 24 17:04:03.379948 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62334e9d-75c5-4acc-8f15-ab9bb805407e admin admin] PATH_INFO: `/v3/domains` {{(pid=71939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 24 17:04:03.380739 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62334e9d-75c5-4acc-8f15-ab9bb805407e admin admin] RBAC: Adding query filter params (name=Default) {{(pid=71939) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:161}} Nov 24 17:04:03.381092 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62334e9d-75c5-4acc-8f15-ab9bb805407e admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=71939) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:442}} Nov 24 17:04:03.414194 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62334e9d-75c5-4acc-8f15-ab9bb805407e admin admin] RBAC: Authorization granted {{(pid=71939) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 24 17:04:03.428380 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: [pid: 71939|app: 0|req: 1438/2863] 10.222.0.53 () {58 vars in 1143 bytes} [Wed Nov 24 17:04:03 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 65 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 24 17:04:03.433709 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b4f3295-e78e-4c9c-b5e3-6123041e50a2 None None] Authenticating user token {{(pid=71938) process_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 24 17:04:03.443048 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b4f3295-e78e-4c9c-b5e3-6123041e50a2 None None] Validating token access rules against request {{(pid=71938) validate_allowed_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 24 17:04:03.447718 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b4fae49-13c6-4bb5-95ba-9a60c4af18e6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f2ba2e8375b4e8c8792ee1e22b60427', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '00a5583c7b7443e98e7a1d31a0b638dc', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=71938) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 24 17:04:03.448327 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b4fae49-13c6-4bb5-95ba-9a60c4af18e6 admin admin] REQUEST_METHOD: `POST` {{(pid=71938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 24 17:04:03.448666 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b4fae49-13c6-4bb5-95ba-9a60c4af18e6 admin admin] SCRIPT_NAME: `/identity` {{(pid=71938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 24 17:04:03.448998 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b4fae49-13c6-4bb5-95ba-9a60c4af18e6 admin admin] PATH_INFO: `/v3/projects` {{(pid=71938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 24 17:04:03.449732 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b4fae49-13c6-4bb5-95ba-9a60c4af18e6 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=71938) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:442}} Nov 24 17:04:03.478726 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b4fae49-13c6-4bb5-95ba-9a60c4af18e6 admin admin] RBAC: Authorization granted {{(pid=71938) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 24 17:04:03.506685 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: [pid: 71938|app: 0|req: 1426/2864] 10.222.0.53 () {60 vars in 1143 bytes} [Wed Nov 24 17:04:03 2021] POST /identity/v3/projects => generated 375 bytes in 73 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 24 17:04:03.511110 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62334e9d-75c5-4acc-8f15-ab9bb805407e admin admin] Authenticating user token {{(pid=71939) process_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 24 17:04:03.521137 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62334e9d-75c5-4acc-8f15-ab9bb805407e admin admin] Validating token access rules against request {{(pid=71939) validate_allowed_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 24 17:04:03.585892 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b378bbe2-1d9e-4c8a-93a0-73cc7f472bb1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f2ba2e8375b4e8c8792ee1e22b60427', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '00a5583c7b7443e98e7a1d31a0b638dc', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=71939) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 24 17:04:03.586609 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b378bbe2-1d9e-4c8a-93a0-73cc7f472bb1 admin admin] REQUEST_METHOD: `POST` {{(pid=71939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 24 17:04:03.586946 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b378bbe2-1d9e-4c8a-93a0-73cc7f472bb1 admin admin] SCRIPT_NAME: `/identity` {{(pid=71939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 24 17:04:03.587338 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b378bbe2-1d9e-4c8a-93a0-73cc7f472bb1 admin admin] PATH_INFO: `/v3/users` {{(pid=71939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 24 17:04:03.588048 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b378bbe2-1d9e-4c8a-93a0-73cc7f472bb1 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=71939) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:442}} Nov 24 17:04:03.616596 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b378bbe2-1d9e-4c8a-93a0-73cc7f472bb1 admin admin] RBAC: Authorization granted {{(pid=71939) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 24 17:04:03.635196 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: [pid: 71939|app: 0|req: 1439/2865] 10.222.0.53 () {60 vars in 1134 bytes} [Wed Nov 24 17:04:03 2021] POST /identity/v3/users => generated 288 bytes in 125 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 24 17:04:03.639550 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b4fae49-13c6-4bb5-95ba-9a60c4af18e6 admin admin] Authenticating user token {{(pid=71938) process_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 24 17:04:03.650094 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b4fae49-13c6-4bb5-95ba-9a60c4af18e6 admin admin] Validating token access rules against request {{(pid=71938) validate_allowed_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 24 17:04:03.654625 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31a393fb-72e3-4170-8e3f-03f25592e72e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f2ba2e8375b4e8c8792ee1e22b60427', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '00a5583c7b7443e98e7a1d31a0b638dc', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=71938) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 24 17:04:03.655290 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31a393fb-72e3-4170-8e3f-03f25592e72e admin admin] REQUEST_METHOD: `GET` {{(pid=71938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 24 17:04:03.655628 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31a393fb-72e3-4170-8e3f-03f25592e72e admin admin] SCRIPT_NAME: `/identity` {{(pid=71938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 24 17:04:03.655977 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31a393fb-72e3-4170-8e3f-03f25592e72e admin admin] PATH_INFO: `/v3/roles` {{(pid=71938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 24 17:04:03.656741 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31a393fb-72e3-4170-8e3f-03f25592e72e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=71938) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:442}} Nov 24 17:04:03.685883 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31a393fb-72e3-4170-8e3f-03f25592e72e admin admin] RBAC: Authorization granted {{(pid=71938) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 24 17:04:03.696511 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: [pid: 71938|app: 0|req: 1427/2866] 10.222.0.53 () {58 vars in 1112 bytes} [Wed Nov 24 17:04:03 2021] GET /identity/v3/roles => generated 1420 bytes in 57 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 24 17:04:03.700771 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b378bbe2-1d9e-4c8a-93a0-73cc7f472bb1 admin admin] Authenticating user token {{(pid=71939) process_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 24 17:04:03.710727 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b378bbe2-1d9e-4c8a-93a0-73cc7f472bb1 admin admin] Validating token access rules against request {{(pid=71939) validate_allowed_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 24 17:04:03.715230 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1be7bc87-fac2-48a5-8a82-a4320f5b7a34 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f2ba2e8375b4e8c8792ee1e22b60427', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '00a5583c7b7443e98e7a1d31a0b638dc', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=71939) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 24 17:04:03.716120 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1be7bc87-fac2-48a5-8a82-a4320f5b7a34 admin admin] REQUEST_METHOD: `PUT` {{(pid=71939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 24 17:04:03.716459 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1be7bc87-fac2-48a5-8a82-a4320f5b7a34 admin admin] SCRIPT_NAME: `/identity` {{(pid=71939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 24 17:04:03.716793 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1be7bc87-fac2-48a5-8a82-a4320f5b7a34 admin admin] PATH_INFO: `/v3/projects/a2c362aa776c4e128f908114ba5cc909/users/36bff3be7db44396af82889caee0d477/roles/912ab5f10fa5477da74acf239f07604e` {{(pid=71939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 24 17:04:03.737594 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1be7bc87-fac2-48a5-8a82-a4320f5b7a34 admin admin] RBAC: Authorizing `identity:create_grant(project_id=a2c362aa776c4e128f908114ba5cc909, user_id=36bff3be7db44396af82889caee0d477, role_id=912ab5f10fa5477da74acf239f07604e)` {{(pid=71939) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:442}} Nov 24 17:04:03.767003 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1be7bc87-fac2-48a5-8a82-a4320f5b7a34 admin admin] RBAC: Authorization granted {{(pid=71939) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 24 17:04:03.778998 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: [pid: 71939|app: 0|req: 1440/2867] 10.222.0.53 () {60 vars in 1473 bytes} [Wed Nov 24 17:04:03 2021] PUT /identity/v3/projects/a2c362aa776c4e128f908114ba5cc909/users/36bff3be7db44396af82889caee0d477/roles/912ab5f10fa5477da74acf239f07604e => generated 0 bytes in 79 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 24 17:04:03.791350 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d0dedc2-9c31-4885-889b-ff5c695593e9 None None] REQUEST_METHOD: `POST` {{(pid=71938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 24 17:04:03.791693 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d0dedc2-9c31-4885-889b-ff5c695593e9 None None] SCRIPT_NAME: `/identity` {{(pid=71938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 24 17:04:03.792025 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d0dedc2-9c31-4885-889b-ff5c695593e9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=71938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 24 17:04:03.829372 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.auth.core [None req-8d0dedc2-9c31-4885-889b-ff5c695593e9 None None] MFA Rules not processed for user `36bff3be7db44396af82889caee0d477`. Rule list: `[]` (Enabled: `True`). {{(pid=71938) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:442}} Nov 24 17:04:03.830607 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.fernet_utils [None req-8d0dedc2-9c31-4885-889b-ff5c695593e9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=71938) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:289}} Nov 24 17:04:03.905958 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: [pid: 71938|app: 0|req: 1428/2868] 10.222.0.53 () {58 vars in 948 bytes} [Wed Nov 24 17:04:03 2021] POST /identity/v3/auth/tokens => generated 3682 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 24 17:04:03.916735 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1be7bc87-fac2-48a5-8a82-a4320f5b7a34 admin admin] Authenticating user token {{(pid=71939) process_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 24 17:04:03.918497 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.fernet_utils [None req-1be7bc87-fac2-48a5-8a82-a4320f5b7a34 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=71939) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:289}} Nov 24 17:04:03.985210 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1be7bc87-fac2-48a5-8a82-a4320f5b7a34 admin admin] Validating token access rules against request {{(pid=71939) validate_allowed_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 24 17:04:03.988747 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b7eb8b4-5881-44d2-9c32-074ee3ea2540 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a12374a3093a401a97c343ff0854184d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3b3940d4ae1c4177ae29c02377bb4b0b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=71939) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 24 17:04:03.989393 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b7eb8b4-5881-44d2-9c32-074ee3ea2540 service cinder] REQUEST_METHOD: `GET` {{(pid=71939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 24 17:04:03.989729 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b7eb8b4-5881-44d2-9c32-074ee3ea2540 service cinder] SCRIPT_NAME: `/identity` {{(pid=71939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 24 17:04:03.990076 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b7eb8b4-5881-44d2-9c32-074ee3ea2540 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=71939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 24 17:04:03.998666 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b7eb8b4-5881-44d2-9c32-074ee3ea2540 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=71939) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:442}} Nov 24 17:04:04.026720 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b7eb8b4-5881-44d2-9c32-074ee3ea2540 service cinder] RBAC: Authorization granted {{(pid=71939) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 24 17:04:04.035873 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: [pid: 71939|app: 0|req: 1441/2869] 10.222.0.53 () {60 vars in 1356 bytes} [Wed Nov 24 17:04:03 2021] GET /identity/v3/auth/tokens => generated 3682 bytes in 120 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 24 17:04:07.893040 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d0dedc2-9c31-4885-889b-ff5c695593e9 None None] Authenticating user token {{(pid=71938) process_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 24 17:04:07.965348 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d0dedc2-9c31-4885-889b-ff5c695593e9 None None] Validating token access rules against request {{(pid=71938) validate_allowed_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 24 17:04:07.969798 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82560269-dc37-4763-b5dc-3ab803008d46 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f2ba2e8375b4e8c8792ee1e22b60427', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '00a5583c7b7443e98e7a1d31a0b638dc', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=71938) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 24 17:04:07.970709 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82560269-dc37-4763-b5dc-3ab803008d46 admin admin] REQUEST_METHOD: `DELETE` {{(pid=71938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 24 17:04:07.971044 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82560269-dc37-4763-b5dc-3ab803008d46 admin admin] SCRIPT_NAME: `/identity` {{(pid=71938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 24 17:04:07.971373 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82560269-dc37-4763-b5dc-3ab803008d46 admin admin] PATH_INFO: `/v3/users/36bff3be7db44396af82889caee0d477` {{(pid=71938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 24 17:04:07.972573 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82560269-dc37-4763-b5dc-3ab803008d46 admin admin] RBAC: Authorizing `identity:delete_user(user_id=36bff3be7db44396af82889caee0d477)` {{(pid=71938) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:442}} Nov 24 17:04:08.001106 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82560269-dc37-4763-b5dc-3ab803008d46 admin admin] RBAC: Authorization granted {{(pid=71938) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 24 17:04:08.049879 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.notifications [None req-82560269-dc37-4763-b5dc-3ab803008d46 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '36bff3be7db44396af82889caee0d477'} {{(pid=71938) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:357}} Nov 24 17:04:08.062277 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.notifications [None req-82560269-dc37-4763-b5dc-3ab803008d46 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '36bff3be7db44396af82889caee0d477'} {{(pid=71938) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:357}} Nov 24 17:04:08.062972 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.notifications [None req-82560269-dc37-4763-b5dc-3ab803008d46 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '36bff3be7db44396af82889caee0d477'} {{(pid=71938) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:357}} Nov 24 17:04:08.071008 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.notifications [None req-82560269-dc37-4763-b5dc-3ab803008d46 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '36bff3be7db44396af82889caee0d477'} {{(pid=71938) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:357}} Nov 24 17:04:08.077264 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.notifications [None req-82560269-dc37-4763-b5dc-3ab803008d46 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '36bff3be7db44396af82889caee0d477'} {{(pid=71938) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:357}} Nov 24 17:04:08.083750 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: [pid: 71938|app: 0|req: 1429/2870] 10.222.0.53 () {58 vars in 1214 bytes} [Wed Nov 24 17:04:07 2021] DELETE /identity/v3/users/36bff3be7db44396af82889caee0d477 => generated 0 bytes in 191 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 24 17:04:08.089202 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76b84e8c-715c-4d65-9a8c-c4497fea9394 None None] REQUEST_METHOD: `POST` {{(pid=71939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 24 17:04:08.089559 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76b84e8c-715c-4d65-9a8c-c4497fea9394 None None] SCRIPT_NAME: `/identity` {{(pid=71939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 24 17:04:08.089904 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76b84e8c-715c-4d65-9a8c-c4497fea9394 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=71939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 24 17:04:08.113959 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.auth.core [None req-76b84e8c-715c-4d65-9a8c-c4497fea9394 None None] MFA Rules not processed for user `0f2ba2e8375b4e8c8792ee1e22b60427`. Rule list: `[]` (Enabled: `True`). {{(pid=71939) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:442}} Nov 24 17:04:08.115167 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.fernet_utils [None req-76b84e8c-715c-4d65-9a8c-c4497fea9394 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=71939) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:289}} Nov 24 17:04:08.183481 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: [pid: 71939|app: 0|req: 1442/2871] 10.222.0.53 () {58 vars in 948 bytes} [Wed Nov 24 17:04:08 2021] POST /identity/v3/auth/tokens => generated 3669 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 24 17:04:08.194799 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82560269-dc37-4763-b5dc-3ab803008d46 admin admin] Authenticating user token {{(pid=71938) process_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 24 17:04:08.196253 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.fernet_utils [None req-82560269-dc37-4763-b5dc-3ab803008d46 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=71938) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:289}} Nov 24 17:04:08.264819 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82560269-dc37-4763-b5dc-3ab803008d46 admin admin] Validating token access rules against request {{(pid=71938) validate_allowed_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 24 17:04:08.268490 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33c8b8da-5bab-48ee-a429-80878dc46190 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c90f21b9cdcb413282461fa83cb6b7a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3b3940d4ae1c4177ae29c02377bb4b0b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=71938) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 24 17:04:08.269155 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33c8b8da-5bab-48ee-a429-80878dc46190 service neutron] REQUEST_METHOD: `GET` {{(pid=71938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 24 17:04:08.269500 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33c8b8da-5bab-48ee-a429-80878dc46190 service neutron] SCRIPT_NAME: `/identity` {{(pid=71938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 24 17:04:08.269835 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33c8b8da-5bab-48ee-a429-80878dc46190 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=71938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 24 17:04:08.279850 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33c8b8da-5bab-48ee-a429-80878dc46190 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=71938) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:442}} Nov 24 17:04:08.308626 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33c8b8da-5bab-48ee-a429-80878dc46190 service neutron] RBAC: Authorization granted {{(pid=71938) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 24 17:04:08.318354 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: [pid: 71938|app: 0|req: 1430/2872] 10.222.0.53 () {60 vars in 1356 bytes} [Wed Nov 24 17:04:08 2021] GET /identity/v3/auth/tokens => generated 3669 bytes in 124 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Nov 24 17:04:08.686383 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76b84e8c-715c-4d65-9a8c-c4497fea9394 None None] Authenticating user token {{(pid=71939) process_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 24 17:04:08.687868 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.fernet_utils [None req-76b84e8c-715c-4d65-9a8c-c4497fea9394 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=71939) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:289}} Nov 24 17:04:08.701707 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76b84e8c-715c-4d65-9a8c-c4497fea9394 None None] Validating token access rules against request {{(pid=71939) validate_allowed_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 24 17:04:08.706543 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2fc54f4-9d4d-4431-a948-84304c1db767 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f2ba2e8375b4e8c8792ee1e22b60427', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '00a5583c7b7443e98e7a1d31a0b638dc', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=71939) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 24 17:04:08.707425 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2fc54f4-9d4d-4431-a948-84304c1db767 admin admin] REQUEST_METHOD: `DELETE` {{(pid=71939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 24 17:04:08.707767 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2fc54f4-9d4d-4431-a948-84304c1db767 admin admin] SCRIPT_NAME: `/identity` {{(pid=71939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 24 17:04:08.708104 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2fc54f4-9d4d-4431-a948-84304c1db767 admin admin] PATH_INFO: `/v3/projects/a2c362aa776c4e128f908114ba5cc909` {{(pid=71939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 24 17:04:08.709334 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2fc54f4-9d4d-4431-a948-84304c1db767 admin admin] RBAC: Authorizing `identity:delete_project(project_id=a2c362aa776c4e128f908114ba5cc909)` {{(pid=71939) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:442}} Nov 24 17:04:08.738405 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2fc54f4-9d4d-4431-a948-84304c1db767 admin admin] RBAC: Authorization granted {{(pid=71939) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 24 17:04:08.794040 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.notifications [None req-f2fc54f4-9d4d-4431-a948-84304c1db767 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a2c362aa776c4e128f908114ba5cc909', 'request_id': 'req-f2fc54f4-9d4d-4431-a948-84304c1db767'} {{(pid=71939) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:357}} Nov 24 17:04:08.805922 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.notifications [None req-f2fc54f4-9d4d-4431-a948-84304c1db767 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a2c362aa776c4e128f908114ba5cc909', 'request_id': 'req-f2fc54f4-9d4d-4431-a948-84304c1db767'} {{(pid=71939) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:357}} Nov 24 17:04:08.812330 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.notifications [None req-f2fc54f4-9d4d-4431-a948-84304c1db767 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a2c362aa776c4e128f908114ba5cc909', 'request_id': 'req-f2fc54f4-9d4d-4431-a948-84304c1db767'} {{(pid=71939) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:357}} Nov 24 17:04:08.823220 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.notifications [None req-f2fc54f4-9d4d-4431-a948-84304c1db767 admin admin] The token cache is being invalidate because project a2c362aa776c4e128f908114ba5cc909 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=71939) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Nov 24 17:04:08.823552 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.notifications [None req-f2fc54f4-9d4d-4431-a948-84304c1db767 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=71939) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:357}} Nov 24 17:04:08.824220 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.notifications [None req-f2fc54f4-9d4d-4431-a948-84304c1db767 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=71939) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:357}} Nov 24 17:04:08.825773 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: [pid: 71939|app: 0|req: 1443/2873] 10.222.0.53 () {58 vars in 1223 bytes} [Wed Nov 24 17:04:08 2021] DELETE /identity/v3/projects/a2c362aa776c4e128f908114ba5cc909 => generated 0 bytes in 140 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 24 17:04:08.832108 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-868782a0-0428-4f81-aaca-d490972dff99 None None] REQUEST_METHOD: `POST` {{(pid=71938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 24 17:04:08.832460 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-868782a0-0428-4f81-aaca-d490972dff99 None None] SCRIPT_NAME: `/identity` {{(pid=71938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 24 17:04:08.832801 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-868782a0-0428-4f81-aaca-d490972dff99 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=71938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 24 17:04:08.858610 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.auth.core [None req-868782a0-0428-4f81-aaca-d490972dff99 None None] MFA Rules not processed for user `0f2ba2e8375b4e8c8792ee1e22b60427`. Rule list: `[]` (Enabled: `True`). {{(pid=71938) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:442}} Nov 24 17:04:08.859861 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.fernet_utils [None req-868782a0-0428-4f81-aaca-d490972dff99 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=71938) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:289}} Nov 24 17:04:08.944477 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: [pid: 71938|app: 0|req: 1431/2874] 10.222.0.53 () {58 vars in 948 bytes} [Wed Nov 24 17:04:08 2021] POST /identity/v3/auth/tokens => generated 3669 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 24 17:04:08.953339 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b47a4633-4b97-4e07-93da-9aef1cc736d4 None None] REQUEST_METHOD: `POST` {{(pid=71939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 24 17:04:08.953686 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b47a4633-4b97-4e07-93da-9aef1cc736d4 None None] SCRIPT_NAME: `/identity` {{(pid=71939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 24 17:04:08.954018 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b47a4633-4b97-4e07-93da-9aef1cc736d4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=71939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 24 17:04:08.979970 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.auth.core [None req-b47a4633-4b97-4e07-93da-9aef1cc736d4 None None] MFA Rules not processed for user `0f2ba2e8375b4e8c8792ee1e22b60427`. Rule list: `[]` (Enabled: `True`). {{(pid=71939) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:442}} Nov 24 17:04:08.981205 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.fernet_utils [None req-b47a4633-4b97-4e07-93da-9aef1cc736d4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=71939) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:289}} Nov 24 17:04:08.988889 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: [pid: 71939|app: 0|req: 1444/2875] 10.222.0.53 () {58 vars in 948 bytes} [Wed Nov 24 17:04:08 2021] POST /identity/v3/auth/tokens => generated 3669 bytes in 37 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 24 17:04:08.993168 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-868782a0-0428-4f81-aaca-d490972dff99 None None] Authenticating user token {{(pid=71938) process_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 24 17:04:09.002972 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-868782a0-0428-4f81-aaca-d490972dff99 None None] Validating token access rules against request {{(pid=71938) validate_allowed_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 24 17:04:09.007555 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5f04e6e-1bbd-44e4-b59a-c6dbd20acb6e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f2ba2e8375b4e8c8792ee1e22b60427', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '00a5583c7b7443e98e7a1d31a0b638dc', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=71938) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 24 17:04:09.008219 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5f04e6e-1bbd-44e4-b59a-c6dbd20acb6e admin admin] REQUEST_METHOD: `GET` {{(pid=71938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 24 17:04:09.008558 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5f04e6e-1bbd-44e4-b59a-c6dbd20acb6e admin admin] SCRIPT_NAME: `/identity` {{(pid=71938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 24 17:04:09.008897 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5f04e6e-1bbd-44e4-b59a-c6dbd20acb6e admin admin] PATH_INFO: `/v3/domains` {{(pid=71938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 24 17:04:09.010230 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5f04e6e-1bbd-44e4-b59a-c6dbd20acb6e admin admin] RBAC: Adding query filter params (name=Default) {{(pid=71938) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:161}} Nov 24 17:04:09.010585 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5f04e6e-1bbd-44e4-b59a-c6dbd20acb6e admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=71938) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:442}} Nov 24 17:04:09.039182 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5f04e6e-1bbd-44e4-b59a-c6dbd20acb6e admin admin] RBAC: Authorization granted {{(pid=71938) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 24 17:04:09.052689 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: [pid: 71938|app: 0|req: 1432/2876] 10.222.0.53 () {58 vars in 1143 bytes} [Wed Nov 24 17:04:08 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 60 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 24 17:04:09.057938 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b47a4633-4b97-4e07-93da-9aef1cc736d4 None None] Authenticating user token {{(pid=71939) process_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 24 17:04:09.067614 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b47a4633-4b97-4e07-93da-9aef1cc736d4 None None] Validating token access rules against request {{(pid=71939) validate_allowed_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 24 17:04:09.072810 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85844771-98f5-4d73-96b0-24ab19f0abba admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f2ba2e8375b4e8c8792ee1e22b60427', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '00a5583c7b7443e98e7a1d31a0b638dc', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=71939) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 24 17:04:09.073476 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85844771-98f5-4d73-96b0-24ab19f0abba admin admin] REQUEST_METHOD: `POST` {{(pid=71939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 24 17:04:09.073845 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85844771-98f5-4d73-96b0-24ab19f0abba admin admin] SCRIPT_NAME: `/identity` {{(pid=71939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 24 17:04:09.074213 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85844771-98f5-4d73-96b0-24ab19f0abba admin admin] PATH_INFO: `/v3/projects` {{(pid=71939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 24 17:04:09.074943 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85844771-98f5-4d73-96b0-24ab19f0abba admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=71939) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:442}} Nov 24 17:04:09.103217 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85844771-98f5-4d73-96b0-24ab19f0abba admin admin] RBAC: Authorization granted {{(pid=71939) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 24 17:04:09.130550 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: [pid: 71939|app: 0|req: 1445/2877] 10.222.0.53 () {60 vars in 1143 bytes} [Wed Nov 24 17:04:09 2021] POST /identity/v3/projects => generated 375 bytes in 73 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 24 17:04:09.135556 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5f04e6e-1bbd-44e4-b59a-c6dbd20acb6e admin admin] Authenticating user token {{(pid=71938) process_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 24 17:04:09.145581 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5f04e6e-1bbd-44e4-b59a-c6dbd20acb6e admin admin] Validating token access rules against request {{(pid=71938) validate_allowed_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 24 17:04:09.217266 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c99562e-d1dc-4d5b-abfe-2eaf33a9d676 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f2ba2e8375b4e8c8792ee1e22b60427', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '00a5583c7b7443e98e7a1d31a0b638dc', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=71938) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 24 17:04:09.217881 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c99562e-d1dc-4d5b-abfe-2eaf33a9d676 admin admin] REQUEST_METHOD: `POST` {{(pid=71938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 24 17:04:09.218246 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c99562e-d1dc-4d5b-abfe-2eaf33a9d676 admin admin] SCRIPT_NAME: `/identity` {{(pid=71938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 24 17:04:09.218837 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c99562e-d1dc-4d5b-abfe-2eaf33a9d676 admin admin] PATH_INFO: `/v3/users` {{(pid=71938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 24 17:04:09.219557 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c99562e-d1dc-4d5b-abfe-2eaf33a9d676 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=71938) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:442}} Nov 24 17:04:09.249012 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c99562e-d1dc-4d5b-abfe-2eaf33a9d676 admin admin] RBAC: Authorization granted {{(pid=71938) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 24 17:04:09.273976 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: [pid: 71938|app: 0|req: 1433/2878] 10.222.0.53 () {60 vars in 1134 bytes} [Wed Nov 24 17:04:09 2021] POST /identity/v3/users => generated 288 bytes in 136 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Nov 24 17:04:09.275373 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85844771-98f5-4d73-96b0-24ab19f0abba admin admin] Authenticating user token {{(pid=71939) process_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 24 17:04:09.285725 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85844771-98f5-4d73-96b0-24ab19f0abba admin admin] Validating token access rules against request {{(pid=71939) validate_allowed_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 24 17:04:09.290677 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcba9dab-bab7-4c69-8e7f-761db8bcdf03 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f2ba2e8375b4e8c8792ee1e22b60427', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '00a5583c7b7443e98e7a1d31a0b638dc', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=71939) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 24 17:04:09.291435 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcba9dab-bab7-4c69-8e7f-761db8bcdf03 admin admin] REQUEST_METHOD: `GET` {{(pid=71939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 24 17:04:09.291780 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcba9dab-bab7-4c69-8e7f-761db8bcdf03 admin admin] SCRIPT_NAME: `/identity` {{(pid=71939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 24 17:04:09.292117 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcba9dab-bab7-4c69-8e7f-761db8bcdf03 admin admin] PATH_INFO: `/v3/roles` {{(pid=71939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 24 17:04:09.292914 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcba9dab-bab7-4c69-8e7f-761db8bcdf03 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=71939) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:442}} Nov 24 17:04:09.321726 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcba9dab-bab7-4c69-8e7f-761db8bcdf03 admin admin] RBAC: Authorization granted {{(pid=71939) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 24 17:04:09.334104 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: [pid: 71939|app: 0|req: 1446/2879] 10.222.0.53 () {58 vars in 1112 bytes} [Wed Nov 24 17:04:09 2021] GET /identity/v3/roles => generated 1420 bytes in 59 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 24 17:04:09.338665 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c99562e-d1dc-4d5b-abfe-2eaf33a9d676 admin admin] Authenticating user token {{(pid=71938) process_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 24 17:04:09.348985 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c99562e-d1dc-4d5b-abfe-2eaf33a9d676 admin admin] Validating token access rules against request {{(pid=71938) validate_allowed_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 24 17:04:09.353554 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e87cb215-1c91-48d8-8130-f447df6b7010 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f2ba2e8375b4e8c8792ee1e22b60427', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '00a5583c7b7443e98e7a1d31a0b638dc', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=71938) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 24 17:04:09.354515 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e87cb215-1c91-48d8-8130-f447df6b7010 admin admin] REQUEST_METHOD: `PUT` {{(pid=71938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 24 17:04:09.354849 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e87cb215-1c91-48d8-8130-f447df6b7010 admin admin] SCRIPT_NAME: `/identity` {{(pid=71938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 24 17:04:09.355180 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e87cb215-1c91-48d8-8130-f447df6b7010 admin admin] PATH_INFO: `/v3/projects/f6ae79da9496495199607d5000565a02/users/fdb23d2aacb64f189de1cf268d85fe46/roles/912ab5f10fa5477da74acf239f07604e` {{(pid=71938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 24 17:04:09.376410 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e87cb215-1c91-48d8-8130-f447df6b7010 admin admin] RBAC: Authorizing `identity:create_grant(project_id=f6ae79da9496495199607d5000565a02, user_id=fdb23d2aacb64f189de1cf268d85fe46, role_id=912ab5f10fa5477da74acf239f07604e)` {{(pid=71938) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:442}} Nov 24 17:04:09.405997 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e87cb215-1c91-48d8-8130-f447df6b7010 admin admin] RBAC: Authorization granted {{(pid=71938) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 24 17:04:09.418583 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: [pid: 71938|app: 0|req: 1434/2880] 10.222.0.53 () {60 vars in 1473 bytes} [Wed Nov 24 17:04:09 2021] PUT /identity/v3/projects/f6ae79da9496495199607d5000565a02/users/fdb23d2aacb64f189de1cf268d85fe46/roles/912ab5f10fa5477da74acf239f07604e => generated 0 bytes in 81 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 24 17:04:09.429419 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a55d34dd-b347-4fb4-97fe-ed51174362d8 None None] REQUEST_METHOD: `POST` {{(pid=71939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 24 17:04:09.429777 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a55d34dd-b347-4fb4-97fe-ed51174362d8 None None] SCRIPT_NAME: `/identity` {{(pid=71939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 24 17:04:09.430169 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a55d34dd-b347-4fb4-97fe-ed51174362d8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=71939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 24 17:04:09.468516 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.auth.core [None req-a55d34dd-b347-4fb4-97fe-ed51174362d8 None None] MFA Rules not processed for user `fdb23d2aacb64f189de1cf268d85fe46`. Rule list: `[]` (Enabled: `True`). {{(pid=71939) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:442}} Nov 24 17:04:09.469678 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.fernet_utils [None req-a55d34dd-b347-4fb4-97fe-ed51174362d8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=71939) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:289}} Nov 24 17:04:09.544451 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: [pid: 71939|app: 0|req: 1447/2881] 10.222.0.53 () {58 vars in 948 bytes} [Wed Nov 24 17:04:09 2021] POST /identity/v3/auth/tokens => generated 3682 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 24 17:04:09.549604 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e87cb215-1c91-48d8-8130-f447df6b7010 admin admin] Authenticating user token {{(pid=71938) process_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 24 17:04:09.622516 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e87cb215-1c91-48d8-8130-f447df6b7010 admin admin] Validating token access rules against request {{(pid=71938) validate_allowed_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 24 17:04:09.627143 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5f7df3e-38a4-40d5-b350-25f48ffefdf8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f2ba2e8375b4e8c8792ee1e22b60427', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '00a5583c7b7443e98e7a1d31a0b638dc', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=71938) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 24 17:04:09.627816 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5f7df3e-38a4-40d5-b350-25f48ffefdf8 admin admin] REQUEST_METHOD: `POST` {{(pid=71938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 24 17:04:09.628159 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5f7df3e-38a4-40d5-b350-25f48ffefdf8 admin admin] SCRIPT_NAME: `/identity` {{(pid=71938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 24 17:04:09.628495 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5f7df3e-38a4-40d5-b350-25f48ffefdf8 admin admin] PATH_INFO: `/v3/projects` {{(pid=71938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 24 17:04:09.629227 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5f7df3e-38a4-40d5-b350-25f48ffefdf8 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=71938) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:442}} Nov 24 17:04:09.658539 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5f7df3e-38a4-40d5-b350-25f48ffefdf8 admin admin] RBAC: Authorization granted {{(pid=71938) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 24 17:04:09.687119 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: [pid: 71938|app: 0|req: 1435/2882] 10.222.0.53 () {60 vars in 1143 bytes} [Wed Nov 24 17:04:09 2021] POST /identity/v3/projects => generated 375 bytes in 138 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 24 17:04:09.691458 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a55d34dd-b347-4fb4-97fe-ed51174362d8 None None] Authenticating user token {{(pid=71939) process_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 24 17:04:09.702336 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a55d34dd-b347-4fb4-97fe-ed51174362d8 None None] Validating token access rules against request {{(pid=71939) validate_allowed_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 24 17:04:09.767582 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eab05711-6491-4e57-a36e-b611d06997c1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f2ba2e8375b4e8c8792ee1e22b60427', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '00a5583c7b7443e98e7a1d31a0b638dc', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=71939) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 24 17:04:09.768198 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eab05711-6491-4e57-a36e-b611d06997c1 admin admin] REQUEST_METHOD: `POST` {{(pid=71939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 24 17:04:09.768544 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eab05711-6491-4e57-a36e-b611d06997c1 admin admin] SCRIPT_NAME: `/identity` {{(pid=71939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 24 17:04:09.768880 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eab05711-6491-4e57-a36e-b611d06997c1 admin admin] PATH_INFO: `/v3/users` {{(pid=71939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 24 17:04:09.769615 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eab05711-6491-4e57-a36e-b611d06997c1 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=71939) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:442}} Nov 24 17:04:09.799073 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eab05711-6491-4e57-a36e-b611d06997c1 admin admin] RBAC: Authorization granted {{(pid=71939) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 24 17:04:09.820850 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: [pid: 71939|app: 0|req: 1448/2883] 10.222.0.53 () {60 vars in 1134 bytes} [Wed Nov 24 17:04:09 2021] POST /identity/v3/users => generated 288 bytes in 130 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 24 17:04:09.825064 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5f7df3e-38a4-40d5-b350-25f48ffefdf8 admin admin] Authenticating user token {{(pid=71938) process_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 24 17:04:09.836021 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5f7df3e-38a4-40d5-b350-25f48ffefdf8 admin admin] Validating token access rules against request {{(pid=71938) validate_allowed_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 24 17:04:09.841385 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66db9421-a544-4d0f-85c4-cdf00c15b7b9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f2ba2e8375b4e8c8792ee1e22b60427', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '00a5583c7b7443e98e7a1d31a0b638dc', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=71938) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 24 17:04:09.842193 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66db9421-a544-4d0f-85c4-cdf00c15b7b9 admin admin] REQUEST_METHOD: `GET` {{(pid=71938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 24 17:04:09.842542 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66db9421-a544-4d0f-85c4-cdf00c15b7b9 admin admin] SCRIPT_NAME: `/identity` {{(pid=71938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 24 17:04:09.842885 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66db9421-a544-4d0f-85c4-cdf00c15b7b9 admin admin] PATH_INFO: `/v3/roles` {{(pid=71938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 24 17:04:09.843765 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66db9421-a544-4d0f-85c4-cdf00c15b7b9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=71938) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:442}} Nov 24 17:04:09.872721 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66db9421-a544-4d0f-85c4-cdf00c15b7b9 admin admin] RBAC: Authorization granted {{(pid=71938) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 24 17:04:09.888208 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: [pid: 71938|app: 0|req: 1436/2884] 10.222.0.53 () {58 vars in 1112 bytes} [Wed Nov 24 17:04:09 2021] GET /identity/v3/roles => generated 1420 bytes in 60 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 24 17:04:09.889463 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eab05711-6491-4e57-a36e-b611d06997c1 admin admin] Authenticating user token {{(pid=71939) process_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 24 17:04:09.900219 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eab05711-6491-4e57-a36e-b611d06997c1 admin admin] Validating token access rules against request {{(pid=71939) validate_allowed_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 24 17:04:09.904858 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ee91d1d-8ec6-42a1-ab89-54dc2ab559f6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f2ba2e8375b4e8c8792ee1e22b60427', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '00a5583c7b7443e98e7a1d31a0b638dc', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=71939) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 24 17:04:09.905763 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ee91d1d-8ec6-42a1-ab89-54dc2ab559f6 admin admin] REQUEST_METHOD: `PUT` {{(pid=71939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 24 17:04:09.906133 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ee91d1d-8ec6-42a1-ab89-54dc2ab559f6 admin admin] SCRIPT_NAME: `/identity` {{(pid=71939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 24 17:04:09.906474 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ee91d1d-8ec6-42a1-ab89-54dc2ab559f6 admin admin] PATH_INFO: `/v3/projects/d9ae47a13fb045c1b51b0b311719773e/users/47218afacd82400ab4e2af3171f7169c/roles/912ab5f10fa5477da74acf239f07604e` {{(pid=71939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 24 17:04:09.927567 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ee91d1d-8ec6-42a1-ab89-54dc2ab559f6 admin admin] RBAC: Authorizing `identity:create_grant(project_id=d9ae47a13fb045c1b51b0b311719773e, user_id=47218afacd82400ab4e2af3171f7169c, role_id=912ab5f10fa5477da74acf239f07604e)` {{(pid=71939) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:442}} Nov 24 17:04:09.956909 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ee91d1d-8ec6-42a1-ab89-54dc2ab559f6 admin admin] RBAC: Authorization granted {{(pid=71939) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 24 17:04:09.969159 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: [pid: 71939|app: 0|req: 1449/2885] 10.222.0.53 () {60 vars in 1473 bytes} [Wed Nov 24 17:04:09 2021] PUT /identity/v3/projects/d9ae47a13fb045c1b51b0b311719773e/users/47218afacd82400ab4e2af3171f7169c/roles/912ab5f10fa5477da74acf239f07604e => generated 0 bytes in 80 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 24 17:04:09.981383 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08504562-1a99-44ed-a71d-11f09d495647 None None] REQUEST_METHOD: `POST` {{(pid=71938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 24 17:04:09.981746 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08504562-1a99-44ed-a71d-11f09d495647 None None] SCRIPT_NAME: `/identity` {{(pid=71938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 24 17:04:09.982108 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08504562-1a99-44ed-a71d-11f09d495647 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=71938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 24 17:04:10.019277 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.auth.core [None req-08504562-1a99-44ed-a71d-11f09d495647 None None] MFA Rules not processed for user `47218afacd82400ab4e2af3171f7169c`. Rule list: `[]` (Enabled: `True`). {{(pid=71938) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:442}} Nov 24 17:04:10.020466 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.fernet_utils [None req-08504562-1a99-44ed-a71d-11f09d495647 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=71938) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:289}} Nov 24 17:04:10.096198 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: [pid: 71938|app: 0|req: 1437/2886] 10.222.0.53 () {58 vars in 948 bytes} [Wed Nov 24 17:04:09 2021] POST /identity/v3/auth/tokens => generated 3682 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 24 17:04:10.100993 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ee91d1d-8ec6-42a1-ab89-54dc2ab559f6 admin admin] Authenticating user token {{(pid=71939) process_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 24 17:04:10.174092 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ee91d1d-8ec6-42a1-ab89-54dc2ab559f6 admin admin] Validating token access rules against request {{(pid=71939) validate_allowed_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 24 17:04:10.178762 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33c32ed6-5310-4d86-907a-92c5b60ca570 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f2ba2e8375b4e8c8792ee1e22b60427', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '00a5583c7b7443e98e7a1d31a0b638dc', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=71939) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 24 17:04:10.179438 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33c32ed6-5310-4d86-907a-92c5b60ca570 admin admin] REQUEST_METHOD: `POST` {{(pid=71939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 24 17:04:10.179786 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33c32ed6-5310-4d86-907a-92c5b60ca570 admin admin] SCRIPT_NAME: `/identity` {{(pid=71939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 24 17:04:10.180119 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33c32ed6-5310-4d86-907a-92c5b60ca570 admin admin] PATH_INFO: `/v3/projects` {{(pid=71939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 24 17:04:10.180881 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33c32ed6-5310-4d86-907a-92c5b60ca570 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=71939) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:442}} Nov 24 17:04:10.216365 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33c32ed6-5310-4d86-907a-92c5b60ca570 admin admin] RBAC: Authorization granted {{(pid=71939) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 24 17:04:10.245239 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: [pid: 71939|app: 0|req: 1450/2887] 10.222.0.53 () {60 vars in 1143 bytes} [Wed Nov 24 17:04:10 2021] POST /identity/v3/projects => generated 377 bytes in 145 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 24 17:04:10.249653 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08504562-1a99-44ed-a71d-11f09d495647 None None] Authenticating user token {{(pid=71938) process_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 24 17:04:10.261041 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08504562-1a99-44ed-a71d-11f09d495647 None None] Validating token access rules against request {{(pid=71938) validate_allowed_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 24 17:04:10.327511 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19f3e397-9a3d-4110-a7e3-2e58ff6a28e3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f2ba2e8375b4e8c8792ee1e22b60427', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '00a5583c7b7443e98e7a1d31a0b638dc', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=71938) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 24 17:04:10.328541 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19f3e397-9a3d-4110-a7e3-2e58ff6a28e3 admin admin] REQUEST_METHOD: `POST` {{(pid=71938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 24 17:04:10.328878 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19f3e397-9a3d-4110-a7e3-2e58ff6a28e3 admin admin] SCRIPT_NAME: `/identity` {{(pid=71938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 24 17:04:10.329205 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19f3e397-9a3d-4110-a7e3-2e58ff6a28e3 admin admin] PATH_INFO: `/v3/users` {{(pid=71938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 24 17:04:10.329925 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19f3e397-9a3d-4110-a7e3-2e58ff6a28e3 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=71938) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:442}} Nov 24 17:04:10.359674 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19f3e397-9a3d-4110-a7e3-2e58ff6a28e3 admin admin] RBAC: Authorization granted {{(pid=71938) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 24 17:04:10.377814 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: [pid: 71938|app: 0|req: 1438/2888] 10.222.0.53 () {60 vars in 1134 bytes} [Wed Nov 24 17:04:10 2021] POST /identity/v3/users => generated 295 bytes in 129 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 24 17:04:10.382235 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33c32ed6-5310-4d86-907a-92c5b60ca570 admin admin] Authenticating user token {{(pid=71939) process_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 24 17:04:10.393276 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33c32ed6-5310-4d86-907a-92c5b60ca570 admin admin] Validating token access rules against request {{(pid=71939) validate_allowed_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 24 17:04:10.397861 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b29b8b2-6dc4-4c97-8ff3-9f1ac581eba2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f2ba2e8375b4e8c8792ee1e22b60427', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '00a5583c7b7443e98e7a1d31a0b638dc', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=71939) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 24 17:04:10.398592 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b29b8b2-6dc4-4c97-8ff3-9f1ac581eba2 admin admin] REQUEST_METHOD: `GET` {{(pid=71939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 24 17:04:10.398937 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b29b8b2-6dc4-4c97-8ff3-9f1ac581eba2 admin admin] SCRIPT_NAME: `/identity` {{(pid=71939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 24 17:04:10.399275 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b29b8b2-6dc4-4c97-8ff3-9f1ac581eba2 admin admin] PATH_INFO: `/v3/roles` {{(pid=71939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 24 17:04:10.400671 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b29b8b2-6dc4-4c97-8ff3-9f1ac581eba2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=71939) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:442}} Nov 24 17:04:10.428693 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b29b8b2-6dc4-4c97-8ff3-9f1ac581eba2 admin admin] RBAC: Authorization granted {{(pid=71939) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 24 17:04:10.440586 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: [pid: 71939|app: 0|req: 1451/2889] 10.222.0.53 () {58 vars in 1112 bytes} [Wed Nov 24 17:04:10 2021] GET /identity/v3/roles => generated 1420 bytes in 59 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 24 17:04:10.444907 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19f3e397-9a3d-4110-a7e3-2e58ff6a28e3 admin admin] Authenticating user token {{(pid=71938) process_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 24 17:04:10.455585 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19f3e397-9a3d-4110-a7e3-2e58ff6a28e3 admin admin] Validating token access rules against request {{(pid=71938) validate_allowed_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 24 17:04:10.460430 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab883991-8612-4013-9aef-14fcd491c808 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f2ba2e8375b4e8c8792ee1e22b60427', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '00a5583c7b7443e98e7a1d31a0b638dc', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=71938) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 24 17:04:10.461381 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab883991-8612-4013-9aef-14fcd491c808 admin admin] REQUEST_METHOD: `PUT` {{(pid=71938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 24 17:04:10.461723 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab883991-8612-4013-9aef-14fcd491c808 admin admin] SCRIPT_NAME: `/identity` {{(pid=71938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 24 17:04:10.462645 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab883991-8612-4013-9aef-14fcd491c808 admin admin] PATH_INFO: `/v3/projects/21aecd0586eb47f9a3d9ab1af75a384f/users/c3137f03150d46e6a7b86b899159a123/roles/5611724e350b41e19921b5961a342582` {{(pid=71938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 24 17:04:10.483431 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab883991-8612-4013-9aef-14fcd491c808 admin admin] RBAC: Authorizing `identity:create_grant(project_id=21aecd0586eb47f9a3d9ab1af75a384f, user_id=c3137f03150d46e6a7b86b899159a123, role_id=5611724e350b41e19921b5961a342582)` {{(pid=71938) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:442}} Nov 24 17:04:10.516491 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab883991-8612-4013-9aef-14fcd491c808 admin admin] RBAC: Authorization granted {{(pid=71938) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 24 17:04:10.529461 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: [pid: 71938|app: 0|req: 1439/2890] 10.222.0.53 () {60 vars in 1473 bytes} [Wed Nov 24 17:04:10 2021] PUT /identity/v3/projects/21aecd0586eb47f9a3d9ab1af75a384f/users/c3137f03150d46e6a7b86b899159a123/roles/5611724e350b41e19921b5961a342582 => generated 0 bytes in 85 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 24 17:04:10.533579 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b29b8b2-6dc4-4c97-8ff3-9f1ac581eba2 admin admin] Authenticating user token {{(pid=71939) process_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 24 17:04:10.543700 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b29b8b2-6dc4-4c97-8ff3-9f1ac581eba2 admin admin] Validating token access rules against request {{(pid=71939) validate_allowed_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 24 17:04:10.614282 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f148c11f-62ea-4131-a531-90475c8457be admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f2ba2e8375b4e8c8792ee1e22b60427', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '00a5583c7b7443e98e7a1d31a0b638dc', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=71939) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 24 17:04:10.614893 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f148c11f-62ea-4131-a531-90475c8457be admin admin] REQUEST_METHOD: `GET` {{(pid=71939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 24 17:04:10.615236 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f148c11f-62ea-4131-a531-90475c8457be admin admin] SCRIPT_NAME: `/identity` {{(pid=71939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 24 17:04:10.615570 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f148c11f-62ea-4131-a531-90475c8457be admin admin] PATH_INFO: `/v3/roles` {{(pid=71939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 24 17:04:10.616357 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f148c11f-62ea-4131-a531-90475c8457be admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=71939) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:442}} Nov 24 17:04:10.645160 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f148c11f-62ea-4131-a531-90475c8457be admin admin] RBAC: Authorization granted {{(pid=71939) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 24 17:04:10.655946 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: [pid: 71939|app: 0|req: 1452/2891] 10.222.0.53 () {58 vars in 1112 bytes} [Wed Nov 24 17:04:10 2021] GET /identity/v3/roles => generated 1420 bytes in 123 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 24 17:04:10.660466 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab883991-8612-4013-9aef-14fcd491c808 admin admin] Authenticating user token {{(pid=71938) process_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 24 17:04:10.675259 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab883991-8612-4013-9aef-14fcd491c808 admin admin] Validating token access rules against request {{(pid=71938) validate_allowed_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 24 17:04:10.681756 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc355ffa-aeac-4576-8095-0f2e98f91ca0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f2ba2e8375b4e8c8792ee1e22b60427', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '00a5583c7b7443e98e7a1d31a0b638dc', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=71938) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 24 17:04:10.682699 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc355ffa-aeac-4576-8095-0f2e98f91ca0 admin admin] REQUEST_METHOD: `PUT` {{(pid=71938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 24 17:04:10.683041 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc355ffa-aeac-4576-8095-0f2e98f91ca0 admin admin] SCRIPT_NAME: `/identity` {{(pid=71938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 24 17:04:10.683381 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc355ffa-aeac-4576-8095-0f2e98f91ca0 admin admin] PATH_INFO: `/v3/projects/21aecd0586eb47f9a3d9ab1af75a384f/users/c3137f03150d46e6a7b86b899159a123/roles/5611724e350b41e19921b5961a342582` {{(pid=71938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 24 17:04:10.685722 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc355ffa-aeac-4576-8095-0f2e98f91ca0 admin admin] RBAC: Authorizing `identity:create_grant(project_id=21aecd0586eb47f9a3d9ab1af75a384f, user_id=c3137f03150d46e6a7b86b899159a123, role_id=5611724e350b41e19921b5961a342582)` {{(pid=71938) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:442}} Nov 24 17:04:10.715664 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc355ffa-aeac-4576-8095-0f2e98f91ca0 admin admin] RBAC: Authorization granted {{(pid=71938) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 24 17:04:10.726792 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: [pid: 71938|app: 0|req: 1440/2892] 10.222.0.53 () {60 vars in 1473 bytes} [Wed Nov 24 17:04:10 2021] PUT /identity/v3/projects/21aecd0586eb47f9a3d9ab1af75a384f/users/c3137f03150d46e6a7b86b899159a123/roles/5611724e350b41e19921b5961a342582 => generated 0 bytes in 67 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 24 17:04:10.731186 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f148c11f-62ea-4131-a531-90475c8457be admin admin] Authenticating user token {{(pid=71939) process_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 24 17:04:10.741478 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f148c11f-62ea-4131-a531-90475c8457be admin admin] Validating token access rules against request {{(pid=71939) validate_allowed_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 24 17:04:10.809477 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1b96737-0c7d-434e-aece-04684a1dfc30 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f2ba2e8375b4e8c8792ee1e22b60427', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '00a5583c7b7443e98e7a1d31a0b638dc', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=71939) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 24 17:04:10.810185 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1b96737-0c7d-434e-aece-04684a1dfc30 admin admin] REQUEST_METHOD: `GET` {{(pid=71939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 24 17:04:10.810537 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1b96737-0c7d-434e-aece-04684a1dfc30 admin admin] SCRIPT_NAME: `/identity` {{(pid=71939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 24 17:04:10.810875 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1b96737-0c7d-434e-aece-04684a1dfc30 admin admin] PATH_INFO: `/v3/roles` {{(pid=71939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 24 17:04:10.811659 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1b96737-0c7d-434e-aece-04684a1dfc30 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=71939) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:442}} Nov 24 17:04:10.840209 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1b96737-0c7d-434e-aece-04684a1dfc30 admin admin] RBAC: Authorization granted {{(pid=71939) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 24 17:04:10.850874 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: [pid: 71939|app: 0|req: 1453/2893] 10.222.0.53 () {58 vars in 1112 bytes} [Wed Nov 24 17:04:10 2021] GET /identity/v3/roles => generated 1420 bytes in 120 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Nov 24 17:04:10.855468 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc355ffa-aeac-4576-8095-0f2e98f91ca0 admin admin] Authenticating user token {{(pid=71938) process_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 24 17:04:10.865880 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc355ffa-aeac-4576-8095-0f2e98f91ca0 admin admin] Validating token access rules against request {{(pid=71938) validate_allowed_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 24 17:04:10.870984 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-719a5cb9-3c4d-4e29-aef2-641a0c1756c9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f2ba2e8375b4e8c8792ee1e22b60427', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '00a5583c7b7443e98e7a1d31a0b638dc', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=71938) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 24 17:04:10.871879 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-719a5cb9-3c4d-4e29-aef2-641a0c1756c9 admin admin] REQUEST_METHOD: `PUT` {{(pid=71938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 24 17:04:10.872220 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-719a5cb9-3c4d-4e29-aef2-641a0c1756c9 admin admin] SCRIPT_NAME: `/identity` {{(pid=71938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 24 17:04:10.872557 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-719a5cb9-3c4d-4e29-aef2-641a0c1756c9 admin admin] PATH_INFO: `/v3/projects/21aecd0586eb47f9a3d9ab1af75a384f/users/c3137f03150d46e6a7b86b899159a123/roles/912ab5f10fa5477da74acf239f07604e` {{(pid=71938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 24 17:04:10.874560 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-719a5cb9-3c4d-4e29-aef2-641a0c1756c9 admin admin] RBAC: Authorizing `identity:create_grant(project_id=21aecd0586eb47f9a3d9ab1af75a384f, user_id=c3137f03150d46e6a7b86b899159a123, role_id=912ab5f10fa5477da74acf239f07604e)` {{(pid=71938) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:442}} Nov 24 17:04:10.904319 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-719a5cb9-3c4d-4e29-aef2-641a0c1756c9 admin admin] RBAC: Authorization granted {{(pid=71938) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 24 17:04:10.918274 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: [pid: 71938|app: 0|req: 1441/2894] 10.222.0.53 () {60 vars in 1473 bytes} [Wed Nov 24 17:04:10 2021] PUT /identity/v3/projects/21aecd0586eb47f9a3d9ab1af75a384f/users/c3137f03150d46e6a7b86b899159a123/roles/912ab5f10fa5477da74acf239f07604e => generated 0 bytes in 63 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 24 17:04:10.929120 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de8e8f40-4cb1-48c6-81c3-fd64737b8b2f None None] REQUEST_METHOD: `POST` {{(pid=71939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 24 17:04:10.929469 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de8e8f40-4cb1-48c6-81c3-fd64737b8b2f None None] SCRIPT_NAME: `/identity` {{(pid=71939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 24 17:04:10.929811 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de8e8f40-4cb1-48c6-81c3-fd64737b8b2f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=71939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 24 17:04:10.968922 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.auth.core [None req-de8e8f40-4cb1-48c6-81c3-fd64737b8b2f None None] MFA Rules not processed for user `c3137f03150d46e6a7b86b899159a123`. Rule list: `[]` (Enabled: `True`). {{(pid=71939) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:442}} Nov 24 17:04:10.970186 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.fernet_utils [None req-de8e8f40-4cb1-48c6-81c3-fd64737b8b2f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=71939) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:289}} Nov 24 17:04:11.050961 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: [pid: 71939|app: 0|req: 1454/2895] 10.222.0.53 () {58 vars in 948 bytes} [Wed Nov 24 17:04:10 2021] POST /identity/v3/auth/tokens => generated 3751 bytes in 122 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 24 17:04:11.061796 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-719a5cb9-3c4d-4e29-aef2-641a0c1756c9 admin admin] Authenticating user token {{(pid=71938) process_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 24 17:04:11.063646 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.fernet_utils [None req-719a5cb9-3c4d-4e29-aef2-641a0c1756c9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=71938) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:289}} Nov 24 17:04:11.129733 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-719a5cb9-3c4d-4e29-aef2-641a0c1756c9 admin admin] Validating token access rules against request {{(pid=71938) validate_allowed_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 24 17:04:11.133327 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97bb53ae-4389-4b96-ae1e-a7899b013e02 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a12374a3093a401a97c343ff0854184d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3b3940d4ae1c4177ae29c02377bb4b0b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=71938) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 24 17:04:11.134000 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97bb53ae-4389-4b96-ae1e-a7899b013e02 service cinder] REQUEST_METHOD: `GET` {{(pid=71938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 24 17:04:11.134382 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97bb53ae-4389-4b96-ae1e-a7899b013e02 service cinder] SCRIPT_NAME: `/identity` {{(pid=71938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 24 17:04:11.134708 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97bb53ae-4389-4b96-ae1e-a7899b013e02 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=71938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 24 17:04:11.200641 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97bb53ae-4389-4b96-ae1e-a7899b013e02 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=71938) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:442}} Nov 24 17:04:11.229269 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97bb53ae-4389-4b96-ae1e-a7899b013e02 service cinder] RBAC: Authorization granted {{(pid=71938) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 24 17:04:11.238802 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: [pid: 71938|app: 0|req: 1442/2896] 10.222.0.53 () {60 vars in 1356 bytes} [Wed Nov 24 17:04:11 2021] GET /identity/v3/auth/tokens => generated 3682 bytes in 177 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 24 17:04:13.036705 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de8e8f40-4cb1-48c6-81c3-fd64737b8b2f None None] Authenticating user token {{(pid=71939) process_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 24 17:04:13.047620 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de8e8f40-4cb1-48c6-81c3-fd64737b8b2f None None] Validating token access rules against request {{(pid=71939) validate_allowed_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 24 17:04:13.051244 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84e8cec8-6ba4-4945-a37a-ca56b317bd3a service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a12374a3093a401a97c343ff0854184d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3b3940d4ae1c4177ae29c02377bb4b0b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=71939) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 24 17:04:13.051895 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84e8cec8-6ba4-4945-a37a-ca56b317bd3a service cinder] REQUEST_METHOD: `GET` {{(pid=71939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 24 17:04:13.052232 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84e8cec8-6ba4-4945-a37a-ca56b317bd3a service cinder] SCRIPT_NAME: `/identity` {{(pid=71939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 24 17:04:13.052560 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84e8cec8-6ba4-4945-a37a-ca56b317bd3a service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=71939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 24 17:04:13.118828 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84e8cec8-6ba4-4945-a37a-ca56b317bd3a service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=71939) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:442}} Nov 24 17:04:13.147222 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84e8cec8-6ba4-4945-a37a-ca56b317bd3a service cinder] RBAC: Authorization granted {{(pid=71939) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 24 17:04:13.157407 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: [pid: 71939|app: 0|req: 1455/2897] 10.222.0.53 () {60 vars in 1356 bytes} [Wed Nov 24 17:04:13 2021] GET /identity/v3/auth/tokens => generated 3682 bytes in 121 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 24 17:04:13.885006 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97bb53ae-4389-4b96-ae1e-a7899b013e02 service cinder] Authenticating user token {{(pid=71938) process_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 24 17:04:13.893996 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97bb53ae-4389-4b96-ae1e-a7899b013e02 service cinder] Validating token access rules against request {{(pid=71938) validate_allowed_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 24 17:04:13.897663 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-228134fa-eaef-466b-b915-804922e4ef42 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a12374a3093a401a97c343ff0854184d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3b3940d4ae1c4177ae29c02377bb4b0b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=71938) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 24 17:04:13.898340 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-228134fa-eaef-466b-b915-804922e4ef42 service cinder] REQUEST_METHOD: `GET` {{(pid=71938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 24 17:04:13.898676 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-228134fa-eaef-466b-b915-804922e4ef42 service cinder] SCRIPT_NAME: `/identity` {{(pid=71938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 24 17:04:13.899007 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-228134fa-eaef-466b-b915-804922e4ef42 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=71938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 24 17:04:13.908830 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-228134fa-eaef-466b-b915-804922e4ef42 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=71938) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:442}} Nov 24 17:04:13.936970 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-228134fa-eaef-466b-b915-804922e4ef42 service cinder] RBAC: Authorization granted {{(pid=71938) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 24 17:04:13.947010 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: [pid: 71938|app: 0|req: 1443/2898] 10.222.0.53 () {60 vars in 1356 bytes} [Wed Nov 24 17:04:13 2021] GET /identity/v3/auth/tokens => generated 3751 bytes in 63 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 24 17:04:18.505987 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84e8cec8-6ba4-4945-a37a-ca56b317bd3a service cinder] Authenticating user token {{(pid=71939) process_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 24 17:04:18.579090 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84e8cec8-6ba4-4945-a37a-ca56b317bd3a service cinder] Validating token access rules against request {{(pid=71939) validate_allowed_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 24 17:04:18.583654 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d2a56e9-33a0-48b3-bf7d-d542f36b1180 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f2ba2e8375b4e8c8792ee1e22b60427', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '00a5583c7b7443e98e7a1d31a0b638dc', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=71939) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 24 17:04:18.584547 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d2a56e9-33a0-48b3-bf7d-d542f36b1180 admin admin] REQUEST_METHOD: `DELETE` {{(pid=71939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 24 17:04:18.584891 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d2a56e9-33a0-48b3-bf7d-d542f36b1180 admin admin] SCRIPT_NAME: `/identity` {{(pid=71939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 24 17:04:18.585229 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d2a56e9-33a0-48b3-bf7d-d542f36b1180 admin admin] PATH_INFO: `/v3/users/fdb23d2aacb64f189de1cf268d85fe46` {{(pid=71939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 24 17:04:18.586486 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d2a56e9-33a0-48b3-bf7d-d542f36b1180 admin admin] RBAC: Authorizing `identity:delete_user(user_id=fdb23d2aacb64f189de1cf268d85fe46)` {{(pid=71939) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:442}} Nov 24 17:04:18.619032 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d2a56e9-33a0-48b3-bf7d-d542f36b1180 admin admin] RBAC: Authorization granted {{(pid=71939) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 24 17:04:18.668676 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.notifications [None req-8d2a56e9-33a0-48b3-bf7d-d542f36b1180 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'fdb23d2aacb64f189de1cf268d85fe46'} {{(pid=71939) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:357}} Nov 24 17:04:18.681652 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.notifications [None req-8d2a56e9-33a0-48b3-bf7d-d542f36b1180 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'fdb23d2aacb64f189de1cf268d85fe46'} {{(pid=71939) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:357}} Nov 24 17:04:18.682384 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.notifications [None req-8d2a56e9-33a0-48b3-bf7d-d542f36b1180 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'fdb23d2aacb64f189de1cf268d85fe46'} {{(pid=71939) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:357}} Nov 24 17:04:18.690411 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.notifications [None req-8d2a56e9-33a0-48b3-bf7d-d542f36b1180 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'fdb23d2aacb64f189de1cf268d85fe46'} {{(pid=71939) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:357}} Nov 24 17:04:18.696449 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.notifications [None req-8d2a56e9-33a0-48b3-bf7d-d542f36b1180 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'fdb23d2aacb64f189de1cf268d85fe46'} {{(pid=71939) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:357}} Nov 24 17:04:18.702634 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: [pid: 71939|app: 0|req: 1456/2899] 10.222.0.53 () {58 vars in 1214 bytes} [Wed Nov 24 17:04:18 2021] DELETE /identity/v3/users/fdb23d2aacb64f189de1cf268d85fe46 => generated 0 bytes in 197 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 24 17:04:18.707361 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa936595-9751-4aac-bc91-8827290b6203 None None] REQUEST_METHOD: `POST` {{(pid=71938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 24 17:04:18.707704 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa936595-9751-4aac-bc91-8827290b6203 None None] SCRIPT_NAME: `/identity` {{(pid=71938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 24 17:04:18.708037 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa936595-9751-4aac-bc91-8827290b6203 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=71938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 24 17:04:18.731311 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.auth.core [None req-fa936595-9751-4aac-bc91-8827290b6203 None None] MFA Rules not processed for user `0f2ba2e8375b4e8c8792ee1e22b60427`. Rule list: `[]` (Enabled: `True`). {{(pid=71938) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:442}} Nov 24 17:04:18.732514 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.fernet_utils [None req-fa936595-9751-4aac-bc91-8827290b6203 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=71938) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:289}} Nov 24 17:04:18.800216 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: [pid: 71938|app: 0|req: 1444/2900] 10.222.0.53 () {58 vars in 948 bytes} [Wed Nov 24 17:04:18 2021] POST /identity/v3/auth/tokens => generated 3669 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 24 17:04:18.811390 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d2a56e9-33a0-48b3-bf7d-d542f36b1180 admin admin] Authenticating user token {{(pid=71939) process_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 24 17:04:18.812951 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.fernet_utils [None req-8d2a56e9-33a0-48b3-bf7d-d542f36b1180 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=71939) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:289}} Nov 24 17:04:18.881309 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d2a56e9-33a0-48b3-bf7d-d542f36b1180 admin admin] Validating token access rules against request {{(pid=71939) validate_allowed_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 24 17:04:18.884975 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ee1e9e1-dd07-4d68-83a8-4576258ce540 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c90f21b9cdcb413282461fa83cb6b7a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3b3940d4ae1c4177ae29c02377bb4b0b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=71939) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 24 17:04:18.885626 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ee1e9e1-dd07-4d68-83a8-4576258ce540 service neutron] REQUEST_METHOD: `GET` {{(pid=71939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 24 17:04:18.885961 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ee1e9e1-dd07-4d68-83a8-4576258ce540 service neutron] SCRIPT_NAME: `/identity` {{(pid=71939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 24 17:04:18.886346 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ee1e9e1-dd07-4d68-83a8-4576258ce540 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=71939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 24 17:04:18.895652 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ee1e9e1-dd07-4d68-83a8-4576258ce540 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=71939) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:442}} Nov 24 17:04:18.924156 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ee1e9e1-dd07-4d68-83a8-4576258ce540 service neutron] RBAC: Authorization granted {{(pid=71939) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 24 17:04:18.933867 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: [pid: 71939|app: 0|req: 1457/2901] 10.222.0.53 () {60 vars in 1356 bytes} [Wed Nov 24 17:04:18 2021] GET /identity/v3/auth/tokens => generated 3669 bytes in 123 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 24 17:04:19.306722 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa936595-9751-4aac-bc91-8827290b6203 None None] Authenticating user token {{(pid=71938) process_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 24 17:04:19.308270 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.fernet_utils [None req-fa936595-9751-4aac-bc91-8827290b6203 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=71938) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:289}} Nov 24 17:04:19.321017 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa936595-9751-4aac-bc91-8827290b6203 None None] Validating token access rules against request {{(pid=71938) validate_allowed_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 24 17:04:19.325804 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48989c9c-e37d-4c83-bba7-ced0784f8e6d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f2ba2e8375b4e8c8792ee1e22b60427', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '00a5583c7b7443e98e7a1d31a0b638dc', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=71938) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 24 17:04:19.326717 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48989c9c-e37d-4c83-bba7-ced0784f8e6d admin admin] REQUEST_METHOD: `DELETE` {{(pid=71938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 24 17:04:19.327058 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48989c9c-e37d-4c83-bba7-ced0784f8e6d admin admin] SCRIPT_NAME: `/identity` {{(pid=71938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 24 17:04:19.327385 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48989c9c-e37d-4c83-bba7-ced0784f8e6d admin admin] PATH_INFO: `/v3/projects/f6ae79da9496495199607d5000565a02` {{(pid=71938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 24 17:04:19.329140 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48989c9c-e37d-4c83-bba7-ced0784f8e6d admin admin] RBAC: Authorizing `identity:delete_project(project_id=f6ae79da9496495199607d5000565a02)` {{(pid=71938) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:442}} Nov 24 17:04:19.358097 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48989c9c-e37d-4c83-bba7-ced0784f8e6d admin admin] RBAC: Authorization granted {{(pid=71938) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 24 17:04:19.410482 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.notifications [None req-48989c9c-e37d-4c83-bba7-ced0784f8e6d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f6ae79da9496495199607d5000565a02', 'request_id': 'req-48989c9c-e37d-4c83-bba7-ced0784f8e6d'} {{(pid=71938) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:357}} Nov 24 17:04:19.422747 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.notifications [None req-48989c9c-e37d-4c83-bba7-ced0784f8e6d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f6ae79da9496495199607d5000565a02', 'request_id': 'req-48989c9c-e37d-4c83-bba7-ced0784f8e6d'} {{(pid=71938) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:357}} Nov 24 17:04:19.427972 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.notifications [None req-48989c9c-e37d-4c83-bba7-ced0784f8e6d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f6ae79da9496495199607d5000565a02', 'request_id': 'req-48989c9c-e37d-4c83-bba7-ced0784f8e6d'} {{(pid=71938) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:357}} Nov 24 17:04:19.439688 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.notifications [None req-48989c9c-e37d-4c83-bba7-ced0784f8e6d admin admin] The token cache is being invalidate because project f6ae79da9496495199607d5000565a02 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=71938) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Nov 24 17:04:19.440013 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.notifications [None req-48989c9c-e37d-4c83-bba7-ced0784f8e6d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=71938) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:357}} Nov 24 17:04:19.440665 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.notifications [None req-48989c9c-e37d-4c83-bba7-ced0784f8e6d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=71938) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:357}} Nov 24 17:04:19.442227 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: [pid: 71938|app: 0|req: 1445/2902] 10.222.0.53 () {58 vars in 1223 bytes} [Wed Nov 24 17:04:19 2021] DELETE /identity/v3/projects/f6ae79da9496495199607d5000565a02 => generated 0 bytes in 137 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 24 17:04:19.446536 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ee1e9e1-dd07-4d68-83a8-4576258ce540 service neutron] Authenticating user token {{(pid=71939) process_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 24 17:04:19.456665 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ee1e9e1-dd07-4d68-83a8-4576258ce540 service neutron] Validating token access rules against request {{(pid=71939) validate_allowed_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 24 17:04:19.523267 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98ecd4b8-5a65-494d-bc65-9966c9b14199 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f2ba2e8375b4e8c8792ee1e22b60427', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '00a5583c7b7443e98e7a1d31a0b638dc', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=71939) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 24 17:04:19.524163 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98ecd4b8-5a65-494d-bc65-9966c9b14199 admin admin] REQUEST_METHOD: `DELETE` {{(pid=71939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 24 17:04:19.525003 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98ecd4b8-5a65-494d-bc65-9966c9b14199 admin admin] SCRIPT_NAME: `/identity` {{(pid=71939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 24 17:04:19.525338 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98ecd4b8-5a65-494d-bc65-9966c9b14199 admin admin] PATH_INFO: `/v3/users/47218afacd82400ab4e2af3171f7169c` {{(pid=71939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 24 17:04:19.526617 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98ecd4b8-5a65-494d-bc65-9966c9b14199 admin admin] RBAC: Authorizing `identity:delete_user(user_id=47218afacd82400ab4e2af3171f7169c)` {{(pid=71939) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:442}} Nov 24 17:04:19.555515 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98ecd4b8-5a65-494d-bc65-9966c9b14199 admin admin] RBAC: Authorization granted {{(pid=71939) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 24 17:04:19.603389 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.notifications [None req-98ecd4b8-5a65-494d-bc65-9966c9b14199 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '47218afacd82400ab4e2af3171f7169c'} {{(pid=71939) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:357}} Nov 24 17:04:19.615558 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.notifications [None req-98ecd4b8-5a65-494d-bc65-9966c9b14199 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '47218afacd82400ab4e2af3171f7169c'} {{(pid=71939) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:357}} Nov 24 17:04:19.616261 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.notifications [None req-98ecd4b8-5a65-494d-bc65-9966c9b14199 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '47218afacd82400ab4e2af3171f7169c'} {{(pid=71939) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:357}} Nov 24 17:04:19.624420 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.notifications [None req-98ecd4b8-5a65-494d-bc65-9966c9b14199 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '47218afacd82400ab4e2af3171f7169c'} {{(pid=71939) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:357}} Nov 24 17:04:19.630225 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.notifications [None req-98ecd4b8-5a65-494d-bc65-9966c9b14199 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '47218afacd82400ab4e2af3171f7169c'} {{(pid=71939) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:357}} Nov 24 17:04:19.636397 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: [pid: 71939|app: 0|req: 1458/2903] 10.222.0.53 () {58 vars in 1214 bytes} [Wed Nov 24 17:04:19 2021] DELETE /identity/v3/users/47218afacd82400ab4e2af3171f7169c => generated 0 bytes in 190 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 24 17:04:19.997719 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48989c9c-e37d-4c83-bba7-ced0784f8e6d admin admin] Authenticating user token {{(pid=71938) process_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 24 17:04:19.999370 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.fernet_utils [None req-48989c9c-e37d-4c83-bba7-ced0784f8e6d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=71938) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:289}} Nov 24 17:04:20.012069 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48989c9c-e37d-4c83-bba7-ced0784f8e6d admin admin] Validating token access rules against request {{(pid=71938) validate_allowed_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 24 17:04:20.078822 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f7e6de2-8fb5-4e7e-a949-288f202b50fb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f2ba2e8375b4e8c8792ee1e22b60427', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '00a5583c7b7443e98e7a1d31a0b638dc', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=71938) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 24 17:04:20.079706 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f7e6de2-8fb5-4e7e-a949-288f202b50fb admin admin] REQUEST_METHOD: `DELETE` {{(pid=71938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 24 17:04:20.080046 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f7e6de2-8fb5-4e7e-a949-288f202b50fb admin admin] SCRIPT_NAME: `/identity` {{(pid=71938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 24 17:04:20.080381 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f7e6de2-8fb5-4e7e-a949-288f202b50fb admin admin] PATH_INFO: `/v3/projects/d9ae47a13fb045c1b51b0b311719773e` {{(pid=71938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 24 17:04:20.081602 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f7e6de2-8fb5-4e7e-a949-288f202b50fb admin admin] RBAC: Authorizing `identity:delete_project(project_id=d9ae47a13fb045c1b51b0b311719773e)` {{(pid=71938) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:442}} Nov 24 17:04:20.111080 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f7e6de2-8fb5-4e7e-a949-288f202b50fb admin admin] RBAC: Authorization granted {{(pid=71938) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 24 17:04:20.163057 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.notifications [None req-2f7e6de2-8fb5-4e7e-a949-288f202b50fb admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd9ae47a13fb045c1b51b0b311719773e', 'request_id': 'req-2f7e6de2-8fb5-4e7e-a949-288f202b50fb'} {{(pid=71938) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:357}} Nov 24 17:04:20.175099 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.notifications [None req-2f7e6de2-8fb5-4e7e-a949-288f202b50fb admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd9ae47a13fb045c1b51b0b311719773e', 'request_id': 'req-2f7e6de2-8fb5-4e7e-a949-288f202b50fb'} {{(pid=71938) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:357}} Nov 24 17:04:20.180489 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.notifications [None req-2f7e6de2-8fb5-4e7e-a949-288f202b50fb admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd9ae47a13fb045c1b51b0b311719773e', 'request_id': 'req-2f7e6de2-8fb5-4e7e-a949-288f202b50fb'} {{(pid=71938) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:357}} Nov 24 17:04:20.192754 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.notifications [None req-2f7e6de2-8fb5-4e7e-a949-288f202b50fb admin admin] The token cache is being invalidate because project d9ae47a13fb045c1b51b0b311719773e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=71938) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Nov 24 17:04:20.193087 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.notifications [None req-2f7e6de2-8fb5-4e7e-a949-288f202b50fb admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=71938) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:357}} Nov 24 17:04:20.193777 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.notifications [None req-2f7e6de2-8fb5-4e7e-a949-288f202b50fb admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=71938) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:357}} Nov 24 17:04:20.195399 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: [pid: 71938|app: 0|req: 1446/2904] 10.222.0.53 () {58 vars in 1223 bytes} [Wed Nov 24 17:04:19 2021] DELETE /identity/v3/projects/d9ae47a13fb045c1b51b0b311719773e => generated 0 bytes in 198 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 24 17:04:20.200241 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98ecd4b8-5a65-494d-bc65-9966c9b14199 admin admin] Authenticating user token {{(pid=71939) process_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 24 17:04:20.201724 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.fernet_utils [None req-98ecd4b8-5a65-494d-bc65-9966c9b14199 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=71939) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:289}} Nov 24 17:04:20.214954 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98ecd4b8-5a65-494d-bc65-9966c9b14199 admin admin] Validating token access rules against request {{(pid=71939) validate_allowed_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 24 17:04:20.280908 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bb4ffb5-bbeb-4d4e-92fc-975dda4ec887 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f2ba2e8375b4e8c8792ee1e22b60427', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '00a5583c7b7443e98e7a1d31a0b638dc', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=71939) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 24 17:04:20.281750 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bb4ffb5-bbeb-4d4e-92fc-975dda4ec887 admin admin] REQUEST_METHOD: `DELETE` {{(pid=71939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 24 17:04:20.282117 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bb4ffb5-bbeb-4d4e-92fc-975dda4ec887 admin admin] SCRIPT_NAME: `/identity` {{(pid=71939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 24 17:04:20.282454 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bb4ffb5-bbeb-4d4e-92fc-975dda4ec887 admin admin] PATH_INFO: `/v3/users/c3137f03150d46e6a7b86b899159a123` {{(pid=71939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 24 17:04:20.283671 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bb4ffb5-bbeb-4d4e-92fc-975dda4ec887 admin admin] RBAC: Authorizing `identity:delete_user(user_id=c3137f03150d46e6a7b86b899159a123)` {{(pid=71939) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:442}} Nov 24 17:04:20.312782 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bb4ffb5-bbeb-4d4e-92fc-975dda4ec887 admin admin] RBAC: Authorization granted {{(pid=71939) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 24 17:04:20.360260 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.notifications [None req-7bb4ffb5-bbeb-4d4e-92fc-975dda4ec887 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c3137f03150d46e6a7b86b899159a123'} {{(pid=71939) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:357}} Nov 24 17:04:20.372926 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.notifications [None req-7bb4ffb5-bbeb-4d4e-92fc-975dda4ec887 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c3137f03150d46e6a7b86b899159a123'} {{(pid=71939) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:357}} Nov 24 17:04:20.373646 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.notifications [None req-7bb4ffb5-bbeb-4d4e-92fc-975dda4ec887 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c3137f03150d46e6a7b86b899159a123'} {{(pid=71939) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:357}} Nov 24 17:04:20.381732 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.notifications [None req-7bb4ffb5-bbeb-4d4e-92fc-975dda4ec887 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c3137f03150d46e6a7b86b899159a123'} {{(pid=71939) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:357}} Nov 24 17:04:20.388455 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.notifications [None req-7bb4ffb5-bbeb-4d4e-92fc-975dda4ec887 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c3137f03150d46e6a7b86b899159a123'} {{(pid=71939) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:357}} Nov 24 17:04:20.394841 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: [pid: 71939|app: 0|req: 1459/2905] 10.222.0.53 () {58 vars in 1214 bytes} [Wed Nov 24 17:04:20 2021] DELETE /identity/v3/users/c3137f03150d46e6a7b86b899159a123 => generated 0 bytes in 195 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 24 17:04:20.759558 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f7e6de2-8fb5-4e7e-a949-288f202b50fb admin admin] Authenticating user token {{(pid=71938) process_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 24 17:04:20.761137 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.fernet_utils [None req-2f7e6de2-8fb5-4e7e-a949-288f202b50fb admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=71938) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:289}} Nov 24 17:04:20.773526 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f7e6de2-8fb5-4e7e-a949-288f202b50fb admin admin] Validating token access rules against request {{(pid=71938) validate_allowed_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 24 17:04:20.841029 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8eab461-2c93-412e-99a3-e7d012521122 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f2ba2e8375b4e8c8792ee1e22b60427', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '00a5583c7b7443e98e7a1d31a0b638dc', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=71938) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 24 17:04:20.841937 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8eab461-2c93-412e-99a3-e7d012521122 admin admin] REQUEST_METHOD: `DELETE` {{(pid=71938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 24 17:04:20.842310 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8eab461-2c93-412e-99a3-e7d012521122 admin admin] SCRIPT_NAME: `/identity` {{(pid=71938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 24 17:04:20.842924 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8eab461-2c93-412e-99a3-e7d012521122 admin admin] PATH_INFO: `/v3/projects/21aecd0586eb47f9a3d9ab1af75a384f` {{(pid=71938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 24 17:04:20.844947 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8eab461-2c93-412e-99a3-e7d012521122 admin admin] RBAC: Authorizing `identity:delete_project(project_id=21aecd0586eb47f9a3d9ab1af75a384f)` {{(pid=71938) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:442}} Nov 24 17:04:20.878398 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8eab461-2c93-412e-99a3-e7d012521122 admin admin] RBAC: Authorization granted {{(pid=71938) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 24 17:04:20.929975 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.notifications [None req-f8eab461-2c93-412e-99a3-e7d012521122 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '21aecd0586eb47f9a3d9ab1af75a384f', 'request_id': 'req-f8eab461-2c93-412e-99a3-e7d012521122'} {{(pid=71938) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:357}} Nov 24 17:04:20.942800 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.notifications [None req-f8eab461-2c93-412e-99a3-e7d012521122 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '21aecd0586eb47f9a3d9ab1af75a384f', 'request_id': 'req-f8eab461-2c93-412e-99a3-e7d012521122'} {{(pid=71938) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:357}} Nov 24 17:04:20.948185 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.notifications [None req-f8eab461-2c93-412e-99a3-e7d012521122 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '21aecd0586eb47f9a3d9ab1af75a384f', 'request_id': 'req-f8eab461-2c93-412e-99a3-e7d012521122'} {{(pid=71938) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:357}} Nov 24 17:04:20.959141 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.notifications [None req-f8eab461-2c93-412e-99a3-e7d012521122 admin admin] The token cache is being invalidate because project 21aecd0586eb47f9a3d9ab1af75a384f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=71938) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Nov 24 17:04:20.959475 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.notifications [None req-f8eab461-2c93-412e-99a3-e7d012521122 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=71938) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:357}} Nov 24 17:04:20.960143 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.notifications [None req-f8eab461-2c93-412e-99a3-e7d012521122 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=71938) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:357}} Nov 24 17:04:20.961698 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: [pid: 71938|app: 0|req: 1447/2906] 10.222.0.53 () {58 vars in 1223 bytes} [Wed Nov 24 17:04:20 2021] DELETE /identity/v3/projects/21aecd0586eb47f9a3d9ab1af75a384f => generated 0 bytes in 203 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 24 17:04:20.969587 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abd34266-d37f-4094-936d-6d95568c5470 None None] REQUEST_METHOD: `POST` {{(pid=71939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 24 17:04:20.969941 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abd34266-d37f-4094-936d-6d95568c5470 None None] SCRIPT_NAME: `/identity` {{(pid=71939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 24 17:04:20.970317 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abd34266-d37f-4094-936d-6d95568c5470 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=71939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 24 17:04:20.994951 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.auth.core [None req-abd34266-d37f-4094-936d-6d95568c5470 None None] MFA Rules not processed for user `0f2ba2e8375b4e8c8792ee1e22b60427`. Rule list: `[]` (Enabled: `True`). {{(pid=71939) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:442}} Nov 24 17:04:20.996177 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.fernet_utils [None req-abd34266-d37f-4094-936d-6d95568c5470 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=71939) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:289}} Nov 24 17:04:21.064095 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: [pid: 71939|app: 0|req: 1460/2907] 10.222.0.53 () {58 vars in 948 bytes} [Wed Nov 24 17:04:20 2021] POST /identity/v3/auth/tokens => generated 3669 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 24 17:04:21.073366 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89041a24-79d7-4986-a133-0844b088c356 None None] REQUEST_METHOD: `POST` {{(pid=71938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 24 17:04:21.073716 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89041a24-79d7-4986-a133-0844b088c356 None None] SCRIPT_NAME: `/identity` {{(pid=71938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 24 17:04:21.074125 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89041a24-79d7-4986-a133-0844b088c356 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=71938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 24 17:04:21.098055 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.auth.core [None req-89041a24-79d7-4986-a133-0844b088c356 None None] MFA Rules not processed for user `0f2ba2e8375b4e8c8792ee1e22b60427`. Rule list: `[]` (Enabled: `True`). {{(pid=71938) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:442}} Nov 24 17:04:21.099266 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.fernet_utils [None req-89041a24-79d7-4986-a133-0844b088c356 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=71938) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:289}} Nov 24 17:04:21.107216 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: [pid: 71938|app: 0|req: 1448/2908] 10.222.0.53 () {58 vars in 948 bytes} [Wed Nov 24 17:04:21 2021] POST /identity/v3/auth/tokens => generated 3669 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 24 17:04:21.111591 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abd34266-d37f-4094-936d-6d95568c5470 None None] Authenticating user token {{(pid=71939) process_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 24 17:04:21.121307 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abd34266-d37f-4094-936d-6d95568c5470 None None] Validating token access rules against request {{(pid=71939) validate_allowed_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 24 17:04:21.125821 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a97e252-c5e9-444b-b14e-54b52d1e1535 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f2ba2e8375b4e8c8792ee1e22b60427', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '00a5583c7b7443e98e7a1d31a0b638dc', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=71939) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 24 17:04:21.126515 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a97e252-c5e9-444b-b14e-54b52d1e1535 admin admin] REQUEST_METHOD: `GET` {{(pid=71939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 24 17:04:21.126861 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a97e252-c5e9-444b-b14e-54b52d1e1535 admin admin] SCRIPT_NAME: `/identity` {{(pid=71939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 24 17:04:21.127195 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a97e252-c5e9-444b-b14e-54b52d1e1535 admin admin] PATH_INFO: `/v3/domains` {{(pid=71939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 24 17:04:21.127986 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a97e252-c5e9-444b-b14e-54b52d1e1535 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=71939) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:161}} Nov 24 17:04:21.128339 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a97e252-c5e9-444b-b14e-54b52d1e1535 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=71939) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:442}} Nov 24 17:04:21.156623 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a97e252-c5e9-444b-b14e-54b52d1e1535 admin admin] RBAC: Authorization granted {{(pid=71939) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 24 17:04:21.174678 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: [pid: 71939|app: 0|req: 1461/2909] 10.222.0.53 () {58 vars in 1143 bytes} [Wed Nov 24 17:04:21 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 63 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 24 17:04:21.179654 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89041a24-79d7-4986-a133-0844b088c356 None None] Authenticating user token {{(pid=71938) process_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 24 17:04:21.189608 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89041a24-79d7-4986-a133-0844b088c356 None None] Validating token access rules against request {{(pid=71938) validate_allowed_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 24 17:04:21.194615 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-963d0180-feef-4dde-b6ac-f8d5b52bfcb3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f2ba2e8375b4e8c8792ee1e22b60427', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '00a5583c7b7443e98e7a1d31a0b638dc', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=71938) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 24 17:04:21.195291 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-963d0180-feef-4dde-b6ac-f8d5b52bfcb3 admin admin] REQUEST_METHOD: `POST` {{(pid=71938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 24 17:04:21.195633 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-963d0180-feef-4dde-b6ac-f8d5b52bfcb3 admin admin] SCRIPT_NAME: `/identity` {{(pid=71938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 24 17:04:21.195972 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-963d0180-feef-4dde-b6ac-f8d5b52bfcb3 admin admin] PATH_INFO: `/v3/projects` {{(pid=71938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 24 17:04:21.196715 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-963d0180-feef-4dde-b6ac-f8d5b52bfcb3 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=71938) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:442}} Nov 24 17:04:21.226460 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-963d0180-feef-4dde-b6ac-f8d5b52bfcb3 admin admin] RBAC: Authorization granted {{(pid=71938) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 24 17:04:21.254843 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: [pid: 71938|app: 0|req: 1449/2910] 10.222.0.53 () {60 vars in 1143 bytes} [Wed Nov 24 17:04:21 2021] POST /identity/v3/projects => generated 375 bytes in 76 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 24 17:04:21.259491 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a97e252-c5e9-444b-b14e-54b52d1e1535 admin admin] Authenticating user token {{(pid=71939) process_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 24 17:04:21.269539 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a97e252-c5e9-444b-b14e-54b52d1e1535 admin admin] Validating token access rules against request {{(pid=71939) validate_allowed_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 24 17:04:21.336256 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52e32238-fb58-452b-8c7b-e86d56d91fda admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f2ba2e8375b4e8c8792ee1e22b60427', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '00a5583c7b7443e98e7a1d31a0b638dc', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=71939) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 24 17:04:21.336881 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52e32238-fb58-452b-8c7b-e86d56d91fda admin admin] REQUEST_METHOD: `POST` {{(pid=71939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 24 17:04:21.337192 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52e32238-fb58-452b-8c7b-e86d56d91fda admin admin] SCRIPT_NAME: `/identity` {{(pid=71939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 24 17:04:21.337520 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52e32238-fb58-452b-8c7b-e86d56d91fda admin admin] PATH_INFO: `/v3/users` {{(pid=71939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 24 17:04:21.338274 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52e32238-fb58-452b-8c7b-e86d56d91fda admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=71939) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:442}} Nov 24 17:04:21.366373 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52e32238-fb58-452b-8c7b-e86d56d91fda admin admin] RBAC: Authorization granted {{(pid=71939) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 24 17:04:21.389957 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: [pid: 71939|app: 0|req: 1462/2911] 10.222.0.53 () {60 vars in 1134 bytes} [Wed Nov 24 17:04:21 2021] POST /identity/v3/users => generated 288 bytes in 131 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 24 17:04:21.394691 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-963d0180-feef-4dde-b6ac-f8d5b52bfcb3 admin admin] Authenticating user token {{(pid=71938) process_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 24 17:04:21.405405 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-963d0180-feef-4dde-b6ac-f8d5b52bfcb3 admin admin] Validating token access rules against request {{(pid=71938) validate_allowed_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 24 17:04:21.410014 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a423e3d8-c479-433e-9531-5057fb86855e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f2ba2e8375b4e8c8792ee1e22b60427', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '00a5583c7b7443e98e7a1d31a0b638dc', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=71938) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 24 17:04:21.410722 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a423e3d8-c479-433e-9531-5057fb86855e admin admin] REQUEST_METHOD: `GET` {{(pid=71938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 24 17:04:21.411063 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a423e3d8-c479-433e-9531-5057fb86855e admin admin] SCRIPT_NAME: `/identity` {{(pid=71938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 24 17:04:21.411400 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a423e3d8-c479-433e-9531-5057fb86855e admin admin] PATH_INFO: `/v3/roles` {{(pid=71938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 24 17:04:21.412189 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a423e3d8-c479-433e-9531-5057fb86855e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=71938) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:442}} Nov 24 17:04:21.441751 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a423e3d8-c479-433e-9531-5057fb86855e admin admin] RBAC: Authorization granted {{(pid=71938) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 24 17:04:21.452746 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: [pid: 71938|app: 0|req: 1450/2912] 10.222.0.53 () {58 vars in 1112 bytes} [Wed Nov 24 17:04:21 2021] GET /identity/v3/roles => generated 1420 bytes in 59 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 24 17:04:21.457337 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52e32238-fb58-452b-8c7b-e86d56d91fda admin admin] Authenticating user token {{(pid=71939) process_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 24 17:04:21.467324 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52e32238-fb58-452b-8c7b-e86d56d91fda admin admin] Validating token access rules against request {{(pid=71939) validate_allowed_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 24 17:04:21.471913 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a80e63f6-9202-40eb-b602-c7f02cc7938f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f2ba2e8375b4e8c8792ee1e22b60427', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '00a5583c7b7443e98e7a1d31a0b638dc', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=71939) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 24 17:04:21.472800 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a80e63f6-9202-40eb-b602-c7f02cc7938f admin admin] REQUEST_METHOD: `PUT` {{(pid=71939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 24 17:04:21.473140 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a80e63f6-9202-40eb-b602-c7f02cc7938f admin admin] SCRIPT_NAME: `/identity` {{(pid=71939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 24 17:04:21.473470 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a80e63f6-9202-40eb-b602-c7f02cc7938f admin admin] PATH_INFO: `/v3/projects/543c1afa7d454789b2edd14581b0e490/users/a47210f8ba0149278a371328745ae38b/roles/912ab5f10fa5477da74acf239f07604e` {{(pid=71939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 24 17:04:21.495307 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a80e63f6-9202-40eb-b602-c7f02cc7938f admin admin] RBAC: Authorizing `identity:create_grant(project_id=543c1afa7d454789b2edd14581b0e490, user_id=a47210f8ba0149278a371328745ae38b, role_id=912ab5f10fa5477da74acf239f07604e)` {{(pid=71939) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:442}} Nov 24 17:04:21.524267 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a80e63f6-9202-40eb-b602-c7f02cc7938f admin admin] RBAC: Authorization granted {{(pid=71939) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 24 17:04:21.536361 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: [pid: 71939|app: 0|req: 1463/2913] 10.222.0.53 () {60 vars in 1473 bytes} [Wed Nov 24 17:04:21 2021] PUT /identity/v3/projects/543c1afa7d454789b2edd14581b0e490/users/a47210f8ba0149278a371328745ae38b/roles/912ab5f10fa5477da74acf239f07604e => generated 0 bytes in 80 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 24 17:04:21.547622 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72baee80-7a6d-40a1-8ec7-27aa47666157 None None] REQUEST_METHOD: `POST` {{(pid=71938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 24 17:04:21.547971 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72baee80-7a6d-40a1-8ec7-27aa47666157 None None] SCRIPT_NAME: `/identity` {{(pid=71938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 24 17:04:21.548304 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72baee80-7a6d-40a1-8ec7-27aa47666157 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=71938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 24 17:04:21.589031 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.auth.core [None req-72baee80-7a6d-40a1-8ec7-27aa47666157 None None] MFA Rules not processed for user `a47210f8ba0149278a371328745ae38b`. Rule list: `[]` (Enabled: `True`). {{(pid=71938) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:442}} Nov 24 17:04:21.590245 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.fernet_utils [None req-72baee80-7a6d-40a1-8ec7-27aa47666157 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=71938) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:289}} Nov 24 17:04:21.668305 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: [pid: 71938|app: 0|req: 1451/2914] 10.222.0.53 () {58 vars in 948 bytes} [Wed Nov 24 17:04:21 2021] POST /identity/v3/auth/tokens => generated 3682 bytes in 122 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 24 17:04:21.678258 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a80e63f6-9202-40eb-b602-c7f02cc7938f admin admin] Authenticating user token {{(pid=71939) process_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 24 17:04:21.680011 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.fernet_utils [None req-a80e63f6-9202-40eb-b602-c7f02cc7938f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=71939) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:289}} Nov 24 17:04:21.748778 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a80e63f6-9202-40eb-b602-c7f02cc7938f admin admin] Validating token access rules against request {{(pid=71939) validate_allowed_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 24 17:04:21.752436 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-407480fd-f096-4585-9a22-8113dcbfcecf service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a12374a3093a401a97c343ff0854184d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3b3940d4ae1c4177ae29c02377bb4b0b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=71939) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 24 17:04:21.753095 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-407480fd-f096-4585-9a22-8113dcbfcecf service cinder] REQUEST_METHOD: `GET` {{(pid=71939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 24 17:04:21.753432 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-407480fd-f096-4585-9a22-8113dcbfcecf service cinder] SCRIPT_NAME: `/identity` {{(pid=71939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 24 17:04:21.753812 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-407480fd-f096-4585-9a22-8113dcbfcecf service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=71939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 24 17:04:21.766861 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-407480fd-f096-4585-9a22-8113dcbfcecf service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=71939) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:442}} Nov 24 17:04:21.795573 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-407480fd-f096-4585-9a22-8113dcbfcecf service cinder] RBAC: Authorization granted {{(pid=71939) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 24 17:04:21.804596 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: [pid: 71939|app: 0|req: 1464/2915] 10.222.0.53 () {60 vars in 1356 bytes} [Wed Nov 24 17:04:21 2021] GET /identity/v3/auth/tokens => generated 3682 bytes in 127 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 24 17:04:33.004064 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72baee80-7a6d-40a1-8ec7-27aa47666157 None None] Authenticating user token {{(pid=71938) process_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 24 17:04:33.080582 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72baee80-7a6d-40a1-8ec7-27aa47666157 None None] Validating token access rules against request {{(pid=71938) validate_allowed_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 24 17:04:33.083947 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bea1d885-4984-44b0-a8bd-42a2c8c5fa8a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f2ba2e8375b4e8c8792ee1e22b60427', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '00a5583c7b7443e98e7a1d31a0b638dc', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=71938) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 24 17:04:33.084844 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bea1d885-4984-44b0-a8bd-42a2c8c5fa8a admin admin] REQUEST_METHOD: `DELETE` {{(pid=71938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 24 17:04:33.085185 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bea1d885-4984-44b0-a8bd-42a2c8c5fa8a admin admin] SCRIPT_NAME: `/identity` {{(pid=71938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 24 17:04:33.085523 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bea1d885-4984-44b0-a8bd-42a2c8c5fa8a admin admin] PATH_INFO: `/v3/users/a47210f8ba0149278a371328745ae38b` {{(pid=71938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 24 17:04:33.086798 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bea1d885-4984-44b0-a8bd-42a2c8c5fa8a admin admin] RBAC: Authorizing `identity:delete_user(user_id=a47210f8ba0149278a371328745ae38b)` {{(pid=71938) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:442}} Nov 24 17:04:33.115143 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bea1d885-4984-44b0-a8bd-42a2c8c5fa8a admin admin] RBAC: Authorization granted {{(pid=71938) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 24 17:04:33.163747 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.notifications [None req-bea1d885-4984-44b0-a8bd-42a2c8c5fa8a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a47210f8ba0149278a371328745ae38b'} {{(pid=71938) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:357}} Nov 24 17:04:33.175938 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.notifications [None req-bea1d885-4984-44b0-a8bd-42a2c8c5fa8a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a47210f8ba0149278a371328745ae38b'} {{(pid=71938) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:357}} Nov 24 17:04:33.176657 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.notifications [None req-bea1d885-4984-44b0-a8bd-42a2c8c5fa8a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a47210f8ba0149278a371328745ae38b'} {{(pid=71938) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:357}} Nov 24 17:04:33.185710 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.notifications [None req-bea1d885-4984-44b0-a8bd-42a2c8c5fa8a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a47210f8ba0149278a371328745ae38b'} {{(pid=71938) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:357}} Nov 24 17:04:33.191905 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.notifications [None req-bea1d885-4984-44b0-a8bd-42a2c8c5fa8a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a47210f8ba0149278a371328745ae38b'} {{(pid=71938) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:357}} Nov 24 17:04:33.198783 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: [pid: 71938|app: 0|req: 1452/2916] 10.222.0.53 () {58 vars in 1214 bytes} [Wed Nov 24 17:04:33 2021] DELETE /identity/v3/users/a47210f8ba0149278a371328745ae38b => generated 0 bytes in 195 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 24 17:04:33.203659 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f136a323-ce73-4ba5-9729-fdf349c1b61a None None] REQUEST_METHOD: `POST` {{(pid=71939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 24 17:04:33.203962 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f136a323-ce73-4ba5-9729-fdf349c1b61a None None] SCRIPT_NAME: `/identity` {{(pid=71939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 24 17:04:33.204302 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f136a323-ce73-4ba5-9729-fdf349c1b61a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=71939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 24 17:04:33.227391 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.auth.core [None req-f136a323-ce73-4ba5-9729-fdf349c1b61a None None] MFA Rules not processed for user `0f2ba2e8375b4e8c8792ee1e22b60427`. Rule list: `[]` (Enabled: `True`). {{(pid=71939) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:442}} Nov 24 17:04:33.228612 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.fernet_utils [None req-f136a323-ce73-4ba5-9729-fdf349c1b61a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=71939) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:289}} Nov 24 17:04:33.295312 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: [pid: 71939|app: 0|req: 1465/2917] 10.222.0.53 () {58 vars in 948 bytes} [Wed Nov 24 17:04:33 2021] POST /identity/v3/auth/tokens => generated 3669 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 24 17:04:33.307108 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bea1d885-4984-44b0-a8bd-42a2c8c5fa8a admin admin] Authenticating user token {{(pid=71938) process_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 24 17:04:33.308571 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.fernet_utils [None req-bea1d885-4984-44b0-a8bd-42a2c8c5fa8a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=71938) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:289}} Nov 24 17:04:33.376426 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bea1d885-4984-44b0-a8bd-42a2c8c5fa8a admin admin] Validating token access rules against request {{(pid=71938) validate_allowed_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 24 17:04:33.380158 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea2cbf8f-efe5-4b09-b009-85948532611c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c90f21b9cdcb413282461fa83cb6b7a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3b3940d4ae1c4177ae29c02377bb4b0b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=71938) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 24 17:04:33.380818 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea2cbf8f-efe5-4b09-b009-85948532611c service neutron] REQUEST_METHOD: `GET` {{(pid=71938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 24 17:04:33.381204 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea2cbf8f-efe5-4b09-b009-85948532611c service neutron] SCRIPT_NAME: `/identity` {{(pid=71938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 24 17:04:33.381543 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea2cbf8f-efe5-4b09-b009-85948532611c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=71938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 24 17:04:33.395547 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea2cbf8f-efe5-4b09-b009-85948532611c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=71938) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:442}} Nov 24 17:04:33.432528 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea2cbf8f-efe5-4b09-b009-85948532611c service neutron] RBAC: Authorization granted {{(pid=71938) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 24 17:04:33.442712 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: [pid: 71938|app: 0|req: 1453/2918] 10.222.0.53 () {60 vars in 1356 bytes} [Wed Nov 24 17:04:33 2021] GET /identity/v3/auth/tokens => generated 3669 bytes in 137 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Nov 24 17:04:33.814686 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f136a323-ce73-4ba5-9729-fdf349c1b61a None None] Authenticating user token {{(pid=71939) process_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 24 17:04:33.816176 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.fernet_utils [None req-f136a323-ce73-4ba5-9729-fdf349c1b61a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=71939) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:289}} Nov 24 17:04:33.838331 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f136a323-ce73-4ba5-9729-fdf349c1b61a None None] Validating token access rules against request {{(pid=71939) validate_allowed_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 24 17:04:33.849782 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a01b415e-bf98-4356-87dd-1eca36695ddc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f2ba2e8375b4e8c8792ee1e22b60427', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '00a5583c7b7443e98e7a1d31a0b638dc', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=71939) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 24 17:04:33.850725 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a01b415e-bf98-4356-87dd-1eca36695ddc admin admin] REQUEST_METHOD: `DELETE` {{(pid=71939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 24 17:04:33.851102 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a01b415e-bf98-4356-87dd-1eca36695ddc admin admin] SCRIPT_NAME: `/identity` {{(pid=71939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 24 17:04:33.851341 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a01b415e-bf98-4356-87dd-1eca36695ddc admin admin] PATH_INFO: `/v3/projects/543c1afa7d454789b2edd14581b0e490` {{(pid=71939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 24 17:04:33.853223 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a01b415e-bf98-4356-87dd-1eca36695ddc admin admin] RBAC: Authorizing `identity:delete_project(project_id=543c1afa7d454789b2edd14581b0e490)` {{(pid=71939) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:442}} Nov 24 17:04:33.881694 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a01b415e-bf98-4356-87dd-1eca36695ddc admin admin] RBAC: Authorization granted {{(pid=71939) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 24 17:04:33.932768 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.notifications [None req-a01b415e-bf98-4356-87dd-1eca36695ddc admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '543c1afa7d454789b2edd14581b0e490', 'request_id': 'req-a01b415e-bf98-4356-87dd-1eca36695ddc'} {{(pid=71939) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:357}} Nov 24 17:04:33.944485 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.notifications [None req-a01b415e-bf98-4356-87dd-1eca36695ddc admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '543c1afa7d454789b2edd14581b0e490', 'request_id': 'req-a01b415e-bf98-4356-87dd-1eca36695ddc'} {{(pid=71939) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:357}} Nov 24 17:04:33.950420 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.notifications [None req-a01b415e-bf98-4356-87dd-1eca36695ddc admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '543c1afa7d454789b2edd14581b0e490', 'request_id': 'req-a01b415e-bf98-4356-87dd-1eca36695ddc'} {{(pid=71939) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:357}} Nov 24 17:04:33.960715 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.notifications [None req-a01b415e-bf98-4356-87dd-1eca36695ddc admin admin] The token cache is being invalidate because project 543c1afa7d454789b2edd14581b0e490 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=71939) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Nov 24 17:04:33.961047 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.notifications [None req-a01b415e-bf98-4356-87dd-1eca36695ddc admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=71939) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:357}} Nov 24 17:04:33.962250 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.notifications [None req-a01b415e-bf98-4356-87dd-1eca36695ddc admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=71939) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:357}} Nov 24 17:04:33.963766 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: [pid: 71939|app: 0|req: 1466/2919] 10.222.0.53 () {58 vars in 1223 bytes} [Wed Nov 24 17:04:33 2021] DELETE /identity/v3/projects/543c1afa7d454789b2edd14581b0e490 => generated 0 bytes in 150 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 24 17:05:13.228566 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea2cbf8f-efe5-4b09-b009-85948532611c service neutron] Authenticating user token {{(pid=71938) process_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 24 17:05:13.230064 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.fernet_utils [None req-ea2cbf8f-efe5-4b09-b009-85948532611c service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=71938) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:289}} Nov 24 17:05:13.298346 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea2cbf8f-efe5-4b09-b009-85948532611c service neutron] Validating token access rules against request {{(pid=71938) validate_allowed_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 24 17:05:13.355843 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fb67b58-45ae-43db-b9ee-99cf48045343 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a12374a3093a401a97c343ff0854184d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3b3940d4ae1c4177ae29c02377bb4b0b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=71938) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 24 17:05:13.356496 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fb67b58-45ae-43db-b9ee-99cf48045343 service cinder] REQUEST_METHOD: `GET` {{(pid=71938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 24 17:05:13.356830 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fb67b58-45ae-43db-b9ee-99cf48045343 service cinder] SCRIPT_NAME: `/identity` {{(pid=71938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 24 17:05:13.357155 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fb67b58-45ae-43db-b9ee-99cf48045343 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=71938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 24 17:05:13.358960 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.fernet_utils [None req-3fb67b58-45ae-43db-b9ee-99cf48045343 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=71938) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:289}} Nov 24 17:05:13.460879 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fb67b58-45ae-43db-b9ee-99cf48045343 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=71938) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:442}} Nov 24 17:05:13.489134 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fb67b58-45ae-43db-b9ee-99cf48045343 service cinder] RBAC: Authorization granted {{(pid=71938) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 24 17:05:13.510845 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: [pid: 71938|app: 0|req: 1454/2920] 10.222.0.53 () {60 vars in 1356 bytes} [Wed Nov 24 17:05:13 2021] GET /identity/v3/auth/tokens => generated 3692 bytes in 283 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 24 17:06:19.279495 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a01b415e-bf98-4356-87dd-1eca36695ddc admin admin] Authenticating user token {{(pid=71939) process_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 24 17:06:19.281048 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.fernet_utils [None req-a01b415e-bf98-4356-87dd-1eca36695ddc admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=71939) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:289}} Nov 24 17:06:19.350123 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a01b415e-bf98-4356-87dd-1eca36695ddc admin admin] Validating token access rules against request {{(pid=71939) validate_allowed_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 24 17:06:19.353690 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68497ec8-626b-42ad-9536-80e326ec2b54 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c90f21b9cdcb413282461fa83cb6b7a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3b3940d4ae1c4177ae29c02377bb4b0b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=71939) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 24 17:06:19.354362 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68497ec8-626b-42ad-9536-80e326ec2b54 service neutron] REQUEST_METHOD: `GET` {{(pid=71939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 24 17:06:19.354699 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68497ec8-626b-42ad-9536-80e326ec2b54 service neutron] SCRIPT_NAME: `/identity` {{(pid=71939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 24 17:06:19.355029 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68497ec8-626b-42ad-9536-80e326ec2b54 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=71939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 24 17:06:19.356865 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.fernet_utils [None req-68497ec8-626b-42ad-9536-80e326ec2b54 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=71939) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:289}} Nov 24 17:06:19.366983 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68497ec8-626b-42ad-9536-80e326ec2b54 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=71939) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:442}} Nov 24 17:06:19.394501 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68497ec8-626b-42ad-9536-80e326ec2b54 service neutron] RBAC: Authorization granted {{(pid=71939) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 24 17:06:19.402727 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: [pid: 71939|app: 0|req: 1467/2921] 10.222.0.53 () {60 vars in 1356 bytes} [Wed Nov 24 17:06:19 2021] GET /identity/v3/auth/tokens => generated 3551 bytes in 124 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 24 17:06:26.108641 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fb67b58-45ae-43db-b9ee-99cf48045343 service cinder] Authenticating user token {{(pid=71938) process_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 24 17:06:26.110182 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.fernet_utils [None req-3fb67b58-45ae-43db-b9ee-99cf48045343 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=71938) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:289}} Nov 24 17:06:26.121122 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fb67b58-45ae-43db-b9ee-99cf48045343 service cinder] Validating token access rules against request {{(pid=71938) validate_allowed_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 24 17:06:26.125297 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3831b23-2a9f-47b5-9a9d-93357d36eee2 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a12374a3093a401a97c343ff0854184d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3b3940d4ae1c4177ae29c02377bb4b0b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=71938) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 24 17:06:26.125957 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3831b23-2a9f-47b5-9a9d-93357d36eee2 service cinder] REQUEST_METHOD: `GET` {{(pid=71938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 24 17:06:26.126358 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3831b23-2a9f-47b5-9a9d-93357d36eee2 service cinder] SCRIPT_NAME: `/identity` {{(pid=71938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 24 17:06:26.126714 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3831b23-2a9f-47b5-9a9d-93357d36eee2 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=71938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 24 17:06:26.128511 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.fernet_utils [None req-f3831b23-2a9f-47b5-9a9d-93357d36eee2 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=71938) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:289}} Nov 24 17:06:26.197791 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3831b23-2a9f-47b5-9a9d-93357d36eee2 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=71938) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:442}} Nov 24 17:06:26.241648 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3831b23-2a9f-47b5-9a9d-93357d36eee2 service cinder] RBAC: Authorization granted {{(pid=71938) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 24 17:06:26.253618 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: [pid: 71938|app: 0|req: 1455/2922] 10.222.0.53 () {60 vars in 1356 bytes} [Wed Nov 24 17:06:26 2021] GET /identity/v3/auth/tokens => generated 3690 bytes in 146 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 24 17:07:17.974505 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68497ec8-626b-42ad-9536-80e326ec2b54 service neutron] Authenticating user token {{(pid=71939) process_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 24 17:07:17.975953 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.fernet_utils [None req-68497ec8-626b-42ad-9536-80e326ec2b54 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=71939) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:289}} Nov 24 17:07:18.056005 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68497ec8-626b-42ad-9536-80e326ec2b54 service neutron] Validating token access rules against request {{(pid=71939) validate_allowed_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 24 17:07:18.061612 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3caa5e3-da23-4f81-b06d-a682ce38da1e service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a919320c9e2a48d7ba33453b5929d7ee', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3b3940d4ae1c4177ae29c02377bb4b0b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=71939) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 24 17:07:18.062300 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3caa5e3-da23-4f81-b06d-a682ce38da1e service placement] REQUEST_METHOD: `GET` {{(pid=71939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 24 17:07:18.062643 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3caa5e3-da23-4f81-b06d-a682ce38da1e service placement] SCRIPT_NAME: `/identity` {{(pid=71939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 24 17:07:18.062979 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3caa5e3-da23-4f81-b06d-a682ce38da1e service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=71939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 24 17:07:18.064809 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.fernet_utils [None req-e3caa5e3-da23-4f81-b06d-a682ce38da1e service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=71939) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:289}} Nov 24 17:07:18.076043 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3caa5e3-da23-4f81-b06d-a682ce38da1e service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=71939) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:442}} Nov 24 17:07:18.104233 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3caa5e3-da23-4f81-b06d-a682ce38da1e service placement] RBAC: Authorization granted {{(pid=71939) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 24 17:07:18.114944 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: [pid: 71939|app: 0|req: 1468/2923] 10.222.0.53 () {60 vars in 1356 bytes} [Wed Nov 24 17:07:17 2021] GET /identity/v3/auth/tokens => generated 3738 bytes in 141 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 24 17:07:42.802924 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36024ddc-3825-4e97-8e19-94a7311c05e9 None None] REQUEST_METHOD: `POST` {{(pid=71938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 24 17:07:42.803535 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36024ddc-3825-4e97-8e19-94a7311c05e9 None None] SCRIPT_NAME: `/identity` {{(pid=71938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 24 17:07:42.803667 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36024ddc-3825-4e97-8e19-94a7311c05e9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=71938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 24 17:07:42.841932 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.auth.core [None req-36024ddc-3825-4e97-8e19-94a7311c05e9 None None] MFA Rules not processed for user `15ece405347842a29fbc06f934028a84`. Rule list: `[]` (Enabled: `True`). {{(pid=71938) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:442}} Nov 24 17:07:42.843190 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.fernet_utils [None req-36024ddc-3825-4e97-8e19-94a7311c05e9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=71938) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:289}} Nov 24 17:07:42.849907 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: [pid: 71938|app: 0|req: 1456/2924] 10.222.0.53 () {58 vars in 948 bytes} [Wed Nov 24 17:07:42 2021] POST /identity/v3/auth/tokens => generated 3692 bytes in 48 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 24 17:07:43.246402 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3caa5e3-da23-4f81-b06d-a682ce38da1e service placement] Authenticating user token {{(pid=71939) process_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 24 17:07:43.256135 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3caa5e3-da23-4f81-b06d-a682ce38da1e service placement] Validating token access rules against request {{(pid=71939) validate_allowed_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 24 17:07:43.259813 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3873eedb-a8f6-4548-b12b-b97a2ac46eff service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c90f21b9cdcb413282461fa83cb6b7a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3b3940d4ae1c4177ae29c02377bb4b0b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=71939) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 24 17:07:43.260461 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3873eedb-a8f6-4548-b12b-b97a2ac46eff service neutron] REQUEST_METHOD: `GET` {{(pid=71939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 24 17:07:43.260800 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3873eedb-a8f6-4548-b12b-b97a2ac46eff service neutron] SCRIPT_NAME: `/identity` {{(pid=71939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 24 17:07:43.261675 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3873eedb-a8f6-4548-b12b-b97a2ac46eff service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=71939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 24 17:07:43.263556 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.fernet_utils [None req-3873eedb-a8f6-4548-b12b-b97a2ac46eff service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=71939) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:289}} Nov 24 17:07:43.273236 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3873eedb-a8f6-4548-b12b-b97a2ac46eff service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=71939) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:442}} Nov 24 17:07:43.301376 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3873eedb-a8f6-4548-b12b-b97a2ac46eff service neutron] RBAC: Authorization granted {{(pid=71939) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 24 17:07:43.310391 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: [pid: 71939|app: 0|req: 1469/2925] 10.222.0.53 () {60 vars in 1356 bytes} [Wed Nov 24 17:07:43 2021] GET /identity/v3/auth/tokens => generated 3551 bytes in 65 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 24 17:07:43.724993 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36024ddc-3825-4e97-8e19-94a7311c05e9 None None] Authenticating user token {{(pid=71938) process_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 24 17:07:43.726503 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.fernet_utils [None req-36024ddc-3825-4e97-8e19-94a7311c05e9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=71938) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:289}} Nov 24 17:07:43.740830 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36024ddc-3825-4e97-8e19-94a7311c05e9 None None] Validating token access rules against request {{(pid=71938) validate_allowed_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 24 17:07:43.745726 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70772ba0-e863-41e6-aaa0-2da33fabe858 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a919320c9e2a48d7ba33453b5929d7ee', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3b3940d4ae1c4177ae29c02377bb4b0b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=71938) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 24 17:07:43.746506 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70772ba0-e863-41e6-aaa0-2da33fabe858 service placement] REQUEST_METHOD: `GET` {{(pid=71938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 24 17:07:43.746850 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70772ba0-e863-41e6-aaa0-2da33fabe858 service placement] SCRIPT_NAME: `/identity` {{(pid=71938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 24 17:07:43.747182 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70772ba0-e863-41e6-aaa0-2da33fabe858 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=71938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 24 17:07:43.749010 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.fernet_utils [None req-70772ba0-e863-41e6-aaa0-2da33fabe858 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=71938) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:289}} Nov 24 17:07:43.760701 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70772ba0-e863-41e6-aaa0-2da33fabe858 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=71938) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:442}} Nov 24 17:07:43.789672 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70772ba0-e863-41e6-aaa0-2da33fabe858 service placement] RBAC: Authorization granted {{(pid=71938) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 24 17:07:43.800594 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: [pid: 71938|app: 0|req: 1457/2926] 10.222.0.53 () {60 vars in 1356 bytes} [Wed Nov 24 17:07:43 2021] GET /identity/v3/auth/tokens => generated 3738 bytes in 76 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 24 17:07:43.916226 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3873eedb-a8f6-4548-b12b-b97a2ac46eff service neutron] Authenticating user token {{(pid=71939) process_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 24 17:07:43.928323 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3873eedb-a8f6-4548-b12b-b97a2ac46eff service neutron] Validating token access rules against request {{(pid=71939) validate_allowed_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 24 17:07:43.933496 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae136dd2-9827-4eda-aeeb-387f12c18504 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a919320c9e2a48d7ba33453b5929d7ee', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3b3940d4ae1c4177ae29c02377bb4b0b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=71939) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 24 17:07:43.934168 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae136dd2-9827-4eda-aeeb-387f12c18504 service placement] REQUEST_METHOD: `GET` {{(pid=71939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 24 17:07:43.934506 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae136dd2-9827-4eda-aeeb-387f12c18504 service placement] SCRIPT_NAME: `/identity` {{(pid=71939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 24 17:07:43.934837 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae136dd2-9827-4eda-aeeb-387f12c18504 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=71939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 24 17:07:43.936642 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.fernet_utils [None req-ae136dd2-9827-4eda-aeeb-387f12c18504 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=71939) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:289}} Nov 24 17:07:43.947761 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae136dd2-9827-4eda-aeeb-387f12c18504 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=71939) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:442}} Nov 24 17:07:43.976537 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae136dd2-9827-4eda-aeeb-387f12c18504 service placement] RBAC: Authorization granted {{(pid=71939) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 24 17:07:43.986239 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: [pid: 71939|app: 0|req: 1470/2927] 10.222.0.53 () {60 vars in 1356 bytes} [Wed Nov 24 17:07:43 2021] GET /identity/v3/auth/tokens => generated 3738 bytes in 71 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 24 17:07:47.147782 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70772ba0-e863-41e6-aaa0-2da33fabe858 service placement] Authenticating user token {{(pid=71938) process_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 24 17:07:47.149544 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.fernet_utils [None req-70772ba0-e863-41e6-aaa0-2da33fabe858 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=71938) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:289}} Nov 24 17:07:47.233925 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70772ba0-e863-41e6-aaa0-2da33fabe858 service placement] Validating token access rules against request {{(pid=71938) validate_allowed_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 24 17:07:47.239592 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d2b9f3c-97d9-43af-a350-3e64cdac6248 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e196802d4d5432482b6d2eabc25f74e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3b3940d4ae1c4177ae29c02377bb4b0b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'service', 'ResellerAdmin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=71938) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 24 17:07:47.240269 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d2b9f3c-97d9-43af-a350-3e64cdac6248 service nova] REQUEST_METHOD: `GET` {{(pid=71938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 24 17:07:47.240612 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d2b9f3c-97d9-43af-a350-3e64cdac6248 service nova] SCRIPT_NAME: `/identity` {{(pid=71938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 24 17:07:47.240945 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d2b9f3c-97d9-43af-a350-3e64cdac6248 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=71938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 24 17:07:47.242808 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.fernet_utils [None req-1d2b9f3c-97d9-43af-a350-3e64cdac6248 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=71938) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:289}} Nov 24 17:07:47.255541 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d2b9f3c-97d9-43af-a350-3e64cdac6248 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=71938) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:442}} Nov 24 17:07:47.284509 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d2b9f3c-97d9-43af-a350-3e64cdac6248 service nova] RBAC: Authorization granted {{(pid=71938) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 24 17:07:47.296042 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: [pid: 71938|app: 0|req: 1458/2928] 10.222.0.53 () {60 vars in 1356 bytes} [Wed Nov 24 17:07:47 2021] GET /identity/v3/auth/tokens => generated 3802 bytes in 149 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 24 17:07:53.455447 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae136dd2-9827-4eda-aeeb-387f12c18504 service placement] Authenticating user token {{(pid=71939) process_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 24 17:07:53.468303 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae136dd2-9827-4eda-aeeb-387f12c18504 service placement] Validating token access rules against request {{(pid=71939) validate_allowed_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 24 17:07:53.474553 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea3ff424-b3a1-42da-a82a-cbf47b861d3a service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e196802d4d5432482b6d2eabc25f74e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3b3940d4ae1c4177ae29c02377bb4b0b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'service', 'ResellerAdmin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=71939) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 24 17:07:53.475188 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea3ff424-b3a1-42da-a82a-cbf47b861d3a service nova] REQUEST_METHOD: `GET` {{(pid=71939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 24 17:07:53.475527 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea3ff424-b3a1-42da-a82a-cbf47b861d3a service nova] SCRIPT_NAME: `/identity` {{(pid=71939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 24 17:07:53.475856 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea3ff424-b3a1-42da-a82a-cbf47b861d3a service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=71939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 24 17:07:53.477702 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.fernet_utils [None req-ea3ff424-b3a1-42da-a82a-cbf47b861d3a service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=71939) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:289}} Nov 24 17:07:53.493007 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea3ff424-b3a1-42da-a82a-cbf47b861d3a service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=71939) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:442}} Nov 24 17:07:53.521526 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea3ff424-b3a1-42da-a82a-cbf47b861d3a service nova] RBAC: Authorization granted {{(pid=71939) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 24 17:07:53.533376 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: [pid: 71939|app: 0|req: 1471/2929] 10.222.0.53 () {60 vars in 1356 bytes} [Wed Nov 24 17:07:53 2021] GET /identity/v3/auth/tokens => generated 3802 bytes in 78 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 24 17:08:11.960432 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9bee8e0-730c-4acf-845c-807edb0ab294 None None] REQUEST_METHOD: `POST` {{(pid=71938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 24 17:08:11.960945 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9bee8e0-730c-4acf-845c-807edb0ab294 None None] SCRIPT_NAME: `/identity` {{(pid=71938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 24 17:08:11.961069 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9bee8e0-730c-4acf-845c-807edb0ab294 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=71938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 24 17:08:11.985505 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.auth.core [None req-f9bee8e0-730c-4acf-845c-807edb0ab294 None None] MFA Rules not processed for user `d26062d73eba417cade03161e754914b`. Rule list: `[]` (Enabled: `True`). {{(pid=71938) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:442}} Nov 24 17:08:11.986747 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.fernet_utils [None req-f9bee8e0-730c-4acf-845c-807edb0ab294 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=71938) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:289}} Nov 24 17:08:11.997518 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: [pid: 71938|app: 0|req: 1459/2930] 10.222.0.53 () {58 vars in 948 bytes} [Wed Nov 24 17:08:11 2021] POST /identity/v3/auth/tokens => generated 3690 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 24 17:08:12.326522 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea3ff424-b3a1-42da-a82a-cbf47b861d3a service nova] Authenticating user token {{(pid=71939) process_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 24 17:08:12.336463 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea3ff424-b3a1-42da-a82a-cbf47b861d3a service nova] Validating token access rules against request {{(pid=71939) validate_allowed_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 24 17:08:12.340074 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5195a1f0-8dcc-4ccb-b684-d21165cc1056 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c90f21b9cdcb413282461fa83cb6b7a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3b3940d4ae1c4177ae29c02377bb4b0b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=71939) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 24 17:08:12.340719 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5195a1f0-8dcc-4ccb-b684-d21165cc1056 service neutron] REQUEST_METHOD: `GET` {{(pid=71939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 24 17:08:12.341055 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5195a1f0-8dcc-4ccb-b684-d21165cc1056 service neutron] SCRIPT_NAME: `/identity` {{(pid=71939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 24 17:08:12.341388 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5195a1f0-8dcc-4ccb-b684-d21165cc1056 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=71939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 24 17:08:12.343256 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.fernet_utils [None req-5195a1f0-8dcc-4ccb-b684-d21165cc1056 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=71939) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:289}} Nov 24 17:08:12.353265 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5195a1f0-8dcc-4ccb-b684-d21165cc1056 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=71939) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:442}} Nov 24 17:08:12.381979 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5195a1f0-8dcc-4ccb-b684-d21165cc1056 service neutron] RBAC: Authorization granted {{(pid=71939) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 24 17:08:12.390310 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: [pid: 71939|app: 0|req: 1472/2931] 10.222.0.53 () {60 vars in 1356 bytes} [Wed Nov 24 17:08:12 2021] GET /identity/v3/auth/tokens => generated 3551 bytes in 64 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 24 17:08:23.699335 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9bee8e0-730c-4acf-845c-807edb0ab294 None None] Authenticating user token {{(pid=71938) process_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 24 17:08:23.700784 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.fernet_utils [None req-f9bee8e0-730c-4acf-845c-807edb0ab294 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=71938) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:289}} Nov 24 17:08:23.712759 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9bee8e0-730c-4acf-845c-807edb0ab294 None None] Validating token access rules against request {{(pid=71938) validate_allowed_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 24 17:08:23.716420 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cddad29e-f8e8-48e1-902a-21739655e341 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a12374a3093a401a97c343ff0854184d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3b3940d4ae1c4177ae29c02377bb4b0b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=71938) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 24 17:08:23.717077 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cddad29e-f8e8-48e1-902a-21739655e341 service cinder] REQUEST_METHOD: `GET` {{(pid=71938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 24 17:08:23.717418 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cddad29e-f8e8-48e1-902a-21739655e341 service cinder] SCRIPT_NAME: `/identity` {{(pid=71938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 24 17:08:23.717756 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cddad29e-f8e8-48e1-902a-21739655e341 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=71938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 24 17:08:23.719557 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.fernet_utils [None req-cddad29e-f8e8-48e1-902a-21739655e341 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=71938) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:289}} Nov 24 17:08:23.733258 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cddad29e-f8e8-48e1-902a-21739655e341 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=71938) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:442}} Nov 24 17:08:23.761894 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cddad29e-f8e8-48e1-902a-21739655e341 service cinder] RBAC: Authorization granted {{(pid=71938) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 24 17:08:23.772927 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: [pid: 71938|app: 0|req: 1460/2932] 10.222.0.53 () {60 vars in 1356 bytes} [Wed Nov 24 17:08:23 2021] GET /identity/v3/auth/tokens => generated 3802 bytes in 74 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 24 17:10:13.604970 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5195a1f0-8dcc-4ccb-b684-d21165cc1056 service neutron] Authenticating user token {{(pid=71939) process_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 24 17:10:13.614988 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5195a1f0-8dcc-4ccb-b684-d21165cc1056 service neutron] Validating token access rules against request {{(pid=71939) validate_allowed_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 24 17:10:13.618599 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fcb768e-656b-4ab4-ac69-c622131fb3de service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a12374a3093a401a97c343ff0854184d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3b3940d4ae1c4177ae29c02377bb4b0b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=71939) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 24 17:10:13.619242 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fcb768e-656b-4ab4-ac69-c622131fb3de service cinder] REQUEST_METHOD: `GET` {{(pid=71939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 24 17:10:13.619580 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fcb768e-656b-4ab4-ac69-c622131fb3de service cinder] SCRIPT_NAME: `/identity` {{(pid=71939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 24 17:10:13.619910 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fcb768e-656b-4ab4-ac69-c622131fb3de service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=71939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 24 17:10:13.628680 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fcb768e-656b-4ab4-ac69-c622131fb3de service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=71939) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:442}} Nov 24 17:10:13.657263 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fcb768e-656b-4ab4-ac69-c622131fb3de service cinder] RBAC: Authorization granted {{(pid=71939) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 24 17:10:13.666373 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: [pid: 71939|app: 0|req: 1473/2933] 10.222.0.53 () {60 vars in 1356 bytes} [Wed Nov 24 17:10:13 2021] GET /identity/v3/auth/tokens => generated 3692 bytes in 62 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 24 17:11:25.735801 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cddad29e-f8e8-48e1-902a-21739655e341 service cinder] Authenticating user token {{(pid=71938) process_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 24 17:11:25.778548 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cddad29e-f8e8-48e1-902a-21739655e341 service cinder] Validating token access rules against request {{(pid=71938) validate_allowed_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 24 17:11:25.782974 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc7ba553-f6a4-4281-b6e8-29a4a1c7f5cc service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c90f21b9cdcb413282461fa83cb6b7a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3b3940d4ae1c4177ae29c02377bb4b0b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=71938) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 24 17:11:25.783634 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc7ba553-f6a4-4281-b6e8-29a4a1c7f5cc service neutron] REQUEST_METHOD: `GET` {{(pid=71938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 24 17:11:25.783976 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc7ba553-f6a4-4281-b6e8-29a4a1c7f5cc service neutron] SCRIPT_NAME: `/identity` {{(pid=71938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 24 17:11:25.784311 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc7ba553-f6a4-4281-b6e8-29a4a1c7f5cc service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=71938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 24 17:11:25.792245 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc7ba553-f6a4-4281-b6e8-29a4a1c7f5cc service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=71938) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:442}} Nov 24 17:11:25.820468 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc7ba553-f6a4-4281-b6e8-29a4a1c7f5cc service neutron] RBAC: Authorization granted {{(pid=71938) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 24 17:11:25.829526 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: [pid: 71938|app: 0|req: 1461/2934] 10.222.0.53 () {60 vars in 1356 bytes} [Wed Nov 24 17:11:25 2021] GET /identity/v3/auth/tokens => generated 3551 bytes in 94 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 24 17:11:26.217420 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fcb768e-656b-4ab4-ac69-c622131fb3de service cinder] Authenticating user token {{(pid=71939) process_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 24 17:11:26.238226 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fcb768e-656b-4ab4-ac69-c622131fb3de service cinder] Validating token access rules against request {{(pid=71939) validate_allowed_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 24 17:11:26.242048 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1daae1f-9290-4de0-9c5f-71db8ad52055 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a12374a3093a401a97c343ff0854184d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3b3940d4ae1c4177ae29c02377bb4b0b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=71939) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 24 17:11:26.242717 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1daae1f-9290-4de0-9c5f-71db8ad52055 service cinder] REQUEST_METHOD: `GET` {{(pid=71939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 24 17:11:26.243099 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1daae1f-9290-4de0-9c5f-71db8ad52055 service cinder] SCRIPT_NAME: `/identity` {{(pid=71939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 24 17:11:26.243435 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1daae1f-9290-4de0-9c5f-71db8ad52055 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=71939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 24 17:11:26.269100 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1daae1f-9290-4de0-9c5f-71db8ad52055 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=71939) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:442}} Nov 24 17:11:26.297515 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1daae1f-9290-4de0-9c5f-71db8ad52055 service cinder] RBAC: Authorization granted {{(pid=71939) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 24 17:11:26.307748 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: [pid: 71939|app: 0|req: 1474/2935] 10.222.0.53 () {60 vars in 1356 bytes} [Wed Nov 24 17:11:26 2021] GET /identity/v3/auth/tokens => generated 3690 bytes in 91 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 24 17:12:23.965078 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc7ba553-f6a4-4281-b6e8-29a4a1c7f5cc service neutron] Authenticating user token {{(pid=71938) process_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 24 17:12:24.005957 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc7ba553-f6a4-4281-b6e8-29a4a1c7f5cc service neutron] Validating token access rules against request {{(pid=71938) validate_allowed_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 24 17:12:24.013574 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28ffbfcc-3682-4008-8db2-a8896d0373ed service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a919320c9e2a48d7ba33453b5929d7ee', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3b3940d4ae1c4177ae29c02377bb4b0b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=71938) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 24 17:12:24.014310 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28ffbfcc-3682-4008-8db2-a8896d0373ed service placement] REQUEST_METHOD: `GET` {{(pid=71938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 24 17:12:24.014932 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28ffbfcc-3682-4008-8db2-a8896d0373ed service placement] SCRIPT_NAME: `/identity` {{(pid=71938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 24 17:12:24.015561 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28ffbfcc-3682-4008-8db2-a8896d0373ed service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=71938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 24 17:12:24.027312 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28ffbfcc-3682-4008-8db2-a8896d0373ed service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=71938) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:442}} Nov 24 17:12:24.056163 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28ffbfcc-3682-4008-8db2-a8896d0373ed service placement] RBAC: Authorization granted {{(pid=71938) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 24 17:12:24.066744 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: [pid: 71938|app: 0|req: 1462/2936] 10.222.0.53 () {60 vars in 1356 bytes} [Wed Nov 24 17:12:23 2021] GET /identity/v3/auth/tokens => generated 3738 bytes in 102 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 24 17:13:59.098161 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1daae1f-9290-4de0-9c5f-71db8ad52055 service cinder] Authenticating user token {{(pid=71939) process_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 24 17:13:59.107870 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1daae1f-9290-4de0-9c5f-71db8ad52055 service cinder] Validating token access rules against request {{(pid=71939) validate_allowed_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 24 17:13:59.111563 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e981277-3664-48ab-aa6d-fd19aea17e5e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c90f21b9cdcb413282461fa83cb6b7a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3b3940d4ae1c4177ae29c02377bb4b0b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=71939) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 24 17:13:59.112215 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e981277-3664-48ab-aa6d-fd19aea17e5e service neutron] REQUEST_METHOD: `GET` {{(pid=71939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 24 17:13:59.112557 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e981277-3664-48ab-aa6d-fd19aea17e5e service neutron] SCRIPT_NAME: `/identity` {{(pid=71939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 24 17:13:59.112897 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e981277-3664-48ab-aa6d-fd19aea17e5e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=71939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 24 17:13:59.130707 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e981277-3664-48ab-aa6d-fd19aea17e5e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=71939) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:442}} Nov 24 17:13:59.159573 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e981277-3664-48ab-aa6d-fd19aea17e5e service neutron] RBAC: Authorization granted {{(pid=71939) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 24 17:13:59.183857 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: [pid: 71939|app: 0|req: 1475/2937] 10.222.0.53 () {60 vars in 1356 bytes} [Wed Nov 24 17:13:59 2021] GET /identity/v3/auth/tokens => generated 3802 bytes in 86 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 24 17:14:00.294816 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28ffbfcc-3682-4008-8db2-a8896d0373ed service placement] Authenticating user token {{(pid=71938) process_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 24 17:14:00.313099 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28ffbfcc-3682-4008-8db2-a8896d0373ed service placement] Validating token access rules against request {{(pid=71938) validate_allowed_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 24 17:14:00.319403 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6257a94-8a30-4264-ad78-83a42cc17e6b service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e196802d4d5432482b6d2eabc25f74e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3b3940d4ae1c4177ae29c02377bb4b0b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'service', 'ResellerAdmin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=71938) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 24 17:14:00.320072 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6257a94-8a30-4264-ad78-83a42cc17e6b service nova] REQUEST_METHOD: `GET` {{(pid=71938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 24 17:14:00.320407 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6257a94-8a30-4264-ad78-83a42cc17e6b service nova] SCRIPT_NAME: `/identity` {{(pid=71938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 24 17:14:00.320910 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6257a94-8a30-4264-ad78-83a42cc17e6b service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=71938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 24 17:14:00.331999 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6257a94-8a30-4264-ad78-83a42cc17e6b service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=71938) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:442}} Nov 24 17:14:00.361781 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6257a94-8a30-4264-ad78-83a42cc17e6b service nova] RBAC: Authorization granted {{(pid=71938) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 24 17:14:00.373934 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: [pid: 71938|app: 0|req: 1463/2938] 10.222.0.53 () {60 vars in 1356 bytes} [Wed Nov 24 17:14:00 2021] GET /identity/v3/auth/tokens => generated 3802 bytes in 80 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 24 17:14:03.232788 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e981277-3664-48ab-aa6d-fd19aea17e5e service neutron] Authenticating user token {{(pid=71939) process_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 24 17:14:03.243110 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e981277-3664-48ab-aa6d-fd19aea17e5e service neutron] Validating token access rules against request {{(pid=71939) validate_allowed_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 24 17:14:03.247098 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2db55075-478e-46af-95bb-406024cf771f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c90f21b9cdcb413282461fa83cb6b7a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3b3940d4ae1c4177ae29c02377bb4b0b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=71939) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 24 17:14:03.247754 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2db55075-478e-46af-95bb-406024cf771f service neutron] REQUEST_METHOD: `GET` {{(pid=71939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 24 17:14:03.248094 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2db55075-478e-46af-95bb-406024cf771f service neutron] SCRIPT_NAME: `/identity` {{(pid=71939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 24 17:14:03.248425 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2db55075-478e-46af-95bb-406024cf771f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=71939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 24 17:14:03.259861 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2db55075-478e-46af-95bb-406024cf771f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=71939) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:442}} Nov 24 17:14:03.288395 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2db55075-478e-46af-95bb-406024cf771f service neutron] RBAC: Authorization granted {{(pid=71939) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 24 17:14:03.300766 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: [pid: 71939|app: 0|req: 1476/2939] 10.222.0.53 () {60 vars in 1356 bytes} [Wed Nov 24 17:14:03 2021] GET /identity/v3/auth/tokens => generated 3802 bytes in 69 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 24 17:14:09.758820 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6257a94-8a30-4264-ad78-83a42cc17e6b service nova] Authenticating user token {{(pid=71938) process_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 24 17:14:09.768778 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6257a94-8a30-4264-ad78-83a42cc17e6b service nova] Validating token access rules against request {{(pid=71938) validate_allowed_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 24 17:14:09.772487 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e08b291-49ca-4637-8a92-99c4054a07c1 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c90f21b9cdcb413282461fa83cb6b7a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3b3940d4ae1c4177ae29c02377bb4b0b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=71938) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 24 17:14:09.773142 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e08b291-49ca-4637-8a92-99c4054a07c1 service neutron] REQUEST_METHOD: `GET` {{(pid=71938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 24 17:14:09.773484 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e08b291-49ca-4637-8a92-99c4054a07c1 service neutron] SCRIPT_NAME: `/identity` {{(pid=71938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 24 17:14:09.773817 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e08b291-49ca-4637-8a92-99c4054a07c1 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=71938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 24 17:14:09.775711 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.fernet_utils [None req-9e08b291-49ca-4637-8a92-99c4054a07c1 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=71938) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:289}} Nov 24 17:14:09.895182 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e08b291-49ca-4637-8a92-99c4054a07c1 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=71938) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:442}} Nov 24 17:14:09.923996 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e08b291-49ca-4637-8a92-99c4054a07c1 service neutron] RBAC: Authorization granted {{(pid=71938) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 24 17:14:09.945847 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: [pid: 71938|app: 0|req: 1464/2940] 10.222.0.53 () {60 vars in 1356 bytes} [Wed Nov 24 17:14:09 2021] GET /identity/v3/auth/tokens => generated 3669 bytes in 188 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 24 17:14:10.713477 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2db55075-478e-46af-95bb-406024cf771f service neutron] Authenticating user token {{(pid=71939) process_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 24 17:14:10.714992 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.fernet_utils [None req-2db55075-478e-46af-95bb-406024cf771f service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=71939) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:289}} Nov 24 17:14:10.728574 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2db55075-478e-46af-95bb-406024cf771f service neutron] Validating token access rules against request {{(pid=71939) validate_allowed_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 24 17:14:10.733209 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76cd47f7-c19e-4947-9066-68271906d64a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f2ba2e8375b4e8c8792ee1e22b60427', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '00a5583c7b7443e98e7a1d31a0b638dc', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=71939) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 24 17:14:10.734149 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76cd47f7-c19e-4947-9066-68271906d64a admin admin] REQUEST_METHOD: `DELETE` {{(pid=71939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 24 17:14:10.734493 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76cd47f7-c19e-4947-9066-68271906d64a admin admin] SCRIPT_NAME: `/identity` {{(pid=71939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 24 17:14:10.734830 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76cd47f7-c19e-4947-9066-68271906d64a admin admin] PATH_INFO: `/v3/users/15ece405347842a29fbc06f934028a84` {{(pid=71939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 24 17:14:10.736052 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76cd47f7-c19e-4947-9066-68271906d64a admin admin] RBAC: Authorizing `identity:delete_user(user_id=15ece405347842a29fbc06f934028a84)` {{(pid=71939) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:442}} Nov 24 17:14:10.764788 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76cd47f7-c19e-4947-9066-68271906d64a admin admin] RBAC: Authorization granted {{(pid=71939) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 24 17:14:10.812372 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.notifications [None req-76cd47f7-c19e-4947-9066-68271906d64a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '15ece405347842a29fbc06f934028a84'} {{(pid=71939) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:357}} Nov 24 17:14:10.824475 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.notifications [None req-76cd47f7-c19e-4947-9066-68271906d64a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '15ece405347842a29fbc06f934028a84'} {{(pid=71939) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:357}} Nov 24 17:14:10.825164 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.notifications [None req-76cd47f7-c19e-4947-9066-68271906d64a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '15ece405347842a29fbc06f934028a84'} {{(pid=71939) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:357}} Nov 24 17:14:10.833747 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.notifications [None req-76cd47f7-c19e-4947-9066-68271906d64a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '15ece405347842a29fbc06f934028a84'} {{(pid=71939) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:357}} Nov 24 17:14:10.839515 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.notifications [None req-76cd47f7-c19e-4947-9066-68271906d64a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '15ece405347842a29fbc06f934028a84'} {{(pid=71939) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:357}} Nov 24 17:14:10.845604 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: [pid: 71939|app: 0|req: 1477/2941] 10.222.0.53 () {58 vars in 1214 bytes} [Wed Nov 24 17:14:10 2021] DELETE /identity/v3/users/15ece405347842a29fbc06f934028a84 => generated 0 bytes in 133 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 24 17:14:11.094959 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e08b291-49ca-4637-8a92-99c4054a07c1 service neutron] Authenticating user token {{(pid=71938) process_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 24 17:14:11.105160 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e08b291-49ca-4637-8a92-99c4054a07c1 service neutron] Validating token access rules against request {{(pid=71938) validate_allowed_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 24 17:14:11.174000 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-756c57f6-d532-4f1c-9489-76fabe9403d5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f2ba2e8375b4e8c8792ee1e22b60427', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '00a5583c7b7443e98e7a1d31a0b638dc', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=71938) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 24 17:14:11.175181 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-756c57f6-d532-4f1c-9489-76fabe9403d5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=71938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 24 17:14:11.175526 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-756c57f6-d532-4f1c-9489-76fabe9403d5 admin admin] SCRIPT_NAME: `/identity` {{(pid=71938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 24 17:14:11.175860 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-756c57f6-d532-4f1c-9489-76fabe9403d5 admin admin] PATH_INFO: `/v3/projects/ddf80c87c78545b596193aea044877ba` {{(pid=71938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 24 17:14:11.177088 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-756c57f6-d532-4f1c-9489-76fabe9403d5 admin admin] RBAC: Authorizing `identity:delete_project(project_id=ddf80c87c78545b596193aea044877ba)` {{(pid=71938) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:442}} Nov 24 17:14:11.206665 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-756c57f6-d532-4f1c-9489-76fabe9403d5 admin admin] RBAC: Authorization granted {{(pid=71938) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 24 17:14:11.256617 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.notifications [None req-756c57f6-d532-4f1c-9489-76fabe9403d5 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ddf80c87c78545b596193aea044877ba', 'request_id': 'req-756c57f6-d532-4f1c-9489-76fabe9403d5'} {{(pid=71938) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:357}} Nov 24 17:14:11.269025 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.notifications [None req-756c57f6-d532-4f1c-9489-76fabe9403d5 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ddf80c87c78545b596193aea044877ba', 'request_id': 'req-756c57f6-d532-4f1c-9489-76fabe9403d5'} {{(pid=71938) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:357}} Nov 24 17:14:11.274372 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.notifications [None req-756c57f6-d532-4f1c-9489-76fabe9403d5 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ddf80c87c78545b596193aea044877ba', 'request_id': 'req-756c57f6-d532-4f1c-9489-76fabe9403d5'} {{(pid=71938) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:357}} Nov 24 17:14:11.285542 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.notifications [None req-756c57f6-d532-4f1c-9489-76fabe9403d5 admin admin] The token cache is being invalidate because project ddf80c87c78545b596193aea044877ba was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=71938) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Nov 24 17:14:11.285872 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.notifications [None req-756c57f6-d532-4f1c-9489-76fabe9403d5 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=71938) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:357}} Nov 24 17:14:11.286569 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.notifications [None req-756c57f6-d532-4f1c-9489-76fabe9403d5 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=71938) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:357}} Nov 24 17:14:11.288108 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: [pid: 71938|app: 0|req: 1465/2942] 10.222.0.53 () {58 vars in 1223 bytes} [Wed Nov 24 17:14:11 2021] DELETE /identity/v3/projects/ddf80c87c78545b596193aea044877ba => generated 0 bytes in 194 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 24 17:14:11.294246 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0c46cb0-f379-4e7e-813c-63fa33ec8780 None None] REQUEST_METHOD: `POST` {{(pid=71939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 24 17:14:11.294738 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0c46cb0-f379-4e7e-813c-63fa33ec8780 None None] SCRIPT_NAME: `/identity` {{(pid=71939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 24 17:14:11.295084 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0c46cb0-f379-4e7e-813c-63fa33ec8780 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=71939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 24 17:14:11.370659 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.auth.core [None req-f0c46cb0-f379-4e7e-813c-63fa33ec8780 None None] MFA Rules not processed for user `0f2ba2e8375b4e8c8792ee1e22b60427`. Rule list: `[]` (Enabled: `True`). {{(pid=71939) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:442}} Nov 24 17:14:11.371816 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.fernet_utils [None req-f0c46cb0-f379-4e7e-813c-63fa33ec8780 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=71939) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:289}} Nov 24 17:14:11.440000 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: [pid: 71939|app: 0|req: 1478/2943] 10.222.0.53 () {58 vars in 948 bytes} [Wed Nov 24 17:14:11 2021] POST /identity/v3/auth/tokens => generated 3669 bytes in 147 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 24 17:14:11.448413 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ae6d1cd-50eb-4f5c-9a47-a7bf57c869f3 None None] REQUEST_METHOD: `POST` {{(pid=71938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 24 17:14:11.448806 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ae6d1cd-50eb-4f5c-9a47-a7bf57c869f3 None None] SCRIPT_NAME: `/identity` {{(pid=71938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 24 17:14:11.449147 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ae6d1cd-50eb-4f5c-9a47-a7bf57c869f3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=71938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 24 17:14:11.473436 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.auth.core [None req-6ae6d1cd-50eb-4f5c-9a47-a7bf57c869f3 None None] MFA Rules not processed for user `0f2ba2e8375b4e8c8792ee1e22b60427`. Rule list: `[]` (Enabled: `True`). {{(pid=71938) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:442}} Nov 24 17:14:11.474700 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.fernet_utils [None req-6ae6d1cd-50eb-4f5c-9a47-a7bf57c869f3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=71938) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:289}} Nov 24 17:14:11.482234 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: [pid: 71938|app: 0|req: 1466/2944] 10.222.0.53 () {58 vars in 948 bytes} [Wed Nov 24 17:14:11 2021] POST /identity/v3/auth/tokens => generated 3669 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 24 17:14:11.486615 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0c46cb0-f379-4e7e-813c-63fa33ec8780 None None] Authenticating user token {{(pid=71939) process_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 24 17:14:11.496547 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0c46cb0-f379-4e7e-813c-63fa33ec8780 None None] Validating token access rules against request {{(pid=71939) validate_allowed_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 24 17:14:11.501609 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2fce682-6168-4479-b6cc-1e052e710955 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f2ba2e8375b4e8c8792ee1e22b60427', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '00a5583c7b7443e98e7a1d31a0b638dc', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=71939) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 24 17:14:11.502299 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2fce682-6168-4479-b6cc-1e052e710955 admin admin] REQUEST_METHOD: `GET` {{(pid=71939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 24 17:14:11.502638 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2fce682-6168-4479-b6cc-1e052e710955 admin admin] SCRIPT_NAME: `/identity` {{(pid=71939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 24 17:14:11.502967 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2fce682-6168-4479-b6cc-1e052e710955 admin admin] PATH_INFO: `/v3/domains` {{(pid=71939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 24 17:14:11.503752 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2fce682-6168-4479-b6cc-1e052e710955 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=71939) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:161}} Nov 24 17:14:11.504102 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2fce682-6168-4479-b6cc-1e052e710955 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=71939) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:442}} Nov 24 17:14:11.532638 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2fce682-6168-4479-b6cc-1e052e710955 admin admin] RBAC: Authorization granted {{(pid=71939) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 24 17:14:11.547396 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: [pid: 71939|app: 0|req: 1479/2945] 10.222.0.53 () {58 vars in 1143 bytes} [Wed Nov 24 17:14:11 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 61 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 24 17:14:11.552328 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ae6d1cd-50eb-4f5c-9a47-a7bf57c869f3 None None] Authenticating user token {{(pid=71938) process_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 24 17:14:11.562641 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ae6d1cd-50eb-4f5c-9a47-a7bf57c869f3 None None] Validating token access rules against request {{(pid=71938) validate_allowed_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 24 17:14:11.567289 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e15f0c69-cc6d-45f7-b1fb-9b076d4376de admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f2ba2e8375b4e8c8792ee1e22b60427', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '00a5583c7b7443e98e7a1d31a0b638dc', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=71938) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 24 17:14:11.567949 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e15f0c69-cc6d-45f7-b1fb-9b076d4376de admin admin] REQUEST_METHOD: `POST` {{(pid=71938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 24 17:14:11.568287 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e15f0c69-cc6d-45f7-b1fb-9b076d4376de admin admin] SCRIPT_NAME: `/identity` {{(pid=71938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 24 17:14:11.568617 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e15f0c69-cc6d-45f7-b1fb-9b076d4376de admin admin] PATH_INFO: `/v3/projects` {{(pid=71938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 24 17:14:11.569345 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e15f0c69-cc6d-45f7-b1fb-9b076d4376de admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=71938) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:442}} Nov 24 17:14:11.598280 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e15f0c69-cc6d-45f7-b1fb-9b076d4376de admin admin] RBAC: Authorization granted {{(pid=71938) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 24 17:14:11.636726 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: [pid: 71938|app: 0|req: 1467/2946] 10.222.0.53 () {60 vars in 1143 bytes} [Wed Nov 24 17:14:11 2021] POST /identity/v3/projects => generated 405 bytes in 85 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 24 17:14:11.641101 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2fce682-6168-4479-b6cc-1e052e710955 admin admin] Authenticating user token {{(pid=71939) process_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 24 17:14:11.651158 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2fce682-6168-4479-b6cc-1e052e710955 admin admin] Validating token access rules against request {{(pid=71939) validate_allowed_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 24 17:14:11.717883 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58013152-f3eb-4059-be4b-9ecaa69c6e1b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f2ba2e8375b4e8c8792ee1e22b60427', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '00a5583c7b7443e98e7a1d31a0b638dc', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=71939) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 24 17:14:11.718628 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58013152-f3eb-4059-be4b-9ecaa69c6e1b admin admin] REQUEST_METHOD: `POST` {{(pid=71939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 24 17:14:11.718987 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58013152-f3eb-4059-be4b-9ecaa69c6e1b admin admin] SCRIPT_NAME: `/identity` {{(pid=71939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 24 17:14:11.719320 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58013152-f3eb-4059-be4b-9ecaa69c6e1b admin admin] PATH_INFO: `/v3/users` {{(pid=71939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 24 17:14:11.720051 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58013152-f3eb-4059-be4b-9ecaa69c6e1b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=71939) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:442}} Nov 24 17:14:11.748621 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58013152-f3eb-4059-be4b-9ecaa69c6e1b admin admin] RBAC: Authorization granted {{(pid=71939) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 24 17:14:11.767833 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: [pid: 71939|app: 0|req: 1480/2947] 10.222.0.53 () {60 vars in 1134 bytes} [Wed Nov 24 17:14:11 2021] POST /identity/v3/users => generated 303 bytes in 127 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 24 17:14:11.772282 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e15f0c69-cc6d-45f7-b1fb-9b076d4376de admin admin] Authenticating user token {{(pid=71938) process_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 24 17:14:11.782735 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e15f0c69-cc6d-45f7-b1fb-9b076d4376de admin admin] Validating token access rules against request {{(pid=71938) validate_allowed_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 24 17:14:11.787287 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec3cb362-fab7-49b7-a04d-80453b3b6101 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f2ba2e8375b4e8c8792ee1e22b60427', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '00a5583c7b7443e98e7a1d31a0b638dc', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=71938) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 24 17:14:11.787960 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec3cb362-fab7-49b7-a04d-80453b3b6101 admin admin] REQUEST_METHOD: `GET` {{(pid=71938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 24 17:14:11.788299 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec3cb362-fab7-49b7-a04d-80453b3b6101 admin admin] SCRIPT_NAME: `/identity` {{(pid=71938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 24 17:14:11.788631 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec3cb362-fab7-49b7-a04d-80453b3b6101 admin admin] PATH_INFO: `/v3/roles` {{(pid=71938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 24 17:14:11.789416 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec3cb362-fab7-49b7-a04d-80453b3b6101 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=71938) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:442}} Nov 24 17:14:11.818914 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec3cb362-fab7-49b7-a04d-80453b3b6101 admin admin] RBAC: Authorization granted {{(pid=71938) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 24 17:14:11.829822 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: [pid: 71938|app: 0|req: 1468/2948] 10.222.0.53 () {58 vars in 1112 bytes} [Wed Nov 24 17:14:11 2021] GET /identity/v3/roles => generated 1420 bytes in 58 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 24 17:14:11.834270 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58013152-f3eb-4059-be4b-9ecaa69c6e1b admin admin] Authenticating user token {{(pid=71939) process_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 24 17:14:11.844199 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58013152-f3eb-4059-be4b-9ecaa69c6e1b admin admin] Validating token access rules against request {{(pid=71939) validate_allowed_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 24 17:14:11.848978 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-561191ca-5419-4fe6-852d-d6bf7e423332 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f2ba2e8375b4e8c8792ee1e22b60427', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '00a5583c7b7443e98e7a1d31a0b638dc', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=71939) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 24 17:14:11.849886 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-561191ca-5419-4fe6-852d-d6bf7e423332 admin admin] REQUEST_METHOD: `PUT` {{(pid=71939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 24 17:14:11.850246 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-561191ca-5419-4fe6-852d-d6bf7e423332 admin admin] SCRIPT_NAME: `/identity` {{(pid=71939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 24 17:14:11.850572 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-561191ca-5419-4fe6-852d-d6bf7e423332 admin admin] PATH_INFO: `/v3/projects/a73e75511eaf4e6381bb17497cb73436/users/df9635c76d6a4f498a19452fac15bace/roles/912ab5f10fa5477da74acf239f07604e` {{(pid=71939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 24 17:14:11.876668 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-561191ca-5419-4fe6-852d-d6bf7e423332 admin admin] RBAC: Authorizing `identity:create_grant(project_id=a73e75511eaf4e6381bb17497cb73436, user_id=df9635c76d6a4f498a19452fac15bace, role_id=912ab5f10fa5477da74acf239f07604e)` {{(pid=71939) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:442}} Nov 24 17:14:11.905579 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-561191ca-5419-4fe6-852d-d6bf7e423332 admin admin] RBAC: Authorization granted {{(pid=71939) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 24 17:14:11.917317 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: [pid: 71939|app: 0|req: 1481/2949] 10.222.0.53 () {60 vars in 1473 bytes} [Wed Nov 24 17:14:11 2021] PUT /identity/v3/projects/a73e75511eaf4e6381bb17497cb73436/users/df9635c76d6a4f498a19452fac15bace/roles/912ab5f10fa5477da74acf239f07604e => generated 0 bytes in 84 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 24 17:14:11.929543 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30353eb3-b5e5-49d5-917e-c91ef679af7e None None] REQUEST_METHOD: `POST` {{(pid=71938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 24 17:14:11.929887 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30353eb3-b5e5-49d5-917e-c91ef679af7e None None] SCRIPT_NAME: `/identity` {{(pid=71938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 24 17:14:11.930248 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30353eb3-b5e5-49d5-917e-c91ef679af7e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=71938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 24 17:14:11.967837 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.auth.core [None req-30353eb3-b5e5-49d5-917e-c91ef679af7e None None] MFA Rules not processed for user `df9635c76d6a4f498a19452fac15bace`. Rule list: `[]` (Enabled: `True`). {{(pid=71938) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:442}} Nov 24 17:14:11.969581 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.fernet_utils [None req-30353eb3-b5e5-49d5-917e-c91ef679af7e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=71938) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:289}} Nov 24 17:14:12.044627 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: [pid: 71938|app: 0|req: 1469/2950] 10.222.0.53 () {58 vars in 948 bytes} [Wed Nov 24 17:14:11 2021] POST /identity/v3/auth/tokens => generated 3712 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 24 17:14:12.050301 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-561191ca-5419-4fe6-852d-d6bf7e423332 admin admin] Authenticating user token {{(pid=71939) process_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 24 17:14:12.124596 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-561191ca-5419-4fe6-852d-d6bf7e423332 admin admin] Validating token access rules against request {{(pid=71939) validate_allowed_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 24 17:14:12.129185 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9c15d1e-4034-4e6d-b47e-19567584c130 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f2ba2e8375b4e8c8792ee1e22b60427', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '00a5583c7b7443e98e7a1d31a0b638dc', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=71939) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 24 17:14:12.129856 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9c15d1e-4034-4e6d-b47e-19567584c130 admin admin] REQUEST_METHOD: `POST` {{(pid=71939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 24 17:14:12.130227 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9c15d1e-4034-4e6d-b47e-19567584c130 admin admin] SCRIPT_NAME: `/identity` {{(pid=71939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 24 17:14:12.130561 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9c15d1e-4034-4e6d-b47e-19567584c130 admin admin] PATH_INFO: `/v3/projects` {{(pid=71939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 24 17:14:12.131293 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9c15d1e-4034-4e6d-b47e-19567584c130 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=71939) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:442}} Nov 24 17:14:12.160133 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9c15d1e-4034-4e6d-b47e-19567584c130 admin admin] RBAC: Authorization granted {{(pid=71939) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 24 17:14:12.192192 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: [pid: 71939|app: 0|req: 1482/2951] 10.222.0.53 () {60 vars in 1143 bytes} [Wed Nov 24 17:14:12 2021] POST /identity/v3/projects => generated 405 bytes in 142 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 24 17:14:12.196494 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30353eb3-b5e5-49d5-917e-c91ef679af7e None None] Authenticating user token {{(pid=71938) process_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 24 17:14:12.207820 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30353eb3-b5e5-49d5-917e-c91ef679af7e None None] Validating token access rules against request {{(pid=71938) validate_allowed_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 24 17:14:12.274723 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a05040cc-6053-4844-a6b6-07914079801f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f2ba2e8375b4e8c8792ee1e22b60427', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '00a5583c7b7443e98e7a1d31a0b638dc', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=71938) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 24 17:14:12.275401 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a05040cc-6053-4844-a6b6-07914079801f admin admin] REQUEST_METHOD: `POST` {{(pid=71938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 24 17:14:12.275739 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a05040cc-6053-4844-a6b6-07914079801f admin admin] SCRIPT_NAME: `/identity` {{(pid=71938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 24 17:14:12.276070 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a05040cc-6053-4844-a6b6-07914079801f admin admin] PATH_INFO: `/v3/users` {{(pid=71938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 24 17:14:12.276794 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a05040cc-6053-4844-a6b6-07914079801f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=71938) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:442}} Nov 24 17:14:12.306175 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a05040cc-6053-4844-a6b6-07914079801f admin admin] RBAC: Authorization granted {{(pid=71938) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 24 17:14:12.327121 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: [pid: 71938|app: 0|req: 1470/2952] 10.222.0.53 () {60 vars in 1134 bytes} [Wed Nov 24 17:14:12 2021] POST /identity/v3/users => generated 309 bytes in 131 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 24 17:14:12.331924 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9c15d1e-4034-4e6d-b47e-19567584c130 admin admin] Authenticating user token {{(pid=71939) process_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 24 17:14:12.342304 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9c15d1e-4034-4e6d-b47e-19567584c130 admin admin] Validating token access rules against request {{(pid=71939) validate_allowed_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 24 17:14:12.347401 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0f943a9-c26d-43e4-80a9-ffbacfd1b574 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f2ba2e8375b4e8c8792ee1e22b60427', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '00a5583c7b7443e98e7a1d31a0b638dc', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=71939) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 24 17:14:12.348070 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0f943a9-c26d-43e4-80a9-ffbacfd1b574 admin admin] REQUEST_METHOD: `GET` {{(pid=71939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 24 17:14:12.348405 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0f943a9-c26d-43e4-80a9-ffbacfd1b574 admin admin] SCRIPT_NAME: `/identity` {{(pid=71939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 24 17:14:12.348733 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0f943a9-c26d-43e4-80a9-ffbacfd1b574 admin admin] PATH_INFO: `/v3/roles` {{(pid=71939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 24 17:14:12.349511 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0f943a9-c26d-43e4-80a9-ffbacfd1b574 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=71939) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:442}} Nov 24 17:14:12.377348 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0f943a9-c26d-43e4-80a9-ffbacfd1b574 admin admin] RBAC: Authorization granted {{(pid=71939) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 24 17:14:12.388907 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: [pid: 71939|app: 0|req: 1483/2953] 10.222.0.53 () {58 vars in 1112 bytes} [Wed Nov 24 17:14:12 2021] GET /identity/v3/roles => generated 1420 bytes in 58 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 24 17:14:12.393704 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a05040cc-6053-4844-a6b6-07914079801f admin admin] Authenticating user token {{(pid=71938) process_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 24 17:14:12.403971 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a05040cc-6053-4844-a6b6-07914079801f admin admin] Validating token access rules against request {{(pid=71938) validate_allowed_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 24 17:14:12.409153 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6667b93b-aa2e-4186-b34d-c00b78b7ccb1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f2ba2e8375b4e8c8792ee1e22b60427', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '00a5583c7b7443e98e7a1d31a0b638dc', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=71938) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 24 17:14:12.410082 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6667b93b-aa2e-4186-b34d-c00b78b7ccb1 admin admin] REQUEST_METHOD: `PUT` {{(pid=71938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 24 17:14:12.410477 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6667b93b-aa2e-4186-b34d-c00b78b7ccb1 admin admin] SCRIPT_NAME: `/identity` {{(pid=71938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 24 17:14:12.410894 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6667b93b-aa2e-4186-b34d-c00b78b7ccb1 admin admin] PATH_INFO: `/v3/projects/70efa4c35fcc437eb66db0517d16c8b8/users/074047193c664be6a72192ac8c08b3f4/roles/5611724e350b41e19921b5961a342582` {{(pid=71938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 24 17:14:12.432701 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6667b93b-aa2e-4186-b34d-c00b78b7ccb1 admin admin] RBAC: Authorizing `identity:create_grant(project_id=70efa4c35fcc437eb66db0517d16c8b8, user_id=074047193c664be6a72192ac8c08b3f4, role_id=5611724e350b41e19921b5961a342582)` {{(pid=71938) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:442}} Nov 24 17:14:12.462537 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6667b93b-aa2e-4186-b34d-c00b78b7ccb1 admin admin] RBAC: Authorization granted {{(pid=71938) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 24 17:14:12.475180 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: [pid: 71938|app: 0|req: 1471/2954] 10.222.0.53 () {60 vars in 1473 bytes} [Wed Nov 24 17:14:12 2021] PUT /identity/v3/projects/70efa4c35fcc437eb66db0517d16c8b8/users/074047193c664be6a72192ac8c08b3f4/roles/5611724e350b41e19921b5961a342582 => generated 0 bytes in 82 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 24 17:14:12.479393 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0f943a9-c26d-43e4-80a9-ffbacfd1b574 admin admin] Authenticating user token {{(pid=71939) process_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 24 17:14:12.489465 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0f943a9-c26d-43e4-80a9-ffbacfd1b574 admin admin] Validating token access rules against request {{(pid=71939) validate_allowed_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 24 17:14:12.555754 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d585a8b9-7514-4b0b-bc1d-b9c668322ac1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f2ba2e8375b4e8c8792ee1e22b60427', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '00a5583c7b7443e98e7a1d31a0b638dc', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=71939) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 24 17:14:12.556477 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d585a8b9-7514-4b0b-bc1d-b9c668322ac1 admin admin] REQUEST_METHOD: `GET` {{(pid=71939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 24 17:14:12.556818 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d585a8b9-7514-4b0b-bc1d-b9c668322ac1 admin admin] SCRIPT_NAME: `/identity` {{(pid=71939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 24 17:14:12.557153 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d585a8b9-7514-4b0b-bc1d-b9c668322ac1 admin admin] PATH_INFO: `/v3/roles` {{(pid=71939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 24 17:14:12.557938 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d585a8b9-7514-4b0b-bc1d-b9c668322ac1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=71939) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:442}} Nov 24 17:14:12.586445 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d585a8b9-7514-4b0b-bc1d-b9c668322ac1 admin admin] RBAC: Authorization granted {{(pid=71939) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 24 17:14:12.598315 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: [pid: 71939|app: 0|req: 1484/2955] 10.222.0.53 () {58 vars in 1112 bytes} [Wed Nov 24 17:14:12 2021] GET /identity/v3/roles => generated 1420 bytes in 119 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 24 17:14:12.602829 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6667b93b-aa2e-4186-b34d-c00b78b7ccb1 admin admin] Authenticating user token {{(pid=71938) process_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 24 17:14:12.613208 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6667b93b-aa2e-4186-b34d-c00b78b7ccb1 admin admin] Validating token access rules against request {{(pid=71938) validate_allowed_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 24 17:14:12.617808 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2914936e-125a-4cc3-a828-898a026626cd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f2ba2e8375b4e8c8792ee1e22b60427', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '00a5583c7b7443e98e7a1d31a0b638dc', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=71938) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 24 17:14:12.618734 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2914936e-125a-4cc3-a828-898a026626cd admin admin] REQUEST_METHOD: `PUT` {{(pid=71938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 24 17:14:12.619072 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2914936e-125a-4cc3-a828-898a026626cd admin admin] SCRIPT_NAME: `/identity` {{(pid=71938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 24 17:14:12.619431 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2914936e-125a-4cc3-a828-898a026626cd admin admin] PATH_INFO: `/v3/projects/70efa4c35fcc437eb66db0517d16c8b8/users/074047193c664be6a72192ac8c08b3f4/roles/5611724e350b41e19921b5961a342582` {{(pid=71938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 24 17:14:12.621358 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2914936e-125a-4cc3-a828-898a026626cd admin admin] RBAC: Authorizing `identity:create_grant(project_id=70efa4c35fcc437eb66db0517d16c8b8, user_id=074047193c664be6a72192ac8c08b3f4, role_id=5611724e350b41e19921b5961a342582)` {{(pid=71938) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:442}} Nov 24 17:14:12.650908 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2914936e-125a-4cc3-a828-898a026626cd admin admin] RBAC: Authorization granted {{(pid=71938) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 24 17:14:12.662436 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: [pid: 71938|app: 0|req: 1472/2956] 10.222.0.53 () {60 vars in 1473 bytes} [Wed Nov 24 17:14:12 2021] PUT /identity/v3/projects/70efa4c35fcc437eb66db0517d16c8b8/users/074047193c664be6a72192ac8c08b3f4/roles/5611724e350b41e19921b5961a342582 => generated 0 bytes in 60 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 24 17:14:12.666746 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d585a8b9-7514-4b0b-bc1d-b9c668322ac1 admin admin] Authenticating user token {{(pid=71939) process_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 24 17:14:12.677997 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d585a8b9-7514-4b0b-bc1d-b9c668322ac1 admin admin] Validating token access rules against request {{(pid=71939) validate_allowed_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 24 17:14:12.744595 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af1b0df9-f67f-45bb-a1ec-2311a7c1e428 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f2ba2e8375b4e8c8792ee1e22b60427', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '00a5583c7b7443e98e7a1d31a0b638dc', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=71939) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 24 17:14:12.745273 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af1b0df9-f67f-45bb-a1ec-2311a7c1e428 admin admin] REQUEST_METHOD: `GET` {{(pid=71939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 24 17:14:12.745610 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af1b0df9-f67f-45bb-a1ec-2311a7c1e428 admin admin] SCRIPT_NAME: `/identity` {{(pid=71939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 24 17:14:12.745942 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af1b0df9-f67f-45bb-a1ec-2311a7c1e428 admin admin] PATH_INFO: `/v3/roles` {{(pid=71939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 24 17:14:12.746756 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af1b0df9-f67f-45bb-a1ec-2311a7c1e428 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=71939) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:442}} Nov 24 17:14:12.775643 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af1b0df9-f67f-45bb-a1ec-2311a7c1e428 admin admin] RBAC: Authorization granted {{(pid=71939) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 24 17:14:12.786224 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: [pid: 71939|app: 0|req: 1485/2957] 10.222.0.53 () {58 vars in 1112 bytes} [Wed Nov 24 17:14:12 2021] GET /identity/v3/roles => generated 1420 bytes in 120 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 24 17:14:12.790752 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2914936e-125a-4cc3-a828-898a026626cd admin admin] Authenticating user token {{(pid=71938) process_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 24 17:14:12.801497 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2914936e-125a-4cc3-a828-898a026626cd admin admin] Validating token access rules against request {{(pid=71938) validate_allowed_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 24 17:14:12.806070 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-120209f7-fe6a-4ccf-a113-aceca502deaa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f2ba2e8375b4e8c8792ee1e22b60427', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '00a5583c7b7443e98e7a1d31a0b638dc', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=71938) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 24 17:14:12.806970 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-120209f7-fe6a-4ccf-a113-aceca502deaa admin admin] REQUEST_METHOD: `PUT` {{(pid=71938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 24 17:14:12.807308 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-120209f7-fe6a-4ccf-a113-aceca502deaa admin admin] SCRIPT_NAME: `/identity` {{(pid=71938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 24 17:14:12.807638 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-120209f7-fe6a-4ccf-a113-aceca502deaa admin admin] PATH_INFO: `/v3/projects/70efa4c35fcc437eb66db0517d16c8b8/users/074047193c664be6a72192ac8c08b3f4/roles/912ab5f10fa5477da74acf239f07604e` {{(pid=71938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 24 17:14:12.809617 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-120209f7-fe6a-4ccf-a113-aceca502deaa admin admin] RBAC: Authorizing `identity:create_grant(project_id=70efa4c35fcc437eb66db0517d16c8b8, user_id=074047193c664be6a72192ac8c08b3f4, role_id=912ab5f10fa5477da74acf239f07604e)` {{(pid=71938) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:442}} Nov 24 17:14:12.839686 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-120209f7-fe6a-4ccf-a113-aceca502deaa admin admin] RBAC: Authorization granted {{(pid=71938) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 24 17:14:12.852239 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: [pid: 71938|app: 0|req: 1473/2958] 10.222.0.53 () {60 vars in 1473 bytes} [Wed Nov 24 17:14:12 2021] PUT /identity/v3/projects/70efa4c35fcc437eb66db0517d16c8b8/users/074047193c664be6a72192ac8c08b3f4/roles/912ab5f10fa5477da74acf239f07604e => generated 0 bytes in 62 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 24 17:14:12.862572 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab254cad-144c-46a9-a012-f8267b82ec0b None None] REQUEST_METHOD: `POST` {{(pid=71939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 24 17:14:12.862926 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab254cad-144c-46a9-a012-f8267b82ec0b None None] SCRIPT_NAME: `/identity` {{(pid=71939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 24 17:14:12.863267 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab254cad-144c-46a9-a012-f8267b82ec0b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=71939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 24 17:14:12.903184 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.auth.core [None req-ab254cad-144c-46a9-a012-f8267b82ec0b None None] MFA Rules not processed for user `074047193c664be6a72192ac8c08b3f4`. Rule list: `[]` (Enabled: `True`). {{(pid=71939) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:442}} Nov 24 17:14:12.904412 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.fernet_utils [None req-ab254cad-144c-46a9-a012-f8267b82ec0b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=71939) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:289}} Nov 24 17:14:13.058723 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: [pid: 71939|app: 0|req: 1486/2959] 10.222.0.53 () {58 vars in 948 bytes} [Wed Nov 24 17:14:12 2021] POST /identity/v3/auth/tokens => generated 3779 bytes in 197 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 24 17:14:13.069348 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-120209f7-fe6a-4ccf-a113-aceca502deaa admin admin] Authenticating user token {{(pid=71938) process_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 24 17:14:13.071181 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.fernet_utils [None req-120209f7-fe6a-4ccf-a113-aceca502deaa admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=71938) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:289}} Nov 24 17:14:13.169121 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-120209f7-fe6a-4ccf-a113-aceca502deaa admin admin] Validating token access rules against request {{(pid=71938) validate_allowed_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 24 17:14:13.174079 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23f4e190-344f-49ed-b5fb-e8d85bcb2c89 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a12374a3093a401a97c343ff0854184d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3b3940d4ae1c4177ae29c02377bb4b0b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=71938) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 24 17:14:13.175118 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23f4e190-344f-49ed-b5fb-e8d85bcb2c89 service cinder] REQUEST_METHOD: `GET` {{(pid=71938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 24 17:14:13.175469 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23f4e190-344f-49ed-b5fb-e8d85bcb2c89 service cinder] SCRIPT_NAME: `/identity` {{(pid=71938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 24 17:14:13.175805 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23f4e190-344f-49ed-b5fb-e8d85bcb2c89 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=71938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 24 17:14:13.186119 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23f4e190-344f-49ed-b5fb-e8d85bcb2c89 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=71938) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:442}} Nov 24 17:14:13.215296 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23f4e190-344f-49ed-b5fb-e8d85bcb2c89 service cinder] RBAC: Authorization granted {{(pid=71938) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 24 17:14:13.225831 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: [pid: 71938|app: 0|req: 1474/2960] 10.222.0.53 () {60 vars in 1356 bytes} [Wed Nov 24 17:14:13 2021] GET /identity/v3/auth/tokens => generated 3779 bytes in 157 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 24 17:14:13.354808 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab254cad-144c-46a9-a012-f8267b82ec0b None None] Authenticating user token {{(pid=71939) process_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 24 17:14:13.426045 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab254cad-144c-46a9-a012-f8267b82ec0b None None] Validating token access rules against request {{(pid=71939) validate_allowed_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 24 17:14:13.430577 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8d96eab-3ea3-4c9b-a588-aafd19526140 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f2ba2e8375b4e8c8792ee1e22b60427', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '00a5583c7b7443e98e7a1d31a0b638dc', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=71939) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 24 17:14:13.431455 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8d96eab-3ea3-4c9b-a588-aafd19526140 admin admin] REQUEST_METHOD: `DELETE` {{(pid=71939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 24 17:14:13.431794 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8d96eab-3ea3-4c9b-a588-aafd19526140 admin admin] SCRIPT_NAME: `/identity` {{(pid=71939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 24 17:14:13.432126 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8d96eab-3ea3-4c9b-a588-aafd19526140 admin admin] PATH_INFO: `/v3/users/df9635c76d6a4f498a19452fac15bace` {{(pid=71939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 24 17:14:13.433346 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8d96eab-3ea3-4c9b-a588-aafd19526140 admin admin] RBAC: Authorizing `identity:delete_user(user_id=df9635c76d6a4f498a19452fac15bace)` {{(pid=71939) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:442}} Nov 24 17:14:13.462626 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8d96eab-3ea3-4c9b-a588-aafd19526140 admin admin] RBAC: Authorization granted {{(pid=71939) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 24 17:14:13.510581 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.notifications [None req-f8d96eab-3ea3-4c9b-a588-aafd19526140 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'df9635c76d6a4f498a19452fac15bace'} {{(pid=71939) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:357}} Nov 24 17:14:13.523203 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.notifications [None req-f8d96eab-3ea3-4c9b-a588-aafd19526140 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'df9635c76d6a4f498a19452fac15bace'} {{(pid=71939) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:357}} Nov 24 17:14:13.523904 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.notifications [None req-f8d96eab-3ea3-4c9b-a588-aafd19526140 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'df9635c76d6a4f498a19452fac15bace'} {{(pid=71939) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:357}} Nov 24 17:14:13.531976 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.notifications [None req-f8d96eab-3ea3-4c9b-a588-aafd19526140 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'df9635c76d6a4f498a19452fac15bace'} {{(pid=71939) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:357}} Nov 24 17:14:13.538014 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.notifications [None req-f8d96eab-3ea3-4c9b-a588-aafd19526140 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'df9635c76d6a4f498a19452fac15bace'} {{(pid=71939) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:357}} Nov 24 17:14:13.544393 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: [pid: 71939|app: 0|req: 1487/2961] 10.222.0.53 () {58 vars in 1214 bytes} [Wed Nov 24 17:14:13 2021] DELETE /identity/v3/users/df9635c76d6a4f498a19452fac15bace => generated 0 bytes in 190 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 24 17:14:13.549265 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46510b7b-1f30-4624-8d8a-c986e9710c6e None None] REQUEST_METHOD: `POST` {{(pid=71938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 24 17:14:13.549885 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46510b7b-1f30-4624-8d8a-c986e9710c6e None None] SCRIPT_NAME: `/identity` {{(pid=71938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 24 17:14:13.550247 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46510b7b-1f30-4624-8d8a-c986e9710c6e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=71938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 24 17:14:13.574046 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.auth.core [None req-46510b7b-1f30-4624-8d8a-c986e9710c6e None None] MFA Rules not processed for user `0f2ba2e8375b4e8c8792ee1e22b60427`. Rule list: `[]` (Enabled: `True`). {{(pid=71938) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:442}} Nov 24 17:14:13.575239 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.fernet_utils [None req-46510b7b-1f30-4624-8d8a-c986e9710c6e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=71938) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:289}} Nov 24 17:14:13.643298 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: [pid: 71938|app: 0|req: 1475/2962] 10.222.0.53 () {58 vars in 948 bytes} [Wed Nov 24 17:14:13 2021] POST /identity/v3/auth/tokens => generated 3669 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 24 17:14:13.654591 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8d96eab-3ea3-4c9b-a588-aafd19526140 admin admin] Authenticating user token {{(pid=71939) process_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 24 17:14:13.656100 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.fernet_utils [None req-f8d96eab-3ea3-4c9b-a588-aafd19526140 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=71939) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:289}} Nov 24 17:14:13.740452 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8d96eab-3ea3-4c9b-a588-aafd19526140 admin admin] Validating token access rules against request {{(pid=71939) validate_allowed_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 24 17:14:13.744118 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2236271f-3e80-4f95-a502-9bd578a12379 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c90f21b9cdcb413282461fa83cb6b7a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3b3940d4ae1c4177ae29c02377bb4b0b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=71939) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 24 17:14:13.744777 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2236271f-3e80-4f95-a502-9bd578a12379 service neutron] REQUEST_METHOD: `GET` {{(pid=71939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 24 17:14:13.745120 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2236271f-3e80-4f95-a502-9bd578a12379 service neutron] SCRIPT_NAME: `/identity` {{(pid=71939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 24 17:14:13.745455 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2236271f-3e80-4f95-a502-9bd578a12379 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=71939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 24 17:14:13.755335 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2236271f-3e80-4f95-a502-9bd578a12379 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=71939) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:442}} Nov 24 17:14:13.783610 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2236271f-3e80-4f95-a502-9bd578a12379 service neutron] RBAC: Authorization granted {{(pid=71939) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 24 17:14:13.793180 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: [pid: 71939|app: 0|req: 1488/2963] 10.222.0.53 () {60 vars in 1356 bytes} [Wed Nov 24 17:14:13 2021] GET /identity/v3/auth/tokens => generated 3669 bytes in 139 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 24 17:14:14.147378 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46510b7b-1f30-4624-8d8a-c986e9710c6e None None] Authenticating user token {{(pid=71938) process_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 24 17:14:14.148862 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.fernet_utils [None req-46510b7b-1f30-4624-8d8a-c986e9710c6e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=71938) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:289}} Nov 24 17:14:14.160814 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46510b7b-1f30-4624-8d8a-c986e9710c6e None None] Validating token access rules against request {{(pid=71938) validate_allowed_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 24 17:14:14.165510 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6bcb09c-ae36-4e67-a53e-b7f33efde304 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f2ba2e8375b4e8c8792ee1e22b60427', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '00a5583c7b7443e98e7a1d31a0b638dc', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=71938) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 24 17:14:14.166522 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6bcb09c-ae36-4e67-a53e-b7f33efde304 admin admin] REQUEST_METHOD: `DELETE` {{(pid=71938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 24 17:14:14.166863 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6bcb09c-ae36-4e67-a53e-b7f33efde304 admin admin] SCRIPT_NAME: `/identity` {{(pid=71938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 24 17:14:14.167199 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6bcb09c-ae36-4e67-a53e-b7f33efde304 admin admin] PATH_INFO: `/v3/projects/a73e75511eaf4e6381bb17497cb73436` {{(pid=71938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 24 17:14:14.168442 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6bcb09c-ae36-4e67-a53e-b7f33efde304 admin admin] RBAC: Authorizing `identity:delete_project(project_id=a73e75511eaf4e6381bb17497cb73436)` {{(pid=71938) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:442}} Nov 24 17:14:14.198876 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6bcb09c-ae36-4e67-a53e-b7f33efde304 admin admin] RBAC: Authorization granted {{(pid=71938) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 24 17:14:14.251926 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.notifications [None req-d6bcb09c-ae36-4e67-a53e-b7f33efde304 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a73e75511eaf4e6381bb17497cb73436', 'request_id': 'req-d6bcb09c-ae36-4e67-a53e-b7f33efde304'} {{(pid=71938) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:357}} Nov 24 17:14:14.263889 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.notifications [None req-d6bcb09c-ae36-4e67-a53e-b7f33efde304 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a73e75511eaf4e6381bb17497cb73436', 'request_id': 'req-d6bcb09c-ae36-4e67-a53e-b7f33efde304'} {{(pid=71938) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:357}} Nov 24 17:14:14.269327 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.notifications [None req-d6bcb09c-ae36-4e67-a53e-b7f33efde304 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a73e75511eaf4e6381bb17497cb73436', 'request_id': 'req-d6bcb09c-ae36-4e67-a53e-b7f33efde304'} {{(pid=71938) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:357}} Nov 24 17:14:14.282196 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.notifications [None req-d6bcb09c-ae36-4e67-a53e-b7f33efde304 admin admin] The token cache is being invalidate because project a73e75511eaf4e6381bb17497cb73436 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=71938) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Nov 24 17:14:14.282531 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.notifications [None req-d6bcb09c-ae36-4e67-a53e-b7f33efde304 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=71938) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:357}} Nov 24 17:14:14.283229 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.notifications [None req-d6bcb09c-ae36-4e67-a53e-b7f33efde304 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=71938) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:357}} Nov 24 17:14:14.284812 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: [pid: 71938|app: 0|req: 1476/2964] 10.222.0.53 () {58 vars in 1223 bytes} [Wed Nov 24 17:14:14 2021] DELETE /identity/v3/projects/a73e75511eaf4e6381bb17497cb73436 => generated 0 bytes in 138 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Nov 24 17:14:14.289159 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2236271f-3e80-4f95-a502-9bd578a12379 service neutron] Authenticating user token {{(pid=71939) process_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 24 17:14:14.299841 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2236271f-3e80-4f95-a502-9bd578a12379 service neutron] Validating token access rules against request {{(pid=71939) validate_allowed_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 24 17:14:14.366644 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3fa0e68-090c-48bf-9c9d-fa85c34841b2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f2ba2e8375b4e8c8792ee1e22b60427', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '00a5583c7b7443e98e7a1d31a0b638dc', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=71939) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 24 17:14:14.367530 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3fa0e68-090c-48bf-9c9d-fa85c34841b2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=71939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 24 17:14:14.367872 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3fa0e68-090c-48bf-9c9d-fa85c34841b2 admin admin] SCRIPT_NAME: `/identity` {{(pid=71939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 24 17:14:14.368203 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3fa0e68-090c-48bf-9c9d-fa85c34841b2 admin admin] PATH_INFO: `/v3/users/074047193c664be6a72192ac8c08b3f4` {{(pid=71939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 24 17:14:14.369445 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3fa0e68-090c-48bf-9c9d-fa85c34841b2 admin admin] RBAC: Authorizing `identity:delete_user(user_id=074047193c664be6a72192ac8c08b3f4)` {{(pid=71939) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:442}} Nov 24 17:14:14.397621 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3fa0e68-090c-48bf-9c9d-fa85c34841b2 admin admin] RBAC: Authorization granted {{(pid=71939) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 24 17:14:14.445334 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.notifications [None req-f3fa0e68-090c-48bf-9c9d-fa85c34841b2 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '074047193c664be6a72192ac8c08b3f4'} {{(pid=71939) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:357}} Nov 24 17:14:14.457792 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.notifications [None req-f3fa0e68-090c-48bf-9c9d-fa85c34841b2 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '074047193c664be6a72192ac8c08b3f4'} {{(pid=71939) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:357}} Nov 24 17:14:14.458535 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.notifications [None req-f3fa0e68-090c-48bf-9c9d-fa85c34841b2 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '074047193c664be6a72192ac8c08b3f4'} {{(pid=71939) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:357}} Nov 24 17:14:14.466716 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.notifications [None req-f3fa0e68-090c-48bf-9c9d-fa85c34841b2 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '074047193c664be6a72192ac8c08b3f4'} {{(pid=71939) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:357}} Nov 24 17:14:14.473300 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.notifications [None req-f3fa0e68-090c-48bf-9c9d-fa85c34841b2 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '074047193c664be6a72192ac8c08b3f4'} {{(pid=71939) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:357}} Nov 24 17:14:14.479551 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: [pid: 71939|app: 0|req: 1489/2965] 10.222.0.53 () {58 vars in 1214 bytes} [Wed Nov 24 17:14:14 2021] DELETE /identity/v3/users/074047193c664be6a72192ac8c08b3f4 => generated 0 bytes in 191 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 24 17:14:14.840911 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6bcb09c-ae36-4e67-a53e-b7f33efde304 admin admin] Authenticating user token {{(pid=71938) process_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 24 17:14:14.842438 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.fernet_utils [None req-d6bcb09c-ae36-4e67-a53e-b7f33efde304 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=71938) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:289}} Nov 24 17:14:14.856080 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6bcb09c-ae36-4e67-a53e-b7f33efde304 admin admin] Validating token access rules against request {{(pid=71938) validate_allowed_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 24 17:14:14.923651 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13393d42-46ea-4bea-81fd-01a0203f5bb0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f2ba2e8375b4e8c8792ee1e22b60427', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '00a5583c7b7443e98e7a1d31a0b638dc', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=71938) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 24 17:14:14.924466 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13393d42-46ea-4bea-81fd-01a0203f5bb0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=71938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 24 17:14:14.925059 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13393d42-46ea-4bea-81fd-01a0203f5bb0 admin admin] SCRIPT_NAME: `/identity` {{(pid=71938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 24 17:14:14.925390 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13393d42-46ea-4bea-81fd-01a0203f5bb0 admin admin] PATH_INFO: `/v3/projects/70efa4c35fcc437eb66db0517d16c8b8` {{(pid=71938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 24 17:14:14.926634 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13393d42-46ea-4bea-81fd-01a0203f5bb0 admin admin] RBAC: Authorizing `identity:delete_project(project_id=70efa4c35fcc437eb66db0517d16c8b8)` {{(pid=71938) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:442}} Nov 24 17:14:14.955797 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13393d42-46ea-4bea-81fd-01a0203f5bb0 admin admin] RBAC: Authorization granted {{(pid=71938) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 24 17:14:15.012025 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.notifications [None req-13393d42-46ea-4bea-81fd-01a0203f5bb0 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '70efa4c35fcc437eb66db0517d16c8b8', 'request_id': 'req-13393d42-46ea-4bea-81fd-01a0203f5bb0'} {{(pid=71938) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:357}} Nov 24 17:14:15.023905 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.notifications [None req-13393d42-46ea-4bea-81fd-01a0203f5bb0 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '70efa4c35fcc437eb66db0517d16c8b8', 'request_id': 'req-13393d42-46ea-4bea-81fd-01a0203f5bb0'} {{(pid=71938) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:357}} Nov 24 17:14:15.031292 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.notifications [None req-13393d42-46ea-4bea-81fd-01a0203f5bb0 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '70efa4c35fcc437eb66db0517d16c8b8', 'request_id': 'req-13393d42-46ea-4bea-81fd-01a0203f5bb0'} {{(pid=71938) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:357}} Nov 24 17:14:15.043682 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.notifications [None req-13393d42-46ea-4bea-81fd-01a0203f5bb0 admin admin] The token cache is being invalidate because project 70efa4c35fcc437eb66db0517d16c8b8 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=71938) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Nov 24 17:14:15.044018 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.notifications [None req-13393d42-46ea-4bea-81fd-01a0203f5bb0 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=71938) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:357}} Nov 24 17:14:15.044684 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.notifications [None req-13393d42-46ea-4bea-81fd-01a0203f5bb0 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=71938) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:357}} Nov 24 17:14:15.046829 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: [pid: 71938|app: 0|req: 1477/2966] 10.222.0.53 () {58 vars in 1223 bytes} [Wed Nov 24 17:14:14 2021] DELETE /identity/v3/projects/70efa4c35fcc437eb66db0517d16c8b8 => generated 0 bytes in 207 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 24 17:14:15.053220 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71bbd352-2247-49ac-a349-68ce9378fe73 None None] REQUEST_METHOD: `POST` {{(pid=71939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 24 17:14:15.053570 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71bbd352-2247-49ac-a349-68ce9378fe73 None None] SCRIPT_NAME: `/identity` {{(pid=71939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 24 17:14:15.053911 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71bbd352-2247-49ac-a349-68ce9378fe73 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=71939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 24 17:14:15.079387 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.auth.core [None req-71bbd352-2247-49ac-a349-68ce9378fe73 None None] MFA Rules not processed for user `0f2ba2e8375b4e8c8792ee1e22b60427`. Rule list: `[]` (Enabled: `True`). {{(pid=71939) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:442}} Nov 24 17:14:15.080619 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.fernet_utils [None req-71bbd352-2247-49ac-a349-68ce9378fe73 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=71939) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:289}} Nov 24 17:14:15.147808 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: [pid: 71939|app: 0|req: 1490/2967] 10.222.0.53 () {58 vars in 948 bytes} [Wed Nov 24 17:14:15 2021] POST /identity/v3/auth/tokens => generated 3669 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 24 17:14:15.157076 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18d6278e-2385-4b5f-9769-ffe774f18dc5 None None] REQUEST_METHOD: `POST` {{(pid=71938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 24 17:14:15.157423 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18d6278e-2385-4b5f-9769-ffe774f18dc5 None None] SCRIPT_NAME: `/identity` {{(pid=71938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 24 17:14:15.157757 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18d6278e-2385-4b5f-9769-ffe774f18dc5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=71938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 24 17:14:15.182071 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.auth.core [None req-18d6278e-2385-4b5f-9769-ffe774f18dc5 None None] MFA Rules not processed for user `0f2ba2e8375b4e8c8792ee1e22b60427`. Rule list: `[]` (Enabled: `True`). {{(pid=71938) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:442}} Nov 24 17:14:15.183210 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.fernet_utils [None req-18d6278e-2385-4b5f-9769-ffe774f18dc5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=71938) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:289}} Nov 24 17:14:15.191730 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: [pid: 71938|app: 0|req: 1478/2968] 10.222.0.53 () {58 vars in 948 bytes} [Wed Nov 24 17:14:15 2021] POST /identity/v3/auth/tokens => generated 3669 bytes in 37 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 24 17:14:15.196217 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71bbd352-2247-49ac-a349-68ce9378fe73 None None] Authenticating user token {{(pid=71939) process_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 24 17:14:15.205946 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71bbd352-2247-49ac-a349-68ce9378fe73 None None] Validating token access rules against request {{(pid=71939) validate_allowed_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 24 17:14:15.210656 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a61deee-bfec-4c43-a507-82559a900fbf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f2ba2e8375b4e8c8792ee1e22b60427', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '00a5583c7b7443e98e7a1d31a0b638dc', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=71939) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 24 17:14:15.211320 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a61deee-bfec-4c43-a507-82559a900fbf admin admin] REQUEST_METHOD: `GET` {{(pid=71939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 24 17:14:15.211653 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a61deee-bfec-4c43-a507-82559a900fbf admin admin] SCRIPT_NAME: `/identity` {{(pid=71939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 24 17:14:15.211977 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a61deee-bfec-4c43-a507-82559a900fbf admin admin] PATH_INFO: `/v3/domains` {{(pid=71939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 24 17:14:15.212758 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a61deee-bfec-4c43-a507-82559a900fbf admin admin] RBAC: Adding query filter params (name=Default) {{(pid=71939) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:161}} Nov 24 17:14:15.213103 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a61deee-bfec-4c43-a507-82559a900fbf admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=71939) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:442}} Nov 24 17:14:15.242109 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a61deee-bfec-4c43-a507-82559a900fbf admin admin] RBAC: Authorization granted {{(pid=71939) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 24 17:14:15.255865 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: [pid: 71939|app: 0|req: 1491/2969] 10.222.0.53 () {58 vars in 1143 bytes} [Wed Nov 24 17:14:15 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 60 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 24 17:14:15.260533 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18d6278e-2385-4b5f-9769-ffe774f18dc5 None None] Authenticating user token {{(pid=71938) process_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 24 17:14:15.270276 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18d6278e-2385-4b5f-9769-ffe774f18dc5 None None] Validating token access rules against request {{(pid=71938) validate_allowed_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 24 17:14:15.274881 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4efad0b-ec01-4436-9d5a-2111d56fb474 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f2ba2e8375b4e8c8792ee1e22b60427', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '00a5583c7b7443e98e7a1d31a0b638dc', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=71938) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 24 17:14:15.275545 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4efad0b-ec01-4436-9d5a-2111d56fb474 admin admin] REQUEST_METHOD: `POST` {{(pid=71938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 24 17:14:15.275886 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4efad0b-ec01-4436-9d5a-2111d56fb474 admin admin] SCRIPT_NAME: `/identity` {{(pid=71938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 24 17:14:15.276222 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4efad0b-ec01-4436-9d5a-2111d56fb474 admin admin] PATH_INFO: `/v3/projects` {{(pid=71938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 24 17:14:15.276954 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4efad0b-ec01-4436-9d5a-2111d56fb474 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=71938) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:442}} Nov 24 17:14:15.306916 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4efad0b-ec01-4436-9d5a-2111d56fb474 admin admin] RBAC: Authorization granted {{(pid=71938) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 24 17:14:15.342089 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: [pid: 71938|app: 0|req: 1479/2970] 10.222.0.53 () {60 vars in 1143 bytes} [Wed Nov 24 17:14:15 2021] POST /identity/v3/projects => generated 381 bytes in 81 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 24 17:14:15.346592 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a61deee-bfec-4c43-a507-82559a900fbf admin admin] Authenticating user token {{(pid=71939) process_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 24 17:14:15.356694 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a61deee-bfec-4c43-a507-82559a900fbf admin admin] Validating token access rules against request {{(pid=71939) validate_allowed_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 24 17:14:15.424008 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc0216c3-2fa0-48b6-879b-4a7f7ccbaf21 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f2ba2e8375b4e8c8792ee1e22b60427', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '00a5583c7b7443e98e7a1d31a0b638dc', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=71939) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 24 17:14:15.424943 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc0216c3-2fa0-48b6-879b-4a7f7ccbaf21 admin admin] REQUEST_METHOD: `POST` {{(pid=71939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 24 17:14:15.425285 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc0216c3-2fa0-48b6-879b-4a7f7ccbaf21 admin admin] SCRIPT_NAME: `/identity` {{(pid=71939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 24 17:14:15.425621 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc0216c3-2fa0-48b6-879b-4a7f7ccbaf21 admin admin] PATH_INFO: `/v3/users` {{(pid=71939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 24 17:14:15.426386 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc0216c3-2fa0-48b6-879b-4a7f7ccbaf21 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=71939) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:442}} Nov 24 17:14:15.455195 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc0216c3-2fa0-48b6-879b-4a7f7ccbaf21 admin admin] RBAC: Authorization granted {{(pid=71939) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 24 17:14:15.474179 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: [pid: 71939|app: 0|req: 1492/2971] 10.222.0.53 () {60 vars in 1134 bytes} [Wed Nov 24 17:14:15 2021] POST /identity/v3/users => generated 291 bytes in 128 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 24 17:14:15.478579 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4efad0b-ec01-4436-9d5a-2111d56fb474 admin admin] Authenticating user token {{(pid=71938) process_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 24 17:14:15.489324 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4efad0b-ec01-4436-9d5a-2111d56fb474 admin admin] Validating token access rules against request {{(pid=71938) validate_allowed_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 24 17:14:15.493857 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6381890e-a08d-444e-a638-daac25404fbc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f2ba2e8375b4e8c8792ee1e22b60427', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '00a5583c7b7443e98e7a1d31a0b638dc', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=71938) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 24 17:14:15.494556 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6381890e-a08d-444e-a638-daac25404fbc admin admin] REQUEST_METHOD: `GET` {{(pid=71938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 24 17:14:15.494899 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6381890e-a08d-444e-a638-daac25404fbc admin admin] SCRIPT_NAME: `/identity` {{(pid=71938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 24 17:14:15.495240 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6381890e-a08d-444e-a638-daac25404fbc admin admin] PATH_INFO: `/v3/roles` {{(pid=71938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 24 17:14:15.496027 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6381890e-a08d-444e-a638-daac25404fbc admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=71938) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:442}} Nov 24 17:14:15.524512 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6381890e-a08d-444e-a638-daac25404fbc admin admin] RBAC: Authorization granted {{(pid=71938) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 24 17:14:15.536100 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: [pid: 71938|app: 0|req: 1480/2972] 10.222.0.53 () {58 vars in 1112 bytes} [Wed Nov 24 17:14:15 2021] GET /identity/v3/roles => generated 1420 bytes in 58 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 24 17:14:15.540281 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc0216c3-2fa0-48b6-879b-4a7f7ccbaf21 admin admin] Authenticating user token {{(pid=71939) process_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 24 17:14:15.550601 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc0216c3-2fa0-48b6-879b-4a7f7ccbaf21 admin admin] Validating token access rules against request {{(pid=71939) validate_allowed_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 24 17:14:15.555132 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-157a1b76-93f9-4da5-baaa-e30a2f6cf99d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f2ba2e8375b4e8c8792ee1e22b60427', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '00a5583c7b7443e98e7a1d31a0b638dc', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=71939) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 24 17:14:15.556029 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-157a1b76-93f9-4da5-baaa-e30a2f6cf99d admin admin] REQUEST_METHOD: `PUT` {{(pid=71939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 24 17:14:15.556372 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-157a1b76-93f9-4da5-baaa-e30a2f6cf99d admin admin] SCRIPT_NAME: `/identity` {{(pid=71939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 24 17:14:15.556707 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-157a1b76-93f9-4da5-baaa-e30a2f6cf99d admin admin] PATH_INFO: `/v3/projects/ee73adbae66f4d91834f956622e81cd0/users/dda80c4d3c5a4ba597e5350e8f73ebd5/roles/912ab5f10fa5477da74acf239f07604e` {{(pid=71939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 24 17:14:15.577780 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-157a1b76-93f9-4da5-baaa-e30a2f6cf99d admin admin] RBAC: Authorizing `identity:create_grant(project_id=ee73adbae66f4d91834f956622e81cd0, user_id=dda80c4d3c5a4ba597e5350e8f73ebd5, role_id=912ab5f10fa5477da74acf239f07604e)` {{(pid=71939) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:442}} Nov 24 17:14:15.607337 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-157a1b76-93f9-4da5-baaa-e30a2f6cf99d admin admin] RBAC: Authorization granted {{(pid=71939) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 24 17:14:15.619044 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: [pid: 71939|app: 0|req: 1493/2973] 10.222.0.53 () {60 vars in 1473 bytes} [Wed Nov 24 17:14:15 2021] PUT /identity/v3/projects/ee73adbae66f4d91834f956622e81cd0/users/dda80c4d3c5a4ba597e5350e8f73ebd5/roles/912ab5f10fa5477da74acf239f07604e => generated 0 bytes in 79 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 24 17:14:15.669707 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1d6b0a9-8eeb-4bb9-9c32-7e4eab1563d9 None None] REQUEST_METHOD: `POST` {{(pid=71938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 24 17:14:15.670085 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1d6b0a9-8eeb-4bb9-9c32-7e4eab1563d9 None None] SCRIPT_NAME: `/identity` {{(pid=71938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 24 17:14:15.670426 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1d6b0a9-8eeb-4bb9-9c32-7e4eab1563d9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=71938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 24 17:14:15.709326 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.auth.core [None req-a1d6b0a9-8eeb-4bb9-9c32-7e4eab1563d9 None None] MFA Rules not processed for user `dda80c4d3c5a4ba597e5350e8f73ebd5`. Rule list: `[]` (Enabled: `True`). {{(pid=71938) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:442}} Nov 24 17:14:15.710563 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.fernet_utils [None req-a1d6b0a9-8eeb-4bb9-9c32-7e4eab1563d9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=71938) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:289}} Nov 24 17:14:15.784459 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: [pid: 71938|app: 0|req: 1481/2974] 10.222.0.53 () {58 vars in 948 bytes} [Wed Nov 24 17:14:15 2021] POST /identity/v3/auth/tokens => generated 3688 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 24 17:14:15.789217 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-157a1b76-93f9-4da5-baaa-e30a2f6cf99d admin admin] Authenticating user token {{(pid=71939) process_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 24 17:14:15.860933 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-157a1b76-93f9-4da5-baaa-e30a2f6cf99d admin admin] Validating token access rules against request {{(pid=71939) validate_allowed_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 24 17:14:15.865541 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dc54ab0-4c60-40dc-b6f7-beebed3074c8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f2ba2e8375b4e8c8792ee1e22b60427', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '00a5583c7b7443e98e7a1d31a0b638dc', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=71939) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 24 17:14:15.866231 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dc54ab0-4c60-40dc-b6f7-beebed3074c8 admin admin] REQUEST_METHOD: `POST` {{(pid=71939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 24 17:14:15.866573 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dc54ab0-4c60-40dc-b6f7-beebed3074c8 admin admin] SCRIPT_NAME: `/identity` {{(pid=71939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 24 17:14:15.866906 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dc54ab0-4c60-40dc-b6f7-beebed3074c8 admin admin] PATH_INFO: `/v3/projects` {{(pid=71939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 24 17:14:15.867639 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8dc54ab0-4c60-40dc-b6f7-beebed3074c8 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=71939) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:442}} Nov 24 17:14:15.896351 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8dc54ab0-4c60-40dc-b6f7-beebed3074c8 admin admin] RBAC: Authorization granted {{(pid=71939) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 24 17:14:15.922798 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: [pid: 71939|app: 0|req: 1494/2975] 10.222.0.53 () {60 vars in 1143 bytes} [Wed Nov 24 17:14:15 2021] POST /identity/v3/projects => generated 379 bytes in 134 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 24 17:14:15.927328 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1d6b0a9-8eeb-4bb9-9c32-7e4eab1563d9 None None] Authenticating user token {{(pid=71938) process_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 24 17:14:15.938167 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1d6b0a9-8eeb-4bb9-9c32-7e4eab1563d9 None None] Validating token access rules against request {{(pid=71938) validate_allowed_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 24 17:14:16.003030 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11d1301f-f483-4c56-9b91-34330525a2a3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f2ba2e8375b4e8c8792ee1e22b60427', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '00a5583c7b7443e98e7a1d31a0b638dc', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=71938) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 24 17:14:16.003651 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11d1301f-f483-4c56-9b91-34330525a2a3 admin admin] REQUEST_METHOD: `POST` {{(pid=71938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 24 17:14:16.003990 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11d1301f-f483-4c56-9b91-34330525a2a3 admin admin] SCRIPT_NAME: `/identity` {{(pid=71938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 24 17:14:16.004324 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11d1301f-f483-4c56-9b91-34330525a2a3 admin admin] PATH_INFO: `/v3/users` {{(pid=71938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 24 17:14:16.005051 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11d1301f-f483-4c56-9b91-34330525a2a3 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=71938) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:442}} Nov 24 17:14:16.034161 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11d1301f-f483-4c56-9b91-34330525a2a3 admin admin] RBAC: Authorization granted {{(pid=71938) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 24 17:14:16.053035 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: [pid: 71938|app: 0|req: 1482/2976] 10.222.0.53 () {60 vars in 1134 bytes} [Wed Nov 24 17:14:15 2021] POST /identity/v3/users => generated 296 bytes in 126 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 24 17:14:16.057250 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dc54ab0-4c60-40dc-b6f7-beebed3074c8 admin admin] Authenticating user token {{(pid=71939) process_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 24 17:14:16.067660 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dc54ab0-4c60-40dc-b6f7-beebed3074c8 admin admin] Validating token access rules against request {{(pid=71939) validate_allowed_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 24 17:14:16.072304 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63d51deb-43f8-4c65-8564-95ea1d43a314 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f2ba2e8375b4e8c8792ee1e22b60427', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '00a5583c7b7443e98e7a1d31a0b638dc', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=71939) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 24 17:14:16.072979 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63d51deb-43f8-4c65-8564-95ea1d43a314 admin admin] REQUEST_METHOD: `GET` {{(pid=71939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 24 17:14:16.073325 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63d51deb-43f8-4c65-8564-95ea1d43a314 admin admin] SCRIPT_NAME: `/identity` {{(pid=71939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 24 17:14:16.073664 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63d51deb-43f8-4c65-8564-95ea1d43a314 admin admin] PATH_INFO: `/v3/roles` {{(pid=71939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 24 17:14:16.074486 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63d51deb-43f8-4c65-8564-95ea1d43a314 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=71939) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:442}} Nov 24 17:14:16.108604 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63d51deb-43f8-4c65-8564-95ea1d43a314 admin admin] RBAC: Authorization granted {{(pid=71939) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 24 17:14:16.120526 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: [pid: 71939|app: 0|req: 1495/2977] 10.222.0.53 () {58 vars in 1112 bytes} [Wed Nov 24 17:14:16 2021] GET /identity/v3/roles => generated 1420 bytes in 64 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 24 17:14:16.124991 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11d1301f-f483-4c56-9b91-34330525a2a3 admin admin] Authenticating user token {{(pid=71938) process_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 24 17:14:16.135012 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11d1301f-f483-4c56-9b91-34330525a2a3 admin admin] Validating token access rules against request {{(pid=71938) validate_allowed_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 24 17:14:16.139545 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7c6f459-7149-4891-a107-153e7acd3f2f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f2ba2e8375b4e8c8792ee1e22b60427', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '00a5583c7b7443e98e7a1d31a0b638dc', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=71938) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 24 17:14:16.140974 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7c6f459-7149-4891-a107-153e7acd3f2f admin admin] REQUEST_METHOD: `PUT` {{(pid=71938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 24 17:14:16.141318 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7c6f459-7149-4891-a107-153e7acd3f2f admin admin] SCRIPT_NAME: `/identity` {{(pid=71938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 24 17:14:16.141646 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7c6f459-7149-4891-a107-153e7acd3f2f admin admin] PATH_INFO: `/v3/projects/82ffce5600084193a2b6d7e6a340dc67/users/730d55e789484157a87e479803953fa7/roles/5611724e350b41e19921b5961a342582` {{(pid=71938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 24 17:14:16.162959 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7c6f459-7149-4891-a107-153e7acd3f2f admin admin] RBAC: Authorizing `identity:create_grant(project_id=82ffce5600084193a2b6d7e6a340dc67, user_id=730d55e789484157a87e479803953fa7, role_id=5611724e350b41e19921b5961a342582)` {{(pid=71938) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:442}} Nov 24 17:14:16.192521 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7c6f459-7149-4891-a107-153e7acd3f2f admin admin] RBAC: Authorization granted {{(pid=71938) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 24 17:14:16.205236 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: [pid: 71938|app: 0|req: 1483/2978] 10.222.0.53 () {60 vars in 1473 bytes} [Wed Nov 24 17:14:16 2021] PUT /identity/v3/projects/82ffce5600084193a2b6d7e6a340dc67/users/730d55e789484157a87e479803953fa7/roles/5611724e350b41e19921b5961a342582 => generated 0 bytes in 81 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 24 17:14:16.209508 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63d51deb-43f8-4c65-8564-95ea1d43a314 admin admin] Authenticating user token {{(pid=71939) process_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 24 17:14:16.220623 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63d51deb-43f8-4c65-8564-95ea1d43a314 admin admin] Validating token access rules against request {{(pid=71939) validate_allowed_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 24 17:14:16.285525 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4abeb4d-127d-4968-be73-74a5515d434e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f2ba2e8375b4e8c8792ee1e22b60427', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '00a5583c7b7443e98e7a1d31a0b638dc', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=71939) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 24 17:14:16.286162 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4abeb4d-127d-4968-be73-74a5515d434e admin admin] REQUEST_METHOD: `GET` {{(pid=71939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 24 17:14:16.286499 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4abeb4d-127d-4968-be73-74a5515d434e admin admin] SCRIPT_NAME: `/identity` {{(pid=71939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 24 17:14:16.286828 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4abeb4d-127d-4968-be73-74a5515d434e admin admin] PATH_INFO: `/v3/roles` {{(pid=71939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 24 17:14:16.287609 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4abeb4d-127d-4968-be73-74a5515d434e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=71939) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:442}} Nov 24 17:14:16.315687 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4abeb4d-127d-4968-be73-74a5515d434e admin admin] RBAC: Authorization granted {{(pid=71939) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 24 17:14:16.326235 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: [pid: 71939|app: 0|req: 1496/2979] 10.222.0.53 () {58 vars in 1112 bytes} [Wed Nov 24 17:14:16 2021] GET /identity/v3/roles => generated 1420 bytes in 117 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 24 17:14:16.331477 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7c6f459-7149-4891-a107-153e7acd3f2f admin admin] Authenticating user token {{(pid=71938) process_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 24 17:14:16.341934 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7c6f459-7149-4891-a107-153e7acd3f2f admin admin] Validating token access rules against request {{(pid=71938) validate_allowed_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 24 17:14:16.346608 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b58de716-3e9d-48f7-a4b4-2436349fd2e1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f2ba2e8375b4e8c8792ee1e22b60427', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '00a5583c7b7443e98e7a1d31a0b638dc', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=71938) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 24 17:14:16.347516 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b58de716-3e9d-48f7-a4b4-2436349fd2e1 admin admin] REQUEST_METHOD: `PUT` {{(pid=71938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 24 17:14:16.347854 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b58de716-3e9d-48f7-a4b4-2436349fd2e1 admin admin] SCRIPT_NAME: `/identity` {{(pid=71938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 24 17:14:16.348193 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b58de716-3e9d-48f7-a4b4-2436349fd2e1 admin admin] PATH_INFO: `/v3/projects/82ffce5600084193a2b6d7e6a340dc67/users/730d55e789484157a87e479803953fa7/roles/5611724e350b41e19921b5961a342582` {{(pid=71938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 24 17:14:16.350183 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b58de716-3e9d-48f7-a4b4-2436349fd2e1 admin admin] RBAC: Authorizing `identity:create_grant(project_id=82ffce5600084193a2b6d7e6a340dc67, user_id=730d55e789484157a87e479803953fa7, role_id=5611724e350b41e19921b5961a342582)` {{(pid=71938) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:442}} Nov 24 17:14:16.380458 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b58de716-3e9d-48f7-a4b4-2436349fd2e1 admin admin] RBAC: Authorization granted {{(pid=71938) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 24 17:14:16.391210 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: [pid: 71938|app: 0|req: 1484/2980] 10.222.0.53 () {60 vars in 1473 bytes} [Wed Nov 24 17:14:16 2021] PUT /identity/v3/projects/82ffce5600084193a2b6d7e6a340dc67/users/730d55e789484157a87e479803953fa7/roles/5611724e350b41e19921b5961a342582 => generated 0 bytes in 60 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 24 17:14:16.395310 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4abeb4d-127d-4968-be73-74a5515d434e admin admin] Authenticating user token {{(pid=71939) process_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 24 17:14:16.405848 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4abeb4d-127d-4968-be73-74a5515d434e admin admin] Validating token access rules against request {{(pid=71939) validate_allowed_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 24 17:14:16.475063 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52244a63-b570-4f90-a04e-337ea21663a2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f2ba2e8375b4e8c8792ee1e22b60427', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '00a5583c7b7443e98e7a1d31a0b638dc', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=71939) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 24 17:14:16.475745 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52244a63-b570-4f90-a04e-337ea21663a2 admin admin] REQUEST_METHOD: `GET` {{(pid=71939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 24 17:14:16.476087 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52244a63-b570-4f90-a04e-337ea21663a2 admin admin] SCRIPT_NAME: `/identity` {{(pid=71939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 24 17:14:16.476428 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52244a63-b570-4f90-a04e-337ea21663a2 admin admin] PATH_INFO: `/v3/roles` {{(pid=71939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 24 17:14:16.477213 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52244a63-b570-4f90-a04e-337ea21663a2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=71939) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:442}} Nov 24 17:14:16.505895 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52244a63-b570-4f90-a04e-337ea21663a2 admin admin] RBAC: Authorization granted {{(pid=71939) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 24 17:14:16.517398 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: [pid: 71939|app: 0|req: 1497/2981] 10.222.0.53 () {58 vars in 1112 bytes} [Wed Nov 24 17:14:16 2021] GET /identity/v3/roles => generated 1420 bytes in 122 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 24 17:14:16.522001 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b58de716-3e9d-48f7-a4b4-2436349fd2e1 admin admin] Authenticating user token {{(pid=71938) process_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 24 17:14:16.532575 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b58de716-3e9d-48f7-a4b4-2436349fd2e1 admin admin] Validating token access rules against request {{(pid=71938) validate_allowed_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 24 17:14:16.537202 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54653fb0-0176-4e7a-96a9-290d8f193604 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f2ba2e8375b4e8c8792ee1e22b60427', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '00a5583c7b7443e98e7a1d31a0b638dc', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=71938) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 24 17:14:16.538062 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54653fb0-0176-4e7a-96a9-290d8f193604 admin admin] REQUEST_METHOD: `PUT` {{(pid=71938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 24 17:14:16.538423 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54653fb0-0176-4e7a-96a9-290d8f193604 admin admin] SCRIPT_NAME: `/identity` {{(pid=71938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 24 17:14:16.538755 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54653fb0-0176-4e7a-96a9-290d8f193604 admin admin] PATH_INFO: `/v3/projects/82ffce5600084193a2b6d7e6a340dc67/users/730d55e789484157a87e479803953fa7/roles/912ab5f10fa5477da74acf239f07604e` {{(pid=71938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 24 17:14:16.540727 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54653fb0-0176-4e7a-96a9-290d8f193604 admin admin] RBAC: Authorizing `identity:create_grant(project_id=82ffce5600084193a2b6d7e6a340dc67, user_id=730d55e789484157a87e479803953fa7, role_id=912ab5f10fa5477da74acf239f07604e)` {{(pid=71938) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:442}} Nov 24 17:14:16.570933 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54653fb0-0176-4e7a-96a9-290d8f193604 admin admin] RBAC: Authorization granted {{(pid=71938) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 24 17:14:16.583519 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: [pid: 71938|app: 0|req: 1485/2982] 10.222.0.53 () {60 vars in 1473 bytes} [Wed Nov 24 17:14:16 2021] PUT /identity/v3/projects/82ffce5600084193a2b6d7e6a340dc67/users/730d55e789484157a87e479803953fa7/roles/912ab5f10fa5477da74acf239f07604e => generated 0 bytes in 62 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 24 17:14:16.594613 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6c781fd-1076-4e2e-97d4-27ee42a27f72 None None] REQUEST_METHOD: `POST` {{(pid=71939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 24 17:14:16.594968 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6c781fd-1076-4e2e-97d4-27ee42a27f72 None None] SCRIPT_NAME: `/identity` {{(pid=71939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 24 17:14:16.595309 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6c781fd-1076-4e2e-97d4-27ee42a27f72 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=71939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 24 17:14:16.633157 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.auth.core [None req-a6c781fd-1076-4e2e-97d4-27ee42a27f72 None None] MFA Rules not processed for user `730d55e789484157a87e479803953fa7`. Rule list: `[]` (Enabled: `True`). {{(pid=71939) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:442}} Nov 24 17:14:16.634431 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.fernet_utils [None req-a6c781fd-1076-4e2e-97d4-27ee42a27f72 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=71939) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:289}} Nov 24 17:14:16.714013 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: [pid: 71939|app: 0|req: 1498/2983] 10.222.0.53 () {58 vars in 948 bytes} [Wed Nov 24 17:14:16 2021] POST /identity/v3/auth/tokens => generated 3753 bytes in 121 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 24 17:14:16.725998 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54653fb0-0176-4e7a-96a9-290d8f193604 admin admin] Authenticating user token {{(pid=71938) process_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 24 17:14:16.727755 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.fernet_utils [None req-54653fb0-0176-4e7a-96a9-290d8f193604 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=71938) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:289}} Nov 24 17:14:16.795657 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54653fb0-0176-4e7a-96a9-290d8f193604 admin admin] Validating token access rules against request {{(pid=71938) validate_allowed_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 24 17:14:16.800113 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d921b726-0cac-4ba1-9f32-8f14312aad34 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a12374a3093a401a97c343ff0854184d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3b3940d4ae1c4177ae29c02377bb4b0b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=71938) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 24 17:14:16.800761 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d921b726-0cac-4ba1-9f32-8f14312aad34 service cinder] REQUEST_METHOD: `GET` {{(pid=71938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 24 17:14:16.801101 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d921b726-0cac-4ba1-9f32-8f14312aad34 service cinder] SCRIPT_NAME: `/identity` {{(pid=71938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 24 17:14:16.801431 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d921b726-0cac-4ba1-9f32-8f14312aad34 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=71938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 24 17:14:16.810709 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d921b726-0cac-4ba1-9f32-8f14312aad34 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=71938) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:442}} Nov 24 17:14:16.838766 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d921b726-0cac-4ba1-9f32-8f14312aad34 service cinder] RBAC: Authorization granted {{(pid=71938) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 24 17:14:16.848740 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: [pid: 71938|app: 0|req: 1486/2984] 10.222.0.53 () {60 vars in 1356 bytes} [Wed Nov 24 17:14:16 2021] GET /identity/v3/auth/tokens => generated 3753 bytes in 123 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 24 17:14:17.189948 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6c781fd-1076-4e2e-97d4-27ee42a27f72 None None] Authenticating user token {{(pid=71939) process_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 24 17:14:17.199196 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6c781fd-1076-4e2e-97d4-27ee42a27f72 None None] Validating token access rules against request {{(pid=71939) validate_allowed_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 24 17:14:17.206083 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-273531e0-fe75-4f0b-8f52-eff1fe5da9dd tempest-VolumeQuotaClassesTest-154925074 tempest-VolumeQuotaClassesTest-154925074-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '730d55e789484157a87e479803953fa7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '82ffce5600084193a2b6d7e6a340dc67', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=71939) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 24 17:14:17.206755 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-273531e0-fe75-4f0b-8f52-eff1fe5da9dd tempest-VolumeQuotaClassesTest-154925074 tempest-VolumeQuotaClassesTest-154925074-project-admin] REQUEST_METHOD: `GET` {{(pid=71939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 24 17:14:17.207106 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-273531e0-fe75-4f0b-8f52-eff1fe5da9dd tempest-VolumeQuotaClassesTest-154925074 tempest-VolumeQuotaClassesTest-154925074-project-admin] SCRIPT_NAME: `/identity` {{(pid=71939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 24 17:14:17.207449 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-273531e0-fe75-4f0b-8f52-eff1fe5da9dd tempest-VolumeQuotaClassesTest-154925074 tempest-VolumeQuotaClassesTest-154925074-project-admin] PATH_INFO: `/v3/domains` {{(pid=71939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 24 17:14:17.208237 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-273531e0-fe75-4f0b-8f52-eff1fe5da9dd tempest-VolumeQuotaClassesTest-154925074 tempest-VolumeQuotaClassesTest-154925074-project-admin] RBAC: Adding query filter params (name=Default) {{(pid=71939) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:161}} Nov 24 17:14:17.208593 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-273531e0-fe75-4f0b-8f52-eff1fe5da9dd tempest-VolumeQuotaClassesTest-154925074 tempest-VolumeQuotaClassesTest-154925074-project-admin] RBAC: Authorizing `identity:list_domains()` {{(pid=71939) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:442}} Nov 24 17:14:17.236340 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-273531e0-fe75-4f0b-8f52-eff1fe5da9dd tempest-VolumeQuotaClassesTest-154925074 tempest-VolumeQuotaClassesTest-154925074-project-admin] RBAC: Authorization granted {{(pid=71939) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 24 17:14:17.250659 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: [pid: 71939|app: 0|req: 1499/2985] 10.222.0.53 () {58 vars in 1143 bytes} [Wed Nov 24 17:14:17 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 61 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 24 17:14:17.255187 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d921b726-0cac-4ba1-9f32-8f14312aad34 service cinder] Authenticating user token {{(pid=71938) process_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 24 17:14:17.264455 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d921b726-0cac-4ba1-9f32-8f14312aad34 service cinder] Validating token access rules against request {{(pid=71938) validate_allowed_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 24 17:14:17.270622 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74a3647e-220b-449d-b2b5-3481b7ad3994 tempest-VolumeQuotaClassesTest-154925074 tempest-VolumeQuotaClassesTest-154925074-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '730d55e789484157a87e479803953fa7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '82ffce5600084193a2b6d7e6a340dc67', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=71938) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 24 17:14:17.271300 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74a3647e-220b-449d-b2b5-3481b7ad3994 tempest-VolumeQuotaClassesTest-154925074 tempest-VolumeQuotaClassesTest-154925074-project-admin] REQUEST_METHOD: `POST` {{(pid=71938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 24 17:14:17.271653 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74a3647e-220b-449d-b2b5-3481b7ad3994 tempest-VolumeQuotaClassesTest-154925074 tempest-VolumeQuotaClassesTest-154925074-project-admin] SCRIPT_NAME: `/identity` {{(pid=71938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 24 17:14:17.271999 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74a3647e-220b-449d-b2b5-3481b7ad3994 tempest-VolumeQuotaClassesTest-154925074 tempest-VolumeQuotaClassesTest-154925074-project-admin] PATH_INFO: `/v3/projects` {{(pid=71938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 24 17:14:17.272738 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74a3647e-220b-449d-b2b5-3481b7ad3994 tempest-VolumeQuotaClassesTest-154925074 tempest-VolumeQuotaClassesTest-154925074-project-admin] RBAC: Authorizing `identity:create_project()` {{(pid=71938) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:442}} Nov 24 17:14:17.307568 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74a3647e-220b-449d-b2b5-3481b7ad3994 tempest-VolumeQuotaClassesTest-154925074 tempest-VolumeQuotaClassesTest-154925074-project-admin] RBAC: Authorization granted {{(pid=71938) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 24 17:14:17.335653 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: [pid: 71938|app: 0|req: 1487/2986] 10.222.0.53 () {60 vars in 1143 bytes} [Wed Nov 24 17:14:17 2021] POST /identity/v3/projects => generated 353 bytes in 81 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 24 17:14:17.340074 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-273531e0-fe75-4f0b-8f52-eff1fe5da9dd tempest-VolumeQuotaClassesTest-154925074 tempest-VolumeQuotaClassesTest-154925074-project-admin] Authenticating user token {{(pid=71939) process_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 24 17:14:17.350063 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-273531e0-fe75-4f0b-8f52-eff1fe5da9dd tempest-VolumeQuotaClassesTest-154925074 tempest-VolumeQuotaClassesTest-154925074-project-admin] Validating token access rules against request {{(pid=71939) validate_allowed_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 24 17:14:17.415369 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dba41cd-80d3-4b74-a54b-5a7a6ae089d1 tempest-VolumeQuotaClassesTest-154925074 tempest-VolumeQuotaClassesTest-154925074-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '730d55e789484157a87e479803953fa7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '82ffce5600084193a2b6d7e6a340dc67', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=71939) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 24 17:14:17.416026 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dba41cd-80d3-4b74-a54b-5a7a6ae089d1 tempest-VolumeQuotaClassesTest-154925074 tempest-VolumeQuotaClassesTest-154925074-project-admin] REQUEST_METHOD: `GET` {{(pid=71939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 24 17:14:17.416377 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dba41cd-80d3-4b74-a54b-5a7a6ae089d1 tempest-VolumeQuotaClassesTest-154925074 tempest-VolumeQuotaClassesTest-154925074-project-admin] SCRIPT_NAME: `/identity` {{(pid=71939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 24 17:14:17.416721 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dba41cd-80d3-4b74-a54b-5a7a6ae089d1 tempest-VolumeQuotaClassesTest-154925074 tempest-VolumeQuotaClassesTest-154925074-project-admin] PATH_INFO: `/v3/domains` {{(pid=71939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 24 17:14:17.417517 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0dba41cd-80d3-4b74-a54b-5a7a6ae089d1 tempest-VolumeQuotaClassesTest-154925074 tempest-VolumeQuotaClassesTest-154925074-project-admin] RBAC: Adding query filter params (name=Default) {{(pid=71939) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:161}} Nov 24 17:14:17.417872 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0dba41cd-80d3-4b74-a54b-5a7a6ae089d1 tempest-VolumeQuotaClassesTest-154925074 tempest-VolumeQuotaClassesTest-154925074-project-admin] RBAC: Authorizing `identity:list_domains()` {{(pid=71939) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:442}} Nov 24 17:14:17.446700 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0dba41cd-80d3-4b74-a54b-5a7a6ae089d1 tempest-VolumeQuotaClassesTest-154925074 tempest-VolumeQuotaClassesTest-154925074-project-admin] RBAC: Authorization granted {{(pid=71939) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 24 17:14:17.459915 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: [pid: 71939|app: 0|req: 1500/2987] 10.222.0.53 () {58 vars in 1143 bytes} [Wed Nov 24 17:14:17 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 120 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 24 17:14:17.498146 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74a3647e-220b-449d-b2b5-3481b7ad3994 tempest-VolumeQuotaClassesTest-154925074 tempest-VolumeQuotaClassesTest-154925074-project-admin] Authenticating user token {{(pid=71938) process_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 24 17:14:17.509535 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74a3647e-220b-449d-b2b5-3481b7ad3994 tempest-VolumeQuotaClassesTest-154925074 tempest-VolumeQuotaClassesTest-154925074-project-admin] Validating token access rules against request {{(pid=71938) validate_allowed_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 24 17:14:17.514322 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7143f98-b390-4af1-b53d-7a8453c92957 tempest-VolumeQuotaClassesTest-154925074 tempest-VolumeQuotaClassesTest-154925074-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '730d55e789484157a87e479803953fa7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '82ffce5600084193a2b6d7e6a340dc67', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=71938) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 24 17:14:17.515836 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7143f98-b390-4af1-b53d-7a8453c92957 tempest-VolumeQuotaClassesTest-154925074 tempest-VolumeQuotaClassesTest-154925074-project-admin] REQUEST_METHOD: `DELETE` {{(pid=71938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 24 17:14:17.516186 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7143f98-b390-4af1-b53d-7a8453c92957 tempest-VolumeQuotaClassesTest-154925074 tempest-VolumeQuotaClassesTest-154925074-project-admin] SCRIPT_NAME: `/identity` {{(pid=71938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 24 17:14:17.516707 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7143f98-b390-4af1-b53d-7a8453c92957 tempest-VolumeQuotaClassesTest-154925074 tempest-VolumeQuotaClassesTest-154925074-project-admin] PATH_INFO: `/v3/projects/0ec6072cfbec4fdab3f2a0ad1632cfb3` {{(pid=71938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 24 17:14:17.518109 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7143f98-b390-4af1-b53d-7a8453c92957 tempest-VolumeQuotaClassesTest-154925074 tempest-VolumeQuotaClassesTest-154925074-project-admin] RBAC: Authorizing `identity:delete_project(project_id=0ec6072cfbec4fdab3f2a0ad1632cfb3)` {{(pid=71938) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:442}} Nov 24 17:14:17.546754 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7143f98-b390-4af1-b53d-7a8453c92957 tempest-VolumeQuotaClassesTest-154925074 tempest-VolumeQuotaClassesTest-154925074-project-admin] RBAC: Authorization granted {{(pid=71938) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 24 17:14:17.605590 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.notifications [None req-b7143f98-b390-4af1-b53d-7a8453c92957 tempest-VolumeQuotaClassesTest-154925074 tempest-VolumeQuotaClassesTest-154925074-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '0ec6072cfbec4fdab3f2a0ad1632cfb3', 'request_id': 'req-b7143f98-b390-4af1-b53d-7a8453c92957'} {{(pid=71938) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:357}} Nov 24 17:14:17.617940 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.notifications [None req-b7143f98-b390-4af1-b53d-7a8453c92957 tempest-VolumeQuotaClassesTest-154925074 tempest-VolumeQuotaClassesTest-154925074-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '0ec6072cfbec4fdab3f2a0ad1632cfb3', 'request_id': 'req-b7143f98-b390-4af1-b53d-7a8453c92957'} {{(pid=71938) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:357}} Nov 24 17:14:17.623218 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.notifications [None req-b7143f98-b390-4af1-b53d-7a8453c92957 tempest-VolumeQuotaClassesTest-154925074 tempest-VolumeQuotaClassesTest-154925074-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '0ec6072cfbec4fdab3f2a0ad1632cfb3', 'request_id': 'req-b7143f98-b390-4af1-b53d-7a8453c92957'} {{(pid=71938) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:357}} Nov 24 17:14:17.635082 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.notifications [None req-b7143f98-b390-4af1-b53d-7a8453c92957 tempest-VolumeQuotaClassesTest-154925074 tempest-VolumeQuotaClassesTest-154925074-project-admin] The token cache is being invalidate because project 0ec6072cfbec4fdab3f2a0ad1632cfb3 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=71938) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Nov 24 17:14:17.635407 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.notifications [None req-b7143f98-b390-4af1-b53d-7a8453c92957 tempest-VolumeQuotaClassesTest-154925074 tempest-VolumeQuotaClassesTest-154925074-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=71938) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:357}} Nov 24 17:14:17.636092 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.notifications [None req-b7143f98-b390-4af1-b53d-7a8453c92957 tempest-VolumeQuotaClassesTest-154925074 tempest-VolumeQuotaClassesTest-154925074-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=71938) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:357}} Nov 24 17:14:17.637650 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: [pid: 71938|app: 0|req: 1488/2988] 10.222.0.53 () {58 vars in 1223 bytes} [Wed Nov 24 17:14:17 2021] DELETE /identity/v3/projects/0ec6072cfbec4fdab3f2a0ad1632cfb3 => generated 0 bytes in 140 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 24 17:14:17.867084 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dba41cd-80d3-4b74-a54b-5a7a6ae089d1 tempest-VolumeQuotaClassesTest-154925074 tempest-VolumeQuotaClassesTest-154925074-project-admin] Authenticating user token {{(pid=71939) process_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 24 17:14:17.868855 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.fernet_utils [None req-0dba41cd-80d3-4b74-a54b-5a7a6ae089d1 tempest-VolumeQuotaClassesTest-154925074 tempest-VolumeQuotaClassesTest-154925074-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=71939) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:289}} Nov 24 17:14:17.955097 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dba41cd-80d3-4b74-a54b-5a7a6ae089d1 tempest-VolumeQuotaClassesTest-154925074 tempest-VolumeQuotaClassesTest-154925074-project-admin] Validating token access rules against request {{(pid=71939) validate_allowed_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 24 17:14:18.022427 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d0ec5b3-91d1-4927-8c8a-5e9a8d9a3100 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f2ba2e8375b4e8c8792ee1e22b60427', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '00a5583c7b7443e98e7a1d31a0b638dc', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=71939) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 24 17:14:18.023252 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d0ec5b3-91d1-4927-8c8a-5e9a8d9a3100 admin admin] REQUEST_METHOD: `DELETE` {{(pid=71939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 24 17:14:18.023591 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d0ec5b3-91d1-4927-8c8a-5e9a8d9a3100 admin admin] SCRIPT_NAME: `/identity` {{(pid=71939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 24 17:14:18.023928 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d0ec5b3-91d1-4927-8c8a-5e9a8d9a3100 admin admin] PATH_INFO: `/v3/users/dda80c4d3c5a4ba597e5350e8f73ebd5` {{(pid=71939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 24 17:14:18.025148 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d0ec5b3-91d1-4927-8c8a-5e9a8d9a3100 admin admin] RBAC: Authorizing `identity:delete_user(user_id=dda80c4d3c5a4ba597e5350e8f73ebd5)` {{(pid=71939) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:442}} Nov 24 17:14:18.054556 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d0ec5b3-91d1-4927-8c8a-5e9a8d9a3100 admin admin] RBAC: Authorization granted {{(pid=71939) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 24 17:14:18.101480 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.notifications [None req-1d0ec5b3-91d1-4927-8c8a-5e9a8d9a3100 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'dda80c4d3c5a4ba597e5350e8f73ebd5'} {{(pid=71939) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:357}} Nov 24 17:14:18.114390 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.notifications [None req-1d0ec5b3-91d1-4927-8c8a-5e9a8d9a3100 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'dda80c4d3c5a4ba597e5350e8f73ebd5'} {{(pid=71939) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:357}} Nov 24 17:14:18.115086 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.notifications [None req-1d0ec5b3-91d1-4927-8c8a-5e9a8d9a3100 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'dda80c4d3c5a4ba597e5350e8f73ebd5'} {{(pid=71939) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:357}} Nov 24 17:14:18.123228 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.notifications [None req-1d0ec5b3-91d1-4927-8c8a-5e9a8d9a3100 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'dda80c4d3c5a4ba597e5350e8f73ebd5'} {{(pid=71939) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:357}} Nov 24 17:14:18.129334 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.notifications [None req-1d0ec5b3-91d1-4927-8c8a-5e9a8d9a3100 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'dda80c4d3c5a4ba597e5350e8f73ebd5'} {{(pid=71939) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:357}} Nov 24 17:14:18.136229 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: [pid: 71939|app: 0|req: 1501/2989] 10.222.0.53 () {58 vars in 1214 bytes} [Wed Nov 24 17:14:17 2021] DELETE /identity/v3/users/dda80c4d3c5a4ba597e5350e8f73ebd5 => generated 0 bytes in 270 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 24 17:14:18.141079 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7790d94-11f6-4667-87d9-c3140285656b None None] REQUEST_METHOD: `POST` {{(pid=71938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 24 17:14:18.141435 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7790d94-11f6-4667-87d9-c3140285656b None None] SCRIPT_NAME: `/identity` {{(pid=71938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 24 17:14:18.141770 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7790d94-11f6-4667-87d9-c3140285656b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=71938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 24 17:14:18.165229 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.auth.core [None req-c7790d94-11f6-4667-87d9-c3140285656b None None] MFA Rules not processed for user `0f2ba2e8375b4e8c8792ee1e22b60427`. Rule list: `[]` (Enabled: `True`). {{(pid=71938) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:442}} Nov 24 17:14:18.166501 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.fernet_utils [None req-c7790d94-11f6-4667-87d9-c3140285656b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=71938) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:289}} Nov 24 17:14:18.236460 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: [pid: 71938|app: 0|req: 1489/2990] 10.222.0.53 () {58 vars in 948 bytes} [Wed Nov 24 17:14:18 2021] POST /identity/v3/auth/tokens => generated 3669 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 24 17:14:18.249585 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d0ec5b3-91d1-4927-8c8a-5e9a8d9a3100 admin admin] Authenticating user token {{(pid=71939) process_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 24 17:14:18.251227 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.fernet_utils [None req-1d0ec5b3-91d1-4927-8c8a-5e9a8d9a3100 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=71939) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:289}} Nov 24 17:14:18.318234 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d0ec5b3-91d1-4927-8c8a-5e9a8d9a3100 admin admin] Validating token access rules against request {{(pid=71939) validate_allowed_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 24 17:14:18.321799 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17b39779-de46-4cd6-be5e-3bb75f450330 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c90f21b9cdcb413282461fa83cb6b7a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3b3940d4ae1c4177ae29c02377bb4b0b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=71939) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 24 17:14:18.322486 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17b39779-de46-4cd6-be5e-3bb75f450330 service neutron] REQUEST_METHOD: `GET` {{(pid=71939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 24 17:14:18.322832 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17b39779-de46-4cd6-be5e-3bb75f450330 service neutron] SCRIPT_NAME: `/identity` {{(pid=71939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 24 17:14:18.323169 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17b39779-de46-4cd6-be5e-3bb75f450330 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=71939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 24 17:14:18.333580 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17b39779-de46-4cd6-be5e-3bb75f450330 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=71939) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:442}} Nov 24 17:14:18.361956 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17b39779-de46-4cd6-be5e-3bb75f450330 service neutron] RBAC: Authorization granted {{(pid=71939) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 24 17:14:18.371595 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: [pid: 71939|app: 0|req: 1502/2991] 10.222.0.53 () {60 vars in 1356 bytes} [Wed Nov 24 17:14:18 2021] GET /identity/v3/auth/tokens => generated 3669 bytes in 123 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 24 17:14:18.730956 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7790d94-11f6-4667-87d9-c3140285656b None None] Authenticating user token {{(pid=71938) process_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 24 17:14:18.732591 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.fernet_utils [None req-c7790d94-11f6-4667-87d9-c3140285656b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=71938) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:289}} Nov 24 17:14:18.745517 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7790d94-11f6-4667-87d9-c3140285656b None None] Validating token access rules against request {{(pid=71938) validate_allowed_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 24 17:14:18.750594 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a7331f0-3b23-4cb9-9af6-cb1f2196f7d8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f2ba2e8375b4e8c8792ee1e22b60427', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '00a5583c7b7443e98e7a1d31a0b638dc', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=71938) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 24 17:14:18.751478 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a7331f0-3b23-4cb9-9af6-cb1f2196f7d8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=71938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 24 17:14:18.751843 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a7331f0-3b23-4cb9-9af6-cb1f2196f7d8 admin admin] SCRIPT_NAME: `/identity` {{(pid=71938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 24 17:14:18.752157 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a7331f0-3b23-4cb9-9af6-cb1f2196f7d8 admin admin] PATH_INFO: `/v3/projects/ee73adbae66f4d91834f956622e81cd0` {{(pid=71938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 24 17:14:18.753383 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a7331f0-3b23-4cb9-9af6-cb1f2196f7d8 admin admin] RBAC: Authorizing `identity:delete_project(project_id=ee73adbae66f4d91834f956622e81cd0)` {{(pid=71938) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:442}} Nov 24 17:14:18.782588 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a7331f0-3b23-4cb9-9af6-cb1f2196f7d8 admin admin] RBAC: Authorization granted {{(pid=71938) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 24 17:14:18.833401 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.notifications [None req-6a7331f0-3b23-4cb9-9af6-cb1f2196f7d8 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ee73adbae66f4d91834f956622e81cd0', 'request_id': 'req-6a7331f0-3b23-4cb9-9af6-cb1f2196f7d8'} {{(pid=71938) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:357}} Nov 24 17:14:18.845158 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.notifications [None req-6a7331f0-3b23-4cb9-9af6-cb1f2196f7d8 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ee73adbae66f4d91834f956622e81cd0', 'request_id': 'req-6a7331f0-3b23-4cb9-9af6-cb1f2196f7d8'} {{(pid=71938) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:357}} Nov 24 17:14:18.850779 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.notifications [None req-6a7331f0-3b23-4cb9-9af6-cb1f2196f7d8 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ee73adbae66f4d91834f956622e81cd0', 'request_id': 'req-6a7331f0-3b23-4cb9-9af6-cb1f2196f7d8'} {{(pid=71938) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:357}} Nov 24 17:14:18.862225 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.notifications [None req-6a7331f0-3b23-4cb9-9af6-cb1f2196f7d8 admin admin] The token cache is being invalidate because project ee73adbae66f4d91834f956622e81cd0 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=71938) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Nov 24 17:14:18.862560 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.notifications [None req-6a7331f0-3b23-4cb9-9af6-cb1f2196f7d8 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=71938) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:357}} Nov 24 17:14:18.863234 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.notifications [None req-6a7331f0-3b23-4cb9-9af6-cb1f2196f7d8 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=71938) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:357}} Nov 24 17:14:18.864808 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: [pid: 71938|app: 0|req: 1490/2992] 10.222.0.53 () {58 vars in 1223 bytes} [Wed Nov 24 17:14:18 2021] DELETE /identity/v3/projects/ee73adbae66f4d91834f956622e81cd0 => generated 0 bytes in 135 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 24 17:14:18.869045 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17b39779-de46-4cd6-be5e-3bb75f450330 service neutron] Authenticating user token {{(pid=71939) process_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 24 17:14:18.879358 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17b39779-de46-4cd6-be5e-3bb75f450330 service neutron] Validating token access rules against request {{(pid=71939) validate_allowed_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 24 17:14:18.950683 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a384a77-3e59-43c8-95c7-bfd0d45f048e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f2ba2e8375b4e8c8792ee1e22b60427', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '00a5583c7b7443e98e7a1d31a0b638dc', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=71939) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 24 17:14:18.951581 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a384a77-3e59-43c8-95c7-bfd0d45f048e admin admin] REQUEST_METHOD: `DELETE` {{(pid=71939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 24 17:14:18.951925 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a384a77-3e59-43c8-95c7-bfd0d45f048e admin admin] SCRIPT_NAME: `/identity` {{(pid=71939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 24 17:14:18.952792 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a384a77-3e59-43c8-95c7-bfd0d45f048e admin admin] PATH_INFO: `/v3/users/730d55e789484157a87e479803953fa7` {{(pid=71939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 24 17:14:18.954004 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a384a77-3e59-43c8-95c7-bfd0d45f048e admin admin] RBAC: Authorizing `identity:delete_user(user_id=730d55e789484157a87e479803953fa7)` {{(pid=71939) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:442}} Nov 24 17:14:18.982341 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a384a77-3e59-43c8-95c7-bfd0d45f048e admin admin] RBAC: Authorization granted {{(pid=71939) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 24 17:14:19.036342 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.notifications [None req-8a384a77-3e59-43c8-95c7-bfd0d45f048e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '730d55e789484157a87e479803953fa7'} {{(pid=71939) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:357}} Nov 24 17:14:19.048260 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.notifications [None req-8a384a77-3e59-43c8-95c7-bfd0d45f048e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '730d55e789484157a87e479803953fa7'} {{(pid=71939) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:357}} Nov 24 17:14:19.048956 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.notifications [None req-8a384a77-3e59-43c8-95c7-bfd0d45f048e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '730d55e789484157a87e479803953fa7'} {{(pid=71939) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:357}} Nov 24 17:14:19.057203 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.notifications [None req-8a384a77-3e59-43c8-95c7-bfd0d45f048e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '730d55e789484157a87e479803953fa7'} {{(pid=71939) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:357}} Nov 24 17:14:19.063593 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.notifications [None req-8a384a77-3e59-43c8-95c7-bfd0d45f048e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '730d55e789484157a87e479803953fa7'} {{(pid=71939) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:357}} Nov 24 17:14:19.069739 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: [pid: 71939|app: 0|req: 1503/2993] 10.222.0.53 () {58 vars in 1214 bytes} [Wed Nov 24 17:14:18 2021] DELETE /identity/v3/users/730d55e789484157a87e479803953fa7 => generated 0 bytes in 201 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 24 17:14:19.446547 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a7331f0-3b23-4cb9-9af6-cb1f2196f7d8 admin admin] Authenticating user token {{(pid=71938) process_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 24 17:14:19.448038 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.fernet_utils [None req-6a7331f0-3b23-4cb9-9af6-cb1f2196f7d8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=71938) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:289}} Nov 24 17:14:19.461109 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a7331f0-3b23-4cb9-9af6-cb1f2196f7d8 admin admin] Validating token access rules against request {{(pid=71938) validate_allowed_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 24 17:14:19.527251 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-576cfde5-5549-42c6-8eb9-813ffc6de5cf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f2ba2e8375b4e8c8792ee1e22b60427', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '00a5583c7b7443e98e7a1d31a0b638dc', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=71938) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 24 17:14:19.528152 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-576cfde5-5549-42c6-8eb9-813ffc6de5cf admin admin] REQUEST_METHOD: `DELETE` {{(pid=71938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 24 17:14:19.528480 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-576cfde5-5549-42c6-8eb9-813ffc6de5cf admin admin] SCRIPT_NAME: `/identity` {{(pid=71938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 24 17:14:19.528815 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-576cfde5-5549-42c6-8eb9-813ffc6de5cf admin admin] PATH_INFO: `/v3/projects/82ffce5600084193a2b6d7e6a340dc67` {{(pid=71938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 24 17:14:19.530076 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-576cfde5-5549-42c6-8eb9-813ffc6de5cf admin admin] RBAC: Authorizing `identity:delete_project(project_id=82ffce5600084193a2b6d7e6a340dc67)` {{(pid=71938) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:442}} Nov 24 17:14:19.570033 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-576cfde5-5549-42c6-8eb9-813ffc6de5cf admin admin] RBAC: Authorization granted {{(pid=71938) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 24 17:14:19.622902 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.notifications [None req-576cfde5-5549-42c6-8eb9-813ffc6de5cf admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '82ffce5600084193a2b6d7e6a340dc67', 'request_id': 'req-576cfde5-5549-42c6-8eb9-813ffc6de5cf'} {{(pid=71938) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:357}} Nov 24 17:14:19.634742 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.notifications [None req-576cfde5-5549-42c6-8eb9-813ffc6de5cf admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '82ffce5600084193a2b6d7e6a340dc67', 'request_id': 'req-576cfde5-5549-42c6-8eb9-813ffc6de5cf'} {{(pid=71938) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:357}} Nov 24 17:14:19.640031 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.notifications [None req-576cfde5-5549-42c6-8eb9-813ffc6de5cf admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '82ffce5600084193a2b6d7e6a340dc67', 'request_id': 'req-576cfde5-5549-42c6-8eb9-813ffc6de5cf'} {{(pid=71938) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:357}} Nov 24 17:14:19.651070 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.notifications [None req-576cfde5-5549-42c6-8eb9-813ffc6de5cf admin admin] The token cache is being invalidate because project 82ffce5600084193a2b6d7e6a340dc67 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=71938) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Nov 24 17:14:19.651397 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.notifications [None req-576cfde5-5549-42c6-8eb9-813ffc6de5cf admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=71938) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:357}} Nov 24 17:14:19.652066 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.notifications [None req-576cfde5-5549-42c6-8eb9-813ffc6de5cf admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=71938) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:357}} Nov 24 17:14:19.653605 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: [pid: 71938|app: 0|req: 1491/2994] 10.222.0.53 () {58 vars in 1223 bytes} [Wed Nov 24 17:14:19 2021] DELETE /identity/v3/projects/82ffce5600084193a2b6d7e6a340dc67 => generated 0 bytes in 208 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 24 17:14:19.660262 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a05d8d27-9ea8-4da4-85d2-840ba8d98b3b None None] REQUEST_METHOD: `POST` {{(pid=71939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 24 17:14:19.660639 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a05d8d27-9ea8-4da4-85d2-840ba8d98b3b None None] SCRIPT_NAME: `/identity` {{(pid=71939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 24 17:14:19.660981 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a05d8d27-9ea8-4da4-85d2-840ba8d98b3b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=71939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 24 17:14:19.685169 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.auth.core [None req-a05d8d27-9ea8-4da4-85d2-840ba8d98b3b None None] MFA Rules not processed for user `0f2ba2e8375b4e8c8792ee1e22b60427`. Rule list: `[]` (Enabled: `True`). {{(pid=71939) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:442}} Nov 24 17:14:19.686429 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.fernet_utils [None req-a05d8d27-9ea8-4da4-85d2-840ba8d98b3b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=71939) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:289}} Nov 24 17:14:19.755212 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: [pid: 71939|app: 0|req: 1504/2995] 10.222.0.53 () {58 vars in 948 bytes} [Wed Nov 24 17:14:19 2021] POST /identity/v3/auth/tokens => generated 3669 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 24 17:14:19.763792 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f2883e2-d1bc-489b-9671-29a641b89968 None None] REQUEST_METHOD: `POST` {{(pid=71938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 24 17:14:19.764171 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f2883e2-d1bc-489b-9671-29a641b89968 None None] SCRIPT_NAME: `/identity` {{(pid=71938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 24 17:14:19.764511 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f2883e2-d1bc-489b-9671-29a641b89968 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=71938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 24 17:14:19.788585 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.auth.core [None req-1f2883e2-d1bc-489b-9671-29a641b89968 None None] MFA Rules not processed for user `0f2ba2e8375b4e8c8792ee1e22b60427`. Rule list: `[]` (Enabled: `True`). {{(pid=71938) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:442}} Nov 24 17:14:19.789805 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.fernet_utils [None req-1f2883e2-d1bc-489b-9671-29a641b89968 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=71938) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:289}} Nov 24 17:14:19.798686 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: [pid: 71938|app: 0|req: 1492/2996] 10.222.0.53 () {58 vars in 948 bytes} [Wed Nov 24 17:14:19 2021] POST /identity/v3/auth/tokens => generated 3669 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 24 17:14:19.803347 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a05d8d27-9ea8-4da4-85d2-840ba8d98b3b None None] Authenticating user token {{(pid=71939) process_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 24 17:14:19.813482 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a05d8d27-9ea8-4da4-85d2-840ba8d98b3b None None] Validating token access rules against request {{(pid=71939) validate_allowed_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 24 17:14:19.822851 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a8f570b-3fdc-472f-9b57-f1a3a916ee5e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f2ba2e8375b4e8c8792ee1e22b60427', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '00a5583c7b7443e98e7a1d31a0b638dc', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=71939) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 24 17:14:19.824060 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a8f570b-3fdc-472f-9b57-f1a3a916ee5e admin admin] REQUEST_METHOD: `GET` {{(pid=71939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 24 17:14:19.824680 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a8f570b-3fdc-472f-9b57-f1a3a916ee5e admin admin] SCRIPT_NAME: `/identity` {{(pid=71939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 24 17:14:19.825038 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a8f570b-3fdc-472f-9b57-f1a3a916ee5e admin admin] PATH_INFO: `/v3/domains` {{(pid=71939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 24 17:14:19.825852 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a8f570b-3fdc-472f-9b57-f1a3a916ee5e admin admin] RBAC: Adding query filter params (name=Default) {{(pid=71939) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:161}} Nov 24 17:14:19.826227 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a8f570b-3fdc-472f-9b57-f1a3a916ee5e admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=71939) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:442}} Nov 24 17:14:19.865877 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a8f570b-3fdc-472f-9b57-f1a3a916ee5e admin admin] RBAC: Authorization granted {{(pid=71939) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 24 17:14:19.880074 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: [pid: 71939|app: 0|req: 1505/2997] 10.222.0.53 () {58 vars in 1143 bytes} [Wed Nov 24 17:14:19 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 77 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 24 17:14:19.884767 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f2883e2-d1bc-489b-9671-29a641b89968 None None] Authenticating user token {{(pid=71938) process_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 24 17:14:19.894921 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f2883e2-d1bc-489b-9671-29a641b89968 None None] Validating token access rules against request {{(pid=71938) validate_allowed_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 24 17:14:19.899593 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d50f24aa-275d-4727-a532-7ffe8f7d0faa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f2ba2e8375b4e8c8792ee1e22b60427', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '00a5583c7b7443e98e7a1d31a0b638dc', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=71938) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 24 17:14:19.900258 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d50f24aa-275d-4727-a532-7ffe8f7d0faa admin admin] REQUEST_METHOD: `POST` {{(pid=71938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 24 17:14:19.900597 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d50f24aa-275d-4727-a532-7ffe8f7d0faa admin admin] SCRIPT_NAME: `/identity` {{(pid=71938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 24 17:14:19.900928 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d50f24aa-275d-4727-a532-7ffe8f7d0faa admin admin] PATH_INFO: `/v3/projects` {{(pid=71938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 24 17:14:19.901656 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d50f24aa-275d-4727-a532-7ffe8f7d0faa admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=71938) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:442}} Nov 24 17:14:19.930877 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d50f24aa-275d-4727-a532-7ffe8f7d0faa admin admin] RBAC: Authorization granted {{(pid=71938) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 24 17:14:19.957203 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: [pid: 71938|app: 0|req: 1493/2998] 10.222.0.53 () {60 vars in 1143 bytes} [Wed Nov 24 17:14:19 2021] POST /identity/v3/projects => generated 383 bytes in 73 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 24 17:14:19.961675 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a8f570b-3fdc-472f-9b57-f1a3a916ee5e admin admin] Authenticating user token {{(pid=71939) process_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 24 17:14:19.972567 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a8f570b-3fdc-472f-9b57-f1a3a916ee5e admin admin] Validating token access rules against request {{(pid=71939) validate_allowed_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 24 17:14:20.039868 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98fabeb5-b3cd-4a04-b627-85d6096430a7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f2ba2e8375b4e8c8792ee1e22b60427', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '00a5583c7b7443e98e7a1d31a0b638dc', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=71939) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 24 17:14:20.040543 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98fabeb5-b3cd-4a04-b627-85d6096430a7 admin admin] REQUEST_METHOD: `POST` {{(pid=71939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 24 17:14:20.040883 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98fabeb5-b3cd-4a04-b627-85d6096430a7 admin admin] SCRIPT_NAME: `/identity` {{(pid=71939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 24 17:14:20.041215 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98fabeb5-b3cd-4a04-b627-85d6096430a7 admin admin] PATH_INFO: `/v3/users` {{(pid=71939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 24 17:14:20.041942 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98fabeb5-b3cd-4a04-b627-85d6096430a7 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=71939) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:442}} Nov 24 17:14:20.070447 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98fabeb5-b3cd-4a04-b627-85d6096430a7 admin admin] RBAC: Authorization granted {{(pid=71939) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 24 17:14:20.089115 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: [pid: 71939|app: 0|req: 1506/2999] 10.222.0.53 () {60 vars in 1134 bytes} [Wed Nov 24 17:14:19 2021] POST /identity/v3/users => generated 292 bytes in 128 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 24 17:14:20.094270 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d50f24aa-275d-4727-a532-7ffe8f7d0faa admin admin] Authenticating user token {{(pid=71938) process_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 24 17:14:20.104600 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d50f24aa-275d-4727-a532-7ffe8f7d0faa admin admin] Validating token access rules against request {{(pid=71938) validate_allowed_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 24 17:14:20.109442 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25d11df3-0d89-4710-abc8-08006bb1c9ff admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f2ba2e8375b4e8c8792ee1e22b60427', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '00a5583c7b7443e98e7a1d31a0b638dc', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=71938) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 24 17:14:20.110161 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25d11df3-0d89-4710-abc8-08006bb1c9ff admin admin] REQUEST_METHOD: `GET` {{(pid=71938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 24 17:14:20.110503 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25d11df3-0d89-4710-abc8-08006bb1c9ff admin admin] SCRIPT_NAME: `/identity` {{(pid=71938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 24 17:14:20.110833 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25d11df3-0d89-4710-abc8-08006bb1c9ff admin admin] PATH_INFO: `/v3/roles` {{(pid=71938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 24 17:14:20.111613 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25d11df3-0d89-4710-abc8-08006bb1c9ff admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=71938) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:442}} Nov 24 17:14:20.139374 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25d11df3-0d89-4710-abc8-08006bb1c9ff admin admin] RBAC: Authorization granted {{(pid=71938) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 24 17:14:20.150627 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: [pid: 71938|app: 0|req: 1494/3000] 10.222.0.53 () {58 vars in 1112 bytes} [Wed Nov 24 17:14:20 2021] GET /identity/v3/roles => generated 1420 bytes in 57 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 24 17:14:20.155237 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98fabeb5-b3cd-4a04-b627-85d6096430a7 admin admin] Authenticating user token {{(pid=71939) process_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 24 17:14:20.165662 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98fabeb5-b3cd-4a04-b627-85d6096430a7 admin admin] Validating token access rules against request {{(pid=71939) validate_allowed_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 24 17:14:20.170346 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aae06700-0e0f-4a58-9418-791a381bd257 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f2ba2e8375b4e8c8792ee1e22b60427', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '00a5583c7b7443e98e7a1d31a0b638dc', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=71939) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 24 17:14:20.171271 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aae06700-0e0f-4a58-9418-791a381bd257 admin admin] REQUEST_METHOD: `PUT` {{(pid=71939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 24 17:14:20.171608 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aae06700-0e0f-4a58-9418-791a381bd257 admin admin] SCRIPT_NAME: `/identity` {{(pid=71939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 24 17:14:20.171940 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aae06700-0e0f-4a58-9418-791a381bd257 admin admin] PATH_INFO: `/v3/projects/4843f96b95b94b8a944ca1e51e212ec3/users/c98f8791c2304f0ea51c8f051a1b779f/roles/912ab5f10fa5477da74acf239f07604e` {{(pid=71939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 24 17:14:20.196618 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aae06700-0e0f-4a58-9418-791a381bd257 admin admin] RBAC: Authorizing `identity:create_grant(project_id=4843f96b95b94b8a944ca1e51e212ec3, user_id=c98f8791c2304f0ea51c8f051a1b779f, role_id=912ab5f10fa5477da74acf239f07604e)` {{(pid=71939) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:442}} Nov 24 17:14:20.228694 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aae06700-0e0f-4a58-9418-791a381bd257 admin admin] RBAC: Authorization granted {{(pid=71939) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 24 17:14:20.240956 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: [pid: 71939|app: 0|req: 1507/3001] 10.222.0.53 () {60 vars in 1473 bytes} [Wed Nov 24 17:14:20 2021] PUT /identity/v3/projects/4843f96b95b94b8a944ca1e51e212ec3/users/c98f8791c2304f0ea51c8f051a1b779f/roles/912ab5f10fa5477da74acf239f07604e => generated 0 bytes in 87 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 24 17:14:20.253410 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d72d6790-d8ff-439e-91aa-30085e294093 None None] REQUEST_METHOD: `POST` {{(pid=71938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 24 17:14:20.253872 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d72d6790-d8ff-439e-91aa-30085e294093 None None] SCRIPT_NAME: `/identity` {{(pid=71938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 24 17:14:20.254272 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d72d6790-d8ff-439e-91aa-30085e294093 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=71938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 24 17:14:20.292321 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.auth.core [None req-d72d6790-d8ff-439e-91aa-30085e294093 None None] MFA Rules not processed for user `c98f8791c2304f0ea51c8f051a1b779f`. Rule list: `[]` (Enabled: `True`). {{(pid=71938) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:442}} Nov 24 17:14:20.293548 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.fernet_utils [None req-d72d6790-d8ff-439e-91aa-30085e294093 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=71938) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:289}} Nov 24 17:14:20.370664 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: [pid: 71938|app: 0|req: 1495/3002] 10.222.0.53 () {58 vars in 948 bytes} [Wed Nov 24 17:14:20 2021] POST /identity/v3/auth/tokens => generated 3690 bytes in 118 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 24 17:14:20.381872 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aae06700-0e0f-4a58-9418-791a381bd257 admin admin] Authenticating user token {{(pid=71939) process_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 24 17:14:20.383646 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.fernet_utils [None req-aae06700-0e0f-4a58-9418-791a381bd257 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=71939) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:289}} Nov 24 17:14:20.451141 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aae06700-0e0f-4a58-9418-791a381bd257 admin admin] Validating token access rules against request {{(pid=71939) validate_allowed_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 24 17:14:20.455320 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78ae005c-85ce-43e3-bddf-2d4164575c8c service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a12374a3093a401a97c343ff0854184d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3b3940d4ae1c4177ae29c02377bb4b0b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=71939) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 24 17:14:20.456011 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78ae005c-85ce-43e3-bddf-2d4164575c8c service cinder] REQUEST_METHOD: `GET` {{(pid=71939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 24 17:14:20.456350 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78ae005c-85ce-43e3-bddf-2d4164575c8c service cinder] SCRIPT_NAME: `/identity` {{(pid=71939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 24 17:14:20.456721 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78ae005c-85ce-43e3-bddf-2d4164575c8c service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=71939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 24 17:14:20.465484 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78ae005c-85ce-43e3-bddf-2d4164575c8c service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=71939) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:442}} Nov 24 17:14:20.493078 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78ae005c-85ce-43e3-bddf-2d4164575c8c service cinder] RBAC: Authorization granted {{(pid=71939) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 24 17:14:20.502577 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: [pid: 71939|app: 0|req: 1508/3003] 10.222.0.53 () {60 vars in 1356 bytes} [Wed Nov 24 17:14:20 2021] GET /identity/v3/auth/tokens => generated 3690 bytes in 121 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 24 17:14:20.524724 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d72d6790-d8ff-439e-91aa-30085e294093 None None] Authenticating user token {{(pid=71938) process_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 24 17:14:20.597832 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d72d6790-d8ff-439e-91aa-30085e294093 None None] Validating token access rules against request {{(pid=71938) validate_allowed_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 24 17:14:20.602646 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-477b3ed9-e614-4b52-a2b4-1575907caa58 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f2ba2e8375b4e8c8792ee1e22b60427', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '00a5583c7b7443e98e7a1d31a0b638dc', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=71938) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 24 17:14:20.603554 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-477b3ed9-e614-4b52-a2b4-1575907caa58 admin admin] REQUEST_METHOD: `DELETE` {{(pid=71938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 24 17:14:20.603897 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-477b3ed9-e614-4b52-a2b4-1575907caa58 admin admin] SCRIPT_NAME: `/identity` {{(pid=71938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 24 17:14:20.604233 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-477b3ed9-e614-4b52-a2b4-1575907caa58 admin admin] PATH_INFO: `/v3/users/c98f8791c2304f0ea51c8f051a1b779f` {{(pid=71938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 24 17:14:20.605459 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-477b3ed9-e614-4b52-a2b4-1575907caa58 admin admin] RBAC: Authorizing `identity:delete_user(user_id=c98f8791c2304f0ea51c8f051a1b779f)` {{(pid=71938) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:442}} Nov 24 17:14:20.634587 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-477b3ed9-e614-4b52-a2b4-1575907caa58 admin admin] RBAC: Authorization granted {{(pid=71938) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 24 17:14:20.682107 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.notifications [None req-477b3ed9-e614-4b52-a2b4-1575907caa58 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c98f8791c2304f0ea51c8f051a1b779f'} {{(pid=71938) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:357}} Nov 24 17:14:20.694860 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.notifications [None req-477b3ed9-e614-4b52-a2b4-1575907caa58 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c98f8791c2304f0ea51c8f051a1b779f'} {{(pid=71938) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:357}} Nov 24 17:14:20.695565 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.notifications [None req-477b3ed9-e614-4b52-a2b4-1575907caa58 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c98f8791c2304f0ea51c8f051a1b779f'} {{(pid=71938) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:357}} Nov 24 17:14:20.704341 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.notifications [None req-477b3ed9-e614-4b52-a2b4-1575907caa58 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c98f8791c2304f0ea51c8f051a1b779f'} {{(pid=71938) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:357}} Nov 24 17:14:20.709897 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.notifications [None req-477b3ed9-e614-4b52-a2b4-1575907caa58 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c98f8791c2304f0ea51c8f051a1b779f'} {{(pid=71938) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:357}} Nov 24 17:14:20.716165 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: [pid: 71938|app: 0|req: 1496/3004] 10.222.0.53 () {58 vars in 1214 bytes} [Wed Nov 24 17:14:20 2021] DELETE /identity/v3/users/c98f8791c2304f0ea51c8f051a1b779f => generated 0 bytes in 192 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 24 17:14:20.720982 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f25c1a1-869e-4a17-836f-82ce9d85b8ff None None] REQUEST_METHOD: `POST` {{(pid=71939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 24 17:14:20.721332 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f25c1a1-869e-4a17-836f-82ce9d85b8ff None None] SCRIPT_NAME: `/identity` {{(pid=71939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 24 17:14:20.721674 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f25c1a1-869e-4a17-836f-82ce9d85b8ff None None] PATH_INFO: `/v3/auth/tokens` {{(pid=71939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 24 17:14:20.745110 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.auth.core [None req-8f25c1a1-869e-4a17-836f-82ce9d85b8ff None None] MFA Rules not processed for user `0f2ba2e8375b4e8c8792ee1e22b60427`. Rule list: `[]` (Enabled: `True`). {{(pid=71939) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:442}} Nov 24 17:14:20.746368 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.fernet_utils [None req-8f25c1a1-869e-4a17-836f-82ce9d85b8ff None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=71939) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:289}} Nov 24 17:14:20.815848 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: [pid: 71939|app: 0|req: 1509/3005] 10.222.0.53 () {58 vars in 948 bytes} [Wed Nov 24 17:14:20 2021] POST /identity/v3/auth/tokens => generated 3669 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 24 17:14:20.826840 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-477b3ed9-e614-4b52-a2b4-1575907caa58 admin admin] Authenticating user token {{(pid=71938) process_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 24 17:14:20.828928 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.fernet_utils [None req-477b3ed9-e614-4b52-a2b4-1575907caa58 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=71938) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:289}} Nov 24 17:14:20.896171 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-477b3ed9-e614-4b52-a2b4-1575907caa58 admin admin] Validating token access rules against request {{(pid=71938) validate_allowed_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 24 17:14:20.899806 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b134973a-7744-4b3a-9630-60c70a1e0ec5 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c90f21b9cdcb413282461fa83cb6b7a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3b3940d4ae1c4177ae29c02377bb4b0b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=71938) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 24 17:14:20.900461 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b134973a-7744-4b3a-9630-60c70a1e0ec5 service neutron] REQUEST_METHOD: `GET` {{(pid=71938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 24 17:14:20.900796 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b134973a-7744-4b3a-9630-60c70a1e0ec5 service neutron] SCRIPT_NAME: `/identity` {{(pid=71938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 24 17:14:20.901124 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b134973a-7744-4b3a-9630-60c70a1e0ec5 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=71938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 24 17:14:20.910536 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b134973a-7744-4b3a-9630-60c70a1e0ec5 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=71938) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:442}} Nov 24 17:14:20.939028 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b134973a-7744-4b3a-9630-60c70a1e0ec5 service neutron] RBAC: Authorization granted {{(pid=71938) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 24 17:14:20.948468 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: [pid: 71938|app: 0|req: 1497/3006] 10.222.0.53 () {60 vars in 1356 bytes} [Wed Nov 24 17:14:20 2021] GET /identity/v3/auth/tokens => generated 3669 bytes in 122 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 24 17:14:21.323805 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f25c1a1-869e-4a17-836f-82ce9d85b8ff None None] Authenticating user token {{(pid=71939) process_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 24 17:14:21.325290 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.fernet_utils [None req-8f25c1a1-869e-4a17-836f-82ce9d85b8ff None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=71939) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:289}} Nov 24 17:14:21.337987 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f25c1a1-869e-4a17-836f-82ce9d85b8ff None None] Validating token access rules against request {{(pid=71939) validate_allowed_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 24 17:14:21.343478 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c00342bc-ccee-4adb-9d76-af08409d178b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f2ba2e8375b4e8c8792ee1e22b60427', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '00a5583c7b7443e98e7a1d31a0b638dc', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=71939) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 24 17:14:21.344358 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c00342bc-ccee-4adb-9d76-af08409d178b admin admin] REQUEST_METHOD: `DELETE` {{(pid=71939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 24 17:14:21.344693 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c00342bc-ccee-4adb-9d76-af08409d178b admin admin] SCRIPT_NAME: `/identity` {{(pid=71939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 24 17:14:21.345019 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c00342bc-ccee-4adb-9d76-af08409d178b admin admin] PATH_INFO: `/v3/projects/4843f96b95b94b8a944ca1e51e212ec3` {{(pid=71939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 24 17:14:21.346299 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c00342bc-ccee-4adb-9d76-af08409d178b admin admin] RBAC: Authorizing `identity:delete_project(project_id=4843f96b95b94b8a944ca1e51e212ec3)` {{(pid=71939) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:442}} Nov 24 17:14:21.375240 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c00342bc-ccee-4adb-9d76-af08409d178b admin admin] RBAC: Authorization granted {{(pid=71939) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 24 17:14:21.425534 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.notifications [None req-c00342bc-ccee-4adb-9d76-af08409d178b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '4843f96b95b94b8a944ca1e51e212ec3', 'request_id': 'req-c00342bc-ccee-4adb-9d76-af08409d178b'} {{(pid=71939) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:357}} Nov 24 17:14:21.437117 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.notifications [None req-c00342bc-ccee-4adb-9d76-af08409d178b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '4843f96b95b94b8a944ca1e51e212ec3', 'request_id': 'req-c00342bc-ccee-4adb-9d76-af08409d178b'} {{(pid=71939) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:357}} Nov 24 17:14:21.442854 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.notifications [None req-c00342bc-ccee-4adb-9d76-af08409d178b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '4843f96b95b94b8a944ca1e51e212ec3', 'request_id': 'req-c00342bc-ccee-4adb-9d76-af08409d178b'} {{(pid=71939) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:357}} Nov 24 17:14:21.452949 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.notifications [None req-c00342bc-ccee-4adb-9d76-af08409d178b admin admin] The token cache is being invalidate because project 4843f96b95b94b8a944ca1e51e212ec3 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=71939) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Nov 24 17:14:21.453446 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.notifications [None req-c00342bc-ccee-4adb-9d76-af08409d178b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=71939) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:357}} Nov 24 17:14:21.453913 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.notifications [None req-c00342bc-ccee-4adb-9d76-af08409d178b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=71939) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:357}} Nov 24 17:14:21.455450 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: [pid: 71939|app: 0|req: 1510/3007] 10.222.0.53 () {58 vars in 1223 bytes} [Wed Nov 24 17:14:21 2021] DELETE /identity/v3/projects/4843f96b95b94b8a944ca1e51e212ec3 => generated 0 bytes in 132 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 24 17:14:21.461463 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94d97c20-c665-45be-8bb5-6ccf78a72923 None None] REQUEST_METHOD: `POST` {{(pid=71938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 24 17:14:21.461809 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94d97c20-c665-45be-8bb5-6ccf78a72923 None None] SCRIPT_NAME: `/identity` {{(pid=71938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 24 17:14:21.462172 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94d97c20-c665-45be-8bb5-6ccf78a72923 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=71938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 24 17:14:21.488276 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.auth.core [None req-94d97c20-c665-45be-8bb5-6ccf78a72923 None None] MFA Rules not processed for user `0f2ba2e8375b4e8c8792ee1e22b60427`. Rule list: `[]` (Enabled: `True`). {{(pid=71938) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:442}} Nov 24 17:14:21.489413 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.fernet_utils [None req-94d97c20-c665-45be-8bb5-6ccf78a72923 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=71938) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:289}} Nov 24 17:14:21.556970 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: [pid: 71938|app: 0|req: 1498/3008] 10.222.0.53 () {58 vars in 948 bytes} [Wed Nov 24 17:14:21 2021] POST /identity/v3/auth/tokens => generated 3669 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 24 17:14:21.566378 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2f22d2c-40d9-452c-a307-bc713d3e44c9 None None] REQUEST_METHOD: `POST` {{(pid=71939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 24 17:14:21.566727 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2f22d2c-40d9-452c-a307-bc713d3e44c9 None None] SCRIPT_NAME: `/identity` {{(pid=71939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 24 17:14:21.567061 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2f22d2c-40d9-452c-a307-bc713d3e44c9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=71939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 24 17:14:21.599852 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.auth.core [None req-e2f22d2c-40d9-452c-a307-bc713d3e44c9 None None] MFA Rules not processed for user `0f2ba2e8375b4e8c8792ee1e22b60427`. Rule list: `[]` (Enabled: `True`). {{(pid=71939) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:442}} Nov 24 17:14:21.601717 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.fernet_utils [None req-e2f22d2c-40d9-452c-a307-bc713d3e44c9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=71939) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:289}} Nov 24 17:14:21.611510 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: [pid: 71939|app: 0|req: 1511/3009] 10.222.0.53 () {58 vars in 948 bytes} [Wed Nov 24 17:14:21 2021] POST /identity/v3/auth/tokens => generated 3669 bytes in 46 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 24 17:14:21.616101 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94d97c20-c665-45be-8bb5-6ccf78a72923 None None] Authenticating user token {{(pid=71938) process_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 24 17:14:21.626008 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94d97c20-c665-45be-8bb5-6ccf78a72923 None None] Validating token access rules against request {{(pid=71938) validate_allowed_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 24 17:14:21.630579 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f813ddf3-72af-43b0-8e60-5ae42d744eb6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f2ba2e8375b4e8c8792ee1e22b60427', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '00a5583c7b7443e98e7a1d31a0b638dc', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=71938) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 24 17:14:21.631240 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f813ddf3-72af-43b0-8e60-5ae42d744eb6 admin admin] REQUEST_METHOD: `GET` {{(pid=71938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 24 17:14:21.631577 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f813ddf3-72af-43b0-8e60-5ae42d744eb6 admin admin] SCRIPT_NAME: `/identity` {{(pid=71938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 24 17:14:21.631908 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f813ddf3-72af-43b0-8e60-5ae42d744eb6 admin admin] PATH_INFO: `/v3/domains` {{(pid=71938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 24 17:14:21.632682 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f813ddf3-72af-43b0-8e60-5ae42d744eb6 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=71938) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:161}} Nov 24 17:14:21.633029 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f813ddf3-72af-43b0-8e60-5ae42d744eb6 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=71938) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:442}} Nov 24 17:14:21.661377 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f813ddf3-72af-43b0-8e60-5ae42d744eb6 admin admin] RBAC: Authorization granted {{(pid=71938) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 24 17:14:21.675561 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: [pid: 71938|app: 0|req: 1499/3010] 10.222.0.53 () {58 vars in 1143 bytes} [Wed Nov 24 17:14:21 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 60 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 24 17:14:21.680071 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2f22d2c-40d9-452c-a307-bc713d3e44c9 None None] Authenticating user token {{(pid=71939) process_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 24 17:14:21.689498 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2f22d2c-40d9-452c-a307-bc713d3e44c9 None None] Validating token access rules against request {{(pid=71939) validate_allowed_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 24 17:14:21.694156 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1711657-bb64-4065-b58b-9e71304f00d9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f2ba2e8375b4e8c8792ee1e22b60427', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '00a5583c7b7443e98e7a1d31a0b638dc', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=71939) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 24 17:14:21.694815 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1711657-bb64-4065-b58b-9e71304f00d9 admin admin] REQUEST_METHOD: `POST` {{(pid=71939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 24 17:14:21.695158 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1711657-bb64-4065-b58b-9e71304f00d9 admin admin] SCRIPT_NAME: `/identity` {{(pid=71939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 24 17:14:21.695490 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1711657-bb64-4065-b58b-9e71304f00d9 admin admin] PATH_INFO: `/v3/projects` {{(pid=71939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 24 17:14:21.696225 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1711657-bb64-4065-b58b-9e71304f00d9 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=71939) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:442}} Nov 24 17:14:21.725278 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1711657-bb64-4065-b58b-9e71304f00d9 admin admin] RBAC: Authorization granted {{(pid=71939) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 24 17:14:21.752053 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: [pid: 71939|app: 0|req: 1512/3011] 10.222.0.53 () {60 vars in 1143 bytes} [Wed Nov 24 17:14:21 2021] POST /identity/v3/projects => generated 385 bytes in 72 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 24 17:14:21.756628 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f813ddf3-72af-43b0-8e60-5ae42d744eb6 admin admin] Authenticating user token {{(pid=71938) process_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 24 17:14:21.767203 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f813ddf3-72af-43b0-8e60-5ae42d744eb6 admin admin] Validating token access rules against request {{(pid=71938) validate_allowed_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 24 17:14:21.832797 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7907a00a-ca4c-47c8-a4be-ff64fd88bf31 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f2ba2e8375b4e8c8792ee1e22b60427', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '00a5583c7b7443e98e7a1d31a0b638dc', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=71938) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 24 17:14:21.833487 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7907a00a-ca4c-47c8-a4be-ff64fd88bf31 admin admin] REQUEST_METHOD: `POST` {{(pid=71938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 24 17:14:21.833830 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7907a00a-ca4c-47c8-a4be-ff64fd88bf31 admin admin] SCRIPT_NAME: `/identity` {{(pid=71938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 24 17:14:21.834194 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7907a00a-ca4c-47c8-a4be-ff64fd88bf31 admin admin] PATH_INFO: `/v3/users` {{(pid=71938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 24 17:14:21.834932 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7907a00a-ca4c-47c8-a4be-ff64fd88bf31 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=71938) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:442}} Nov 24 17:14:21.868697 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7907a00a-ca4c-47c8-a4be-ff64fd88bf31 admin admin] RBAC: Authorization granted {{(pid=71938) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 24 17:14:21.887727 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: [pid: 71938|app: 0|req: 1500/3012] 10.222.0.53 () {60 vars in 1134 bytes} [Wed Nov 24 17:14:21 2021] POST /identity/v3/users => generated 293 bytes in 132 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 24 17:14:21.892646 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1711657-bb64-4065-b58b-9e71304f00d9 admin admin] Authenticating user token {{(pid=71939) process_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 24 17:14:21.903464 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1711657-bb64-4065-b58b-9e71304f00d9 admin admin] Validating token access rules against request {{(pid=71939) validate_allowed_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 24 17:14:21.908596 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50780c9a-194b-4031-8f51-5e88a9b4ec39 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f2ba2e8375b4e8c8792ee1e22b60427', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '00a5583c7b7443e98e7a1d31a0b638dc', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=71939) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 24 17:14:21.909395 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50780c9a-194b-4031-8f51-5e88a9b4ec39 admin admin] REQUEST_METHOD: `GET` {{(pid=71939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 24 17:14:21.909741 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50780c9a-194b-4031-8f51-5e88a9b4ec39 admin admin] SCRIPT_NAME: `/identity` {{(pid=71939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 24 17:14:21.910123 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50780c9a-194b-4031-8f51-5e88a9b4ec39 admin admin] PATH_INFO: `/v3/roles` {{(pid=71939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 24 17:14:21.910922 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50780c9a-194b-4031-8f51-5e88a9b4ec39 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=71939) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:442}} Nov 24 17:14:21.939487 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50780c9a-194b-4031-8f51-5e88a9b4ec39 admin admin] RBAC: Authorization granted {{(pid=71939) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 24 17:14:21.950633 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: [pid: 71939|app: 0|req: 1513/3013] 10.222.0.53 () {58 vars in 1112 bytes} [Wed Nov 24 17:14:21 2021] GET /identity/v3/roles => generated 1420 bytes in 59 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 24 17:14:21.955594 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7907a00a-ca4c-47c8-a4be-ff64fd88bf31 admin admin] Authenticating user token {{(pid=71938) process_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 24 17:14:21.965623 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7907a00a-ca4c-47c8-a4be-ff64fd88bf31 admin admin] Validating token access rules against request {{(pid=71938) validate_allowed_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 24 17:14:21.970884 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c77bae80-f162-4a6d-afcb-86ec85f87843 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f2ba2e8375b4e8c8792ee1e22b60427', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '00a5583c7b7443e98e7a1d31a0b638dc', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=71938) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 24 17:14:21.971791 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c77bae80-f162-4a6d-afcb-86ec85f87843 admin admin] REQUEST_METHOD: `PUT` {{(pid=71938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 24 17:14:21.972128 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c77bae80-f162-4a6d-afcb-86ec85f87843 admin admin] SCRIPT_NAME: `/identity` {{(pid=71938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 24 17:14:21.972458 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c77bae80-f162-4a6d-afcb-86ec85f87843 admin admin] PATH_INFO: `/v3/projects/6414277403164dcaba6ad4f88baa1d23/users/1eb602caae8f46fbb03a5fc346a7b9d3/roles/912ab5f10fa5477da74acf239f07604e` {{(pid=71938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 24 17:14:21.993325 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c77bae80-f162-4a6d-afcb-86ec85f87843 admin admin] RBAC: Authorizing `identity:create_grant(project_id=6414277403164dcaba6ad4f88baa1d23, user_id=1eb602caae8f46fbb03a5fc346a7b9d3, role_id=912ab5f10fa5477da74acf239f07604e)` {{(pid=71938) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:442}} Nov 24 17:14:22.023183 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c77bae80-f162-4a6d-afcb-86ec85f87843 admin admin] RBAC: Authorization granted {{(pid=71938) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 24 17:14:22.035325 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: [pid: 71938|app: 0|req: 1501/3014] 10.222.0.53 () {60 vars in 1473 bytes} [Wed Nov 24 17:14:21 2021] PUT /identity/v3/projects/6414277403164dcaba6ad4f88baa1d23/users/1eb602caae8f46fbb03a5fc346a7b9d3/roles/912ab5f10fa5477da74acf239f07604e => generated 0 bytes in 80 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 24 17:14:22.045997 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4801136c-bdde-4699-b49f-cdfd4c261a04 None None] REQUEST_METHOD: `POST` {{(pid=71939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 24 17:14:22.046378 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4801136c-bdde-4699-b49f-cdfd4c261a04 None None] SCRIPT_NAME: `/identity` {{(pid=71939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 24 17:14:22.046713 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4801136c-bdde-4699-b49f-cdfd4c261a04 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=71939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 24 17:14:22.086747 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.auth.core [None req-4801136c-bdde-4699-b49f-cdfd4c261a04 None None] MFA Rules not processed for user `1eb602caae8f46fbb03a5fc346a7b9d3`. Rule list: `[]` (Enabled: `True`). {{(pid=71939) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:442}} Nov 24 17:14:22.087991 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.fernet_utils [None req-4801136c-bdde-4699-b49f-cdfd4c261a04 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=71939) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:289}} Nov 24 17:14:22.163155 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: [pid: 71939|app: 0|req: 1514/3015] 10.222.0.53 () {58 vars in 948 bytes} [Wed Nov 24 17:14:22 2021] POST /identity/v3/auth/tokens => generated 3692 bytes in 118 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 24 17:14:22.168230 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c77bae80-f162-4a6d-afcb-86ec85f87843 admin admin] Authenticating user token {{(pid=71938) process_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 24 17:14:22.241269 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c77bae80-f162-4a6d-afcb-86ec85f87843 admin admin] Validating token access rules against request {{(pid=71938) validate_allowed_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 24 17:14:22.245915 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69ed6f1e-dbb6-4eee-a5d5-8cd78abfe698 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f2ba2e8375b4e8c8792ee1e22b60427', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '00a5583c7b7443e98e7a1d31a0b638dc', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=71938) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 24 17:14:22.246617 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69ed6f1e-dbb6-4eee-a5d5-8cd78abfe698 admin admin] REQUEST_METHOD: `POST` {{(pid=71938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 24 17:14:22.246955 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69ed6f1e-dbb6-4eee-a5d5-8cd78abfe698 admin admin] SCRIPT_NAME: `/identity` {{(pid=71938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 24 17:14:22.247286 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69ed6f1e-dbb6-4eee-a5d5-8cd78abfe698 admin admin] PATH_INFO: `/v3/projects` {{(pid=71938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 24 17:14:22.248022 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69ed6f1e-dbb6-4eee-a5d5-8cd78abfe698 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=71938) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:442}} Nov 24 17:14:22.276954 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69ed6f1e-dbb6-4eee-a5d5-8cd78abfe698 admin admin] RBAC: Authorization granted {{(pid=71938) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 24 17:14:22.303188 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: [pid: 71938|app: 0|req: 1502/3016] 10.222.0.53 () {60 vars in 1143 bytes} [Wed Nov 24 17:14:22 2021] POST /identity/v3/projects => generated 385 bytes in 136 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 24 17:14:22.307666 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4801136c-bdde-4699-b49f-cdfd4c261a04 None None] Authenticating user token {{(pid=71939) process_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 24 17:14:22.318656 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4801136c-bdde-4699-b49f-cdfd4c261a04 None None] Validating token access rules against request {{(pid=71939) validate_allowed_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 24 17:14:22.384467 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6991e8b-c189-4d1f-a2b9-14b45cb9737b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f2ba2e8375b4e8c8792ee1e22b60427', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '00a5583c7b7443e98e7a1d31a0b638dc', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=71939) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 24 17:14:22.385151 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6991e8b-c189-4d1f-a2b9-14b45cb9737b admin admin] REQUEST_METHOD: `POST` {{(pid=71939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 24 17:14:22.385492 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6991e8b-c189-4d1f-a2b9-14b45cb9737b admin admin] SCRIPT_NAME: `/identity` {{(pid=71939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 24 17:14:22.385828 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6991e8b-c189-4d1f-a2b9-14b45cb9737b admin admin] PATH_INFO: `/v3/users` {{(pid=71939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 24 17:14:22.386607 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6991e8b-c189-4d1f-a2b9-14b45cb9737b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=71939) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:442}} Nov 24 17:14:22.415400 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6991e8b-c189-4d1f-a2b9-14b45cb9737b admin admin] RBAC: Authorization granted {{(pid=71939) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 24 17:14:22.434915 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: [pid: 71939|app: 0|req: 1515/3017] 10.222.0.53 () {60 vars in 1134 bytes} [Wed Nov 24 17:14:22 2021] POST /identity/v3/users => generated 293 bytes in 128 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 24 17:14:22.439258 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69ed6f1e-dbb6-4eee-a5d5-8cd78abfe698 admin admin] Authenticating user token {{(pid=71938) process_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 24 17:14:22.449692 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69ed6f1e-dbb6-4eee-a5d5-8cd78abfe698 admin admin] Validating token access rules against request {{(pid=71938) validate_allowed_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 24 17:14:22.454323 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cff6eb4-f0d3-4e06-9c8c-c24aeda112ff admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f2ba2e8375b4e8c8792ee1e22b60427', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '00a5583c7b7443e98e7a1d31a0b638dc', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=71938) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 24 17:14:22.455002 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cff6eb4-f0d3-4e06-9c8c-c24aeda112ff admin admin] REQUEST_METHOD: `GET` {{(pid=71938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 24 17:14:22.455344 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cff6eb4-f0d3-4e06-9c8c-c24aeda112ff admin admin] SCRIPT_NAME: `/identity` {{(pid=71938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 24 17:14:22.455678 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cff6eb4-f0d3-4e06-9c8c-c24aeda112ff admin admin] PATH_INFO: `/v3/roles` {{(pid=71938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 24 17:14:22.456530 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cff6eb4-f0d3-4e06-9c8c-c24aeda112ff admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=71938) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:442}} Nov 24 17:14:22.485644 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cff6eb4-f0d3-4e06-9c8c-c24aeda112ff admin admin] RBAC: Authorization granted {{(pid=71938) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 24 17:14:22.497384 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: [pid: 71938|app: 0|req: 1503/3018] 10.222.0.53 () {58 vars in 1112 bytes} [Wed Nov 24 17:14:22 2021] GET /identity/v3/roles => generated 1420 bytes in 59 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 24 17:14:22.501779 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6991e8b-c189-4d1f-a2b9-14b45cb9737b admin admin] Authenticating user token {{(pid=71939) process_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 24 17:14:22.511998 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6991e8b-c189-4d1f-a2b9-14b45cb9737b admin admin] Validating token access rules against request {{(pid=71939) validate_allowed_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 24 17:14:22.517118 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-019f7edd-3eb9-41d1-9db8-6f5507402506 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f2ba2e8375b4e8c8792ee1e22b60427', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '00a5583c7b7443e98e7a1d31a0b638dc', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=71939) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 24 17:14:22.518017 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-019f7edd-3eb9-41d1-9db8-6f5507402506 admin admin] REQUEST_METHOD: `PUT` {{(pid=71939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 24 17:14:22.518418 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-019f7edd-3eb9-41d1-9db8-6f5507402506 admin admin] SCRIPT_NAME: `/identity` {{(pid=71939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 24 17:14:22.518757 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-019f7edd-3eb9-41d1-9db8-6f5507402506 admin admin] PATH_INFO: `/v3/projects/046e2c084a584976934a40a06fd1614d/users/fe72f3d015b545d89ad307dcfc3693a4/roles/912ab5f10fa5477da74acf239f07604e` {{(pid=71939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 24 17:14:22.539998 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-019f7edd-3eb9-41d1-9db8-6f5507402506 admin admin] RBAC: Authorizing `identity:create_grant(project_id=046e2c084a584976934a40a06fd1614d, user_id=fe72f3d015b545d89ad307dcfc3693a4, role_id=912ab5f10fa5477da74acf239f07604e)` {{(pid=71939) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:442}} Nov 24 17:14:22.569322 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-019f7edd-3eb9-41d1-9db8-6f5507402506 admin admin] RBAC: Authorization granted {{(pid=71939) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 24 17:14:22.582001 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: [pid: 71939|app: 0|req: 1516/3019] 10.222.0.53 () {60 vars in 1473 bytes} [Wed Nov 24 17:14:22 2021] PUT /identity/v3/projects/046e2c084a584976934a40a06fd1614d/users/fe72f3d015b545d89ad307dcfc3693a4/roles/912ab5f10fa5477da74acf239f07604e => generated 0 bytes in 81 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 24 17:14:22.594547 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-553d07a7-1ca2-454e-9ae0-5fd27d269956 None None] REQUEST_METHOD: `POST` {{(pid=71938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 24 17:14:22.594899 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-553d07a7-1ca2-454e-9ae0-5fd27d269956 None None] SCRIPT_NAME: `/identity` {{(pid=71938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 24 17:14:22.595235 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-553d07a7-1ca2-454e-9ae0-5fd27d269956 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=71938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 24 17:14:22.632350 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.auth.core [None req-553d07a7-1ca2-454e-9ae0-5fd27d269956 None None] MFA Rules not processed for user `fe72f3d015b545d89ad307dcfc3693a4`. Rule list: `[]` (Enabled: `True`). {{(pid=71938) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:442}} Nov 24 17:14:22.633592 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.fernet_utils [None req-553d07a7-1ca2-454e-9ae0-5fd27d269956 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=71938) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:289}} Nov 24 17:14:22.787720 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: [pid: 71938|app: 0|req: 1504/3020] 10.222.0.53 () {58 vars in 948 bytes} [Wed Nov 24 17:14:22 2021] POST /identity/v3/auth/tokens => generated 3692 bytes in 195 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 24 17:14:22.792469 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-019f7edd-3eb9-41d1-9db8-6f5507402506 admin admin] Authenticating user token {{(pid=71939) process_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 24 17:14:22.864257 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-019f7edd-3eb9-41d1-9db8-6f5507402506 admin admin] Validating token access rules against request {{(pid=71939) validate_allowed_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 24 17:14:22.868818 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87c85ac9-9ae4-4c44-96ae-8e7025b689be admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f2ba2e8375b4e8c8792ee1e22b60427', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '00a5583c7b7443e98e7a1d31a0b638dc', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=71939) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 24 17:14:22.869482 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87c85ac9-9ae4-4c44-96ae-8e7025b689be admin admin] REQUEST_METHOD: `POST` {{(pid=71939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 24 17:14:22.869823 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87c85ac9-9ae4-4c44-96ae-8e7025b689be admin admin] SCRIPT_NAME: `/identity` {{(pid=71939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 24 17:14:22.870189 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87c85ac9-9ae4-4c44-96ae-8e7025b689be admin admin] PATH_INFO: `/v3/projects` {{(pid=71939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 24 17:14:22.870924 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87c85ac9-9ae4-4c44-96ae-8e7025b689be admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=71939) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:442}} Nov 24 17:14:22.904905 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87c85ac9-9ae4-4c44-96ae-8e7025b689be admin admin] RBAC: Authorization granted {{(pid=71939) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 24 17:14:22.931085 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: [pid: 71939|app: 0|req: 1517/3021] 10.222.0.53 () {60 vars in 1143 bytes} [Wed Nov 24 17:14:22 2021] POST /identity/v3/projects => generated 383 bytes in 139 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 24 17:14:22.935435 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-553d07a7-1ca2-454e-9ae0-5fd27d269956 None None] Authenticating user token {{(pid=71938) process_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 24 17:14:22.946906 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-553d07a7-1ca2-454e-9ae0-5fd27d269956 None None] Validating token access rules against request {{(pid=71938) validate_allowed_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 24 17:14:23.013019 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3030b9c1-020b-4cf7-b858-c09a786d8fe8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f2ba2e8375b4e8c8792ee1e22b60427', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '00a5583c7b7443e98e7a1d31a0b638dc', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=71938) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 24 17:14:23.013756 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3030b9c1-020b-4cf7-b858-c09a786d8fe8 admin admin] REQUEST_METHOD: `POST` {{(pid=71938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 24 17:14:23.014128 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3030b9c1-020b-4cf7-b858-c09a786d8fe8 admin admin] SCRIPT_NAME: `/identity` {{(pid=71938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 24 17:14:23.014505 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3030b9c1-020b-4cf7-b858-c09a786d8fe8 admin admin] PATH_INFO: `/v3/users` {{(pid=71938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 24 17:14:23.016791 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3030b9c1-020b-4cf7-b858-c09a786d8fe8 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=71938) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:442}} Nov 24 17:14:23.046470 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3030b9c1-020b-4cf7-b858-c09a786d8fe8 admin admin] RBAC: Authorization granted {{(pid=71938) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 24 17:14:23.066796 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: [pid: 71938|app: 0|req: 1505/3022] 10.222.0.53 () {60 vars in 1134 bytes} [Wed Nov 24 17:14:22 2021] POST /identity/v3/users => generated 298 bytes in 132 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 24 17:14:23.071204 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87c85ac9-9ae4-4c44-96ae-8e7025b689be admin admin] Authenticating user token {{(pid=71939) process_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 24 17:14:23.082211 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87c85ac9-9ae4-4c44-96ae-8e7025b689be admin admin] Validating token access rules against request {{(pid=71939) validate_allowed_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 24 17:14:23.086858 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8b6a882-134a-4a46-9a27-59cb327f4f71 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f2ba2e8375b4e8c8792ee1e22b60427', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '00a5583c7b7443e98e7a1d31a0b638dc', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=71939) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 24 17:14:23.087537 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8b6a882-134a-4a46-9a27-59cb327f4f71 admin admin] REQUEST_METHOD: `GET` {{(pid=71939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 24 17:14:23.087878 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8b6a882-134a-4a46-9a27-59cb327f4f71 admin admin] SCRIPT_NAME: `/identity` {{(pid=71939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 24 17:14:23.088211 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8b6a882-134a-4a46-9a27-59cb327f4f71 admin admin] PATH_INFO: `/v3/roles` {{(pid=71939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 24 17:14:23.088994 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8b6a882-134a-4a46-9a27-59cb327f4f71 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=71939) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:442}} Nov 24 17:14:23.116996 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8b6a882-134a-4a46-9a27-59cb327f4f71 admin admin] RBAC: Authorization granted {{(pid=71939) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 24 17:14:23.129172 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: [pid: 71939|app: 0|req: 1518/3023] 10.222.0.53 () {58 vars in 1112 bytes} [Wed Nov 24 17:14:23 2021] GET /identity/v3/roles => generated 1420 bytes in 59 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Nov 24 17:14:23.133669 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3030b9c1-020b-4cf7-b858-c09a786d8fe8 admin admin] Authenticating user token {{(pid=71938) process_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 24 17:14:23.144457 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3030b9c1-020b-4cf7-b858-c09a786d8fe8 admin admin] Validating token access rules against request {{(pid=71938) validate_allowed_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 24 17:14:23.149109 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59cff464-243a-4176-bd93-273297f3390a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f2ba2e8375b4e8c8792ee1e22b60427', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '00a5583c7b7443e98e7a1d31a0b638dc', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=71938) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 24 17:14:23.150038 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59cff464-243a-4176-bd93-273297f3390a admin admin] REQUEST_METHOD: `PUT` {{(pid=71938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 24 17:14:23.150390 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59cff464-243a-4176-bd93-273297f3390a admin admin] SCRIPT_NAME: `/identity` {{(pid=71938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 24 17:14:23.150727 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59cff464-243a-4176-bd93-273297f3390a admin admin] PATH_INFO: `/v3/projects/38d5d7cfd87a4ea69ba3cb27e56bab9d/users/2ead48d6f7ba4ca0bb9701277eab7bb2/roles/5611724e350b41e19921b5961a342582` {{(pid=71938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 24 17:14:23.171433 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59cff464-243a-4176-bd93-273297f3390a admin admin] RBAC: Authorizing `identity:create_grant(project_id=38d5d7cfd87a4ea69ba3cb27e56bab9d, user_id=2ead48d6f7ba4ca0bb9701277eab7bb2, role_id=5611724e350b41e19921b5961a342582)` {{(pid=71938) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:442}} Nov 24 17:14:23.201569 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59cff464-243a-4176-bd93-273297f3390a admin admin] RBAC: Authorization granted {{(pid=71938) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 24 17:14:23.214415 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: [pid: 71938|app: 0|req: 1506/3024] 10.222.0.53 () {60 vars in 1473 bytes} [Wed Nov 24 17:14:23 2021] PUT /identity/v3/projects/38d5d7cfd87a4ea69ba3cb27e56bab9d/users/2ead48d6f7ba4ca0bb9701277eab7bb2/roles/5611724e350b41e19921b5961a342582 => generated 0 bytes in 81 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 24 17:14:23.218687 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8b6a882-134a-4a46-9a27-59cb327f4f71 admin admin] Authenticating user token {{(pid=71939) process_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 24 17:14:23.229647 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8b6a882-134a-4a46-9a27-59cb327f4f71 admin admin] Validating token access rules against request {{(pid=71939) validate_allowed_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 24 17:14:23.299032 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e4997c4-fd0d-43ca-8c0d-515831332eff admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f2ba2e8375b4e8c8792ee1e22b60427', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '00a5583c7b7443e98e7a1d31a0b638dc', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=71939) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 24 17:14:23.299891 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e4997c4-fd0d-43ca-8c0d-515831332eff admin admin] REQUEST_METHOD: `GET` {{(pid=71939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 24 17:14:23.300234 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e4997c4-fd0d-43ca-8c0d-515831332eff admin admin] SCRIPT_NAME: `/identity` {{(pid=71939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 24 17:14:23.300572 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e4997c4-fd0d-43ca-8c0d-515831332eff admin admin] PATH_INFO: `/v3/roles` {{(pid=71939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 24 17:14:23.301363 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e4997c4-fd0d-43ca-8c0d-515831332eff admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=71939) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:442}} Nov 24 17:14:23.330458 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e4997c4-fd0d-43ca-8c0d-515831332eff admin admin] RBAC: Authorization granted {{(pid=71939) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 24 17:14:23.341108 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: [pid: 71939|app: 0|req: 1519/3025] 10.222.0.53 () {58 vars in 1112 bytes} [Wed Nov 24 17:14:23 2021] GET /identity/v3/roles => generated 1420 bytes in 123 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 24 17:14:23.345666 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59cff464-243a-4176-bd93-273297f3390a admin admin] Authenticating user token {{(pid=71938) process_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 24 17:14:23.356223 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59cff464-243a-4176-bd93-273297f3390a admin admin] Validating token access rules against request {{(pid=71938) validate_allowed_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 24 17:14:23.361474 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dce39fd-4bd4-405d-9c9a-9624f547aa16 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f2ba2e8375b4e8c8792ee1e22b60427', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '00a5583c7b7443e98e7a1d31a0b638dc', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=71938) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 24 17:14:23.362409 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dce39fd-4bd4-405d-9c9a-9624f547aa16 admin admin] REQUEST_METHOD: `PUT` {{(pid=71938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 24 17:14:23.362744 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dce39fd-4bd4-405d-9c9a-9624f547aa16 admin admin] SCRIPT_NAME: `/identity` {{(pid=71938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 24 17:14:23.363070 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dce39fd-4bd4-405d-9c9a-9624f547aa16 admin admin] PATH_INFO: `/v3/projects/38d5d7cfd87a4ea69ba3cb27e56bab9d/users/2ead48d6f7ba4ca0bb9701277eab7bb2/roles/5611724e350b41e19921b5961a342582` {{(pid=71938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 24 17:14:23.365029 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1dce39fd-4bd4-405d-9c9a-9624f547aa16 admin admin] RBAC: Authorizing `identity:create_grant(project_id=38d5d7cfd87a4ea69ba3cb27e56bab9d, user_id=2ead48d6f7ba4ca0bb9701277eab7bb2, role_id=5611724e350b41e19921b5961a342582)` {{(pid=71938) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:442}} Nov 24 17:14:23.394729 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1dce39fd-4bd4-405d-9c9a-9624f547aa16 admin admin] RBAC: Authorization granted {{(pid=71938) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 24 17:14:23.405101 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: [pid: 71938|app: 0|req: 1507/3026] 10.222.0.53 () {60 vars in 1473 bytes} [Wed Nov 24 17:14:23 2021] PUT /identity/v3/projects/38d5d7cfd87a4ea69ba3cb27e56bab9d/users/2ead48d6f7ba4ca0bb9701277eab7bb2/roles/5611724e350b41e19921b5961a342582 => generated 0 bytes in 60 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 24 17:14:23.409201 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e4997c4-fd0d-43ca-8c0d-515831332eff admin admin] Authenticating user token {{(pid=71939) process_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 24 17:14:23.419159 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e4997c4-fd0d-43ca-8c0d-515831332eff admin admin] Validating token access rules against request {{(pid=71939) validate_allowed_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 24 17:14:23.486476 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2ec08f1-9d48-4566-866f-7a14553f972c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f2ba2e8375b4e8c8792ee1e22b60427', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '00a5583c7b7443e98e7a1d31a0b638dc', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=71939) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 24 17:14:23.487145 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2ec08f1-9d48-4566-866f-7a14553f972c admin admin] REQUEST_METHOD: `GET` {{(pid=71939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 24 17:14:23.487482 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2ec08f1-9d48-4566-866f-7a14553f972c admin admin] SCRIPT_NAME: `/identity` {{(pid=71939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 24 17:14:23.487812 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2ec08f1-9d48-4566-866f-7a14553f972c admin admin] PATH_INFO: `/v3/roles` {{(pid=71939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 24 17:14:23.488588 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2ec08f1-9d48-4566-866f-7a14553f972c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=71939) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:442}} Nov 24 17:14:23.516754 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2ec08f1-9d48-4566-866f-7a14553f972c admin admin] RBAC: Authorization granted {{(pid=71939) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 24 17:14:23.527301 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: [pid: 71939|app: 0|req: 1520/3027] 10.222.0.53 () {58 vars in 1112 bytes} [Wed Nov 24 17:14:23 2021] GET /identity/v3/roles => generated 1420 bytes in 119 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 24 17:14:23.531754 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dce39fd-4bd4-405d-9c9a-9624f547aa16 admin admin] Authenticating user token {{(pid=71938) process_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 24 17:14:23.542277 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dce39fd-4bd4-405d-9c9a-9624f547aa16 admin admin] Validating token access rules against request {{(pid=71938) validate_allowed_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 24 17:14:23.547394 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d08b0375-f737-4637-9efd-792651d1ea6c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f2ba2e8375b4e8c8792ee1e22b60427', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '00a5583c7b7443e98e7a1d31a0b638dc', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=71938) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 24 17:14:23.548339 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d08b0375-f737-4637-9efd-792651d1ea6c admin admin] REQUEST_METHOD: `PUT` {{(pid=71938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 24 17:14:23.548675 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d08b0375-f737-4637-9efd-792651d1ea6c admin admin] SCRIPT_NAME: `/identity` {{(pid=71938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 24 17:14:23.549007 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d08b0375-f737-4637-9efd-792651d1ea6c admin admin] PATH_INFO: `/v3/projects/38d5d7cfd87a4ea69ba3cb27e56bab9d/users/2ead48d6f7ba4ca0bb9701277eab7bb2/roles/912ab5f10fa5477da74acf239f07604e` {{(pid=71938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 24 17:14:23.551289 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d08b0375-f737-4637-9efd-792651d1ea6c admin admin] RBAC: Authorizing `identity:create_grant(project_id=38d5d7cfd87a4ea69ba3cb27e56bab9d, user_id=2ead48d6f7ba4ca0bb9701277eab7bb2, role_id=912ab5f10fa5477da74acf239f07604e)` {{(pid=71938) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:442}} Nov 24 17:14:23.581349 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d08b0375-f737-4637-9efd-792651d1ea6c admin admin] RBAC: Authorization granted {{(pid=71938) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 24 17:14:23.594921 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: [pid: 71938|app: 0|req: 1508/3028] 10.222.0.53 () {60 vars in 1473 bytes} [Wed Nov 24 17:14:23 2021] PUT /identity/v3/projects/38d5d7cfd87a4ea69ba3cb27e56bab9d/users/2ead48d6f7ba4ca0bb9701277eab7bb2/roles/912ab5f10fa5477da74acf239f07604e => generated 0 bytes in 64 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 24 17:14:23.605531 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-163a65ec-1061-43ac-a774-301fb5fcc109 None None] REQUEST_METHOD: `POST` {{(pid=71939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 24 17:14:23.605884 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-163a65ec-1061-43ac-a774-301fb5fcc109 None None] SCRIPT_NAME: `/identity` {{(pid=71939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 24 17:14:23.606254 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-163a65ec-1061-43ac-a774-301fb5fcc109 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=71939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 24 17:14:23.643981 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.auth.core [None req-163a65ec-1061-43ac-a774-301fb5fcc109 None None] MFA Rules not processed for user `2ead48d6f7ba4ca0bb9701277eab7bb2`. Rule list: `[]` (Enabled: `True`). {{(pid=71939) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:442}} Nov 24 17:14:23.645203 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.fernet_utils [None req-163a65ec-1061-43ac-a774-301fb5fcc109 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=71939) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:289}} Nov 24 17:14:23.724402 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: [pid: 71939|app: 0|req: 1521/3029] 10.222.0.53 () {58 vars in 948 bytes} [Wed Nov 24 17:14:23 2021] POST /identity/v3/auth/tokens => generated 3757 bytes in 120 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 24 17:14:23.735783 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d08b0375-f737-4637-9efd-792651d1ea6c admin admin] Authenticating user token {{(pid=71938) process_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 24 17:14:23.737533 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.fernet_utils [None req-d08b0375-f737-4637-9efd-792651d1ea6c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=71938) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:289}} Nov 24 17:14:23.805060 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d08b0375-f737-4637-9efd-792651d1ea6c admin admin] Validating token access rules against request {{(pid=71938) validate_allowed_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 24 17:14:23.808690 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ce46e13-b85e-48eb-8c9b-0c14723c3eae service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a12374a3093a401a97c343ff0854184d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3b3940d4ae1c4177ae29c02377bb4b0b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=71938) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 24 17:14:23.809350 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ce46e13-b85e-48eb-8c9b-0c14723c3eae service cinder] REQUEST_METHOD: `GET` {{(pid=71938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 24 17:14:23.809692 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ce46e13-b85e-48eb-8c9b-0c14723c3eae service cinder] SCRIPT_NAME: `/identity` {{(pid=71938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 24 17:14:23.810059 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ce46e13-b85e-48eb-8c9b-0c14723c3eae service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=71938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 24 17:14:23.876978 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ce46e13-b85e-48eb-8c9b-0c14723c3eae service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=71938) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:442}} Nov 24 17:14:23.904834 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ce46e13-b85e-48eb-8c9b-0c14723c3eae service cinder] RBAC: Authorization granted {{(pid=71938) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 24 17:14:23.914507 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: [pid: 71938|app: 0|req: 1509/3030] 10.222.0.53 () {60 vars in 1356 bytes} [Wed Nov 24 17:14:23 2021] GET /identity/v3/auth/tokens => generated 3692 bytes in 179 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 24 17:14:25.731965 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-163a65ec-1061-43ac-a774-301fb5fcc109 None None] Authenticating user token {{(pid=71939) process_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 24 17:14:25.733366 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.fernet_utils [None req-163a65ec-1061-43ac-a774-301fb5fcc109 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=71939) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:289}} Nov 24 17:14:25.746911 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-163a65ec-1061-43ac-a774-301fb5fcc109 None None] Validating token access rules against request {{(pid=71939) validate_allowed_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 24 17:14:25.750984 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b885609b-8400-4c83-b75e-2ed6bf7900bb service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a12374a3093a401a97c343ff0854184d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3b3940d4ae1c4177ae29c02377bb4b0b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=71939) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 24 17:14:25.751638 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b885609b-8400-4c83-b75e-2ed6bf7900bb service cinder] REQUEST_METHOD: `GET` {{(pid=71939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 24 17:14:25.751976 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b885609b-8400-4c83-b75e-2ed6bf7900bb service cinder] SCRIPT_NAME: `/identity` {{(pid=71939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 24 17:14:25.752307 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b885609b-8400-4c83-b75e-2ed6bf7900bb service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=71939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 24 17:14:25.824512 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b885609b-8400-4c83-b75e-2ed6bf7900bb service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=71939) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:442}} Nov 24 17:14:25.856848 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b885609b-8400-4c83-b75e-2ed6bf7900bb service cinder] RBAC: Authorization granted {{(pid=71939) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 24 17:14:25.867467 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: [pid: 71939|app: 0|req: 1522/3031] 10.222.0.53 () {60 vars in 1356 bytes} [Wed Nov 24 17:14:25 2021] GET /identity/v3/auth/tokens => generated 3692 bytes in 136 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 24 17:14:26.610508 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ce46e13-b85e-48eb-8c9b-0c14723c3eae service cinder] Authenticating user token {{(pid=71938) process_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 24 17:14:26.620424 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ce46e13-b85e-48eb-8c9b-0c14723c3eae service cinder] Validating token access rules against request {{(pid=71938) validate_allowed_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 24 17:14:26.624735 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ca264a7-4e93-4cac-b0f8-21de432e4b03 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a12374a3093a401a97c343ff0854184d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3b3940d4ae1c4177ae29c02377bb4b0b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=71938) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 24 17:14:26.625394 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ca264a7-4e93-4cac-b0f8-21de432e4b03 service cinder] REQUEST_METHOD: `GET` {{(pid=71938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 24 17:14:26.625738 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ca264a7-4e93-4cac-b0f8-21de432e4b03 service cinder] SCRIPT_NAME: `/identity` {{(pid=71938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 24 17:14:26.626095 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ca264a7-4e93-4cac-b0f8-21de432e4b03 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=71938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 24 17:14:26.636075 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ca264a7-4e93-4cac-b0f8-21de432e4b03 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=71938) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:442}} Nov 24 17:14:26.665004 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ca264a7-4e93-4cac-b0f8-21de432e4b03 service cinder] RBAC: Authorization granted {{(pid=71938) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 24 17:14:26.675665 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: [pid: 71938|app: 0|req: 1510/3032] 10.222.0.53 () {60 vars in 1356 bytes} [Wed Nov 24 17:14:26 2021] GET /identity/v3/auth/tokens => generated 3757 bytes in 66 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 24 17:14:32.314561 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b885609b-8400-4c83-b75e-2ed6bf7900bb service cinder] Authenticating user token {{(pid=71939) process_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 24 17:14:32.386791 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b885609b-8400-4c83-b75e-2ed6bf7900bb service cinder] Validating token access rules against request {{(pid=71939) validate_allowed_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 24 17:14:32.391365 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72286a8f-d070-4f2b-b2d6-5f62e2c00ad7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f2ba2e8375b4e8c8792ee1e22b60427', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '00a5583c7b7443e98e7a1d31a0b638dc', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=71939) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 24 17:14:32.392256 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72286a8f-d070-4f2b-b2d6-5f62e2c00ad7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=71939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 24 17:14:32.392595 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72286a8f-d070-4f2b-b2d6-5f62e2c00ad7 admin admin] SCRIPT_NAME: `/identity` {{(pid=71939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 24 17:14:32.392931 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72286a8f-d070-4f2b-b2d6-5f62e2c00ad7 admin admin] PATH_INFO: `/v3/users/1eb602caae8f46fbb03a5fc346a7b9d3` {{(pid=71939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 24 17:14:32.394177 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72286a8f-d070-4f2b-b2d6-5f62e2c00ad7 admin admin] RBAC: Authorizing `identity:delete_user(user_id=1eb602caae8f46fbb03a5fc346a7b9d3)` {{(pid=71939) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:442}} Nov 24 17:14:32.422930 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72286a8f-d070-4f2b-b2d6-5f62e2c00ad7 admin admin] RBAC: Authorization granted {{(pid=71939) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 24 17:14:32.470319 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.notifications [None req-72286a8f-d070-4f2b-b2d6-5f62e2c00ad7 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '1eb602caae8f46fbb03a5fc346a7b9d3'} {{(pid=71939) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:357}} Nov 24 17:14:32.482420 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.notifications [None req-72286a8f-d070-4f2b-b2d6-5f62e2c00ad7 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '1eb602caae8f46fbb03a5fc346a7b9d3'} {{(pid=71939) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:357}} Nov 24 17:14:32.483114 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.notifications [None req-72286a8f-d070-4f2b-b2d6-5f62e2c00ad7 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '1eb602caae8f46fbb03a5fc346a7b9d3'} {{(pid=71939) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:357}} Nov 24 17:14:32.491793 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.notifications [None req-72286a8f-d070-4f2b-b2d6-5f62e2c00ad7 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '1eb602caae8f46fbb03a5fc346a7b9d3'} {{(pid=71939) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:357}} Nov 24 17:14:32.497635 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.notifications [None req-72286a8f-d070-4f2b-b2d6-5f62e2c00ad7 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '1eb602caae8f46fbb03a5fc346a7b9d3'} {{(pid=71939) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:357}} Nov 24 17:14:32.504476 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: [pid: 71939|app: 0|req: 1523/3033] 10.222.0.53 () {58 vars in 1214 bytes} [Wed Nov 24 17:14:32 2021] DELETE /identity/v3/users/1eb602caae8f46fbb03a5fc346a7b9d3 => generated 0 bytes in 191 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 24 17:14:32.509278 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27c40213-b594-477a-b04f-3e8dac4e99cc None None] REQUEST_METHOD: `POST` {{(pid=71938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 24 17:14:32.509630 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27c40213-b594-477a-b04f-3e8dac4e99cc None None] SCRIPT_NAME: `/identity` {{(pid=71938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 24 17:14:32.509968 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27c40213-b594-477a-b04f-3e8dac4e99cc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=71938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 24 17:14:32.533149 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.auth.core [None req-27c40213-b594-477a-b04f-3e8dac4e99cc None None] MFA Rules not processed for user `0f2ba2e8375b4e8c8792ee1e22b60427`. Rule list: `[]` (Enabled: `True`). {{(pid=71938) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:442}} Nov 24 17:14:32.534422 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.fernet_utils [None req-27c40213-b594-477a-b04f-3e8dac4e99cc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=71938) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:289}} Nov 24 17:14:32.602328 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: [pid: 71938|app: 0|req: 1511/3034] 10.222.0.53 () {58 vars in 948 bytes} [Wed Nov 24 17:14:32 2021] POST /identity/v3/auth/tokens => generated 3669 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 24 17:14:32.613707 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72286a8f-d070-4f2b-b2d6-5f62e2c00ad7 admin admin] Authenticating user token {{(pid=71939) process_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 24 17:14:32.615177 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.fernet_utils [None req-72286a8f-d070-4f2b-b2d6-5f62e2c00ad7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=71939) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:289}} Nov 24 17:14:32.684145 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72286a8f-d070-4f2b-b2d6-5f62e2c00ad7 admin admin] Validating token access rules against request {{(pid=71939) validate_allowed_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 24 17:14:32.687798 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41ba0b70-55b4-4620-8efd-b0c2d3b01948 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c90f21b9cdcb413282461fa83cb6b7a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3b3940d4ae1c4177ae29c02377bb4b0b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=71939) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 24 17:14:32.688448 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41ba0b70-55b4-4620-8efd-b0c2d3b01948 service neutron] REQUEST_METHOD: `GET` {{(pid=71939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 24 17:14:32.688785 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41ba0b70-55b4-4620-8efd-b0c2d3b01948 service neutron] SCRIPT_NAME: `/identity` {{(pid=71939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 24 17:14:32.689112 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41ba0b70-55b4-4620-8efd-b0c2d3b01948 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=71939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 24 17:14:32.698425 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41ba0b70-55b4-4620-8efd-b0c2d3b01948 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=71939) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:442}} Nov 24 17:14:32.726662 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41ba0b70-55b4-4620-8efd-b0c2d3b01948 service neutron] RBAC: Authorization granted {{(pid=71939) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 24 17:14:32.736360 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: [pid: 71939|app: 0|req: 1524/3035] 10.222.0.53 () {60 vars in 1356 bytes} [Wed Nov 24 17:14:32 2021] GET /identity/v3/auth/tokens => generated 3669 bytes in 123 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 24 17:14:33.114842 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27c40213-b594-477a-b04f-3e8dac4e99cc None None] Authenticating user token {{(pid=71938) process_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 24 17:14:33.116737 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.fernet_utils [None req-27c40213-b594-477a-b04f-3e8dac4e99cc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=71938) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:289}} Nov 24 17:14:33.129688 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27c40213-b594-477a-b04f-3e8dac4e99cc None None] Validating token access rules against request {{(pid=71938) validate_allowed_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 24 17:14:33.134950 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11d3f72c-c1cc-4a10-9bc6-31dc7a5bc9fc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f2ba2e8375b4e8c8792ee1e22b60427', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '00a5583c7b7443e98e7a1d31a0b638dc', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=71938) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 24 17:14:33.135951 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11d3f72c-c1cc-4a10-9bc6-31dc7a5bc9fc admin admin] REQUEST_METHOD: `DELETE` {{(pid=71938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 24 17:14:33.136458 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11d3f72c-c1cc-4a10-9bc6-31dc7a5bc9fc admin admin] SCRIPT_NAME: `/identity` {{(pid=71938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 24 17:14:33.136888 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11d3f72c-c1cc-4a10-9bc6-31dc7a5bc9fc admin admin] PATH_INFO: `/v3/projects/6414277403164dcaba6ad4f88baa1d23` {{(pid=71938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 24 17:14:33.138230 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11d3f72c-c1cc-4a10-9bc6-31dc7a5bc9fc admin admin] RBAC: Authorizing `identity:delete_project(project_id=6414277403164dcaba6ad4f88baa1d23)` {{(pid=71938) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:442}} Nov 24 17:14:33.167948 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11d3f72c-c1cc-4a10-9bc6-31dc7a5bc9fc admin admin] RBAC: Authorization granted {{(pid=71938) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 24 17:14:33.224683 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.notifications [None req-11d3f72c-c1cc-4a10-9bc6-31dc7a5bc9fc admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '6414277403164dcaba6ad4f88baa1d23', 'request_id': 'req-11d3f72c-c1cc-4a10-9bc6-31dc7a5bc9fc'} {{(pid=71938) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:357}} Nov 24 17:14:33.236757 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.notifications [None req-11d3f72c-c1cc-4a10-9bc6-31dc7a5bc9fc admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '6414277403164dcaba6ad4f88baa1d23', 'request_id': 'req-11d3f72c-c1cc-4a10-9bc6-31dc7a5bc9fc'} {{(pid=71938) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:357}} Nov 24 17:14:33.242110 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.notifications [None req-11d3f72c-c1cc-4a10-9bc6-31dc7a5bc9fc admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '6414277403164dcaba6ad4f88baa1d23', 'request_id': 'req-11d3f72c-c1cc-4a10-9bc6-31dc7a5bc9fc'} {{(pid=71938) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:357}} Nov 24 17:14:33.253889 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.notifications [None req-11d3f72c-c1cc-4a10-9bc6-31dc7a5bc9fc admin admin] The token cache is being invalidate because project 6414277403164dcaba6ad4f88baa1d23 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=71938) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Nov 24 17:14:33.254181 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.notifications [None req-11d3f72c-c1cc-4a10-9bc6-31dc7a5bc9fc admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=71938) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:357}} Nov 24 17:14:33.254850 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.notifications [None req-11d3f72c-c1cc-4a10-9bc6-31dc7a5bc9fc admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=71938) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:357}} Nov 24 17:14:33.256567 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: [pid: 71938|app: 0|req: 1512/3036] 10.222.0.53 () {58 vars in 1223 bytes} [Wed Nov 24 17:14:33 2021] DELETE /identity/v3/projects/6414277403164dcaba6ad4f88baa1d23 => generated 0 bytes in 142 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 24 17:14:33.260858 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41ba0b70-55b4-4620-8efd-b0c2d3b01948 service neutron] Authenticating user token {{(pid=71939) process_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 24 17:14:33.271478 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41ba0b70-55b4-4620-8efd-b0c2d3b01948 service neutron] Validating token access rules against request {{(pid=71939) validate_allowed_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 24 17:14:33.342230 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff15ddea-18d3-4e89-9cc2-4e74e3fbd56e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f2ba2e8375b4e8c8792ee1e22b60427', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '00a5583c7b7443e98e7a1d31a0b638dc', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=71939) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 24 17:14:33.343821 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff15ddea-18d3-4e89-9cc2-4e74e3fbd56e admin admin] REQUEST_METHOD: `DELETE` {{(pid=71939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 24 17:14:33.344168 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff15ddea-18d3-4e89-9cc2-4e74e3fbd56e admin admin] SCRIPT_NAME: `/identity` {{(pid=71939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 24 17:14:33.344504 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff15ddea-18d3-4e89-9cc2-4e74e3fbd56e admin admin] PATH_INFO: `/v3/users/fe72f3d015b545d89ad307dcfc3693a4` {{(pid=71939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 24 17:14:33.345744 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff15ddea-18d3-4e89-9cc2-4e74e3fbd56e admin admin] RBAC: Authorizing `identity:delete_user(user_id=fe72f3d015b545d89ad307dcfc3693a4)` {{(pid=71939) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:442}} Nov 24 17:14:33.374527 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff15ddea-18d3-4e89-9cc2-4e74e3fbd56e admin admin] RBAC: Authorization granted {{(pid=71939) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 24 17:14:33.423892 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.notifications [None req-ff15ddea-18d3-4e89-9cc2-4e74e3fbd56e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'fe72f3d015b545d89ad307dcfc3693a4'} {{(pid=71939) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:357}} Nov 24 17:14:33.440595 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.notifications [None req-ff15ddea-18d3-4e89-9cc2-4e74e3fbd56e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'fe72f3d015b545d89ad307dcfc3693a4'} {{(pid=71939) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:357}} Nov 24 17:14:33.442057 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.notifications [None req-ff15ddea-18d3-4e89-9cc2-4e74e3fbd56e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'fe72f3d015b545d89ad307dcfc3693a4'} {{(pid=71939) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:357}} Nov 24 17:14:33.451279 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.notifications [None req-ff15ddea-18d3-4e89-9cc2-4e74e3fbd56e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'fe72f3d015b545d89ad307dcfc3693a4'} {{(pid=71939) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:357}} Nov 24 17:14:33.458180 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.notifications [None req-ff15ddea-18d3-4e89-9cc2-4e74e3fbd56e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'fe72f3d015b545d89ad307dcfc3693a4'} {{(pid=71939) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:357}} Nov 24 17:14:33.464755 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: [pid: 71939|app: 0|req: 1525/3037] 10.222.0.53 () {58 vars in 1214 bytes} [Wed Nov 24 17:14:33 2021] DELETE /identity/v3/users/fe72f3d015b545d89ad307dcfc3693a4 => generated 0 bytes in 204 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 24 17:14:33.845493 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11d3f72c-c1cc-4a10-9bc6-31dc7a5bc9fc admin admin] Authenticating user token {{(pid=71938) process_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 24 17:14:33.847028 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.fernet_utils [None req-11d3f72c-c1cc-4a10-9bc6-31dc7a5bc9fc admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=71938) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:289}} Nov 24 17:14:33.860350 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11d3f72c-c1cc-4a10-9bc6-31dc7a5bc9fc admin admin] Validating token access rules against request {{(pid=71938) validate_allowed_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 24 17:14:33.926811 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-373e619d-e011-4ea2-ba8f-841d65903783 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f2ba2e8375b4e8c8792ee1e22b60427', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '00a5583c7b7443e98e7a1d31a0b638dc', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=71938) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 24 17:14:33.927693 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-373e619d-e011-4ea2-ba8f-841d65903783 admin admin] REQUEST_METHOD: `DELETE` {{(pid=71938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 24 17:14:33.928026 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-373e619d-e011-4ea2-ba8f-841d65903783 admin admin] SCRIPT_NAME: `/identity` {{(pid=71938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 24 17:14:33.928352 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-373e619d-e011-4ea2-ba8f-841d65903783 admin admin] PATH_INFO: `/v3/projects/046e2c084a584976934a40a06fd1614d` {{(pid=71938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 24 17:14:33.929563 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-373e619d-e011-4ea2-ba8f-841d65903783 admin admin] RBAC: Authorizing `identity:delete_project(project_id=046e2c084a584976934a40a06fd1614d)` {{(pid=71938) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:442}} Nov 24 17:14:33.958510 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-373e619d-e011-4ea2-ba8f-841d65903783 admin admin] RBAC: Authorization granted {{(pid=71938) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 24 17:14:34.008823 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.notifications [None req-373e619d-e011-4ea2-ba8f-841d65903783 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '046e2c084a584976934a40a06fd1614d', 'request_id': 'req-373e619d-e011-4ea2-ba8f-841d65903783'} {{(pid=71938) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:357}} Nov 24 17:14:34.023488 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.notifications [None req-373e619d-e011-4ea2-ba8f-841d65903783 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '046e2c084a584976934a40a06fd1614d', 'request_id': 'req-373e619d-e011-4ea2-ba8f-841d65903783'} {{(pid=71938) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:357}} Nov 24 17:14:34.030853 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.notifications [None req-373e619d-e011-4ea2-ba8f-841d65903783 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '046e2c084a584976934a40a06fd1614d', 'request_id': 'req-373e619d-e011-4ea2-ba8f-841d65903783'} {{(pid=71938) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:357}} Nov 24 17:14:34.044650 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.notifications [None req-373e619d-e011-4ea2-ba8f-841d65903783 admin admin] The token cache is being invalidate because project 046e2c084a584976934a40a06fd1614d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=71938) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Nov 24 17:14:34.044966 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.notifications [None req-373e619d-e011-4ea2-ba8f-841d65903783 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=71938) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:357}} Nov 24 17:14:34.045633 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.notifications [None req-373e619d-e011-4ea2-ba8f-841d65903783 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=71938) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:357}} Nov 24 17:14:34.047777 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: [pid: 71938|app: 0|req: 1513/3038] 10.222.0.53 () {58 vars in 1223 bytes} [Wed Nov 24 17:14:33 2021] DELETE /identity/v3/projects/046e2c084a584976934a40a06fd1614d => generated 0 bytes in 203 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 24 17:14:34.052375 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff15ddea-18d3-4e89-9cc2-4e74e3fbd56e admin admin] Authenticating user token {{(pid=71939) process_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 24 17:14:34.053842 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.fernet_utils [None req-ff15ddea-18d3-4e89-9cc2-4e74e3fbd56e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=71939) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:289}} Nov 24 17:14:34.067143 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff15ddea-18d3-4e89-9cc2-4e74e3fbd56e admin admin] Validating token access rules against request {{(pid=71939) validate_allowed_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 24 17:14:34.132029 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15265e24-946d-4993-82da-9e58905f7caa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f2ba2e8375b4e8c8792ee1e22b60427', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '00a5583c7b7443e98e7a1d31a0b638dc', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=71939) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 24 17:14:34.132918 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15265e24-946d-4993-82da-9e58905f7caa admin admin] REQUEST_METHOD: `DELETE` {{(pid=71939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 24 17:14:34.133255 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15265e24-946d-4993-82da-9e58905f7caa admin admin] SCRIPT_NAME: `/identity` {{(pid=71939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 24 17:14:34.133586 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15265e24-946d-4993-82da-9e58905f7caa admin admin] PATH_INFO: `/v3/users/2ead48d6f7ba4ca0bb9701277eab7bb2` {{(pid=71939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 24 17:14:34.134809 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15265e24-946d-4993-82da-9e58905f7caa admin admin] RBAC: Authorizing `identity:delete_user(user_id=2ead48d6f7ba4ca0bb9701277eab7bb2)` {{(pid=71939) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:442}} Nov 24 17:14:34.163547 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15265e24-946d-4993-82da-9e58905f7caa admin admin] RBAC: Authorization granted {{(pid=71939) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 24 17:14:34.221272 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.notifications [None req-15265e24-946d-4993-82da-9e58905f7caa admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '2ead48d6f7ba4ca0bb9701277eab7bb2'} {{(pid=71939) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:357}} Nov 24 17:14:34.234051 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.notifications [None req-15265e24-946d-4993-82da-9e58905f7caa admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '2ead48d6f7ba4ca0bb9701277eab7bb2'} {{(pid=71939) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:357}} Nov 24 17:14:34.234749 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.notifications [None req-15265e24-946d-4993-82da-9e58905f7caa admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '2ead48d6f7ba4ca0bb9701277eab7bb2'} {{(pid=71939) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:357}} Nov 24 17:14:34.242785 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.notifications [None req-15265e24-946d-4993-82da-9e58905f7caa admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '2ead48d6f7ba4ca0bb9701277eab7bb2'} {{(pid=71939) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:357}} Nov 24 17:14:34.248735 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.notifications [None req-15265e24-946d-4993-82da-9e58905f7caa admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '2ead48d6f7ba4ca0bb9701277eab7bb2'} {{(pid=71939) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:357}} Nov 24 17:14:34.254961 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: [pid: 71939|app: 0|req: 1526/3039] 10.222.0.53 () {58 vars in 1214 bytes} [Wed Nov 24 17:14:34 2021] DELETE /identity/v3/users/2ead48d6f7ba4ca0bb9701277eab7bb2 => generated 0 bytes in 203 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 24 17:14:34.616369 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-373e619d-e011-4ea2-ba8f-841d65903783 admin admin] Authenticating user token {{(pid=71938) process_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 24 17:14:34.617871 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.fernet_utils [None req-373e619d-e011-4ea2-ba8f-841d65903783 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=71938) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:289}} Nov 24 17:14:34.630432 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-373e619d-e011-4ea2-ba8f-841d65903783 admin admin] Validating token access rules against request {{(pid=71938) validate_allowed_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 24 17:14:34.696501 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1aee35b-8485-4b7e-8556-d8c43a499251 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f2ba2e8375b4e8c8792ee1e22b60427', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '00a5583c7b7443e98e7a1d31a0b638dc', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=71938) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 24 17:14:34.697325 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1aee35b-8485-4b7e-8556-d8c43a499251 admin admin] REQUEST_METHOD: `DELETE` {{(pid=71938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 24 17:14:34.697663 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1aee35b-8485-4b7e-8556-d8c43a499251 admin admin] SCRIPT_NAME: `/identity` {{(pid=71938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 24 17:14:34.697994 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1aee35b-8485-4b7e-8556-d8c43a499251 admin admin] PATH_INFO: `/v3/projects/38d5d7cfd87a4ea69ba3cb27e56bab9d` {{(pid=71938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 24 17:14:34.699263 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1aee35b-8485-4b7e-8556-d8c43a499251 admin admin] RBAC: Authorizing `identity:delete_project(project_id=38d5d7cfd87a4ea69ba3cb27e56bab9d)` {{(pid=71938) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:442}} Nov 24 17:14:34.728732 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1aee35b-8485-4b7e-8556-d8c43a499251 admin admin] RBAC: Authorization granted {{(pid=71938) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 24 17:14:34.783275 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.notifications [None req-e1aee35b-8485-4b7e-8556-d8c43a499251 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '38d5d7cfd87a4ea69ba3cb27e56bab9d', 'request_id': 'req-e1aee35b-8485-4b7e-8556-d8c43a499251'} {{(pid=71938) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:357}} Nov 24 17:14:34.795584 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.notifications [None req-e1aee35b-8485-4b7e-8556-d8c43a499251 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '38d5d7cfd87a4ea69ba3cb27e56bab9d', 'request_id': 'req-e1aee35b-8485-4b7e-8556-d8c43a499251'} {{(pid=71938) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:357}} Nov 24 17:14:34.801391 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.notifications [None req-e1aee35b-8485-4b7e-8556-d8c43a499251 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '38d5d7cfd87a4ea69ba3cb27e56bab9d', 'request_id': 'req-e1aee35b-8485-4b7e-8556-d8c43a499251'} {{(pid=71938) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:357}} Nov 24 17:14:34.813942 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.notifications [None req-e1aee35b-8485-4b7e-8556-d8c43a499251 admin admin] The token cache is being invalidate because project 38d5d7cfd87a4ea69ba3cb27e56bab9d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=71938) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Nov 24 17:14:34.814304 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.notifications [None req-e1aee35b-8485-4b7e-8556-d8c43a499251 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=71938) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:357}} Nov 24 17:14:34.814974 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.notifications [None req-e1aee35b-8485-4b7e-8556-d8c43a499251 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=71938) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:357}} Nov 24 17:14:34.816791 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: [pid: 71938|app: 0|req: 1514/3040] 10.222.0.53 () {58 vars in 1223 bytes} [Wed Nov 24 17:14:34 2021] DELETE /identity/v3/projects/38d5d7cfd87a4ea69ba3cb27e56bab9d => generated 0 bytes in 201 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 24 17:14:34.824177 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e9d11ac-0e1b-457b-8aff-e3fa413818a9 None None] REQUEST_METHOD: `POST` {{(pid=71939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 24 17:14:34.824529 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e9d11ac-0e1b-457b-8aff-e3fa413818a9 None None] SCRIPT_NAME: `/identity` {{(pid=71939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 24 17:14:34.824865 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e9d11ac-0e1b-457b-8aff-e3fa413818a9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=71939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 24 17:14:34.849477 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.auth.core [None req-2e9d11ac-0e1b-457b-8aff-e3fa413818a9 None None] MFA Rules not processed for user `0f2ba2e8375b4e8c8792ee1e22b60427`. Rule list: `[]` (Enabled: `True`). {{(pid=71939) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:442}} Nov 24 17:14:34.850754 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.fernet_utils [None req-2e9d11ac-0e1b-457b-8aff-e3fa413818a9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=71939) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:289}} Nov 24 17:14:34.920013 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: [pid: 71939|app: 0|req: 1527/3041] 10.222.0.53 () {58 vars in 948 bytes} [Wed Nov 24 17:14:34 2021] POST /identity/v3/auth/tokens => generated 3669 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 24 17:14:34.929457 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1b1f6c3-6f0a-445e-8839-0ddadf60d772 None None] REQUEST_METHOD: `POST` {{(pid=71938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 24 17:14:34.929960 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1b1f6c3-6f0a-445e-8839-0ddadf60d772 None None] SCRIPT_NAME: `/identity` {{(pid=71938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 24 17:14:34.930408 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1b1f6c3-6f0a-445e-8839-0ddadf60d772 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=71938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 24 17:14:34.955834 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.auth.core [None req-e1b1f6c3-6f0a-445e-8839-0ddadf60d772 None None] MFA Rules not processed for user `0f2ba2e8375b4e8c8792ee1e22b60427`. Rule list: `[]` (Enabled: `True`). {{(pid=71938) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:442}} Nov 24 17:14:34.956995 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.fernet_utils [None req-e1b1f6c3-6f0a-445e-8839-0ddadf60d772 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=71938) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:289}} Nov 24 17:14:34.964645 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: [pid: 71938|app: 0|req: 1515/3042] 10.222.0.53 () {58 vars in 948 bytes} [Wed Nov 24 17:14:34 2021] POST /identity/v3/auth/tokens => generated 3669 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 24 17:14:34.969418 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e9d11ac-0e1b-457b-8aff-e3fa413818a9 None None] Authenticating user token {{(pid=71939) process_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 24 17:14:34.979655 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e9d11ac-0e1b-457b-8aff-e3fa413818a9 None None] Validating token access rules against request {{(pid=71939) validate_allowed_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 24 17:14:34.984249 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdf04d48-096e-45f9-92b9-997d709934eb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f2ba2e8375b4e8c8792ee1e22b60427', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '00a5583c7b7443e98e7a1d31a0b638dc', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=71939) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 24 17:14:34.984913 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdf04d48-096e-45f9-92b9-997d709934eb admin admin] REQUEST_METHOD: `GET` {{(pid=71939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 24 17:14:34.985256 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdf04d48-096e-45f9-92b9-997d709934eb admin admin] SCRIPT_NAME: `/identity` {{(pid=71939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 24 17:14:34.985629 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdf04d48-096e-45f9-92b9-997d709934eb admin admin] PATH_INFO: `/v3/domains` {{(pid=71939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 24 17:14:34.986599 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdf04d48-096e-45f9-92b9-997d709934eb admin admin] RBAC: Adding query filter params (name=Default) {{(pid=71939) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:161}} Nov 24 17:14:34.986954 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdf04d48-096e-45f9-92b9-997d709934eb admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=71939) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:442}} Nov 24 17:14:35.016876 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdf04d48-096e-45f9-92b9-997d709934eb admin admin] RBAC: Authorization granted {{(pid=71939) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 24 17:14:35.031168 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: [pid: 71939|app: 0|req: 1528/3043] 10.222.0.53 () {58 vars in 1143 bytes} [Wed Nov 24 17:14:34 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 62 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 24 17:14:35.035752 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1b1f6c3-6f0a-445e-8839-0ddadf60d772 None None] Authenticating user token {{(pid=71938) process_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 24 17:14:35.045447 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1b1f6c3-6f0a-445e-8839-0ddadf60d772 None None] Validating token access rules against request {{(pid=71938) validate_allowed_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 24 17:14:35.050493 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d40fae4-1540-4950-9788-1940f839bfc4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f2ba2e8375b4e8c8792ee1e22b60427', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '00a5583c7b7443e98e7a1d31a0b638dc', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=71938) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 24 17:14:35.051163 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d40fae4-1540-4950-9788-1940f839bfc4 admin admin] REQUEST_METHOD: `POST` {{(pid=71938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 24 17:14:35.051548 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d40fae4-1540-4950-9788-1940f839bfc4 admin admin] SCRIPT_NAME: `/identity` {{(pid=71938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 24 17:14:35.051918 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d40fae4-1540-4950-9788-1940f839bfc4 admin admin] PATH_INFO: `/v3/projects` {{(pid=71938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 24 17:14:35.052647 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d40fae4-1540-4950-9788-1940f839bfc4 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=71938) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:442}} Nov 24 17:14:35.082890 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d40fae4-1540-4950-9788-1940f839bfc4 admin admin] RBAC: Authorization granted {{(pid=71938) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 24 17:14:35.112277 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: [pid: 71938|app: 0|req: 1516/3044] 10.222.0.53 () {60 vars in 1143 bytes} [Wed Nov 24 17:14:35 2021] POST /identity/v3/projects => generated 385 bytes in 77 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 24 17:14:35.116671 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdf04d48-096e-45f9-92b9-997d709934eb admin admin] Authenticating user token {{(pid=71939) process_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 24 17:14:35.127746 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdf04d48-096e-45f9-92b9-997d709934eb admin admin] Validating token access rules against request {{(pid=71939) validate_allowed_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 24 17:14:35.194913 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ea4bede-dd13-472b-8293-60244abf66b9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f2ba2e8375b4e8c8792ee1e22b60427', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '00a5583c7b7443e98e7a1d31a0b638dc', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=71939) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 24 17:14:35.195606 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ea4bede-dd13-472b-8293-60244abf66b9 admin admin] REQUEST_METHOD: `POST` {{(pid=71939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 24 17:14:35.195948 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ea4bede-dd13-472b-8293-60244abf66b9 admin admin] SCRIPT_NAME: `/identity` {{(pid=71939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 24 17:14:35.196287 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ea4bede-dd13-472b-8293-60244abf66b9 admin admin] PATH_INFO: `/v3/users` {{(pid=71939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 24 17:14:35.197032 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ea4bede-dd13-472b-8293-60244abf66b9 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=71939) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:442}} Nov 24 17:14:35.226403 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ea4bede-dd13-472b-8293-60244abf66b9 admin admin] RBAC: Authorization granted {{(pid=71939) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 24 17:14:35.245754 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: [pid: 71939|app: 0|req: 1529/3045] 10.222.0.53 () {60 vars in 1134 bytes} [Wed Nov 24 17:14:35 2021] POST /identity/v3/users => generated 293 bytes in 130 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 24 17:14:35.250763 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d40fae4-1540-4950-9788-1940f839bfc4 admin admin] Authenticating user token {{(pid=71938) process_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 24 17:14:35.261274 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d40fae4-1540-4950-9788-1940f839bfc4 admin admin] Validating token access rules against request {{(pid=71938) validate_allowed_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 24 17:14:35.265887 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14aaa2f4-a84a-4590-8d8d-fcde8735bf5a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f2ba2e8375b4e8c8792ee1e22b60427', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '00a5583c7b7443e98e7a1d31a0b638dc', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=71938) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 24 17:14:35.266593 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14aaa2f4-a84a-4590-8d8d-fcde8735bf5a admin admin] REQUEST_METHOD: `GET` {{(pid=71938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 24 17:14:35.266934 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14aaa2f4-a84a-4590-8d8d-fcde8735bf5a admin admin] SCRIPT_NAME: `/identity` {{(pid=71938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 24 17:14:35.267312 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14aaa2f4-a84a-4590-8d8d-fcde8735bf5a admin admin] PATH_INFO: `/v3/roles` {{(pid=71938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 24 17:14:35.268128 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14aaa2f4-a84a-4590-8d8d-fcde8735bf5a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=71938) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:442}} Nov 24 17:14:35.296892 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14aaa2f4-a84a-4590-8d8d-fcde8735bf5a admin admin] RBAC: Authorization granted {{(pid=71938) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 24 17:14:35.308114 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: [pid: 71938|app: 0|req: 1517/3046] 10.222.0.53 () {58 vars in 1112 bytes} [Wed Nov 24 17:14:35 2021] GET /identity/v3/roles => generated 1420 bytes in 58 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Nov 24 17:14:35.313118 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ea4bede-dd13-472b-8293-60244abf66b9 admin admin] Authenticating user token {{(pid=71939) process_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 24 17:14:35.324770 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ea4bede-dd13-472b-8293-60244abf66b9 admin admin] Validating token access rules against request {{(pid=71939) validate_allowed_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 24 17:14:35.330004 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-faf025c2-63f6-49d4-b890-dd52c85f506f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f2ba2e8375b4e8c8792ee1e22b60427', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '00a5583c7b7443e98e7a1d31a0b638dc', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=71939) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 24 17:14:35.330951 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faf025c2-63f6-49d4-b890-dd52c85f506f admin admin] REQUEST_METHOD: `PUT` {{(pid=71939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 24 17:14:35.331292 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faf025c2-63f6-49d4-b890-dd52c85f506f admin admin] SCRIPT_NAME: `/identity` {{(pid=71939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 24 17:14:35.331630 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faf025c2-63f6-49d4-b890-dd52c85f506f admin admin] PATH_INFO: `/v3/projects/d34737322e7d4c859668007012c7bdc6/users/8f0b73c86b8c4821a7f71d00a69791fc/roles/912ab5f10fa5477da74acf239f07604e` {{(pid=71939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 24 17:14:35.358728 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-faf025c2-63f6-49d4-b890-dd52c85f506f admin admin] RBAC: Authorizing `identity:create_grant(project_id=d34737322e7d4c859668007012c7bdc6, user_id=8f0b73c86b8c4821a7f71d00a69791fc, role_id=912ab5f10fa5477da74acf239f07604e)` {{(pid=71939) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:442}} Nov 24 17:14:35.394531 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-faf025c2-63f6-49d4-b890-dd52c85f506f admin admin] RBAC: Authorization granted {{(pid=71939) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 24 17:14:35.407305 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: [pid: 71939|app: 0|req: 1530/3047] 10.222.0.53 () {60 vars in 1473 bytes} [Wed Nov 24 17:14:35 2021] PUT /identity/v3/projects/d34737322e7d4c859668007012c7bdc6/users/8f0b73c86b8c4821a7f71d00a69791fc/roles/912ab5f10fa5477da74acf239f07604e => generated 0 bytes in 95 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 24 17:14:35.418233 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3815df24-74fe-4645-a6d8-a73139f5937b None None] REQUEST_METHOD: `POST` {{(pid=71938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 24 17:14:35.418580 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3815df24-74fe-4645-a6d8-a73139f5937b None None] SCRIPT_NAME: `/identity` {{(pid=71938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 24 17:14:35.418909 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3815df24-74fe-4645-a6d8-a73139f5937b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=71938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 24 17:14:35.457392 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.auth.core [None req-3815df24-74fe-4645-a6d8-a73139f5937b None None] MFA Rules not processed for user `8f0b73c86b8c4821a7f71d00a69791fc`. Rule list: `[]` (Enabled: `True`). {{(pid=71938) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:442}} Nov 24 17:14:35.458621 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.fernet_utils [None req-3815df24-74fe-4645-a6d8-a73139f5937b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=71938) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:289}} Nov 24 17:14:35.534140 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: [pid: 71938|app: 0|req: 1518/3048] 10.222.0.53 () {58 vars in 948 bytes} [Wed Nov 24 17:14:35 2021] POST /identity/v3/auth/tokens => generated 3692 bytes in 117 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 24 17:14:35.544831 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-faf025c2-63f6-49d4-b890-dd52c85f506f admin admin] Authenticating user token {{(pid=71939) process_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 24 17:14:35.547208 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.fernet_utils [None req-faf025c2-63f6-49d4-b890-dd52c85f506f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=71939) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:289}} Nov 24 17:14:35.615026 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-faf025c2-63f6-49d4-b890-dd52c85f506f admin admin] Validating token access rules against request {{(pid=71939) validate_allowed_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 24 17:14:35.618626 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e062badd-abc4-4609-b30b-c756f3923537 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a12374a3093a401a97c343ff0854184d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3b3940d4ae1c4177ae29c02377bb4b0b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=71939) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 24 17:14:35.619278 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e062badd-abc4-4609-b30b-c756f3923537 service cinder] REQUEST_METHOD: `GET` {{(pid=71939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 24 17:14:35.619621 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e062badd-abc4-4609-b30b-c756f3923537 service cinder] SCRIPT_NAME: `/identity` {{(pid=71939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 24 17:14:35.619957 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e062badd-abc4-4609-b30b-c756f3923537 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=71939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 24 17:14:35.629207 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e062badd-abc4-4609-b30b-c756f3923537 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=71939) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:442}} Nov 24 17:14:35.657316 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e062badd-abc4-4609-b30b-c756f3923537 service cinder] RBAC: Authorization granted {{(pid=71939) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 24 17:14:35.666526 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: [pid: 71939|app: 0|req: 1531/3049] 10.222.0.53 () {60 vars in 1356 bytes} [Wed Nov 24 17:14:35 2021] GET /identity/v3/auth/tokens => generated 3692 bytes in 122 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 24 17:14:38.568436 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3815df24-74fe-4645-a6d8-a73139f5937b None None] Authenticating user token {{(pid=71938) process_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 24 17:14:38.641266 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3815df24-74fe-4645-a6d8-a73139f5937b None None] Validating token access rules against request {{(pid=71938) validate_allowed_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 24 17:14:38.645831 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d23f65ff-7559-43dc-bd05-8f5527e20ea3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f2ba2e8375b4e8c8792ee1e22b60427', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '00a5583c7b7443e98e7a1d31a0b638dc', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=71938) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 24 17:14:38.646757 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d23f65ff-7559-43dc-bd05-8f5527e20ea3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=71938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 24 17:14:38.647106 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d23f65ff-7559-43dc-bd05-8f5527e20ea3 admin admin] SCRIPT_NAME: `/identity` {{(pid=71938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 24 17:14:38.647437 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d23f65ff-7559-43dc-bd05-8f5527e20ea3 admin admin] PATH_INFO: `/v3/users/8f0b73c86b8c4821a7f71d00a69791fc` {{(pid=71938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 24 17:14:38.648667 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d23f65ff-7559-43dc-bd05-8f5527e20ea3 admin admin] RBAC: Authorizing `identity:delete_user(user_id=8f0b73c86b8c4821a7f71d00a69791fc)` {{(pid=71938) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:442}} Nov 24 17:14:38.677160 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d23f65ff-7559-43dc-bd05-8f5527e20ea3 admin admin] RBAC: Authorization granted {{(pid=71938) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 24 17:14:38.733374 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.notifications [None req-d23f65ff-7559-43dc-bd05-8f5527e20ea3 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '8f0b73c86b8c4821a7f71d00a69791fc'} {{(pid=71938) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:357}} Nov 24 17:14:38.745813 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.notifications [None req-d23f65ff-7559-43dc-bd05-8f5527e20ea3 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '8f0b73c86b8c4821a7f71d00a69791fc'} {{(pid=71938) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:357}} Nov 24 17:14:38.746576 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.notifications [None req-d23f65ff-7559-43dc-bd05-8f5527e20ea3 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '8f0b73c86b8c4821a7f71d00a69791fc'} {{(pid=71938) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:357}} Nov 24 17:14:38.755330 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.notifications [None req-d23f65ff-7559-43dc-bd05-8f5527e20ea3 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '8f0b73c86b8c4821a7f71d00a69791fc'} {{(pid=71938) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:357}} Nov 24 17:14:38.761562 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.notifications [None req-d23f65ff-7559-43dc-bd05-8f5527e20ea3 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '8f0b73c86b8c4821a7f71d00a69791fc'} {{(pid=71938) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:357}} Nov 24 17:14:38.768488 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: [pid: 71938|app: 0|req: 1519/3050] 10.222.0.53 () {58 vars in 1214 bytes} [Wed Nov 24 17:14:38 2021] DELETE /identity/v3/users/8f0b73c86b8c4821a7f71d00a69791fc => generated 0 bytes in 201 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 24 17:14:38.773480 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a94393f8-f62c-45b9-9964-0d0cd9eadace None None] REQUEST_METHOD: `POST` {{(pid=71939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 24 17:14:38.773824 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a94393f8-f62c-45b9-9964-0d0cd9eadace None None] SCRIPT_NAME: `/identity` {{(pid=71939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 24 17:14:38.774189 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a94393f8-f62c-45b9-9964-0d0cd9eadace None None] PATH_INFO: `/v3/auth/tokens` {{(pid=71939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 24 17:14:38.796969 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.auth.core [None req-a94393f8-f62c-45b9-9964-0d0cd9eadace None None] MFA Rules not processed for user `0f2ba2e8375b4e8c8792ee1e22b60427`. Rule list: `[]` (Enabled: `True`). {{(pid=71939) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:442}} Nov 24 17:14:38.798203 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.fernet_utils [None req-a94393f8-f62c-45b9-9964-0d0cd9eadace None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=71939) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:289}} Nov 24 17:14:38.866242 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: [pid: 71939|app: 0|req: 1532/3051] 10.222.0.53 () {58 vars in 948 bytes} [Wed Nov 24 17:14:38 2021] POST /identity/v3/auth/tokens => generated 3669 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 24 17:14:38.877789 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d23f65ff-7559-43dc-bd05-8f5527e20ea3 admin admin] Authenticating user token {{(pid=71938) process_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 24 17:14:38.879325 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.fernet_utils [None req-d23f65ff-7559-43dc-bd05-8f5527e20ea3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=71938) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:289}} Nov 24 17:14:38.946905 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d23f65ff-7559-43dc-bd05-8f5527e20ea3 admin admin] Validating token access rules against request {{(pid=71938) validate_allowed_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 24 17:14:38.950567 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3356ab45-76df-4901-ad3e-08af71982249 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c90f21b9cdcb413282461fa83cb6b7a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3b3940d4ae1c4177ae29c02377bb4b0b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=71938) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 24 17:14:38.951224 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3356ab45-76df-4901-ad3e-08af71982249 service neutron] REQUEST_METHOD: `GET` {{(pid=71938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 24 17:14:38.951565 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3356ab45-76df-4901-ad3e-08af71982249 service neutron] SCRIPT_NAME: `/identity` {{(pid=71938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 24 17:14:38.952530 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3356ab45-76df-4901-ad3e-08af71982249 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=71938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 24 17:14:38.961939 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3356ab45-76df-4901-ad3e-08af71982249 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=71938) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:442}} Nov 24 17:14:38.990709 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3356ab45-76df-4901-ad3e-08af71982249 service neutron] RBAC: Authorization granted {{(pid=71938) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 24 17:14:39.001626 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: [pid: 71938|app: 0|req: 1520/3052] 10.222.0.53 () {60 vars in 1356 bytes} [Wed Nov 24 17:14:38 2021] GET /identity/v3/auth/tokens => generated 3669 bytes in 124 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 24 17:14:39.364934 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a94393f8-f62c-45b9-9964-0d0cd9eadace None None] Authenticating user token {{(pid=71939) process_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 24 17:14:39.366464 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.fernet_utils [None req-a94393f8-f62c-45b9-9964-0d0cd9eadace None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=71939) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:289}} Nov 24 17:14:39.378342 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a94393f8-f62c-45b9-9964-0d0cd9eadace None None] Validating token access rules against request {{(pid=71939) validate_allowed_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 24 17:14:39.384298 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe30256b-e009-486f-aa23-8bdc101f9ab8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f2ba2e8375b4e8c8792ee1e22b60427', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '00a5583c7b7443e98e7a1d31a0b638dc', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=71939) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 24 17:14:39.385189 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe30256b-e009-486f-aa23-8bdc101f9ab8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=71939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 24 17:14:39.385536 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe30256b-e009-486f-aa23-8bdc101f9ab8 admin admin] SCRIPT_NAME: `/identity` {{(pid=71939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 24 17:14:39.385875 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe30256b-e009-486f-aa23-8bdc101f9ab8 admin admin] PATH_INFO: `/v3/projects/d34737322e7d4c859668007012c7bdc6` {{(pid=71939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 24 17:14:39.387137 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe30256b-e009-486f-aa23-8bdc101f9ab8 admin admin] RBAC: Authorizing `identity:delete_project(project_id=d34737322e7d4c859668007012c7bdc6)` {{(pid=71939) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:442}} Nov 24 17:14:39.415924 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe30256b-e009-486f-aa23-8bdc101f9ab8 admin admin] RBAC: Authorization granted {{(pid=71939) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 24 17:14:39.466776 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.notifications [None req-fe30256b-e009-486f-aa23-8bdc101f9ab8 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd34737322e7d4c859668007012c7bdc6', 'request_id': 'req-fe30256b-e009-486f-aa23-8bdc101f9ab8'} {{(pid=71939) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:357}} Nov 24 17:14:39.479086 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.notifications [None req-fe30256b-e009-486f-aa23-8bdc101f9ab8 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd34737322e7d4c859668007012c7bdc6', 'request_id': 'req-fe30256b-e009-486f-aa23-8bdc101f9ab8'} {{(pid=71939) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:357}} Nov 24 17:14:39.485484 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.notifications [None req-fe30256b-e009-486f-aa23-8bdc101f9ab8 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd34737322e7d4c859668007012c7bdc6', 'request_id': 'req-fe30256b-e009-486f-aa23-8bdc101f9ab8'} {{(pid=71939) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:357}} Nov 24 17:14:39.495807 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.notifications [None req-fe30256b-e009-486f-aa23-8bdc101f9ab8 admin admin] The token cache is being invalidate because project d34737322e7d4c859668007012c7bdc6 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=71939) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Nov 24 17:14:39.496138 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.notifications [None req-fe30256b-e009-486f-aa23-8bdc101f9ab8 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=71939) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:357}} Nov 24 17:14:39.496810 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.notifications [None req-fe30256b-e009-486f-aa23-8bdc101f9ab8 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=71939) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:357}} Nov 24 17:14:39.498397 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: [pid: 71939|app: 0|req: 1533/3053] 10.222.0.53 () {58 vars in 1223 bytes} [Wed Nov 24 17:14:39 2021] DELETE /identity/v3/projects/d34737322e7d4c859668007012c7bdc6 => generated 0 bytes in 134 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 24 17:14:52.791049 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3356ab45-76df-4901-ad3e-08af71982249 service neutron] Authenticating user token {{(pid=71938) process_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 24 17:14:52.800948 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3356ab45-76df-4901-ad3e-08af71982249 service neutron] Validating token access rules against request {{(pid=71938) validate_allowed_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 24 17:14:52.859954 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73479c14-04d1-4f3d-a0b7-e7969465b9e9 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c90f21b9cdcb413282461fa83cb6b7a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3b3940d4ae1c4177ae29c02377bb4b0b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=71938) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 24 17:14:52.860615 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73479c14-04d1-4f3d-a0b7-e7969465b9e9 service neutron] REQUEST_METHOD: `GET` {{(pid=71938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 24 17:14:52.861015 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73479c14-04d1-4f3d-a0b7-e7969465b9e9 service neutron] SCRIPT_NAME: `/identity` {{(pid=71938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 24 17:14:52.861349 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73479c14-04d1-4f3d-a0b7-e7969465b9e9 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=71938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 24 17:14:52.863283 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.fernet_utils [None req-73479c14-04d1-4f3d-a0b7-e7969465b9e9 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=71938) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:289}} Nov 24 17:14:52.934940 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73479c14-04d1-4f3d-a0b7-e7969465b9e9 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=71938) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:442}} Nov 24 17:14:52.963375 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73479c14-04d1-4f3d-a0b7-e7969465b9e9 service neutron] RBAC: Authorization granted {{(pid=71938) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 24 17:14:52.973896 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: [pid: 71938|app: 0|req: 1521/3054] 10.222.0.53 () {60 vars in 1356 bytes} [Wed Nov 24 17:14:52 2021] GET /identity/v3/auth/tokens => generated 3669 bytes in 183 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 24 17:14:53.933278 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe30256b-e009-486f-aa23-8bdc101f9ab8 admin admin] Authenticating user token {{(pid=71939) process_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 24 17:14:53.934800 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.fernet_utils [None req-fe30256b-e009-486f-aa23-8bdc101f9ab8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=71939) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:289}} Nov 24 17:14:53.948542 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe30256b-e009-486f-aa23-8bdc101f9ab8 admin admin] Validating token access rules against request {{(pid=71939) validate_allowed_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 24 17:14:53.953061 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c653adfd-3c5d-4107-a05c-3234b202621d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f2ba2e8375b4e8c8792ee1e22b60427', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '00a5583c7b7443e98e7a1d31a0b638dc', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=71939) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 24 17:14:53.953946 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c653adfd-3c5d-4107-a05c-3234b202621d admin admin] REQUEST_METHOD: `DELETE` {{(pid=71939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 24 17:14:53.954313 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c653adfd-3c5d-4107-a05c-3234b202621d admin admin] SCRIPT_NAME: `/identity` {{(pid=71939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 24 17:14:53.955292 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c653adfd-3c5d-4107-a05c-3234b202621d admin admin] PATH_INFO: `/v3/users/d26062d73eba417cade03161e754914b` {{(pid=71939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 24 17:14:53.974274 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c653adfd-3c5d-4107-a05c-3234b202621d admin admin] RBAC: Authorizing `identity:delete_user(user_id=d26062d73eba417cade03161e754914b)` {{(pid=71939) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:442}} Nov 24 17:14:54.002932 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c653adfd-3c5d-4107-a05c-3234b202621d admin admin] RBAC: Authorization granted {{(pid=71939) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 24 17:14:54.050381 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.notifications [None req-c653adfd-3c5d-4107-a05c-3234b202621d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd26062d73eba417cade03161e754914b'} {{(pid=71939) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:357}} Nov 24 17:14:54.062941 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.notifications [None req-c653adfd-3c5d-4107-a05c-3234b202621d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd26062d73eba417cade03161e754914b'} {{(pid=71939) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:357}} Nov 24 17:14:54.063660 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.notifications [None req-c653adfd-3c5d-4107-a05c-3234b202621d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd26062d73eba417cade03161e754914b'} {{(pid=71939) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:357}} Nov 24 17:14:54.072529 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.notifications [None req-c653adfd-3c5d-4107-a05c-3234b202621d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd26062d73eba417cade03161e754914b'} {{(pid=71939) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:357}} Nov 24 17:14:54.078710 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.notifications [None req-c653adfd-3c5d-4107-a05c-3234b202621d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd26062d73eba417cade03161e754914b'} {{(pid=71939) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:357}} Nov 24 17:14:54.085547 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: [pid: 71939|app: 0|req: 1534/3055] 10.222.0.53 () {58 vars in 1214 bytes} [Wed Nov 24 17:14:53 2021] DELETE /identity/v3/users/d26062d73eba417cade03161e754914b => generated 0 bytes in 153 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 24 17:14:54.304495 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73479c14-04d1-4f3d-a0b7-e7969465b9e9 service neutron] Authenticating user token {{(pid=71938) process_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 24 17:14:54.315534 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73479c14-04d1-4f3d-a0b7-e7969465b9e9 service neutron] Validating token access rules against request {{(pid=71938) validate_allowed_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 24 17:14:54.385237 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0d44d2f-6376-46b3-b2f5-e1a397b4e607 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f2ba2e8375b4e8c8792ee1e22b60427', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '00a5583c7b7443e98e7a1d31a0b638dc', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=71938) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 24 17:14:54.386132 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0d44d2f-6376-46b3-b2f5-e1a397b4e607 admin admin] REQUEST_METHOD: `DELETE` {{(pid=71938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 24 17:14:54.386471 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0d44d2f-6376-46b3-b2f5-e1a397b4e607 admin admin] SCRIPT_NAME: `/identity` {{(pid=71938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 24 17:14:54.386797 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0d44d2f-6376-46b3-b2f5-e1a397b4e607 admin admin] PATH_INFO: `/v3/projects/c81e7a74b5d641a4809c97b8741f3cf7` {{(pid=71938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 24 17:14:54.398681 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0d44d2f-6376-46b3-b2f5-e1a397b4e607 admin admin] RBAC: Authorizing `identity:delete_project(project_id=c81e7a74b5d641a4809c97b8741f3cf7)` {{(pid=71938) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:442}} Nov 24 17:14:54.427731 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0d44d2f-6376-46b3-b2f5-e1a397b4e607 admin admin] RBAC: Authorization granted {{(pid=71938) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 24 17:14:54.478821 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.notifications [None req-c0d44d2f-6376-46b3-b2f5-e1a397b4e607 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c81e7a74b5d641a4809c97b8741f3cf7', 'request_id': 'req-c0d44d2f-6376-46b3-b2f5-e1a397b4e607'} {{(pid=71938) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:357}} Nov 24 17:14:54.490474 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.notifications [None req-c0d44d2f-6376-46b3-b2f5-e1a397b4e607 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c81e7a74b5d641a4809c97b8741f3cf7', 'request_id': 'req-c0d44d2f-6376-46b3-b2f5-e1a397b4e607'} {{(pid=71938) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:357}} Nov 24 17:14:54.495779 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.notifications [None req-c0d44d2f-6376-46b3-b2f5-e1a397b4e607 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c81e7a74b5d641a4809c97b8741f3cf7', 'request_id': 'req-c0d44d2f-6376-46b3-b2f5-e1a397b4e607'} {{(pid=71938) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:357}} Nov 24 17:14:54.506632 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.notifications [None req-c0d44d2f-6376-46b3-b2f5-e1a397b4e607 admin admin] The token cache is being invalidate because project c81e7a74b5d641a4809c97b8741f3cf7 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=71938) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Nov 24 17:14:54.506963 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.notifications [None req-c0d44d2f-6376-46b3-b2f5-e1a397b4e607 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=71938) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:357}} Nov 24 17:14:54.507628 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.notifications [None req-c0d44d2f-6376-46b3-b2f5-e1a397b4e607 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=71938) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:357}} Nov 24 17:14:54.509160 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: [pid: 71938|app: 0|req: 1522/3056] 10.222.0.53 () {58 vars in 1223 bytes} [Wed Nov 24 17:14:54 2021] DELETE /identity/v3/projects/c81e7a74b5d641a4809c97b8741f3cf7 => generated 0 bytes in 205 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 24 17:14:54.515883 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e90e6f4-3b1e-43b8-8b35-cc0d7dfdde98 None None] REQUEST_METHOD: `POST` {{(pid=71939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 24 17:14:54.516230 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e90e6f4-3b1e-43b8-8b35-cc0d7dfdde98 None None] SCRIPT_NAME: `/identity` {{(pid=71939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 24 17:14:54.516566 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e90e6f4-3b1e-43b8-8b35-cc0d7dfdde98 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=71939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 24 17:14:54.540694 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.auth.core [None req-0e90e6f4-3b1e-43b8-8b35-cc0d7dfdde98 None None] MFA Rules not processed for user `0f2ba2e8375b4e8c8792ee1e22b60427`. Rule list: `[]` (Enabled: `True`). {{(pid=71939) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:442}} Nov 24 17:14:54.541920 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.fernet_utils [None req-0e90e6f4-3b1e-43b8-8b35-cc0d7dfdde98 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=71939) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:289}} Nov 24 17:14:54.611616 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: [pid: 71939|app: 0|req: 1535/3057] 10.222.0.53 () {58 vars in 948 bytes} [Wed Nov 24 17:14:54 2021] POST /identity/v3/auth/tokens => generated 3669 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 24 17:14:54.619692 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-613864a4-8965-4a05-ae46-1f1ea9bc5694 None None] REQUEST_METHOD: `POST` {{(pid=71938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 24 17:14:54.620038 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-613864a4-8965-4a05-ae46-1f1ea9bc5694 None None] SCRIPT_NAME: `/identity` {{(pid=71938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 24 17:14:54.620371 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-613864a4-8965-4a05-ae46-1f1ea9bc5694 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=71938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 24 17:14:54.643905 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.auth.core [None req-613864a4-8965-4a05-ae46-1f1ea9bc5694 None None] MFA Rules not processed for user `0f2ba2e8375b4e8c8792ee1e22b60427`. Rule list: `[]` (Enabled: `True`). {{(pid=71938) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:442}} Nov 24 17:14:54.645106 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.fernet_utils [None req-613864a4-8965-4a05-ae46-1f1ea9bc5694 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=71938) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:289}} Nov 24 17:14:54.652565 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: [pid: 71938|app: 0|req: 1523/3058] 10.222.0.53 () {58 vars in 948 bytes} [Wed Nov 24 17:14:54 2021] POST /identity/v3/auth/tokens => generated 3669 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 24 17:14:54.657155 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e90e6f4-3b1e-43b8-8b35-cc0d7dfdde98 None None] Authenticating user token {{(pid=71939) process_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 24 17:14:54.667384 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e90e6f4-3b1e-43b8-8b35-cc0d7dfdde98 None None] Validating token access rules against request {{(pid=71939) validate_allowed_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 24 17:14:54.671966 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09528f26-41d1-466e-8d7f-b0a0385101b2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f2ba2e8375b4e8c8792ee1e22b60427', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '00a5583c7b7443e98e7a1d31a0b638dc', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=71939) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 24 17:14:54.672633 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09528f26-41d1-466e-8d7f-b0a0385101b2 admin admin] REQUEST_METHOD: `GET` {{(pid=71939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 24 17:14:54.672978 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09528f26-41d1-466e-8d7f-b0a0385101b2 admin admin] SCRIPT_NAME: `/identity` {{(pid=71939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 24 17:14:54.673344 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09528f26-41d1-466e-8d7f-b0a0385101b2 admin admin] PATH_INFO: `/v3/domains` {{(pid=71939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 24 17:14:54.674433 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09528f26-41d1-466e-8d7f-b0a0385101b2 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=71939) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:161}} Nov 24 17:14:54.674790 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09528f26-41d1-466e-8d7f-b0a0385101b2 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=71939) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:442}} Nov 24 17:14:54.703096 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09528f26-41d1-466e-8d7f-b0a0385101b2 admin admin] RBAC: Authorization granted {{(pid=71939) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 24 17:14:54.717078 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: [pid: 71939|app: 0|req: 1536/3059] 10.222.0.53 () {58 vars in 1143 bytes} [Wed Nov 24 17:14:54 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 61 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Nov 24 17:14:54.721628 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-613864a4-8965-4a05-ae46-1f1ea9bc5694 None None] Authenticating user token {{(pid=71938) process_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 24 17:14:54.731146 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-613864a4-8965-4a05-ae46-1f1ea9bc5694 None None] Validating token access rules against request {{(pid=71938) validate_allowed_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 24 17:14:54.735739 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e79f8546-af8b-4f64-95e7-c405beffb68c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f2ba2e8375b4e8c8792ee1e22b60427', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '00a5583c7b7443e98e7a1d31a0b638dc', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=71938) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 24 17:14:54.736400 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e79f8546-af8b-4f64-95e7-c405beffb68c admin admin] REQUEST_METHOD: `POST` {{(pid=71938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 24 17:14:54.736743 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e79f8546-af8b-4f64-95e7-c405beffb68c admin admin] SCRIPT_NAME: `/identity` {{(pid=71938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 24 17:14:54.737081 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e79f8546-af8b-4f64-95e7-c405beffb68c admin admin] PATH_INFO: `/v3/projects` {{(pid=71938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 24 17:14:54.737815 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e79f8546-af8b-4f64-95e7-c405beffb68c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=71938) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:442}} Nov 24 17:14:54.766741 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e79f8546-af8b-4f64-95e7-c405beffb68c admin admin] RBAC: Authorization granted {{(pid=71938) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 24 17:14:54.793149 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: [pid: 71938|app: 0|req: 1524/3060] 10.222.0.53 () {60 vars in 1143 bytes} [Wed Nov 24 17:14:54 2021] POST /identity/v3/projects => generated 373 bytes in 72 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 24 17:14:54.797434 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09528f26-41d1-466e-8d7f-b0a0385101b2 admin admin] Authenticating user token {{(pid=71939) process_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 24 17:14:54.807801 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09528f26-41d1-466e-8d7f-b0a0385101b2 admin admin] Validating token access rules against request {{(pid=71939) validate_allowed_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 24 17:14:54.873163 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-817adc9d-b25b-4260-ad18-df1d83aa1b45 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f2ba2e8375b4e8c8792ee1e22b60427', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '00a5583c7b7443e98e7a1d31a0b638dc', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=71939) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 24 17:14:54.873843 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-817adc9d-b25b-4260-ad18-df1d83aa1b45 admin admin] REQUEST_METHOD: `POST` {{(pid=71939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 24 17:14:54.874219 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-817adc9d-b25b-4260-ad18-df1d83aa1b45 admin admin] SCRIPT_NAME: `/identity` {{(pid=71939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 24 17:14:54.874553 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-817adc9d-b25b-4260-ad18-df1d83aa1b45 admin admin] PATH_INFO: `/v3/users` {{(pid=71939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 24 17:14:54.875287 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-817adc9d-b25b-4260-ad18-df1d83aa1b45 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=71939) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:442}} Nov 24 17:14:54.904522 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-817adc9d-b25b-4260-ad18-df1d83aa1b45 admin admin] RBAC: Authorization granted {{(pid=71939) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 24 17:14:54.922981 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: [pid: 71939|app: 0|req: 1537/3061] 10.222.0.53 () {60 vars in 1134 bytes} [Wed Nov 24 17:14:54 2021] POST /identity/v3/users => generated 287 bytes in 126 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 24 17:14:54.927683 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e79f8546-af8b-4f64-95e7-c405beffb68c admin admin] Authenticating user token {{(pid=71938) process_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 24 17:14:54.938361 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e79f8546-af8b-4f64-95e7-c405beffb68c admin admin] Validating token access rules against request {{(pid=71938) validate_allowed_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 24 17:14:54.943504 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a837f8be-58ba-465a-b2a3-2e62d86efa54 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f2ba2e8375b4e8c8792ee1e22b60427', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '00a5583c7b7443e98e7a1d31a0b638dc', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=71938) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 24 17:14:54.944178 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a837f8be-58ba-465a-b2a3-2e62d86efa54 admin admin] REQUEST_METHOD: `GET` {{(pid=71938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 24 17:14:54.944521 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a837f8be-58ba-465a-b2a3-2e62d86efa54 admin admin] SCRIPT_NAME: `/identity` {{(pid=71938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 24 17:14:54.944852 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a837f8be-58ba-465a-b2a3-2e62d86efa54 admin admin] PATH_INFO: `/v3/roles` {{(pid=71938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 24 17:14:54.945663 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a837f8be-58ba-465a-b2a3-2e62d86efa54 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=71938) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:442}} Nov 24 17:14:54.974411 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a837f8be-58ba-465a-b2a3-2e62d86efa54 admin admin] RBAC: Authorization granted {{(pid=71938) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 24 17:14:54.985253 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: [pid: 71938|app: 0|req: 1525/3062] 10.222.0.53 () {58 vars in 1112 bytes} [Wed Nov 24 17:14:54 2021] GET /identity/v3/roles => generated 1420 bytes in 58 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 24 17:14:54.989630 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-817adc9d-b25b-4260-ad18-df1d83aa1b45 admin admin] Authenticating user token {{(pid=71939) process_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 24 17:14:54.999756 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-817adc9d-b25b-4260-ad18-df1d83aa1b45 admin admin] Validating token access rules against request {{(pid=71939) validate_allowed_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 24 17:14:55.004808 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83f66edc-8443-4e56-b908-9fa336686df1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f2ba2e8375b4e8c8792ee1e22b60427', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '00a5583c7b7443e98e7a1d31a0b638dc', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=71939) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 24 17:14:55.005706 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83f66edc-8443-4e56-b908-9fa336686df1 admin admin] REQUEST_METHOD: `PUT` {{(pid=71939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 24 17:14:55.006062 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83f66edc-8443-4e56-b908-9fa336686df1 admin admin] SCRIPT_NAME: `/identity` {{(pid=71939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 24 17:14:55.006434 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83f66edc-8443-4e56-b908-9fa336686df1 admin admin] PATH_INFO: `/v3/projects/691189ee36be416e89930e13e47d818e/users/7d09a55c26594bc59d073b4001551c75/roles/912ab5f10fa5477da74acf239f07604e` {{(pid=71939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 24 17:14:55.027582 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83f66edc-8443-4e56-b908-9fa336686df1 admin admin] RBAC: Authorizing `identity:create_grant(project_id=691189ee36be416e89930e13e47d818e, user_id=7d09a55c26594bc59d073b4001551c75, role_id=912ab5f10fa5477da74acf239f07604e)` {{(pid=71939) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:442}} Nov 24 17:14:55.056639 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83f66edc-8443-4e56-b908-9fa336686df1 admin admin] RBAC: Authorization granted {{(pid=71939) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 24 17:14:55.068836 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: [pid: 71939|app: 0|req: 1538/3063] 10.222.0.53 () {60 vars in 1473 bytes} [Wed Nov 24 17:14:54 2021] PUT /identity/v3/projects/691189ee36be416e89930e13e47d818e/users/7d09a55c26594bc59d073b4001551c75/roles/912ab5f10fa5477da74acf239f07604e => generated 0 bytes in 80 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 24 17:14:55.076308 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65577f57-b207-4ce0-91e9-29e6243daa73 None None] REQUEST_METHOD: `POST` {{(pid=71938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 24 17:14:55.076666 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65577f57-b207-4ce0-91e9-29e6243daa73 None None] SCRIPT_NAME: `/identity` {{(pid=71938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 24 17:14:55.077007 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65577f57-b207-4ce0-91e9-29e6243daa73 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=71938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 24 17:14:55.109744 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.auth.core [None req-65577f57-b207-4ce0-91e9-29e6243daa73 None None] MFA Rules not processed for user `0f2ba2e8375b4e8c8792ee1e22b60427`. Rule list: `[]` (Enabled: `True`). {{(pid=71938) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:442}} Nov 24 17:14:55.112101 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.fernet_utils [None req-65577f57-b207-4ce0-91e9-29e6243daa73 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=71938) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:289}} Nov 24 17:14:55.194121 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: [pid: 71938|app: 0|req: 1526/3064] 10.222.0.53 () {58 vars in 948 bytes} [Wed Nov 24 17:14:55 2021] POST /identity/v3/auth/tokens => generated 3669 bytes in 119 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 24 17:14:55.205427 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83f66edc-8443-4e56-b908-9fa336686df1 admin admin] Authenticating user token {{(pid=71939) process_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 24 17:14:55.207220 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.fernet_utils [None req-83f66edc-8443-4e56-b908-9fa336686df1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=71939) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:289}} Nov 24 17:14:55.274897 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83f66edc-8443-4e56-b908-9fa336686df1 admin admin] Validating token access rules against request {{(pid=71939) validate_allowed_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 24 17:14:55.278524 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ddb55ca-9d66-4a07-9a07-d8f3dcba093c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c90f21b9cdcb413282461fa83cb6b7a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3b3940d4ae1c4177ae29c02377bb4b0b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=71939) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 24 17:14:55.279176 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ddb55ca-9d66-4a07-9a07-d8f3dcba093c service neutron] REQUEST_METHOD: `GET` {{(pid=71939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 24 17:14:55.279518 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ddb55ca-9d66-4a07-9a07-d8f3dcba093c service neutron] SCRIPT_NAME: `/identity` {{(pid=71939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 24 17:14:55.279852 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ddb55ca-9d66-4a07-9a07-d8f3dcba093c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=71939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 24 17:14:55.289355 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ddb55ca-9d66-4a07-9a07-d8f3dcba093c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=71939) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:442}} Nov 24 17:14:55.319368 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ddb55ca-9d66-4a07-9a07-d8f3dcba093c service neutron] RBAC: Authorization granted {{(pid=71939) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 24 17:14:55.329603 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: [pid: 71939|app: 0|req: 1539/3065] 10.222.0.53 () {60 vars in 1356 bytes} [Wed Nov 24 17:14:55 2021] GET /identity/v3/auth/tokens => generated 3669 bytes in 125 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 24 17:15:00.755685 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3bad922-e457-4c63-82d8-f3f2ee233b64 None None] REQUEST_METHOD: `POST` {{(pid=71938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 24 17:15:00.756081 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3bad922-e457-4c63-82d8-f3f2ee233b64 None None] SCRIPT_NAME: `/identity` {{(pid=71938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 24 17:15:00.756545 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3bad922-e457-4c63-82d8-f3f2ee233b64 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=71938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 24 17:15:00.795132 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.auth.core [None req-b3bad922-e457-4c63-82d8-f3f2ee233b64 None None] MFA Rules not processed for user `7d09a55c26594bc59d073b4001551c75`. Rule list: `[]` (Enabled: `True`). {{(pid=71938) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:442}} Nov 24 17:15:00.796379 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.fernet_utils [None req-b3bad922-e457-4c63-82d8-f3f2ee233b64 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=71938) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:289}} Nov 24 17:15:00.877042 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: [pid: 71938|app: 0|req: 1527/3066] 10.222.0.53 () {58 vars in 948 bytes} [Wed Nov 24 17:15:00 2021] POST /identity/v3/auth/tokens => generated 3680 bytes in 123 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 24 17:15:00.881873 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ddb55ca-9d66-4a07-9a07-d8f3dcba093c service neutron] Authenticating user token {{(pid=71939) process_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 24 17:15:00.891877 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ddb55ca-9d66-4a07-9a07-d8f3dcba093c service neutron] Validating token access rules against request {{(pid=71939) validate_allowed_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 24 17:15:00.897255 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f9fc3ff-737d-4add-bd23-44738bb49f54 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f2ba2e8375b4e8c8792ee1e22b60427', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '00a5583c7b7443e98e7a1d31a0b638dc', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=71939) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 24 17:15:00.897926 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f9fc3ff-737d-4add-bd23-44738bb49f54 admin admin] REQUEST_METHOD: `POST` {{(pid=71939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 24 17:15:00.898363 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f9fc3ff-737d-4add-bd23-44738bb49f54 admin admin] SCRIPT_NAME: `/identity` {{(pid=71939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 24 17:15:00.898704 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f9fc3ff-737d-4add-bd23-44738bb49f54 admin admin] PATH_INFO: `/v3/projects` {{(pid=71939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 24 17:15:00.899576 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f9fc3ff-737d-4add-bd23-44738bb49f54 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=71939) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:442}} Nov 24 17:15:00.930767 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f9fc3ff-737d-4add-bd23-44738bb49f54 admin admin] RBAC: Authorization granted {{(pid=71939) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 24 17:15:00.963151 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: [pid: 71939|app: 0|req: 1540/3067] 10.222.0.53 () {60 vars in 1143 bytes} [Wed Nov 24 17:15:00 2021] POST /identity/v3/projects => generated 371 bytes in 79 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 24 17:15:00.964323 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3bad922-e457-4c63-82d8-f3f2ee233b64 None None] Authenticating user token {{(pid=71938) process_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 24 17:15:00.977174 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3bad922-e457-4c63-82d8-f3f2ee233b64 None None] Validating token access rules against request {{(pid=71938) validate_allowed_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 24 17:15:01.044433 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d5079b5-d13c-4e06-813b-b994a06f3703 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f2ba2e8375b4e8c8792ee1e22b60427', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '00a5583c7b7443e98e7a1d31a0b638dc', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=71938) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 24 17:15:01.045170 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d5079b5-d13c-4e06-813b-b994a06f3703 admin admin] REQUEST_METHOD: `POST` {{(pid=71938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 24 17:15:01.045458 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d5079b5-d13c-4e06-813b-b994a06f3703 admin admin] SCRIPT_NAME: `/identity` {{(pid=71938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 24 17:15:01.045793 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d5079b5-d13c-4e06-813b-b994a06f3703 admin admin] PATH_INFO: `/v3/users` {{(pid=71938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 24 17:15:01.046567 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d5079b5-d13c-4e06-813b-b994a06f3703 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=71938) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:442}} Nov 24 17:15:01.075766 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d5079b5-d13c-4e06-813b-b994a06f3703 admin admin] RBAC: Authorization granted {{(pid=71938) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 24 17:15:01.095787 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: [pid: 71938|app: 0|req: 1528/3068] 10.222.0.53 () {60 vars in 1134 bytes} [Wed Nov 24 17:15:00 2021] POST /identity/v3/users => generated 292 bytes in 132 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Nov 24 17:15:01.100184 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f9fc3ff-737d-4add-bd23-44738bb49f54 admin admin] Authenticating user token {{(pid=71939) process_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 24 17:15:01.111080 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f9fc3ff-737d-4add-bd23-44738bb49f54 admin admin] Validating token access rules against request {{(pid=71939) validate_allowed_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 24 17:15:01.115665 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fafd4b6e-0c5f-41ec-b098-6659a3fb0814 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f2ba2e8375b4e8c8792ee1e22b60427', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '00a5583c7b7443e98e7a1d31a0b638dc', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=71939) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 24 17:15:01.116345 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fafd4b6e-0c5f-41ec-b098-6659a3fb0814 admin admin] REQUEST_METHOD: `GET` {{(pid=71939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 24 17:15:01.116687 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fafd4b6e-0c5f-41ec-b098-6659a3fb0814 admin admin] SCRIPT_NAME: `/identity` {{(pid=71939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 24 17:15:01.117022 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fafd4b6e-0c5f-41ec-b098-6659a3fb0814 admin admin] PATH_INFO: `/v3/roles` {{(pid=71939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 24 17:15:01.117832 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fafd4b6e-0c5f-41ec-b098-6659a3fb0814 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=71939) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:442}} Nov 24 17:15:01.146695 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fafd4b6e-0c5f-41ec-b098-6659a3fb0814 admin admin] RBAC: Authorization granted {{(pid=71939) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 24 17:15:01.159465 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: [pid: 71939|app: 0|req: 1541/3069] 10.222.0.53 () {58 vars in 1112 bytes} [Wed Nov 24 17:15:01 2021] GET /identity/v3/roles => generated 1420 bytes in 60 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 24 17:15:01.163867 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d5079b5-d13c-4e06-813b-b994a06f3703 admin admin] Authenticating user token {{(pid=71938) process_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 24 17:15:01.175213 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d5079b5-d13c-4e06-813b-b994a06f3703 admin admin] Validating token access rules against request {{(pid=71938) validate_allowed_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 24 17:15:01.180926 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d6e2d96-b0ea-4352-8f78-e9f0a818242a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f2ba2e8375b4e8c8792ee1e22b60427', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '00a5583c7b7443e98e7a1d31a0b638dc', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=71938) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 24 17:15:01.181857 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d6e2d96-b0ea-4352-8f78-e9f0a818242a admin admin] REQUEST_METHOD: `PUT` {{(pid=71938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 24 17:15:01.182243 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d6e2d96-b0ea-4352-8f78-e9f0a818242a admin admin] SCRIPT_NAME: `/identity` {{(pid=71938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 24 17:15:01.182583 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d6e2d96-b0ea-4352-8f78-e9f0a818242a admin admin] PATH_INFO: `/v3/projects/2bb474cc91854e179ddeec67e5894ba6/users/90ede61d3dac4b7480ab2c3f784539de/roles/5611724e350b41e19921b5961a342582` {{(pid=71938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 24 17:15:01.216662 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d6e2d96-b0ea-4352-8f78-e9f0a818242a admin admin] RBAC: Authorizing `identity:create_grant(project_id=2bb474cc91854e179ddeec67e5894ba6, user_id=90ede61d3dac4b7480ab2c3f784539de, role_id=5611724e350b41e19921b5961a342582)` {{(pid=71938) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:442}} Nov 24 17:15:01.248263 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d6e2d96-b0ea-4352-8f78-e9f0a818242a admin admin] RBAC: Authorization granted {{(pid=71938) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 24 17:15:01.267294 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: [pid: 71938|app: 0|req: 1529/3070] 10.222.0.53 () {60 vars in 1473 bytes} [Wed Nov 24 17:15:01 2021] PUT /identity/v3/projects/2bb474cc91854e179ddeec67e5894ba6/users/90ede61d3dac4b7480ab2c3f784539de/roles/5611724e350b41e19921b5961a342582 => generated 0 bytes in 104 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 24 17:15:01.271659 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fafd4b6e-0c5f-41ec-b098-6659a3fb0814 admin admin] Authenticating user token {{(pid=71939) process_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 24 17:15:01.282245 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fafd4b6e-0c5f-41ec-b098-6659a3fb0814 admin admin] Validating token access rules against request {{(pid=71939) validate_allowed_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 24 17:15:01.354961 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a81792a-b2da-4e83-b3c9-b2b2deed5406 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f2ba2e8375b4e8c8792ee1e22b60427', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '00a5583c7b7443e98e7a1d31a0b638dc', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=71939) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 24 17:15:01.355657 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a81792a-b2da-4e83-b3c9-b2b2deed5406 admin admin] REQUEST_METHOD: `GET` {{(pid=71939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 24 17:15:01.356001 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a81792a-b2da-4e83-b3c9-b2b2deed5406 admin admin] SCRIPT_NAME: `/identity` {{(pid=71939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 24 17:15:01.356335 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a81792a-b2da-4e83-b3c9-b2b2deed5406 admin admin] PATH_INFO: `/v3/roles` {{(pid=71939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 24 17:15:01.357120 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a81792a-b2da-4e83-b3c9-b2b2deed5406 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=71939) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:442}} Nov 24 17:15:01.385569 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a81792a-b2da-4e83-b3c9-b2b2deed5406 admin admin] RBAC: Authorization granted {{(pid=71939) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 24 17:15:01.398314 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: [pid: 71939|app: 0|req: 1542/3071] 10.222.0.53 () {58 vars in 1112 bytes} [Wed Nov 24 17:15:01 2021] GET /identity/v3/roles => generated 1420 bytes in 127 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 24 17:15:01.402868 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d6e2d96-b0ea-4352-8f78-e9f0a818242a admin admin] Authenticating user token {{(pid=71938) process_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 24 17:15:01.414284 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d6e2d96-b0ea-4352-8f78-e9f0a818242a admin admin] Validating token access rules against request {{(pid=71938) validate_allowed_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 24 17:15:01.419037 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d93b864-5f0a-434c-b713-d3a03caf395a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f2ba2e8375b4e8c8792ee1e22b60427', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '00a5583c7b7443e98e7a1d31a0b638dc', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=71938) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 24 17:15:01.419958 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d93b864-5f0a-434c-b713-d3a03caf395a admin admin] REQUEST_METHOD: `PUT` {{(pid=71938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 24 17:15:01.420302 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d93b864-5f0a-434c-b713-d3a03caf395a admin admin] SCRIPT_NAME: `/identity` {{(pid=71938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 24 17:15:01.420634 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d93b864-5f0a-434c-b713-d3a03caf395a admin admin] PATH_INFO: `/v3/projects/2bb474cc91854e179ddeec67e5894ba6/users/90ede61d3dac4b7480ab2c3f784539de/roles/5611724e350b41e19921b5961a342582` {{(pid=71938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 24 17:15:01.422736 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d93b864-5f0a-434c-b713-d3a03caf395a admin admin] RBAC: Authorizing `identity:create_grant(project_id=2bb474cc91854e179ddeec67e5894ba6, user_id=90ede61d3dac4b7480ab2c3f784539de, role_id=5611724e350b41e19921b5961a342582)` {{(pid=71938) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:442}} Nov 24 17:15:01.452766 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d93b864-5f0a-434c-b713-d3a03caf395a admin admin] RBAC: Authorization granted {{(pid=71938) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 24 17:15:01.464702 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: [pid: 71938|app: 0|req: 1530/3072] 10.222.0.53 () {60 vars in 1473 bytes} [Wed Nov 24 17:15:01 2021] PUT /identity/v3/projects/2bb474cc91854e179ddeec67e5894ba6/users/90ede61d3dac4b7480ab2c3f784539de/roles/5611724e350b41e19921b5961a342582 => generated 0 bytes in 62 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 24 17:15:01.468979 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a81792a-b2da-4e83-b3c9-b2b2deed5406 admin admin] Authenticating user token {{(pid=71939) process_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 24 17:15:01.479939 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a81792a-b2da-4e83-b3c9-b2b2deed5406 admin admin] Validating token access rules against request {{(pid=71939) validate_allowed_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 24 17:15:01.549689 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f56964c7-0d65-445b-88ff-e1c41cf708da admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f2ba2e8375b4e8c8792ee1e22b60427', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '00a5583c7b7443e98e7a1d31a0b638dc', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=71939) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 24 17:15:01.550413 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f56964c7-0d65-445b-88ff-e1c41cf708da admin admin] REQUEST_METHOD: `GET` {{(pid=71939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 24 17:15:01.550758 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f56964c7-0d65-445b-88ff-e1c41cf708da admin admin] SCRIPT_NAME: `/identity` {{(pid=71939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 24 17:15:01.551098 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f56964c7-0d65-445b-88ff-e1c41cf708da admin admin] PATH_INFO: `/v3/roles` {{(pid=71939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 24 17:15:01.552059 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f56964c7-0d65-445b-88ff-e1c41cf708da admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=71939) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:442}} Nov 24 17:15:01.582089 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f56964c7-0d65-445b-88ff-e1c41cf708da admin admin] RBAC: Authorization granted {{(pid=71939) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 24 17:15:01.593845 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: [pid: 71939|app: 0|req: 1543/3073] 10.222.0.53 () {58 vars in 1112 bytes} [Wed Nov 24 17:15:01 2021] GET /identity/v3/roles => generated 1420 bytes in 125 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 24 17:15:01.598502 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d93b864-5f0a-434c-b713-d3a03caf395a admin admin] Authenticating user token {{(pid=71938) process_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 24 17:15:01.609386 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d93b864-5f0a-434c-b713-d3a03caf395a admin admin] Validating token access rules against request {{(pid=71938) validate_allowed_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 24 17:15:01.613945 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60e296a4-ab15-4d4d-8439-c63d0ed548e5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f2ba2e8375b4e8c8792ee1e22b60427', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '00a5583c7b7443e98e7a1d31a0b638dc', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=71938) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 24 17:15:01.614905 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60e296a4-ab15-4d4d-8439-c63d0ed548e5 admin admin] REQUEST_METHOD: `PUT` {{(pid=71938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 24 17:15:01.615258 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60e296a4-ab15-4d4d-8439-c63d0ed548e5 admin admin] SCRIPT_NAME: `/identity` {{(pid=71938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 24 17:15:01.615553 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60e296a4-ab15-4d4d-8439-c63d0ed548e5 admin admin] PATH_INFO: `/v3/projects/2bb474cc91854e179ddeec67e5894ba6/users/90ede61d3dac4b7480ab2c3f784539de/roles/912ab5f10fa5477da74acf239f07604e` {{(pid=71938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 24 17:15:01.617541 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60e296a4-ab15-4d4d-8439-c63d0ed548e5 admin admin] RBAC: Authorizing `identity:create_grant(project_id=2bb474cc91854e179ddeec67e5894ba6, user_id=90ede61d3dac4b7480ab2c3f784539de, role_id=912ab5f10fa5477da74acf239f07604e)` {{(pid=71938) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:442}} Nov 24 17:15:01.648014 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60e296a4-ab15-4d4d-8439-c63d0ed548e5 admin admin] RBAC: Authorization granted {{(pid=71938) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 24 17:15:01.662160 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: [pid: 71938|app: 0|req: 1531/3074] 10.222.0.53 () {60 vars in 1473 bytes} [Wed Nov 24 17:15:01 2021] PUT /identity/v3/projects/2bb474cc91854e179ddeec67e5894ba6/users/90ede61d3dac4b7480ab2c3f784539de/roles/912ab5f10fa5477da74acf239f07604e => generated 0 bytes in 64 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 24 17:15:07.290862 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-316f309c-99dc-4658-a020-8f56f8403da1 None None] REQUEST_METHOD: `POST` {{(pid=71939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 24 17:15:07.292011 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-316f309c-99dc-4658-a020-8f56f8403da1 None None] SCRIPT_NAME: `/identity` {{(pid=71939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 24 17:15:07.292358 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-316f309c-99dc-4658-a020-8f56f8403da1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=71939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 24 17:15:07.342405 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.auth.core [None req-316f309c-99dc-4658-a020-8f56f8403da1 None None] MFA Rules not processed for user `90ede61d3dac4b7480ab2c3f784539de`. Rule list: `[]` (Enabled: `True`). {{(pid=71939) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:442}} Nov 24 17:15:07.343703 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.fernet_utils [None req-316f309c-99dc-4658-a020-8f56f8403da1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=71939) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:289}} Nov 24 17:15:07.464231 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: [pid: 71939|app: 0|req: 1544/3075] 10.222.0.53 () {58 vars in 948 bytes} [Wed Nov 24 17:15:07 2021] POST /identity/v3/auth/tokens => generated 3745 bytes in 171 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 24 17:15:07.473175 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60e296a4-ab15-4d4d-8439-c63d0ed548e5 admin admin] Authenticating user token {{(pid=71938) process_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 24 17:15:07.476567 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.fernet_utils [None req-60e296a4-ab15-4d4d-8439-c63d0ed548e5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=71938) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:289}} Nov 24 17:15:07.607579 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60e296a4-ab15-4d4d-8439-c63d0ed548e5 admin admin] Validating token access rules against request {{(pid=71938) validate_allowed_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 24 17:15:07.614701 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e0562e1-abbe-4540-95ea-d70553af4185 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e196802d4d5432482b6d2eabc25f74e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3b3940d4ae1c4177ae29c02377bb4b0b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'service', 'ResellerAdmin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=71938) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 24 17:15:07.615709 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e0562e1-abbe-4540-95ea-d70553af4185 service nova] REQUEST_METHOD: `GET` {{(pid=71938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 24 17:15:07.616274 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e0562e1-abbe-4540-95ea-d70553af4185 service nova] SCRIPT_NAME: `/identity` {{(pid=71938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 24 17:15:07.616824 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e0562e1-abbe-4540-95ea-d70553af4185 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=71938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 24 17:15:07.708418 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e0562e1-abbe-4540-95ea-d70553af4185 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=71938) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:442}} Nov 24 17:15:07.741061 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e0562e1-abbe-4540-95ea-d70553af4185 service nova] RBAC: Authorization granted {{(pid=71938) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 24 17:15:07.752355 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: [pid: 71938|app: 0|req: 1532/3076] 10.222.0.53 () {60 vars in 1356 bytes} [Wed Nov 24 17:15:07 2021] GET /identity/v3/auth/tokens => generated 3680 bytes in 280 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 24 17:15:09.370324 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ced77c2-539c-45cf-82a2-18a03ca0be6e None None] REQUEST_METHOD: `POST` {{(pid=71939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 24 17:15:09.371276 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ced77c2-539c-45cf-82a2-18a03ca0be6e None None] SCRIPT_NAME: `/identity` {{(pid=71939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 24 17:15:09.372149 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ced77c2-539c-45cf-82a2-18a03ca0be6e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=71939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 24 17:15:09.396349 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.auth.core [None req-1ced77c2-539c-45cf-82a2-18a03ca0be6e None None] MFA Rules not processed for user `7d09a55c26594bc59d073b4001551c75`. Rule list: `[]` (Enabled: `True`). {{(pid=71939) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:442}} Nov 24 17:15:09.397881 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.fernet_utils [None req-1ced77c2-539c-45cf-82a2-18a03ca0be6e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=71939) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:289}} Nov 24 17:15:09.404747 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: [pid: 71939|app: 0|req: 1545/3077] 10.222.0.53 () {58 vars in 948 bytes} [Wed Nov 24 17:15:09 2021] POST /identity/v3/auth/tokens => generated 3680 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 24 17:15:25.932398 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e0562e1-abbe-4540-95ea-d70553af4185 service nova] Authenticating user token {{(pid=71938) process_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 24 17:15:25.997467 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e0562e1-abbe-4540-95ea-d70553af4185 service nova] Validating token access rules against request {{(pid=71938) validate_allowed_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 24 17:15:26.001763 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fffe0c6-4ad4-42c4-bf60-dbac90acb56c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c90f21b9cdcb413282461fa83cb6b7a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3b3940d4ae1c4177ae29c02377bb4b0b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=71938) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 24 17:15:26.002466 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fffe0c6-4ad4-42c4-bf60-dbac90acb56c service neutron] REQUEST_METHOD: `GET` {{(pid=71938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 24 17:15:26.002795 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fffe0c6-4ad4-42c4-bf60-dbac90acb56c service neutron] SCRIPT_NAME: `/identity` {{(pid=71938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 24 17:15:26.003131 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fffe0c6-4ad4-42c4-bf60-dbac90acb56c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=71938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 24 17:15:26.004982 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.fernet_utils [None req-9fffe0c6-4ad4-42c4-bf60-dbac90acb56c service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=71938) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:289}} Nov 24 17:15:26.014760 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fffe0c6-4ad4-42c4-bf60-dbac90acb56c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=71938) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:442}} Nov 24 17:15:26.042789 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fffe0c6-4ad4-42c4-bf60-dbac90acb56c service neutron] RBAC: Authorization granted {{(pid=71938) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 24 17:15:26.051902 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: [pid: 71938|app: 0|req: 1533/3078] 10.222.0.53 () {60 vars in 1356 bytes} [Wed Nov 24 17:15:25 2021] GET /identity/v3/auth/tokens => generated 3551 bytes in 120 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 24 17:15:26.691037 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ced77c2-539c-45cf-82a2-18a03ca0be6e None None] Authenticating user token {{(pid=71939) process_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 24 17:15:26.693373 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.fernet_utils [None req-1ced77c2-539c-45cf-82a2-18a03ca0be6e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=71939) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:289}} Nov 24 17:15:26.793356 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ced77c2-539c-45cf-82a2-18a03ca0be6e None None] Validating token access rules against request {{(pid=71939) validate_allowed_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 24 17:15:26.798470 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0345d9b9-9e82-475a-8301-3fbfa42b5552 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a919320c9e2a48d7ba33453b5929d7ee', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3b3940d4ae1c4177ae29c02377bb4b0b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=71939) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 24 17:15:26.799391 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0345d9b9-9e82-475a-8301-3fbfa42b5552 service placement] REQUEST_METHOD: `GET` {{(pid=71939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 24 17:15:26.799731 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0345d9b9-9e82-475a-8301-3fbfa42b5552 service placement] SCRIPT_NAME: `/identity` {{(pid=71939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 24 17:15:26.800066 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0345d9b9-9e82-475a-8301-3fbfa42b5552 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=71939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 24 17:15:26.801895 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.fernet_utils [None req-0345d9b9-9e82-475a-8301-3fbfa42b5552 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=71939) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:289}} Nov 24 17:15:26.813185 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0345d9b9-9e82-475a-8301-3fbfa42b5552 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=71939) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:442}} Nov 24 17:15:26.841879 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0345d9b9-9e82-475a-8301-3fbfa42b5552 service placement] RBAC: Authorization granted {{(pid=71939) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 24 17:15:26.852258 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: [pid: 71939|app: 0|req: 1546/3079] 10.222.0.53 () {60 vars in 1356 bytes} [Wed Nov 24 17:15:26 2021] GET /identity/v3/auth/tokens => generated 3738 bytes in 162 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 24 17:15:26.956723 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fffe0c6-4ad4-42c4-bf60-dbac90acb56c service neutron] Authenticating user token {{(pid=71938) process_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 24 17:15:26.958217 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.fernet_utils [None req-9fffe0c6-4ad4-42c4-bf60-dbac90acb56c service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=71938) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:289}} Nov 24 17:15:26.972576 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fffe0c6-4ad4-42c4-bf60-dbac90acb56c service neutron] Validating token access rules against request {{(pid=71938) validate_allowed_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 24 17:15:26.977546 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-714484b1-4da0-4440-bc86-b6e4260f5f76 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a919320c9e2a48d7ba33453b5929d7ee', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3b3940d4ae1c4177ae29c02377bb4b0b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=71938) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 24 17:15:26.978239 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-714484b1-4da0-4440-bc86-b6e4260f5f76 service placement] REQUEST_METHOD: `GET` {{(pid=71938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 24 17:15:26.978586 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-714484b1-4da0-4440-bc86-b6e4260f5f76 service placement] SCRIPT_NAME: `/identity` {{(pid=71938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 24 17:15:26.978956 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-714484b1-4da0-4440-bc86-b6e4260f5f76 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=71938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 24 17:15:26.980729 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.fernet_utils [None req-714484b1-4da0-4440-bc86-b6e4260f5f76 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=71938) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:289}} Nov 24 17:15:26.991929 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-714484b1-4da0-4440-bc86-b6e4260f5f76 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=71938) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:442}} Nov 24 17:15:27.024077 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-714484b1-4da0-4440-bc86-b6e4260f5f76 service placement] RBAC: Authorization granted {{(pid=71938) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 24 17:15:27.039611 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: [pid: 71938|app: 0|req: 1534/3080] 10.222.0.53 () {60 vars in 1356 bytes} [Wed Nov 24 17:15:26 2021] GET /identity/v3/auth/tokens => generated 3738 bytes in 83 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 24 17:15:34.447953 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0345d9b9-9e82-475a-8301-3fbfa42b5552 service placement] Authenticating user token {{(pid=71939) process_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 24 17:15:34.459161 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0345d9b9-9e82-475a-8301-3fbfa42b5552 service placement] Validating token access rules against request {{(pid=71939) validate_allowed_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 24 17:15:34.464175 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c40517c-1916-43f0-95f9-043c82006c68 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a919320c9e2a48d7ba33453b5929d7ee', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3b3940d4ae1c4177ae29c02377bb4b0b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=71939) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 24 17:15:34.464828 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c40517c-1916-43f0-95f9-043c82006c68 service placement] REQUEST_METHOD: `GET` {{(pid=71939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 24 17:15:34.465171 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c40517c-1916-43f0-95f9-043c82006c68 service placement] SCRIPT_NAME: `/identity` {{(pid=71939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 24 17:15:34.465505 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c40517c-1916-43f0-95f9-043c82006c68 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=71939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 24 17:15:34.467447 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.fernet_utils [None req-2c40517c-1916-43f0-95f9-043c82006c68 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=71939) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:289}} Nov 24 17:15:34.479234 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c40517c-1916-43f0-95f9-043c82006c68 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=71939) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:442}} Nov 24 17:15:34.507940 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c40517c-1916-43f0-95f9-043c82006c68 service placement] RBAC: Authorization granted {{(pid=71939) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 24 17:15:34.517849 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: [pid: 71939|app: 0|req: 1547/3081] 10.222.0.53 () {60 vars in 1356 bytes} [Wed Nov 24 17:15:34 2021] GET /identity/v3/auth/tokens => generated 3738 bytes in 70 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 24 17:15:47.354008 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-714484b1-4da0-4440-bc86-b6e4260f5f76 service placement] Authenticating user token {{(pid=71938) process_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 24 17:15:47.428688 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-714484b1-4da0-4440-bc86-b6e4260f5f76 service placement] Validating token access rules against request {{(pid=71938) validate_allowed_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 24 17:15:47.433145 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5a3adcb-7d34-46f3-a020-1888c6ae819a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f2ba2e8375b4e8c8792ee1e22b60427', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '00a5583c7b7443e98e7a1d31a0b638dc', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=71938) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 24 17:15:47.434056 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5a3adcb-7d34-46f3-a020-1888c6ae819a admin admin] REQUEST_METHOD: `DELETE` {{(pid=71938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 24 17:15:47.434382 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5a3adcb-7d34-46f3-a020-1888c6ae819a admin admin] SCRIPT_NAME: `/identity` {{(pid=71938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 24 17:15:47.434708 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5a3adcb-7d34-46f3-a020-1888c6ae819a admin admin] PATH_INFO: `/v3/users/7d09a55c26594bc59d073b4001551c75` {{(pid=71938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 24 17:15:47.435939 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5a3adcb-7d34-46f3-a020-1888c6ae819a admin admin] RBAC: Authorizing `identity:delete_user(user_id=7d09a55c26594bc59d073b4001551c75)` {{(pid=71938) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:442}} Nov 24 17:15:47.464736 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5a3adcb-7d34-46f3-a020-1888c6ae819a admin admin] RBAC: Authorization granted {{(pid=71938) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 24 17:15:47.512872 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.notifications [None req-a5a3adcb-7d34-46f3-a020-1888c6ae819a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '7d09a55c26594bc59d073b4001551c75'} {{(pid=71938) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:357}} Nov 24 17:15:47.525414 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.notifications [None req-a5a3adcb-7d34-46f3-a020-1888c6ae819a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '7d09a55c26594bc59d073b4001551c75'} {{(pid=71938) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:357}} Nov 24 17:15:47.526149 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.notifications [None req-a5a3adcb-7d34-46f3-a020-1888c6ae819a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '7d09a55c26594bc59d073b4001551c75'} {{(pid=71938) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:357}} Nov 24 17:15:47.534868 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.notifications [None req-a5a3adcb-7d34-46f3-a020-1888c6ae819a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '7d09a55c26594bc59d073b4001551c75'} {{(pid=71938) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:357}} Nov 24 17:15:47.540795 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.notifications [None req-a5a3adcb-7d34-46f3-a020-1888c6ae819a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '7d09a55c26594bc59d073b4001551c75'} {{(pid=71938) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:357}} Nov 24 17:15:47.547548 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: [pid: 71938|app: 0|req: 1535/3082] 10.222.0.53 () {58 vars in 1214 bytes} [Wed Nov 24 17:15:47 2021] DELETE /identity/v3/users/7d09a55c26594bc59d073b4001551c75 => generated 0 bytes in 194 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 24 17:15:47.781835 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c40517c-1916-43f0-95f9-043c82006c68 service placement] Authenticating user token {{(pid=71939) process_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 24 17:15:47.792559 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c40517c-1916-43f0-95f9-043c82006c68 service placement] Validating token access rules against request {{(pid=71939) validate_allowed_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 24 17:15:47.858766 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71102bb5-225c-497c-b01a-9b070159fdc8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f2ba2e8375b4e8c8792ee1e22b60427', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '00a5583c7b7443e98e7a1d31a0b638dc', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=71939) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 24 17:15:47.859684 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71102bb5-225c-497c-b01a-9b070159fdc8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=71939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 24 17:15:47.860017 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71102bb5-225c-497c-b01a-9b070159fdc8 admin admin] SCRIPT_NAME: `/identity` {{(pid=71939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 24 17:15:47.860345 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71102bb5-225c-497c-b01a-9b070159fdc8 admin admin] PATH_INFO: `/v3/projects/691189ee36be416e89930e13e47d818e` {{(pid=71939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 24 17:15:47.861554 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71102bb5-225c-497c-b01a-9b070159fdc8 admin admin] RBAC: Authorizing `identity:delete_project(project_id=691189ee36be416e89930e13e47d818e)` {{(pid=71939) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:442}} Nov 24 17:15:47.889621 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71102bb5-225c-497c-b01a-9b070159fdc8 admin admin] RBAC: Authorization granted {{(pid=71939) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 24 17:15:47.941245 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.notifications [None req-71102bb5-225c-497c-b01a-9b070159fdc8 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '691189ee36be416e89930e13e47d818e', 'request_id': 'req-71102bb5-225c-497c-b01a-9b070159fdc8'} {{(pid=71939) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:357}} Nov 24 17:15:47.953496 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.notifications [None req-71102bb5-225c-497c-b01a-9b070159fdc8 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '691189ee36be416e89930e13e47d818e', 'request_id': 'req-71102bb5-225c-497c-b01a-9b070159fdc8'} {{(pid=71939) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:357}} Nov 24 17:15:47.959421 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.notifications [None req-71102bb5-225c-497c-b01a-9b070159fdc8 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '691189ee36be416e89930e13e47d818e', 'request_id': 'req-71102bb5-225c-497c-b01a-9b070159fdc8'} {{(pid=71939) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:357}} Nov 24 17:15:47.969900 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.notifications [None req-71102bb5-225c-497c-b01a-9b070159fdc8 admin admin] The token cache is being invalidate because project 691189ee36be416e89930e13e47d818e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=71939) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Nov 24 17:15:47.970275 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.notifications [None req-71102bb5-225c-497c-b01a-9b070159fdc8 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=71939) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:357}} Nov 24 17:15:47.970952 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.notifications [None req-71102bb5-225c-497c-b01a-9b070159fdc8 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=71939) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:357}} Nov 24 17:15:47.972491 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: [pid: 71939|app: 0|req: 1548/3083] 10.222.0.53 () {58 vars in 1223 bytes} [Wed Nov 24 17:15:47 2021] DELETE /identity/v3/projects/691189ee36be416e89930e13e47d818e => generated 0 bytes in 192 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 24 17:15:47.976842 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5a3adcb-7d34-46f3-a020-1888c6ae819a admin admin] Authenticating user token {{(pid=71938) process_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 24 17:15:47.978327 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.fernet_utils [None req-a5a3adcb-7d34-46f3-a020-1888c6ae819a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=71938) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:289}} Nov 24 17:15:47.991313 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5a3adcb-7d34-46f3-a020-1888c6ae819a admin admin] Validating token access rules against request {{(pid=71938) validate_allowed_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 24 17:15:48.057107 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32722e09-d464-4b44-bc43-f6fc2a0d1c40 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f2ba2e8375b4e8c8792ee1e22b60427', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '00a5583c7b7443e98e7a1d31a0b638dc', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=71938) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 24 17:15:48.057998 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32722e09-d464-4b44-bc43-f6fc2a0d1c40 admin admin] REQUEST_METHOD: `DELETE` {{(pid=71938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 24 17:15:48.058384 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32722e09-d464-4b44-bc43-f6fc2a0d1c40 admin admin] SCRIPT_NAME: `/identity` {{(pid=71938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 24 17:15:48.058718 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32722e09-d464-4b44-bc43-f6fc2a0d1c40 admin admin] PATH_INFO: `/v3/users/90ede61d3dac4b7480ab2c3f784539de` {{(pid=71938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 24 17:15:48.059950 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32722e09-d464-4b44-bc43-f6fc2a0d1c40 admin admin] RBAC: Authorizing `identity:delete_user(user_id=90ede61d3dac4b7480ab2c3f784539de)` {{(pid=71938) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:442}} Nov 24 17:15:48.089614 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32722e09-d464-4b44-bc43-f6fc2a0d1c40 admin admin] RBAC: Authorization granted {{(pid=71938) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 24 17:15:48.140903 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.notifications [None req-32722e09-d464-4b44-bc43-f6fc2a0d1c40 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '90ede61d3dac4b7480ab2c3f784539de'} {{(pid=71938) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:357}} Nov 24 17:15:48.153065 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.notifications [None req-32722e09-d464-4b44-bc43-f6fc2a0d1c40 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '90ede61d3dac4b7480ab2c3f784539de'} {{(pid=71938) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:357}} Nov 24 17:15:48.153768 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.notifications [None req-32722e09-d464-4b44-bc43-f6fc2a0d1c40 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '90ede61d3dac4b7480ab2c3f784539de'} {{(pid=71938) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:357}} Nov 24 17:15:48.162422 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.notifications [None req-32722e09-d464-4b44-bc43-f6fc2a0d1c40 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '90ede61d3dac4b7480ab2c3f784539de'} {{(pid=71938) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:357}} Nov 24 17:15:48.168401 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.notifications [None req-32722e09-d464-4b44-bc43-f6fc2a0d1c40 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '90ede61d3dac4b7480ab2c3f784539de'} {{(pid=71938) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:357}} Nov 24 17:15:48.175249 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: [pid: 71938|app: 0|req: 1536/3084] 10.222.0.53 () {58 vars in 1214 bytes} [Wed Nov 24 17:15:47 2021] DELETE /identity/v3/users/90ede61d3dac4b7480ab2c3f784539de => generated 0 bytes in 199 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 24 17:15:48.402980 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71102bb5-225c-497c-b01a-9b070159fdc8 admin admin] Authenticating user token {{(pid=71939) process_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 24 17:15:48.404486 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.fernet_utils [None req-71102bb5-225c-497c-b01a-9b070159fdc8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=71939) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:289}} Nov 24 17:15:48.418105 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71102bb5-225c-497c-b01a-9b070159fdc8 admin admin] Validating token access rules against request {{(pid=71939) validate_allowed_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 24 17:15:48.487174 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad12dbb9-8d39-4d45-be88-6a03a6812b1f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f2ba2e8375b4e8c8792ee1e22b60427', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '00a5583c7b7443e98e7a1d31a0b638dc', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=71939) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 24 17:15:48.488043 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad12dbb9-8d39-4d45-be88-6a03a6812b1f admin admin] REQUEST_METHOD: `DELETE` {{(pid=71939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 24 17:15:48.488386 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad12dbb9-8d39-4d45-be88-6a03a6812b1f admin admin] SCRIPT_NAME: `/identity` {{(pid=71939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 24 17:15:48.488722 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad12dbb9-8d39-4d45-be88-6a03a6812b1f admin admin] PATH_INFO: `/v3/projects/2bb474cc91854e179ddeec67e5894ba6` {{(pid=71939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 24 17:15:48.489947 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad12dbb9-8d39-4d45-be88-6a03a6812b1f admin admin] RBAC: Authorizing `identity:delete_project(project_id=2bb474cc91854e179ddeec67e5894ba6)` {{(pid=71939) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:442}} Nov 24 17:15:48.518577 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad12dbb9-8d39-4d45-be88-6a03a6812b1f admin admin] RBAC: Authorization granted {{(pid=71939) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 24 17:15:48.568776 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.notifications [None req-ad12dbb9-8d39-4d45-be88-6a03a6812b1f admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '2bb474cc91854e179ddeec67e5894ba6', 'request_id': 'req-ad12dbb9-8d39-4d45-be88-6a03a6812b1f'} {{(pid=71939) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:357}} Nov 24 17:15:48.580596 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.notifications [None req-ad12dbb9-8d39-4d45-be88-6a03a6812b1f admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '2bb474cc91854e179ddeec67e5894ba6', 'request_id': 'req-ad12dbb9-8d39-4d45-be88-6a03a6812b1f'} {{(pid=71939) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:357}} Nov 24 17:15:48.586513 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.notifications [None req-ad12dbb9-8d39-4d45-be88-6a03a6812b1f admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '2bb474cc91854e179ddeec67e5894ba6', 'request_id': 'req-ad12dbb9-8d39-4d45-be88-6a03a6812b1f'} {{(pid=71939) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:357}} Nov 24 17:15:48.596825 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.notifications [None req-ad12dbb9-8d39-4d45-be88-6a03a6812b1f admin admin] The token cache is being invalidate because project 2bb474cc91854e179ddeec67e5894ba6 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=71939) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Nov 24 17:15:48.597156 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.notifications [None req-ad12dbb9-8d39-4d45-be88-6a03a6812b1f admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=71939) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:357}} Nov 24 17:15:48.597834 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.notifications [None req-ad12dbb9-8d39-4d45-be88-6a03a6812b1f admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=71939) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:357}} Nov 24 17:15:48.599358 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: [pid: 71939|app: 0|req: 1549/3085] 10.222.0.53 () {58 vars in 1223 bytes} [Wed Nov 24 17:15:48 2021] DELETE /identity/v3/projects/2bb474cc91854e179ddeec67e5894ba6 => generated 0 bytes in 197 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 24 17:17:29.925033 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32722e09-d464-4b44-bc43-f6fc2a0d1c40 admin admin] Authenticating user token {{(pid=71938) process_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 24 17:17:29.926558 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.fernet_utils [None req-32722e09-d464-4b44-bc43-f6fc2a0d1c40 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=71938) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:289}} Nov 24 17:17:30.008788 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32722e09-d464-4b44-bc43-f6fc2a0d1c40 admin admin] Validating token access rules against request {{(pid=71938) validate_allowed_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 24 17:17:30.076902 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc826c8b-f728-478d-8344-c49e8ea1aa4a service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a919320c9e2a48d7ba33453b5929d7ee', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3b3940d4ae1c4177ae29c02377bb4b0b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=71938) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 24 17:17:30.077560 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc826c8b-f728-478d-8344-c49e8ea1aa4a service placement] REQUEST_METHOD: `GET` {{(pid=71938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 24 17:17:30.077902 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc826c8b-f728-478d-8344-c49e8ea1aa4a service placement] SCRIPT_NAME: `/identity` {{(pid=71938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 24 17:17:30.078263 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc826c8b-f728-478d-8344-c49e8ea1aa4a service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=71938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 24 17:17:30.080097 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.fernet_utils [None req-cc826c8b-f728-478d-8344-c49e8ea1aa4a service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=71938) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:289}} Nov 24 17:17:30.091643 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc826c8b-f728-478d-8344-c49e8ea1aa4a service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=71938) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:442}} Nov 24 17:17:30.119731 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc826c8b-f728-478d-8344-c49e8ea1aa4a service placement] RBAC: Authorization granted {{(pid=71938) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 24 17:17:30.130309 dv-cinder-818778-2-iscsi devstack@keystone.service[71937]: [pid: 71938|app: 0|req: 1537/3086] 10.222.0.53 () {60 vars in 1356 bytes} [Wed Nov 24 17:17:29 2021] GET /identity/v3/auth/tokens => generated 3738 bytes in 206 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0)